Understand this story
On October 27, 2026, Perplexity released a practical guide to LLM gateways, explaining how this middleware layer routes, authenticates, caches, and logs model calls, and distinguishing four forms: API gateways, LLM gateways, MCP gateways, and AI gateways. The guide breaks down the mechanism through a six-step request lifecycle, while warning that gateways concentrate credentials from various vendors, and cites the LiteLLM gateway intrusion incident disclosed by Microsoft and two high-severity vulnerabilities, CVE-2026-35029 and CVE-2026-59823, reported by Check Point (already fixed in LiteLLM 1.83.9). The article also lists post-incident reviews of Cloudflare AI Gateway and OpenRouter, four deployment paths, and paid plans starting at about $50 per month. The guide is currently reported by Unite.AI, with no further developments yet.
AI-generated from public reports
Latest development · Report
Perplexity Publishes LLM Gateway Best Practices Guide, Outlining Request Flow and Production RisksDevelopments
1 confirmed developments
- Source:Unite.AI
Reports and discussion timeline
Browse reports and discussion by time. Their evidence levels remain distinct.
Oct 28
Unite.AI
Perplexity Publishes LLM Gateway Best Practices Guide, Outlining Request Flow and Production Risks
On October 27, 2026, Perplexity published an LLM gateway best practices guide explaining how this middleware layer routes, authenticates, caches, and logs model calls, and distinguishing four categories: API gateways, LLM gateways, MCP gateways, and AI gateways. The guide breaks down the mechanism through a six-step request lifecycle, while warning that the gateway centralizes credentials from various providers, and cites the LiteLLM gateway breach disclosed by Microsoft and two high-severity vulnerabilities, CVE-2026-35029 and CVE-2026-59823, reported by Check Point (already fixed in LiteLLM 1.83.9). The article also lists postmortems of Cloudflare AI Gateway and OpenRouter outages, four deployment paths, and paid plans starting at about $50 per month.