# Envoy AI Gateway vs LiteLLM

**Leader by Vioscale score:** LiteLLM

| Attribute | Envoy AI Gateway | LiteLLM |
|---|---|---|
| **Vioscale score** | 48.7 (28% (low)) | 81 (36% (low)) |
| activity.commits_last_30d | 65 | - |
| adoption.dependent_repos | 0 | - |
| adoption.github_stars | 1,961 | - |
| deployment.options | `{"self_hosted":true}` | `{"cloud":true,"hybrid":true,"on_prem":true,"air_gapped":true,"self_hosted":true}` |
| description.long | Provides routing and traffic management between applications and generative AI services, built on the open source Envoy Gateway. Supports multiple AI provider integrations and OpenAI-compatible APIs. | An open-source AI gateway that provides a centralized control point for managing multiple large language models from different providers. It offers virtual key management, spend tracking, budget controls, and intelligent request routing without charging per token. |
| features.capabilities | - | `{"open_source":true,"pricing_model":"open-source-self-host","rate_limiting":true,"deployment_model":"self-hosted","routing_strategy":"cost-based","architecture_model":"open_source_proxy","automatic_failover":true,"budget_spend_controls":true,"guardrails_moderation":"built-in","openai_compatible_api":true,"virtual_key_management":true,"request_cost_observability":true,"bring_your_own_keys_byok_routing":true,"mit_or_apache_permissive_oss_license":true,"custom_rate_limiting_by_user_or_tenant_id":true,"universal_api_key_for_100_plus_llm_providers":true,"auto_fallback_routing_on_rate_limit_or_downtime":true,"organization_wide_cost_tracking_and_chargebacks":true}` |
| integrations.count | 18 | 140 |
| integrations.list | `[{"name":"OpenAI"},{"name":"AWS Bedrock"},{"name":"Azure OpenAI"},{"name":"Google Vertex AI"},{"name":"Google Gemini"},{"name":"Anthropic"},{"name":"Groq"},{"name":"Together AI"},{"name":"Mistral"},{"name":"Cohere"},{"name":"DeepInfra"},{"name":"DeepSeek"},{"name":"Hunyuan"},{"name":"Tencent LLM Knowledge Engine"},{"name":"SambaNova"},{"name":"Grok"},{"name":"OIDC"},{"name":"cert-manager"}]` | `[{"name":"OpenAI"},{"name":"Anthropic"},{"name":"Azure"},{"name":"AWS Bedrock"},{"name":"Cloudflare"},{"name":"Google VertexAI"},{"name":"Meta Llama"},{"name":"Mistral AI"},{"name":"NLP Cloud"},{"name":"OVHCloud"},{"name":"vLLM"},{"name":"Nvidia NIM"},{"name":"Slack"},{"name":"Discord"},{"name":"Microsoft Teams"},{"name":"PagerDuty"},{"name":"Prometheus"},{"name":"AWS Secrets Manager"},{"name":"Google Cloud Secret Manager"},{"name":"MCP servers"},{"name":"Gemini"},{"name":"Bedrock"},{"name":"VertexAI"},{"name":"Langfuse"},{"name":"Langsmith"},{"name":"Datadog"},{"name":"Email"},{"name":"Webhook"},{"name":"S3"},{"name":"Google Cloud Storage"},{"name":"Azure Data Lake"},{"name":"GCP Secret Manager"}]` |
| language.primary | Go | - |
| license.spdx | Apache-2.0 | - |
| market.availability | - | `{"primaryMarkets":[],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` |
| platform.support | `{"cli":true}` | `{"cli":true,"web":true}` |
| pricing | `{"type":"open_source","freeTier":true,"sourceUrl":"https://aigateway.envoyproxy.io","retrievedAt":"2026-08-19T13:42:04.915Z"}` | `{"type":"hybrid","plans":[{"free":true,"name":"Open Source","summary":"Free forever, self-hosted","features":["100+ LLM providers","Virtual keys, users & teams","Spend tracking","Prometheus metrics","Logging and alerting","Admin UI","Guardrails","Load balancing"],"components":[{"kind":"fixed","amount":0,"period":"month","currency":"USD"}],"description":"MIT-licensed, self-hosted gateway","contactSales":false,"includedLimits":{"providers":"100+","deployment":"self-hosted"}},{"free":false,"name":"Enterprise","summary":"Priced annually based on gateway request capacity and deployment architecture","features":["Everything in Open Source, plus:","SSO + SCIM provisioning","OIDC / JWT authentication","Audit logs on every request","Secret manager integration","Key rotation","Organization & team administration","Multi-region control plane","24/7 support & SLAs","Dedicated support & onboarding","Volume discount tiers","Air-gapped deployment available"],"commitment":"annual","description":"Production deployment with governance, security, and professional support","contactSales":true,"includedLimits":{"deployment":"self-hosted or air-gapped"}}],"summary":"Free open-source tier. Enterprise pricing based on annual request volume, not per-token.","currency":"USD","freeTier":true,"sourceUrl":"https://www.litellm.ai/pricing","retrievedAt":"2026-08-19T13:43:01.911Z","freeTrialDays":30,"billingPeriods":["year"]}` |
| pricing.free_tier | yes | yes |
| pricing.model | commercial | freemium |
| pricing.price_level | free | low |
| pricing.transparent | - | yes |
| release.cadence_days | 11 | - |
| release.history | `[{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v1.1.0","date":"2026-08-21T18:23:16Z","type":"stable","version":"v1.1.0"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v1.0.0","date":"2026-06-23T15:32:39Z","type":"stable","version":"v1.0.0"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v1.0.0-rc1","date":"2026-06-23T02:37:10Z","type":"prerelease","version":"v1.0.0-rc1"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.7.0","date":"2026-06-06T20:59:58Z","type":"stable","version":"v0.7.0"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.6.0","date":"2026-05-05T20:43:06Z","type":"stable","version":"v0.6.0"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.6.0-rc1","date":"2026-04-30T21:12:21Z","type":"prerelease","version":"v0.6.0-rc1"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.5.0","date":"2026-01-23T21:17:55Z","type":"stable","version":"v0.5.0"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.5.0-rc1","date":"2026-01-12T19:47:59Z","type":"prerelease","version":"v0.5.0-rc1"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.4.0","date":"2025-11-08T00:55:51Z","type":"stable","version":"v0.4.0"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.4.0-rc2","date":"2025-11-07T22:42:47Z","type":"prerelease","version":"v0.4.0-rc2"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.4.0-rc1","date":"2025-11-05T21:31:00Z","type":"prerelease","version":"v0.4.0-rc1"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.3.0","date":"2025-08-21T10:28:43Z","type":"stable","version":"v0.3.0"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.3.0-rc2","date":"2025-08-21T10:01:37Z","type":"prerelease","version":"v0.3.0-rc2"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.3.0-rc1","date":"2025-08-15T04:15:29Z","type":"prerelease","version":"v0.3.0-rc1"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.2.1","date":"2025-06-10T04:01:45Z","type":"stable","version":"v0.2.1"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.2.0","date":"2025-06-05T21:20:28Z","type":"stable","version":"v0.2.0"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.2.0-rc3","date":"2025-06-05T21:12:25Z","type":"prerelease","version":"v0.2.0-rc3"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.2.0-rc1","date":"2025-06-02T22:27:40Z","type":"prerelease","version":"v0.2.0-rc1"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.1.5","date":"2025-07-04T17:22:33Z","type":"stable","version":"v0.1.5"},{"url":"https://github.com/envoyproxy/ai-gateway/releases/tag/v0.1.4","date":"2025-03-20T20:37:28Z","type":"stable","version":"v0.1.4"}]` | - |
| security.vulnerabilities | `{"count":1,"source":"https://advisories.ecosyste.ms/api/v1/advisories?ecosystem=go&package_name=github.com%2Fenvoyproxy%2Fai-gateway&per_page=100","last_12m":1,"max_severity":"MODERATE"}` | - |

## Capabilities (Llm Gateways)

| Capability | Envoy AI Gateway | LiteLLM |
|---|:--:|:--:|
| **Capabilities** |  |  |
| Openai compatible API | - | ✓ |
| Automatic failover | - | ✓ |
| Routing strategy | - | Cost based |
| Caching | - | - |
| Virtual key management | - | ✓ |
| Budget spend controls | - | ✓ |
| Rate limiting | - | ✓ |
| Guardrails moderation | - | Built in |
| Request cost observability | - | ✓ |
| Streaming support | - | - |
| Deployment model | - | Self hosted |
| Open source | - | ✓ |
| Pricing model | - | Open source self host |

*Source: Vioscale. Generated 2026-09-01T17:07:24.125Z. "-" = undocumented, not absent.*