# Envoy AI Gateway vs Not Diamond

| Attribute | Envoy AI Gateway | Not Diamond |
|---|---|---|
| **vioscaleAI score** | 59.3 (54% (medium)) | 62.1 (60% (medium)) |
| activity.commits_last_30d | 68 | - |
| adoption.dependent_repos | 0 | - |
| adoption.github_stars | 2,229 | - |
| content.faq | `[{"answer":"Provides routing and traffic management between applications and generative AI services, built on the open source Envoy Gateway. Supports multiple AI provider integrations and OpenAI-compatible APIs. It is indexed under Llm Gateways.","source":"https://aigateway.envoyproxy.io","question":"What is Envoy AI Gateway?","confidence":0.6},{"answer":"Envoy AI Gateway is open source, so it can be self-hosted and used at no licence cost. It is released under the Apache-2.0 licence. Pricing changes often, so verify at source before relying on it.","source":"https://aigateway.envoyproxy.io","question":"Is Envoy AI Gateway free to use?","confidence":0.6},{"answer":"Envoy AI Gateway supports a command-line interface. Platforms we have not confirmed are simply not listed here rather than ruled out.","source":"https://aigateway.envoyproxy.io","question":"What platforms does Envoy AI Gateway support?","confidence":0.6},{"answer":"Yes. Envoy AI Gateway can be deployed self-hosted, so it does not have to run on the vendor's infrastructure.","source":"https://aigateway.envoyproxy.io","question":"Can Envoy AI Gateway be self-hosted?","confidence":0.6},{"answer":"We have confirmed 17 integrations for Envoy AI Gateway, including OpenAI, AWS Bedrock, Google Vertex AI, Google Gemini, Anthropic, Groq, Together AI and Mistral, plus 9 more. This is what we could verify from public sources, so the vendor may support others we have not indexed.","source":"https://aigateway.envoyproxy.io","question":"What does Envoy AI Gateway integrate with?","confidence":0.6},{"answer":"Yes. Envoy AI Gateway is published under the Apache-2.0 licence, a permissive licence that generally allows commercial use and modification. Licence terms can change between releases, so verify against the repository for the version you intend to use.","source":"https://github.com/envoyproxy/ai-gateway","question":"Is Envoy AI Gateway open source?","confidence":0.95}]` | - |
| deployment.options | `{"cloud":true,"hybrid":true,"on_prem":true,"self_hosted":true}` | `{"cloud":true}` |
| description.long | An open-source gateway built on Envoy that centralizes AI traffic management by forwarding OpenAI-compatible requests to various LLM providers with automatic failover, token-based rate limiting, and Kubernetes-native deployment. | A model routing service for coding agents that uses machine learning to predict and recommend the most cost-effective and accurate AI model for each request. Engineering teams typically achieve 20-40% cost savings without quality degradation through continuous learning from real usage patterns. |
| features.capabilities | `{"caching":"semantic","open_source":true,"pricing_model":"open-source-self-host","rate_limiting":true,"deployment_model":"self-hosted","routing_strategy":"custom","streaming_support":true,"automatic_failover":true,"budget_spend_controls":true,"openai_compatible_api":true,"virtual_key_management":true,"request_cost_observability":true}` | `{"pricing_model":"usage-based-saas","deployment_model":"managed-SaaS","routing_strategy":"custom","request_cost_observability":true}` |
| integrations.count | 16 | - |
| integrations.list | `[{"name":"OpenAI"},{"name":"AWS Bedrock"},{"name":"Azure OpenAI"},{"name":"Google Vertex AI"},{"name":"Google Gemini"},{"name":"Anthropic"},{"name":"Groq"},{"name":"Together AI"},{"name":"Mistral"},{"name":"Cohere"},{"name":"DeepInfra"},{"name":"DeepSeek"},{"name":"Hunyuan"},{"name":"Tencent LLM Knowledge Engine"},{"name":"SambaNova"},{"name":"Grok"},{"name":"OIDC"},{"name":"cert-manager"},{"name":"GCP Vertex AI","native":true},{"name":"Gemini","native":true},{"name":"vLLM","native":true},{"name":"MCP","native":true},{"name":"Kubernetes","native":true},{"name":"AWS STS","native":true,"category":"auth"},{"name":"Entra ID","native":true,"category":"auth"},{"name":"Google STS","native":true,"category":"auth"},{"name":"Google Vertex"},{"name":"Model Context Protocol","category":"tools","direction":"bidirectional"}]` | - |
| language.primary | Go | - |
| license.spdx | Apache-2.0 | - |
| market.availability | - | `{"primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` |
| platform.support | `{"cli":true}` | - |
| pricing | `{"type":"open_source","summary":"Open-source. Commercial managed hosting and enterprise self-hosted options available.","freeTier":true,"sourceUrl":"https://aigateway.envoyproxy.io","retrievedAt":"2026-10-15T21:05:53.824Z"}` | `{"type":"usage","plans":[{"free":false,"name":"Pay-as-you-go","summary":"$0.05 per million tokens routed","features":["Multi-harness support","Multi-provider support","Savings and usage dashboard","Continuous learning from harness usage"],"components":[{"per":{"qty":1,"unit":"million tokens"},"kind":"metered","amount":0.05,"currency":"USD"}],"description":"For developers and small teams","contactSales":false},{"free":false,"name":"Enterprise","summary":"Custom pricing","features":["Volume-based discounts","Organization-wide analytics","Advanced security and admin controls","SSO with SAML","Privacy-preserving deployment"],"description":"For enterprise teams ready to scale","contactSales":true}],"summary":"$0.05 per million tokens; enterprise plans available","currency":"USD","sourceUrl":"https://notdiamond.ai/pricing","retrievedAt":"2026-10-06T22:08:09.888Z","startingPrice":{"unit":"million tokens","amount":0.05,"currency":"USD"}}` |
| pricing.free_tier | yes | - |
| pricing.model | open_source | commercial |
| pricing.price_level | free | low |
| pricing.starting_price | - | `{"amount":0.05,"currency":"USD"}` |
| pricing.transparent | - | yes |
| release.cadence_days | 6 | - |
| release.history | `[{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v1.2.0","date":"2026-10-07T11:58:00Z","type":"stable","version":"v1.2.0"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v1.2.0-rc1","date":"2026-10-06T08:40:06Z","type":"prerelease","version":"v1.2.0-rc1"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v1.1.0","date":"2026-08-21T18:23:16Z","type":"stable","version":"v1.1.0"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v1.0.0","date":"2026-06-23T15:32:39Z","type":"stable","version":"v1.0.0"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v1.0.0-rc1","date":"2026-06-23T02:37:10Z","type":"prerelease","version":"v1.0.0-rc1"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.7.0","date":"2026-06-06T20:59:58Z","type":"stable","version":"v0.7.0"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.6.0","date":"2026-05-05T20:43:06Z","type":"stable","version":"v0.6.0"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.6.0-rc1","date":"2026-04-30T21:12:21Z","type":"prerelease","version":"v0.6.0-rc1"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.5.0","date":"2026-01-23T21:17:55Z","type":"stable","version":"v0.5.0"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.5.0-rc1","date":"2026-01-12T19:47:59Z","type":"prerelease","version":"v0.5.0-rc1"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.4.0","date":"2025-11-08T00:55:51Z","type":"stable","version":"v0.4.0"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.4.0-rc2","date":"2025-11-07T22:42:47Z","type":"prerelease","version":"v0.4.0-rc2"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.4.0-rc1","date":"2025-11-05T21:31:00Z","type":"prerelease","version":"v0.4.0-rc1"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.3.0","date":"2025-08-21T10:28:43Z","type":"stable","version":"v0.3.0"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.3.0-rc2","date":"2025-08-21T10:01:37Z","type":"prerelease","version":"v0.3.0-rc2"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.3.0-rc1","date":"2025-08-15T04:15:29Z","type":"prerelease","version":"v0.3.0-rc1"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.2.1","date":"2025-06-10T04:01:45Z","type":"stable","version":"v0.2.1"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.2.0","date":"2025-06-05T21:20:28Z","type":"stable","version":"v0.2.0"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.2.0-rc3","date":"2025-06-05T21:12:25Z","type":"prerelease","version":"v0.2.0-rc3"},{"url":"https://github.com/theagentrouter/agent-router/releases/tag/v0.2.0-rc1","date":"2025-06-02T22:27:40Z","type":"prerelease","version":"v0.2.0-rc1"}]` | - |
| security.certifications | - | `[{"name":"SOC 2","status":"active"},{"name":"ISO 27001","status":"active"}]` |
| security.iso27001 | - | yes |
| security.soc2 | - | yes |
| security.trust_center | https://aigateway.envoyproxy.io/docs/0.4/capabilities/security/ | - |
| security.vulnerabilities | `{"count":0,"source":"https://advisories.ecosyste.ms/api/v1/advisories?ecosystem=helm&package_name=envoy-ai-gateway%2Fai-gateway-helm&per_page=100","last_12m":0,"max_severity":null}` | - |

## Capabilities (Llm Gateways)

| Capability | Envoy AI Gateway | Not Diamond |
|---|:--:|:--:|
| **Capabilities** |  |  |
| Openai compatible API | ✓ | - |
| Automatic failover | ✓ | - |
| Routing strategy | Custom | Custom |
| Caching | Semantic | - |
| Virtual key management | ✓ | - |
| Budget spend controls | ✓ | - |
| Rate limiting | ✓ | - |
| Guardrails moderation | - | - |
| Request cost observability | ✓ | ✓ |
| Streaming support | ✓ | - |
| Deployment model | Self hosted | Managed SaaS |
| Open source | ✓ | - |
| Pricing model | Open source self host | Usage based saas |

*Source: vioscaleAI. Generated 2026-10-16T19:29:25.379Z. "-" = undocumented, not absent.*
