LiteLLM
Unified API gateway that routes requests across 100+ LLM providers through a single OpenAI-compatible interface
- Also known as
- litellm
Available worldwide
What is LiteLLM?
An open-source AI gateway that provides a centralized control point for managing multiple large language models from different providers. It offers virtual key management, spend tracking, budget controls, and intelligent request routing without charging per token.
LiteLLM pricing
Plans, per-tier features and add-ons, dated and linked to live pricing. Pricing changes often; always verify at source before you rely on it.
Free open-source tier. Enterprise pricing based on annual request volume, not per-token.
Open Source
FreeMIT-licensed, self-hosted gateway
- providers
- 100+
- deployment
- self-hosted
- 100+ LLM providers
- Virtual keys, users & teams
- Spend tracking
- Prometheus metrics
- Logging and alerting
- Admin UI
- Guardrails
- Load balancing
Enterprise
Contact salesProduction deployment with governance, security, and professional support
- deployment
- self-hosted or air-gapped
- Everything in Open Source, plus:
- SSO + SCIM provisioning
- OIDC / JWT authentication
- Audit logs on every request
- Secret manager integration
- Key rotation
- Organization & team administration
- Multi-region control plane
- 24/7 support & SLAs
- Dedicated support & onboarding
- Volume discount tiers
- Air-gapped deployment available
What LiteLLM does
The capabilities that matter for llm gateways, normalised so it lines up with every alternative. “-” means we haven't confirmed it, not that it's missing.
- Openai compatible API
- ✓
- Automatic failover
- ✓
- Routing strategy
- Cost based
- Caching
- -
- Virtual key management
- ✓
- Budget spend controls
- ✓
- Rate limiting
- ✓
- Guardrails moderation
- Built in
- Request cost observability
- ✓
- Streaming support
- -
- Deployment model
- Self hosted
- Open source
- ✓
- Pricing model
- Open source self host
Platform & deployment
Independently observed- CLI
- Web
- Cloud / SaaS
- Hybrid
- On-premise
- Air-gapped
- Self-hosted
Integrations (32)
Independently observed- OpenAI
- Anthropic
- Azure
- AWS Bedrock
- Cloudflare
- Google VertexAI
- Meta Llama
- Mistral AI
- NLP Cloud
- OVHCloud
- vLLM
- Nvidia NIM
- Slack
- Discord
- Microsoft Teams
- PagerDuty
- Prometheus
- AWS Secrets Manager
- Google Cloud Secret Manager
- MCP servers
- Gemini
- Bedrock
- VertexAI
- Langfuse
- Langsmith
- Datadog
- Webhook
- S3
- Google Cloud Storage
- Azure Data Lake
- GCP Secret Manager
LiteLLM alternatives
Other llm gateways we track, ranked by the same independent score.
- Cloudflare AI GatewayMonitor and manage AI application traffic and costslow · 37%
- OpenRouterA unified API gateway providing single-point access to hundreds of AI language models from multiple providerslow · 36%
- UnifyVirtual AI teammates that automate work across your existing toolsmedium · 55%
- Eden AIUnified gateway providing access to hundreds of AI models from multiple providers through a single standardized APIhigh · 76%
- Not Diamondlow · 5%
- Keywords AIA unified API gateway for accessing thousands of language models with automatic failover, caching, and real-time cost controlsmedium · 74%
Compare LiteLLM
Side by side against other llm gateways, attribute by attribute, with a source on every value.
The Vioscale score: one lens on the evidence
Not user reviews and not a paid placement: a confidence-weighted blend of the independent signals below (adoption, activity, security posture, and more), which you can sort and re-weight yourself. Vendors can correct their listing but can never move their rank, and stars are weighted low as a vanity metric. It is one way to read the evidence for LiteLLM, not the verdict.
| Signal | Score | Weight | Contribution | Evidence |
|---|---|---|---|---|
| Pricing transparency | 80 | 0.08 | 6.7 | ✓ |
| Capabilities | 100 | 0.05 | 4.9 | ✓ |
| Price level | 80 | 0.05 | 4.2 | ✓ |
| Integrations | 62 | 0.04 | 2.5 | ✓ |
| Reliability | 0 | 0.07 | 0.0 | - |
| Security posture | 0 | 0.07 | 0.0 | - |
Computed . Re-weight it by intent, or see the full method.
All data & sourcesshow ↓
Every value we hold, with its source, retrieval date, and confidence. This is the evidence behind the score: don't trust it, verify it.
Features
| Attribute | Value | Evidence |
|---|---|---|
| Capabilities | Open source: Yes · Pricing model: open-source-self-host · Rate limiting: Yes · Deployment model: self-hosted · Routing strategy: cost-based · Architecture model: open_source_proxy | mediumsource · 2026-08-21 · 60% |
Integrations
| Attribute | Value | Evidence |
|---|---|---|
| Count | 140 | mediumsource · 2026-08-19 · 60% |
Market
| Attribute | Value | Evidence |
|---|---|---|
| Availability | PrimaryMarkets: … · AvailabilityScope: global · AvailableCountries: … · NotAvailableCountries: … | highsource · 2026-08-21 · 75% |