# AgentOps vs Portkey

**Leader by vioscaleAI score:** Portkey

| Attribute | AgentOps | Portkey |
|---|---|---|
| **vioscaleAI score** | 48.7 (53% (medium)) | 78.9 (74% (medium)) |
| content.faq | `[{"answer":"A developer platform providing observability, debugging, and performance tracking for AI agents and language model applications across multiple frameworks and 400+ LLM providers. It is indexed under Llm Observability.","source":"https://www.agentops.ai","question":"What is AgentOps?","confidence":0.6},{"answer":"AgentOps offers a free tier, so you can start without paying. Paid plans start at $40 per month. Pricing changes often, so verify at source before relying on it.","source":"https://www.agentops.ai","question":"Is AgentOps free?","confidence":0.6},{"answer":"We have confirmed browser-based access to AgentOps. That is the extent of what we could verify from public sources, so it may well offer desktop or mobile clients we have not indexed.","source":"https://www.agentops.ai","question":"What platforms does AgentOps support?","confidence":0.6},{"answer":"Yes. AgentOps can be deployed cloud / SaaS and self-hosted, so it does not have to run on the vendor's infrastructure.","source":"https://www.agentops.ai","question":"Can AgentOps be self-hosted?","confidence":0.6},{"answer":"We have confirmed 11 integrations for AgentOps, including CrewAI, AG2 (AutoGen), Agno, LangGraph, OpenAI Agents SDK, Langchain, Cohere and LiteLLM, plus 3 more. This is what we could verify from public sources, so the vendor may support others we have not indexed.","source":"https://www.agentops.ai","question":"What does AgentOps integrate with?","confidence":0.6},{"answer":"We have independently confirmed SOC 2 and HIPAA for AgentOps. Certifications we do not list are ones we have not been able to verify from public sources, which is not the same as AgentOps not holding them. Always confirm compliance directly before you rely on it.","source":"https://www.agentops.ai","question":"What security certifications does AgentOps have?","confidence":0.6},{"answer":"AgentOps is available worldwide. Its primary market is the United States.","source":"https://www.agentops.ai","question":"Where is AgentOps available?","confidence":0.5}]` | `[{"answer":"Portkey is an AI gateway platform that routes to 1,600+ language models while incorporating 50+ built-in content safety guardrails. It provides SDKs, CLI tools, and infrastructure components for deploying and managing generative AI applications. It is indexed under MLOps & LLMOps Tools.","source":"https://portkey.ai","question":"What is Portkey?","confidence":0.6},{"answer":"Portkey offers a free tier, so you can start without paying. Paid plans start at $9. Prices are published openly on the vendor's own pricing page. Pricing changes often, so verify at source before relying on it.","source":"https://portkey.ai/pricing","question":"Is Portkey free?","confidence":0.6},{"answer":"Portkey supports the web and a command-line interface. Platforms we have not confirmed are simply not listed here rather than ruled out.","source":"https://portkey.ai","question":"What platforms does Portkey support?","confidence":0.6},{"answer":"Yes. Portkey can be deployed cloud / SaaS and self-hosted, so it does not have to run on the vendor's infrastructure.","source":"https://portkey.ai","question":"Can Portkey be self-hosted?","confidence":0.6},{"answer":"We have confirmed 13 integrations for Portkey, including OpenAI, Google Cloud (Vertex AI, Gemini), Azure, AWS, GCP, Langgraph, CrewAI and Strands Agents, plus 5 more. This is what we could verify from public sources, so the vendor may support others we have not indexed.","source":"https://portkey.ai","question":"What does Portkey integrate with?","confidence":0.6},{"answer":"We have independently confirmed SOC 2, ISO 27001, HIPAA and GDPR for Portkey. Certifications we do not list are ones we have not been able to verify from public sources, which is not the same as Portkey not holding them. Always confirm compliance directly before you rely on it.","source":"https://portkey.ai/features/security-compliance","question":"What security certifications does Portkey have?","confidence":0.7}]` |
| deployment.options | `{"cloud":true,"self_hosted":true}` | `{"cloud":true,"hybrid":true,"on_prem":true,"self_hosted":true}` |
| description.long | A developer platform providing observability, debugging, and performance tracking for AI agents and language model applications across multiple frameworks and 400+ LLM providers. | Platform providing API gateway functionality, observability with logging and traces, safety guardrails, access governance, and prompt version management for teams deploying AI applications at scale. |
| features.capabilities | `{"pricing_model":"free_open_source","architecture_model":"managed_cloud_saas","mit_or_apache_permissive_oss_license":true,"prompt_playground_and_in_dashboard_replay":true,"multi_step_agentic_workflow_distributed_tracing":true,"native_integration_with_langchain_and_llamaindex":true}` | `{"role":"gateway","caching":"semantic","evaluation":true,"open_source":true,"soc2_type_ii":true,"managed_cloud":true,"model_serving":true,"pricing_model":"pay_per_10k_traces","rate_limiting":true,"self_hostable":true,"multi_provider":true,"vpc_deployment":true,"deployment_model":"managed-SaaS","no_train_on_data":"unknown","routing_strategy":"load-based","llm_observability":true,"prompt_management":true,"architecture_model":"managed_cloud_saas","automatic_failover":true,"framework_agnostic":true,"experiment_tracking":true,"budget_spend_controls":true,"guardrails_moderation":"via-integration","openai_compatible_api":true,"virtual_key_management":true,"request_cost_observability":true,"mit_or_apache_permissive_oss_license":true,"production_ab_testing_of_system_prompts":true,"token_cost_and_latency_waterfall_charts":true,"pii_redaction_and_prompt_content_masking":true,"prompt_playground_and_in_dashboard_replay":true,"multi_step_agentic_workflow_distributed_tracing":true,"user_feedback_score_api_for_thumbs_up_down_tags":true,"native_integration_with_langchain_and_llamaindex":true}` |
| integrations.count | 11 | 1,600 |
| integrations.list | `[{"name":"CrewAI"},{"name":"AG2 (AutoGen)"},{"name":"Agno"},{"name":"LangGraph"},{"name":"OpenAI Agents SDK"},{"name":"Langchain"},{"name":"Cohere"},{"name":"LiteLLM"},{"name":"LlamaIndex"},{"name":"Llama Stack"},{"name":"CamelAI"},{"name":"AG2","native":true,"category":"framework"},{"name":"CAMEL","native":true,"category":"agent"}]` | `[{"name":"OpenAI"},{"name":"Google Cloud (Vertex AI, Gemini)"},{"name":"Azure"},{"name":"AWS"},{"name":"GCP"},{"name":"Langgraph"},{"name":"CrewAI"},{"name":"Strands Agents"},{"name":"Google ADK"},{"name":"Anthropic"},{"name":"Claude"},{"name":"Mistral"},{"name":"Google"},{"name":"MongoDB"},{"name":"Vertex AI"},{"name":"Claude Code","native":true}]` |
| market.availability | `{"primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` | `{"primaryMarkets":[],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` |
| platform.support | `{"web":true}` | `{"cli":true,"web":true}` |
| pricing | `{"type":"hybrid","plans":[{"free":true,"name":"Basic","summary":"Free up to 5,000 events","features":["Agent Agnostic SDK","LLM Cost Tracking (400+ LLMs)","Replay Analytics"],"components":[{"kind":"fixed","amount":0,"period":"month","currency":"USD"}],"description":"Free tier with limited event tracking","contactSales":false,"includedLimits":{"events":"5,000/month"}},{"free":false,"name":"Pro","summary":"From $40/month","features":["Unlimited event limit","Unlimited log retention","Session and event export","Dedicated Slack and email support","Role-based permissioning"],"components":[{"kind":"fixed","amount":40,"period":"month","currency":"USD"}],"description":"Unlimited events with extended features and support","contactSales":false,"includedLimits":{"events":"unlimited"}},{"free":false,"name":"Enterprise","summary":"Custom pricing","features":["SLA","Slack Connect","Custom SSO","On-premise deployment","Custom data retention policy","Self-hosting (AWS, GCP, Azure)","SOC-2 compliance","HIPAA compliance","NIST AI RMF"],"description":"Custom deployment, support, and compliance","contactSales":true}],"summary":"Free tier for up to 5,000 events; Pro from $40/month","currency":"USD","freeTier":true,"sourceUrl":"https://www.agentops.ai","retrievedAt":"2026-08-25T21:38:49.778Z","startingPrice":{"amount":40,"period":"month","currency":"USD"}}` | `{"type":"hybrid","plans":[{"free":true,"name":"Developer","summary":"Free forever, 10k logs/month","features":["Universal API & Key Management","Routing, Fallbacks, Load Balancing, Retries","3 Prompt Templates with Playground, Versioning, Variables","Logs, Traces, Feedback, Custom Metadata, Filters","Simple Caching","Deterministic Guardrails","Community Support","3 days log retention, 30 days metrics retention"],"components":[{"kind":"fixed","amount":0,"period":"month","currency":"USD"}],"description":"Free tier for prototyping and testing; not suitable for production workloads","contactSales":false,"includedLimits":{"recorded_logs":"10k/month"}},{"free":false,"name":"Production","summary":"$49/month + $9 per 100k request overage","features":["Universal API, Fallbacks, Load Balancing, Retries","Unlimited Prompt Templates with Playground, API Deployment, Versioning, Variables","Logs, Traces, Feedback, Metadata, Filters, Alerts","LLM & Partner Guardrails","Role-Based Access Control, Service Account API Keys","Simple & Semantic Caching","Production Support","30 days log retention, 90 days metrics retention"],"commitment":"monthly","components":[{"kind":"fixed","amount":49,"period":"month","currency":"USD"},{"per":{"qty":100000,"unit":"requests"},"kind":"metered","amount":9,"currency":"USD"}],"description":"For teams deploying LLM apps to production","contactSales":false,"includedLimits":{"recorded_logs":"100k/month"}},{"free":false,"name":"Enterprise","summary":"Custom pricing","features":["Custom retention periods for logs and metrics","Advanced Evaluation Templates with custom guardrail hooks","Role-Based Access Control, SSO (Okta), Granular Budget & Rate Limits","Private Cloud Deployment, VPC Hosting, Data Export to Data Lakes","SOC2 Type 2, GDPR, HIPAA compliance certifications","Custom Business Associate Agreements","Data Isolation, Configurable exports to data lakes","Dedicated Onboarding & Priority Support"],"description":"For organizations with complex compliance and high-volume production requirements","contactSales":true,"includedLimits":{"recorded_logs":"10M+/month"}}],"summary":"Free tier with 10k logs/month. Production at $49/month with usage overages. Enterprise custom pricing for compliance-focused organizations.","currency":"USD","freeTier":true,"sourceUrl":"https://portkey.ai/pricing","retrievedAt":"2026-08-21T13:46:13.229Z","startingPrice":{"amount":49,"period":"month","currency":"USD"},"billingPeriods":["month"]}` |
| pricing.free_tier | yes | yes |
| pricing.model | freemium | freemium |
| pricing.price_level | mid | mid |
| pricing.starting_price | `{"amount":40,"currency":"USD"}` | `{"amount":49,"currency":"USD"}` |
| pricing.transparent | no | yes |
| reliability.status_page | - | yes |
| security.certifications | - | `[{"name":"SOC2 Type II","level":"Type II","status":"active"},{"name":"ISO 27001","status":"active"},{"name":"GDPR","status":"active"},{"name":"HIPAA","status":"active"}]` |
| security.gdpr | - | yes |
| security.hipaa | yes | yes |
| security.iso27001 | - | yes |
| security.soc2 | yes | yes |
| security.trust_center | - | https://portkey.ai/features/security-compliance |

## Capabilities (Llm Observability)

| Capability | AgentOps | Portkey |
|---|:--:|:--:|
| **Capabilities** |  |  |
| Architecture model | Managed cloud saas | Managed cloud saas |
| Token cost and latency waterfall charts | - | ✓ |
| Opentelemetry openllmetry native export support | - | - |
| Prompt playground and in dashboard replay | ✓ | ✓ |
| Multi step agentic workflow distributed tracing | ✓ | ✓ |
| User feedback score API for thumbs up down tags | - | ✓ |
| Pii redaction and prompt content masking | - | ✓ |
| Production ab testing of system prompts | - | ✓ |
| Automated anomaly detection for rate limits | - | - |
| Native integration with langchain and llamaindex | ✓ | ✓ |
| SOC2 type ii | - | ✓ |
| Mit or apache permissive oss license | ✓ | ✓ |
| Pricing model | Free open source | Pay per 10k traces |

*Source: vioscaleAI. Generated 2026-10-17T05:42:42.522Z. "-" = undocumented, not absent.*