# Metaflow vs Portkey

**Leader by vioscaleAI score:** Portkey

| Attribute | Metaflow | Portkey |
|---|---|---|
| **vioscaleAI score** | 55.9 (63% (medium)) | 78.9 (74% (medium)) |
| activity.commits_last_30d | 13 | - |
| adoption.dependent_repos | 106 | - |
| adoption.github_stars | 10,304 | - |
| adoption.package_downloads_weekly | 103,395 | - |
| content.faq | `[{"answer":"An open-source tool that enables data scientists and engineers to move from local experimentation to scalable production systems, with features for tracking experiments, versioning data and models, and orchestrating compute across multiple cloud platforms or self-hosted infrastructure. It is indexed under MLOps & LLMOps Tools.","source":"https://metaflow.org","question":"What is Metaflow?","confidence":0.6},{"answer":"Metaflow is open source, so it can be self-hosted and used at no licence cost. It is released under the Apache-2.0 licence. Pricing changes often, so verify at source before relying on it.","source":"https://metaflow.org","question":"Is Metaflow free to use?","confidence":0.6},{"answer":"Metaflow supports a command-line interface. Platforms we have not confirmed are simply not listed here rather than ruled out.","source":"https://metaflow.org","question":"What platforms does Metaflow support?","confidence":0.6},{"answer":"Yes. Metaflow can be deployed cloud / SaaS, on-premise and self-hosted, so it does not have to run on the vendor's infrastructure.","source":"https://metaflow.org","question":"Can Metaflow be self-hosted?","confidence":0.6},{"answer":"We have confirmed 3 integrations for Metaflow, including AWS, Azure and Google Cloud. This is what we could verify from public sources, so the vendor may support others we have not indexed.","source":"https://metaflow.org","question":"What does Metaflow integrate with?","confidence":0.6},{"answer":"Yes. Metaflow is published under the Apache-2.0 licence, a permissive licence that generally allows commercial use and modification. Licence terms can change between releases, so verify against the repository for the version you intend to use.","source":"https://github.com/Netflix/metaflow","question":"Is Metaflow open source?","confidence":0.95},{"answer":"Metaflow is available worldwide. Its primary market is the United States. The vendor is headquartered in the United States.","source":"https://metaflow.org","question":"Where is Metaflow available?","confidence":0.75}]` | `[{"answer":"Portkey is an AI gateway platform that routes to 1,600+ language models while incorporating 50+ built-in content safety guardrails. It provides SDKs, CLI tools, and infrastructure components for deploying and managing generative AI applications. It is indexed under MLOps & LLMOps Tools.","source":"https://portkey.ai","question":"What is Portkey?","confidence":0.6},{"answer":"Portkey offers a free tier, so you can start without paying. Paid plans start at $9. Prices are published openly on the vendor's own pricing page. Pricing changes often, so verify at source before relying on it.","source":"https://portkey.ai/pricing","question":"Is Portkey free?","confidence":0.6},{"answer":"Portkey supports the web and a command-line interface. Platforms we have not confirmed are simply not listed here rather than ruled out.","source":"https://portkey.ai","question":"What platforms does Portkey support?","confidence":0.6},{"answer":"Yes. Portkey can be deployed cloud / SaaS and self-hosted, so it does not have to run on the vendor's infrastructure.","source":"https://portkey.ai","question":"Can Portkey be self-hosted?","confidence":0.6},{"answer":"We have confirmed 13 integrations for Portkey, including OpenAI, Google Cloud (Vertex AI, Gemini), Azure, AWS, GCP, Langgraph, CrewAI and Strands Agents, plus 5 more. This is what we could verify from public sources, so the vendor may support others we have not indexed.","source":"https://portkey.ai","question":"What does Portkey integrate with?","confidence":0.6},{"answer":"We have independently confirmed SOC 2, ISO 27001, HIPAA and GDPR for Portkey. Certifications we do not list are ones we have not been able to verify from public sources, which is not the same as Portkey not holding them. Always confirm compliance directly before you rely on it.","source":"https://portkey.ai/features/security-compliance","question":"What security certifications does Portkey have?","confidence":0.7}]` |
| deployment.options | `{"cloud":true,"self_hosted":true}` | `{"cloud":true,"hybrid":true,"on_prem":true,"self_hosted":true}` |
| description.long | An open-source tool that enables data scientists and engineers to move from local experimentation to scalable production systems, with features for tracking experiments, versioning data and models, and orchestrating compute across multiple cloud platforms or self-hosted infrastructure. | Platform providing API gateway functionality, observability with logging and traces, safety guardrails, access governance, and prompt version management for teams deploying AI applications at scale. |
| features.capabilities | `{"role":"framework","managed_cloud":true,"self_hostable":true,"multi_provider":true,"vpc_deployment":true,"otel_compatible":true,"framework_agnostic":true,"experiment_tracking":true}` | `{"role":"gateway","caching":"semantic","evaluation":true,"open_source":true,"soc2_type_ii":true,"managed_cloud":true,"model_serving":true,"pricing_model":"pay_per_10k_traces","rate_limiting":true,"self_hostable":true,"multi_provider":true,"vpc_deployment":true,"deployment_model":"managed-SaaS","no_train_on_data":"unknown","routing_strategy":"load-based","llm_observability":true,"prompt_management":true,"architecture_model":"managed_cloud_saas","automatic_failover":true,"framework_agnostic":true,"experiment_tracking":true,"budget_spend_controls":true,"guardrails_moderation":"via-integration","openai_compatible_api":true,"virtual_key_management":true,"request_cost_observability":true,"mit_or_apache_permissive_oss_license":true,"production_ab_testing_of_system_prompts":true,"token_cost_and_latency_waterfall_charts":true,"pii_redaction_and_prompt_content_masking":true,"prompt_playground_and_in_dashboard_replay":true,"multi_step_agentic_workflow_distributed_tracing":true,"user_feedback_score_api_for_thumbs_up_down_tags":true,"native_integration_with_langchain_and_llamaindex":true}` |
| integrations.count | 3 | 1,600 |
| integrations.list | `[{"name":"AWS"},{"name":"Azure"},{"name":"Google Cloud"},{"name":"IPython","native":true}]` | `[{"name":"OpenAI"},{"name":"Google Cloud (Vertex AI, Gemini)"},{"name":"Azure"},{"name":"AWS"},{"name":"GCP"},{"name":"Langgraph"},{"name":"CrewAI"},{"name":"Strands Agents"},{"name":"Google ADK"},{"name":"Anthropic"},{"name":"Claude"},{"name":"Mistral"},{"name":"Google"},{"name":"MongoDB"},{"name":"Vertex AI"},{"name":"Claude Code","native":true}]` |
| language.primary | Python | - |
| license.spdx | Apache-2.0 | - |
| market.availability | `{"hqCountry":"US","primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` | `{"primaryMarkets":[],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` |
| platform.support | `{"cli":true}` | `{"cli":true,"web":true}` |
| pricing | `{"type":"open_source","freeTier":true,"sourceUrl":"https://metaflow.org","retrievedAt":"2026-08-14T09:21:30.422Z"}` | `{"type":"hybrid","plans":[{"free":true,"name":"Developer","summary":"Free forever, 10k logs/month","features":["Universal API & Key Management","Routing, Fallbacks, Load Balancing, Retries","3 Prompt Templates with Playground, Versioning, Variables","Logs, Traces, Feedback, Custom Metadata, Filters","Simple Caching","Deterministic Guardrails","Community Support","3 days log retention, 30 days metrics retention"],"components":[{"kind":"fixed","amount":0,"period":"month","currency":"USD"}],"description":"Free tier for prototyping and testing; not suitable for production workloads","contactSales":false,"includedLimits":{"recorded_logs":"10k/month"}},{"free":false,"name":"Production","summary":"$49/month + $9 per 100k request overage","features":["Universal API, Fallbacks, Load Balancing, Retries","Unlimited Prompt Templates with Playground, API Deployment, Versioning, Variables","Logs, Traces, Feedback, Metadata, Filters, Alerts","LLM & Partner Guardrails","Role-Based Access Control, Service Account API Keys","Simple & Semantic Caching","Production Support","30 days log retention, 90 days metrics retention"],"commitment":"monthly","components":[{"kind":"fixed","amount":49,"period":"month","currency":"USD"},{"per":{"qty":100000,"unit":"requests"},"kind":"metered","amount":9,"currency":"USD"}],"description":"For teams deploying LLM apps to production","contactSales":false,"includedLimits":{"recorded_logs":"100k/month"}},{"free":false,"name":"Enterprise","summary":"Custom pricing","features":["Custom retention periods for logs and metrics","Advanced Evaluation Templates with custom guardrail hooks","Role-Based Access Control, SSO (Okta), Granular Budget & Rate Limits","Private Cloud Deployment, VPC Hosting, Data Export to Data Lakes","SOC2 Type 2, GDPR, HIPAA compliance certifications","Custom Business Associate Agreements","Data Isolation, Configurable exports to data lakes","Dedicated Onboarding & Priority Support"],"description":"For organizations with complex compliance and high-volume production requirements","contactSales":true,"includedLimits":{"recorded_logs":"10M+/month"}}],"summary":"Free tier with 10k logs/month. Production at $49/month with usage overages. Enterprise custom pricing for compliance-focused organizations.","currency":"USD","freeTier":true,"sourceUrl":"https://portkey.ai/pricing","retrievedAt":"2026-08-21T13:46:13.229Z","startingPrice":{"amount":49,"period":"month","currency":"USD"},"billingPeriods":["month"]}` |
| pricing.free_tier | yes | yes |
| pricing.model | open_source | freemium |
| pricing.price_level | free | mid |
| pricing.starting_price | - | `{"amount":49,"currency":"USD"}` |
| pricing.transparent | - | yes |
| release.cadence_days | 5 | - |
| release.history | `[{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.39","date":"2026-09-02T21:17:39Z","type":"stable","version":"2.19.39"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.38","date":"2026-08-18T00:34:39Z","type":"stable","version":"2.19.38"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.37","date":"2026-08-11T17:15:05Z","type":"stable","version":"2.19.37"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.36","date":"2026-08-05T18:15:13Z","type":"stable","version":"2.19.36"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.35","date":"2026-06-24T22:08:22Z","type":"stable","version":"2.19.35"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.34","date":"2026-06-18T12:37:53Z","type":"stable","version":"2.19.34"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.33","date":"2026-06-09T19:37:12Z","type":"stable","version":"2.19.33"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.32","date":"2026-06-03T21:24:38Z","type":"stable","version":"2.19.32"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.31","date":"2026-06-01T01:48:44Z","type":"stable","version":"2.19.31"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.30","date":"2026-05-29T08:38:51Z","type":"stable","version":"2.19.30"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.29","date":"2026-05-11T23:37:35Z","type":"stable","version":"2.19.29"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.28","date":"2026-05-07T16:37:54Z","type":"stable","version":"2.19.28"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.27","date":"2026-05-06T15:44:03Z","type":"stable","version":"2.19.27"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.26","date":"2026-05-05T19:10:56Z","type":"stable","version":"2.19.26"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.25","date":"2026-05-05T17:20:26Z","type":"stable","version":"2.19.25"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.24","date":"2026-05-01T18:36:35Z","type":"stable","version":"2.19.24"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.23","date":"2026-04-28T04:04:38Z","type":"stable","version":"2.19.23"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.22","date":"2026-03-20T21:38:19Z","type":"stable","version":"2.19.22"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.21","date":"2026-03-11T23:56:51Z","type":"stable","version":"2.19.21"},{"url":"https://github.com/Netflix/metaflow/releases/tag/2.19.20","date":"2026-02-26T20:51:42Z","type":"stable","version":"2.19.20"}]` | - |
| reliability.status_page | yes | yes |
| security.certifications | - | `[{"name":"SOC2 Type II","level":"Type II","status":"active"},{"name":"ISO 27001","status":"active"},{"name":"GDPR","status":"active"},{"name":"HIPAA","status":"active"}]` |
| security.gdpr | - | yes |
| security.hipaa | - | yes |
| security.iso27001 | - | yes |
| security.scorecard | 6.9 | - |
| security.soc2 | - | yes |
| security.trust_center | - | https://portkey.ai/features/security-compliance |
| security.vulnerabilities | `{"count":0,"source":"https://advisories.ecosyste.ms/api/v1/advisories?ecosystem=pypi&package_name=metaflow&per_page=100","last_12m":0,"max_severity":null}` | - |

## Capabilities (MLOps & LLMOps Tools)

| Capability | Metaflow | Portkey |
|---|:--:|:--:|
| **Core** |  |  |
| Tool role | Agent / RAG framework | Model gateway / router |
| **Deployment** |  |  |
| Self-hostable / OSS core | ✓ | ✓ |
| Managed cloud available | ✓ | ✓ |
| On-prem / VPC deployment | ✓ | ✓ |
| **Observability** |  |  |
| LLM tracing / observability | - | ✓ |
| Evaluation (offline / LLM-judge / human) | - | ✓ |
| **Dev** |  |  |
| Prompt management + versioning | - | ✓ |
| **Tracking** |  |  |
| Experiment tracking / model registry | ✓ | ✓ |
| **Serving** |  |  |
| Model serving / inference endpoint | - | ✓ |
| **Interop** |  |  |
| OpenTelemetry / OpenLLMetry compatible | ✓ | - |
| Framework-agnostic | ✓ | ✓ |
| **Gateway** |  |  |
| Multi-provider model support | ✓ | ✓ |
| **Data** |  |  |
| No-train-on-customer-data guarantee | - | Unknown |

*Source: vioscaleAI. Generated 2026-10-16T19:04:36.250Z. "-" = undocumented, not absent.*