# Arize Phoenix vs Humanloop

| Attribute | Arize Phoenix | Humanloop |
|---|---|---|
| **vioscaleAI score** | 53.7 (51% (medium)) | 55.9 (75% (high)) |
| activity.commits_last_30d | 100 | - |
| adoption.dependent_repos | 0 | - |
| adoption.github_stars | 11,858 | - |
| content.faq | `[{"answer":"Phoenix provides OpenTelemetry-based instrumentation for LLM applications, AI-powered evaluation of model outputs and retrieval quality, and systematic prompt management with versioning. It supports both self-hosted and cloud deployment and integrates with major LLM frameworks and development tools. It is indexed under Llm Observability.","source":"https://phoenix.arize.com","question":"What is Arize Phoenix?","confidence":0.6},{"answer":"Yes. Arize Phoenix can be deployed cloud / SaaS and self-hosted, so it does not have to run on the vendor's infrastructure.","source":"https://phoenix.arize.com","question":"Can Arize Phoenix be self-hosted?","confidence":0.6},{"answer":"We have confirmed 8 integrations for Arize Phoenix, including LlamaIndex, OpenAI, Anthropic, AWS Bedrock, Vertex AI, Claude Code, Cursor and OpenLLMetry. This is what we could verify from public sources, so the vendor may support others we have not indexed.","source":"https://phoenix.arize.com","question":"What does Arize Phoenix integrate with?","confidence":0.6}]` | `[{"answer":"An enterprise platform that helps teams evaluate language model performance, manage and version prompts, and monitor AI systems in production. It is indexed under Prompt Management.","source":"https://humanloop.com/pricing","question":"What is Humanloop?","confidence":0.6},{"answer":"Humanloop does not publish its prices. Pricing is quoted on request, across 2 plans (Free Trial and Enterprise), so the figure depends on your seat count and requirements. We record this as a pricing-transparency signal rather than guessing a number. Pricing changes often, so verify at source before relying on it.","source":"https://humanloop.com/pricing","question":"How much does Humanloop cost?","confidence":0.6},{"answer":"We have confirmed browser-based access to Humanloop. That is the extent of what we could verify from public sources, so it may well offer desktop or mobile clients we have not indexed.","source":"https://humanloop.com/pricing","question":"What platforms does Humanloop support?","confidence":0.6},{"answer":"Yes. Humanloop can be deployed cloud / SaaS and self-hosted, so it does not have to run on the vendor's infrastructure.","source":"https://humanloop.com/pricing","question":"Can Humanloop be self-hosted?","confidence":0.6},{"answer":"We have confirmed 5 integrations for Humanloop, including Git, CI/CD pipelines, Vercel AI SDK, OpenAI and Anthropic. This is what we could verify from public sources, so the vendor may support others we have not indexed.","source":"https://humanloop.com/pricing","question":"What does Humanloop integrate with?","confidence":0.6},{"answer":"We have independently confirmed SOC 2, HIPAA and GDPR for Humanloop. Certifications we do not list are ones we have not been able to verify from public sources, which is not the same as Humanloop not holding them. Always confirm compliance directly before you rely on it.","source":"https://humanloop.com/platform/compliance-security","question":"What security certifications does Humanloop have?","confidence":0.7},{"answer":"Humanloop is available worldwide. Its primary markets are the United States, the United Kingdom and the EU. The vendor is headquartered in the United Kingdom.","source":"https://humanloop.com/pricing","question":"Where is Humanloop available?","confidence":0.75}]` |
| deployment.options | `{"self_hosted":true}` | `{"cloud":true,"self_hosted":true}` |
| description.long | A self-hosted platform that traces and evaluates language model application behavior using OpenTelemetry instrumentation, enabling teams to debug, optimize, and monitor LLM performance. | An enterprise platform that helps teams evaluate language model performance, manage and version prompts, and monitor AI systems in production. |
| features.capabilities | `{"pricing_model":"free_open_source","architecture_model":"open_source_self_hosted","production_ab_testing_of_system_prompts":true,"token_cost_and_latency_waterfall_charts":true,"prompt_playground_and_in_dashboard_replay":true,"multi_step_agentic_workflow_distributed_tracing":true,"opentelemetry_openllmetry_native_export_support":true,"native_integration_with_langchain_and_llamaindex":true}` | `{"ab_testing":true,"soc2_type_ii":true,"pricing_model":"usage/seat-based-saas","self_hostable":true,"multi_step_flows":true,"tracing_included":true,"versioning_model":"hybrid","diff_and_rollback":true,"architecture_model":"managed_cloud_saas","non_engineer_editing":true,"multi_model_playground":true,"llm_judge_or_human_eval":true,"mit_or_apache_permissive_oss_license":false,"production_ab_testing_of_system_prompts":true,"prompt_playground_and_in_dashboard_replay":true,"automated_anomaly_detection_for_rate_limits":true,"multi_step_agentic_workflow_distributed_tracing":true,"user_feedback_score_api_for_thumbs_up_down_tags":true}` |
| integrations.count | 11 | 5 |
| integrations.list | `[{"name":"LlamaIndex"},{"name":"OpenAI"},{"name":"Anthropic"},{"name":"AWS Bedrock"},{"name":"Vertex AI"},{"name":"Claude Code"},{"name":"Cursor"},{"name":"OpenLLMetry"},{"name":"OpenTelemetry","native":true},{"name":"OpenInference"},{"name":"Gemini","native":true,"category":"llm"},{"name":"Google Vertex AI","native":true},{"name":"Google Gemini","native":true},{"name":"Together AI","native":true},{"name":"Fireworks","native":true},{"name":"NVIDIA NIM","native":true},{"name":"LiteLLM","native":true},{"name":"LangChain","native":true},{"name":"Traceloop","native":true}]` | `[{"name":"Git"},{"name":"CI/CD pipelines"},{"name":"Vercel AI SDK"},{"name":"OpenAI"},{"name":"Anthropic"},{"name":"CI/CD","native":true,"direction":"inbound"}]` |
| language.primary | Python | - |
| market.availability | - | `{"hqCountry":"GB","primaryMarkets":["US","GB","EU"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` |
| platform.support | `{"cli":true,"web":true}` | `{"web":true}` |
| pricing | `{"type":"open_source","summary":"Open-source and free","freeTier":true,"sourceUrl":"https://phoenix.arize.com","retrievedAt":"2026-09-13T20:03:21.729Z"}` | `{"type":"subscription","plans":[{"free":true,"name":"Free Trial","summary":"50 eval runs","description":"Limited access to platform features","contactSales":false,"includedLimits":{"eval_runs":"50"}},{"free":false,"name":"Enterprise","summary":"Custom pricing, contact sales","features":["SSO + SAML","Role-based access controls","Hands-on support with SLA","VPC deployment add-on"],"description":"Custom features, dedicated support, and compliance options","contactSales":true}],"addOns":[{"name":"VPC Deployment"}],"summary":"Free trial. Monthly billing with no long-term commitment for standard plans; annual billing available for enterprise.","freeTier":true,"sourceUrl":"https://humanloop.com/pricing","retrievedAt":"2026-09-09T12:26:04.514Z","billingPeriods":["month","year"]}` |
| pricing.free_tier | yes | yes |
| pricing.model | open_source | freemium |
| pricing.price_level | free | low |
| pricing.transparent | - | no |
| release.history | `[{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.22.0","date":"2026-10-15T07:02:33Z","type":"stable","version":"arize-phoenix-v20.22.0"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.21.4","date":"2026-10-14T16:12:17Z","type":"stable","version":"arize-phoenix-v20.21.4"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.21.3","date":"2026-10-14T03:38:44Z","type":"stable","version":"arize-phoenix-v20.21.3"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.21.2","date":"2026-10-13T16:04:09Z","type":"stable","version":"arize-phoenix-v20.21.2"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.21.1","date":"2026-10-12T21:09:18Z","type":"stable","version":"arize-phoenix-v20.21.1"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-sqlean-v0.2.0","date":"2026-10-13T03:17:51Z","type":"stable","version":"arize-phoenix-sqlean-v0.2.0"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.21.0","date":"2026-10-11T14:23:03Z","type":"stable","version":"arize-phoenix-v20.21.0"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-evals-v3.9.2","date":"2026-10-09T15:27:08Z","type":"stable","version":"arize-phoenix-evals-v3.9.2"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/%40arizeai/phoenix-mcp%404.3.16","date":"2026-10-09T22:00:58Z","type":"stable","version":"@arizeai/phoenix-mcp@4.3.16"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/%40arizeai/phoenix-client%407.16.1","date":"2026-10-09T22:00:52Z","type":"stable","version":"@arizeai/phoenix-client@7.16.1"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/%40arizeai/phoenix-cli%401.18.8","date":"2026-10-09T22:00:55Z","type":"stable","version":"@arizeai/phoenix-cli@1.18.8"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.20.0","date":"2026-10-09T00:35:00Z","type":"stable","version":"arize-phoenix-v20.20.0"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-evals-v3.9.1","date":"2026-10-08T03:15:45Z","type":"stable","version":"arize-phoenix-evals-v3.9.1"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.19.0","date":"2026-10-01T22:59:10Z","type":"stable","version":"arize-phoenix-v20.19.0"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.18.0","date":"2026-09-30T23:04:10Z","type":"stable","version":"arize-phoenix-v20.18.0"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/arize-phoenix-v20.17.0","date":"2026-09-30T22:10:01Z","type":"stable","version":"arize-phoenix-v20.17.0"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/%40arizeai/phoenix-mcp%404.3.15","date":"2026-09-30T23:35:39Z","type":"stable","version":"@arizeai/phoenix-mcp@4.3.15"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/%40arizeai/phoenix-client%407.16.0","date":"2026-09-30T23:35:33Z","type":"stable","version":"@arizeai/phoenix-client@7.16.0"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/%40arizeai/phoenix-cli%401.18.7","date":"2026-09-30T23:35:36Z","type":"stable","version":"@arizeai/phoenix-cli@1.18.7"},{"url":"https://github.com/Arize-ai/phoenix/releases/tag/%40arizeai/phoenix-mcp%404.3.14","date":"2026-09-29T19:17:12Z","type":"stable","version":"@arizeai/phoenix-mcp@4.3.14"}]` | - |
| security.certifications | - | `[{"name":"SOC 2 Type II","level":"Type II","status":"active"}]` |
| security.disclosure_policy | - | yes |
| security.gdpr | - | yes |
| security.hipaa | - | yes |
| security.soc2 | - | yes |
| security.trust_center | - | https://humanloop.com/platform/compliance-security |
| security.vulnerabilities | `{"count":0,"source":"https://advisories.ecosyste.ms/api/v1/advisories?ecosystem=npm&package_name=%40arizeai%2Fphoenix-config&per_page=100","last_12m":0,"max_severity":null}` | - |

## Capabilities (Llm Observability)

| Capability | Arize Phoenix | Humanloop |
|---|:--:|:--:|
| **Capabilities** |  |  |
| Architecture model | Open source self hosted | Managed cloud saas |
| Token cost and latency waterfall charts | ✓ | - |
| Opentelemetry openllmetry native export support | ✓ | - |
| Prompt playground and in dashboard replay | ✓ | ✓ |
| Multi step agentic workflow distributed tracing | ✓ | ✓ |
| User feedback score API for thumbs up down tags | - | ✓ |
| Pii redaction and prompt content masking | - | - |
| Production ab testing of system prompts | ✓ | ✓ |
| Automated anomaly detection for rate limits | - | ✓ |
| Native integration with langchain and llamaindex | ✓ | - |
| SOC2 type ii | - | ✓ |
| Mit or apache permissive oss license | - | ✗ |
| Pricing model | Free open source | usage/seat-based-saas |

*Source: vioscaleAI. Generated 2026-10-16T17:44:41.822Z. "-" = undocumented, not absent.*