# Orq.ai vs Promptfoo

**Leader by vioscaleAI score:** Orq.ai

| Attribute | Orq.ai | Promptfoo |
|---|---|---|
| **vioscaleAI score** | 69.8 (74% (medium)) | 58.1 (22% (low)) |
| content.faq | `[{"answer":"A SaaS platform that centralizes AI model access and observability, allowing teams to route requests through multiple LLM providers with built-in cost tracking, policy enforcement, and compliance controls. Includes routing optimization, audit trails, and optional on-premise deployment. It is indexed under Prompt Management.","source":"https://orq.ai/pricing","question":"What is Orq.ai?","confidence":0.6},{"answer":"Orq.ai does not publish its prices. Pricing is quoted on request, across 2 plans (Pay-as-you-go and Enterprise), so the figure depends on your seat count and requirements. We record this as a pricing-transparency signal rather than guessing a number. Pricing changes often, so verify at source before relying on it.","source":"https://orq.ai/pricing","question":"How much does Orq.ai cost?","confidence":0.6},{"answer":"Orq.ai supports the web and a command-line interface. Platforms we have not confirmed are simply not listed here rather than ruled out.","source":"https://orq.ai/pricing","question":"What platforms does Orq.ai support?","confidence":0.6},{"answer":"Yes. Orq.ai can be deployed cloud / SaaS, hybrid, on-premise, air-gapped and self-hosted, so it does not have to run on the vendor's infrastructure.","source":"https://orq.ai/pricing","question":"Can Orq.ai be self-hosted?","confidence":0.6},{"answer":"We have confirmed 16 integrations for Orq.ai, including OpenAI, Anthropic, Google, Mistral, Azure AI Foundry, Vertex AI, LiteLLM and LangGraph, plus 8 more. This is what we could verify from public sources, so the vendor may support others we have not indexed.","source":"https://orq.ai/pricing","question":"What does Orq.ai integrate with?","confidence":0.6},{"answer":"We have independently confirmed SOC 2, ISO 27001 and GDPR for Orq.ai. Certifications we do not list are ones we have not been able to verify from public sources, which is not the same as Orq.ai not holding them. Always confirm compliance directly before you rely on it.","source":"https://orq.ai/legal/security","question":"What security certifications does Orq.ai have?","confidence":0.7},{"answer":"Orq.ai is available worldwide. Its primary market is the United States. The vendor is headquartered in the Netherlands.","source":"https://orq.ai/pricing","question":"Where is Orq.ai available?","confidence":0.75}]` | `[{"answer":"A CLI and library for testing, evaluating, and red-teaming LLM applications and agents. Automatically identifies vulnerabilities through security scanning and provides remediation guidance. It is indexed under Prompt Management.","source":"https://www.promptfoo.dev/pricing/","question":"What is Promptfoo?","confidence":0.6},{"answer":"Promptfoo does not publish its prices. Pricing is quoted on request, across 3 plans (Community, Enterprise and On-Premise), so the figure depends on your seat count and requirements. We record this as a pricing-transparency signal rather than guessing a number. Pricing changes often, so verify at source before relying on it.","source":"https://www.promptfoo.dev/pricing/","question":"How much does Promptfoo cost?","confidence":0.6},{"answer":"Promptfoo supports the web and a command-line interface. Platforms we have not confirmed are simply not listed here rather than ruled out.","source":"https://www.promptfoo.dev/pricing/","question":"What platforms does Promptfoo support?","confidence":0.6},{"answer":"Yes. Promptfoo can be deployed cloud / SaaS, on-premise and self-hosted, so it does not have to run on the vendor's infrastructure.","source":"https://www.promptfoo.dev/pricing/","question":"Can Promptfoo be self-hosted?","confidence":0.6},{"answer":"We have confirmed 14 integrations for Promptfoo, including OpenAI, Anthropic, Google (Gemini), DeepSeek, MCP (Model Context Protocol), CI/CD pipelines, Webhooks and Agent frameworks, plus 6 more. This is what we could verify from public sources, so the vendor may support others we have not indexed.","source":"https://www.promptfoo.dev/pricing/","question":"What does Promptfoo integrate with?","confidence":0.6},{"answer":"We have independently confirmed SOC 2 and ISO 27001 for Promptfoo. Certifications we do not list are ones we have not been able to verify from public sources, which is not the same as Promptfoo not holding them. Always confirm compliance directly before you rely on it.","source":"https://www.promptfoo.dev/blog/SOC2-compliance/","question":"What security certifications does Promptfoo have?","confidence":0.7},{"answer":"Promptfoo is available worldwide. Its primary market is the United States. The vendor is headquartered in the United States.","source":"https://www.promptfoo.dev/pricing/","question":"Where is Promptfoo available?","confidence":0.75}]` |
| deployment.options | `{"cloud":true,"hybrid":true,"on_prem":true,"air_gapped":true,"self_hosted":true}` | `{"self_hosted":true}` |
| description.long | A platform that centralizes AI application traffic through a single OpenAI-compatible API, routing requests to 500+ models while providing real-time tracing, cost visibility, compliance features, and support for agent deployment with versioning. | Automated testing and security evaluation framework for AI applications, with support for comparing multiple model providers and identifying potential vulnerabilities through red teaming and assertion-based validation. |
| features.capabilities | `{"ab_testing":true,"pricing_model":"usage/seat-based-saas","self_hostable":true,"deployment_model":"managed-SaaS","multi_step_flows":true,"tracing_included":true,"versioning_model":"UI-hosted registry","approval_workflow":true,"diff_and_rollback":true,"non_engineer_editing":true,"multi_model_playground":true,"llm_judge_or_human_eval":true}` | `{"soc2_type_ii":true,"pricing_model":"open-source-self-host","self_hostable":true,"deployment_model":"self-hosted","versioning_model":"UI-hosted registry","architecture_model":"open_source_cli","non_engineer_editing":false,"multi_model_playground":true,"llm_judge_or_human_eval":true,"mit_or_apache_permissive_oss_license":true,"llm_as_a_judge_prompt_grading_framework":true,"ci_cd_github_actions_pipeline_blocking_gates":true,"deterministic_regex_and_json_schema_assertions":true,"multi_model_side_by_side_ab_regression_testing":true,"red_teaming_and_adversarial_vulnerability_scanning":true}` |
| integrations.count | 12 | 8 |
| integrations.list | `[{"name":"OpenAI"},{"name":"Anthropic"},{"name":"Google"},{"name":"Mistral"},{"name":"Azure AI Foundry"},{"name":"Vertex AI"},{"name":"LiteLLM"},{"name":"LangGraph"},{"name":"OpenAI Agents"},{"name":"CrewAI"},{"name":"Vercel AI"},{"name":"OpenTelemetry"},{"name":"VS Code"},{"name":"Slack"},{"name":"Teams"},{"name":"Microsoft Teams","native":true,"category":"notifications","direction":"outbound"},{"name":"Okta","native":true,"category":"identity","direction":"inbound"},{"name":"Microsoft Entra","native":true,"category":"identity","direction":"inbound"},{"name":"Google Vertex AI","native":false,"category":"models","direction":"outbound"},{"name":"Codex","native":true,"category":"ai-tools","direction":"bidirectional"}]` | `[{"name":"OpenAI"},{"name":"Anthropic"},{"name":"Google (Gemini)"},{"name":"DeepSeek"},{"name":"MCP (Model Context Protocol)"},{"name":"CI/CD pipelines"},{"name":"Webhooks"},{"name":"Agent frameworks"},{"name":"CI/CD platforms"},{"name":"GitHub"},{"name":"Python providers"},{"name":"Azure","native":true,"category":"llm"},{"name":"Bedrock","native":true,"category":"llm"},{"name":"Ollama","native":true,"category":"llm"},{"name":"Gemini"}]` |
| market.availability | `{"hqCountry":"NL","primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` | `{"hqCountry":"US","primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` |
| platform.support | `{"cli":true,"web":true}` | `{"cli":true}` |
| pricing | `{"type":"subscription","plans":[{"free":true,"name":"Pay-as-you-go","summary":"Free tier with 100k spans/mo, 1GB data/mo, 500 agent runs/mo. Studio seats €35/month. Usage-based billing after free allowances.","features":["100k spans/month included","1 GB data/month included","500 agent runs/month included","Unlimited gateway seats (API key users, no per-seat charge)","Studio seats at €35/month (optional, for interface access)","All platform features unlocked from day one","Evaluation tools and custom evaluators","RAG support","Routing rules, failovers, and retries","Audit logs and cost attribution by team/user","PII redaction and response masking","Auto Router optimization","Multi-agent systems with versioning","OpenTelemetry native support","Rate limiting and budget controls"],"commitment":"monthly","components":[{"kind":"fixed","amount":35,"period":"month","currency":"EUR"}],"description":"Free tier includes 100k spans, 1GB data, and 500 agent runs monthly. Add Studio seats and pay for usage above free allowances.","contactSales":false,"includedLimits":{"data":"1 GB/mo","spans":"100k/mo","agent_runs":"500/mo","request_routing":"1M free then 4%"}},{"free":false,"name":"Enterprise","summary":"Custom enterprise pricing. Contact sales for volume discounts and deployment options.","features":["Custom volume pricing and committed contracts","Enterprise SSO (Okta, Microsoft, SAML/OIDC)","SSO enforcement","Fine-grained RBAC","Dedicated Slack channel support","On-premise deployment (Helm chart)","VPC deployment on AWS/Azure","Air-gapped environment support","Annual commitment discounts","Custom contracts and redlines","Startup, nonprofit, and educational discounts available"],"commitment":"annual","description":"Custom pricing for large volumes, enterprise security features, on-premise and VPC deployment options, and dedicated support.","contactSales":true}],"summary":"Free tier (100k spans/mo, 1GB/mo, 500 agent runs/mo). Studio seats €35/month. Usage-based billing beyond free tier. Enterprise custom pricing.","currency":"EUR","freeTier":true,"sourceUrl":"https://orq.ai/pricing","retrievedAt":"2026-10-02T16:19:29.861Z","billingPeriods":["month","year"]}` | `{"type":"hybrid","plans":[{"free":true,"name":"Community","features":["All LLM evaluation features","All model providers and integrations","Red teaming (10k probes/month)","Custom integration with your own app","Run locally or self-host on your own infrastructure","Vulnerability scanning","Community support"],"components":[{"kind":"fixed","amount":0,"period":"month","currency":"USD"}],"description":"Open-source version for individual developers and small teams","contactSales":false,"includedLimits":{"red_teaming_probes":"10k/mo"}},{"free":false,"name":"Enterprise","features":["All Community features","Custom red teaming limits","Team sharing & collaboration","Continuous monitoring","Centralized security/compliance dashboard","Customizable attack profiles and target settings","SSO and granular permission profiles","Promptfoo API access","Managed cloud deployment","Professional services support","Priority support & SLA guarantees"],"description":"Managed cloud platform with team collaboration, continuous monitoring, and compliance features","contactSales":true},{"free":false,"name":"On-Premise","features":["Complete data isolation","On-premise deployment"],"description":"Custom deployment for organizations requiring full control over infrastructure","contactSales":true}],"summary":"Free open-source Community tier; Enterprise and On-Premise plans with custom pricing","currency":"USD","freeTier":true,"sourceUrl":"https://www.promptfoo.dev/pricing/","retrievedAt":"2026-08-19T18:21:49.377Z"}` |
| pricing.free_tier | yes | yes |
| pricing.model | freemium | open_source |
| pricing.price_level | low | free |
| pricing.starting_price | `{"amount":35,"currency":"EUR"}` | - |
| pricing.transparent | yes | yes |
| reliability.sla_pct | 99.99 | - |
| security.certifications | `[{"name":"SOC 2 Type II","level":"Type II","status":"active"},{"name":"ISO 27001","status":"active"}]` | - |
| security.gdpr | yes | - |
| security.iso27001 | yes | yes |
| security.soc2 | yes | yes |
| security.trust_center | https://trust.orq.ai | https://www.promptfoo.dev/blog/tags/security-vulnerability/ |

## Capabilities (Prompt Management)

| Capability | Orq.ai | Promptfoo |
|---|:--:|:--:|
| **Capabilities** |  |  |
| Versioning model | UI hosted registry | UI hosted registry |
| Diff and rollback | ✓ | - |
| Deploy without redeploy | - | - |
| Non engineer editing | ✓ | ✗ |
| Multi model playground | ✓ | ✓ |
| Ab testing | ✓ | - |
| LLM judge or human eval | ✓ | ✓ |
| Multi step flows | ✓ | - |
| Approval workflow | ✓ | - |
| Tracing included | ✓ | - |
| Self hostable | ✓ | ✓ |
| Deployment model | Managed SaaS | Self hosted |
| Pricing model | Usage/seat based saas | Open source self host |

*Source: vioscaleAI. Generated 2026-10-16T17:47:46.493Z. "-" = undocumented, not absent.*