# Orq.ai vs Promptfoo

**Leader by Vioscale score:** Orq.ai

| Attribute | Orq.ai | Promptfoo |
|---|---|---|
| **Vioscale score** | 74.4 (55% (medium)) | 54.4 (55% (medium)) |
| deployment.options | `{"cloud":true,"hybrid":true,"on_prem":true,"air_gapped":true,"self_hosted":true}` | `{"cloud":true,"hybrid":true,"on_prem":true,"self_hosted":true}` |
| description.long | Orq.ai is an AI gateway platform that routes requests across 500+ models from 30+ providers through a single OpenAI-compatible API. It includes built-in observability for tracing every request, governance tools for compliance and cost management, and support for managing agents. The platform supports cloud, hybrid, and on-premises deployment options. | A comprehensive LLM security testing solution that automatically scans for vulnerabilities such as prompt injections and jailbreaks through dynamic red teaming. Offers both open-source software for local testing and enterprise SaaS with team collaboration, continuous monitoring, and compliance dashboards. |
| features.capabilities | `{"ab_testing":true,"pricing_model":"usage/seat-based-saas","self_hostable":true,"deployment_model":"managed-SaaS","multi_step_flows":true,"tracing_included":true,"versioning_model":"UI-hosted registry","approval_workflow":true,"diff_and_rollback":true,"non_engineer_editing":true,"multi_model_playground":true,"llm_judge_or_human_eval":true}` | `{"soc2_type_ii":true,"self_hostable":true,"versioning_model":"UI-hosted registry","non_engineer_editing":false,"llm_judge_or_human_eval":true,"llm_as_a_judge_prompt_grading_framework":true,"ci_cd_github_actions_pipeline_blocking_gates":true,"deterministic_regex_and_json_schema_assertions":true,"red_teaming_and_adversarial_vulnerability_scanning":true}` |
| integrations.count | 15 | 6 |
| integrations.list | `[{"name":"OpenAI"},{"name":"Anthropic"},{"name":"Google"},{"name":"Mistral"},{"name":"Azure AI Foundry"},{"name":"Vertex AI"},{"name":"LiteLLM"},{"name":"LangGraph"},{"name":"OpenAI Agents"},{"name":"CrewAI"},{"name":"Vercel AI"},{"name":"OpenTelemetry"},{"name":"VS Code"},{"name":"Slack"},{"name":"Teams"}]` | `[{"name":"OpenAI"},{"name":"Anthropic"},{"name":"Google (Gemini)"},{"name":"DeepSeek"},{"name":"MCP (Model Context Protocol)"},{"name":"CI/CD pipelines"},{"name":"Webhooks"},{"name":"Agent frameworks"},{"name":"CI/CD platforms"},{"name":"GitHub"},{"name":"Python providers"}]` |
| market.availability | `{"hqCountry":"NL","primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` | `{"hqCountry":"US","primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` |
| platform.support | `{"web":true}` | `{"cli":true,"web":true}` |
| pricing | `{"type":"subscription","plans":[{"free":false,"name":"Pay-as-you-go","summary":"€35/studio seat/month + 4% platform fee on top of provider costs. 1M requests/month free to start.","features":["500+ models from 30+ providers","OpenAI-compatible API","Full request tracing and observability","Cost and token tracking","Routing policies and fallbacks","Caching and load balancing","Agent management and versioning","Evaluation and benchmarking tools","GDPR and EU AI Act compliance tools","PII redaction and data masking","Slack and webhook alerts","Cloud deployment included"],"commitment":"monthly","components":[{"kind":"per_unit","unit":"studio seat","amount":35,"period":"month","currency":"EUR"},{"of":"provider model costs","kind":"percentage","rate":4}],"description":"Start with 1M free requests per month and included spans, data, and agent runs. Add studio seats at €35/seat/month as needed.","contactSales":false,"includedLimits":{"data":"1GB","spans":"100k","requests":"1M/month","agent_runs":"500"}},{"free":false,"name":"Enterprise","features":["Custom volume pricing","Enterprise SSO (Okta, Microsoft)","SAML/OIDC","Fine-grained RBAC","VPC and on-premises deployment","Air-gapped environments","Dedicated Slack channel","Custom SLA","Data residency options (EU, US, or custom)"],"commitment":"annual","description":"Custom deployment, security, and support options for organizations with specific governance and scale requirements.","contactSales":true}],"summary":"Pay-as-you-go with 1M free requests/month (€35 per studio seat/month + 4% platform fee), or Enterprise with custom pricing","currency":"EUR","freeTier":true,"sourceUrl":"https://orq.ai/pricing","retrievedAt":"2026-08-21T11:11:51.980Z","startingPrice":{"unit":"studio seat","amount":35,"period":"month","currency":"EUR"},"billingPeriods":["month"]}` | `{"type":"hybrid","plans":[{"free":true,"name":"Community","features":["All LLM evaluation features","All model providers and integrations","Red teaming (10k probes/month)","Custom integration with your own app","Run locally or self-host on your own infrastructure","Vulnerability scanning","Community support"],"components":[{"kind":"fixed","amount":0,"period":"month","currency":"USD"}],"description":"Open-source version for individual developers and small teams","contactSales":false,"includedLimits":{"red_teaming_probes":"10k/mo"}},{"free":false,"name":"Enterprise","features":["All Community features","Custom red teaming limits","Team sharing & collaboration","Continuous monitoring","Centralized security/compliance dashboard","Customizable attack profiles and target settings","SSO and granular permission profiles","Promptfoo API access","Managed cloud deployment","Professional services support","Priority support & SLA guarantees"],"description":"Managed cloud platform with team collaboration, continuous monitoring, and compliance features","contactSales":true},{"free":false,"name":"On-Premise","features":["Complete data isolation","On-premise deployment"],"description":"Custom deployment for organizations requiring full control over infrastructure","contactSales":true}],"summary":"Free open-source Community tier; Enterprise and On-Premise plans with custom pricing","currency":"USD","freeTier":true,"sourceUrl":"https://www.promptfoo.dev/pricing/","retrievedAt":"2026-08-19T18:21:49.377Z"}` |
| pricing.free_tier | yes | yes |
| pricing.model | freemium | freemium |
| pricing.price_level | mid | low |
| pricing.starting_price | `{"amount":35,"currency":"EUR"}` | - |
| pricing.transparent | yes | no |
| security.gdpr | yes | - |
| security.iso27001 | yes | yes |
| security.soc2 | yes | yes |

## Capabilities (Prompt Management)

| Capability | Orq.ai | Promptfoo |
|---|:--:|:--:|
| **Capabilities** |  |  |
| Versioning model | UI hosted registry | UI hosted registry |
| Diff and rollback | ✓ | - |
| Deploy without redeploy | - | - |
| Non engineer editing | ✓ | ✗ |
| Multi model playground | ✓ | - |
| Ab testing | ✓ | - |
| LLM judge or human eval | ✓ | ✓ |
| Multi step flows | ✓ | - |
| Approval workflow | ✓ | - |
| Tracing included | ✓ | - |
| Self hostable | ✓ | ✓ |
| Deployment model | Managed SaaS | - |
| Pricing model | Usage/seat based saas | - |

*Source: Vioscale. Generated 2026-09-01T15:17:59.045Z. "-" = undocumented, not absent.*