# Promptfoo vs Vellum

**Leader by Vioscale score:** Vellum

| Attribute | Promptfoo | Vellum |
|---|---|---|
| **Vioscale score** | 54.4 (55% (medium)) | 66.9 (37% (low)) |
| deployment.options | `{"cloud":true,"hybrid":true,"on_prem":true,"self_hosted":true}` | `{"cloud":true}` |
| description.long | A comprehensive LLM security testing solution that automatically scans for vulnerabilities such as prompt injections and jailbreaks through dynamic red teaming. Offers both open-source software for local testing and enterprise SaaS with team collaboration, continuous monitoring, and compliance dashboards. | A cloud-based AI assistant that maintains continuous context about your preferences and history, accessible via web, desktop, mobile, and messaging platforms, capable of automating tasks like email, calendar management, and web browsing with your explicit approval for each action. |
| features.capabilities | `{"soc2_type_ii":true,"self_hostable":true,"versioning_model":"UI-hosted registry","non_engineer_editing":false,"llm_judge_or_human_eval":true,"llm_as_a_judge_prompt_grading_framework":true,"ci_cd_github_actions_pipeline_blocking_gates":true,"deterministic_regex_and_json_schema_assertions":true,"red_teaming_and_adversarial_vulnerability_scanning":true}` | `{"pricing_model":"usage/seat-based-saas","deployment_model":"managed-SaaS","multi_step_flows":true,"approval_workflow":true,"non_engineer_editing":true}` |
| integrations.count | 6 | 11 |
| integrations.list | `[{"name":"OpenAI"},{"name":"Anthropic"},{"name":"Google (Gemini)"},{"name":"DeepSeek"},{"name":"MCP (Model Context Protocol)"},{"name":"CI/CD pipelines"},{"name":"Webhooks"},{"name":"Agent frameworks"},{"name":"CI/CD platforms"},{"name":"GitHub"},{"name":"Python providers"}]` | `[{"name":"Gmail"},{"name":"Google Calendar"},{"name":"Slack"},{"name":"Telegram"},{"name":"Web browsing"},{"name":"Computer control"},{"name":"Phone calls"},{"name":"Image generation"},{"name":"Coding"},{"name":"App building"},{"name":"Task management"}]` |
| market.availability | `{"hqCountry":"US","primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` | `{"primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` |
| platform.support | `{"cli":true,"web":true}` | `{"cli":true,"ios":true,"mac":true,"web":true}` |
| pricing | `{"type":"hybrid","plans":[{"free":true,"name":"Community","features":["All LLM evaluation features","All model providers and integrations","Red teaming (10k probes/month)","Custom integration with your own app","Run locally or self-host on your own infrastructure","Vulnerability scanning","Community support"],"components":[{"kind":"fixed","amount":0,"period":"month","currency":"USD"}],"description":"Open-source version for individual developers and small teams","contactSales":false,"includedLimits":{"red_teaming_probes":"10k/mo"}},{"free":false,"name":"Enterprise","features":["All Community features","Custom red teaming limits","Team sharing & collaboration","Continuous monitoring","Centralized security/compliance dashboard","Customizable attack profiles and target settings","SSO and granular permission profiles","Promptfoo API access","Managed cloud deployment","Professional services support","Priority support & SLA guarantees"],"description":"Managed cloud platform with team collaboration, continuous monitoring, and compliance features","contactSales":true},{"free":false,"name":"On-Premise","features":["Complete data isolation","On-premise deployment"],"description":"Custom deployment for organizations requiring full control over infrastructure","contactSales":true}],"summary":"Free open-source Community tier; Enterprise and On-Premise plans with custom pricing","currency":"USD","freeTier":true,"sourceUrl":"https://www.promptfoo.dev/pricing/","retrievedAt":"2026-08-19T18:21:49.377Z"}` | `{"type":"hybrid","plans":[{"free":true,"name":"Free","summary":"Free with starter credits","features":["Free starter credits","Multi-platform access","Memory and context"],"description":"Free credits to start","contactSales":false},{"free":false,"name":"Paid","summary":"$30/mo","features":["Larger machine","More storage","Bundled credits"],"commitment":"monthly","components":[{"kind":"fixed","amount":30,"period":"month","currency":"USD"}],"description":"Larger machine, more storage, bundled credits","contactSales":false}],"summary":"Free tier with credits, paid plans from $30/mo","currency":"USD","freeTier":true,"sourceUrl":"https://vellum.ai","retrievedAt":"2026-08-21T13:54:36.865Z","startingPrice":{"amount":30,"period":"month","currency":"USD"},"billingPeriods":["month"]}` |
| pricing.free_tier | yes | yes |
| pricing.model | freemium | freemium |
| pricing.price_level | low | mid |
| pricing.starting_price | - | `{"amount":30,"currency":"USD"}` |
| pricing.transparent | no | yes |
| security.iso27001 | yes | - |
| security.soc2 | yes | - |

## Capabilities (Prompt Management)

| Capability | Promptfoo | Vellum |
|---|:--:|:--:|
| **Capabilities** |  |  |
| Versioning model | UI hosted registry | - |
| Diff and rollback | - | - |
| Deploy without redeploy | - | - |
| Non engineer editing | ✗ | ✓ |
| Multi model playground | - | - |
| Ab testing | - | - |
| LLM judge or human eval | ✓ | - |
| Multi step flows | - | ✓ |
| Approval workflow | - | ✓ |
| Tracing included | - | - |
| Self hostable | ✓ | - |
| Deployment model | - | Managed SaaS |
| Pricing model | - | Usage/seat based saas |

*Source: Vioscale. Generated 2026-09-01T16:50:39.296Z. "-" = undocumented, not absent.*