# Promptfoo vs Promptmetheus

| Attribute | Promptfoo | Promptmetheus |
|---|---|---|
| **Vioscale score** | 54.4 (55% (medium)) | 55.1 (66% (medium)) |
| deployment.options | `{"cloud":true,"hybrid":true,"on_prem":true,"self_hosted":true}` | `{"cloud":true}` |
| description.long | A comprehensive LLM security testing solution that automatically scans for vulnerabilities such as prompt injections and jailbreaks through dynamic red teaming. Offers both open-source software for local testing and enterprise SaaS with team collaboration, continuous monitoring, and compliance dashboards. | A platform for building structured prompts through modular components, testing across 150+ language models, evaluating outputs, and enabling teams to collaboratively develop shared prompt libraries and workflows. |
| features.capabilities | `{"soc2_type_ii":true,"self_hostable":true,"versioning_model":"UI-hosted registry","non_engineer_editing":false,"llm_judge_or_human_eval":true,"llm_as_a_judge_prompt_grading_framework":true,"ci_cd_github_actions_pipeline_blocking_gates":true,"deterministic_regex_and_json_schema_assertions":true,"red_teaming_and_adversarial_vulnerability_scanning":true}` | `{"ab_testing":true,"pricing_model":"usage/seat-based-saas","deployment_model":"managed-SaaS","multi_step_flows":true,"tracing_included":true,"versioning_model":"UI-hosted registry","diff_and_rollback":true,"non_engineer_editing":true,"multi_model_playground":true,"llm_judge_or_human_eval":true}` |
| integrations.count | 6 | - |
| integrations.list | `[{"name":"OpenAI"},{"name":"Anthropic"},{"name":"Google (Gemini)"},{"name":"DeepSeek"},{"name":"MCP (Model Context Protocol)"},{"name":"CI/CD pipelines"},{"name":"Webhooks"},{"name":"Agent frameworks"},{"name":"CI/CD platforms"},{"name":"GitHub"},{"name":"Python providers"}]` | - |
| market.availability | `{"hqCountry":"US","primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` | `{"primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` |
| platform.support | `{"cli":true,"web":true}` | `{"web":true}` |
| pricing | `{"type":"hybrid","plans":[{"free":true,"name":"Community","features":["All LLM evaluation features","All model providers and integrations","Red teaming (10k probes/month)","Custom integration with your own app","Run locally or self-host on your own infrastructure","Vulnerability scanning","Community support"],"components":[{"kind":"fixed","amount":0,"period":"month","currency":"USD"}],"description":"Open-source version for individual developers and small teams","contactSales":false,"includedLimits":{"red_teaming_probes":"10k/mo"}},{"free":false,"name":"Enterprise","features":["All Community features","Custom red teaming limits","Team sharing & collaboration","Continuous monitoring","Centralized security/compliance dashboard","Customizable attack profiles and target settings","SSO and granular permission profiles","Promptfoo API access","Managed cloud deployment","Professional services support","Priority support & SLA guarantees"],"description":"Managed cloud platform with team collaboration, continuous monitoring, and compliance features","contactSales":true},{"free":false,"name":"On-Premise","features":["Complete data isolation","On-premise deployment"],"description":"Custom deployment for organizations requiring full control over infrastructure","contactSales":true}],"summary":"Free open-source Community tier; Enterprise and On-Premise plans with custom pricing","currency":"USD","freeTier":true,"sourceUrl":"https://www.promptfoo.dev/pricing/","retrievedAt":"2026-08-19T18:21:49.377Z"}` | `{"type":"subscription","plans":[{"free":false,"name":"Team","summary":"$19/month per additional user","components":[{"kind":"per_unit","unit":"seat","amount":19,"period":"month","currency":"USD"}],"description":"Team collaboration with shared workspaces","contactSales":false},{"free":false,"name":"Enterprise","contactSales":true}],"summary":"7-day free trial. $19/month per additional user. Enterprise available.","currency":"USD","freeTier":false,"sourceUrl":"https://promptmetheus.com","retrievedAt":"2026-08-21T11:09:39.935Z","freeTrialDays":7,"startingPrice":{"unit":"seat","amount":19,"period":"month","currency":"USD"},"billingPeriods":["month"]}` |
| pricing.free_tier | yes | no |
| pricing.model | freemium | commercial |
| pricing.price_level | low | mid |
| pricing.starting_price | - | `{"amount":19,"currency":"USD"}` |
| pricing.transparent | no | yes |
| reliability.status_page | - | yes |
| security.gdpr | - | yes |
| security.iso27001 | yes | - |
| security.pci | - | yes |
| security.soc2 | yes | - |

## Capabilities (Prompt Management)

| Capability | Promptfoo | Promptmetheus |
|---|:--:|:--:|
| **Capabilities** |  |  |
| Versioning model | UI hosted registry | UI hosted registry |
| Diff and rollback | - | ✓ |
| Deploy without redeploy | - | - |
| Non engineer editing | ✗ | ✓ |
| Multi model playground | - | ✓ |
| Ab testing | - | ✓ |
| LLM judge or human eval | ✓ | ✓ |
| Multi step flows | - | ✓ |
| Approval workflow | - | - |
| Tracing included | - | ✓ |
| Self hostable | ✓ | - |
| Deployment model | - | Managed SaaS |
| Pricing model | - | Usage/seat based saas |

*Source: Vioscale. Generated 2026-09-01T15:18:02.416Z. "-" = undocumented, not absent.*