# Promptfoo vs Rivet

**Leader by Vioscale score:** Promptfoo

| Attribute | Promptfoo | Rivet |
|---|---|---|
| **Vioscale score** | 54.4 (55% (medium)) | 41.4 (32% (low)) |
| activity.commits_last_30d | - | 3 |
| adoption.dependent_repos | - | 0 |
| adoption.github_stars | - | 4,680 |
| deployment.options | `{"cloud":true,"hybrid":true,"on_prem":true,"self_hosted":true}` | `{"self_hosted":true}` |
| description.long | A comprehensive LLM security testing solution that automatically scans for vulnerabilities such as prompt injections and jailbreaks through dynamic red teaming. Offers both open-source software for local testing and enterprise SaaS with team collaboration, continuous monitoring, and compliance dashboards. | An open-source desktop tool for building interconnected language model workflows through a graphical interface. The generated systems can be embedded directly into applications using the included TypeScript library. |
| features.capabilities | `{"soc2_type_ii":true,"self_hostable":true,"versioning_model":"UI-hosted registry","non_engineer_editing":false,"llm_judge_or_human_eval":true,"llm_as_a_judge_prompt_grading_framework":true,"ci_cd_github_actions_pipeline_blocking_gates":true,"deterministic_regex_and_json_schema_assertions":true,"red_teaming_and_adversarial_vulnerability_scanning":true}` | `{"pricing_model":"open-source-self-host","self_hostable":true,"deployment_model":"self-hosted","multi_step_flows":true,"non_engineer_editing":true,"multi_model_playground":true}` |
| integrations.count | 6 | 8 |
| integrations.list | `[{"name":"OpenAI"},{"name":"Anthropic"},{"name":"Google (Gemini)"},{"name":"DeepSeek"},{"name":"MCP (Model Context Protocol)"},{"name":"CI/CD pipelines"},{"name":"Webhooks"},{"name":"Agent frameworks"},{"name":"CI/CD platforms"},{"name":"GitHub"},{"name":"Python providers"}]` | `[{"name":"OpenAI GPT-3.5"},{"name":"OpenAI GPT-4"},{"name":"Anthropic Claude Instant"},{"name":"Anthropic Claude 2"},{"name":"Anthropic Claude 3 Haiku"},{"name":"Anthropic Claude 3 Sonnet"},{"name":"Anthropic Claude 3 Opus"},{"name":"Google Gemini"}]` |
| language.primary | - | TypeScript |
| license.spdx | - | MIT |
| market.availability | `{"hqCountry":"US","primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` | - |
| platform.support | `{"cli":true,"web":true}` | `{"mac":true,"linux":true,"windows":true}` |
| pricing | `{"type":"hybrid","plans":[{"free":true,"name":"Community","features":["All LLM evaluation features","All model providers and integrations","Red teaming (10k probes/month)","Custom integration with your own app","Run locally or self-host on your own infrastructure","Vulnerability scanning","Community support"],"components":[{"kind":"fixed","amount":0,"period":"month","currency":"USD"}],"description":"Open-source version for individual developers and small teams","contactSales":false,"includedLimits":{"red_teaming_probes":"10k/mo"}},{"free":false,"name":"Enterprise","features":["All Community features","Custom red teaming limits","Team sharing & collaboration","Continuous monitoring","Centralized security/compliance dashboard","Customizable attack profiles and target settings","SSO and granular permission profiles","Promptfoo API access","Managed cloud deployment","Professional services support","Priority support & SLA guarantees"],"description":"Managed cloud platform with team collaboration, continuous monitoring, and compliance features","contactSales":true},{"free":false,"name":"On-Premise","features":["Complete data isolation","On-premise deployment"],"description":"Custom deployment for organizations requiring full control over infrastructure","contactSales":true}],"summary":"Free open-source Community tier; Enterprise and On-Premise plans with custom pricing","currency":"USD","freeTier":true,"sourceUrl":"https://www.promptfoo.dev/pricing/","retrievedAt":"2026-08-19T18:21:49.377Z"}` | `{"type":"open_source","freeTier":true,"sourceUrl":"https://rivet.ironcladapp.com","retrievedAt":"2026-08-21T11:00:25.337Z"}` |
| pricing.free_tier | yes | yes |
| pricing.model | freemium | open_source |
| pricing.price_level | low | free |
| pricing.transparent | no | yes |
| release.cadence_days | - | 3 |
| release.history | - | `[{"url":"https://github.com/Ironclad/rivet/releases/tag/app-v1.11.3","date":"2025-08-08T22:18:18Z","type":"stable","version":"app-v1.11.3"},{"url":"https://github.com/Ironclad/rivet/releases/tag/v1.25.0","date":"2025-06-30T18:29:50Z","type":"stable","version":"v1.25.0"},{"url":"https://github.com/Ironclad/rivet/releases/tag/app-v1.11.2","date":"2025-06-02T02:58:10Z","type":"stable","version":"app-v1.11.2"},{"url":"https://github.com/Ironclad/rivet/releases/tag/app-v1.11.1","date":"2025-05-29T17:25:25Z","type":"stable","version":"app-v1.11.1"},{"url":"https://github.com/Ironclad/rivet/releases/tag/v1.24.0","date":"2025-05-28T17:57:25Z","type":"stable","version":"v1.24.0"},{"url":"https://github.com/Ironclad/rivet/releases/tag/app-v1.11.0","date":"2025-05-28T17:48:06Z","type":"stable","version":"app-v1.11.0"},{"url":"https://github.com/Ironclad/rivet/releases/tag/app-v1.10.1","date":"2025-02-17T21:19:04Z","type":"stable","version":"app-v1.10.1"},{"url":"https://github.com/Ironclad/rivet/releases/tag/v1.21.0","date":"2025-02-13T21:21:42Z","type":"stable","version":"v1.21.0"},{"url":"https://github.com/Ironclad/rivet/releases/tag/app-v1.10.0","date":"2025-02-13T19:58:00Z","type":"stable","version":"app-v1.10.0"},{"url":"https://github.com/Ironclad/rivet/releases/tag/app-v1.10.0-beta.1","date":"2025-02-12T07:01:32Z","type":"prerelease","version":"app-v1.10.0-beta.1"},{"url":"https://github.com/Ironclad/rivet/releases/tag/v1.20.3","date":"2025-01-30T18:51:59Z","type":"stable","version":"v1.20.3"},{"url":"https://github.com/Ironclad/rivet/releases/tag/v1.20.2","date":"2025-01-22T19:59:15Z","type":"stable","version":"v1.20.2"},{"url":"https://github.com/Ironclad/rivet/releases/tag/v1.20.1","date":"2025-01-02T19:41:21Z","type":"stable","version":"v1.20.1"},{"url":"https://github.com/Ironclad/rivet/releases/tag/v1.20.0","date":"2024-10-02T18:25:33Z","type":"stable","version":"v1.20.0"},{"url":"https://github.com/Ironclad/rivet/releases/tag/app-v1.9.0","date":"2024-10-02T18:40:25Z","type":"stable","version":"app-v1.9.0"},{"url":"https://github.com/Ironclad/rivet/releases/tag/app-v1.8.0","date":"2024-08-02T18:20:43Z","type":"stable","version":"app-v1.8.0"},{"url":"https://github.com/Ironclad/rivet/releases/tag/v1.19.1","date":"2024-07-31T22:52:56Z","type":"stable","version":"v1.19.1"},{"url":"https://github.com/Ironclad/rivet/releases/tag/v1.19.0","date":"2024-07-31T22:52:32Z","type":"stable","version":"v1.19.0"},{"url":"https://github.com/Ironclad/rivet/releases/tag/v1.18.1","date":"2024-05-10T19:12:29Z","type":"stable","version":"v1.18.1"},{"url":"https://github.com/Ironclad/rivet/releases/tag/app-v1.7.12","date":"2024-05-10T22:28:45Z","type":"stable","version":"app-v1.7.12"}]` |
| security.iso27001 | yes | - |
| security.soc2 | yes | - |
| security.vulnerabilities | - | `{"count":0,"source":"https://advisories.ecosyste.ms/api/v1/advisories?ecosystem=npm&package_name=%40griders%2Frivet-app&per_page=100","last_12m":0,"max_severity":null}` |

## Capabilities (Prompt Management)

| Capability | Promptfoo | Rivet |
|---|:--:|:--:|
| **Capabilities** |  |  |
| Versioning model | UI hosted registry | - |
| Diff and rollback | - | - |
| Deploy without redeploy | - | - |
| Non engineer editing | ✗ | ✓ |
| Multi model playground | - | ✓ |
| Ab testing | - | - |
| LLM judge or human eval | ✓ | - |
| Multi step flows | - | ✓ |
| Approval workflow | - | - |
| Tracing included | - | - |
| Self hostable | ✓ | ✓ |
| Deployment model | - | Self hosted |
| Pricing model | - | Open source self host |

*Source: Vioscale. Generated 2026-09-01T14:39:21.697Z. "-" = undocumented, not absent.*