Promptfoo
Open-source CLI for testing and securing language model applications
- Vendor
- Promptfoo, Inc.
- Also known as
- promptfoo
Available worldwide · Popular in: US
What is Promptfoo?
Automated testing and security evaluation framework for AI applications, with support for comparing multiple model providers and identifying potential vulnerabilities through red teaming and assertion-based validation.
Promptfoo pricing
Plans, per-tier features and add-ons, dated and linked to live pricing. Pricing changes often; always verify at source before you rely on it.
Free open-source Community tier; Enterprise and On-Premise plans with custom pricing
Community
FreeOpen-source version for individual developers and small teams
- red_teaming_probes
- 10k/mo
- All LLM evaluation features
- All model providers and integrations
- Red teaming (10k probes/month)
- Custom integration with your own app
- Run locally or self-host on your own infrastructure
- Vulnerability scanning
- Community support
Enterprise
Contact salesManaged cloud platform with team collaboration, continuous monitoring, and compliance features
- All Community features
- Custom red teaming limits
- Team sharing & collaboration
- Continuous monitoring
- Centralized security/compliance dashboard
- Customizable attack profiles and target settings
- SSO and granular permission profiles
- Promptfoo API access
- Managed cloud deployment
- Professional services support
- Priority support & SLA guarantees
On-Premise
Contact salesCustom deployment for organizations requiring full control over infrastructure
- Complete data isolation
- On-premise deployment
What Promptfoo does
The capabilities that matter for prompt management, normalised so it lines up with every alternative. “-” means we haven't confirmed it, not that it's missing.
- Versioning model
- UI hosted registry
- Diff and rollback
- -
- Deploy without redeploy
- -
- Non engineer editing
- ✗
- Multi model playground
- ✓
- Ab testing
- -
- LLM judge or human eval
- ✓
- Multi step flows
- -
- Approval workflow
- -
- Tracing included
- -
- Self hostable
- ✓
- Deployment model
- Self hosted
- Pricing model
- Open source self host
Platform & deployment
Independently observed- CLI
- Self-hosted
Integrations (15)
Independently observed- Azure•
- Bedrock•
- Ollama•
- OpenAI
- Anthropic
- Google (Gemini)
- DeepSeek
- MCP (Model Context Protocol)
- CI/CD pipelines
- Webhooks
- Agent frameworks
- CI/CD platforms
- GitHub
- Python providers
- Gemini
Promptfoo FAQ
Common questions about Promptfoo, answered from independent, dated evidence.
What is Promptfoo?
A CLI and library for testing, evaluating, and red-teaming LLM applications and agents. Automatically identifies vulnerabilities through security scanning and provides remediation guidance. It is indexed under Prompt Management.
How much does Promptfoo cost?
Promptfoo does not publish its prices. Pricing is quoted on request, across 3 plans (Community, Enterprise and On-Premise), so the figure depends on your seat count and requirements. We record this as a pricing-transparency signal rather than guessing a number. Pricing changes often, so verify at source before relying on it.
What platforms does Promptfoo support?
Promptfoo supports the web and a command-line interface. Platforms we have not confirmed are simply not listed here rather than ruled out.
Can Promptfoo be self-hosted?
Yes. Promptfoo can be deployed cloud / SaaS, on-premise and self-hosted, so it does not have to run on the vendor's infrastructure.
What does Promptfoo integrate with?
We have confirmed 14 integrations for Promptfoo, including OpenAI, Anthropic, Google (Gemini), DeepSeek, MCP (Model Context Protocol), CI/CD pipelines, Webhooks and Agent frameworks, plus 6 more. This is what we could verify from public sources, so the vendor may support others we have not indexed.
What security certifications does Promptfoo have?
We have independently confirmed SOC 2 and ISO 27001 for Promptfoo. Certifications we do not list are ones we have not been able to verify from public sources, which is not the same as Promptfoo not holding them. Always confirm compliance directly before you rely on it.
Where is Promptfoo available?
Promptfoo is available worldwide. Its primary market is the United States. The vendor is headquartered in the United States.
Promptfoo alternatives
Other prompt management we track, ranked by the same independent score.
- AWS Bedrock Prompt ManagementA managed cloud platform for building and deploying generative AI applications using multiple foundation models with built-in customization and enterprise securhigh · 75%
- Orq.aiA unified gateway for routing AI requests across hundreds of models with built-in observability, cost tracking, and governance controls.medium · 74%
- PromptLayerA logging service that tracks prompts and API requests for debugging and replaymedium · 72%
- PromptHubA collaborative platform for managing, testing, and deploying AI prompts across teamslow · 25%
- LatitudeAutomated observability and fixing for AI agentslow · 22%
- VellumA personal AI assistant that runs on your device and takes real actions across your apps and fileslow · 35%
Compare Promptfoo
Side by side against other prompt management, attribute by attribute, with a source on every value.
The vioscaleAI score: one lens on the evidence
Not user reviews and not a paid placement: a confidence-weighted blend of the independent signals below (adoption, activity, security posture, and more), which you can sort and re-weight yourself. Vendors can correct their listing but can never move their rank, and stars are weighted low as a vanity metric. It is one way to read the evidence for Promptfoo, not the verdict.
| Signal | Score | Weight | Contribution | Evidence |
|---|---|---|---|---|
| Capabilities | 100 | 0.08 | 8.0 | ✓ |
| Security posture | 65 | 0.12 | 7.9 | ✓ |
| Integrations | 27 | 0.05 | 1.5 | ✓ |
| Stars | 0 | 0.05 | 0.0 | - |
| Dependent projects | 0 | 0.05 | 0.0 | - |
| Development activity | 0 | 0.14 | 0.0 | - |
| Release cadence | 0 | 0.08 | 0.0 | - |
| Package downloads | 0 | 0.04 | 0.0 | - |
| Security score | 0 | 0.05 | 0.0 | - |
| Developer Q&A activity | 0 | 0.14 | 0.0 | - |
Computed . Re-weight it by intent, or see the full method.
All data & sourcesshow ↓
Every value we hold, with its source, retrieval date, and confidence. This is the evidence behind the score: don't trust it, verify it.
Content
| Attribute | Value | Evidence |
|---|---|---|
| Faq | 7 items | mediumsource · 2026-09-10 · 64% |
Features
| Attribute | Value | Evidence |
|---|---|---|
| Capabilities | Soc2 type ii: Yes · Pricing model: open-source-self-host · Self hostable: Yes · Deployment model: self-hosted · Versioning model: UI-hosted registry · Architecture model: open_source_cli | mediumsource · 2026-10-02 · 60% |
Integrations
| Attribute | Value | Evidence |
|---|---|---|
| Count | 8 | mediumsource · 2026-10-02 · 60% |
Market
| Attribute | Value | Evidence |
|---|---|---|
| Availability | HqCountry: US · PrimaryMarkets: … · AvailabilityScope: global · AvailableCountries: … · NotAvailableCountries: … | highsource · 2026-08-21 · 75% |
Pricing
Security
Is Promptfoo the right choice for you?
Tell us the job, the constraints and what you weigh most, and we will rank Promptfoo against the rest of the prompt management we index, using the same dated evidence weighted your way.
Free to run, no account needed to start. How the evaluation works
Is this your product?
This profile was built from public sources without asking you. You can take the badge below and use it anywhere, and you can claim the profile to correct anything we got wrong. Both are free, and neither moves Promptfoo up or down: nobody can buy rank here, including you.
Take the badge
Live, always current, and free to use on your own site. It shows Promptfoo's independent score and links back to this profile.
<a href="https://www.vioscale.ai/software/promptfoo" target="_blank" rel="noopener">
<img src="https://www.vioscale.ai/badge/software/promptfoo.svg" alt="Promptfoo, verified on vioscaleAI" width="330" height="76" loading="lazy" />
</a>Markdown, for a README →
[](https://www.vioscale.ai/software/promptfoo)Claim the profile
Verify you control the domain, then point us at the pages that state the facts about Promptfoo and add your own description and media. Free, and it does not change the score.
- Correct anything wrong, with evidence
- Point our crawler at the pages that matter
- Write your own description and add media
Not the owner? How vendor profiles work