# Microsoft Prompt Flow vs Promptfoo

**Leader by Vioscale score:** Promptfoo

| Attribute | Microsoft Prompt Flow | Promptfoo |
|---|---|---|
| **Vioscale score** | 30.3 (16% (low)) | 54.4 (55% (medium)) |
| activity.commits_last_30d | 0 | - |
| adoption.dependent_repos | 1 | - |
| adoption.github_stars | 11,229 | - |
| deployment.options | `{"cloud":true,"self_hosted":true}` | `{"cloud":true,"hybrid":true,"on_prem":true,"self_hosted":true}` |
| description.long | Provides integrated tools for the complete development lifecycle of AI applications powered by large language models, from initial design through prototyping, testing, evaluation, and production deployment with monitoring. | A comprehensive LLM security testing solution that automatically scans for vulnerabilities such as prompt injections and jailbreaks through dynamic red teaming. Offers both open-source software for local testing and enterprise SaaS with team collaboration, continuous monitoring, and compliance dashboards. |
| features.capabilities | - | `{"soc2_type_ii":true,"self_hostable":true,"versioning_model":"UI-hosted registry","non_engineer_editing":false,"llm_judge_or_human_eval":true,"llm_as_a_judge_prompt_grading_framework":true,"ci_cd_github_actions_pipeline_blocking_gates":true,"deterministic_regex_and_json_schema_assertions":true,"red_teaming_and_adversarial_vulnerability_scanning":true}` |
| integrations.count | - | 6 |
| integrations.list | - | `[{"name":"OpenAI"},{"name":"Anthropic"},{"name":"Google (Gemini)"},{"name":"DeepSeek"},{"name":"MCP (Model Context Protocol)"},{"name":"CI/CD pipelines"},{"name":"Webhooks"},{"name":"Agent frameworks"},{"name":"CI/CD platforms"},{"name":"GitHub"},{"name":"Python providers"}]` |
| language.primary | Python | - |
| license.spdx | MIT | - |
| market.availability | - | `{"hqCountry":"US","primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` |
| platform.support | `{"cli":true}` | `{"cli":true,"web":true}` |
| pricing | - | `{"type":"hybrid","plans":[{"free":true,"name":"Community","features":["All LLM evaluation features","All model providers and integrations","Red teaming (10k probes/month)","Custom integration with your own app","Run locally or self-host on your own infrastructure","Vulnerability scanning","Community support"],"components":[{"kind":"fixed","amount":0,"period":"month","currency":"USD"}],"description":"Open-source version for individual developers and small teams","contactSales":false,"includedLimits":{"red_teaming_probes":"10k/mo"}},{"free":false,"name":"Enterprise","features":["All Community features","Custom red teaming limits","Team sharing & collaboration","Continuous monitoring","Centralized security/compliance dashboard","Customizable attack profiles and target settings","SSO and granular permission profiles","Promptfoo API access","Managed cloud deployment","Professional services support","Priority support & SLA guarantees"],"description":"Managed cloud platform with team collaboration, continuous monitoring, and compliance features","contactSales":true},{"free":false,"name":"On-Premise","features":["Complete data isolation","On-premise deployment"],"description":"Custom deployment for organizations requiring full control over infrastructure","contactSales":true}],"summary":"Free open-source Community tier; Enterprise and On-Premise plans with custom pricing","currency":"USD","freeTier":true,"sourceUrl":"https://www.promptfoo.dev/pricing/","retrievedAt":"2026-08-19T18:21:49.377Z"}` |
| pricing.free_tier | - | yes |
| pricing.model | - | freemium |
| pricing.price_level | - | low |
| pricing.transparent | - | no |
| release.cadence_days | 13 | - |
| release.history | `[{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.17.1","date":"2025-01-09T21:00:17Z","type":"stable","version":"promptflow_1.17.1"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.17.0","date":"2025-01-06T20:04:04Z","type":"stable","version":"promptflow_1.17.0"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.16.2","date":"2024-11-25T21:07:56Z","type":"stable","version":"promptflow_1.16.2"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.16.1","date":"2024-10-08T18:55:50Z","type":"stable","version":"promptflow_1.16.1"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.16.0","date":"2024-09-30T16:42:02Z","type":"stable","version":"promptflow_1.16.0"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.15.0.post1","date":"2024-09-23T18:57:51Z","type":"stable","version":"promptflow_1.15.0.post1"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.15.0","date":"2024-08-15T05:56:00Z","type":"stable","version":"promptflow_1.15.0"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.14.0","date":"2024-07-26T02:57:50Z","type":"stable","version":"promptflow_1.14.0"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.12.0","date":"2024-06-11T08:58:23Z","type":"stable","version":"promptflow_1.12.0"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.11.0","date":"2024-05-17T07:13:07Z","type":"stable","version":"promptflow_1.11.0"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.10.1","date":"2024-05-10T08:29:44Z","type":"stable","version":"promptflow_1.10.1"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.10.0","date":"2024-04-26T14:28:24Z","type":"stable","version":"promptflow_1.10.0"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.9.0","date":"2024-04-17T11:06:50Z","type":"stable","version":"promptflow_1.9.0"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.8.0","date":"2024-04-10T11:57:28Z","type":"stable","version":"promptflow_1.8.0"},{"url":"https://github.com/microsoft/promptflow/releases/tag/v1.4.0-tools","date":"2024-03-26T10:13:11Z","type":"stable","version":"v1.4.0-tools"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.7.0","date":"2024-03-25T02:47:56Z","type":"stable","version":"promptflow_1.7.0"},{"url":"https://github.com/microsoft/promptflow/releases/tag/v1.3.0-tools","date":"2024-03-01T10:08:22Z","type":"stable","version":"v1.3.0-tools"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.6.0","date":"2024-03-01T09:34:19Z","type":"stable","version":"promptflow_1.6.0"},{"url":"https://github.com/microsoft/promptflow/releases/tag/v1.2.0-tools","date":"2024-02-07T02:40:43Z","type":"stable","version":"v1.2.0-tools"},{"url":"https://github.com/microsoft/promptflow/releases/tag/promptflow_1.5.0","date":"2024-02-06T10:56:28Z","type":"stable","version":"promptflow_1.5.0"}]` | - |
| security.iso27001 | - | yes |
| security.soc2 | - | yes |
| security.vulnerabilities | `{"count":0,"source":"https://advisories.ecosyste.ms/api/v1/advisories?ecosystem=pypi&package_name=promptflow&per_page=100","last_12m":0,"max_severity":null}` | - |

## Capabilities (Prompt Management)

| Capability | Microsoft Prompt Flow | Promptfoo |
|---|:--:|:--:|
| **Capabilities** |  |  |
| Versioning model | - | UI hosted registry |
| Diff and rollback | - | - |
| Deploy without redeploy | - | - |
| Non engineer editing | - | ✗ |
| Multi model playground | - | - |
| Ab testing | - | - |
| LLM judge or human eval | - | ✓ |
| Multi step flows | - | - |
| Approval workflow | - | - |
| Tracing included | - | - |
| Self hostable | - | ✓ |
| Deployment model | - | - |
| Pricing model | - | - |

*Source: Vioscale. Generated 2026-09-01T17:30:40.801Z. "-" = undocumented, not absent.*
