# Patronus AI

> Automated evaluation and monitoring platform for testing and optimizing language models and AI agents

- **Canonical URI:** https://www.vioscale.ai/software/patronus-ai
- **Category:** AI Evals Testing
- **Homepage:** https://patronus.ai
- **Also known as:** patronus-ai
- **Profile claimed by vendor:** no
- **Last updated:** 2026-08-21T11:20:54.922Z

## Vioscale score

**69 / 100**, confidence 37% (low). Computed 2026-09-01. _(updating — computed under an earlier model version or past its freshness window.)_

Composite of weighted, independently-sourced signals (no user reviews, no vendor payment).

| Signal | Score | Weight | Contribution | Evidence present |
|---|--:|--:|--:|:--:|
| price_level | 50 | 0.052 | 2.6 | ✓ |
| reliability | 0 | 0.073 | 0 | - |
| capabilities | 74.7 | 0.04877777777777778 | 3.6 | ✓ |
| integrations | 22.4 | 0.04066666666666666 | 0.9 | ✓ |
| security_posture | 5 | 0.073 | 0 | - |
| pricing_transparency | 100 | 0.084 | 8.4 | ✓ |

## Pricing

_As of 2026-08-21, [verify at source](https://patronus.ai/pricing). Independently observed._

from $25/mo · Hybrid · Free tier

> Free tiers available ($0/mo), paid plan from $25/mo, API pricing from $10/1k calls

| Plan | Price | Free | Commitment |
|---|---|:--:|---|
| Developer | Free | ✓ | - |
| Individual | Free | ✓ | - |
| Base | $25/month for 600 pages | - | - |
| Enterprise | Contact sales | - | - |

### Developer

Free tier for API evaluation

- $10 in free credits
- Patronus Experiments (last 2 weeks)
- Patronus Comparisons
- Patronus Datasets
- Optional Patronus API

### Individual

Free platform tier

**Included limits:** pages: 20

- 20 pages
- Customizable options
- Secure data storage
- Email support

### Base

Professional plan

**Included limits:** pages: 600

- 600 pages
- Page add-ons available
- 24/7 customer support
- Analytics and reporting
- Account Management

### Enterprise (Contact sales)

Custom enterprise solution with security and AI services

**Included limits:** pages: Unlimited

- Unlimited pages and runs
- On-premise or dedicated VPC deployment
- Custom data retention
- SSO
- Premium Platform Features (Evaluation Runs, webhooks)
- Premium API Features (higher rate limits, volume discounts)
- Custom eval model fine-tuning
- Eval dataset generation

### Add-ons

- **API - Small Evaluator** ($10 per 1000 calls)
- **API - Large Evaluator** ($20 per 1000 calls)
- **API - Eval Explanations** ($20 per 1000 calls)

## About

A managed platform that evaluates language models and AI agents using specialized scoring models, provides adversarial test datasets, monitors performance in production, and enables side-by-side comparison and debugging of AI systems at scale.

_Independently observed._

## Platform & deployment

- **Platforms:** Web
- **Deployment:** Cloud / SaaS, Hybrid, On-premise

## Integrations (5)

_Independently observed._

- Smolagents
- OpenAI Agents
- Pydantic
- CrewAI
- Langchain

## Capabilities

_The capabilities that matter for AI Evals Testing. "-" = undocumented, not absent._

| Capability | Supported |
|---|:--:|
| **Capabilities** | |
| Architecture model | Managed enterprise saas |
| LLM as a judge prompt grading framework | ✓ |
| Specialized rag metrics faithfulness context relevance | ✓ |
| Deterministic regex and json schema assertions | - |
| Synthetic test dataset generation from documents | - |
| Ci cd github actions pipeline blocking gates | - |
| Red teaming and adversarial vulnerability scanning | ✓ |
| Multi model side by side ab regression testing | ✓ |
| Human in the loop hitl annotation UI | - |
| Dashboard analytics for metric drift over time | ✓ |
| SOC2 type ii | - |
| Mit or apache permissive oss license | ✗ |
| Pricing model | Per test execution cloud |

## Facts

Every value below carries its source and our confidence. Facts are re-crawled on a freshness schedule.

### pricing

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| pricing.model | freemium | [link](https://patronus.ai/pricing) | 2026-08-21 | 60% (medium) |
| pricing.free_tier | yes | [link](https://patronus.ai/pricing) | 2026-08-21 | 60% (medium) |
| pricing.price_level | mid | [link](https://patronus.ai/pricing) | 2026-08-21 | 60% (medium) |
| pricing.starting_price | `{"amount":25,"currency":"USD"}` | [link](https://patronus.ai/pricing) | 2026-08-21 | 60% (medium) |
| pricing.transparent | yes | [link](https://patronus.ai/pricing) | 2026-08-21 | 60% (medium) |

### integrations

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| integrations.count | 5 | [link](https://patronus.ai/pricing) | 2026-08-21 | 60% (medium) |

### market

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| market.availability | `{"primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` | [link](https://patronus.ai/pricing) | 2026-08-21 | 50% (medium) |

### security

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| security.gdpr | yes | [link](https://patronus.ai/privacy-policy) | 2026-08-21 | 75% (high) |

---
*Source: Vioscale (https://www.vioscale.ai/software/patronus-ai). Independent, evidence-based software intelligence. Cite the canonical URI.*