# Ragas vs txtai

**Leader by Vioscale score:** txtai

| Attribute | Ragas | txtai |
|---|---|---|
| **Vioscale score** | 54.1 (27% (low)) | 60.4 (56% (medium)) |
| activity.commits_last_30d | - | 70 |
| adoption.dependent_repos | 1 | 14 |
| adoption.github_stars | 15,484 | 12,909 |
| deployment.options | `{"self_hosted":true}` | `{"cloud":true,"self_hosted":true}` |
| description.long | A Python-based framework that evaluates RAG applications through automatic metrics covering faithfulness, relevance, and recall. Includes tools to synthetically generate test datasets customized for specific use cases, enabling developers to assess LLM application performance at both component and end-to-end levels. | txtai is an open-source Python framework for building semantic search applications, LLM-powered agents, retrieval augmented generation systems, and language model workflows with support for multiple vector backends and integration with various LLMs. |
| features.capabilities | `{"open_source":true,"pricing_model":"free_open_source","architecture_model":"open_source_cli","built_in_rag_eval_metrics":true,"llm_as_a_judge_prompt_grading_framework":true,"synthetic_test_dataset_generation_from_documents":true}` | `{"ann_index":"HNSW, IVF, IVFSparse, milvus-lite, turbovec, zvec","deployment":"embedded","consistency":"tunable","open_source":true,"quantization":"scalar","storage_tier":"disk_backed","hybrid_search":true,"licence_class":"permissive_oss","multi_tenancy":true,"product_class":"dedicated_dbms","full_text_bm25":true,"multimodal_rag":true,"distance_metrics":"cosine","horizontal_scale":"sharded_distributed","hybrid_retrieval":true,"metadata_filtering":"pre_filter","citation_attribution":true,"llm_provider_agnostic":true,"managed_ingestion_pipeline":true,"embedding_provider_agnostic":true,"multi_hop_agentic_retrieval":true}` |
| integrations.count | 3 | 10 |
| integrations.list | `[{"name":"LlamaIndex"},{"name":"LangSmith"},{"name":"OpenAI"}]` | `[{"name":"llama.cpp"},{"name":"LiteLLM"},{"name":"Hugging Face"},{"name":"OpenAI"},{"name":"Claude"},{"name":"AWS Bedrock"},{"name":"smolagents"},{"name":"OpenCode"},{"name":"DuckDB"},{"name":"Milvus"},{"name":"LiteRT"}]` |
| language.primary | Python | Python |
| license.spdx | Apache-2.0 | Apache-2.0 |
| platform.support | `{"cli":true}` | `{"cli":true,"web":true}` |
| pricing | `{"type":"open_source","freeTier":true,"sourceUrl":"https://ragas.io","retrievedAt":"2026-08-21T13:52:19.928Z"}` | `{"type":"open_source","freeTier":true,"sourceUrl":"https://neuml.github.io/txtai","retrievedAt":"2026-08-21T12:43:59.946Z"}` |
| pricing.free_tier | yes | yes |
| pricing.model | commercial | open_source |
| pricing.price_level | free | free |
| pricing.transparent | yes | yes |
| release.cadence_days | 7 | 26 |
| release.history | `[{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.4.3","date":"2026-01-13T17:47:29Z","type":"stable","version":"v0.4.3"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.4.2","date":"2025-12-23T17:13:41Z","type":"stable","version":"v0.4.2"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.4.1","date":"2025-12-10T16:28:51Z","type":"stable","version":"v0.4.1"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.4.0","date":"2025-12-03T16:22:29Z","type":"stable","version":"v0.4.0"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.9","date":"2025-11-11T17:24:46Z","type":"stable","version":"v0.3.9"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.8","date":"2025-10-28T19:09:17Z","type":"stable","version":"v0.3.8"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.7","date":"2025-10-14T16:21:37Z","type":"stable","version":"v0.3.7"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.6","date":"2025-10-03T03:56:31Z","type":"stable","version":"v0.3.6"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.5","date":"2025-09-17T19:13:15Z","type":"stable","version":"v0.3.5"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.5rc2","date":"2025-09-17T17:40:25Z","type":"prerelease","version":"v0.3.5rc2"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.5rc1","date":"2025-09-17T17:31:23Z","type":"prerelease","version":"v0.3.5rc1"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.4","date":"2025-09-10T23:57:28Z","type":"stable","version":"v0.3.4"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.3","date":"2025-09-04T17:59:51Z","type":"stable","version":"v0.3.3"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.3rc1","date":"2025-09-04T17:46:09Z","type":"prerelease","version":"v0.3.3rc1"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.2","date":"2025-08-19T12:03:50Z","type":"stable","version":"v0.3.2"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.2rc3","date":"2025-08-19T12:01:12Z","type":"prerelease","version":"v0.3.2rc3"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.2-rc2","date":"2025-08-19T11:49:23Z","type":"prerelease","version":"v0.3.2-rc2"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.2-rc1","date":"2025-08-19T10:28:33Z","type":"prerelease","version":"v0.3.2-rc1"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.1","date":"2025-08-11T11:15:03Z","type":"stable","version":"v0.3.1"},{"url":"https://github.com/vibrantlabsai/ragas/releases/tag/v0.3.0","date":"2025-07-17T05:32:24Z","type":"stable","version":"v0.3.0"}]` | `[{"url":"https://github.com/neuml/txtai/releases/tag/v9.12.0","date":"2026-07-30T19:43:23Z","type":"stable","version":"v9.12.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.11.0","date":"2026-07-01T15:07:00Z","type":"stable","version":"v9.11.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.10.0","date":"2026-06-04T10:22:48Z","type":"stable","version":"v9.10.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.9.0","date":"2026-05-12T15:21:53Z","type":"stable","version":"v9.9.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.8.0","date":"2026-04-29T15:29:38Z","type":"stable","version":"v9.8.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.7.0","date":"2026-03-20T17:10:04Z","type":"stable","version":"v9.7.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.6.0","date":"2026-02-25T17:56:31Z","type":"stable","version":"v9.6.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.5.0","date":"2026-02-12T16:44:38Z","type":"stable","version":"v9.5.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.4.1","date":"2026-01-23T17:03:50Z","type":"stable","version":"v9.4.1"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.4.0","date":"2026-01-21T15:30:33Z","type":"stable","version":"v9.4.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.3.0","date":"2025-12-22T23:35:33Z","type":"stable","version":"v9.3.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.2.0","date":"2025-11-21T15:09:50Z","type":"stable","version":"v9.2.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.1.0","date":"2025-11-04T13:23:09Z","type":"stable","version":"v9.1.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.0.1","date":"2025-09-15T13:25:58Z","type":"stable","version":"v9.0.1"},{"url":"https://github.com/neuml/txtai/releases/tag/v9.0.0","date":"2025-08-28T19:17:55Z","type":"stable","version":"v9.0.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v8.6.0","date":"2025-06-10T14:25:49Z","type":"stable","version":"v8.6.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v8.5.0","date":"2025-04-14T20:09:38Z","type":"stable","version":"v8.5.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v8.4.0","date":"2025-03-11T14:24:16Z","type":"stable","version":"v8.4.0"},{"url":"https://github.com/neuml/txtai/releases/tag/v8.3.1","date":"2025-02-12T16:51:27Z","type":"stable","version":"v8.3.1"},{"url":"https://github.com/neuml/txtai/releases/tag/v8.3.0","date":"2025-02-11T18:56:25Z","type":"stable","version":"v8.3.0"}]` |
| reliability.status_page | - | yes |
| security.scorecard | - | 4.9 |
| security.vulnerabilities | `{"count":2,"source":"https://advisories.ecosyste.ms/api/v1/advisories?ecosystem=pypi&package_name=ragas&per_page=100","last_12m":2,"max_severity":"HIGH"}` | `{"count":0,"source":"https://advisories.ecosyste.ms/api/v1/advisories?ecosystem=pypi&package_name=txtai&per_page=100","last_12m":0,"max_severity":null}` |

## Capabilities (RAG Tools)

| Capability | Ragas | txtai |
|---|:--:|:--:|
| **Capabilities** |  |  |
| Hybrid retrieval | - | ✓ |
| Reranking integration | - | - |
| Multi hop agentic retrieval | - | ✓ |
| Embedding provider agnostic | - | ✓ |
| LLM provider agnostic | - | ✓ |
| Built in rag eval metrics | ✓ | - |
| Citation attribution | - | ✓ |
| Multimodal rag | - | ✓ |
| Managed ingestion pipeline | - | ✓ |
| Open source | ✓ | ✓ |

*Source: Vioscale. Generated 2026-09-01T17:44:18.437Z. "-" = undocumented, not absent.*