# Hugging Face Text Generation Inference

- **Canonical URI:** https://www.vioscale.ai/software/hugging-face-text-generation-inference
- **Category:** Model Serving
- **Homepage:** https://huggingface.co/docs/text-generation-inference/en/index
- **Also known as:** hugging-face-text-generation-inference
- **Profile claimed by vendor:** no
- **Last updated:** 2026-08-26T19:29:14.710Z

## Vioscale score

**53.8 / 100**, confidence 27% (low). Computed 2026-09-01.

Composite of weighted, independently-sourced signals (no user reviews, no vendor payment).

| Signal | Score | Weight | Contribution | Evidence present |
|---|--:|--:|--:|:--:|
| price_level | 80 | 0.052 | 4.2 | ✓ |
| reliability | 0 | 0.073 | 0 | - |
| capabilities | 0 | 0.084 | 0 | - |
| repo_stars | 76.2 | 0.026 | 2 | ✓ |
| integrations | 34.6 | 0.09355555555555557 | 3.2 | ✓ |
| dependent_projects | 39.4 | 0.063 | 2.5 | ✓ |
| dev_activity | 0 | 0.094 | 0 | ✓ |
| release_cadence | 90.6 | 0.052 | 4.7 | ✓ |
| security_posture | 10 | 0.073 | 0 | - |
| package_downloads | 0 | 0.136 | 0 | - |
| security_score | 0 | 0.042 | 0 | - |
| pricing_transparency | 100 | 0.084 | 8.4 | ✓ |
| community_qa_activity | 0 | 0.063 | 0 | - |

## Pricing

_As of 2026-08-19, [verify at source](https://huggingface.co/pricing). Independently observed._

from $9/mo · Hybrid · Free tier

> Hybrid pricing: $9/mo personal, $20/user/mo teams, custom enterprise. Storage $8-12/TB/mo. GPU compute and inference endpoints metered hourly. Free tier for CPU-only deployments.

| Plan | Price | Free | Commitment |
|---|---|:--:|---|
| PRO | $9/month | - | - |
| Team | $20 per user/month | - | - |
| Enterprise | Contact sales | - | - |

### PRO

Personal account enhancement

- Private storage
- 20x included inference credits
- 8x ZeroGPU quota and highest queue priority
- PRO Badge

### Team

For growing teams

- Instant setup
- Collaborative features

### Enterprise (Contact sales)

Custom onboarding and enterprise features

### Add-ons

- **Storage** ($12 per TB)
- **Spaces Hardware** ($0 per hour)
- **Inference Endpoints** ($0.03 per hour)

## About

Text Generation Inference provides infrastructure and tools for running open-source language models at scale, supporting multiple popular architectures with built-in optimizations for inference speed, fine-tuning support, and compatibility with various hardware accelerators.

_Independently observed._

## Platform & deployment

- **Platforms:** CLI, Web
- **Deployment:** Cloud / SaaS, Hybrid, Self-hosted

## Integrations (15)

_Independently observed._

- AWS Bedrock
- Amazon SageMaker
- OpenAI API
- Docker
- Kubernetes
- NVIDIA CUDA
- AMD Instinct MI210
- AMD Instinct MI250
- Llama
- Falcon
- StarCoder
- BLOOM
- GPT-NeoX
- T5
- Gemma

## Release history

| Version | Date | Type |
|---|---|---|
| [v3.3.7](https://github.com/huggingface/text-generation-inference/releases/tag/v3.3.7) | 2025-12-19 | stable |
| [v3.3.6](https://github.com/huggingface/text-generation-inference/releases/tag/v3.3.6) | 2025-09-17 | stable |
| [v3.3.5](https://github.com/huggingface/text-generation-inference/releases/tag/v3.3.5) | 2025-09-02 | stable |
| [v3.3.4](https://github.com/huggingface/text-generation-inference/releases/tag/v3.3.4) | 2025-06-19 | stable |
| [v3.3.3](https://github.com/huggingface/text-generation-inference/releases/tag/v3.3.3) | 2025-06-18 | stable |
| [v3.3.2](https://github.com/huggingface/text-generation-inference/releases/tag/v3.3.2) | 2025-05-30 | stable |
| [v3.3.1](https://github.com/huggingface/text-generation-inference/releases/tag/v3.3.1) | 2025-05-22 | stable |
| [v3.3.0](https://github.com/huggingface/text-generation-inference/releases/tag/v3.3.0) | 2025-05-09 | stable |
| [v3.2.3](https://github.com/huggingface/text-generation-inference/releases/tag/v3.2.3) | 2025-04-08 | stable |
| [v3.2.2](https://github.com/huggingface/text-generation-inference/releases/tag/v3.2.2) | 2025-04-06 | stable |
| [v3.2.1](https://github.com/huggingface/text-generation-inference/releases/tag/v3.2.1) | 2025-03-18 | stable |
| [v3.2.0](https://github.com/huggingface/text-generation-inference/releases/tag/v3.2.0) | 2025-03-12 | stable |
| [v3.1.1](https://github.com/huggingface/text-generation-inference/releases/tag/v3.1.1) | 2025-03-04 | stable |
| [v3.1.0](https://github.com/huggingface/text-generation-inference/releases/tag/v3.1.0) | 2025-01-31 | stable |
| [v3.0.2](https://github.com/huggingface/text-generation-inference/releases/tag/v3.0.2) | 2025-01-24 | stable |

_… and 5 earlier release(s)._

## Security & compliance


Known vulnerabilities: 2 (1 in the last 12 months), max severity HIGH ([source](https://advisories.ecosyste.ms/api/v1/advisories?ecosystem=pypi&package_name=text-generation&per_page=100)). A count reflects scale and disclosure, not quality.

## Facts

Every value below carries its source and our confidence. Facts are re-crawled on a freshness schedule.

### integrations

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| integrations.count | 15 | [link](https://huggingface.co/pricing) | 2026-08-19 | 60% (medium) |

### market

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| market.availability | `{"primaryMarkets":[],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` | [link](https://huggingface.co/pricing) | 2026-08-19 | 75% (high) |

### pricing

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| pricing.free_tier | yes | [link](https://huggingface.co/pricing) | 2026-08-19 | 60% (medium) |
| pricing.price_level | low | [link](https://huggingface.co/pricing) | 2026-08-19 | 60% (medium) |
| pricing.starting_price | `{"amount":9,"currency":"USD"}` | [link](https://huggingface.co/pricing) | 2026-08-19 | 60% (medium) |
| pricing.transparent | yes | [link](https://huggingface.co/pricing) | 2026-08-19 | 60% (medium) |
| pricing.model | commercial | [link](https://huggingface.co/docs/text-generation-inference/en/index) | 2026-08-26 | 40% (low) |

### security

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| security.disclosure_policy | yes | [link](https://huggingface.co/pricing) | 2026-08-19 | 60% (medium) |
| security.gdpr | yes | [link](https://huggingface.co/blog/security-incident-july-2026) | 2026-08-19 | 75% (high) |
| security.vulnerabilities | `{"count":2,"source":"https://advisories.ecosyste.ms/api/v1/advisories?ecosystem=pypi&package_name=text-generation&per_page=100","last_12m":1,"max_severity":"HIGH"}` | [link](https://advisories.ecosyste.ms/api/v1/advisories?ecosystem=pypi&package_name=text-generation&per_page=100) | 2026-08-26 | 90% (high) |

### adoption

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| adoption.github_stars | 10,889 | [link](https://github.com/huggingface/text-generation-inference) | 2026-08-26 | 90% (high) |
| adoption.dependent_repos | 231 | [link](https://packages.ecosyste.ms/api/v1/packages/lookup?repository_url=https%3A%2F%2Fgithub.com%2Fhuggingface%2Ftext-generation-inference) | 2026-08-26 | 85% (high) |

### language

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| language.primary | Python | [link](https://github.com/huggingface/text-generation-inference) | 2026-08-26 | 90% (high) |

### license

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| license.spdx | Apache-2.0 | [link](https://github.com/huggingface/text-generation-inference) | 2026-08-26 | 95% (high) |

### release

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| release.cadence_days | 17 | [link](https://github.com/huggingface/text-generation-inference/releases) | 2026-08-26 | 70% (medium) |

### activity

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| activity.commits_last_30d | 0 | [link](https://github.com/huggingface/text-generation-inference/pulse) | 2026-08-26 | 65% (medium) |

---
*Source: Vioscale (https://www.vioscale.ai/software/hugging-face-text-generation-inference). Independent, evidence-based software intelligence. Cite the canonical URI.*