# Replicate vs Together AI

**Leader by Vioscale score:** Together AI

| Attribute | Replicate | Together AI |
|---|---|---|
| **Vioscale score** | 52 (41% (low)) | 72.8 (60% (medium)) |
| deployment.options | `{"cloud":true,"on_prem":true,"self_hosted":true}` | `{"cloud":true}` |
| description.long | Replicate is an infrastructure platform that lets you run state-of-the-art AI models through a simple API or deploy your own custom models. It automatically handles containerization, scaling, and resource allocation, charging only for compute used. | Together AI provides cloud infrastructure for hosting and serving open-source language, image, audio, and video models through serverless inference, reserved capacity, and dedicated GPU instances. The platform includes fine-tuning capabilities, batch processing, managed storage, and GPU cluster support for custom model development and training—eliminating the need for users to manage underlying infrastructure. |
| features.capabilities | `{"role":"serving","compute_model":"serverless_per_token","managed_cloud":true,"model_serving":true,"pricing_model":"per_compute_hour","self_hostable":true,"multi_provider":true,"vpc_deployment":true,"no_train_on_data":"unknown","llm_observability":true,"framework_agnostic":true,"experiment_tracking":true,"bring_your_own_weights_byow_hosting":true,"multimodal_vision_and_audio_in_out_support":true,"lpu_or_custom_silicon_for_extreme_low_latency":false}` | `{"role":"platform","evaluation":false,"soc2_type_ii":false,"compute_model":"multi_tenant_hybrid","managed_cloud":true,"model_serving":true,"pricing_model":"per_million_tokens","self_hostable":false,"multi_provider":true,"vpc_deployment":true,"otel_compatible":false,"no_train_on_data":"yes","llm_observability":false,"prompt_management":false,"framework_agnostic":true,"experiment_tracking":false,"openai_compatible_rest_api_schema":false,"bring_your_own_weights_byow_hosting":true,"dynamic_batching_and_kv_cache_management":false,"massive_context_window_support_100k_plus":false,"hipaa_baa_compliance_for_medical_inference":false,"multimodal_vision_and_audio_in_out_support":true,"native_function_calling_and_strict_json_mode":false,"streaming_server_sent_events_sse_token_yield":false,"lpu_or_custom_silicon_for_extreme_low_latency":false,"zero_data_retention_training_opt_out_enterprise":true}` |
| integrations.count | 8 | - |
| integrations.list | `[{"name":"Google"},{"name":"OpenAI"},{"name":"ByteDance"},{"name":"Black Forest Labs"},{"name":"HuggingFace"},{"name":"Anthropic"},{"name":"Alibaba"},{"name":"Krea"},{"name":"GitHub"},{"name":"Docker"}]` | - |
| market.availability | `{"primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` | `{"primaryMarkets":["US"],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` |
| platform.support | `{"cli":true,"web":true}` | `{"cli":true,"web":true}` |
| pricing | `{"type":"usage","plans":[{"name":"Public Models","summary":"Per-token or per-output pricing varies by model","features":["Run public models","Text-to-image generation","Image editing and restoration","Video generation","Speech generation","Large language models","Music generation"],"components":[{"per":{"qty":1000,"unit":"output tokens"},"kind":"metered","amount":0.015,"currency":"USD"},{"per":{"qty":1000000,"unit":"input tokens"},"kind":"metered","amount":3,"currency":"USD"},{"kind":"per_unit","unit":"image","amount":0.04,"period":"per_output","currency":"USD"},{"kind":"per_unit","unit":"video","amount":0.09,"period":"per_second","currency":"USD"}],"description":"Thousands of open-source and proprietary models billed by execution time or output tokens/images","contactSales":false},{"free":false,"name":"Private Models","summary":"$0.09–$20.16/hr depending on hardware","features":["Dedicated hardware (no shared queue)","Auto-scaling","Custom model deployment","Hourly billing available"],"components":[{"kind":"per_unit","unit":"CPU (Small)","amount":0.000025,"period":"second","currency":"USD"},{"kind":"per_unit","unit":"CPU","amount":0.0001,"period":"second","currency":"USD"},{"kind":"per_unit","unit":"Nvidia A100 (80GB)","amount":0.0014,"period":"second","currency":"USD"},{"kind":"per_unit","unit":"Nvidia H100","amount":0.001525,"period":"second","currency":"USD"},{"kind":"per_unit","unit":"Nvidia L40S","amount":0.000975,"period":"second","currency":"USD"},{"kind":"per_unit","unit":"Nvidia T4","amount":0.000225,"period":"second","currency":"USD"}],"description":"Deploy custom models on dedicated hardware. Billed for all uptime (setup, idle, and processing)","contactSales":false},{"free":false,"name":"Fast Booting Fine-Tunes","summary":"Active processing time only","features":["Fine-tuned model deployment","No idle time billing"],"description":"Private fine-tuned models billed only for active processing time (no idle time charges)","contactSales":false}],"addOns":[{"name":"Multi-GPU A100 Capacity","components":[{"kind":"per_unit","unit":"4x Nvidia A100 (80GB)","amount":0.0056,"period":"second","currency":"USD"},{"kind":"per_unit","unit":"8x Nvidia A100 (80GB)","amount":0.0112,"period":"second","currency":"USD"}]},{"name":"Multi-GPU H100 Capacity","components":[{"kind":"per_unit","unit":"2x Nvidia H100","amount":0.00305,"period":"second","currency":"USD"},{"kind":"per_unit","unit":"4x Nvidia H100","amount":0.0061,"period":"second","currency":"USD"},{"kind":"per_unit","unit":"8x Nvidia H100","amount":0.0122,"period":"second","currency":"USD"}]}],"summary":"Usage-based: public models from $0.01–$0.25 per output token/image/second; private models from $0.09–$40.32/hr. Free tier available.","currency":"USD","freeTier":true,"sourceUrl":"https://replicate.com","retrievedAt":"2026-08-03T22:46:21.215Z","startingPrice":{"amount":0.000025,"period":"month","currency":"USD"}}` | `{"type":"usage","plans":[{"free":false,"name":"Serverless Inference","summary":"From $0.00014–$15/1M tokens depending on model. Pay only for usage.","features":["50+ open-source models","Variable pricing by model and token type","Batch API support","Private endpoints"],"components":[{"per":{"qty":1000000,"unit":"tokens"},"kind":"metered","amount":0.00014,"currency":"USD"}],"contactSales":false},{"free":false,"name":"Provisioned Throughput","summary":"Reserved throughput capacity with 99% SLA. PTU-based pricing structure.","features":["Reserved token capacity","99% uptime SLA","Token-based pricing model","Production-grade reliability"],"commitment":"monthly","contactSales":false},{"free":false,"name":"Dedicated Inference","summary":"$3.69–$8.99 per GPU per hour (on-demand); reserved discounts available.","features":["Single-tenant GPU instances","Guaranteed performance (no resource sharing)","Custom model support","Autoscaling for traffic spikes"],"commitment":"monthly","components":[{"kind":"fixed","amount":3.69,"period":"hour","currency":"USD"}],"contactSales":false}],"addOns":[{"name":"Fine-Tuning","components":[{"per":{"qty":1000000,"unit":"tokens"},"kind":"metered","amount":0.48,"currency":"USD"}]},{"name":"Managed Storage"},{"name":"GPU Clusters"}],"summary":"Usage-based pricing starting from $0.00014/1M tokens for serverless inference. Reserved capacity and dedicated GPU instances available; on-demand GPU pricing from $3.69/hour.","currency":"USD","freeTier":false,"sourceUrl":"https://www.together.ai/pricing","retrievedAt":"2026-08-21T12:44:34.463Z","startingPrice":{"unit":"tokens","amount":0.00014,"currency":"USD"},"billingPeriods":["month"]}` |
| pricing.free_tier | yes | no |
| pricing.model | commercial | commercial |
| pricing.price_level | unknown | low |
| pricing.starting_price | - | `{"amount":0.00014,"currency":"USD"}` |
| pricing.transparent | no | yes |
| reliability.sla_pct | - | 99 |
| reliability.status_page | yes | yes |
| security.disclosure_policy | - | yes |
| security.gdpr | - | yes |
| security.iso27001 | - | yes |
| security.soc2 | - | yes |

## Capabilities (MLOps & LLMOps Tools)

| Capability | Replicate | Together AI |
|---|:--:|:--:|
| **Core** |  |  |
| Tool role | Model serving | End-to-end ML platform |
| **Deployment** |  |  |
| Self-hostable / OSS core | ✓ | ✗ |
| Managed cloud available | ✓ | ✓ |
| On-prem / VPC deployment | ✓ | ✓ |
| **Observability** |  |  |
| LLM tracing / observability | ✓ | ✗ |
| Evaluation (offline / LLM-judge / human) | - | ✗ |
| **Dev** |  |  |
| Prompt management + versioning | - | ✗ |
| **Tracking** |  |  |
| Experiment tracking / model registry | ✓ | ✗ |
| **Serving** |  |  |
| Model serving / inference endpoint | ✓ | ✓ |
| **Interop** |  |  |
| OpenTelemetry / OpenLLMetry compatible | - | ✗ |
| Framework-agnostic | ✓ | ✓ |
| **Gateway** |  |  |
| Multi-provider model support | ✓ | ✓ |
| **Data** |  |  |
| No-train-on-customer-data guarantee | Unknown | Yes |

*Source: Vioscale. Generated 2026-09-01T15:03:05.814Z. "-" = undocumented, not absent.*