# Apache Spark

- **Canonical URI:** https://www.vioscale.ai/software/apache-spark
- **Category:** Data Engineering Tools
- **Homepage:** https://spark.apache.org
- **Also known as:** apache-spark
- **Profile claimed by vendor:** no
- **Last updated:** 2026-08-05T14:30:23.186Z

## Vioscale score

**73.5 / 100**, confidence 16% (low).

Composite of weighted, independently-sourced signals (no user reviews, no vendor payment).

| Signal | Score | Weight | Contribution | Evidence present |
|---|--:|--:|--:|:--:|
| price_level | 100 | 0.058 | 5.8 | ✓ |
| reliability | 0 | 0.082 | 0 | - |
| capabilities | 57.8 | 0.094 | 5.4 | ✓ |
| github_stars | 87.6 | 0.029 | 2.5 | ✓ |
| integrations | 0 | 0.175 | 0 | - |
| github_activity | 63.1 | 0.105 | 6.6 | ✓ |
| release_cadence | 0 | 0.058 | 0 | - |
| security_posture | 0 | 0.082 | 0 | - |
| package_downloads | 0 | 0.152 | 0 | - |
| pricing_transparency | 80 | 0.094 | 7.5 | ✓ |
| stackoverflow_activity | 0 | 0.07 | 0 | - |

## Pricing

_As of 2026-08-05, [verify at source](https://spark.apache.org). Independently observed._

Open source · Free tier

## About

Apache Spark is a multi-language engine for executing data engineering, data science, and machine learning on single-node machines or clusters. It unifies batch and real-time streaming processing with SQL analytics and machine learning capabilities.

_Independently observed._

## Platform & deployment

- **Platforms:** CLI, Linux
- **Deployment:** Cloud / SaaS, On-premise, Self-hosted

## Capabilities

_The capabilities that matter for Data Engineering Tools. "-" = undocumented, not absent._

| Capability | Supported |
|---|:--:|
| **Core** | |
| Tool role | Orchestrator |
| Processing paradigm | Batch + streaming |
| **Connectivity** | |
| Connector count | - |
| CDC / log-based replication | - |
| **Transformation** | |
| In-warehouse transformation (push-down) | - |
| dbt-native orchestration | - |
| **Deployment** | |
| Self-hosted / open-source available | ✓ |
| Managed cloud available | ✗ |
| **Governance** | |
| Data lineage / asset catalog | - |
| **Authoring** | |
| Python-first authoring | ✓ |
| **Execution** | |
| Incremental / partition-aware runs | - |
| **Quality** | |
| Built-in data quality / tests | - |
| **Scale** | |
| Horizontal scale (distributed executor) | ✓ |

## Facts

Every value below carries its source and our confidence. Facts are re-crawled on a freshness schedule.

### activity

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| activity.commits_last_30d | 100 | [link](https://github.com/apache/spark/pulse) | 2026-08-01 | 65% (medium) |

### adoption

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| adoption.github_stars | 43,759 | [link](https://github.com/apache/spark) | 2026-08-01 | 90% (high) |

### language

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| language.primary | Scala | [link](https://github.com/apache/spark) | 2026-08-01 | 90% (high) |

### license

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| license.spdx | Apache-2.0 | [link](https://github.com/apache/spark) | 2026-08-01 | 95% (high) |

### pricing

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| pricing.free_tier | yes | [link](https://spark.apache.org) | 2026-08-05 | 60% (medium) |
| pricing.model | commercial | [link](https://spark.apache.org) | 2026-08-05 | 60% (medium) |
| pricing.price_level | free | [link](https://spark.apache.org) | 2026-08-05 | 60% (medium) |
| pricing.transparent | yes | [link](https://spark.apache.org) | 2026-08-05 | 60% (medium) |

### market

| Attribute | Value | Source | Retrieved | Confidence |
|---|---|---|---|---|
| market.availability | `{"hqCountry":"US","primaryMarkets":[],"availabilityScope":"global","availableCountries":[],"notAvailableCountries":[]}` | [link](https://spark.apache.org) | 2026-08-05 | 75% (high) |

---
*Source: Vioscale (https://www.vioscale.ai/software/apache-spark). Independent, evidence-based software intelligence. Cite the canonical URI.*