Dataproc Managed Service for Apache Spark
Legacy names Dataproc, Dataproc on Compute Engine, Google Cloud Serverless for Apache Spark, Dataproc Serverless, Dataproc Serverless for Spark
Managed Apache Spark execution across Compute Engine clusters and serverless workloads.
Naming timeline
- Cloud Dataproc
Managed Spark and Hadoop cluster service launched in Beta in September 2015 (GA on February 22, 2016).
- Dataproc & Dataproc Serverless for Spark
Added serverless Spark execution (GA on January 19, 2022; renamed Google Cloud Serverless for Apache Spark in September 2025).
- Managed Service for Apache SparkCurrent name
Consolidates cluster mode (Dataproc on Compute Engine) and serverless mode (Google Cloud Serverless for Apache Spark) under Managed Service for Apache Spark on April 3, 2026.
What is Dataproc called now?
Dataproc was consolidated into Managed Service for Apache Spark, with the latest change on 3 April 2026 (Google Cloud Next '26). Earlier names covered by this entry also include Dataproc on Compute Engine, Google Cloud Serverless for Apache Spark, Dataproc Serverless, Dataproc Serverless for Spark. Managed Apache Spark execution across Compute Engine clusters and serverless workloads. Only the customer-facing name changed; the underlying technical identifiers remain backward compatible.
Also known as
- Google Managed Spark
- Managed Service for Apache Spark Clusters
- Managed Service for Apache Spark Serverless
Technical identifiers
Technical identifiers unchanged. Only the customer-facing product name changed; the APIs, CLI commands, IAM roles and Terraform resources below keep their legacy identifiers for backward compatibility.
| REST / gRPC APIs | dataproc.googleapis.com dataproc-rm.googleapis.com |
|---|---|
| gcloud / CLI Commands | gcloud dataproc |
| IAM Predefined Roles | roles/dataproc.* |
| Terraform Resources | google_dataproc_* |
No impact to Dataproc API, client libraries, gcloud dataproc CLI, or IAM roles.
Notes & disambiguation
- On April 3, 2026, Dataproc (Dataproc on Compute Engine) and Google Cloud Serverless for Apache Spark (formerly Dataproc Serverless for Spark) were unified under the Managed Service for Apache Spark umbrella brand.
- Exception: Dataproc Metastore retains its legacy name.
- All API endpoints (dataproc.googleapis.com), CLI commands (gcloud dataproc), client libraries, IAM roles (roles/dataproc.*), and Terraform resources (google_dataproc_*) retain 'dataproc'.
Sources & official documentation
Catalog last updated . Spotted an error? Suggest an edit