Announcing Spark Connect on Amazon EMR Serverless: Interactive PySpark development, anywhere
Emr Serverless ยท 2026-06-09
Actions
Technical Details
| Affected Versions | 7.13 and later |
|---|---|
| Regions | all |
| Cost Impact | Neutral |
What This Means
For DevOps Teams
Deploy Spark Connect on EMR Serverless to enable local PySpark development with remote execution, eliminating the need for cluster provisioning and reducing dependency conflicts, resulting in faster development cycles and lower operational overhead.
For Platform Teams
Adopt Spark Connect on EMR Serverless to integrate local development environments with serverless Spark execution, enhancing developer productivity, reducing environment mismatches, and providing fine-grained IAM permissions and cost allocation.
For Executives
Evaluate Spark Connect on EMR Serverless to streamline PySpark development, reduce deployment cycles, and enhance cost visibility with per-session IAM permissions and tag-based cost allocation, leading to improved developer efficiency and reduced operational toil.
Source
Related Emr Serverless Updates
- Run Interactive Workloads on Amazon EMR Serverless with Spark Connect (2026-06-09)
- Announcing general availability of Apache Spark 4.0 on Amazon EMR (2026-06-09)
- Amazon EMR now supports Apache Spark 4.0.2 in general availability (2026-05-27)
- Amazon EMR Serverless is now available in additional AWS Regions (2026-05-15)
- Amazon EMR 7.13 now available with Python 3.11 (2026-04-29)