Announcing Spark Connect on Amazon EMR on EKS: Interactive PySpark development, anywhere
Amazon EKS ยท 2026-09-29
Actions
Technical Details
| Affected Versions | 7.14, emr-spark-8.1 |
|---|---|
| Regions | all except AWS GovCloud (US) Regions and the China Regions |
| Cost Impact | Neutral |
What This Means
For DevOps Teams
Deploy Spark Connect on Amazon EMR on EKS to streamline Spark application development, testing, and debugging by leveraging existing EKS infrastructure and IAM roles, reducing toil and improving operational efficiency.
For Platform Teams
Integrate Spark Connect on Amazon EMR on EKS into your platform to provide a seamless experience for data engineers and scientists, enabling interactive and embedded Spark workloads on shared Kubernetes clusters with existing infrastructure and tooling.
For Executives
Evaluate Spark Connect on Amazon EMR on EKS to enhance developer productivity by enabling interactive PySpark development from local tools with remote execution on scalable EKS clusters, reducing environment differences and dependency conflicts.
Source
Related Amazon EKS Updates
- Run interactive workloads on Amazon EMR on EKS with Spark Connect (2026-09-24)
- Amazon SageMaker HyperPod Inference Gateway for scalable LLM inference (2026-09-24)
- AWS Resilience Hub adds three new capabilities (2026-09-18)
- CVE-2026-86831: Improper validation of pod identifier uniqueness in aws-network-policy-agent in Amazon EKS (2026-09-16)
- Amazon EKS now supports multiple external OIDC identity providers per cluster (2026-08-24)