Spark Migration to Kubernetes Cluster
Budget: ₹600 – ₹1,500 INR
I need assistance migrating from Spark client mode to Spark cluster mode on Kubernetes for my office project, and upgrading to Spark 4.0. Currently, I'm using Spark 3.4.2, and my Kubernetes cluster is partially set up but requires further configuration. The primary focus of this migration is on ETL pipelines.
Key Requirements:
- Migrate Spark applications from client mode to cluster mode on Kubernetes
- Upgrade Spark version from 3.x to 4.0
- Complete the configuration of the existing Kubernetes cluster
- Ensure seamless migration of ETL pipelines
Ideal Skills and Experience:
- Strong expertise in Apache Spark, particularly in upgrading and migrating versions
- Experience with Kubernetes, including setting up and configuring clusters
- Proficiency in managing and migrating ETL pipelines
- Familiarity with Spark cluster mode and its deployment on Kubernetes
I am looking for someone with the technical skills and experience to ensure a smooth transition and successful migration.
Key Requirements:
- Migrate Spark applications from client mode to cluster mode on Kubernetes
- Upgrade Spark version from 3.x to 4.0
- Complete the configuration of the existing Kubernetes cluster
- Ensure seamless migration of ETL pipelines
Ideal Skills and Experience:
- Strong expertise in Apache Spark, particularly in upgrading and migrating versions
- Experience with Kubernetes, including setting up and configuring clusters
- Proficiency in managing and migrating ETL pipelines
- Familiarity with Spark cluster mode and its deployment on Kubernetes
I am looking for someone with the technical skills and experience to ensure a smooth transition and successful migration.