Expert PySpark Developer for AWS Data Processing - 11/07/2024 02:55 EDT
Budget: ₹1,500 – ₹12,500 INR
I'm looking for an expert PySpark developer to help manage and process big data sets on AWS. The successful candidate will have a strong knowledge of key AWS services such as S3, Lambda, and EMR.
Ingest the data from source CSV file to target delta tables
Tasks include:
- Building and managing large scale data processes in PySpark
- Understanding and using AWS services like S3, Lambda and EMR
- Implementing algorithms for data computation
Ideally, you'll have:
- Expertise in PySpark development
- In-depth knowledge of AWS services, specifically S3, Lambda and EMR
- Proven experience in handling and processing big data
- A problem-solving approach with excellent attention to detail.
Your experience should allow you to hit the ground running on this data processing project.
Ingest the data from source CSV file to target delta tables
Tasks include:
- Building and managing large scale data processes in PySpark
- Understanding and using AWS services like S3, Lambda and EMR
- Implementing algorithms for data computation
Ideally, you'll have:
- Expertise in PySpark development
- In-depth knowledge of AWS services, specifically S3, Lambda and EMR
- Proven experience in handling and processing big data
- A problem-solving approach with excellent attention to detail.
Your experience should allow you to hit the ground running on this data processing project.
Related categories:
Business, Accounting, Human Resources & Legal
MySQL
Amazon Web Services
Hadoop
PySpark