ETL Job Transformation to PySpark
Budget: ₹600 – ₹1,500 INR
I'm seeking a professional with extensive experience in PySpark and ETL processes. The project involves migrating my current ETL job, which sources data from a PySpark database and targets a Data Lake.
Key tasks include:
- Designing and implementing the necessary PySpark code
- Ensuring data is effectively transformed through cleaning, validation, aggregation, summarization, merging and joining.
Ideal candidates will have a deep understanding of both PySpark and data transformations. Your expertise will be crucial to successfully migrate this ETL job.
Key tasks include:
- Designing and implementing the necessary PySpark code
- Ensuring data is effectively transformed through cleaning, validation, aggregation, summarization, merging and joining.
Ideal candidates will have a deep understanding of both PySpark and data transformations. Your expertise will be crucial to successfully migrate this ETL job.
Related categories:
SQL
Database Administration
Database Programming
Database Development
Data Warehousing