ETL Pipeline Setup for Data Migration

Job ID: 39359352

Budget: $15 – $25 USD

I need an experienced Data Engineer to set up and configure an ETL pipeline for a production data migration project. The goal is to extract semi-structured data from PostgreSQL and MS SQL Server, and load it into a centralized data warehouse.

Key Responsibilities:
- Design and implement ETL workflows using Apache Airflow (preferred)
- Write and optimize Python and SQL scripts for data extraction and transformation
- Integrate semi-structured data (e.g., JSON, XML) from PostgreSQL and MS SQL Server
- Perform data cleansing, aggregation, and schema mapping
- Containerize components using Docker for repeatable deployment
- Collaborate with our internal team to ensure smooth data migration

Ideal Skills:
- Proficiency in Python and SQL
- Experience with Apache Airflow or similar ETL orchestration tools
- Familiarity with Docker and containerized workflows
- Ability to work independently and deliver in a short-term contract

Looking forward to your proposals!
Related categories: Python SQL Data Engineer