ETL Pipeline Development with PostgreSQL & Python- Dynamic Partitioning
Budget: $10 – $30 CAD
I'm seeking a professional with experience in creating data pipelines and performing ETL processes. The main goal is to build an ETL pipeline that utilizes PostgreSQL, Airflow, and Python with Pandas.
Key Skills and Experience Required:
- PostgreSQL: Expertise in database management and optimization is a must.
- Airflow: Experience with orchestrating complex workflows.
- Python: Proficiency required for writing scripts and handling data manipulation.
- Pandas: Essential for data analysis and transformation.
- Data Sources: Comfortable working with databases and CSV or Excel files.
Responsibilities:
- Design and implement a data pipeline.
- Perform simple data transformations during the ETL process.
- Ensure efficient data extraction and loading.
The ideal freelancer for this project will have a strong background in data engineering and a proven track record of working with the aforementioned tools and technologies. Please provide examples of similar projects you've completed in your proposal.
Key Skills and Experience Required:
- PostgreSQL: Expertise in database management and optimization is a must.
- Airflow: Experience with orchestrating complex workflows.
- Python: Proficiency required for writing scripts and handling data manipulation.
- Pandas: Essential for data analysis and transformation.
- Data Sources: Comfortable working with databases and CSV or Excel files.
Responsibilities:
- Design and implement a data pipeline.
- Perform simple data transformations during the ETL process.
- Ensure efficient data extraction and loading.
The ideal freelancer for this project will have a strong background in data engineering and a proven track record of working with the aforementioned tools and technologies. Please provide examples of similar projects you've completed in your proposal.