Metadata driven ETL Framework Development
Budget: $750 – $1,500 AUD
I'm looking for an data engineer expert to help and build a metadata-driven ETL framework. This project will involve working primarily with generic python notebooks and control tables using any database.
Key Responsibilities:
- Design and implement a metadata-driven ETL framework
- Conduct data cleaning as part of the transformation process using great expectations
- Use medallion architecture data flow
Flow Landing—Bronze—Silver—Gold
Ideal Skills and Experience:
- Proficiency in Notebooks
- Extensive experience with ETL processes
- Strong skills in data engineering
I am open to look and take any off the shelf solution if it meet the requirements.
Key Responsibilities:
- Design and implement a metadata-driven ETL framework
- Conduct data cleaning as part of the transformation process using great expectations
- Use medallion architecture data flow
Flow Landing—Bronze—Silver—Gold
Ideal Skills and Experience:
- Proficiency in Notebooks
- Extensive experience with ETL processes
- Strong skills in data engineering
I am open to look and take any off the shelf solution if it meet the requirements.