Data Engineering pipeline

Job ID: 36833138

Budget: $750 – $1,500 CAD

Data Engineering Pipeline

I am in need of a data engineering pipeline that will primarily process structured data. The volume of data that needs to be processed is less than 1TB. Additionally, I prefer a cloud-based platform for the pipeline.

Skills and Experience required:
-Python, SQL, GCP
- Strong experience in data engineering and processing structured data
- Proficiency in cloud-based platforms for data processing
- Knowledge of data pipeline architecture and design
- Familiarity with handling and managing data volumes of less than 1TB
- Ability to optimize data processing pipelines for efficiency and scalability
- Experience with integrating various data sources and formats
Related categories: Python SQL Cloud Computing Data Mining