Data Pipeline Development for Extraction & Transformation
Budget: $250 – $750 AUD
I'm seeking a proficient data engineer to create a data pipeline for efficient data extraction and transformation. The pipeline will need to manage data from databases and files, specifically SQL, NoSQL, and Data Warehouse databases.
Key Responsibilities:
- Designing and implementing a robust data pipeline
- Handling data from various sources including databases and files
- Working with SQL, NoSQL, and Data Warehouse databases
Data transformations required include:
- Aggregation: Combining data from multiple sources
- Cleaning: Filtering out unnecessary or erroneous data
- Normalization: Standardizing data to a common format
Ideal Skills and Experience:
- Extensive experience with data pipeline construction
- Proficiency in SQL and NoSQL databases
- Familiarity with Data Warehousing
- Strong data transformation skills, specifically in aggregation, cleaning, and normalization
- Prior experience working with databases and files as data sources.
Key Responsibilities:
- Designing and implementing a robust data pipeline
- Handling data from various sources including databases and files
- Working with SQL, NoSQL, and Data Warehouse databases
Data transformations required include:
- Aggregation: Combining data from multiple sources
- Cleaning: Filtering out unnecessary or erroneous data
- Normalization: Standardizing data to a common format
Ideal Skills and Experience:
- Extensive experience with data pipeline construction
- Proficiency in SQL and NoSQL databases
- Familiarity with Data Warehousing
- Strong data transformation skills, specifically in aggregation, cleaning, and normalization
- Prior experience working with databases and files as data sources.
Related categories:
SQL
Database Administration
Database Programming
Database Development
Data Warehousing