Database Engineer & ETL Pipeline Expert
Budget: ₹150,000 – ₹250,000 INR
I'm looking for a skilled Data Engineer/Full Stack Developer with extensive knowledge and experience in database structuring and implementation on AWS. The project revolves around a financial platform, necessitating the design and implementation of a robust ETL (Extract, Transform, Load) pipeline for our data warehouse.
Key Responsibilities:
- Creating the ETL pipeline
- Data extraction primarily from vendor APIs with occasional web scraping
- Data loading to various databases
Ideal Skills:
- Strong expertise in AWS and cloud-based database implementation
- Proficiency in designing and optimizing ETL pipelines
- Experience in integrating vendor APIs
- Knowledge in database structuring and optimization
Good to Have:
- Proficiency in AI and prompt engineering
Please note that while the specific databases have not been determined yet, experience with MySQL, PostgreSQL, and NoSQL (like MongoDB) would be advantageous.
Key Responsibilities:
- Creating the ETL pipeline
- Data extraction primarily from vendor APIs with occasional web scraping
- Data loading to various databases
Ideal Skills:
- Strong expertise in AWS and cloud-based database implementation
- Proficiency in designing and optimizing ETL pipelines
- Experience in integrating vendor APIs
- Knowledge in database structuring and optimization
Good to Have:
- Proficiency in AI and prompt engineering
Please note that while the specific databases have not been determined yet, experience with MySQL, PostgreSQL, and NoSQL (like MongoDB) would be advantageous.