Build Robust Data Pipelines & Warehouse

Job ID: 39816470

Budget: ₹1,250 – ₹2,500 INR

I’m expanding our analytics stack and need a data engineer who can take full ownership of three intertwined areas: building fresh data pipelines, managing the central warehouse, and developing the ETL logic that binds everything together.

The job starts with ingesting data from two primary sources—our operational SQL databases and several SaaS platforms we surface via REST-based APIs. From there, you’ll design and orchestrate reliable pipelines that land this data in our cloud-hosted warehouse, model it for analytics, and keep it humming with automated tests, monitoring, and clear documentation.

What I expect as concrete deliverables:
• Production-ready pipelines that pull from the specified SQL databases and APIs on an agreed schedule
• A well-organized warehouse schema with documented data lineage and transformation steps
• Reusable ETL/ELT scripts plus any orchestration code or configuration files
• Run-books and hand-over notes so my in-house team can operate and extend your work confidently

Code quality, transparency, and timely communication are essential. If you’ve shipped similar end-to-end solutions before—especially in cloud environments—let’s talk about timelines and the best tooling to get this live quickly.