Senior Data Pipeline Engineer Needed

Job ID: 40468674

Budget: ₹12,500 – ₹37,500 INR

I’m after an experienced data engineer (7 + years in the field) to own the end-to-end development of a production-grade data pipeline that pulls from our primary MySQL database and delivers clean, reliable tables to our analytics layer.

The scope
Right now the only source you need to worry about is MySQL, but I’d like the new pipeline to be flexible enough that we can plug in other sources—APIs or CSV drops—later without a full re-write. The immediate goal is automated extraction, transformation, and loading on a daily schedule, with robust monitoring and alerting around failure points.

Deliverables
• Technical design outlining tables, job orchestration, and recovery strategy
• Implemented ETL / ELT code (language and framework of your choice—Python + Airflow is welcome but not mandatory) checked into our Git repo
• Unit and integration tests covering the critical transformations
• Deployment scripts or IaC templates so the pipeline can be spun up in staging and production
• A concise run-book that lets any engineer on my team understand, operate, and extend the workflow

Acceptance criteria will be a green test suite and at least one successful load from MySQL into the target warehouse, visible in our BI tool.

If this lines up with your expertise, please share a quick note on similar pipelines you’ve built, preferred tooling, and your availability to start.