Advanced Data Engineering and Azure Migration

Job ID: 39650095

Budget: ₹75,000 – ₹150,000 INR

 Credit Risk & Forecasting Models: Built credit risk models to forecast losses and recoveries, enabling
proactive decision-making for a finance client. Managed offshore teams and pre-production data
validations.
 Data Engineering on Azure: Designed and built modern data pipelines using Azure Data Factory, Synapse
Analytics, Logic Apps, and Azure Functions for various domains like healthcare, insurance, education, and
manufacturing.
 Cloud Migration Projects: Led end-to-end data migrations from on-prem SQL Server and SSIS packages to
Azure Synapse, including metadata-driven incremental loads and DDL script automation using PowerShell.
 Performance Optimization: Improved data extraction performance with Polybase, BCP, and Copy Activity,
external tables, and durable functions. Refactored Python/PySpark code for AWS compatibility and better
performance.
 Data Warehousing & Modelling: Designed star schema and normalized data models, implemented SCD
Type 2, and developed Fact/Dim tables with curated layers across industries like education, healthcare,
and manufacturing.
 ETL & Orchestration Expertise: Developed complex ETL workflows using SSIS, ADF pipelines, PowerShell
scripts, and custom API integrations, handling incremental loads and error monitoring.
 Automation & QA: Automated data quality checks, restore operations, and pipeline monitoring using
Azure tools and scheduled triggers for performance optimization and resource management.