Looking for an Azure Data Engineer from India for our Enterprise Client

Job ID: 33505443

Budget: $20 – $30 USD

Looking for an Azure Data Engineer from India for our Enterprise Client (INDIVIDUALS ONLY). Teams/Enterprises/Consultancies/Agencies please stay away.

Project Duration: 3-6 months
Location: Remote/WFH.
Hours Required: 40 hrs/week

Responsibilities
• Design Azure Data Lake solution, partition strategy for files
• Explore and load data from structured and semi-structured data sources into ADLS and Azure Blob Storage
• Ingest and transform data using Azure Data Factory
• Ingest and transform data using Azure Databricks and PySpark
• Design and build data engineering pipelines using Azure Data Factory
• Implement data pipelines for full load and incremental data loads
• Design and build error handling, data quality routines using Data factory and PySpark
• Orchestrate data movement and transformation using Azure Data Factory
• Trigger batch loads, handle failed jobs, manage and monitor batch jobs
• Send email alerts and notifications using Azure Logic App

Required Skills
• Azure data factory
• Azure Data bricks
• Azure Cloud Services
• ADLS, Azure Blog Storage
• Azure Functions
• Azure SQL Database
• Azure Logic App
• Python and PySpark
Related categories: Python SQL Azure Cloud Data PySpark