ADF/ Azure Data Engineer

Responsibilities: ADF/ Azure Data Engineer Job Description

• You will produce high-quality, secure, and maintainable code in an agile environment;
• Support in creating ADF pipeline, data flow and datasets similar to NiFi
• Process and verification of the sample raw data and enrich data set
• Learn and understand business processes with limited guidance;
• Work collaboratively as a member of the development team to build best-in-class software solutions in an agile environment;
• Support and research issues across all application layers and database;
• You will identify areas to improve and scale our Azure architecture and application design;
• Ensure code can be deployed using Azure DevOps;
• Design and query database tables, views, functions, stored procedures and batch processes;
• Develop, implement, and support interfaces that connect our websites, back-end systems, and various 3rd party cloud solutions.
Requirements:
• Experience with private and public cloud architectures, pros/cons, and migration considerations;
• Cloud migration methodologies and processes including tools like Azure Data Factory, Event Hub, etc;
• Experience in Apache NiFi, Hadoop (HDFS) , Data Lake Migration,
• Support in creating ADF pipeline, data flow and datasets similar to NiFi
• Process and verification of the sample raw data and enrich data set
• Microsoft Azure certifications are a plus;
• Excellent problem solving, analytical, and critical thinking skills.