Data Engineer

· Experience in a similar Data Engineering role, who has attained a Graduate degree or above in Computer Science, Statistics, Informatics, Information Systems, or another
quantitative field.

· Experience designing big data real-time processing solutions

· Building and implementing Big Data solutions using Microsoft Data Platform and Azure Data Services; including Data Factory, Azure Functions, Data Warehouse, Data Lake,
Data Lake Analytics, Data Bricks and U-SQL

· Working with both traditional and modern data architecture and processing concepts such as relational SQL and NoSQL databases

· Designing data pipelines to support machine-learning solutions.

· The right candidate must also be able to support and work with cross-functional teams in a dynamic environment in an AGILE development environment.

Technical Requirements:

· Excellent knowledge and ‘hands on’ experience with Azure cloud computing including Azure
SQL DB/DW, HD Insight, Azure Data Lake Storage, Azure Data Lake Analytics, Azure Machine Learning, Stream Analytics, Azure Data Factory, Azure
Functions and Azure Data Bricks

· Create and/or maintain the data pipeline architecture.

· Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources.

· Design, coordinate and execute scalable data processing and analytics solutions, including technical feasibility for Big Data storage, processing, and consumption.

· Identify, design, and implement internal process improvements.

· Build analytics tools that utilize the data pipeline to provide actionable insights for data scientist team members.

· Ensure plan execution, document, and share technical best practices / insights with stakeholders to assist with
data-related technical issues and support their data infrastructure needs.


· Work with other members of the data team, including data architects, data administrators and data scientists