Data factory, Azure,ETL
Budget: ₹75,000 – ₹150,000 INR
Data Factory, Azure, ETL resource Project starting in 15days
Desired Competencies (Technical/Behavioral Competency)
Must-Have
• Strong knowledge of data modelling, data warehousing and ETL framework
• This role will be responsible for creating Data orchestration with Azure Data Factory Pipelines & Dataflows. Key role is to understand the business requirements and implement the requirements using Azure Data Factory
• Knowledge of the following:
• SQL queries
• Azure Cloud services
Good-to-Have
Python, Azure Synapse, Azure Data Factory
Role descriptions / Expectations from the Role
• Understand business requirement and actively provide inputs from Data perspective
• Understand the underlying data and flow of data.
• Build simple to complex pipelines & dataflows.
• Should be able to implement modules that has security and authorization frameworks.
• Recognize and adapt to the changes in processes as the project evolves in size and function
• Work on understanding requirements, data and implement data pipelines
• Highly proficient at SQL development
• Significant experience in Python development
• Solid grasp of database engineering and design principles
• Familiarity with CI/CD methods desired
• Past or current experience with an ETL tools such as Infomatica, Talend, ADF is an advantage
Responsibilities:
– Lead the data technology activities including preparation, patching, backup, and restoration.
– Work with the data architecture team to design the data model and data flow.
– Lead the implementation of the physical data model.
– Manage the design and change of the database to improve the performance and stability.
– Provide and maintain the guidelines and directions for developers to build technical design.
– Act as the database owner to control all the activities related to the DDL.
Requirements:
– At least 8 years experience of in supporting and building data warehouse.
– Expert in SQL writing.
– Solid experience in using Azure DataWarehouse and Azure Data Lake.
– Knowledge in Microsoft Azure and its components including Data Lake and ADF is highly preferred.
– Knowledge in database administration in an enterprise environment.
Desired Competencies (Technical/Behavioral Competency)
Must-Have
• Strong knowledge of data modelling, data warehousing and ETL framework
• This role will be responsible for creating Data orchestration with Azure Data Factory Pipelines & Dataflows. Key role is to understand the business requirements and implement the requirements using Azure Data Factory
• Knowledge of the following:
• SQL queries
• Azure Cloud services
Good-to-Have
Python, Azure Synapse, Azure Data Factory
Role descriptions / Expectations from the Role
• Understand business requirement and actively provide inputs from Data perspective
• Understand the underlying data and flow of data.
• Build simple to complex pipelines & dataflows.
• Should be able to implement modules that has security and authorization frameworks.
• Recognize and adapt to the changes in processes as the project evolves in size and function
• Work on understanding requirements, data and implement data pipelines
• Highly proficient at SQL development
• Significant experience in Python development
• Solid grasp of database engineering and design principles
• Familiarity with CI/CD methods desired
• Past or current experience with an ETL tools such as Infomatica, Talend, ADF is an advantage
Responsibilities:
– Lead the data technology activities including preparation, patching, backup, and restoration.
– Work with the data architecture team to design the data model and data flow.
– Lead the implementation of the physical data model.
– Manage the design and change of the database to improve the performance and stability.
– Provide and maintain the guidelines and directions for developers to build technical design.
– Act as the database owner to control all the activities related to the DDL.
Requirements:
– At least 8 years experience of in supporting and building data warehouse.
– Expert in SQL writing.
– Solid experience in using Azure DataWarehouse and Azure Data Lake.
– Knowledge in Microsoft Azure and its components including Data Lake and ADF is highly preferred.
– Knowledge in database administration in an enterprise environment.