Azure Data Engineering Expert Needed
Budget: ₹400 – ₹750 INR
I'm seeking an experienced Azure Data Engineer to step in and effectively collaborate with my remote team. Given the lack of a specific task or main goal, your expertise, adaptiveness, and versatility will come in handy.
Key responsibilities may likely include: -
• Ideal candidates should have strong experience with Azure Databricks and Data factory.
• Conducting data analysis - Data integration - Data processing - Possibly executing ETL processes - Maybe venturing into data modelling, optimization, and pipeline development.
• Efficient communication and collaboration capabilities are needed for this remote role.
• I look forward to working with an adaptable professional who can confidently handle diverse tasks in Azure data engineering.
• Design, develop, and maintain data pipelines using Azure Data Factory to ingest, transform, and load data into data lakes.
• Implement and optimize data processing workflows using Azure Databricks for efficient data manipulation and analysis.
• Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs.
• Ensure data quality and integrity by implementing data validation and cleansing processes.
• Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
• Develop and maintain documentation for data engineering processes, standards, and best practices.
• Stay updated with the latest trends and advancements in Azure data technologies to continuously improve our data solutions
Key Skills :-
• Bachelor's degree in Computer Science, Information Technology, or related field.
• 4-5 years of professional experience as a Data Engineer with a focus on Azure Databricks and Azure Data Factory.
• Strong proficiency in SQL, Python, and/or Scala for data manipulation and scripting tasks.
• Experience working with data lakes, data warehouses, and ETL processes.
• Familiarity with cloud platforms (preferably Azure) and related services such as Azure Blob Storage, Azure SQL Database, etc.
• Excellent problem-solving skills and attention to detail.
• Effective communication and collaboration skills to work with cross-functional teams.
• Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus.
The scope of the data involved is also currently undefined, but I would prefer an individual who can manage large quantities of data comfortably. In terms of goals, they're not yet firmly set - but they could range from data analysis and reporting, data integration and consolidation, to data migration etc.
Key responsibilities may likely include: -
• Ideal candidates should have strong experience with Azure Databricks and Data factory.
• Conducting data analysis - Data integration - Data processing - Possibly executing ETL processes - Maybe venturing into data modelling, optimization, and pipeline development.
• Efficient communication and collaboration capabilities are needed for this remote role.
• I look forward to working with an adaptable professional who can confidently handle diverse tasks in Azure data engineering.
• Design, develop, and maintain data pipelines using Azure Data Factory to ingest, transform, and load data into data lakes.
• Implement and optimize data processing workflows using Azure Databricks for efficient data manipulation and analysis.
• Collaborate with cross-functional teams to understand data requirements and design solutions that meet business needs.
• Ensure data quality and integrity by implementing data validation and cleansing processes.
• Monitor and troubleshoot data pipelines to identify and resolve issues in a timely manner.
• Develop and maintain documentation for data engineering processes, standards, and best practices.
• Stay updated with the latest trends and advancements in Azure data technologies to continuously improve our data solutions
Key Skills :-
• Bachelor's degree in Computer Science, Information Technology, or related field.
• 4-5 years of professional experience as a Data Engineer with a focus on Azure Databricks and Azure Data Factory.
• Strong proficiency in SQL, Python, and/or Scala for data manipulation and scripting tasks.
• Experience working with data lakes, data warehouses, and ETL processes.
• Familiarity with cloud platforms (preferably Azure) and related services such as Azure Blob Storage, Azure SQL Database, etc.
• Excellent problem-solving skills and attention to detail.
• Effective communication and collaboration skills to work with cross-functional teams.
• Azure certifications (e.g., Microsoft Certified: Azure Data Engineer Associate) are a plus.
The scope of the data involved is also currently undefined, but I would prefer an individual who can manage large quantities of data comfortably. In terms of goals, they're not yet firmly set - but they could range from data analysis and reporting, data integration and consolidation, to data migration etc.