Senior Data Engineer
Budget: ₹37,500 – ₹75,000 INR
Job Description: Data Engineer
We are seeking an experienced Data Engineer with a minimum of 5 years of expertise in their field. As a Data Engineer specializing in AWS Glue, you will primarily focus on the review, setup, modification, and continuous improvement of data pipelines. Your proficiency in PySpark, Python, AWS Glue, crawler, SQL, as well as knowledge of SAP and CRM systems, will be instrumental in managing the pipelines between data lakes.
Key Responsibilities:
Review and assess the existing pipelines to ensure their effectiveness and efficiency.
Set up robust data pipelines using AWS Glue, adhering to industry best practices and standards.
Continuously modify and enhance existing pipelines to meet evolving business requirements.
Collaborate with cross-functional teams to identify opportunities for optimizing data integration and transformation processes.
Troubleshoot and resolve any pipeline issues or discrepancies in a timely manner.
Perform data validation, quality assurance, and data integrity checks throughout the pipelines.
Utilize PySpark, Python, SQL, and other relevant tools to implement data transformations and manipulations.
Effectively manage pipelines that involve SAP and CRM systems, ensuring seamless data flow between these systems and data lakes.
Stay up to date with the latest industry trends, technologies, and best practices in data engineering and analytics.
Qualifications and Skills:
Bachelor's degree in Computer Science, Engineering, or a related field. Equivalent work experience will also be considered.
Minimum of 5 years of hands-on experience as a Data Engineer, with a focus on AWS Glue.
Strong proficiency in PySpark, Python, AWS Glue, and SQL for data manipulation and transformation.
Familiarity with SAP and CRM systems, with the ability to integrate them into data pipelines.
Experience in managing data pipelines and workflows using AWS Glue and related tools.
Solid understanding of data warehousing concepts and best practices.
Strong problem-solving and analytical skills, with the ability to identify and resolve data-related issues efficiently.
Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
Proven ability to adapt to changing priorities and deliver high-quality results within tight deadlines.
AWS certification in Glue or other relevant areas is a plus.
Join our team of skilled professionals and contribute to the successful execution of data engineering projects. Apply now and embark on an exciting journey of driving data-driven insights for our organization.
We are seeking an experienced Data Engineer with a minimum of 5 years of expertise in their field. As a Data Engineer specializing in AWS Glue, you will primarily focus on the review, setup, modification, and continuous improvement of data pipelines. Your proficiency in PySpark, Python, AWS Glue, crawler, SQL, as well as knowledge of SAP and CRM systems, will be instrumental in managing the pipelines between data lakes.
Key Responsibilities:
Review and assess the existing pipelines to ensure their effectiveness and efficiency.
Set up robust data pipelines using AWS Glue, adhering to industry best practices and standards.
Continuously modify and enhance existing pipelines to meet evolving business requirements.
Collaborate with cross-functional teams to identify opportunities for optimizing data integration and transformation processes.
Troubleshoot and resolve any pipeline issues or discrepancies in a timely manner.
Perform data validation, quality assurance, and data integrity checks throughout the pipelines.
Utilize PySpark, Python, SQL, and other relevant tools to implement data transformations and manipulations.
Effectively manage pipelines that involve SAP and CRM systems, ensuring seamless data flow between these systems and data lakes.
Stay up to date with the latest industry trends, technologies, and best practices in data engineering and analytics.
Qualifications and Skills:
Bachelor's degree in Computer Science, Engineering, or a related field. Equivalent work experience will also be considered.
Minimum of 5 years of hands-on experience as a Data Engineer, with a focus on AWS Glue.
Strong proficiency in PySpark, Python, AWS Glue, and SQL for data manipulation and transformation.
Familiarity with SAP and CRM systems, with the ability to integrate them into data pipelines.
Experience in managing data pipelines and workflows using AWS Glue and related tools.
Solid understanding of data warehousing concepts and best practices.
Strong problem-solving and analytical skills, with the ability to identify and resolve data-related issues efficiently.
Excellent communication and collaboration skills, with the ability to work effectively in a team-oriented environment.
Proven ability to adapt to changing priorities and deliver high-quality results within tight deadlines.
AWS certification in Glue or other relevant areas is a plus.
Join our team of skilled professionals and contribute to the successful execution of data engineering projects. Apply now and embark on an exciting journey of driving data-driven insights for our organization.