Data Engineer
Budget: ₹150,000 – ₹250,000 INR
We are looking for Full Time employee who can work on our payroll.
Responsibilities:
ETL Development:
● Design, develop, and implement robust ETL processes using AWS Glue, AWS Data Pipeline, or custom scripts as needed.
● Ensure the efficient extraction, transformation, and loading of data from diverse sources into our data warehouse.
Data Warehousing:
● Design and maintain data warehouse solutions on AWS, with a focus on scalability, performance, and reliability.
● Implement and optimize data models for efficient storage and retrieval in AWS Redshift.
AWS Service Utilization:
● Leverage AWS services such as S3, Lambda, Glue, Redshift, and others to build end-to-end data solutions.
● Stay abreast of AWS developments and recommend the adoption of new services to enhance our data architecture.
SQL Expertise:
● Craft complex SQL queries to support data analysis, reporting, and business intelligence requirements.
● Optimize SQL code for performance and efficiency, and troubleshoot any issues related to data retrieval.
Performance Optimization:
● Optimize ETL workflows and data warehouse queries to ensure optimal performance.
● Identify and resolve bottlenecks in data processing and storage.
Data Integration:
● Collaborate with cross-functional teams to integrate data from various sources into the data warehouse.
● Work closely with business stakeholders to understand data requirements.
Security and Compliance:
● Implement and maintain security measures to protect data integrity and ensure compliance with industry standards and regulations.
● Collaborate with the security and compliance teams to implement best practices.
Documentation:
● Document ETL processes, data models, and system configurations for future reference.
● Ensure comprehensive documentation of the developed solutions for knowledge transfer.
Requirements:
● Bachelor's degree in Computer Science, Information Technology, or a related field.
● Proven experience as an ETL & Data Warehouse Developer with a focus on AWS services and SQL expertise.
● Strong proficiency in SQL, stored procedures, and views.
● In-depth understanding of AWS services related to data processing and storage.
● Experience with data modeling and designing efficient data warehouses.
● Familiarity with best practices in data security, compliance, and governance.
● Strong problem-solving and analytical skills.
● Excellent communication and collaboration skills.
● Certification in AWS or relevant technologies.
Responsibilities:
ETL Development:
● Design, develop, and implement robust ETL processes using AWS Glue, AWS Data Pipeline, or custom scripts as needed.
● Ensure the efficient extraction, transformation, and loading of data from diverse sources into our data warehouse.
Data Warehousing:
● Design and maintain data warehouse solutions on AWS, with a focus on scalability, performance, and reliability.
● Implement and optimize data models for efficient storage and retrieval in AWS Redshift.
AWS Service Utilization:
● Leverage AWS services such as S3, Lambda, Glue, Redshift, and others to build end-to-end data solutions.
● Stay abreast of AWS developments and recommend the adoption of new services to enhance our data architecture.
SQL Expertise:
● Craft complex SQL queries to support data analysis, reporting, and business intelligence requirements.
● Optimize SQL code for performance and efficiency, and troubleshoot any issues related to data retrieval.
Performance Optimization:
● Optimize ETL workflows and data warehouse queries to ensure optimal performance.
● Identify and resolve bottlenecks in data processing and storage.
Data Integration:
● Collaborate with cross-functional teams to integrate data from various sources into the data warehouse.
● Work closely with business stakeholders to understand data requirements.
Security and Compliance:
● Implement and maintain security measures to protect data integrity and ensure compliance with industry standards and regulations.
● Collaborate with the security and compliance teams to implement best practices.
Documentation:
● Document ETL processes, data models, and system configurations for future reference.
● Ensure comprehensive documentation of the developed solutions for knowledge transfer.
Requirements:
● Bachelor's degree in Computer Science, Information Technology, or a related field.
● Proven experience as an ETL & Data Warehouse Developer with a focus on AWS services and SQL expertise.
● Strong proficiency in SQL, stored procedures, and views.
● In-depth understanding of AWS services related to data processing and storage.
● Experience with data modeling and designing efficient data warehouses.
● Familiarity with best practices in data security, compliance, and governance.
● Strong problem-solving and analytical skills.
● Excellent communication and collaboration skills.
● Certification in AWS or relevant technologies.