Data Engineer Support Needed -- 2
Budget: ₹100 – ₹400 INR
I'm seeking a skilled data engineer to assist with various software development tasks.
Key Responsibilities:
- Building and maintaining data pipelines
- Designing and implementing database solutions
- Ensuring data quality and integrity
- Collaborating with the team on data-related projects
Ideal Skills and Experience:
- Proficiency in SQL and NoSQL databases
- Experience with ETL tools and data modeling
- Strong programming skills in Python or Java
- Familiarity with cloud platforms (AWS, Azure, GCP)
- Excellent problem-solving abilities and attention to detail
If you have a solid background in data engineering and can support day-to-day tasks, I would love to hear from you.
This Could be longer time work required support with Whatsapp or any other channel and Apart from this here are below responblitites and later pay will increase based on response
need Strong hands-on experience in Databricks using PySpark and Spark SQL (Unity Catalog, workflows, Optimization techniques)
Experience with at least one cloud provider solution (GCP,AWS preferred)
Strong experience working with relational SQL databases.
Strong experience with object-oriented/object function scripting language: Python.
Working knowledge in any transformation tools, DBT preferred.
Ability to work with Linux platform.
Strong knowledge of data pipeline and workflow management tools (Airflow)
Working knowledge of Git hub /Git Toolkit
Expertise in standard software engineering methodology, e.g. unit testing, code reviews, design documentation
Experience creating Data pipelines that prepare data for ingestion & consumption appropriately.
Experience in maintaining and optimizing databases/filesystems for production usage in reporting, analytics.
Key Responsibilities:
- Building and maintaining data pipelines
- Designing and implementing database solutions
- Ensuring data quality and integrity
- Collaborating with the team on data-related projects
Ideal Skills and Experience:
- Proficiency in SQL and NoSQL databases
- Experience with ETL tools and data modeling
- Strong programming skills in Python or Java
- Familiarity with cloud platforms (AWS, Azure, GCP)
- Excellent problem-solving abilities and attention to detail
If you have a solid background in data engineering and can support day-to-day tasks, I would love to hear from you.
This Could be longer time work required support with Whatsapp or any other channel and Apart from this here are below responblitites and later pay will increase based on response
need Strong hands-on experience in Databricks using PySpark and Spark SQL (Unity Catalog, workflows, Optimization techniques)
Experience with at least one cloud provider solution (GCP,AWS preferred)
Strong experience working with relational SQL databases.
Strong experience with object-oriented/object function scripting language: Python.
Working knowledge in any transformation tools, DBT preferred.
Ability to work with Linux platform.
Strong knowledge of data pipeline and workflow management tools (Airflow)
Working knowledge of Git hub /Git Toolkit
Expertise in standard software engineering methodology, e.g. unit testing, code reviews, design documentation
Experience creating Data pipelines that prepare data for ingestion & consumption appropriately.
Experience in maintaining and optimizing databases/filesystems for production usage in reporting, analytics.