Databricks Data Engineer
Budget: ₹750 – ₹1,250 INR
Requirements (Knowledge, Skills & Abilities)
5 years’ experience developing data warehouses and analytical products in analytics team environment.
Demonstrated ability to build processes that support data transformation, data structures, metadata, dependency and workload management. Strong data modeling skills (relational, dimensional and flattened).
Advanced Python and PySpark knowledge, good SQL knowledge
Knowledge of pytest and regression testing for spark
Experience in an operational role supporting data platforms and business intelligence solutions. Experience performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement.
Strong solution design experience.
Experience integrating data from different sources (API, Databases, files, etc.)
Experience with the following platforms: Azure, Power BI (nice to have).
Experience with the following tools and technologies: Data Bricks, ADF, Azure Data Lake, DevOps Repos/Pipelines (nice to have).
Building and optimizing ‘big data’ data pipelines, architectures and data sets for machine learning and analytics.
Strong interpersonal skills and ability to project manage and work with cross-functional global teams.
Excellent communication skills; both verbal and written.
5 years’ experience developing data warehouses and analytical products in analytics team environment.
Demonstrated ability to build processes that support data transformation, data structures, metadata, dependency and workload management. Strong data modeling skills (relational, dimensional and flattened).
Advanced Python and PySpark knowledge, good SQL knowledge
Knowledge of pytest and regression testing for spark
Experience in an operational role supporting data platforms and business intelligence solutions. Experience performing root cause analysis on data and processes to answer specific business questions and identify opportunities for improvement.
Strong solution design experience.
Experience integrating data from different sources (API, Databases, files, etc.)
Experience with the following platforms: Azure, Power BI (nice to have).
Experience with the following tools and technologies: Data Bricks, ADF, Azure Data Lake, DevOps Repos/Pipelines (nice to have).
Building and optimizing ‘big data’ data pipelines, architectures and data sets for machine learning and analytics.
Strong interpersonal skills and ability to project manage and work with cross-functional global teams.
Excellent communication skills; both verbal and written.