Azure Databricks Data Pipeline Engineer
Budget: $8 – $15 USD
Description:
We’re looking for an experienced Data Engineer preferably based from Dubai to help build and manage data pipelines for a global platform. Most work is in Azure, using Azure Data Factory, ADLS, and Databricks.
What you’ll do:
Build and manage PySpark/Spark pipelines in Databricks
Schedule and monitor pipelines in Azure Data Factory
Optimize Databricks for better performance
Keep code and documentation organized and clear
Requirements:
Experience with Azure cloud and Databricks
Strong PySpark / Spark skills
Experience building scalable, reliable data pipelines
Details:
Project-based, with potential to move to full-time
Ideal for engineers who like building cloud-native pipelines
We’re looking for an experienced Data Engineer preferably based from Dubai to help build and manage data pipelines for a global platform. Most work is in Azure, using Azure Data Factory, ADLS, and Databricks.
What you’ll do:
Build and manage PySpark/Spark pipelines in Databricks
Schedule and monitor pipelines in Azure Data Factory
Optimize Databricks for better performance
Keep code and documentation organized and clear
Requirements:
Experience with Azure cloud and Databricks
Strong PySpark / Spark skills
Experience building scalable, reliable data pipelines
Details:
Project-based, with potential to move to full-time
Ideal for engineers who like building cloud-native pipelines
Related categories:
Data Processing
Cloud Computing
Azure
Data Warehousing
Spark
Data Integration
Data Governance
ETL
PySpark
Big Data