Databricks Engineer for Large Scale Data
Budget: $8 – $15 USD
As the professional handling this project, you'll engage with big data exceeding 10GB. Proficiency in Python, Java, and Pyspark are vital for success as we demand expertise in:
- Data ingestion and extraction: The role involves managing complex datasets and running ETL operations.
- Data transformation and cleaning: You'll also need to audit the data for quality and cleanse it for accuracy, ensuring integrity throughout the system.
- Handling Streaming pipelines and Delta Live Tables: Mastery of these could be game-changing in our pipelines, facilitating the real-time analysis of data.
- Data ingestion and extraction: The role involves managing complex datasets and running ETL operations.
- Data transformation and cleaning: You'll also need to audit the data for quality and cleanse it for accuracy, ensuring integrity throughout the system.
- Handling Streaming pipelines and Delta Live Tables: Mastery of these could be game-changing in our pipelines, facilitating the real-time analysis of data.
Related categories:
Business, Accounting, Human Resources & Legal
Python
Data Mining
Big Data Sales
Hadoop