Databricks Error Logging Setup
Budget: ₹2,000 – ₹3,000 INR
Description:
Need an experienced Databricks engineer to guide me through adding logging tasks to 2 workflows in Azure Databricks.
What needs to be done:
Add log_success and log_failure notebook tasks to 2 existing Databricks workflows
Configure parameters to write execution details to monitoring table
Update task dependencies
Test in Prod Dev environment
Help update YAML configuration for Production
CRITICAL REQUIREMENT:
All work must be done via Zoom screen sharing on MY machine
You will guide/instruct me while I make the changes or you can do it
I need to learn the process, not just get it done
Must Have:
Strong Azure Databricks workflows/jobs experience
Experience with pipeline logging/monitoring patterns
Patient teaching approach
Tech Stack:
Azure Databricks
Unity Catalog
Python/PySpark
Azure DevOps (YAML configs)
Timeline: Start ASAP
To Apply:
Share your Databricks experience and availability for Zoom sessions (mention your timezone).
Need an experienced Databricks engineer to guide me through adding logging tasks to 2 workflows in Azure Databricks.
What needs to be done:
Add log_success and log_failure notebook tasks to 2 existing Databricks workflows
Configure parameters to write execution details to monitoring table
Update task dependencies
Test in Prod Dev environment
Help update YAML configuration for Production
CRITICAL REQUIREMENT:
All work must be done via Zoom screen sharing on MY machine
You will guide/instruct me while I make the changes or you can do it
I need to learn the process, not just get it done
Must Have:
Strong Azure Databricks workflows/jobs experience
Experience with pipeline logging/monitoring patterns
Patient teaching approach
Tech Stack:
Azure Databricks
Unity Catalog
Python/PySpark
Azure DevOps (YAML configs)
Timeline: Start ASAP
To Apply:
Share your Databricks experience and availability for Zoom sessions (mention your timezone).
Related categories:
Python
Cloud Computing
C# Programming
Software Architecture
Azure
Amazon Web Services
Data Analysis
Data Management