Databricks Error Logging Setup

Job ID: 40004384

Budget: ₹2,000 – ₹3,000 INR

Description:
Need an experienced Databricks engineer to guide me through adding logging tasks to 2 workflows in Azure Databricks.
What needs to be done:

Add log_success and log_failure notebook tasks to 2 existing Databricks workflows
Configure parameters to write execution details to monitoring table
Update task dependencies
Test in Prod Dev environment
Help update YAML configuration for Production

CRITICAL REQUIREMENT:

All work must be done via Zoom screen sharing on MY machine
You will guide/instruct me while I make the changes or you can do it
I need to learn the process, not just get it done

Must Have:

Strong Azure Databricks workflows/jobs experience
Experience with pipeline logging/monitoring patterns
Patient teaching approach


Tech Stack:

Azure Databricks
Unity Catalog
Python/PySpark
Azure DevOps (YAML configs)


Timeline: Start ASAP
To Apply:
Share your Databricks experience and availability for Zoom sessions (mention your timezone).