Azure Data Factory Backup Pipeline
Budget: $15 – $25 USD
I’m looking for an Azure Data Factory specialist who can design and deploy a reliable pipeline that backs up a Job and restores it on demand.
My source environment is a SQL database, so you’ll need to create the linked services and datasets required for secure connectivity (managed identity preferred).
What I need you to deliver:
• A parameter-driven ADF pipeline that exports the Job definition and related data to a storage target of your recommendation (e.g., Blob, Data Lake).
• A complementary restore path that takes the saved artefact and recreates the Job exactly as it was, including schedules and dependencies.
• Error handling, logging, and email/Teams notification so I’m alerted if a step fails.
• Deployment guidance: JSON templates or ARM/Bicep scripts plus a concise runbook that lets me roll this out to other environments.
• Brief walkthrough and hand-off documentation.
Please build in best practices—key-vault-based secrets, activity retry policies, and clear naming conventions—so the solution is production ready from day one. If you’ve handled SQL Agent or similar Job backups with Azure Data Factory before, I’d love to see an example when you apply.
My source environment is a SQL database, so you’ll need to create the linked services and datasets required for secure connectivity (managed identity preferred).
What I need you to deliver:
• A parameter-driven ADF pipeline that exports the Job definition and related data to a storage target of your recommendation (e.g., Blob, Data Lake).
• A complementary restore path that takes the saved artefact and recreates the Job exactly as it was, including schedules and dependencies.
• Error handling, logging, and email/Teams notification so I’m alerted if a step fails.
• Deployment guidance: JSON templates or ARM/Bicep scripts plus a concise runbook that lets me roll this out to other environments.
• Brief walkthrough and hand-off documentation.
Please build in best practices—key-vault-based secrets, activity retry policies, and clear naming conventions—so the solution is production ready from day one. If you’ve handled SQL Agent or similar Job backups with Azure Data Factory before, I’d love to see an example when you apply.
Related categories:
SQL
Cloud Computing
Azure
Data Warehousing
Data Integration
Data Management
Data Backup