Databricks Architecture Guidance
Budget: ₹1,500 – ₹12,500 INR
I’m still at the concept stage of a Databricks-based application that will handle mainly structured data. CRUD application which will display model outputs and also allow user to upload files to get scored model outputs
Here’s what I need from you:
• A concise but detailed architecture blueprint (diagram + narrative) covering workspace setup, data ingress, storage layout, Delta Lake design, compute clusters, and governance.
• Written guidance on best-practice patterns for structured data ETL, quality checks, and job orchestration in Databricks (Jobs, Workflows, or a recommended alternative).
• Recommendations on dev-to-prod promotion: repos, CI/CD strategy, and environment isolation.
• Will need 2-3 1 hour consultations spread over a week
I’m comfortable with AWS or Azure Back end
Here’s what I need from you:
• A concise but detailed architecture blueprint (diagram + narrative) covering workspace setup, data ingress, storage layout, Delta Lake design, compute clusters, and governance.
• Written guidance on best-practice patterns for structured data ETL, quality checks, and job orchestration in Databricks (Jobs, Workflows, or a recommended alternative).
• Recommendations on dev-to-prod promotion: repos, CI/CD strategy, and environment isolation.
• Will need 2-3 1 hour consultations spread over a week
I’m comfortable with AWS or Azure Back end