Databricks Cloud Schema Design

I have a collection of fully structured datasets already living in a Databricks workspace and now need a clean, scalable schema that takes advantage of Databricks SQL in a cloud-based environment. The work involves analysing the existing tables, proposing an optimal relational model, and then producing the physical DDL so I can deploy everything straight into Databricks.

Key goals
• Normalise the data where it makes sense, but stay pragmatic for query performance.
• Define primary and foreign keys, partitioning and clustering strategy suited to Spark execution.
• Provide clear, version-controlled DDL (Databricks notebooks or .sql files) plus an ER diagram so future teammates can understand the design quickly.

Acceptance criteria
– All tables created successfully in my Databricks workspace with no errors.
– Sample queries I supply run within agreed performance thresholds.
– Documentation covers table purpose, column definitions, relationships and any governance notes (e.g., PII handling).

If you have hands-on experience modelling structured data specifically for Databricks or other cloud data platforms, I’d love to review your approach and timeline.