Databricks engineer
Budget: $8 – $15 AUD
I am looking for a databricks engineer to optimize the cloud computing environment hosted on Azure Databricks. The project requires an understanding of data models and architectures as well as strong data analysis, data transformation, visualisation and reporting skills. The size of the dataset is more than 10GB and the preferred programming language is Python. Being able to understand best practices for cloud computing and automation is desired in order to best optimise the environment. The engineer should have experience in carrying out such tasks before. An understanding of other objects required to support the cloud environment is highly desired.
Overall, the goal of this project is to create an optimised environment that can effectively manage workloads. The databricks engineer should have sound knowledge of cloud-computing models and be experienced in processing large datasets and deploying the platform to provide a cost-effective solution. The chosen engineer must demonstrate good communication skills, be creative and use an analytical approach to problem solving. The successful candidate is expected to work independently and take pride in producing high quality, reliable work.
Overall, the goal of this project is to create an optimised environment that can effectively manage workloads. The databricks engineer should have sound knowledge of cloud-computing models and be experienced in processing large datasets and deploying the platform to provide a cost-effective solution. The chosen engineer must demonstrate good communication skills, be creative and use an analytical approach to problem solving. The successful candidate is expected to work independently and take pride in producing high quality, reliable work.