Looking for an Apache Spark & Docker engineer for a quick setup on a private cloud.
Budget: $30 – $250 USD
I am looking for an Apache Spark & Docker engineer to quickly set up a master and two slaves in a cloud provider. What I want is two Docker files, one for the master and another configured as a Slave. And using this particular cloud "CLI", deploy the master Docker. Be able to access the UI for Spark. Then deploy the slave and it must auto-connect to the master. I have tested this with a Bitnami Docker image, but I have not been able to finish the work for lack of time.
It should be really straightforward for a knowledgeable Docker engineer, and if you also know a bit of Spark (only setup, I don't need anything else), then it will be even faster. For a knowledgeable engineer, I think it shouldn't take more than two to three hours.
The deliverables are:
* Docker for Master
* Docker for Slave
* Documented CLI commands to deploy both
* Documentation for the steps to create both Docker containers.
* Video of the deployment in action, including using the Spark UI and in it, the slave (Use a Loom video, it's free)
* Everything uploaded to a private repository
I need someone that can work during this weekend (Aug 26-27th), and deliver the files no later than Sunday in the afternoon, Pacific Time.
Required skills and experience for the job:
- Proficiency in Docker
- Bonus points if you know how to set up a simple Spark cluster
- Ability to work quickly and efficiently to meet project deadlines
It should be really straightforward for a knowledgeable Docker engineer, and if you also know a bit of Spark (only setup, I don't need anything else), then it will be even faster. For a knowledgeable engineer, I think it shouldn't take more than two to three hours.
The deliverables are:
* Docker for Master
* Docker for Slave
* Documented CLI commands to deploy both
* Documentation for the steps to create both Docker containers.
* Video of the deployment in action, including using the Spark UI and in it, the slave (Use a Loom video, it's free)
* Everything uploaded to a private repository
I need someone that can work during this weekend (Aug 26-27th), and deliver the files no later than Sunday in the afternoon, Pacific Time.
Required skills and experience for the job:
- Proficiency in Docker
- Bonus points if you know how to set up a simple Spark cluster
- Ability to work quickly and efficiently to meet project deadlines