Executing Spark Jobs from External Python Script
Budget: $30 – $250 USD
Support Executing Spark Jobs from External Python Script
Hi there!
We are looking for a software engineer with python and spark proficiency. Specifically, we need support defining the best way for starting and getting the status of spark scripts that are going to execute in a dedicated spark server.
We are open to use any tool or framework that could help us to build a seamless and robust way in order to execute spark scripts (or spark jobs) from an external python script.
Deliverables:
• Description of the tool, framework or way for executing the spark code
• Scripts or code that could achieve the execution (poc)
Feel free to ask for more information.
Hi there!
We are looking for a software engineer with python and spark proficiency. Specifically, we need support defining the best way for starting and getting the status of spark scripts that are going to execute in a dedicated spark server.
We are open to use any tool or framework that could help us to build a seamless and robust way in order to execute spark scripts (or spark jobs) from an external python script.
Deliverables:
• Description of the tool, framework or way for executing the spark code
• Scripts or code that could achieve the execution (poc)
Feel free to ask for more information.