PySpark with Datastage
Budget: $750 – $1,500 USD
I am looking for a python engineer who is experienced with PySpark and Datastage. You need to understand datastage jobs and convert them into PySpark to run via databricks. The jobs need to be tested in the client's environment to make sure they produce the same results like the datastage jobs.
I can send the sample code (the converted one) and you have to have a wrapper in Python like a workflow calling PySpark jobs to manage the flow of the jobs.
Need someone for 2 weeks.
I can send the sample code (the converted one) and you have to have a wrapper in Python like a workflow calling PySpark jobs to manage the flow of the jobs.
Need someone for 2 weeks.
Related categories:
Business, Accounting, Human Resources & Legal
Python
Linux
Software Architecture
PySpark