Spark Structured Streamming

Job ID: 31828131

Budget: $40 – $50 AUD

This project needs a spark structured streaming program which needs to be done in Pyspark. Need to stream the CSV files with Pyspark.
The code should be able to run in Anaconda Jupyter Notebook
and also the code should be able to save all INFO messages to the file which are generated during spark streaming

I need this in the next 2 hrs of time
please don't bid if you are not able to work in next 2 hrs
Related categories: Spark PySpark Big Data