Pyspack streaming pipeline

Have a work in pySpark streaming, need to parse data from Docker nodes over a port and save in the PostgreSQL. The data is binary stream and can be decomposed to data frame, the data needs to be filtered with certain rules.

I will provide you with whole docker setup, just need to write the filters on dataframe and dump in db.

20USD, need the work done in max 5hrs, (actual work, if you have proper skill would take max 1 hour)