Optimization of python code script with Redis and Celery (Eventlet) for downloading tennis live streams

Job ID: 37775629

Budget: $30 – $250 USD

Hi, I am looking for someone who can update or optimize existing script in python for downloading tennis live streams. The current script is working with Celery (Eventlet) and Redis and final version should run permanently on linux server like Google Cloud. You need be expert with Redis and Celery! Also has strong knowledge of the python!

Issues in the current version of the script:
1) The first issue is in Celery (I think because of the celery (eventlet) settings) during downloading for example 10 live streams in the same time sometimes happen that the livestream is not downloaded or the downloaded .ts file has 0 byte size. This issue have to be analysed and fixed!
The celery is triggered with this command "python3 -m celery -A test worker -c 1000 -l INFO -P eventlet"

2) The second issue is that I expect that celery should automatically end the Concurrency (-c 1000) when the live stream is finished (downloaded) but this is not happening and concurrency is still triggered. You should solve this issue. I think it is maybe because of the eventlet (celery) settings. Because of this issue is Concurrency set to 1000 otherwise otherwise if this value is set to low (for example to 20) then it starts downloading only 20 live streams and the 21th is not downloaded.

IMPORTANT INFORMATION!
Fot prooving that the issues are fixed the final version of the script will run for 7 days on the GoogleCloud platform and it should download every present live stream for proving that these issues are fixed! After prooving that issues are fixed the project will be resolved and you will be payed! Keep this in mind if you are interested in my project!

Website for downloading tennis livestreams is: "https://live.itftennis.com/en/live-streams/r
Related categories: Python Redis Celery