Run Scrapy spiders in parallel - when triggered from Flask Application
Budget: ₹1,500 – ₹12,500 INR
2 Tasks - Project budget (Max 5000 INR)
1. I have a flask web application that runs scrapy spiders at the click of a button. As of now, all spiders are running one after another, I want them to run in parallel. Also, when the button is clicked it should be disabled untill complete spiders execution has been completed.
2. Deploy on Heroku or Pythonanywhere
1. I have a flask web application that runs scrapy spiders at the click of a button. As of now, all spiders are running one after another, I want them to run in parallel. Also, when the button is clicked it should be disabled untill complete spiders execution has been completed.
2. Deploy on Heroku or Pythonanywhere