Troubleshoot Python Playwright Webscraping Script on Server
Budget: $250 – $750 SGD
I am in need of an expert who can troubleshoot a script that is written using Playwright in Python. This script was working perfectly for web scraping until recently. It still runs but is unable to load the website.
The website has not blocked my server or IP because I can still access the website when I use selenium
- No Changes: To pinpoint the issue, it's essential to note that no recent modifications have been done neither to the code nor the website.
- Main Issue: The script flaw is not about access the website and scraping some data. The script can somehow no longer load the website. Sometimes when the server is restart, the script works again for 1minute but stops working after that.
Ideally, the person for this job should understand how Playwright works, have good experience in Python and debugging scripts that are returning incorrect data. You should also be able not only to identify the problem but also suggest solutions to prevent this from happening in the future. It will be a plus if you have worked frequently with long web scraping tasks and familiar with issues related to them.
The website has not blocked my server or IP because I can still access the website when I use selenium
- No Changes: To pinpoint the issue, it's essential to note that no recent modifications have been done neither to the code nor the website.
- Main Issue: The script flaw is not about access the website and scraping some data. The script can somehow no longer load the website. Sometimes when the server is restart, the script works again for 1minute but stops working after that.
Ideally, the person for this job should understand how Playwright works, have good experience in Python and debugging scripts that are returning incorrect data. You should also be able not only to identify the problem but also suggest solutions to prevent this from happening in the future. It will be a plus if you have worked frequently with long web scraping tasks and familiar with issues related to them.