Troubleshoot python crawler cloudfare blocking issue on linux server. Same crawler works well on local computer.
Budget: $10 – $30 USD
Hello! I'm looking for a freelancer who can troubleshoot an issue with a python crawler on a Linux server.
The crawler works properly on a local computer but fails to operate correctly when given the same conditions on the Linux server.
The Linux server is running a Ubuntu operating system. When the crawler is blocked by cloudfare, there is no error message - instead, the Chrome browser crashes.
I have already tried running the crawler directly on the server, but the same issue persists. If you think you have the skills to solve this issue, please let me know - I'm looking forward to our collaboration!
Target website might be blocking because the crawler is headless. However crawler works well on local computer
Please bid if you have encountered same issue in the past.
Regards
Andy
The crawler works properly on a local computer but fails to operate correctly when given the same conditions on the Linux server.
The Linux server is running a Ubuntu operating system. When the crawler is blocked by cloudfare, there is no error message - instead, the Chrome browser crashes.
I have already tried running the crawler directly on the server, but the same issue persists. If you think you have the skills to solve this issue, please let me know - I'm looking forward to our collaboration!
Target website might be blocking because the crawler is headless. However crawler works well on local computer
Please bid if you have encountered same issue in the past.
Regards
Andy