Fix Errors in Python Scraper File -- 3
Budget: $2 – $8 USD
Scraping Issue (Headless Mode on Server)
We're facing an issue where our scraper fails to extract data when running on a server in headless mode. Here's a breakdown:
Locally, using VS Code with a remote host connection, the scraper works fine.
When running on the server, the scraper connects but fails shortly after – and doesn't extract data.
The target website presents a CAPTCHA before accessing the "view notice" page.
Locally, we receive logs from anti-captcha services, but on the server, no such logs appear, making debugging difficult.
It seems the browser behavior in headless mode on the server is getting blocked or disconnected, possibly due to detection or incomplete resource loading.
We need someone who can:
Diagnose why the scraper behaves differently on the server.
Ensure anti-captcha integration and logging works consistently.
Make scraping reliable in headless server environments.
We're facing an issue where our scraper fails to extract data when running on a server in headless mode. Here's a breakdown:
Locally, using VS Code with a remote host connection, the scraper works fine.
When running on the server, the scraper connects but fails shortly after – and doesn't extract data.
The target website presents a CAPTCHA before accessing the "view notice" page.
Locally, we receive logs from anti-captcha services, but on the server, no such logs appear, making debugging difficult.
It seems the browser behavior in headless mode on the server is getting blocked or disconnected, possibly due to detection or incomplete resource loading.
We need someone who can:
Diagnose why the scraper behaves differently on the server.
Ensure anti-captcha integration and logging works consistently.
Make scraping reliable in headless server environments.