Web Scraping Expert Needed to Capture Incoming Requests to a Website -- 2
Budget: $10 – $100 USD
I need a skilled web scraping and automation expert to capture all incoming HTTP requests to a specific website. The solution should log request details, including headers, payloads, and response data, in real-time.
Requirements:
Experience with network sniffing, proxy tools, or browser automation (e.g., mitmproxy, Burp Suite, Selenium, Puppeteer).
Ability to bypass bot protection mechanisms (Cloudflare, reCAPTCHA, etc.).
Knowledge of HTTP/HTTPS traffic analysis and request interception.
Logging requests efficiently to a database or structured file format.
Must ensure stealth and non-disruptive monitoring.
Deliverables:
Fully functional script capturing incoming requests.
Clear documentation on setup and usage.
- Please insert "DRAGON" at the beginning of the bid to identify bots.
- Please include examples of similar work you've done.
Looking forward to working with an expert in this field!
Requirements:
Experience with network sniffing, proxy tools, or browser automation (e.g., mitmproxy, Burp Suite, Selenium, Puppeteer).
Ability to bypass bot protection mechanisms (Cloudflare, reCAPTCHA, etc.).
Knowledge of HTTP/HTTPS traffic analysis and request interception.
Logging requests efficiently to a database or structured file format.
Must ensure stealth and non-disruptive monitoring.
Deliverables:
Fully functional script capturing incoming requests.
Clear documentation on setup and usage.
- Please insert "DRAGON" at the beginning of the bid to identify bots.
- Please include examples of similar work you've done.
Looking forward to working with an expert in this field!