Scraper Development Scrapy Cloud

Job ID: 39352491

Budget: $15 – $25 USD

ALL AUTOMATIC and AI BIDS GOT AUTOMATICALLY DELETED AND BLOCKED BY AI.
IF YOU ARE SERIOUS APPLY AS HUMAN AND YOU WILL BE HIRED AS A HUMAN.


I'm seeking an experienced Python developer to build a Scrapy spider for scraping a specific job board website. The scraper must be deployed and scheduled on Scrapy Cloud with Zyte Smart Proxy Manager for proxy rotation and ban avoidance.

Requirements:
• Develop a clean and efficient Scrapy spider
• Configure Smart Proxy Manager integration (via Zyte API key)
• Deploy and schedule the spider on Scrapy Cloud
• Output data in JSON format (or CSV if easier)
• Handle pagination, errors, and retries gracefully
• Provide minimal documentation for deployment and edits

Bonus Skills:
• Experience with Scrapy pipelines to export to databases like MongoDB or Postgres
• Set up basic job monitoring (success/failure rates) on Scrapy Cloud dashboard

Please include links to similar scraping projects you’ve completed, especially those involving Scrapy Cloud or Zyte.


ALL AUTOMATIC and AI BIDS GOT AUTOMATICALLY DELETED AND BLOCKED BY AI.
IF YOU ARE SERIOUS APPLY AS HUMAN AND YOU WILL BE HIRED AS A HUMAN.