Scraper Development Scrapy Cloud
Budget: $15 – $25 USD
ALL AUTOMATIC and AI BIDS GOT AUTOMATICALLY DELETED AND BLOCKED BY AI.
IF YOU ARE SERIOUS APPLY AS HUMAN AND YOU WILL BE HIRED AS A HUMAN.
I'm seeking an experienced Python developer to build a Scrapy spider for scraping a specific job board website. The scraper must be deployed and scheduled on Scrapy Cloud with Zyte Smart Proxy Manager for proxy rotation and ban avoidance.
Requirements:
• Develop a clean and efficient Scrapy spider
• Configure Smart Proxy Manager integration (via Zyte API key)
• Deploy and schedule the spider on Scrapy Cloud
• Output data in JSON format (or CSV if easier)
• Handle pagination, errors, and retries gracefully
• Provide minimal documentation for deployment and edits
Bonus Skills:
• Experience with Scrapy pipelines to export to databases like MongoDB or Postgres
• Set up basic job monitoring (success/failure rates) on Scrapy Cloud dashboard
Please include links to similar scraping projects you’ve completed, especially those involving Scrapy Cloud or Zyte.
ALL AUTOMATIC and AI BIDS GOT AUTOMATICALLY DELETED AND BLOCKED BY AI.
IF YOU ARE SERIOUS APPLY AS HUMAN AND YOU WILL BE HIRED AS A HUMAN.
IF YOU ARE SERIOUS APPLY AS HUMAN AND YOU WILL BE HIRED AS A HUMAN.
I'm seeking an experienced Python developer to build a Scrapy spider for scraping a specific job board website. The scraper must be deployed and scheduled on Scrapy Cloud with Zyte Smart Proxy Manager for proxy rotation and ban avoidance.
Requirements:
• Develop a clean and efficient Scrapy spider
• Configure Smart Proxy Manager integration (via Zyte API key)
• Deploy and schedule the spider on Scrapy Cloud
• Output data in JSON format (or CSV if easier)
• Handle pagination, errors, and retries gracefully
• Provide minimal documentation for deployment and edits
Bonus Skills:
• Experience with Scrapy pipelines to export to databases like MongoDB or Postgres
• Set up basic job monitoring (success/failure rates) on Scrapy Cloud dashboard
Please include links to similar scraping projects you’ve completed, especially those involving Scrapy Cloud or Zyte.
ALL AUTOMATIC and AI BIDS GOT AUTOMATICALLY DELETED AND BLOCKED BY AI.
IF YOU ARE SERIOUS APPLY AS HUMAN AND YOU WILL BE HIRED AS A HUMAN.