E-commerce Text & Image Scraper Needed -- 2
Budget: $30 – $250 USD
I have a data-analysis pipeline that relies on a steady flow of fresh product images from a well-known e-commerce site. What I need is a robust scraper that can navigate the catalog, collect every product’s main and variant images, and deliver them to me neatly organized.
Key points you should know:
• Target: a single e-commerce platform (URL supplied after award).
• Payload: high-resolution image files plus a CSV/JSON map linking each file to product ID, title, price, and category text that you extract during the same run.
• Scale: thousands of products per crawl; a resumable approach is essential so partial failures don’t force a full restart.
• Frequency: I’ll trigger the crawl weekly, so reusable code is a must.
I’m happy with Python—Scrapy, Selenium, Playwright, or a headless solution of your choice—as long as it respects the site’s anti-bot measures and keeps requests polite. Please include a brief outline of how you’ll handle pagination, lazy-loaded images, and rate limiting.
Let me know your proposed stack and turnaround time, and we’ll get started.
Key points you should know:
• Target: a single e-commerce platform (URL supplied after award).
• Payload: high-resolution image files plus a CSV/JSON map linking each file to product ID, title, price, and category text that you extract during the same run.
• Scale: thousands of products per crawl; a resumable approach is essential so partial failures don’t force a full restart.
• Frequency: I’ll trigger the crawl weekly, so reusable code is a must.
I’m happy with Python—Scrapy, Selenium, Playwright, or a headless solution of your choice—as long as it respects the site’s anti-bot measures and keeps requests polite. Please include a brief outline of how you’ll handle pagination, lazy-loaded images, and rate limiting.
Let me know your proposed stack and turnaround time, and we’ll get started.
Related categories:
PHP
Python
Web Scraping
Software Architecture
Scrapy
Data Extraction
Data Analysis
Selenium