Scrape Netmeds & 1mg Catalog
Budget: ₹1,500 – ₹12,500 INR
I need the entire product catalog from Netmeds.com and 1mg.com transferred to my site. The job covers three clear stages:
• First, crawl both sources, collect every product record, and deliver the raw data in a clean CSV. Each row should at minimum include the product name, price, description, category path, and the direct URL of every image associated with that item.
• Second, download the referenced images, keeping original file names where possible so they map easily back to the CSV.
• Third, import everything into my website so it appears in a straightforward list view—no fancy grids, just an orderly, paginated list that mirrors the structure defined in the CSV. When the import finishes I should be able to click any entry, see its images, description, and pricing exactly as shown on the source sites.
Python with Scrapy/BeautifulSoup or a similar reliable stack is fine as long as the scraper is reusable; I will want to rerun it for updates later.
Acceptance will be based on:
1. A complete CSV that opens without errors.
2. Image set matching the CSV one-to-one.
3. A working list-view catalog on my site showing every product with correct details and images.
Let me know the estimated turnaround time and any questions about access to the site’s backend for the import phase.
• First, crawl both sources, collect every product record, and deliver the raw data in a clean CSV. Each row should at minimum include the product name, price, description, category path, and the direct URL of every image associated with that item.
• Second, download the referenced images, keeping original file names where possible so they map easily back to the CSV.
• Third, import everything into my website so it appears in a straightforward list view—no fancy grids, just an orderly, paginated list that mirrors the structure defined in the CSV. When the import finishes I should be able to click any entry, see its images, description, and pricing exactly as shown on the source sites.
Python with Scrapy/BeautifulSoup or a similar reliable stack is fine as long as the scraper is reusable; I will want to rerun it for updates later.
Acceptance will be based on:
1. A complete CSV that opens without errors.
2. Image set matching the CSV one-to-one.
3. A working list-view catalog on my site showing every product with correct details and images.
Let me know the estimated turnaround time and any questions about access to the site’s backend for the import phase.
Related categories:
PHP
Python
Data Processing
Web Scraping
Software Architecture
Scrapy
Data Extraction
BeautifulSoup