Data Scraping Project
Budget: $30 – $250 USD
I need the entire product catalogue on kingmetals.com collected and delivered to me as a clean Excel file. The crawl must cover every category and nested sub-category on the shopping section, not just the first page, capturing these exact fields for each item:
• Page URL
• Category, Sub-category (up to four levels deep)
• Title
• Part Number
• Product URL
• Current Price
Images are not required; please skip them to keep the run light.
I will share a small sample sheet so you can mirror the column order and formatting. Once you have a working script—whether you prefer Python with Scrapy/BeautifulSoup, Selenium, or a similar stack—run it site-wide, remove any duplicates, and export everything to one .xlsx workbook.
Deliverable:
1. Final Excel file containing all scraped records.
2. (Optional but appreciated) the reusable script or notebook so I can rerun it later.
I’ll review the first 50 rows against my example to confirm accuracy before you proceed with the full scrape, so a quick initial pull is helpful. Feel free to let me know if throttling, pagination, or anti-bot measures crop up; we can coordinate timing or headers to stay compliant.
• Page URL
• Category, Sub-category (up to four levels deep)
• Title
• Part Number
• Product URL
• Current Price
Images are not required; please skip them to keep the run light.
I will share a small sample sheet so you can mirror the column order and formatting. Once you have a working script—whether you prefer Python with Scrapy/BeautifulSoup, Selenium, or a similar stack—run it site-wide, remove any duplicates, and export everything to one .xlsx workbook.
Deliverable:
1. Final Excel file containing all scraped records.
2. (Optional but appreciated) the reusable script or notebook so I can rerun it later.
I’ll review the first 50 rows against my example to confirm accuracy before you proceed with the full scrape, so a quick initial pull is helpful. Feel free to let me know if throttling, pagination, or anti-bot measures crop up; we can coordinate timing or headers to stay compliant.