Scrape 59k Magento Products

I need a complete front-end scrape of three Magento-based parts catalogs (a combined 59,214 SKUs). I do not have admin or API access, so the crawler must work solely through the public storefront. Each Catalog should be a separate export file.

Data fields required for every SKU: product name, price, full description, all images, category path and product codes, plus fit, finish, color, manufacturer, style, and origin details where shown. I’m comfortable with Octoparse, but feel free to use the scraping tool you know best as long as it can respect the site’s structure and avoid throttling issues.

First Catalog
Big Twin 1984 & Up
Number of products - 21,187
Number of Categories - 24

Second Catalog
Classic Pre-1984
Number of products - 22,800
Number of Categories - 25

Third Catalog
Sportster 1952-Up
Number of products - 15,227
Number of Categories - 25


Deliverables
• A clean, well-structured CSV covering every requested field for all 59,214 items
• Downloaded image files organised in folders that map cleanly to the CSV
• Your scraping workflow or template so I can rerun updates in the future

Please make sure the CSV columns are consistent, image links are valid, and no products are missed or duplicated. Let me know your estimated turnaround and any specific throttling or proxy requirements you foresee.

Go to website - https://www2.vtwinmfg.com/
CLICK on GUEST
CLICK on Big Twin 1984 & Up (Black Button) - Opens up magento main store & first catalog.