Python Scraper Adjustment
Budget: ₹600 – ₹1,500 INR
I already have a working Python scraper that targets one e-commerce layout. I now need it adapted within 24 hours to cope with several different product page templates from the same marketplace.
What I need done:
• Modify the scraping logic so it detects and adapts to varying layouts.
• Update all CSS/XPath selectors where the structure changes.
• Add a few small extras—grab fields like SKU, image gallery URLs, and store everything in the existing CSV output.
The current stack is requests and BeautifulSoup; please keep it lightweight and stick to that unless a Selenium fallback is absolutely required. Keep my existing function structure intact so I can merge updates quickly.
I’ll share the repo and sample URLs as soon as we start. Deliver an updated script, a short README explaining the new sections, and a quick screen capture (or log) showing a successful run across the provided pages. Fast, clean code and clear variable names are all I’m looking for.
What I need done:
• Modify the scraping logic so it detects and adapts to varying layouts.
• Update all CSS/XPath selectors where the structure changes.
• Add a few small extras—grab fields like SKU, image gallery URLs, and store everything in the existing CSV output.
The current stack is requests and BeautifulSoup; please keep it lightweight and stick to that unless a Selenium fallback is absolutely required. Keep my existing function structure intact so I can merge updates quickly.
I’ll share the repo and sample URLs as soon as we start. Deliver an updated script, a short README explaining the new sections, and a quick screen capture (or log) showing a successful run across the provided pages. Fast, clean code and clear variable names are all I’m looking for.
Related categories:
PHP
JavaScript
Python
Data Processing
Web Scraping
Scrapy
Data Extraction
Frontend Development
BeautifulSoup
Data Management