Python Web Scraping Automation
Budget: ₹1,500 – ₹12,500 INR
I need a straightforward Python script that can visit one or more specified websites, extract the key data I outline (text, numbers, or table rows), and save everything to a clean CSV or JSON file. The focus is strictly on web-based data scraping—no APIs or databases are involved.
Core expectations:
• Clean, well-commented Python 3 code using familiar libraries such as Requests, BeautifulSoup, or Selenium where required.
• A simple configuration section (or .ini/.json file) so I can change target URLs and field selectors without touching the main logic.
• Basic error handling for time-outs, missing elements, and anti-scraping blocks (e.g., polite delays, rotating user-agents).
• A short README explaining setup, required packages, and how to run the script from the command line.
I don’t need a full-scale data pipeline—just an initial working script that I can build on later.
Core expectations:
• Clean, well-commented Python 3 code using familiar libraries such as Requests, BeautifulSoup, or Selenium where required.
• A simple configuration section (or .ini/.json file) so I can change target URLs and field selectors without touching the main logic.
• Basic error handling for time-outs, missing elements, and anti-scraping blocks (e.g., polite delays, rotating user-agents).
• A short README explaining setup, required packages, and how to run the script from the command line.
I don’t need a full-scale data pipeline—just an initial working script that I can build on later.
Related categories:
JavaScript
Python
Web Scraping
Software Architecture
JSON
Data Extraction
BeautifulSoup
Selenium
Automation