Repair Web-Scraping Python Script
Budget: ₹600 – ₹1,500 INR
My existing Python script starts perfectly, pulls the first few pages, and then crashes with runtime errors. It was written to scrape data from a handful of public websites and save the results to CSV, but somewhere mid-run an exception bubbles up and halts the whole job.
I need you to trace and eliminate those runtime issues, keep the scraping logic intact, and return a clean, fully functioning script. If you prefer debugging with tools like pdb, logging, or even a quick refactor into more modular functions, that’s fine as long as the final code still uses standard libraries such as requests and BeautifulSoup (no GUI automation is involved). Selenium is optional only if you discover the target sites require it.
Please deliver:
• The corrected .py file ready to run from the command line
• A brief note (can be inline comments or a separate README) explaining what was wrong and how you fixed it
Once I can run the script end-to-end without errors and see the expected CSV output, the task is complete.
I need you to trace and eliminate those runtime issues, keep the scraping logic intact, and return a clean, fully functioning script. If you prefer debugging with tools like pdb, logging, or even a quick refactor into more modular functions, that’s fine as long as the final code still uses standard libraries such as requests and BeautifulSoup (no GUI automation is involved). Selenium is optional only if you discover the target sites require it.
Please deliver:
• The corrected .py file ready to run from the command line
• A brief note (can be inline comments or a separate README) explaining what was wrong and how you fixed it
Once I can run the script end-to-end without errors and see the expected CSV output, the task is complete.
Related categories:
JavaScript
Python
Data Processing
Web Scraping
Software Architecture
Debugging
BeautifulSoup
Selenium