Web Page to CSV Automation
Budget: ₹100 – ₹400 INR
I need a Python script that uses Requests and BeautifulSoup to scrape text from all <p> tags on a webpage.
Requirements:
- Targets all <p> tags by default (can be changed).
- Handles pagination.
- Strips extracted text and saves to a CSV file.
- Filename includes the current date.
- Uses standard headers to avoid being blocked by the website.
- Main function: extract_text() is triggered when the script runs directly.
Ideal Skills and Experience:
- Proficient in Python, Requests, and BeautifulSoup
- Experience with web scraping and handling pagination
- Familiarity with CSV file manipulation
- Knowledge of HTTP headers and how to avoid getting blocked
Requirements:
- Targets all <p> tags by default (can be changed).
- Handles pagination.
- Strips extracted text and saves to a CSV file.
- Filename includes the current date.
- Uses standard headers to avoid being blocked by the website.
- Main function: extract_text() is triggered when the script runs directly.
Ideal Skills and Experience:
- Proficient in Python, Requests, and BeautifulSoup
- Experience with web scraping and handling pagination
- Familiarity with CSV file manipulation
- Knowledge of HTTP headers and how to avoid getting blocked