Python Script to Fetch News URLs
Budget: ₹600 – ₹1,500 INR
I need a python script that fetches all the URLs from a news website every 5 minutes. The script should run on www.pythonanywhere.com and post all the URLs to an API.
Key Requirements:
- The script should be able to ignore duplicate URLs
- Ideally, the freelancer should have experience with web scraping and working with APIs.
- The ability to write clean, efficient code is a must.
Please note that the specific structure of the news website is currently unknown, as the client has not specified. Therefore, the script should be flexible enough to handle different types of content (static HTML pages, JavaScript-rendered content, API-based content).
Key Requirements:
- The script should be able to ignore duplicate URLs
- Ideally, the freelancer should have experience with web scraping and working with APIs.
- The ability to write clean, efficient code is a must.
Please note that the specific structure of the news website is currently unknown, as the client has not specified. Therefore, the script should be flexible enough to handle different types of content (static HTML pages, JavaScript-rendered content, API-based content).