Scrape all links from a given url
Budget: $10 – $15 USD
Need a scraper, preferably python, script to scrape all links from a webpage.
Webpage example would be -https://archive.org/search?query=football&and%5B%5D=mediatype%3A%22image%22
It has 3951 links which I would need as a txt file.
A typical link would be similar to this- https://archive.org/details/I0016-02-0573
So the script should , upon feeding the url, generate the links to a txt file. I would be awarding the project only if there's a workable demonstration of the requirements and not before. Also, to be noted is the structure of the website.
Webpage example would be -https://archive.org/search?query=football&and%5B%5D=mediatype%3A%22image%22
It has 3951 links which I would need as a txt file.
A typical link would be similar to this- https://archive.org/details/I0016-02-0573
So the script should , upon feeding the url, generate the links to a txt file. I would be awarding the project only if there's a workable demonstration of the requirements and not before. Also, to be noted is the structure of the website.