Web Scraping
Budget: $30 – $250 USD
I am looking for a freelancer who can help me with Web Scraping. We have a list of websites that we would like to scrape specific data from, and have them put into a set of MySQL Databases (or maybe something else). The website that we would like to scrape data from each contain thousands of articles, and we would also want other metadata, such as Author name, article date, number of views, or any other metadata that we can take from the pages.
Please bid, and we can discuss the first website, you can tell us how long you think it'll take to write the scraper.
There are maybe 50 websites to begin with that we would like to do this for, in this one project, and we also have another couple of similar projects.
Ideally, the scraper will run form a program, so that we can run it again in future, and it will get the newest articles that haven't been scraped yet. We can provide Linux servers with high bandwidth as required to run the scraping workload as required.
Please bid, and we can discuss the first website, you can tell us how long you think it'll take to write the scraper.
There are maybe 50 websites to begin with that we would like to do this for, in this one project, and we also have another couple of similar projects.
Ideally, the scraper will run form a program, so that we can run it again in future, and it will get the newest articles that haven't been scraped yet. We can provide Linux servers with high bandwidth as required to run the scraping workload as required.