Scrap Website and get data using Python frameworks
Budget: ₹1,500 – ₹12,500 INR
I am looking for a freelancer who can help me scrape data from a website using Python frameworks. The specific requirements for the project are as follows:
Data to scrape:
- I am interested in scraping text only from the website.
Scraping framework:
- The ideal framework to use for scraping is Scrapy or anything of your choice.
Output format:
- The scraped data should be outputted as a CSV file.
DESCRIPTION:
There would be a total of 8 websites and for each website, there would be 10-15 datapoints to scrap.
Deliverables would be the data and the working code.
Code should cover the following aspects to ensure smooth reusability across those websites for our use.
- Input - Name can be taken from the csv. [We are thinking of approximately 1000 names]
- Code [Python Scrappy/ Beautiful Soup]
- Rotating Proxy [Open Source List Vs Paid]
- Crawl Delay Time
- Onion/ Tor Routing IP Mask
- etc. to maintain anonymity and to ensure that we scrap without issues.
We would run for approximately 1000 names across 8 websites to collect datapoints and we want the code to have that flexibility in terms of crawl time delay, onion/ Tor routing, Rotating proxy and anything to accomplish the same.
Please read the description clearly and then submit your proposal for this project. Thank you.
Data to scrape:
- I am interested in scraping text only from the website.
Scraping framework:
- The ideal framework to use for scraping is Scrapy or anything of your choice.
Output format:
- The scraped data should be outputted as a CSV file.
DESCRIPTION:
There would be a total of 8 websites and for each website, there would be 10-15 datapoints to scrap.
Deliverables would be the data and the working code.
Code should cover the following aspects to ensure smooth reusability across those websites for our use.
- Input - Name can be taken from the csv. [We are thinking of approximately 1000 names]
- Code [Python Scrappy/ Beautiful Soup]
- Rotating Proxy [Open Source List Vs Paid]
- Crawl Delay Time
- Onion/ Tor Routing IP Mask
- etc. to maintain anonymity and to ensure that we scrap without issues.
We would run for approximately 1000 names across 8 websites to collect datapoints and we want the code to have that flexibility in terms of crawl time delay, onion/ Tor routing, Rotating proxy and anything to accomplish the same.
Please read the description clearly and then submit your proposal for this project. Thank you.