Looking for Web Scrapper for Specific Website
Budget: $30 – $250 AUD
Hi, I'm looking for a concerned freelancer to help me with developing a web scrapper to scrape one specific website using multiple queries.
The project requires scraping only some specific pages, which needs to be done accurately and efficiently. Moreover, I also require additional processing of the scraped data.
The most important things for me are:
a) ability to query the website by providing information in three different fields in order to be forwarded to the next / output page
b) the speed of scraping, supporting multiple threads using socks proxies (for example 100 scraping sessions at once) + updating proxies and rotating them every certain period of time
c) convenient method of saving the output data (excel database, text files) - which in the future I could integrate with some solution to make search available for some specific details.
d) stop retrieving any more results, in case you have reached information that data is unavailable
e) the code should be easy to read and understand - also let me recompile it on my own
If you think you have the skills to create such a scrapper, please submit your proposal.
Thank you very much for your time and consideration
The project requires scraping only some specific pages, which needs to be done accurately and efficiently. Moreover, I also require additional processing of the scraped data.
The most important things for me are:
a) ability to query the website by providing information in three different fields in order to be forwarded to the next / output page
b) the speed of scraping, supporting multiple threads using socks proxies (for example 100 scraping sessions at once) + updating proxies and rotating them every certain period of time
c) convenient method of saving the output data (excel database, text files) - which in the future I could integrate with some solution to make search available for some specific details.
d) stop retrieving any more results, in case you have reached information that data is unavailable
e) the code should be easy to read and understand - also let me recompile it on my own
If you think you have the skills to create such a scrapper, please submit your proposal.
Thank you very much for your time and consideration