Compiling a Large List of Whitepapers
Budget: $30 – $250 CAD
--- This is not a scraping project.---
Project involves clicking on 9,719 different links, navigating through and then downloading a whitepaper. The links do not lend themselves to scraping as they go to dramatically different sites and webpage structures, many involving navigating through and clicking again on the proper link for a whitepaper. Some of the whitepapers are dynamically loaded with java script and will need special attention so as to download the entire whitepaper and not just the page that is currently visible.
If you bid thinking you'll scrape, and end up bailing after you have a look at the links I will give a low review. Please do not waste our time.
Once you are done, I will spend a few days going through the data before releasing the milestone. If there are incomplete whitepapers because of miss handling a dynamically loaded site, or you obviously tried to scrape anyways and got bad data I will not release the milestone.
Lastly, in your bid proposal make sure to write the word "cowbell" somewhere. That way I know you read this entire description. Those who do not write "cowbell" will not be considered.
Project involves clicking on 9,719 different links, navigating through and then downloading a whitepaper. The links do not lend themselves to scraping as they go to dramatically different sites and webpage structures, many involving navigating through and clicking again on the proper link for a whitepaper. Some of the whitepapers are dynamically loaded with java script and will need special attention so as to download the entire whitepaper and not just the page that is currently visible.
If you bid thinking you'll scrape, and end up bailing after you have a look at the links I will give a low review. Please do not waste our time.
Once you are done, I will spend a few days going through the data before releasing the milestone. If there are incomplete whitepapers because of miss handling a dynamically loaded site, or you obviously tried to scrape anyways and got bad data I will not release the milestone.
Lastly, in your bid proposal make sure to write the word "cowbell" somewhere. That way I know you read this entire description. Those who do not write "cowbell" will not be considered.