Website Scrape and Mongo DB integration
Budget: $30 – $250 AUD
I need to develop a solution to scrape a website using my account and send the results into a Mongodb database. I need to get peoples Names, job titles, start date for roles they have had in specific companies. A second list needs to be scraped for the same information in addition to end date for employees who have left specified companies.
The data needs to be stored in Mongodb.
The scrape process will need to integrate to a mongodb query so that the data that is alredy scraped is not repeated. The ability to setup the mongodb database and interact with it while scraping is essential.
I have a detailed workflow of the project requirement so it should be fairly simple to setup.
I would like the process to be completely automated. All processes to be documented.
I am willing to buy a scraping software if required.
This project requires that you sign an IP Agreemnet and maintain confidentiality of the work done.
The data needs to be stored in Mongodb.
The scrape process will need to integrate to a mongodb query so that the data that is alredy scraped is not repeated. The ability to setup the mongodb database and interact with it while scraping is essential.
I have a detailed workflow of the project requirement so it should be fairly simple to setup.
I would like the process to be completely automated. All processes to be documented.
I am willing to buy a scraping software if required.
This project requires that you sign an IP Agreemnet and maintain confidentiality of the work done.