looking for a WEB SCRAPING expert for a specific site
Budget: $250 – $750 USD
Hello,
we are looking for a WEB SCRAPING expert for a specific site 1 (with the option to add more sites) - building a program over time - a program that runs on a browser
Can open several instances and each instance will run on a different part.
Bypass google Recaptcha V2 or another security.
On-screen actions in detail, such as: which current extract category, how many items found in the category, number of duplicate items (which are already in our database) Number of extracted items( running number) - how many items did extracted actually do - datetimeStart datetimeEnd and more-
Writing a detailed program log, how many items were found in each Category etc (in order to check if all the data is with us or missing data and we did not take everything)
On the first step, saving data in local SQL DB
the second step (not sure) is building Dotnet core API + SQL DB to save the data, in a separate solution program.
Please,
If you have another suggestion, we would be happy to Hear.
Specify what technologies you would do.
If you have a suggestion to improve what I wrote above - please indicate what you should add to the program.
we are looking for a WEB SCRAPING expert for a specific site 1 (with the option to add more sites) - building a program over time - a program that runs on a browser
Can open several instances and each instance will run on a different part.
Bypass google Recaptcha V2 or another security.
On-screen actions in detail, such as: which current extract category, how many items found in the category, number of duplicate items (which are already in our database) Number of extracted items( running number) - how many items did extracted actually do - datetimeStart datetimeEnd and more-
Writing a detailed program log, how many items were found in each Category etc (in order to check if all the data is with us or missing data and we did not take everything)
On the first step, saving data in local SQL DB
the second step (not sure) is building Dotnet core API + SQL DB to save the data, in a separate solution program.
Please,
If you have another suggestion, we would be happy to Hear.
Specify what technologies you would do.
If you have a suggestion to improve what I wrote above - please indicate what you should add to the program.