website scanner app
Budget: $10 – $30 USD
I am looking to have a website scanner app built for Windows 10. I would like the project to be completed within 1-3 days. The app will read from a text file of urls (one per line) and then visit each site scanning only the first page that comes up to see if it contains a user specified word. If it does then it will save it to an output file. The script must be multithreaded and be able to handle 1000 threads and files with 10 million urls each. I will also require a progress indicator that shows how many urls have been processed, how many with the given word have been found and average processing speed of urls/hour.