Website Text & Product Scraper "Bot"

Job ID: 40292692

Budget: €250 – €750 EUR

I need a reliable script or windows-application that automatically gathers text content from specified websites and online databases, then saves everything into a clean, well-structured CSV file.
A Windows-software would be preferred. The crawler should be able to crawl the website and spider a list of urls for approval or automatically go through the website Or just scrape a given list of urls (from a txt-file)

Key details
• Sources: public-facing websites and shops (also with login using username:password)
• Data type: text only—no images or binary files.
• Output: one CSV per run, UTF-8 encoded, with a header row
• should be able to read/exrtract data from !! various shops & websites !! -> generally i need a basic software + "plugins" for additional websites. This project should include ONE website (url upon request). Price for additional modules will be discussed before job is assigned
• setting in application for multi-threading or scraping-delays to avoid IP-banning must be given

I’m comfortable using a windows-application or a web-application in browser. Robust error handling (timeouts, retries, polite crawl delays) is essential.

Acceptance checklist
1. running application unser windows or as web-application
2. if web-applcation: Development on my server would be very welcome, otherwise transfer to my server is essential + check if it works there

Once the bot passes a short live test on one of my sample sources, the job is done.