create a robots.txt file to filter search requests.

Job ID: 37905179

Budget: €2 – €6 EUR

bot/crawler access to the website. Access requests originating from bots are registered every 2 to 5 seconds.web developer to assist in optimizing the website and create a robots.txt file to filter such requests.