Prevent crawling of gitlab all URL's
Budget: ₹600 – ₹1,500 INR
I am looking for a freelancer who can help me prevent crawling of all URL's on GitLab in order to improve website performance. The ideal candidate should have experience in the following:
- Knowledge of GitLab and web crawling prevention techniques
- Understanding of website performance optimization
- Familiarity with authentication methods, specifically username/password
- Ability to assess and implement security measures, such as IP whitelisting
The project may also involve defining a specific user agent, although I am not sure if this is necessary. Therefore, the freelancer should be open to discussing and determining the need for a specific user agent.
If you possess the skills and experience mentioned above, please submit your proposal. Thank you.
- Knowledge of GitLab and web crawling prevention techniques
- Understanding of website performance optimization
- Familiarity with authentication methods, specifically username/password
- Ability to assess and implement security measures, such as IP whitelisting
The project may also involve defining a specific user agent, although I am not sure if this is necessary. Therefore, the freelancer should be open to discussing and determining the need for a specific user agent.
If you possess the skills and experience mentioned above, please submit your proposal. Thank you.