Crawler for Content Update Monitoring

Job ID: 38425082

Budget: $750 – $1,500 USD

I'm in need of a crawler that can help me monitor changes on a website. The primary focus is to track content updates, specifically text changes.

Key requirements:
- The crawler should be able to bypass cache to ensure accurate monitoring.
- It needs to find all relevant endpoints for tracking.
- It should be capable of sending alerts upon detecting changes.

Ideal skills and experience:
- Proficiency in web scraping and data extraction.
- Experience with building and deploying web crawlers.
- Familiarity with techniques to bypass cache.
- Ability to work with various types of websites.
- Prior experience in monitoring content updates preferred.