Crawler for Content Update Monitoring
Budget: $750 – $1,500 USD
I'm in need of a crawler that can help me monitor changes on a website. The primary focus is to track content updates, specifically text changes.
Key requirements:
- The crawler should be able to bypass cache to ensure accurate monitoring.
- It needs to find all relevant endpoints for tracking.
- It should be capable of sending alerts upon detecting changes.
Ideal skills and experience:
- Proficiency in web scraping and data extraction.
- Experience with building and deploying web crawlers.
- Familiarity with techniques to bypass cache.
- Ability to work with various types of websites.
- Prior experience in monitoring content updates preferred.
Key requirements:
- The crawler should be able to bypass cache to ensure accurate monitoring.
- It needs to find all relevant endpoints for tracking.
- It should be capable of sending alerts upon detecting changes.
Ideal skills and experience:
- Proficiency in web scraping and data extraction.
- Experience with building and deploying web crawlers.
- Familiarity with techniques to bypass cache.
- Ability to work with various types of websites.
- Prior experience in monitoring content updates preferred.
Related categories:
PHP
Business, Accounting, Human Resources & Legal
Python
Web Scraping
Software Architecture