Web Scraping & Automation Expert -- 2
Budget: $250 – $750 CAD
I'm seeking an experienced web scraper to automate data collection from various websites. This will be a long-term, part-time engagement based on your reliability and capability.
Key Tasks:
- Set up scrapers for non-API sources.
- Use Apify or for dynamic content.
- Parse key fields like event name, time, location, description, crowd mentions, deals, etc.
- Clean and format data into JSON for Firebase import or real-time sync.
- Schedule scraping every 15-60 mins using cron or Apify schedule.
- Follow robots.txt rules and ethical scraping practices.
- Log all activities/errors for debugging.
- Coordinate with a developer.
Ideal Skills:
- Proficiency in web scraping tools (Apify, Puppeteer, Selenium).
-
- Ability to handle dynamic content and follow ethical scraping guidelines.
- Good communication skills
Key Tasks:
- Set up scrapers for non-API sources.
- Use Apify or for dynamic content.
- Parse key fields like event name, time, location, description, crowd mentions, deals, etc.
- Clean and format data into JSON for Firebase import or real-time sync.
- Schedule scraping every 15-60 mins using cron or Apify schedule.
- Follow robots.txt rules and ethical scraping practices.
- Log all activities/errors for debugging.
- Coordinate with a developer.
Ideal Skills:
- Proficiency in web scraping tools (Apify, Puppeteer, Selenium).
-
- Ability to handle dynamic content and follow ethical scraping guidelines.
- Good communication skills