Manufactured Home Rate Scraper
Budget: $15 – $25 USD
I’m launching a comparative rater for manufactured-home insurance and I need the first building block: dependable web-scraping code that pulls the numbers and details I care about—insurance rates, coverage options, and any discount information—from three carrier sites that are currently accessible only through their desktop versions.
Here’s what I need from you:
• Code (Python is preferred, but I’m open to another language if it makes sense) that navigates each carrier’s quoting workflow, captures the required data points, and stores them in a clean, consistent format such as CSV or JSON.
• Simple configuration so I can add more carriers or tweak field names without rewriting the entire scraper.
• Clear, step-by-step documentation for setup and ongoing use, plus comments in the code so I can maintain it myself.
For now, no API calls—everything has to run through direct page interaction with tools like Requests, BeautifulSoup, Selenium, or Playwright. As long as the solution is reliable and reasonably fast, the specific stack is yours to choose.
I’d like to see an initial working scraper for one carrier within the first milestone, then expand to the remaining two. If any anti-bot or captcha issues pop up, flag them early so we can decide on work-arounds. Once the three scrapers are stable, we can talk about adding optional sorting or filtering on price, coverage, and discounts in a follow-up phase.
Send over a short outline of how you’d tackle the sites—libraries, high-level flow, and estimated turnaround—and let’s get started.
Here’s what I need from you:
• Code (Python is preferred, but I’m open to another language if it makes sense) that navigates each carrier’s quoting workflow, captures the required data points, and stores them in a clean, consistent format such as CSV or JSON.
• Simple configuration so I can add more carriers or tweak field names without rewriting the entire scraper.
• Clear, step-by-step documentation for setup and ongoing use, plus comments in the code so I can maintain it myself.
For now, no API calls—everything has to run through direct page interaction with tools like Requests, BeautifulSoup, Selenium, or Playwright. As long as the solution is reliable and reasonably fast, the specific stack is yours to choose.
I’d like to see an initial working scraper for one carrier within the first milestone, then expand to the remaining two. If any anti-bot or captcha issues pop up, flag them early so we can decide on work-arounds. Once the three scrapers are stable, we can talk about adding optional sorting or filtering on price, coverage, and discounts in a follow-up phase.
Send over a short outline of how you’d tackle the sites—libraries, high-level flow, and estimated turnaround—and let’s get started.
Related categories:
JavaScript
Python
Web Scraping
Software Architecture
Data Extraction
BeautifulSoup
Selenium
API Development