Golang Web Scraper Framework

I’m putting together a reusable web-automation framework in Go that relies on Rod, the Playwright wrapper, to drive headless Chromium. Its single purpose is web scraping on heavy, JavaScript-driven sites and the only payload I care about right now is clean text content.

You’ll architect the core so that I can point it at any dynamic page, wait for specific DOM events or selectors, and reliably pull the required text. I need graceful error handling, session management, and a simple way to plug in custom extractors for new targets later.

Deliverables
• Idiomatic Go module that wraps Rod/Playwright setups (browser pool, page lifecycle, wait helpers)
• Example scraper demonstrating text extraction from at least one SPA site
• README covering build steps, environment variables, and an outline for extending the extractor layer
• Minimal unit tests that prove page loading, waiting strategy, and text capture work

Acceptance criteria
– Runs with go test ./... without failures
– Works on the latest Go LTS version and the current Rod release
– Returns deterministic text output when pointed at the sample URL I’ll supply

If this sounds straightforward, let’s discuss the finer points—selectors, concurrency limits, and any helper packages you prefer.