JS Web Scraping Specialist Required

Title:
Playwright Expert Needed for Complex JS UI Scraping (Nested Modals, Scroll Containers)

---

Description:

I need an experienced developer to complete and stabilize an existing Playwright (Python) scraping system for a complex web app (React-like UI).

This is NOT a simple scraping task. The system is partially built and must be fixed, not rebuilt from scratch.

---

Scope of Work:

The scraper must extract ~62,000 products with the following data:

1. Product Specifications

* Open product modal
* Extract full specification table
* Table may be internally scrollable (must handle both scrollable and non-scrollable cases)

2. My Last Purchase Price

* Handle 3 cases:
a) NA → no further actions
b) Single price → click icon → extract purchase order modal
c) Multiple prices → icon + “+x more” present

3. Purchase Order Modal

* Extract PO details (date, number, vendor, price breakdown, etc.)

4. Pricing History (“+x more”)

* Opens a new modal
* Contains table with many rows
* Table may be scrollable
* Must scroll fully and extract ALL rows

---

Technical Challenges (must handle correctly):

* Nested modals (modal inside modal)
* Internal scroll containers (NOT page scroll)
* Lazy loading
* Dynamic DOM (React)
* Precise element targeting (no nth(i)-based logic)
* Resume-safe execution (62k items)
* Retry and recovery logic

---

Existing Codebase:

* Python + Playwright
* Files include:

* collector.py (enumeration)
* detail_client.py (UI interaction)
* detail_parser.py
* bulk_parser.py

The code is partially working but unstable. You will:

* debug and fix existing logic
* NOT rewrite from scratch

---

Requirements:

* Strong Playwright experience (Python)
* Experience scraping complex JS apps
* Experience handling modals, scroll containers, dynamic UI
* Ability to debug and stabilize long-running scripts

---

Deliverables:

* Fully working scraper
* Correct data extraction (no missing rows due to scroll issues)
* Stable execution across all parts
* Clean, maintainable fixes in existing codebase

---

To Apply:

Please include:

1. Similar scraping projects you’ve handled (especially with modals/React apps)
2. Your approach to handling:

* nested modals
* scrollable containers
3. Estimated timeline

---

Budget:
Open (fixed or hourly)