Authenticated Website Scraper Automation
Budget: $250 – $750 USD
I need a reusable script that logs into a password-protected sports-betting site, navigates the dynamic pop-ups and modal windows it uses, and pulls multiple categories of betting lines.
Key points
• Authentication: the script must handle the site’s login flow and stay logged in while scraping.
• Dynamic content: pages use JavaScript to load odds in windows and expandable sections; your code should wait for those elements before grabbing the data.
• Categories: several sports and wager types appear in different tabs—everything that displays a betting line should be captured.
• Output: on each run I want a clean Excel-ready file (CSV or XLSX). If a lightweight database or JSON makes the pipeline easier, include a simple export step to Excel.
• Run-on-demand: deliver a self-contained command-line tool or small desktop app so I can launch a fresh scrape whenever I like. No cloud deployment needed.
• Maintainability: please write clean, well-commented code and isolate the selectors so I can edit them if the site layout changes. A short README explaining how to tweak those selectors is part of the deliverable.
Tools and stack
I have no language preference. Feel free to use Python with Selenium, Playwright, or Scrapy-Splash, or JavaScript with Puppeteer/Playwright—just choose what best handles the dynamic pieces.
Deliverables checklist
1. Source code with clear modular structure
2. Configuration file or constants section for login creds and target sports/categories
3. README covering environment setup, how to run, and how to adjust selectors
4. Sample output file from a test scrape
If you have previous experience scraping login-protected, JavaScript-heavy sites—or specifically sports-betting odds—let me know in your proposal along with an estimated turnaround time.
Screenshot examples of the main page, and the popup window with alternate prop lines are attached
Key points
• Authentication: the script must handle the site’s login flow and stay logged in while scraping.
• Dynamic content: pages use JavaScript to load odds in windows and expandable sections; your code should wait for those elements before grabbing the data.
• Categories: several sports and wager types appear in different tabs—everything that displays a betting line should be captured.
• Output: on each run I want a clean Excel-ready file (CSV or XLSX). If a lightweight database or JSON makes the pipeline easier, include a simple export step to Excel.
• Run-on-demand: deliver a self-contained command-line tool or small desktop app so I can launch a fresh scrape whenever I like. No cloud deployment needed.
• Maintainability: please write clean, well-commented code and isolate the selectors so I can edit them if the site layout changes. A short README explaining how to tweak those selectors is part of the deliverable.
Tools and stack
I have no language preference. Feel free to use Python with Selenium, Playwright, or Scrapy-Splash, or JavaScript with Puppeteer/Playwright—just choose what best handles the dynamic pieces.
Deliverables checklist
1. Source code with clear modular structure
2. Configuration file or constants section for login creds and target sports/categories
3. README covering environment setup, how to run, and how to adjust selectors
4. Sample output file from a test scrape
If you have previous experience scraping login-protected, JavaScript-heavy sites—or specifically sports-betting odds—let me know in your proposal along with an estimated turnaround time.
Screenshot examples of the main page, and the popup window with alternate prop lines are attached
Related categories:
PHP
JavaScript
Python
Data Processing
Web Scraping
Scrapy
Data Extraction
Selenium