ESPN Headline Scraper to Excel
Budget: $1,500 – $3,000 USD
I need every ESPN article headline that matches a set of keywords I will supply collected into a single, well-structured Excel workbook. The task is limited to headlines only, nothing else from the page.
You will crawl the entire ESPN domain, test each headline against my keyword list, and save every match. Please keep the crawl respectful of ESPN’s robots.txt rules and throttle requests so the site is not hammered.
Deliverables:
• An Excel file (.xlsx) containing one row per matched headline with these columns: Headline, URL.
• A short read-me (txt or markdown) describing your approach and how to rerun the script.
Acceptance criteria: when I spot-check the Excel sheet, every headline includes at least one of my supplied keywords and the links open correctly on ESPN.
I will send the keyword list as soon as we start.
You will crawl the entire ESPN domain, test each headline against my keyword list, and save every match. Please keep the crawl respectful of ESPN’s robots.txt rules and throttle requests so the site is not hammered.
Deliverables:
• An Excel file (.xlsx) containing one row per matched headline with these columns: Headline, URL.
• A short read-me (txt or markdown) describing your approach and how to rerun the script.
Acceptance criteria: when I spot-check the Excel sheet, every headline includes at least one of my supplied keywords and the links open correctly on ESPN.
I will send the keyword list as soon as we start.
Related categories:
Python
Data Entry
Excel
Web Scraping
Data Analysis
Automation
Data Collection
Data Management