Scrape All RoadshowPBS Videos
Budget: $30 – $250 USD
I need a repeatable way to capture every single video that appears on the Antiques Roadshow PBS YouTube channel ( https://www.youtube.com/@RoadshowPBS ). The public interface caps results around 600, yet there are more than 1,200 pieces of content. Your job is to overcome that limit—using the YouTube Data API, pagination scraping, or any other reliable technique—and deliver a complete, verified list.
The final deliverable must be a plain-text (.txt) file where each line holds the full watch-URL followed by its full video title (for example: “https://www.youtube.com/watch?v=nMDlal5tQP8”, "Renoir Painting Appraisal"). No truncations, shortened links, or missing entries.
Acceptance criteria
• The text file contains every video currently published on the channel at the time of delivery.
• Spot-checking at least 20 random titles from your list matches exactly what appears on the live channel.
• Your approach handles future re-runs without hitting YouTube’s 600-result cap (a short README or inline comments in your script explaining how to re-execute is fine).
If a small script or notebook is required to generate the list, include it; I may want to run it again later.
The final deliverable must be a plain-text (.txt) file where each line holds the full watch-URL followed by its full video title (for example: “https://www.youtube.com/watch?v=nMDlal5tQP8”, "Renoir Painting Appraisal"). No truncations, shortened links, or missing entries.
Acceptance criteria
• The text file contains every video currently published on the channel at the time of delivery.
• Spot-checking at least 20 random titles from your list matches exactly what appears on the live channel.
• Your approach handles future re-runs without hitting YouTube’s 600-result cap (a short README or inline comments in your script explaining how to re-execute is fine).
If a small script or notebook is required to generate the list, include it; I may want to run it again later.
Related categories:
Python
Data Processing
Data Entry
Web Scraping
YouTube
Web Search
Data Extraction
Automation
API Development
Data Management