Youtube search result scraper & aggregator (No API usage) -- 2
Budget: $30 – $250 USD
Hey folks!
I need an app with a simple GUI that scrapes and collects Youtube search results. In detail:
Input:
- Multiple Youtube search result URLs + Option to remove or add more lines with more URLs as needed
- Refresh time for each URL
- Minimum video length to be scraped
- Delay time option field between actions (opening URL, scrolling down to load all results, saving and finish scrape for URL 1, start URL 2....). For example "wait X seconds between each action"
Examples: (youtube com....)
/results?search_query=news&sp=CAISAggB
/results?search_query=let%27s+play&sp=CAISBAgBEAE%253D
/results?search_query=sport
Result: Scrapes the search result pages and collects all results in one big HTML file while filtering out all duplicates. Repeats process every few minutes
> Example file of how the result HTML could look is added as attachment. Feel free to copy the layout
> Example GUI layout added as attachment
Condition: Must be able to run on Windows 10. Does not use Google API or other paid services.
-------------------
-------------------
Function:
1.) The program accesses the URLs at intervals that can be set (Every X seconds/minutes)
2.) Scrolls down to load all search results available and then saves all results, thumbnails, and links (links to video and channel) on the local hard drive (in a defined folder) and creates an HTML file for opening the list in the browser at a later time. One file for each input link. The HTML file has the option to sort the list content by video length, channel etc.
3) Waits a user-defined number of seconds to avoid the IP getting flagged as a bot, repeats the steps for the next URL until all URLs are scraped.
4.) Refreshes pages after a set number of minutes (which can be adjusted by the user for each link)
5.) Automatically repeats steps 1-4 and adds new results to the previous local file. (Does not save duplicates.)
6.) The local file should look like a long search result list if opened. Links should be clickable, same as on Youtube and sortable by video length. See attachment example
Needed data:
- Video Thumbnail (Largest available size. static image file)
- Video length
- Channel name & Link
- Video name & Link
- Video description (Optional)
Features:
- Being able to sort the list after opening it in the browser by: Video length, Video title, Channel title, Time added
- Channel URL link is changed to the videos pages by adding "/videos" to the end. See the attached file for example.
- An option to define minimum video length for being added. (Example: "Add no videos shorter than 5 seconds")
- An option to set wait times between scraping of each URL to prevent being IP banned for accessing results too fast
- Wait time between scraping actions so it works fine on slow PCs
- Important: An auto-skip function in case of internet disconnects. "If scrape for URL 1 has not finished after 10 minutes, skip this time, start URL 2"
Requirements:
- Must work on Windows 10
- Does not use Google API
- Has sorting arrows in the HTML file for video length, channel name, video title, and time added (Please look at the attachment files blue arrows.)
- The final result must be .html so a browser can open it. (Not .csv or similar.)
- The result looks similar to the attachment file, please make the thumbnail as the maximum size youtube provides it as.
Please tell me what you would charge for creating this software :)
I need an app with a simple GUI that scrapes and collects Youtube search results. In detail:
Input:
- Multiple Youtube search result URLs + Option to remove or add more lines with more URLs as needed
- Refresh time for each URL
- Minimum video length to be scraped
- Delay time option field between actions (opening URL, scrolling down to load all results, saving and finish scrape for URL 1, start URL 2....). For example "wait X seconds between each action"
Examples: (youtube com....)
/results?search_query=news&sp=CAISAggB
/results?search_query=let%27s+play&sp=CAISBAgBEAE%253D
/results?search_query=sport
Result: Scrapes the search result pages and collects all results in one big HTML file while filtering out all duplicates. Repeats process every few minutes
> Example file of how the result HTML could look is added as attachment. Feel free to copy the layout
> Example GUI layout added as attachment
Condition: Must be able to run on Windows 10. Does not use Google API or other paid services.
-------------------
-------------------
Function:
1.) The program accesses the URLs at intervals that can be set (Every X seconds/minutes)
2.) Scrolls down to load all search results available and then saves all results, thumbnails, and links (links to video and channel) on the local hard drive (in a defined folder) and creates an HTML file for opening the list in the browser at a later time. One file for each input link. The HTML file has the option to sort the list content by video length, channel etc.
3) Waits a user-defined number of seconds to avoid the IP getting flagged as a bot, repeats the steps for the next URL until all URLs are scraped.
4.) Refreshes pages after a set number of minutes (which can be adjusted by the user for each link)
5.) Automatically repeats steps 1-4 and adds new results to the previous local file. (Does not save duplicates.)
6.) The local file should look like a long search result list if opened. Links should be clickable, same as on Youtube and sortable by video length. See attachment example
Needed data:
- Video Thumbnail (Largest available size. static image file)
- Video length
- Channel name & Link
- Video name & Link
- Video description (Optional)
Features:
- Being able to sort the list after opening it in the browser by: Video length, Video title, Channel title, Time added
- Channel URL link is changed to the videos pages by adding "/videos" to the end. See the attached file for example.
- An option to define minimum video length for being added. (Example: "Add no videos shorter than 5 seconds")
- An option to set wait times between scraping of each URL to prevent being IP banned for accessing results too fast
- Wait time between scraping actions so it works fine on slow PCs
- Important: An auto-skip function in case of internet disconnects. "If scrape for URL 1 has not finished after 10 minutes, skip this time, start URL 2"
Requirements:
- Must work on Windows 10
- Does not use Google API
- Has sorting arrows in the HTML file for video length, channel name, video title, and time added (Please look at the attachment files blue arrows.)
- The final result must be .html so a browser can open it. (Not .csv or similar.)
- The result looks similar to the attachment file, please make the thumbnail as the maximum size youtube provides it as.
Please tell me what you would charge for creating this software :)