AWS EC2 Machine Setup for YouTube Crawler
Budget: $50 – $400 USD
I'm looking for a skilled freelancer who can help me set up an AWS EC2 machine to carry out the following tasks:
- Develop a crawler that searches for YouTube channels based on specific keywords on Google.
- The crawler should be able to:
- Extract channel name
- Extract channel ID
- Extract subscriber counts
- Set up and configure a database to store information for each channel.
- Implement a Kibana dashboard for monitoring and analysis
- Key visualizations should include:
- Total number of channels
- Total number of scanned words
The project will use legitimate APIs of both Google and YouTube and follow their ToS.
The estimated costs of AWS during development should be included in your bid.
Ideal candidates should have experience with AWS EC2, web crawling techniques, database setup and management, and Kibana dashboard creation. The project entails creating an automated system that gathers data from YouTube channels, stores it, and presents key metrics in a visually engaging way. If you have the necessary skills and experience, I'd be keen to discuss this project with you.
- Develop a crawler that searches for YouTube channels based on specific keywords on Google.
- The crawler should be able to:
- Extract channel name
- Extract channel ID
- Extract subscriber counts
- Set up and configure a database to store information for each channel.
- Implement a Kibana dashboard for monitoring and analysis
- Key visualizations should include:
- Total number of channels
- Total number of scanned words
The project will use legitimate APIs of both Google and YouTube and follow their ToS.
The estimated costs of AWS during development should be included in your bid.
Ideal candidates should have experience with AWS EC2, web crawling techniques, database setup and management, and Kibana dashboard creation. The project entails creating an automated system that gathers data from YouTube channels, stores it, and presents key metrics in a visually engaging way. If you have the necessary skills and experience, I'd be keen to discuss this project with you.