social data scrawler and machine learning
Budget: $30 – $60 USD
I would like to build a data analysis script that is able to analysis social data base on given keyword and output a list of words that is associated to the given keyword.
phase 1:
use case:
1. input by user: keyword with filter conditions (paste n days, country, lanaguage)
2. extract social content results based on the keyword search (text, photo, video) from various social media platforms.. (twitter, Reddit, Youtube, TikTok)
-- for all post, extract content, number of likes (or thumbs up, down), number of comments, number of retweets / shares if available, hashtags
-- for photo -- extract tags, hashtag, description of the photo
-- for video -- extract video script provided by youtube, and title, description, hashtag..
3. NLP to extract words from social content, clean up the words and remove stopwords
4. rank the words relevant to the input keyword based on number of likes, comments, shares/retweets
5. build domain specific keyword pool (e.g. Gaming, eCommerce...) that is able to tag words to different categories
5. build a business logic layer on top of the calculation result that is able to adjust ranking according to certain business logic, for example, if the keyword = basketball, reduce ranking by 100 etc..
phase 2: --- this is optional... so please give me quote based on phase 1 first and we can discuss phase 2 quote later
setup server and host web app and run this script and store result..
phase 1:
use case:
1. input by user: keyword with filter conditions (paste n days, country, lanaguage)
2. extract social content results based on the keyword search (text, photo, video) from various social media platforms.. (twitter, Reddit, Youtube, TikTok)
-- for all post, extract content, number of likes (or thumbs up, down), number of comments, number of retweets / shares if available, hashtags
-- for photo -- extract tags, hashtag, description of the photo
-- for video -- extract video script provided by youtube, and title, description, hashtag..
3. NLP to extract words from social content, clean up the words and remove stopwords
4. rank the words relevant to the input keyword based on number of likes, comments, shares/retweets
5. build domain specific keyword pool (e.g. Gaming, eCommerce...) that is able to tag words to different categories
5. build a business logic layer on top of the calculation result that is able to adjust ranking according to certain business logic, for example, if the keyword = basketball, reduce ranking by 100 etc..
phase 2: --- this is optional... so please give me quote based on phase 1 first and we can discuss phase 2 quote later
setup server and host web app and run this script and store result..