Douyin Data Power-Scrape
Budget: $15 – $25 USD
I require a skilled Python developer to build a robust data scraping system for my project. The focus will be on extracting large volumes of data daily from Douyin e-commerce and compiling information from JD.com, specifically tailored to select criteria.
Requirements:
- Develop a scraper that can handle 500,000 data points daily.
- Collect user profiles, product details, and live broadcast comments from Douyin.
- From JD.com, gather relevant product information.
Data Points Needed:
- **User Profiles:** No specific criteria, but must be efficiently extracted to assist in broad market analysis.
- **Product Details:** Focus on price, availability, product specifications, and ratings/reviews to inform pricing strategies and stock decisions.
- **Live Broadcast Comments:** Capture the sentiment and feedback during live streams for real-time consumer insights.
Ideal Candidate:
- Proficiency in Python scripting and web scraping.
- Experience with large-scale data extraction and automation.
- Knowledge of e-commerce platforms, particularly Douyin & JD.com.
- Ability to manage and manipulate large datasets.
- Familiarity with data scraping ethics and legality.
This role will require a detail-oriented freelancer with a knack for handling complex data structures and providing reliable, actionable insights. Looking forward to your proposals!
Can pay daily!Can pay daily!Can pay daily!
I am looking for a long-term collaboration, ideally lasting for at least one year
Requirements:
- Develop a scraper that can handle 500,000 data points daily.
- Collect user profiles, product details, and live broadcast comments from Douyin.
- From JD.com, gather relevant product information.
Data Points Needed:
- **User Profiles:** No specific criteria, but must be efficiently extracted to assist in broad market analysis.
- **Product Details:** Focus on price, availability, product specifications, and ratings/reviews to inform pricing strategies and stock decisions.
- **Live Broadcast Comments:** Capture the sentiment and feedback during live streams for real-time consumer insights.
Ideal Candidate:
- Proficiency in Python scripting and web scraping.
- Experience with large-scale data extraction and automation.
- Knowledge of e-commerce platforms, particularly Douyin & JD.com.
- Ability to manage and manipulate large datasets.
- Familiarity with data scraping ethics and legality.
This role will require a detail-oriented freelancer with a knack for handling complex data structures and providing reliable, actionable insights. Looking forward to your proposals!
Can pay daily!Can pay daily!Can pay daily!
I am looking for a long-term collaboration, ideally lasting for at least one year