Online Course Data Scraping Specialist

Project Title:
Large-Scale Course Data Scraping from Udemy, Coursera, and YouTube

Project Overview:
I am looking for an experienced data scraping specialist who can collect a large dataset of online courses and tutorials from platforms such as Udemy, Coursera, and YouTube. The dataset should include both technical and non-technical tutorials. The objective is to build a structured dataset that can be used for research and analytics purposes.

Project Requirements:
The freelancer will scrape approximately 200,000 course/tutorial records from the following platforms:
- Udemy
- Coursera
- YouTube

The collected dataset should contain the following information for each record:

1. Course / Tutorial Title
2. Course URL / Video URL
3. Platform Name (Udemy / Coursera / YouTube)
4. Category (Technical or Non-Technical)
5. Paid or Free Indicator

Technical Expectations:
- Data scraping can be performed using tools such as Python, BeautifulSoup, Selenium, Scrapy, or other efficient scraping frameworks.
- The freelancer must handle pagination, dynamic loading, and scrolling where required.
- Duplicate entries should be avoided.
- The final dataset should be clean and well-structured.

Output Format:
The final deliverable should be provided in one of the following formats:
- CSV
- Excel
- JSON

The dataset must contain approximately 200,000 unique entries.

Timeline:
The project should be completed within 2 days from the start date.

Additional Notes:
- Data accuracy and proper formatting are very important.
- The freelancer should ensure that the scraping process is efficient and capable of handling large-scale data extraction.

Skills Required:
- Web Scraping
- Python
- Selenium / BeautifulSoup / Scrapy
- Data Cleaning & Structuring
- Handling Large Datasets