News articles web Scraping for NLP

Job ID: 38003135

Budget: $250 – $750 USD

This project is open only to individuals. Agencies need not apply. Freelancers with no rating need not apply. Generic copy-paste responses will be marked as spam. Your past freelance feedback should clearly show that you have completed similar tasks.

I require a specialist in web scraping to extract the body text from articles on Google News. The information will be earmarked for natural language processing, hence, accuracy of extraction and correct formatting into an excel file is of utmost importance.

Key responsibilities and skills:
- Experience in web scraping, specifically from news websites.
- Knowledge of creating Python or PHP scraping scripts or using API.
- Ability to deliver results fast, as the project needs to be completed ASAP.


Please note that the sole requirement is to extract the body of the news articles with no need for the title, date or author. Let me know your approach and estimated timeframe for completion and budget.

I give you (English only)
- search keywords, (possibly 500K-1M news articles)

You give me
- excel file with two columns (possibly split excel file based on year/month)
A- URL to the news article
B- article body (no photo, video or XML tags, ONLY text of the news)
Related categories: PHP Python Data Entry Web Scraping Data Mining