academic article scraping and sorting tool

Job ID: 37057912

Budget: $250 – $750 USD

Academic Article Scraping and Sorting Tool

Purpose:
- The purpose of this project is to develop a tool that can:

1) pull the 250 highest ranked academic articles from Google Scholar for a given set of keywords using boolean search (note that this task requires you to have journal access), and save these articles (pdfs) to a folder.

2) generate a single excel spreadsheet of these articles, which includes the author, title, year, journal, # of citations per google scholar, and full abstract of each article.

3) create a simple web interface for this task that I can install as a page on my website to generate 1) and 2) for keywords of my choosing.

Therefore, the final product will be a tool where a search is entered on a webpage, and then a zip file is generated with the excel sheet and articles that is automatically downloaded. You would host the page while testing, then transfer to my domain upon completion.

Skills and Experience:
- Experience in web scraping, simple GUI web generation and data extraction.
- Knowledge of academic research and terminology, access to academic journal articles.
- Familiarity with spreadsheet software for organizing and presenting data.

Note: The tool will be used to gather research data and analyze trends in academic research, but the primary focus is on organizing the articles.
Related categories: PHP Web Scraping Data Mining