University Scholarships Web Scraper
Budget: $30 – $250 AUD
Task overview:
Write a web scraper that collects information on the university scholarships on this web page:
Griffith: https://www.griffith.edu.au/scholarships
Write a web scraper that collects information on the university scholarships on this web page:
Updated simpler task description:
Use Python
Use packages that can scrape Javascript web pages (like Playwright, Selenium etc.)
Host your code in a Github repository with instructions on how to run the code
Write a scraper function that does the following:
Go to the provided university scholarship page
Extract the following details for all the scholarships on the page:
Name
URL
For each URL:
Go to the URL
Extract the entire raw HTML content of the <body> tag
There is no need for more detailed scraping than this! We simply want all the content in the <body> tag.
Please remove unwanted HTML tags from the <body> tag: 'form', 'script', 'style', 'img', 'video', 'svg', 'path', 'g', 'noscript', 'meta', 'header', 'footer', 'nav', 'iframe'
Save the HTML string along with the scholarship name and URL
Save all of the results to a JSON file
Output should be an array of objects
Each object should have name, url, html
Write a web scraper that collects information on the university scholarships on this web page:
Griffith: https://www.griffith.edu.au/scholarships
Write a web scraper that collects information on the university scholarships on this web page:
Updated simpler task description:
Use Python
Use packages that can scrape Javascript web pages (like Playwright, Selenium etc.)
Host your code in a Github repository with instructions on how to run the code
Write a scraper function that does the following:
Go to the provided university scholarship page
Extract the following details for all the scholarships on the page:
Name
URL
For each URL:
Go to the URL
Extract the entire raw HTML content of the <body> tag
There is no need for more detailed scraping than this! We simply want all the content in the <body> tag.
Please remove unwanted HTML tags from the <body> tag: 'form', 'script', 'style', 'img', 'video', 'svg', 'path', 'g', 'noscript', 'meta', 'header', 'footer', 'nav', 'iframe'
Save the HTML string along with the scholarship name and URL
Save all of the results to a JSON file
Output should be an array of objects
Each object should have name, url, html