Scrape a website for info based on csv of names
Budget: $750 – $1,500 AUD
I am looking for a skilled programmer to scrape this website (abel.lis.illinois.edu/cgi-bin/ethnea/search.py) for ethnicity and gender information based on 3 large csv files containing in total around 2.25 million names.
Some work will need to be undertaken first to clean and format the names to seperate first names from last and middle names etc.
The website states, “If you want json instead of html, just append &format=json to the url but if you plan to harvest our data, please pause your program at least a second between requests.”
Delivery of python script for cleaning and scraping tasks is required.
Some work will need to be undertaken first to clean and format the names to seperate first names from last and middle names etc.
The website states, “If you want json instead of html, just append &format=json to the url but if you plan to harvest our data, please pause your program at least a second between requests.”
Delivery of python script for cleaning and scraping tasks is required.