Windows 10 Desktop APP to Extract Data from Four Websites
Budget: $100 – $200 USD
The purpose of this project is to develop a Windows 10 desktop APP (1 executable file) to extract data on doctors from 4 websites: HEALTHGRADES, WEBMD, VITALS and SHARECARE (all .com), and deliver the data produced by running it on a given set of doctors. The following fields are extracted:
1. HEALTHGRADES: Rating, Reviews, pairs (Conditions/Procedures , Treatment Frequency)
2. WEBMD: Rating, Reviews, Years Experience, Conditions, Procedures
3. VITALS: Rating, Reviews, Years of Experience, Areas of Expertise
4. SHARECARE: Rating, Reviews, Age, Years of Experience, pairs (Condition or Procedure , Treatment Frequency)
The attached PDF file, Extract Data from Four Websites, explains exactly where the data is found on each of the 4 websites.
The data can be stored in JSON files or TXT files, whichever is easier. The APP will ask which of the 4 websites to include. The processing should be:
For Each Doctor
For each Website
If the Website is included
Extract the data for the Doctor from the Website
The APP will also ask for two positive integers X and Y, where X < or = Y. Each time data is fetched from a website the APP will first wait for a random number of seconds between X and Y inclusive. So, for example, if X=3 and Y=5, then 1/3 of the time it will wait 3 seconds, and likewise for 4 or 5 seconds.
The attached TXT file DOCTORS has 5 tab delimited fields on one doctor in each line:
1. Sequential Doctor Number
2. Doctor Name
3. City
4. State
5. Specialty
The user will browse to a directory that contains file DOCTORS. The APP will create one file for each website included, in the same directory. The APP will successfully create files for the attached DOCTORS file.
But before we talk, please tell me the next prime number after 7.
Thanks,
Charlie
1. HEALTHGRADES: Rating, Reviews, pairs (Conditions/Procedures , Treatment Frequency)
2. WEBMD: Rating, Reviews, Years Experience, Conditions, Procedures
3. VITALS: Rating, Reviews, Years of Experience, Areas of Expertise
4. SHARECARE: Rating, Reviews, Age, Years of Experience, pairs (Condition or Procedure , Treatment Frequency)
The attached PDF file, Extract Data from Four Websites, explains exactly where the data is found on each of the 4 websites.
The data can be stored in JSON files or TXT files, whichever is easier. The APP will ask which of the 4 websites to include. The processing should be:
For Each Doctor
For each Website
If the Website is included
Extract the data for the Doctor from the Website
The APP will also ask for two positive integers X and Y, where X < or = Y. Each time data is fetched from a website the APP will first wait for a random number of seconds between X and Y inclusive. So, for example, if X=3 and Y=5, then 1/3 of the time it will wait 3 seconds, and likewise for 4 or 5 seconds.
The attached TXT file DOCTORS has 5 tab delimited fields on one doctor in each line:
1. Sequential Doctor Number
2. Doctor Name
3. City
4. State
5. Specialty
The user will browse to a directory that contains file DOCTORS. The APP will create one file for each website included, in the same directory. The APP will successfully create files for the attached DOCTORS file.
But before we talk, please tell me the next prime number after 7.
Thanks,
Charlie
Related categories:
Python
Web Scraping
Data Extraction
BeautifulSoup
Selenium
Data Collection
Desktop Application