Assessors Website Scraping
Budget: $30 – $250 USD
I am looking for an experienced web scraper who can help me with a web scraping project. I need you to extract data from the following URL structure:
https://propertysearch.jeffco.us/api/neighborhood?Skip={skipNumber}&Take={takeNumber}&neighborhoodIds={neighborhoodId}&page={pageNumber}
You will need to obtain all uniquePropertyIds for neighborhoods 2 through 407. The uniquePropertyIds are obtained by paging through the neighborhoods. However, increasing the "Take" parameter in the URL will allow you to retrieve more results per page and reduce the number of times you need to page through the neighborhoods.
You will need to verify that you have obtained all of a neighborhoods uniquePropertyIds by checking the "totalCount" variable that is sent back in the JSON request.
Once you have obtained all neighborhoods uniquePropertyIds, you will use them to download additional data from this URL:
https://propertysearch.jeffco.us/propertyrecordssearch/neighborhood/property/details/{uniqueID}
An example of a specific property page would look like this:
https://propertysearch.jeffco.us/propertyrecordssearch/neighborhood/property/details/gTc5W0moNbhzQ86f2Cko7Hun4aiLCHnocovNnkA_rfk1
You will need to scrape the Bedroom, Bathroom, and total square footage of each unit, as well as the unique ID, parcel number, and address. Please note that the Bedroom and Bathroom data is structured strangely, separating by (1/2 bath, 3/4 bath, Full Bath+K+L, etc.). It is important to note that other combinations of Bathroom types may exist, and it is crucial that the data be 100% accurate.
The data you scrape must match the Bedroom, Bathroom, and Total Sqft information found on Zillow for each specified address.
You will need to save the final data in CSV format, with the following columns:
Unique ID
Parcel Number
Property Address
Total Bedrooms
Total Bathrooms
Total Square Footage
Additionally, I need the raw HTML document for each uniquePropertyId to be saved with the name of the corresponding parcel number.
You will be working with a total of around 250,000 properties to scrape, so please keep this in mind when providing your timeline for completion.
If you are interested in this project and can guarantee the highest level of accuracy and proper data and document formatting, please let me know your proposed approach and estimated timeline. Thank you!
Main Webpage:
https://propertysearch.jeffco.us/propertyrecordssearch/dashboard
https://propertysearch.jeffco.us/api/neighborhood?Skip={skipNumber}&Take={takeNumber}&neighborhoodIds={neighborhoodId}&page={pageNumber}
You will need to obtain all uniquePropertyIds for neighborhoods 2 through 407. The uniquePropertyIds are obtained by paging through the neighborhoods. However, increasing the "Take" parameter in the URL will allow you to retrieve more results per page and reduce the number of times you need to page through the neighborhoods.
You will need to verify that you have obtained all of a neighborhoods uniquePropertyIds by checking the "totalCount" variable that is sent back in the JSON request.
Once you have obtained all neighborhoods uniquePropertyIds, you will use them to download additional data from this URL:
https://propertysearch.jeffco.us/propertyrecordssearch/neighborhood/property/details/{uniqueID}
An example of a specific property page would look like this:
https://propertysearch.jeffco.us/propertyrecordssearch/neighborhood/property/details/gTc5W0moNbhzQ86f2Cko7Hun4aiLCHnocovNnkA_rfk1
You will need to scrape the Bedroom, Bathroom, and total square footage of each unit, as well as the unique ID, parcel number, and address. Please note that the Bedroom and Bathroom data is structured strangely, separating by (1/2 bath, 3/4 bath, Full Bath+K+L, etc.). It is important to note that other combinations of Bathroom types may exist, and it is crucial that the data be 100% accurate.
The data you scrape must match the Bedroom, Bathroom, and Total Sqft information found on Zillow for each specified address.
You will need to save the final data in CSV format, with the following columns:
Unique ID
Parcel Number
Property Address
Total Bedrooms
Total Bathrooms
Total Square Footage
Additionally, I need the raw HTML document for each uniquePropertyId to be saved with the name of the corresponding parcel number.
You will be working with a total of around 250,000 properties to scrape, so please keep this in mind when providing your timeline for completion.
If you are interested in this project and can guarantee the highest level of accuracy and proper data and document formatting, please let me know your proposed approach and estimated timeline. Thank you!
Main Webpage:
https://propertysearch.jeffco.us/propertyrecordssearch/dashboard