Maryland unclaimed property data

Retrieve fields

Owner
Last Known Address
City
State
Zip Code
Reported By
Amount
Property ID
Process:

Every 24 hours at 5pm

Navigate to: https://www.unclaimed-property.marylandcomptroller.gov/app/claim-search
Change display to 80
Clear daily postgresql table
Loop through AA to ZZ as last name
Collect all results
Navigate through all pages
Write results to master and daily postgresql table
On property ID already existing, ignore
Perform any captchas and rotate proxy as necessary
Anti join where master is not in daily
Populate Claimed in master as today where claimed not already set and property ID not in daily table
Join on ID between daily and master, check for any fields that are different between the two
Write exceptions into difference table with found_date as today


Database structure:

unclaimed_daily

owner
last_known_address
city
state
zip_code
reported_by
amount
property_id



unclaimed_master

owner
last_known_address
city
state
zip_code
reported_by
amount
property_id
claimed

unclaimed_difference

master_owner
master_last_known_address
master_city
master_state
master_zip_code
master_reported_by
master_amount
master_property_id
master_owner
master_last_known_address
master_city
master_state
master_zip_code
master_reported_by
master_amount
master_property_id
found_date