Data Cleaning and Merging Task

Job ID: 38494845

Budget: $250 – $750 USD

I have two large text files that need to be cleaned and merged. The first file is a voter file, which is 261 MB and contains 1.1 million rows. The second file is a history file, which is 1.2 GB and contains 13.3 million rows. Files are tab delimited text files.

Here's what needs to be done:
- In the voter file, eliminate 32 of the 56 columns. (See columns to keep below)
- In the history file, keep only the rows for elections between 2018 and 2024. All other rows should be deleted.
- Finally, merge these two files by the registrant ID. This file should have all of the columns listed below, plus 7 columns for elections between 2018 and 2024. Specifically on
11/6/2018
3/3/2020
11/3/2020
9/14/2021
6/7/2022
11/8/2022
3/5/2024
This file should indicate whether the registrant voted Y or N on each of these dates.

The final merged file needs to be in Excel format. I expect total file to be 1.1M rows, which exceeds Excel limit of 1.0M rows, so OK to divide this into 2 files.

The specific columns for the final file should include
- CountyCode
- RegistrantID
- LastName
- FirstName
- AddressNumber
- StreetName
- City
- State
- Zip
- Phone1Area
- Email
- Language
- DOB
- Gender
- PartyCode
- Status
- RegistrationDate
- Precinct
- PrecinctNumber
- PlaceOfBirth
- PrecinctId
- Voted 11/6/2018
- Voted 3/3/2020
- Voted 11/3/2020
- Voted 9/14/2021
- Voted 6/7/2022
- Voted 11/8/2022
- Voted 3/5/2024

Ideal candidates for this project should have experience with data cleaning, merging, and Excel. Ability to deal with large text files up to 13 million rows of data. Skills in data analysis and familiarity with voter data would be a plus.
Related categories: Data Entry Excel Data Mining