Web Scrap Data CSV Consolidation
Budget: $30 – $250 USD
Web Scraping Data CSV Consolidation Request
Website Link:
https://apps.elections.virginia.gov/SBE_CSV/CF/2023_09/
Objective:
To consolidate multiple CSV files found in distinct folders on the specified Virginia elections website into individual Master Schedule CSVs. Additionally, an overarching MASTER SPREADSHEET is required for detailed analysis.
Task Breakdown:
Individual Schedule Folders:
On the website, there are folders named from Schedule A through Schedule I. Each of these folders contains numerous CSV files pertaining to their respective schedules.
Consolidation of Individual Schedules:
For each Schedule (from A to I), all the CSVs within its folder should be combined to form a Master CSV. The naming convention for these consolidated files will be:
SCHEDULE_A_MASTER.csv
SCHEDULE_B_MASTER.csv
SCHEDULE_C_MASTER.csv
...
I. SCHEDULE_I_MASTER.csv
Creation of an Overall Master Spreadsheet:
After forming the individual Master CSVs for each Schedule, these should be merged into one comprehensive MASTER_SPREADSHEET.csv. This file will be the primary resource for subsequent data analysis.
Additional Notes:
Ensure data integrity is maintained throughout the consolidation process.
If there are header or data format discrepancies among the CSVs, these should be addressed uniformly.
Document any decisions made in handling these discrepancies for future reference.
It is crucial to maintain the chronological order or any other inherent order present within the original CSV files when consolidating.
Website Link:
https://apps.elections.virginia.gov/SBE_CSV/CF/2023_09/
Objective:
To consolidate multiple CSV files found in distinct folders on the specified Virginia elections website into individual Master Schedule CSVs. Additionally, an overarching MASTER SPREADSHEET is required for detailed analysis.
Task Breakdown:
Individual Schedule Folders:
On the website, there are folders named from Schedule A through Schedule I. Each of these folders contains numerous CSV files pertaining to their respective schedules.
Consolidation of Individual Schedules:
For each Schedule (from A to I), all the CSVs within its folder should be combined to form a Master CSV. The naming convention for these consolidated files will be:
SCHEDULE_A_MASTER.csv
SCHEDULE_B_MASTER.csv
SCHEDULE_C_MASTER.csv
...
I. SCHEDULE_I_MASTER.csv
Creation of an Overall Master Spreadsheet:
After forming the individual Master CSVs for each Schedule, these should be merged into one comprehensive MASTER_SPREADSHEET.csv. This file will be the primary resource for subsequent data analysis.
Additional Notes:
Ensure data integrity is maintained throughout the consolidation process.
If there are header or data format discrepancies among the CSVs, these should be addressed uniformly.
Document any decisions made in handling these discrepancies for future reference.
It is crucial to maintain the chronological order or any other inherent order present within the original CSV files when consolidating.