Cleaning, Merging, and Exporting Kickstarter and Indiegogo Datasets (JSON-CSV)
Budget: $20 – $25 USD
I'm looking for a skilled freelancer with experience in data processing to download, clean, merge, and export Kickstarter and Indiegogo public datasets for the years 2021 to 2024, following the detailed specifications below.
1. Kickstarter Dataset
Source page: https://webrobots.io/kickstarter-datasets/
Tasks:
Download all files related to the years 2021 to 2024, in CSV or JSON format.
Remove the following columns (if present):
photo, creator, location, profile, spotlight, source_url, is_starrable, is_starred, staff_pick, state_changed_at, country_displayable_name
Remove duplicate rows within each file.
Merge the files for each year into a single file per year.
If the resulting file exceeds 100 MB, split it into multiple parts (e.g., 2021_part1.xlsx, 2021_part2.xlsx, etc.)
Export each cleaned file in Excel format (.xls or .xlsx), using the following naming convention:
KICKSTARTER_2021.xlsx, KICKSTARTER_2022.xlsx, etc.
2. Indiegogo Dataset
Source page: https://webrobots.io/indiegogo-dataset/
Tasks:
Download the files from 2021 to 2024, in CSV or JSON format.
Merge files for each year into a single file per year (e.g., 2021.xlsx, 2022.xlsx, etc.).
Remove the following columns (if present):
igg_image_url, compressed_image_url, image_url
Remove duplicate rows within each file.
Filter rows based on the category (or category_name) column.
Only include entries belonging to the following categories:
Audio
Camera Gear
Education
Energy & Green Tech
Fashion & Wearable
Food & Beverages
Health & Fitness
Home
Phones & Accessories
Productivity
Transportation
Travel & Outdoors
Community Projects
Culture
Environment
Human Rights
Local Businesses
Wellness
Export each cleaned and filtered file in Excel format (.xls or .xlsx), using the following naming convention:
INDIEGOGO_2021.xlsx, INDIEGOGO_2022.xlsx, etc.
1. Kickstarter Dataset
Source page: https://webrobots.io/kickstarter-datasets/
Tasks:
Download all files related to the years 2021 to 2024, in CSV or JSON format.
Remove the following columns (if present):
photo, creator, location, profile, spotlight, source_url, is_starrable, is_starred, staff_pick, state_changed_at, country_displayable_name
Remove duplicate rows within each file.
Merge the files for each year into a single file per year.
If the resulting file exceeds 100 MB, split it into multiple parts (e.g., 2021_part1.xlsx, 2021_part2.xlsx, etc.)
Export each cleaned file in Excel format (.xls or .xlsx), using the following naming convention:
KICKSTARTER_2021.xlsx, KICKSTARTER_2022.xlsx, etc.
2. Indiegogo Dataset
Source page: https://webrobots.io/indiegogo-dataset/
Tasks:
Download the files from 2021 to 2024, in CSV or JSON format.
Merge files for each year into a single file per year (e.g., 2021.xlsx, 2022.xlsx, etc.).
Remove the following columns (if present):
igg_image_url, compressed_image_url, image_url
Remove duplicate rows within each file.
Filter rows based on the category (or category_name) column.
Only include entries belonging to the following categories:
Audio
Camera Gear
Education
Energy & Green Tech
Fashion & Wearable
Food & Beverages
Health & Fitness
Home
Phones & Accessories
Productivity
Transportation
Travel & Outdoors
Community Projects
Culture
Environment
Human Rights
Local Businesses
Wellness
Export each cleaned and filtered file in Excel format (.xls or .xlsx), using the following naming convention:
INDIEGOGO_2021.xlsx, INDIEGOGO_2022.xlsx, etc.