Download IRS 990 Data and Group Files by Year
Budget: $2 – $8 USD
In the US, nonprofit tax returns are publicly available for all to see. I can't figure out how to get just the files I need from that online folder. There are about 1 million files in the S3 bucket (folder) and I need about 100 thousand of them. These should be divided up into .zip or .7zip archives by year, with multiple archives for each year if needed (even 100,000 files might be too much for my windows operating system), so that I can use the files.
This is where the data is:
https://registry.opendata.aws/irs990/
It's accessible via the AWS CLI (Command Line Interface)
I've tried something like this in AWS CLI but it timed out after hours of just sitting there:
aws s3 cp s3://irs-form-990/ D:\Parse990Data\2021 --exclude "*" --include "2021*" --no-sign-request
I'm looking to get the files that start with 2021. The file name will be "2021........"
I might be more likely to choose someone that can help me with the next steps of the project. They are parsing the files to get the data into a .csv file that will be merged into a sql data base (I've already written the c++ program but it will need additional fields that it searches for added), writing php website app to show all the data we gathered.
This is where the data is:
https://registry.opendata.aws/irs990/
It's accessible via the AWS CLI (Command Line Interface)
I've tried something like this in AWS CLI but it timed out after hours of just sitting there:
aws s3 cp s3://irs-form-990/ D:\Parse990Data\2021 --exclude "*" --include "2021*" --no-sign-request
I'm looking to get the files that start with 2021. The file name will be "2021........"
I might be more likely to choose someone that can help me with the next steps of the project. They are parsing the files to get the data into a .csv file that will be merged into a sql data base (I've already written the c++ program but it will need additional fields that it searches for added), writing php website app to show all the data we gathered.