Create 4 Tables in AWS S3, Glue Studio and MySQL and Load data from CSV files
Budget: $30 – $250 USD
We need 4 tables to be crated and the data needs to be imported into S3, AWS RDS MySQL with proper data types defined. The source data will be provided in csv formats for all 4 types of formats. There are a total of 20 files that goes into these files. The data files for each table is of the same format i.e. there is only one format per table (4 types of ETLs for 20 files). There is no transformation other than data type involved.
Provide clear instructions to transition the work to run on my AWS account (all necessary permissions, roles, etc.)
Programs and ETLs
• Write Database program to load the data into 4 tables & properly format the data types as per the specifications
o Accessible through S3 as raw files
o S3 standardized with proper data types (for querying with Athena
o Write database program using ETL Glue Studio to load into MySQL AWS RDS Free-Tier
• Transfer the programs that I can run on my own AWS account for incremental monthly updates on my own.
• Show proof that all the rows are loaded with proper formats.
These are relatively small ETL jobs, and you should be able to do it on your own AWS account and finally transition it to me. If you have other preferences or approach to load using another aws service please let me know. Also, let me know if the program cannot be finally transferred to me for whatever reason.
The total must reconcile to the total on the csv files.
The dataset is not complex and no or very minimal transformation needed other than datatype standardization.
Please read attached detailed specification before responding. There is a link to the google drive where the source files are please download and see it. I need this done quick, therefore you MUST be experienced in AWS tech stack and MySQL.
Thanks
Provide clear instructions to transition the work to run on my AWS account (all necessary permissions, roles, etc.)
Programs and ETLs
• Write Database program to load the data into 4 tables & properly format the data types as per the specifications
o Accessible through S3 as raw files
o S3 standardized with proper data types (for querying with Athena
o Write database program using ETL Glue Studio to load into MySQL AWS RDS Free-Tier
• Transfer the programs that I can run on my own AWS account for incremental monthly updates on my own.
• Show proof that all the rows are loaded with proper formats.
These are relatively small ETL jobs, and you should be able to do it on your own AWS account and finally transition it to me. If you have other preferences or approach to load using another aws service please let me know. Also, let me know if the program cannot be finally transferred to me for whatever reason.
The total must reconcile to the total on the csv files.
The dataset is not complex and no or very minimal transformation needed other than datatype standardization.
Please read attached detailed specification before responding. There is a link to the google drive where the source files are please download and see it. I need this done quick, therefore you MUST be experienced in AWS tech stack and MySQL.
Thanks