Create an ETL flow with AWS Glue -- 2
Budget: $30 – $250 USD
I need the creation of an AWS glue project to automate an ETL process, which is as follows:
1.- We have a list of ids where we have to get the description of the object from a rest API (multiple calls).
2.- Save raw objects to S3 to create datalake.
2.- Make one transformation from one JSON schema to another JSON schema.
3.- Save transformed JSON into DBs. (Probably DynamoDB and/or OpenSearch Service)
These are the main characteristics of the flow. We are open to any further suggetions toi improve it if needed.
Thank you.
1.- We have a list of ids where we have to get the description of the object from a rest API (multiple calls).
2.- Save raw objects to S3 to create datalake.
2.- Make one transformation from one JSON schema to another JSON schema.
3.- Save transformed JSON into DBs. (Probably DynamoDB and/or OpenSearch Service)
These are the main characteristics of the flow. We are open to any further suggetions toi improve it if needed.
Thank you.