Node.JS Lambda function to load data to Rest API
Budget: $750 – $1,500 USD
A program that takes data from a CSV file and adds it via a public Rest API.
We want to load up to 10,000 rows from a CSV file to a database via a Rest API. This project is to build an application that serves this purpose.
The app will need a config file (TXT file) that we can manually set up to define things such as the API Key and Secret, the mapping of the CSV columns to the API objects (data fields), etc.
We want the app to be written in Node.js, and run in an AWS Lambda function.
To save time and enable easy access to the code for us, build the function in the AWS Lambda Console.
The app will access the CSV file data by looking at an S3 bucket in AWS.
Your code will need to make validated/authenticated requests to the API.
Your code will need to respect the API limits for uploading (PUT) data, as oftentimes, the csv files will contain thousands of rows.
Your app will not run as an automated Lambda function, rather we will manually kick off the function when we need to use it. This function is being used for manual setup and testing of client data.
The process of events should be:
- We manually setup the config file, doing the mapping where needed
- A csv file is dropped somewhere (an S3 bucket or somewhere) accessible to the function
- The Lambda is kicked off manually, processing the CSV file
- The function reports status, errors, and a completed log
Overview spec:
https://docs.google.com/document/d/1lqAJXYAafZebiJ7rvHwlXTJBRY_mmYHx4zgUy-eot3E/edit#
We want to load up to 10,000 rows from a CSV file to a database via a Rest API. This project is to build an application that serves this purpose.
The app will need a config file (TXT file) that we can manually set up to define things such as the API Key and Secret, the mapping of the CSV columns to the API objects (data fields), etc.
We want the app to be written in Node.js, and run in an AWS Lambda function.
To save time and enable easy access to the code for us, build the function in the AWS Lambda Console.
The app will access the CSV file data by looking at an S3 bucket in AWS.
Your code will need to make validated/authenticated requests to the API.
Your code will need to respect the API limits for uploading (PUT) data, as oftentimes, the csv files will contain thousands of rows.
Your app will not run as an automated Lambda function, rather we will manually kick off the function when we need to use it. This function is being used for manual setup and testing of client data.
The process of events should be:
- We manually setup the config file, doing the mapping where needed
- A csv file is dropped somewhere (an S3 bucket or somewhere) accessible to the function
- The Lambda is kicked off manually, processing the CSV file
- The function reports status, errors, and a completed log
Overview spec:
https://docs.google.com/document/d/1lqAJXYAafZebiJ7rvHwlXTJBRY_mmYHx4zgUy-eot3E/edit#