Build Analytics API that Feeds into Postgres Database
Budget: $250 – $750 USD
We need an API written via Amazon API Gateway and AWS Lambda that adds records to our Postgres analytics database (currently setup on Aiven.io), but we could move to AWS too.
We would like to avoid having to manage servers or even a database for this project, as we have no in-house developers or IT staff.
Use Case:
We manage hundreds of marketing campaigns for e-commerce clients and host their checkout pages and CRMs. We are building a unified analytics API so we don't have to log in to hundreds of platforms to build stats.
To ingest stats, we'll have to use Postback URLs (some do not allow API Keys or setting headers) and curl requests from checkout pages themselves.
So for data that arrives via Postback, we'll have to figure out a way to secure the API that doesn't necessarily rely on header values, as some only let us set GET params.
The Project Deliverables:
+ Model the data based on the reports we need -- We use Metabase (similar to Tableau) to build and view reports.
+ Setup up the Database, schedule backups, and add security and other Database related tasks.
+ Configure AWS API Gateway endpoints for the data we'll need to ingest via the API. (e.g., /click, /conversion, /...)
+ Configure AWS Lambda functions to add data to the Database.
+ Setup our Github to store code.
+ Setup alert and error monitoring, so that we receive real-time down or error reporting.
+ Setup a custom domain(s) for these API endpoints.
+ Add authorization and security to API endpoints depending on their function.
We don't have a specific language we want to use, but our research shows that both Python and Node.js work great for Lambda.
We also need this project documented properly, so other developers can pick up and work on the project if need be.
Thanks for reading thus far, and let us know if you have any questions.
We would like to avoid having to manage servers or even a database for this project, as we have no in-house developers or IT staff.
Use Case:
We manage hundreds of marketing campaigns for e-commerce clients and host their checkout pages and CRMs. We are building a unified analytics API so we don't have to log in to hundreds of platforms to build stats.
To ingest stats, we'll have to use Postback URLs (some do not allow API Keys or setting headers) and curl requests from checkout pages themselves.
So for data that arrives via Postback, we'll have to figure out a way to secure the API that doesn't necessarily rely on header values, as some only let us set GET params.
The Project Deliverables:
+ Model the data based on the reports we need -- We use Metabase (similar to Tableau) to build and view reports.
+ Setup up the Database, schedule backups, and add security and other Database related tasks.
+ Configure AWS API Gateway endpoints for the data we'll need to ingest via the API. (e.g., /click, /conversion, /...)
+ Configure AWS Lambda functions to add data to the Database.
+ Setup our Github to store code.
+ Setup alert and error monitoring, so that we receive real-time down or error reporting.
+ Setup a custom domain(s) for these API endpoints.
+ Add authorization and security to API endpoints depending on their function.
We don't have a specific language we want to use, but our research shows that both Python and Node.js work great for Lambda.
We also need this project documented properly, so other developers can pick up and work on the project if need be.
Thanks for reading thus far, and let us know if you have any questions.