AWS Lambda Microservice: Create, List, Delete Sagemaker endpoint.
Budget: $30 – $80 CAD
AWS Lambda Microservice: Create, List, Delete Sagemaker endpoint
I would like to create a backend service which creates, lists and deletes a specific sagemaker model endpoint which hosts the falcon-40b-instruct model available from huggingface.
This should be implemented as a lambda function and made accessible through API Gateway as a lambda proxy integration.
The front end for this microservice will do three things:
- Trigger the creation of the endpoint
- Asynchronously list available endpoints through a react hook (is the model deployed or not?)
- Delete the endpoint if it is in an active state
Additionally, if the sagemaker endpoint is deployed it should monitor its traffic. If no traffic has occurred within 30 minutes (variable) then the endpoint should automatically delete.
The frontend will send a body payload as json and / or query string parameters.
The architecture will be hosted in ca-central-1
I would like to create a backend service which creates, lists and deletes a specific sagemaker model endpoint which hosts the falcon-40b-instruct model available from huggingface.
This should be implemented as a lambda function and made accessible through API Gateway as a lambda proxy integration.
The front end for this microservice will do three things:
- Trigger the creation of the endpoint
- Asynchronously list available endpoints through a react hook (is the model deployed or not?)
- Delete the endpoint if it is in an active state
Additionally, if the sagemaker endpoint is deployed it should monitor its traffic. If no traffic has occurred within 30 minutes (variable) then the endpoint should automatically delete.
The frontend will send a body payload as json and / or query string parameters.
The architecture will be hosted in ca-central-1