setup real-time tensorflow inference using AWS sagemaker endpoint and AWS inferentia -- 2
Budget: £20 – £250 GBP
We have a python script that uses a tensorflow model and keras model to extract data from an image and output the result. Currently it is using CPU with flask, however performance is bad and takes 20+ seconds to compute a single image. We need to speed this up to be done in much faster so require the inference to be handled by AWS sagemaker and utilize a low cost AWS inferentia instance whilst performing the inference.
its a relatively simple task:-
https://introduction-to-inferentia.workshop.aws/inf1onsage/02sageintro.html
We finally require a text file containing the steps required to reproduce the environment from scratch, as this will eventually go into production.
its a relatively simple task:-
https://introduction-to-inferentia.workshop.aws/inf1onsage/02sageintro.html
We finally require a text file containing the steps required to reproduce the environment from scratch, as this will eventually go into production.