setup real-time tensorflow inference using AWS sagemaker endpoint and AWS inferentia -- 2

Job ID: 31394600

Budget: £20 – £250 GBP

We have a python script that uses a tensorflow model and keras model to extract data from an image and output the result. Currently it is using CPU with flask, however performance is bad and takes 20+ seconds to compute a single image. We need to speed this up to be done in much faster so require the inference to be handled by AWS sagemaker and utilize a low cost AWS inferentia instance whilst performing the inference.

its a relatively simple task:-
https://introduction-to-inferentia.workshop.aws/inf1onsage/02sageintro.html

We finally require a text file containing the steps required to reproduce the environment from scratch, as this will eventually go into production.