Build TorchServe Custom Handle for Transformers model (Python)

Job ID: 32010445

Budget: $30 – $250 USD

We are implementing rest api for our pytorch transformers ai model. We have decided to use Pytorch Serve. The inputs will be json and outputs will be text. There might be need to make some helper files for handle file in order to manipulate inputs to the correct format.

Deliverables
We need help implementing Pytorch Torchserve for our Pytorch Transformers Model. The handle need to be created to allow posting inputs using rest api in json format and output should be the prediction of our model. Also classification code need to be coded in order to allow the inputs to be in specific format, but our current model has already examples from where the developer can start. The code is using docker.
Related categories: Python Pytorch NumPy SciPy