Python script to run MPT7-Instruct model with API using Gradio
Budget: $10 – $30 USD
I am looking for assistance in writing a python script to run my MPT7-Instruct model with an API using Gradio. I have already created the model, and I have a specific API in mind that I would like to use for running the model. The expected input format is text input. If you believe you possess the necessary skills to help me on this project, I would love to connect and discuss further. Thank you for your time!
I will validate the script running on my instance and if it works then I will close the project.
You just need to modify this code https://huggingface.co/spaces/mosaicml/mpt-7b-instruct/blob/main/app.py here to convert it into an API.
Input: Text prompt
Output: Text reply based on the prompt
I will validate the script running on my instance and if it works then I will close the project.
You just need to modify this code https://huggingface.co/spaces/mosaicml/mpt-7b-instruct/blob/main/app.py here to convert it into an API.
Input: Text prompt
Output: Text reply based on the prompt