FastChat Docker Deployment for Woz Prototype with MIstral 7B -- 2

I need a fast and efficient deployment of FastChat using Docker, to be implemented on a local server. The goal of this deployment is to facilitate the development of a Woz prototype, which stands for Wizard-of-Oz prototype. The prototype will be used to test various functionalities and gauge human interaction with the system.

Key requirements and considerations:
- FastChat implementation using Docker: The implementation should be smooth and efficient, ensuring seamless operation on a local server.
- Woz prototype focus: The project primarily aims at using FastChat to create a Woz prototype. This prototype will be utilized to test and evaluate various functionalities.
- Functionalities include:
- Speech recognition: The system should be able to recognize and interpret speech inputs.
- Natural language processing: The prototype should be capable of understanding and processing natural language inputs.
- Dialog management: An essential requirement is that the prototype can manage dialogues effectively.
- Model performance: The overall objective is to assess the performance and efficiency of the model.
- RAG: The prototype should follow the RAG (Red, Amber, Green) rating system for providing feedback and user interaction.

Ideal skills and experience for this project:
- Proficiency in Docker and deployment on local servers.
- Experience in FastChat implementation or similar chatbot systems.
- Knowledge in creating and testing Woz prototypes.
- Expertise in speech recognition, natural language processing, and dialog management.
- Understanding of model performance evaluation and RAG rating system.

Your delivery should be a well-documented, functioning deployment of FastChat in a local server setting, with the necessary functionalities for the Woz prototype in place.

Dockerfile
https://github.com/lm-sys/FastChat/blob/main/docker/Dockerfile
https://pf7.eggs.or.kr/2024-05-22-Mistral-7B-V01.html

docker-compose log
fastchat-model-worker-1 | 2024-05-22 15:00:57 | ERROR | stderr | /usr/local/lib/python3.9/dist-packages/transformers/generation/configuration_utils.py:520: UserWarning: `do_sample` is set to `False`. However, `top_p` is set to `0.6` -- this flag is only used in sample-based generation modes. You should set `do_sample=True` or unset `top_p`. This was detected when initializing the generation config instance, which means the corresponding file may hold incorrect parameterization and should be fixed.