Setup my RunPod vLLM inference engine
Budget: $10 – $30 USD
I am looking for a skilled professional to set up my RunPod vLLM inference engine. The project requires a standard setup, and I would like it to be completed immediately. I am a software developer myself but Ive been running into some issues when setting up my private LLM server. Think of this project as a tutoring session as well :).
I would like to host my LLM using RunPod and I feel vLLM would be the best method of serving while making it compatible with other services I plan to use such as Autogen, MemGPT, etc.
This assignment could certainly lead to a long term position.
Ideal Skills and Experience:
- Proficiency in setting up RunPod vLLM inference engine
- Experience with LLMs
- Strong knowledge of Linux operating system
- Ability to work within tight timelines
I would like to host my LLM using RunPod and I feel vLLM would be the best method of serving while making it compatible with other services I plan to use such as Autogen, MemGPT, etc.
This assignment could certainly lead to a long term position.
Ideal Skills and Experience:
- Proficiency in setting up RunPod vLLM inference engine
- Experience with LLMs
- Strong knowledge of Linux operating system
- Ability to work within tight timelines
Related categories:
PHP
Business, Accounting, Human Resources & Legal
Python
Linux
Large Language Models (LLMs)