private chatgpt like local LLM documents answering
Budget: $10 – $30 USD
I need a local chatgpt like using an open source LLM that will answer questions from PDF documents.
It needs to be totally local without internet connection.
It needs to be a steamlit python program, that could run on MAC OS, it will be need to be compiled later as an executable file, it can load data from folders like the LLM model etc...
The LLM model should be Open-Orca/Mistral-7B-OpenOrca (https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca) , it will also be easily possible to change models if needed.
There are already plenty of github examples and tutorials out there, is should not be complicated.
I am also a programmer and I will need the source code and it's IP.
It needs to be totally local without internet connection.
It needs to be a steamlit python program, that could run on MAC OS, it will be need to be compiled later as an executable file, it can load data from folders like the LLM model etc...
The LLM model should be Open-Orca/Mistral-7B-OpenOrca (https://huggingface.co/Open-Orca/Mistral-7B-OpenOrca) , it will also be easily possible to change models if needed.
There are already plenty of github examples and tutorials out there, is should not be complicated.
I am also a programmer and I will need the source code and it's IP.