Optimize Local LLM Setup
Budget: $10 – $15 USD
Looking to setup locally on windows (intel Core i7 10th generation) any LLM that can give good quality responses as ChatGPT without internet connection. Preferred is Ollama however it is very slow for llama 3 70B. NOT sure if it can be done via quantize versions of LLMs.