

11·
3 years agoYou should make sure you are running a model that fits in your vram, for me it runs faster than any online LLM I’ve tried.


You should make sure you are running a model that fits in your vram, for me it runs faster than any online LLM I’ve tried.


ollama + codellama works perfect, I use it from neovim with a plug-in called gen-nvim I think
If you have a smart TV you can use stremio, don’t even need a box.