I ditched Ollama for Docker, and my local LLM setup finally stopped being a hassle
I’ve been using Ollama to run all my local LLMs, but when Docker recently announced Model Runner, I decided to move my models there. The reason is simple — I don’t need another app to run my local LLMs because I already use Docker for several other services, and adding an LLM feels like a natural extension of that setup.
I’ve been using Ollama to run all my local LLMs, but when Docker recently announced Model Runner, I decided to move my models there. The reason is simple — I don’t need another app to run my local LLMs because I already use Docker for several other services, and adding an LLM feels like a natural extension of that setup.
Sami Mortensen
Norway
Norway
Published by: aplhsindia.in
