Local LLMs are great. They’re very efficient, and at a time when API costs are increasing and AI tools are becoming more expensive to use, local LLMs are the way to go. I’ve been using Ollama to run Qwen 2.5 coder, and it’s quite good. The model is able to build things, fix bugs, and understand my requests almost as well as a Claude model, but of course, it has its limitations. It’s constrained by my hardware and its parameter count. It’s a 7-billion-parameter model, and the context window I can run locally is also smaller.