For someone who strayed away from anything AI-related for a long time, hosting my own large language models made me aware of how productive local models can be. Whether it’s aiding my troubleshooting efforts after a botched project renders my home lab offline, extracting precise text snippets from abysmally long documents, or helping me organize my bookmarks, local LLMs are now a staple part of my FOSS a***nal.