My local LLM’s real problem wasn’t hallucination, it was a two-year blind spot
I went looking for hallucinations in my local LLM and found something worse. My setup is the thing I'm proudest of in my home lab: Lemonade serving models, Crush as the terminal-based harness, nothing leaving my network. But I've always wondered how much information those local models make up, so I put together a test suite to check.
I went looking for hallucinations in my local LLM and found something worse. My setup is the thing I’m proudest of in my home lab: Lemonade serving models, Crush as the terminal-based harness, nothing leaving my network. But I’ve always wondered how much information those local models make up, so I put together a test suite to check.
William Garcia
Boston
Boston
Published by: aplhsindia.in
