I ran my local LLM for hours and watched it get dumber in real time
Local LLMs are at a point where I can use them for most of my coding tasks, but moving up to larger models comes with some caveats. If you've got unified memory like on a Mac, you're golden, but I've been running models on an Nvidia RTX 5090 and noticed the model seems to get worse over time.
Local LLMs are at a point where I can use them for most of my coding tasks, but moving up to larger models comes with some caveats. If you’ve got unified memory like on a Mac, you’re golden, but I’ve been running models on an Nvidia RTX 5090 and noticed the model seems to get worse over time.
Daniel Martinez
Dallas
Dallas
Published by: aplhsindia.in
