I changed one llama.cpp flag, and my 8GB laptop GPU now runs a 35B model faster than I can read
A lot of what you can do with your PC seems to be limited by the VRAM its GPU has. It decides what resolution your games run at, how large a video project you can edit without the timeline stuttering intermittently, and most recently, which local AI models you can self-host. A lot of these examples feel like hard limits, but there are workarounds for almost all of them.
A lot of what you can do with your PC seems to be limited by the VRAM its GPU has. It decides what resolution your games run at, how large a video project you can edit without the timeline stuttering intermittently, and most recently, which local AI models you can self-host. A lot of these examples feel like hard limits, but there are workarounds for almost all of them.
Charlie Adam
France
France
Published by: aplhsindia.in
