My mini PC can fit larger models than my old gaming card, but it still loses on one key metric
For the past few weeks, I've been toying around with local AI models of various sizes on two very different kinds of hardware. The first of which is my home lab: an i7-6700K-based system with an RTX 3080 10GB dedicated GPU inside, powering Immich machine learning, Jellyfin transcoding, and now, a llama.cpp instance hosting local AI. I put it head-to-head against a MINISFORUM MS-03, one of their latest "AI workstation" offerings that boasts an Intel Core Ultra 9 386H and 32GB of RAM.
For the past few weeks, I’ve been toying around with local AI models of various sizes on two very different kinds of hardware. The first of which is my home lab: an i7-6700K-based system with an RTX 3080 10GB dedicated GPU inside, powering Immich machine learning, Jellyfin transcoding, and now, a llama.cpp instance hosting local AI. I put it head-to-head against a MINISFORUM MS-03, one of their latest “AI workstation” offerings that boasts an Intel Core Ultra 9 386H and 32GB of RAM.
Daniel Martinez
Dallas
Dallas
Published by: aplhsindia.in
