I’m running AI on my NAS at 5 tokens per second, and it’s surprisingly useful
I knew this was a bad hardware match before I started. My UGREEN DXP4800 Pro doesn’t have a discrete GPU; it already spends its days as a NAS, and there was no reason to expect CPU-only AI inference to be pleasant. I installed Ollama anyway, connected Open WebUI to it, and pulled down small 4B models to see whether the whole thing was merely possible or actually useful. It turned out to be both, though with a lot more waiting than I would’ve preferred.
I knew this was a bad hardware match before I started. My UGREEN DXP4800 Pro doesn’t have a discrete GPU; it already spends its days as a NAS, and there was no reason to expect CPU-only AI inference to be pleasant. I installed Ollama anyway, connected Open WebUI to it, and pulled down small 4B models to see whether the whole thing was merely possible or actually useful. It turned out to be both, though with a lot more waiting than I would’ve preferred.
Sophia Wilson
Atlanta
Atlanta
Published by: aplhsindia.in
