My 8GB laptop now runs an AI that can see and talk, and it never goes online
My M2 MacBook Air has 8GB of system memory, which is something that usually disqualifies it from running any particularly exciting local large language models. A local model that can see an image usually responds through text alone, and giving it the ability to hear, and a voice, usually means running separate models for each capability. Stacking three or four of them on an 8GB system is, understandably, a non-starter.
My M2 MacBook Air has 8GB of system memory, which is something that usually disqualifies it from running any particularly exciting local large language models. A local model that can see an image usually responds through text alone, and giving it the ability to hear, and a voice, usually means running separate models for each capability. Stacking three or four of them on an 8GB system is, understandably, a non-starter.
Leonard Curtis
Australia
Australia
Published by: aplhsindia.in
