Someone squeezed a 28.9M LLM onto an ESP32-S3, and so can you
Ever since LLMs hit the public eye, people have tried to cram them into the smallest thing they can find. We've seen people use both Raspberry Pis and ESP32s to run an AI locally, with varying results. Now, someone has managed to squeeze a 28.9M LLM on an ESP32-S3, and it can tell a pretty good story.
Ever since LLMs hit the public eye, people have tried to cram them into the smallest thing they can find. We’ve seen people use both Raspberry Pis and ESP32s to run an AI locally, with varying results. Now, someone has managed to squeeze a 28.9M LLM on an ESP32-S3, and it can tell a pretty good story.
Jane Smith
Los Angeles
Los Angeles
Published by: aplhsindia.in
