The first time I tried to run a LLM locally, I wasn’t really impressed. Granted that I was running it on a poor MacBook Air with 8GB of RAM that was holding on for dear life, the gap between the local and cloud LLM world was massive.