I don’t pay for Perplexity or ChatGPT after combining my local LLMs with Perplexica and SearXNG
When it comes to simple inference tasks, my locally-hosted large language models are reliable enough to deliver accurate results. But everything falls apart as soon as I start prompting my LLMs about complex errors, new topics, or frequently updated information. By default, the models I run on llama.cpp can only access their training data, meaning they’re completely isolated from real-time information from the Internet.
When it comes to simple inference tasks, my locally-hosted large language models are reliable enough to deliver accurate results. But everything falls apart as soon as I start prompting my LLMs about complex errors, new topics, or frequently updated information. By default, the models I run on llama.cpp can only access their training data, meaning they’re completely isolated from real-time information from the Internet.
Emily Brown
Houston
Houston
Published by: aplhsindia.in
