The Internet being mostly broken at this point is driving me a little insane, and I can’t believe that people who have the power to keep a functioning search engine for themselves wouldn’t go ahead and do it.
I wonder about this every time I see people(?) crowing about how amazing AI is. Like, is there some secret useful AI out there that plebs like me don’t get to use? Because otherwise, huh?
Never considered self-hosting search. How does your LLM compare to the public ones?
Not completely self hosted. Searxng is just a front end for a bunch of other engines, so it fetches results from google et al. Its good but glitches a lot as the engines themselves try to block it.
Yacy is self hosted, it crawls the sites you tell it to.
The LLMs are great. You can self host the models or just link to the hugging face API. The models you can find there are tuned for specific purposes and are far superior for those purposes. You can also train “agents” on top of those models, like upload your policy and procedure manual and ask it to create additional procedures in that context.