OpenWebUI works with plain llama.cpp

16 is a bit small so try a MoE (e.g. QWEN 3.6 35BA3B) model and put experts on the CPU (although DDR4 may be underwhelming) which you can do with llama ( with offloading and drafting for T/s) but not ollama (spitting noise). Here’s a good starting point. You’ll likely get 60+T/s on say a 6 bit quant.

You can use a container approach, but llama.cpp is a bit of a moving target, with new cool features coming along regularly to support new models. I build it in a distrobox and running it is a simple call. When it doesn’t want to build anymore because dependencies have changed too much, I just spin up a new distrobox and leave the old one there for older models. I find it a good balance between flexibility and ease of maintenance, and technically it’s also a container approach. Take notes so you know how to set up the new one.

Agreed.

Hmm, you suggesting KDE and Gnome (and other DEs) are religions, or espoused with religious fervor? Might be something to that, but likely not what OP wants.

Doubt there’s a straight line from LLMs to ASI, gonna need some new architecture.

People often make good decisions, self-interested representative politicians and oligarchs can be relied upon to make good decisions for themselves (mostly, looking at you Musk). See the comment on Athenian democracy above.

You’re right, it is that way now. But it’s not intrinsic to hierarchy, just to the current system.

As a counterexample, not as an endorsement, consider feudalism (the old form, not technofeudalism). While psycho/sociopaths have an advantage reaching the top, there is a reasonable chance that their children will not be sick in the same way.

Also Athenian Democracy, where people were randomly selected to form ruling council, judiciary, and assembly, so only as likely as the populace prevalence to be a psychopath. That system lasted for hundreds of years, including being taken over by (probably) sociopaths and returning afterwards to democracy.

Thanks, makes sense now.

Still seems like a (server) code level problem to provide sensible handling rather than having to try to notify all users of an unintuitive behavior. I’m guessing piefed would likely listen, lemmy perhaps less so.

a deleted post would still have all the comments and discussions below it.

Pretty damn sure that’s exactly what I see. It just says ‘deleted’ or some such and carries on. Makes sense for an instance like .ml where censorship is the goal, much less elsewhere. Are you sure there isn’t an off switch?

So what you’re saying is it’s an instance choice (and instance admin) issue? Mine shows reply comments on deleted comments. You might reflect this in OP… Likely new admins don’t know to turn it off as well.

I assumed Linux given the specs and that Chrome works at all.

Vote for firefox as you should be anyway. Another trick to try is an explicit tab unloader extension (for fine control of unloading) and/or the built in about:unloads .

All browsers seem to accumulate memory (and cpu usage) over time, sometimes you just have to shut it down and restart. (AKA have you tried turning it off and on again :) A daily (possibly shorter if needed) service to restart it can work.

Fair cop.

Still no to Denuvo, any studio using it should be spanked.

you will need a kernel module.

Yeah, Nah. That’s a nope, especially given it can be done in proton. Also, updated Denuvo in 3.2.1…

Denuvo, just say no.

Just get a domain and point it at a provider. Now you’re not locked in and can switch at will upon enshittification. Get one of the offline mail archive services like OpenArchiver. Job done.

You can do CUDA on these, which is not nothing. With that you can run DOOM and pipe it to a video out. If there is a glut of cheap new versions of these after a bubble pop, perhaps the effort will be made to bodge these into pretending they’re a 5090 or something for the drivers, probably on Linux. It’s certainly possible, but significant work. If they’re cheap enough, and plentiful enough, life will find a way.

What they are good at, right now, is running local LLMs, scientific computing, etc., and it is done reasonably commonly by hobbyists. Likely also Photoshop and similar if you want the pain of running them on windows.

Agreed, if so, even more ominous. Sad when a scam at this level failing to be completely successful is what spooks the market.

Rather ominous for the SpaceX IPO.

Shame, SpaceX is probably a reasonable investment, but Nazi boy had to roll his twitter and xAI disasters into it (surprised he didn’t roll Tesla in as well, but he can always do it later with the ironclad control). There are no good outcomes here.

deleted by creator

Pretty bad optics for a country that’s been bringing it’s A game to PR while the US self destructs. Projecting power? Just don’t GAF about NZ?

Apparently you can’t vibe code a rocket, coz, checks notes, rocket science is hard and everyone who could moved from the US like smart people do.

Could sub Ctrl-C, Ctrl-V and Enter and be an old school dev ;)