I’ve been dreaming of local AI for a hot minute. Sadly corporate AI has priced me out of personal computing, and current hardware isn’t up to it.
Maybe my n100 could, I don’t really care how slow it’s generating the tokens if it’s just resetting containers and logging errors.
Does your setup handle automagic updates, how do you handle prompt injection if so? Or, just error correction/logging?
A hosting service for games. Feed it games and it allows you to download them from your server, manage saves, emulate in browser… A bunch of stuff. It’s a good project.
Think of the alternative? Person uses a tool, tool does what they want, they go about their day.
What are they shouting from the rooftops? Gemini is running my herb garden, my herbs haven’t died yet! This is true: plant selection, pot selection, substrate, feeding/watering routine and troubleshooting is all managed by AI… Gardening isn’t a skill I care to aquire, I just want the herbs. I’ll often use it as a rubber duck to cover basic trouble shooting of my homelab, sometimes it figures out the problem, often it doesn’t but I’ll figure it out myself, keeping me off the forums.
Sure there is going to be shills screaming that their particular spanner cures cancer, or whatever, but the rest of us just use spanners and think/say nothing of it.
I’m sympathetic to the anti-capitalist arguments levied against AI, but only the anti-cap ones and only because they’re anti-cap. They’re right, capitalism does over exploit an environment causing climate change, droughts etd. They’re right, capitalism is unethical. They’re right capitalism does steal the value workers create. None of these problems are unique to AI (Nestle was stealing water long before AI), none of these problems are necessary for AI.
Ne, mi ankaŭ ne volis lerni esperanton.
I joke, it was fun, esperantists are good people. I did it to ‘cheat’ at being bi-lingual, I don’t think that was the best motivation. Toki pana would’ve been easier.
It’s a good list. You could put in a spoiler so it would be displayed collapsed by default.
I have cleanuparr, scanning qbit as well as a list. Not nearly as comprehensive as yours though.
I went rpi4>n100> a couple n100s and that pi> the dxp4800, I think it’s a pentium, and those n100s. I think I’m ok here, I have networking, compute + local backup, and storage all in their own box.
Besides, it’s just a good way of doing it. For the people that want to DIY: here’s the instructions. For people that just want the thing: here’s the payment instructions.
Sometimes I just want the thing.
I stuck a rPi in their houses that runs pihole+nginx+tailscale. As far as they’re concerned they go to https://jellyfin.example.domain/ and they’re there.
Better yet, they go to http://homarr.notlocal/ and they have nice little icons to click on, that take them to all the front-end services I run.
They get pihole goodness for free. Their homepage is attached to their pihole if they want to pause/stop it.
I’d like to set them up to be more declarative than I have, setup/updating is a pain. Nix is interesting but the learning curve is too steep for the effort I’m willing to put in. As per usual, being lazy will end up being more work for me in the long run.
They hate you coz they ain’t you. Keep posting.
While I voted green last election, I thought I could ignore politics for a while because no way could Labour be as bad as the Tories. Ah well, neo-libs are gonna neo-lib I guess.
I think that’s an acceptable price of being on the open and free internet.
Everything I do is in the open, and you are free to do as you wish with it. Likewise, everything you do is in the open and you accept, by being here, that I am free to do what I wish with it.
Defederation is likely what you’re looking for, find an instance that defederates GenAI friendly instances.
If the shooting was faked, I have no opinion whether or not it is, those statements would be something called a “double entendre”.
Whether or not it was faked, she knew it would happen, could think of the double, or just overheard someone else making the joke… All up for debate.
At the same time grains of sand becomes a heap.
Fine, I’ll be the low bar.
Proxmox, I just use the GUI to update
I use community-scripts almost exclusively. Community-scripts cron lxc updater does the heavy lifting. pct enter [lxc]
update
does a bunch of work too.
For Docker, I use a couple lxcs with Dockge on it, the “update” button takes me most of the rest of the way.
Finally, I have a couple remote machines [diet-pi]. I haven’t figured out updating over tailscale yet, so I just go round semi frequently for the apt update && apt upgrade -y
VMs get the apt update && apt upgrade -y too. I keep a bare bones mint VM as a virtual laptop, as I don’t have one. I’ll do what I need to do and if I had to install software I’ll just nuke the VM and go again from the bare bones template.
America is an evil oligarchy. Iran is an evil theocracy. The videos are still funny though.
You’re a LEG-END. Legend pronounced leg end.
Do you spend most of your time getting ideas and tips or executing them? Your hobby might be the gathering of tips and ideas. Want to spend less time on Reddit, spend more time executing the ideas and tips you’re gathering.
Your hobby might not have been doing the hobby. But, talking with people doing the hobby then. Less talk about doing the thing, more do the thing.
Example, one of my hobbies is motorcycles and the riding them. I have zero posts in r/motorcycle or c/motorcycles. Because I’m busy riding them and meeting people to ride them.
Enrichment. Take up a creative hobby. You don’t have to be good, just be creating stuff you want to create.
Music, food, plants, drawings, sculpture, journal, creative writing, exercise, knitting, flower pressing, dorodangos (literally polishing a ball of dirt). Be building something, you need enrichment. Learn to sing/instrument. Start a sourdough starter (why did sourdough become popular when we locked indoors? Enrichment). Get some pencils and scrap book. Start a indoor/outdoor garden.
Pick something appropriate to your time/budget. Time rich, money poor: pick something you can fuss over for a long time and is no more expensive than a pack of pencils. Time poor, money poor: Mediterranean herbs thrive on neglect, start a rosemary plant.
Sum total of my hardware:
Ugreen dxp 4800, the Pentium one. 32gb ram. My main box: jellyfin, arrs, immich, pihole, nginx, etc… It can’t go down. I don’t think I want an LLM here.
Beelink n100 16gb ram. Local back up, redundant pihole, immich machine learning… Generally under utilised, I’d like to move some services around, does proxmox have an auto balancer?!
Spare no name n100. 8, or 16gb, I can’t remember. Abandoned box, It’s what I would put the LLM on, I did have it reserved for a remote back up.
I think it would need a ram upgrade, see corporate AI pricing me out of personal computing. Currently Amazon has a Crucial 32gb ddr5 sodimm module for £280. Which is too high a price for what I’d use it for.
Oh, and I have an abandoned gaming rig with a gtx970, and some rPi0/3s
I’ve put Ollama on an n100 before. It obviously ate all of that box and made everything on it chug, and it was too slow for human use. But if it’s just generating logs, and resetting containers then I wouldn’t mind how slow it is.