No errors and I have separate local backup server with spinning drives too which works just fine. Local backup server has ~5,7TB of data and verifications complete in about 5,5 hours. Actual (incremental) backups to S3 take about two hours with that ~2TB on VMs which seems decent enough.
I’m using OVH, not AWS. Their console gives estimation of ~20€/month for the ~2TB I have stored. Versioning is disabled and i’m currently runnign on their signup offer of 200€ credit, so I’m good to go for few weeks more. The storage I’m using includes the traffic, it’s just practically unusable due to verification speeds.
Local server has SSDs with zfs and well enough memory for arc.
150W or so for the main server now that I upgraded it to full SSD setup. Maybe a bit more when under heavier load. Another maybe 100W for router, main switch, frigate-server and other bits and bobs with full load. And then backup server with 4 spinning drives another maybe 150W. Haven’t really measured anything, just ballbark figures.
So around 500W total. But I’ve got electric heating anyways and hobbies tend to cost something.
really helps for that antenna to be on the 2nd floor, in a window, with clear view unobstructed by aluminum siding.
It’s on a roof already and quite capable of receiving signal, we just haven’t used OTA broadcasts for a while as IPTV used to work good enough. So no problems with the antenna, I’m just wondering what I should plug in to that.
Hardware is too wide to tell anything useful out of the blue, depends on what you can get your hands on (as in what’s available locally) and what you actually want to run. Used corporate desktop might be fine, raspberry pi might be good too, mini-pcs are popular and so on. All have their pros and cons.
For the OS proxmox is a solid choise. It has both containers and ‘full’ virtual machines as an option. Debian is good too.
And for the utilities, build something you actually want to use. Pihole is pretty nice. Gaming severs are good to practise with if you’re into that stuff. But if you just build stuff for the sake of it you’ll of course learn on the way but it leaves very little to actually enjoy on what you’ve built.
I really like my immich and nextcloud servers and they’re well worth my time to keep up and running. But with those there’s additional challenge to keep them backed up. Losing pihole server wouldn’t be that bad, it’s easy enough to rebuild, but losing a terabyte of photos is a bit another thing.
And that’s exactly why it’s called Krita. Also it was previously called ‘Krayon’, so they just kind of kept the name.
I haven’t really paid attention on prosumer-hardware lately as my RB4011iGS+RM just keeps on working. 6 watts is really low tho, according to spec sheet my router pulls 18W 24VDC. Few links I checked from your original post however give 15W TDP, so maybe some seller is pulling numbers out of their sleeve or there’s differences between models. Either way, those are pretty damn efficient boxes.
With that celeron CPU I think they have less troughput than what I’m running, but if your internet connection isn’t several hundred megabits I don’t think that’ll be an issue. I had issues with some edgerouter, while it claimed to do full gigabit in practise it managed only up to ~700Mbps and even less than that with even slightly complicated routing.
I don’t have any direct recommendations, but I’d stay away from TP-Link and other budget brands which often promise a lot more than they can actually deliver. My switches are from HPE and they are pretty cheap second hand (or even free if you happen to stumble in a office renewal somewhere).
In most common case you can think VLANs at the firewall end like whole different physical networks. On port LAN1 you have a switch and whatever else you happen to have, on LAN2 similar setup and so on. All the networks can (and should) have their own IP range and it’s the firewall who decides what traffic is allowed, like is a machine in LAN1 allowed to talk with printer on LAN2.
Virtual LAN just bundles that all to one set of cables and network devices with the obvious benefit that you can have benefits of multiple networks for security, access control or whatever but you don’t need extra hardware for each setup. In theory it is possible to break out of VLAN separation, but in practice it’s really not something a home gamer should worry about too much.
What you need is a managed switch (or multiple if needed) so that you can assign ports to different VLANs or a combination of many VLANs in a single port, commonly known as trunk. Some unmanaged switches pass trough VLAN frames as is, but it’s not guaranteed, so safe bet is to get only managed switches.
For the firewall/router, the best option would be to either drop the ISP router totally or if possible use bridged port on it so that you can get ‘raw’ internet to your own device. You can make it work with ‘LAN’ port on your current router too, there’s just one set of port forwarding and firewall rules extra to manage before anything even hits your own network. Instead of firewall PC I’d recommend an actual router. They are often more suited to the task, are physically smaller and tend to consume less energy. Also dedicated firewall/routers are often a bit cheaper (at least less than 600$, I paid ~150€ for my router). I personally have a Mikrotik device and I like it, but there’s plenty decent ones to choose from. PC will work as well, but they tend to have more potentially failing components than dedicated routers.
But in general, at least I can’t see anything fundamentally wrong with your plan. Remember to have fun while setting it up.
Fixed headaches with my proxmox backup server. It has a SAS-controller and 4 spinning drives running backups at detached garage and the old fujitsu desktop I dug out of office dumpster pile just kept crashing. Flashed controller to IT-firmware, updated bios on motherboard and did everything else I could figure out but the system just lost the drives pretty much daily and required a hard reset. Turns out, or at least that’s my conclusion, that the PSU on the machine just didn’t have enough juice for the whole setup and that caused instability. I dug out old (2010 or so) desktop from my own pile and threw 600W PSU on the box, it’s now been stable for at least a week.
I would’ve liked to keep the fujitsu-machine as it’s in a more compact case and couple of generations newer CPU, but that thing has propietary power supply so it was easier to swap out the whole system and just move drives from one to another. So, the current setup consumes maybe a bit more electricity, but at least it’s doing what it is supposed to.
Also known as Schrödinger’s Backup.
Zfs can become painfully slow if you don’t have RAM for it. I tried to run ZFS on my old setup with 64GB RAM and with moderate amount of virtual hosts and it was nearly useless with heavier io-loads. I didn’t try to tweak settings for it, so there might be some workarounds to make it work better, I just repartitioned all the storage drives with mdadm raid5 array and lvm-thin on top of that. Zfs will work with limited memory in a sense that you don’t risk losing data because of it, but as mentioned, performance might drop significantly. Now that I have a system which has memory to run raidz2 it’s pretty damn good, but with limited hardware I would not recommend it.
LVM itself is pretty trivial to move on a another system, most modern kernels just autodetect volume groups and you can use them as any normal filesystem. If you move full, intact, mdadm array to a new system (and have necessary utils installed) it should be autodetected too, but specially with degraded array manual reassembly might be needed. I don’t know what kind of issues you’ve been getting, but in general moving both lvm and mdadm drives between systems is pretty painless. Instead of mdadm you could also run lvm-mirroring on the drives so it’ll drop one layer off from your setup and it potentially makes rebuilding the array a bit simpler on another system, but neither approach should prevent moving drives to another host.
Lvm-thin is more flexible and while it might be a slightly slower on some scenarios I’d still recommend using that. Maybe the biggest benefit you’ll get from it is an option to take snapshots from VMs. Mounting plain directories will work too, but if your storage is only used by proxmox I don’t see any point in that over LVM setup.
For whatever reason ISPs tend (at least in here) to be pretty bad at keeping their DNS services up and running and that could cause issues you’re having. Easy test is to switch your laptop DNS servers to cloudflare (1.1.1.1, 1.0.0.1) or opendns (208.67.222.222, 208.67.220.220) and see if the problem goes away. Or even faster by doing single queries from terminal, like ‘dig a google.com @1.1.1.1’.
If that helps you can change your router WAN DNS server to something than what operator offers you via DHCP. I personally use opendns servers, but cloudflare or google (8.8.8.8, 8.8.4.4) are common pretty decent choices too.
Depends on what you’re looking for, but for server use even a bit older hardware is just fine. My proxmox server has Xeon 2620v3 CPU and it’s plenty for my needs. For storage I went with SAS-controller, controllers are relatively cheap and if you happen to have a friend in some IT department you might get lucky when they replace hardware. RAM is a pain in the rear, but 8GB DDR4 rdimms work still just fine (if someone is interested I have few around)
Personally I wouldn’t pay current prices for new hardware, specially if it’s for hosting. A bit older, but server rated, components give a lot more value for your money.
This, in turn, is different from APT, which is not Debian’s repository, but Debian’s package manager. So, technically, I could write “sudo apt install (anything)” to get any piece of software from Debian’s repository indeed, but I could also use that command to get software from somewhere else also in the form of a Deb package but which would not have come from Debian itself.
With apt (and discover which uses apt/dpkg at the background) you can install anything from repositories configured on your system. So, if you want to use apt to install packages not built by Debian team you’ll need to add those repositories in your system, so they don’t just appear out of nothing.
Some software vendors offers .deb packages you can install which then add their own repository on your system and then you can ‘apt install’ their product just like you would on native Debian software and the same upgrade process which keeps your system up to date will include that ‘3rd party’ software as well. Also some offer instructions on how to add their repository manually, but with a downloaded .deb it might be a bit easier to add repository without really paying attention to it.
Spotify is one of the big vendors who have their own repository for Debian and Ubuntu and with Ubuntu there’s “ppa” repositories, which are basically just random individuals offering their packages for everyone to use and they are generally not going trough the same scrutiny than official repositories.
the joke was that in the USA you can be multi millionaire+ wealthy and pay 0% tax
That is the actual joke here, agreed. If, and that’s a pretty damn big if, there was any sense on USA government they could just take our progressive steps and leave everything above 35% away from it and still have a crapload of budget to actually make their country great again.
But spending 100 million bucks per hour to demolish schools half way across the world is cool too I guess.
You don’t need to be Elon-wealthy to get those percentages. Over 500 000€/year salary gives you nice 50% tax bracket. You absolutely are not poor if your taxes are that high, but you don’t need to be CEO of Google either.
No deduplication, encryption nor support for non-linux operating systems for a start.
There’s also
--delete-beforewhich might help if your destination is tight on available space. And, as usual with ‘traditional’ tools, man-page is pretty good, there’s a ton of parameters which might be helpful. And, as @hades@feddit.uk already mentioned, compression (-z) may actually hurt performance if you have a lot of bandwidth or if you’re copying over already compressed data like JPGs.