In the next ~6 months I’m going to entirely overhaul my setup. Today I have a NUC6i3 running Home Assistant OS, and a NUC8i7 running OpenMediaVault with all the usual suspects via Docker.
I want to upgrade hardware significantly, partially because I’d like to bring in some local LLM. Nothing crazy, 1-8B models hitting 50tps would make me happy. But even that is going to mean a beefy machine compared to today, which will be nice for everything else too of course.
I’m still all over the place on hardware, part of what I’m trying to decide is whether to go with a single machine for everything or keep them separate.
Idea 1 is a beefy machine and Proxmox with HA in a VM, OMV or TrueNAS in another, and maybe a 3rd straight Debian to separate all the Docker stuff. But I don’t know if I want to add the complexity.
Idea 2 would be beefy machine for straight OMV/TrueNAS and run most stuff there, and then just move HA over to the existing i7 for more breathing room (mostly for Frigate, which could also separate to other machine I guess).
I hear a lot of great things about Proxmox, but I’m not sold that it’s worth the new complexity for me. And keeping HA (which is “critical” compared to everything else) separated feels like a smart choice. But keeping it on aging hardware diminishes that anyway, so I don’t know.
Just wanting to hear various opinions I guess.
Not sure what youre doing with OMV that couldn’t be done in proxmox, so feel free to elaborate there.
Almost all my servers are proxmox (some just Debian, though a few more specific work related solutions are lurking about). For docker I’d do an LXC, btw, I wouldn’t bother with a full VM.
My (excessive) setup is all proxmox, set up as a high availability cluster. HA runs in a VM, and my USB devices are passed through (technically its USB over IP extension, so the USB devices for various VMs continually pass through even if I have to shut a server down).
Its where Jellyfin, Audiobookshelf, homepage.dev, a bajillion stupid containers I mostly dont need, DNS, monitoring and analytics, mealie (recipe server), various websites I host, etc, etc all live. Nothing is by itself on a box except my workstations, but for non-linux use I have VMs I remote into (mostly industry specific software and random crap like an xp VM to use an old piece of hardware).
Can you quickly run me through how USB over IP is helping you out? I get it for devices that are physically distant, but how is the abstraction helping you for reboots? Isn’t it just the server you’re rebooting that talks to the USB device anyway?
I have a single.ip transmitter and multiple receivers, IP controllable and routable.
If VM1 uses USB device1 on RX1 from tx1, and host1 goes down, when VM1 is going to be run on host2, rx2 is switched as the receive from tx1, and VM1 still has access to the USB device.
For the record, icron 2304s I got because of work stuff (that accepts commands, which are the version they only oem now).
Ah, got it, it’s for VM migrations. That makes a lot more sense.
Ah yeah, sorry, didnt realize that wasn’t clear.
Only one machine at a time handles USB devices by design - OTA TV tuner, zigbee/zwave, USB to serial adapter, and an 8 channel relay.