Both Ubuntu and Fedora have made it official: support is coming soon for running local generative AI instances.
An epic and still-growing thread in the Fedora forums states one of the goals for the next version: the Fedora AI Developer Desktop Objective. It is causing some discontent, and at least one Fedora contributor, SUSE’s Fernando Mancera, has resigned.
I mean if it’s completely optional and opt-in, sure go for it. Knock yourself out. I won’t be using it (my computer isn’t powerful enough to run local LLMs)
SUSE contributes to Fedora? WTF?
Someone from SUSE used to contribute to Fedora
lol they already support running local models. wtf is the distro gonna do…? pre-install llama.cpp? this is so silly to me that people are resigning over this, too.
Is that the one that really whips the llama.cpp’s ass?
Now I have to install winamp and get a bunch of sick skins for it.
They’re discussing a new spin specifically for AI developers, not changing existing distros to include new stuff.
CTFD
Oh good. We can all just ignore the AI version then?
Well, we get to slam it and heckle its users, because, well, we need SOME joy in The world…
No we can’t, we must be mad, because “AI”
Yes
Shame
Shaame!
I don’t really understand the point? You can already do a lot on Linux using AI via CLI with bash.
I don’t really understand the point?
Correct: you don’t. I’m basing this only off what you wrote, but I’m reasonably confident of my answer. Glad I could answer the question as asked.
Soooo, which distro to switch to next? Or are they all gonna go down this route eventually? Maybe I’ll try a *BSD for once.
Debian or anything based directly on it
Debian or anything based directly on it
Debian can also run AI models. Pretty dumb reason to get mad about.
Every linux distro can run AI models, there is 0 reason to support distros that ship with AI bullshit by default
pretty much anything that is “you build it youself” so Arch, NixOS, Gentoo, etc
but yeah I’m also tempted to finally give BSD a go.
I switched from Kubuntu to CachyOS last week, after 10 years or so. CachyOS is based on Arch, and did not disappoint so far, extremely fast, makes Ubuntu look old and sluggish. It’s really impressive. The basic installation was easy. The GUI package manager isn’t as polished but works. A little bit of terminal tweaking was required to install some packages (VMM and KRDC gave me some trouble) but the documentation was ok. Absolutely can recommend.
Cachy is a nice mix of latest and stable. Still recommend Debian for work, but Cachy is great if you want something that just works
I’ve used PikaOS which is Debian based and IMHO it’s right up there with CachyOS. super fast install, fast distro, great package manager, and repos with the latest stuff. very stable too.
