Nlnet is a non profit which takes ngi money and handles the bureaucracy for the Foss contributors

Ye pretty much. I was just quite astounded at that statement as the AI Horde is basically just a lot of python processes behind a very low powered haproxy server.

Personally, I understand people like to stay with the familiar, which is perfectly fine for a non-demanding service, but when something becomes demanding, I find the haproxy specialization serves better. I wish lemmy deployment by default utilized haproxy myself.

Not sure why you say haproxy can’t serve python. I do it all the time. You just use something like python waitress and then point haproxy to it’s port.

You give money to centralized monopolistic capitalists regardless what you do

People buy GPUs already for video games and other purposes. We’re using the same consumer cards, not enterprise ones.

Me: “The system works exactly as advertised for thousands of people”

You, a wise person: “The system doesn’t work as advertised because not everyone in the world is using it.”

You’re a very unserious person, so I won’t engage further with this nonsense.

But I see the same problems as with email, chat etc. You can selfhost almost everything. But too few people are doing it. You can use Linux as your Desktop and at least 4% are doing it. Still too few if you ask me.

The system is explicitly setup so that normal people don’t need to set up anything. Experts and enthusiasts are the one doing the complex work, while normies just use a simply client like this and power users can also use more advanced clients.

And if most of the people keep using the commercial and closed source options over the self hosted one, then I see this concentration of power.

That’s up to all of us to counter by promoting the good solutions instead, not of just despairing and begging politicians to fix this (they won’t, they’ll promote monopolies instead)

This is not theoretical. It already is in place and is already serving people. The only reason it’s not growing more is because we don’t have any marketing and we don’t participate in the capitalist rot economy.

And self hosting requires money and skill. This means there is a lot of people who lack both and may then use closed source models.

This is what we’ve mostly to solved with the AI Horde, where we allow people to rely on self-hosted open models.

The concentration of power part is not true unless people keep trying to use copyrights and the legal system to protect themselves from genai, at which point it will be true. Currently there’s plenty of self hosted solutions like stable diffusion and services like the ai horde to help even people without gpu for free

Any time I see a grognard seriously suggest going back to bash for anything exceeding 10 lines of code it makes me very happy none of them are in control.