I’ll wait a few months and then check in again.

It stores all metadata in YAML frontmatter and doesn’t cache in an SQLite blob? I bet that decision will be reversed pretty quickly once people try to migrate a 10k+ note collection and want to do operations like search immediately instead of scanning every file to build an in-memory cache.

Still on Microslop Github getting copilot PRs eh?

Thank you. That’s good to know.

Thanks for the response. It’s interesting to read about the experience of others.

Hardly impressive. X. Org isn’t even maintained anymore, is it?

That’s definitely not my level of disposable wealth/income. I can barely afford one card.

Oh nice. Does that depend on just the model or are there other requirements like CUDA or something?

How do you now run out of RAM? Does it offload to system RAM?

Thank you for that writeup.

Do you know how important the parameter size is? 12b, 24b, 128b, etc. Does it really improve performance or is it like megapixels in a camera: more megapixels don’t necessarily mean a better picture?

And what’s “quantisation”. Context compression or something?

I’ve been considering buying a better card to test models (also want to be personally sovereign), but NVIDIA on linux gives me the jeebies and, last i checked, AMD hasn’t released anything with more than 20GB in a while. In fact, figuring out hardware requirements has been tough and I’m considering just riding this whole thing out. Maybe the bubble will collapse and bring prices down to something reasonable.

What’s the quality of the answers though? And how much context can it hold? I imagine it’s only good for small, short questions, but have no concept of what is needed for that.

I’m assuming you’re using a 12b or 24b qwen model. The ones from deepseek go up to hundreds of billions of params and I can’t tell if bigger number is better or just meaningless posturing.

How many GPUs do you even need to have a usable, self-hosted AI? It looks like he has 6 on his rig. Probably each costs 2k or something. That’s not peanuts. I have a 12GB VRAM card. It probably can’t generate anything in any meaningful amount of time. Which brings me to the question: who is this for?

Regardless, impressive what he vibe-coded there.

WERO might be the EU alternative.

The vocal fry made that video unwatchable, jfk. I think the video is about financial censorship. They have been warning about this for more than a decade now, but most recently Trump issued an executive order to force payment providers to keep customers despite religious or political beliefs (article by yahoo finance).

Screenshots would be good…

ITT entitled people, who would never pay a single cent for rsync nor ever contribute to it, having a big mouth about it.

Also the analogy is crap. It’s free soup on somebody’s compound that anybody can walk in and take at their own accord. People walk in, take it, build a business or dependency around it, and get pissy when the recipe changes. They don’t want to take the recipe and fix it themselves, instead they demand the cook change it for them. “My customers are unhappy with the soup you make in your backyard”. The cook is well in his right to tell them to fuck off.

Phoronix commentors are going to be fuming at this news. And C programmers who don’t want to learn Rust won’t like it much either.

I dunno where you are but China has quite a negative image in Europe. Most people aren’t even aware that Tiktok is Chinese (well, maybe not anymore after the hostile Trump takeover). Besides that, I don’t know anything positive about China being shown here. No movies, series,… maybe Chinese tech like solar panels and stuff, but that’s not media.

Where are you seeing Chinese marketing and ads?

Gotcha, sorry didn’t understand that. In the code that I’ve seen so far, there has been no license. Everything was handled in the contract. “Everything you touch is owned by us, all code you write for this project is owned by us, and if you leak it or show it to a third parry without our consent, we have you by the balls”. Pretty much been my experience.

Sometimes there’s been a short header in every file “This code is copyrighted and owned by $Company”.

I see. Yeah, that was discontinued. The maintainers didn’t have time for it.

Do you live in the basement?