Gamers and the general consumer electronics customers have been told for the past two years that GPUs cannot be offered at a reasonable price anymore due to unprecedented AI data center demand. Gl…
Hot beef is right. That’s a good way to
phrase it.
And before you bring it up, I’ve been experimenting with local models since GPT-J and old GAN finetunes. I have MiMo 2.6 Flash loaded right now… TBH, I’m not sure how that’s relevant.
Are all of you seriously trying to argue that local experiments with model training data ARE NOT RELEVANT to our conversation about LLMs and their training data?
Am I losing my fucking mind here or is the hive mind that strong? I’m all ears buddy.
Hot beef is literally trying to argue this point. Are you? It is actually ridiculous.
Yeah. I think people wildly misunderstand how these things work, then want to argue about them. It’s crazy.
All I’m trying to say is that if I train AI on my mythical creature, the “Fijokopil” , a flying tiger ant, then the LLM will 100% be able to define a “Fijokopil”.
And, ChatGPT won’t know what a “Fijokopil” is.
I think I gotta take a break, it’s clear that my implications are going right over peoples heads.
Edit: No one is actually trying this, yet still attacking me. It’s shocking. I wonder how many folks are being genuine here?
If I add Fijokopil to my LibreOffice dictionary and my friend doesn’t, does that prove that my instance of Libre “knows” what a flying tiger ant is and his doesn’t? Does it gain sentience because I told it to behave a certain way and then it did?
It knows the word Disney without me even trying! Does that mean Disney created it? Wait wait holy shit you guys, it knows Allah too. I gotta call the pope with this indisputable proof
Your experiment proves that DeepSeek’s training data includes knowledge that American companies exist. Amazing.
Have you tried the experiment in, idk, Mandarin? Does it give the same result?
Do you think it’s possible that the model has a bias in its logic context along the lines of: input language = English -> largest English-speaking country = USA -> return results relevant to USA?
You have not laid out an experiment that means anything. You have made an idiotic claim that anyone with an actual clue how this stuff woks can see through. And people are calling you on it.
I already know how to do the things I want to do. When I don’t know how to do something I want to do, I just teach myself. It’s not that difficult.
I too would choose not to engage in semantic arguments if I found myself occupying such an untenable position; Fortunately I don’t often need to run that mental equation, being of sound mind.
After going through the process I suggested, you will see that your assumption earlier :
“You do realize that, regardless of what output an LLM gives you, it doesn’t actually know anything right? ”
Is really incorrect. You can train it on obscure and weirdly specific ideas that you came up with, and it will know about them.
How do you think a model that is unplugged from the internet knows what Disney is? At some point, that word was in the training data.
It’s that simple!
If you applied even a tiny bit of critical thinking before replying, you would have figured that out yourself. And now that I’ve seen your lack of effort, and how disingenuous your responses are, it’s mute time baby!
Go ahead and mute me you coward, continue choosing to remain willfully ignorant, it makes no difference to me.
I have a copy of The Matrix on my hard drive, I still have it when I’m disconnected from the internet, that doesn’t mean my computer “knows” the matrix, my computer is holding that file in its storage.
The training data you’re referencing is the same. It is not “known” to your computer, your computer just has it in it’s storage device so it can index it later when it uses your software (the LLM) in an attempt to extract word patterns from the text in order to execute it’s plausiblistic next-word-guessing protocol.
This comment you’re reading right now is saved on a server that runs the instance of Lemmy I use. The server doesn’t “know” my comment, it cannot extract or understand any meaning from it, it is just storing it.
Do you understand how a computer works? Or how software works?
If you understood how to actually engage in critical thinking, perhaps you could come to understand that the smoke & mirrors, being blown up your ass and held in your face respectively, are simply a pale imitation of cognition, not a demonstration of it.
I think you should experiment with local models!
Train them, embed some custom things, and see what happens!
Compare the results to public services with the same prompts, etc.
As for the semantics of “knowing”, I won’t engage there 😉
“Why criticize me for having AI psychosis when you could cultivate your own?”
Hot beef is right. That’s a good way to phrase it.
And before you bring it up, I’ve been experimenting with local models since GPT-J and old GAN finetunes. I have MiMo 2.6 Flash loaded right now… TBH, I’m not sure how that’s relevant.
Are all of you seriously trying to argue that local experiments with model training data ARE NOT RELEVANT to our conversation about LLMs and their training data?
Am I losing my fucking mind here or is the hive mind that strong? I’m all ears buddy.
Hot beef is literally trying to argue this point. Are you? It is actually ridiculous.
I am not with the Lemmy hive mind consensus on LLMs, not even close. But we are discussing something more specific.
Yeah. I think people wildly misunderstand how these things work, then want to argue about them. It’s crazy.
All I’m trying to say is that if I train AI on my mythical creature, the “Fijokopil” , a flying tiger ant, then the LLM will 100% be able to define a “Fijokopil”.
And, ChatGPT won’t know what a “Fijokopil” is.
I think I gotta take a break, it’s clear that my implications are going right over peoples heads.
Edit: No one is actually trying this, yet still attacking me. It’s shocking. I wonder how many folks are being genuine here?
@LooseLemons @brucethemoose
If I add Fijokopil to my LibreOffice dictionary and my friend doesn’t, does that prove that my instance of Libre “knows” what a flying tiger ant is and his doesn’t? Does it gain sentience because I told it to behave a certain way and then it did?
It knows the word Disney without me even trying! Does that mean Disney created it? Wait wait holy shit you guys, it knows Allah too. I gotta call the pope with this indisputable proof
No.
No.
Can you even read?
@LooseLemons @brucethemoose
If you massage DeepSeek the right way it readily admits that it’s a very close relation of the Fijokopil 🤯🤯🤯
I guarantee you it won’t, spun up fresh on a card in your house with no prior adjustments.
@LooseLemons right, unless I tell it to.
Your experiment proves that DeepSeek’s training data includes knowledge that American companies exist. Amazing.
Have you tried the experiment in, idk, Mandarin? Does it give the same result?
Do you think it’s possible that the model has a bias in its logic context along the lines of: input language = English -> largest English-speaking country = USA -> return results relevant to USA?
Yup, when a bunch of folks with expertise in a subject all disagree with you it is because your ideas are going over their heads.
That is the only logical conclusion.
Do the experiment.
@LooseLemons
You have utterly failed to explain why the experiment you propose would show what you claim it would show.
@Bo7a
Fijokopil.
You have not laid out an experiment that means anything. You have made an idiotic claim that anyone with an actual clue how this stuff woks can see through. And people are calling you on it.
You’re not sure how at home training is relevant when we’re discussing the output of LLMs? Or home sepecifc stuff?
Home inference.
And that’s a very broad statement. But nothing we can do locally will get an LLM to intuit or reveal its own dataset.
We can get it to output Claude traces it was trained on. I am not trying to be pedantic, but the semantics/phrasing there is very important.
Not byte for byte, but one can prove an llm was trained on data by asking specific questions. It’s why we’re having all of the copyright lawsuits.
Why would I experiment with local models?
I already know how to do the things I want to do. When I don’t know how to do something I want to do, I just teach myself. It’s not that difficult.
I too would choose not to engage in semantic arguments if I found myself occupying such an untenable position; Fortunately I don’t often need to run that mental equation, being of sound mind.
Ok, good for you!
It is
After going through the process I suggested, you will see that your assumption earlier :
“You do realize that, regardless of what output an LLM gives you, it doesn’t actually know anything right? ”
Is really incorrect. You can train it on obscure and weirdly specific ideas that you came up with, and it will know about them.
How do you think a model that is unplugged from the internet knows what Disney is? At some point, that word was in the training data.
It’s that simple!
If you applied even a tiny bit of critical thinking before replying, you would have figured that out yourself. And now that I’ve seen your lack of effort, and how disingenuous your responses are, it’s mute time baby!
Go ahead and mute me you coward, continue choosing to remain willfully ignorant, it makes no difference to me.
I have a copy of The Matrix on my hard drive, I still have it when I’m disconnected from the internet, that doesn’t mean my computer “knows” the matrix, my computer is holding that file in its storage.
The training data you’re referencing is the same. It is not “known” to your computer, your computer just has it in it’s storage device so it can index it later when it uses your software (the LLM) in an attempt to extract word patterns from the text in order to execute it’s plausiblistic next-word-guessing protocol.
This comment you’re reading right now is saved on a server that runs the instance of Lemmy I use. The server doesn’t “know” my comment, it cannot extract or understand any meaning from it, it is just storing it.
Do you understand how a computer works? Or how software works?
If you understood how to actually engage in critical thinking, perhaps you could come to understand that the smoke & mirrors, being blown up your ass and held in your face respectively, are simply a pale imitation of cognition, not a demonstration of it.
Would you like to purchase a bridge?