ZILtoid1991@lemmy.world to 196@lemmy.blahaj.zoneEnglish · 17 days agoRule2346757123926472142107lemmy.worldimagemessage-square12fedilinkarrow-up1234
arrow-up1234imageRule2346757123926472142107lemmy.worldZILtoid1991@lemmy.world to 196@lemmy.blahaj.zoneEnglish · 17 days agomessage-square12fedilink
minus-squareWirlocke@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up1·edit-213 days agoLLMs don’t see numbers as numbers, they see them as tokens which is like a word or piece of a word. So “123456789” is like a single word to the LLM because it’s a common enough string of characters. This is also why they struggle with math.
LLMs don’t see numbers as numbers, they see them as tokens which is like a word or piece of a word.
So “123456789” is like a single word to the LLM because it’s a common enough string of characters. This is also why they struggle with math.