ZILtoid1991@lemmy.world to 196@lemmy.blahaj.zoneEnglish · 2 months agoRule2346757123926472142107lemmy.worldimagemessage-square12fedilinkarrow-up1235
arrow-up1235imageRule2346757123926472142107lemmy.worldZILtoid1991@lemmy.world to 196@lemmy.blahaj.zoneEnglish · 2 months agomessage-square12fedilink
minus-squareWirlocke@lemmy.blahaj.zonelinkfedilinkEnglisharrow-up2·edit-22 months agoLLMs don’t see numbers as numbers, they see them as tokens which is like a word or piece of a word. So “123456789” is like a single word to the LLM because it’s a common enough string of characters. This is also why they struggle with math.
LLMs don’t see numbers as numbers, they see them as tokens which is like a word or piece of a word.
So “123456789” is like a single word to the LLM because it’s a common enough string of characters. This is also why they struggle with math.