It’s because of how token streaming works. As the reply comes, it generates token after token. Then it uses those in the next token generation. It sees the previous one and associates it with “wrong” then it generates the “correction” tokens. I see this all the time at my work when it goes down the wrong path before correcting itself.
We have an AI at work and it just loves to type “The”, and then stop for a while it think about it, and then finishes the sentence. It’s never any other word, every response always begins with the, if you ask it questions which don’t require any response to begin with the, you get very weird responses. I’ve never seen delete the before, it just yolo’s it.
It’s because of how token streaming works. As the reply comes, it generates token after token. Then it uses those in the next token generation. It sees the previous one and associates it with “wrong” then it generates the “correction” tokens. I see this all the time at my work when it goes down the wrong path before correcting itself.
We have an AI at work and it just loves to type “The”, and then stop for a while it think about it, and then finishes the sentence. It’s never any other word, every response always begins with the, if you ask it questions which don’t require any response to begin with the, you get very weird responses. I’ve never seen delete the before, it just yolo’s it.
I once got back a response along the lines of:
The different accounts do not sync together. …
Which is just grammatically awkward.