• criss_cross@lemmy.world
    link
    fedilink
    English
    arrow-up
    1
    ·
    2 hours ago

    Yeah pretty much. Tokens are how models parse sentences.

    It’s a wonky thing to charge by because each model tokenizes sentences differently. A sentence that would be 10 tokens in Claude can be 15 in OpenAI.

    It’s why it’s crazy to try and charge by it and track employee usage by it.