• BlackLaZoR@lemmy.world
    link
    fedilink
    English
    arrow-up
    2
    ·
    8 hours ago

    does it give the full history to the LLM each time?

    It’s limited to the context size supported by given model. You can give the model 100k tokens of history but if it’s configured for less, it will just truncate it before processing (usually by removing oldest tokens first)