• TheBlackLounge@lemmy.zip
    link
    fedilink
    English
    arrow-up
    2
    ·
    2 hours ago

    Lower temperature is not necessarily better quality. At 0 it will get very repetitive, it’s for classification tasks, not for prose.

    I suppose the optimal temperature depends on the model and the task, and I don’t think it’s very sensitive. Varying temp might even give better results, who knows.