Lower temperature is not necessarily better quality. At 0 it will get very repetitive, it’s for classification tasks, not for prose.
I suppose the optimal temperature depends on the model and the task, and I don’t think it’s very sensitive. Varying temp might even give better results, who knows.
Lower temperature is not necessarily better quality. At 0 it will get very repetitive, it’s for classification tasks, not for prose.
I suppose the optimal temperature depends on the model and the task, and I don’t think it’s very sensitive. Varying temp might even give better results, who knows.