☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 23 days agoQwen 3.8 27B is excellent, but it defaults to wildly overthinking thingssimonwillison.netexternal-linkmessage-square16fedilinkarrow-up139cross-posted to: Aii@programming.dev
arrow-up139external-linkQwen 3.8 27B is excellent, but it defaults to wildly overthinking thingssimonwillison.net☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 23 days agomessage-square16fedilinkcross-posted to: Aii@programming.dev
minus-squaremarcie (she/her)@lemmy.mllinkfedilinkarrow-up4·21 days agoI’ve got it running on 12gb at lowest quant at a decent speed, like 30toks
minus-square☆ Yσɠƚԋσʂ ☆@lemmy.mlOPlinkfedilinkarrow-up2·21 days agoHow’s the output quality on the lowest quant?
I’ve got it running on 12gb at lowest quant at a decent speed, like 30toks
How’s the output quality on the lowest quant?