☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 2 days agoChina open-source AI models surpass 10 billion downloadsdailyittehad.com.pkexternal-linkmessage-square32fedilinkarrow-up177
arrow-up177external-linkChina open-source AI models surpass 10 billion downloadsdailyittehad.com.pk☆ Yσɠƚԋσʂ ☆@lemmy.ml to Technology@lemmy.mlEnglish · 2 days agomessage-square32fedilink
minus-square☆ Yσɠƚԋσʂ ☆@lemmy.mlOPlinkfedilinkarrow-up4·2 days agoI’m using 3.6 at 27bln and q8 on a M1 with 64gb.
I’m using 3.6 at 27bln and q8 on a M1 with 64gb.
What tps do you get on that?
Roghlt 10 to 13 tps give or take.