• Ardyssian@sh.itjust.works
    link
    fedilink
    English
    arrow-up
    1
    ·
    7 hours ago

    If I may ask, which Quantisation are you running it on? I’m on an Apple setup with oMLX and am still experimenting with finding the right balance