• Axolotl@feddit.it
    link
    fedilink
    arrow-up
    1
    ·
    edit-2
    2 days ago

    It would be better if the damn LLM was local, i tried to do it on a crappy 300€ phone, it worked, the LLM was one of those stupid ones but it did a deceny job for a 300€ phone, so i can guess that with flagships it would be good, heck, if we had a processing unit dedicated to LLM stuff it wouldn’t be that bad probably