Do you host your own ML / AI / LLM? What do you use, and what do you use it for?

  • SuspiciousCarrot78@aussie.zoneOP
    link
    fedilink
    English
    arrow-up
    1
    ·
    3 hours ago

    Yeah. Though I think theres a new strix out soon (Medusa? Gorgon? Something like that).

    Its a bit like my P40. On paper, it has 24GB. But that 24gb is capped at 400GB/s and the ai compute is what…Pascal era?

    AI = Good, fast, cheap - pick 2