• fartsparkles@lemmy.world
    link
    fedilink
    English
    arrow-up
    12
    ·
    23 hours ago

    It seems to have been a plan for a long time, given their huge shift to unified memory architectures across most of their hardware.

    They’re pretty much the only vendor where you can cost-effectively deploy a foundational LLM locally.

    • eleitl@lemmy.zip
      link
      fedilink
      English
      arrow-up
      2
      ·
      14 hours ago

      Still nobody build a unified memory model with HBM. I would buy Apple hardware, then. If I can put Linux on it.

      Perhaps I can buy a used Instict with generics science acceleration, once the smoke clears. And add a couple solar kWp to my capacity.

    • eicker@lemmy.worldOP
      link
      fedilink
      English
      arrow-up
      5
      ·
      23 hours ago

      It would seem so. On the other hand, it is puzzling that they did not also allocate the necessary resources to the development of LLMs. 🤷