Apple has new Mac app coming to make running local AI models easy - 9to5Mac
9to5mac.com
Leaker Aaron Perris has discovered evidence of a new Mac app in the works at Apple that makes it easy to run local AI models.
  • Cardiac@lemmy.mlEnglish
    8·
    3 days ago

    Dynamic pooling could make this more accessible to lower power macs.

    Are there other handlers that can bundle computers into a local Ai instance in a similar manner?

    • setsubyou@lemmy.worldEnglish
      1·
      3 days ago

      I guess vLLM supports clusters so you could just use that? The setup is more difficult than just plugging in a cable though.