• i_am_not_a_robot@discuss.tchncs.de
    link
    fedilink
    English
    arrow-up
    4
    ·
    11 hours ago

    Who is downloading these? I thought I would try out the new GLM before it becomes illegal, but these new models require 256GB RAM to run even the scaled down versions. I thought my PC I bought just before hardware prices went crazy was excessive but it only has 128GB. You’re looking at spending over 5000 dollars on a PC that can just barely fit one AI model and only until they make new ones that need 384GB.

    • ☆ Yσɠƚԋσʂ ☆@lemmy.mlOP
      link
      fedilink
      arrow-up
      7
      ·
      11 hours ago

      There are smaller models like Qwen 3.6 27b that can run with as low ast 16gb VRAM. The larger models are largely used either by companies running them on prem, or research institutions.