• Not_mikey@lemmy.dbzer0.com
    link
    fedilink
    English
    arrow-up
    3
    ·
    7 hours ago

    Can you reasonably train a local model? Inference is one thing and can be run on a decent gaming graphics card but training requires a lot more compute.

    • Dran@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 hours ago

      You can absolutely train a nontrivial task model on a gaming gpu (image classifier, sound classifier, text model with a very structured input and output, etc). You can also post-train addon layers on top of existing open-weight models (LORA).

    • frongt@lemmy.zip
      link
      fedilink
      English
      arrow-up
      3
      ·
      6 hours ago

      Depends on the size of the training data, how big the resulting model is, and how fast you want it to finish.