• eicker@lemmy.world
    link
    fedilink
    English
    arrow-up
    67
    ·
    22 hours ago

    We are repeating an old pattern in computing: throw more hardware at the problem until efficiency becomes impossible to ignore. Bigger models have delivered remarkable gains, but they’re increasingly expensive. The next breakthroughs may come less from adding parameters and more from smarter architectures, better algorithms and more efficient inference.

    • JustDorky@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 hours ago

      That’s literally exactly what Chinese researchers are doing at DeepSeek and they’ve built frontier models with that philosophy

    • Rothe@piefed.social
      link
      fedilink
      English
      arrow-up
      15
      ·
      12 hours ago

      Except there likely won’t be a lot of further breakthroughs if we burn down our planet faster than we already do.

      This is all an expenditure of vast amounts of energy for literally no gain for anybody except a handful of billionaires and their corporations.

    • Vlyn@lemmy.zip
      link
      fedilink
      English
      arrow-up
      41
      ·
      21 hours ago

      DeepSeek has really led the way here, especially as they are a bit more hardware constrained. Plus they openly publish their findings and release open source models, so high hopes there.

      It’s probably China’s play to pop the AI bubble, but I’m all for it (:

      • ScoffingLizard@lemmy.dbzer0.com
        link
        fedilink
        English
        arrow-up
        1
        ·
        4 hours ago

        I wonder what all is in the deepseek code that is malicious. I’d like to try it but don’t want a million Mb/s of tracker shit across my network and can’t run it myself.

        • qaz@lemmy.world
          link
          fedilink
          English
          arrow-up
          2
          ·
          edit-2
          3 hours ago

          AFAIK, their open models are distributed as weights, not executables and are therefore not able to start network connections / run code. There if of course tool-calling functionality but that just works by having the model output a special pattern and having something external run predetermined commands based on that.

        • Vlyn@lemmy.zip
          link
          fedilink
          English
          arrow-up
          1
          ·
          3 hours ago

          They are open source models, nothing malicious about them. I’d be much more careful about where you run your agents on. The wrong prompt can even make a non-malicious model misbehave.