• percent@infosec.pub
    link
    fedilink
    arrow-up
    6
    ·
    2 days ago

    I’ve been using a local Qwen3.8 model as a NixOS sysadmin lately for a non-critical VPS. So far, it has been working surprisingly well! I guess it’s easier for AI agents to gather context when the whole system and apps are defined in code, and immutable when applied.

    • TehWorld@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      1 day ago

      I’ve been wanting to do this, even as a testbed. I just want computers to do cool shit, and am getting tired of being a Linux sysadmin in my free time. How large of a model do you have assigned to this?

      • percent@infosec.pub
        link
        fedilink
        arrow-up
        2
        ·
        edit-2
        16 hours ago

        Just Qwen3.8-27B. That little model is surprisingly smart.

        NixOS also gives you the ability to roll back to previous config versions. I have not needed to do that (yet), but it reduces some risk.

        • TehWorld@lemmy.world
          link
          fedilink
          English
          arrow-up
          1
          ·
          10 minutes ago

          “Just” and a 27B model don’t exactly belong in the same sentence if you ask my wallet. 💸