Ello Ello.

Can you recommend a program with which I can generate commit messages locally? I DO NOT want an LLM local or cloud API. What I want is a tiny or small language model. If I could easily swap or customize the model for each project, it would be better, too. So I could have smaller models for specific projects. I can do the training meself.

Thanks in advance!

    • CameronDev@programming.dev
      3·
      17 hours ago

      Its small in the sense it’ll run on basically any GPU from the last decade, rather than high end or specialised GPUs. And there is a 1GB gemma4 model, which is meant for CPU/phones.

        • CameronDev@programming.dev
          4·
          16 hours ago

          You’re not wrong though, even 1GB is quite lot for writing commit messages, I gave it a quick go, and it takes around 15-30s to analyse a very small diff. Kinda silly for git messages.

          • Farooq@realbitcoin.cashOP
            3·
            15 hours ago

            Thanks for letting us know. Yeah sure. It’s not worth it. I personally take about 10s to write the commit message. So such a thing will just make it worse.