Ello Ello.
Can you recommend a program with which I can generate commit messages locally? I DO NOT want an LLM local or cloud API. What I want is a tiny or small language model. If I could easily swap or customize the model for each project, it would be better, too. So I could have smaller models for specific projects. I can do the training meself.
Thanks in advance!
https://victorzhou.com/blog/better-profanity-detection-with-scikit-learn/
That might be of interest to you then? Its a small model trained for profanity detection, might work for your use case. Dunno if it can be used for generation though.
Otherwise, there were 1GB gemma models, you can run them on CPU.