That’s what I generally use. I wanted to see if I could use the 27b to “review” what the 35b put out. The 35b has been working pretty well, but it’s not very thorough. I asked it to make a program and then 27b was like “this is a skeleton, there are folders but no contents.” Lol
These models generally are not capable enough to do one-shot vibe coding. They are pretty good as coding assistants if you tell them exactly what you want and let them focus on a specific aspect/part of code, not the whole thing at once.
Using an agent framework (I like Kilo on VSCode but there are many others) you can start with a planning session to let the model find out what you want to build. Then you let it write that gist into AGENTS.md and double check if that is what you want. AGENTS.md will be loaded into the context automatically so the model has a solid base of understanding for everything you do afterwards. Once you have that, building in vertical slices on top of that skeleton is much easier. Another neat trick is to ask the model a few questions about the current code base (if there is any…) at the beginning of a session, e.g. "How does feature x work in the current code? ". This primes the model for what you are about to do. All this is obviously a bit more work than just vibe coding away, but it lets you keep in control of the code and helps in being alert for errors these models (and all LLMs in general) will inevitably produce.
Thanks for the tips! What I had started doing the other day was having one session where it reviewed the code and created a document explaining what the program did in technical detail and then in another session I asked it to review that document before attempting anything with the program. Agent programs and harnesses are the next thing I need to start learning for sure.
You could use the 35B MoE model, tune it a little bit and get much better results. I have a 5060 ti and 70-80 tok/s are the norm
That’s what I generally use. I wanted to see if I could use the 27b to “review” what the 35b put out. The 35b has been working pretty well, but it’s not very thorough. I asked it to make a program and then 27b was like “this is a skeleton, there are folders but no contents.” Lol
These models generally are not capable enough to do one-shot vibe coding. They are pretty good as coding assistants if you tell them exactly what you want and let them focus on a specific aspect/part of code, not the whole thing at once.
Using an agent framework (I like Kilo on VSCode but there are many others) you can start with a planning session to let the model find out what you want to build. Then you let it write that gist into AGENTS.md and double check if that is what you want. AGENTS.md will be loaded into the context automatically so the model has a solid base of understanding for everything you do afterwards. Once you have that, building in vertical slices on top of that skeleton is much easier. Another neat trick is to ask the model a few questions about the current code base (if there is any…) at the beginning of a session, e.g. "How does feature x work in the current code? ". This primes the model for what you are about to do. All this is obviously a bit more work than just vibe coding away, but it lets you keep in control of the code and helps in being alert for errors these models (and all LLMs in general) will inevitably produce.
Thanks for the tips! What I had started doing the other day was having one session where it reviewed the code and created a document explaining what the program did in technical detail and then in another session I asked it to review that document before attempting anything with the program. Agent programs and harnesses are the next thing I need to start learning for sure.