The thing is while LLMs do make mistakes when you have something you can drive conformance with they are actually pretty good (eventually)
For electrical or plumbing we can simulate those pretty well and a LLM can iterate until it gets a reasonable output since it can check its work against a simulator.
You could likely live in a house for a bit before you stumbled into something stupid. You could live your entire life and not notice if you never tore out the walls.
However if you went to change a light switch you might discover it used 3 different kinds of screws and the screw terminals are mislabeled.
The thing is while LLMs do make mistakes when you have something you can drive conformance with they are actually pretty good (eventually)
For electrical or plumbing we can simulate those pretty well and a LLM can iterate until it gets a reasonable output since it can check its work against a simulator.
You could likely live in a house for a bit before you stumbled into something stupid. You could live your entire life and not notice if you never tore out the walls.
However if you went to change a light switch you might discover it used 3 different kinds of screws and the screw terminals are mislabeled.