☆ Yσɠƚԋσʂ ☆

  • 2.05K Posts
  • 2.35K Comments
Joined 6 years ago
cake
Cake day: January 18th, 2020

help-circle


  • I use these tools extensively, and they absolutely do not replace the need for a coder. The reality is that they’re fundamentally incapable of telling whether something is correct or not in the business sense. And Simply churning out a ton of wrong code really fast doesn’t actually help anybody.

    They certainly can be a help for a developer. For example, I can fluently write code in any language now even if I’m not familiar with the stack or syntax. A skill that would’ve taken months of effort to build previously. But in terms of actual workflow, it’s not all that much faster because I still have to review what the tool is doing, and human comprehension is still the bottleneck in the whole process.








  • I’ve been using LLMs pretty extensively. These tools are effective, they can solve hard problems, and they allow me to work on a wider range of tasks than could before.

    But, they’re also jagged in terms of functionality. When you work with a human, you can learn what their core competencies are, and then if you give them a task that falls within that domain, you can be reasonably sure they’ll finish it correctly. That’s not the case with LLMs. It might do one task brilliantly, and a next similar task, it just shits the bed on. And since it has no understanding of the task in a human sense, it can’t self correct, learn or improve. All its doing is stringing tokens together based on probability.

    So, you need a human in the loop to review everything that it’s doing. Reviewing everything the model outputs takes a lot of time, hence actual productivity gains aren’t all that significant. Having an LLM will allow a backend developer to work on the frontend with fairly low friction for example, but they’re still going to build stuff roughly at the same pace.

    Companies that try to replace humans with LLMs will soon find that they end up with a whole bunch of code that doesn’t actually work, and they have no hope of fixing. The fact that LLMs can produce a lot of code very quickly is precisely the danger because nobody knows what that code is doing, and it’s almost certainly not correct.