Just want to clarify, this is not my Substack, I’m just sharing this because I found it insightful.

The author describes himself as a “fractional CTO”(no clue what that means, don’t ask me) and advisor. His clients asked him how they could leverage AI. He decided to experience it for himself. From the author(emphasis mine):

I forced myself to use Claude Code exclusively to build a product. Three months. Not a single line of code written by me. I wanted to experience what my clients were considering—100% AI adoption. I needed to know firsthand why that 95% failure rate exists.

I got the product launched. It worked. I was proud of what I’d created. Then came the moment that validated every concern in that MIT study: I needed to make a small change and realized I wasn’t confident I could do it. My own product, built under my direction, and I’d lost confidence in my ability to modify it.

Now when clients ask me about AI adoption, I can tell them exactly what 100% looks like: it looks like failure. Not immediate failure—that’s the trap. Initial metrics look great. You ship faster. You feel productive. Then three months later, you realize nobody actually understands what you’ve built.

  • psycotica0@lemmy.ca
    link
    fedilink
    English
    arrow-up
    99
    ·
    22 hours ago

    I can least kinda appreciate this guy’s approach. If we assume that AI is a magic bullet, then it’s not crazy to assume we, the existing programmers, would resist it just to save our own jobs. Or we’d complain because it doesn’t do things our way, but we’re the old way and this is the new way. So maybe we’re just being whiny and can be ignored.

    So he tested it to see for himself, and what he found was that he agreed with us, that it’s not worth it.

    Ignoring experts is annoying, but doing some of your own science and getting first-hand experience isn’t always a bad idea.

    • 5too@lemmy.world
      link
      fedilink
      English
      arrow-up
      44
      ·
      19 hours ago

      And not only did he see for himself, he wrote up and published his results.

    • bassomitron@lemmy.world
      link
      fedilink
      English
      arrow-up
      38
      ·
      20 hours ago

      100% this. The guy was literally a consultant and a developer. It’d just be bad business for him to outright dismiss AI without having actual hands on experience with said product. Clients want that type of experience and knowledge when paying a business to give them advice and develop a product for them.

      • raspberriesareyummy@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        18 hours ago

        Except that outright dismissing snake oil would not at all be bad business. Calling a turd a diamond neither makes it sparkle, nor does it get rid of the stink.

        • fruitycoder@sh.itjust.works
          link
          fedilink
          English
          arrow-up
          16
          ·
          14 hours ago

          I can’t just call everything snake oil without some actual measurements and tests.

          Naive cynicism is just as naive as blind optimism

          • raspberriesareyummy@lemmy.world
            link
            fedilink
            English
            arrow-up
            2
            ·
            13 hours ago

            I can’t just call everything snake oil without some actual measurements and tests.

            With all due respect, you have not understood the basic mechanic of machine learning and the consequences thereof.

    • raspberriesareyummy@lemmy.world
      link
      fedilink
      English
      arrow-up
      1
      ·
      18 hours ago

      Problem is that statistical word prediction has fuck-all to do with AI. It’s not and will never be. By “giving it a try” you contribute to the spread of this snake oil. And even if someone came up with actual AI, if it used enough resources to impact our ecosystem, instead of being a net positive, and if it was in the greedy hands of billionaires, then using it is equivalent to selling your executioner an axe.

      • jve@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        edit-2
        6 hours ago

        Terrible take. Thanks for playing.

        It’s actually impressive the level of downvotes you’ve gathered in what is generally a pretty anti-ai crowd.