• kryptonianCodeMonkey@lemmy.world
    link
    fedilink
    arrow-up
    18
    ·
    edit-2
    1 hour ago

    He fails to mention that he has AI also generate and do all of those tests, which means, A) he has no quality supervision over his quality supervision. Speaking from experience, AI can and will break a test in order to pass it rather than fixing the code if it randomly decides to. It is not always reliable and does not have even the baseline of good sense you would expect a brand new junior dev to have. And B) he’s probably spending 3 times as much on tokens used for generating and running tests than he is already using on code generation. That’s only going to be sustainable while these tokens remain cheap, which won’t be for much longer, my guy.

    Also it is always fun when someone asks you basic questions about your code and you have to admit complete and total ignorance because you neither wrote nor read a single line of it. How are you going to sell confidence in your black box that even you haven’t peeked inside?

    • ZILtoid1991@lemmy.worldOP
      link
      fedilink
      arrow-up
      7
      ·
      1 hour ago

      The D Language Foundation tried to incorporate LLMs in the unittests, and they created something akin to assert(5 + (funcToTest(846) * 0) == 5) early on, now they want to use it to rewrite the standard library from scratch, because “it has become better since”.

      • kryptonianCodeMonkey@lemmy.world
        link
        fedilink
        arrow-up
        8
        ·
        edit-2
        50 minutes ago

        The other day I had Claude write some code that failed a unit test. It was failing at a step that ran assertEquals(actualMap, expectedMap);. The reason it was failing was because one of the values in the map, a UUID, is automatically generated in the code. In the test, it has been hard coded.

        Anyone with any sense would know you need to handle that misalignment. Omit that field from the match assertion? Set that UUID based on the generated value instead of hardcoding it? Anything like that would work just fine.

        But Claud’s solution was to change that assertion to assertTrue("The actualMap and expectedMap will never be equal because the values of ID will never match");. So the test always passes and it explicitly notes that they will not match. I would have fired a Junior Dev on the spot for writing that solution.

  • JakenVeina@midwest.social
    link
    fedilink
    arrow-up
    1
    ·
    8 minutes ago

    I choose to believe this is satire. Also that this man holds no significant position of prominence within the industry.

    /cope

  • HeartyOfGlass@piefed.social
    link
    fedilink
    English
    arrow-up
    27
    ·
    edit-2
    2 hours ago

    “I stopped reading code because I was too busy writing a gauntlet of unit tests”

    Sounds like 100x productivity to me.

    Edit: also, general note - I think you kneecap your argument when you start with “I’m older than you”.

  • HazardousBanjo@lemmy.world
    link
    fedilink
    arrow-up
    29
    ·
    edit-2
    2 hours ago

    I’m significantly older than you. I started coding in the late 60’s

    Yeah, appeal to tangentially related experience, age and arrogance aren’t a way to inspire confidence in your work.

    We live in the perfect times to display that experience, age and arrogance haven’t been working in almost any field, from politics to LLM development. We’ve yet to witness any system that operates well, while also eliminating human oversight. It doesn’t matter the guard rails you put in place. They’re only as strong as your personal ability to evaluate your own product, which itself is a conflict of interest.

    Edit: Also, you can’t use your own credentials to assert the integrity of work you aren’t even actually doing yet passing as your own.

    • sp3ctr4l@lemmy.dbzer0.com
      link
      fedilink
      English
      arrow-up
      14
      ·
      edit-2
      2 hours ago

      Not to be too flippant, but:

      Boomers gonna boom.

      They literally can’t help themselves, they’re egomaniacal narcissists.

      The rare ones that aren’t that way can truly be awesome sources of perspective… but goddamnit so many of them are completely insufferable man-babies.

  • BJW@lemmus.org
    link
    fedilink
    English
    arrow-up
    3
    ·
    37 minutes ago

    Glad to see the angry mob is alive and well on Lemmy.

    Don’t hate AI? Lemmy users will find reasons to hate you.

    • korendian@piefed.social
      link
      fedilink
      English
      arrow-up
      3
      ·
      28 minutes ago

      There’s a difference between hating AI and calling out morons. This dude a moron, plain and simple. Even the dude who coined the phrase “context engineering” doesn’t think AI can produce good code without a human actually reading the code at some point in the process.

  • bookmeat@fedinsfw.app
    link
    fedilink
    English
    arrow-up
    4
    ·
    1 hour ago

    We recently had an example of this. See Bun vs Zig. Even if your LLM doesn’t have meaningless tests and assertions, those will not have 100% coverage on any non-trivial code base.

  • RustyNova@lemmy.world
    link
    fedilink
    arrow-up
    3
    ·
    56 minutes ago

    One thing I do love about the LLM era is that people get forced to be way more pendantic when it comes to code, and that’s a win for everyone.

    … Well admist the enormous losses LLM brings

  • ranzispa@mander.xyz
    link
    fedilink
    arrow-up
    4
    ·
    1 hour ago

    In my experience, agents tend to write functions significantly longer than 12 lines. Where’s your clean code Bob?

  • Mirror Giraffe@piefed.social
    link
    fedilink
    English
    arrow-up
    1
    ·
    28 minutes ago

    If it’s his own products and no-one else needs to work that code I don’t see a big problem with it, but the ways I’ve seen agents treat a code base just to pass tests is horrible.

  • dfyx@lemmy.helios42.de
    link
    fedilink
    arrow-up
    15
    ·
    2 hours ago

    So in other words he spends weeks to write extra tests so that the agent can save him days of coding.

  • Err(()).unwrap()@lemmy.world
    link
    fedilink
    arrow-up
    69
    ·
    edit-2
    4 hours ago

    Sounds like a cryptobro peddling some shitcoin claiming that it’s impossible to get scammed because “code is law” four seconds before the liquidity pool gets drained through a vulnerability in the code.