• ExtremeDullard@piefed.social
    link
    fedilink
    English
    arrow-up
    11
    ·
    2 days ago

    I’ve been using a LLM locally (running on my DGX Spark machine) for general low-level programming help (to code simple boilerplate), for simple code samples, various technical questions, general questions and language translation for a few months now. In fairness, when it knows it knows. It starts making shit up with incredible hubris, and it won’t stop making shit up if it doesn’t.

    That’s my biggest gripe with AI: it won’t say “I don’t know”. If it did (or could?) acknowledge its own shortcomings, it would be a lot more useful and a lot more trustworthy. But as it stands today, you always have to question what it says, because you never quite know if it’s real or made up.

    • Cypher@aussie.zone
      link
      fedilink
      English
      arrow-up
      22
      ·
      2 days ago

      LLMs will never know if they don’t know something.

      That is one of LLMs most crippling flaws.

    • cavitationfetishist2@quokk.au
      link
      fedilink
      English
      arrow-up
      12
      ·
      edit-2
      2 days ago

      It has no way of knowing if it knows or not. You’re saying the stochastic noise machine sometimes says phonemes and real words. Why can’t it always say words?

      It’s a structural problem of what these things are means they cannot improve past a certain point. They just can’t.

      You can fudge it and put up pretty backgrounds along the edges so it looks like there’s more there, but the way past them is to make a fundamentally different kind of thing. None of the work that’s gone into these will contribute to that other thing. None of it. Literally all of this is waste.