• LostWanderer@fedia.io
    link
    fedilink
    arrow-up
    43
    ·
    1 day ago

    Meh, its less exciting whenever Claude Code is involved; I am wondering how many undetected bugs will sneak into the kernel. If he was going to use an LLM, he could at least use something local and not connected to one of the many nasty big corps that are ruining shit.

      • LostWanderer@fedia.io
        link
        fedilink
        arrow-up
        5
        ·
        10 hours ago

        Yeah, but you are still relying on models that are going to go up in smoke when the bubble fucking crashes. As people are rightfully hesitant to pay the real price for these things, these things are controlled by mega-corps which is ultimately a bad thing because a centralized authority sets the terms of engagement with their services. They are the ones actively scraping open source projects so much that it acts as a DDoS attack, hovering up personal data of other people as if it were candy. Not to mention the other effects it is having on jobs, AI systems being central to massive data breaches, etc. A few positives don’t outweigh the massive negatives that come with the technology.

        • MangoCats@feddit.it
          link
          fedilink
          arrow-up
          2
          ·
          edit-2
          9 hours ago

          If the models all go up in smoke, we still have the code (and its bugs) - so let’s get as many bugs out as possible as soon as possible and not accept a bunch of garbage code - as has always been the case, it’s just happening faster now.

          Trainers (all over the world) are behaving badly, because they can get away with it. I’m not sure where that ends up, but it doesn’t change the generated code or the discovered vulnerabilities or the fixes.

          The personal data has been abused for decades already, but again - now it’s easier for more actors to abuse your personal data and mine. Maybe, someday, we’ll get serious about enforcing privacy policies and not just have completely toothless theater about it.

    • NotMyOldRedditName@lemmy.world
      link
      fedilink
      arrow-up
      17
      ·
      edit-2
      21 hours ago

      You wouldn’t want him using a local model unless he was running some fancy rig that could run a high end frontier model. He might not have such a thing laying around. Using the best out there for something like this is how you help avoid bugs.

        • NotMyOldRedditName@lemmy.world
          link
          fedilink
          arrow-up
          4
          ·
          edit-2
          14 hours ago

          He definitely can afford it yes, but its still a big ask to want someone to spend 15-25k or whatever it would be (shits getting more expensive by the day) to use a tool that he can just do pay per use. The code is open source so its not like he’d be using a local llm to keep it private.

        • Knock_Knock_Lemmy_In@lemmy.world
          link
          fedilink
          arrow-up
          1
          ·
          13 hours ago
          • AMD Ryzen Threadripper 9960X

          • GIGABYTE TRX50 AERO D Motherboard

          • Samsung SSD 9100 PRO 2TB SSD

          • Noctua NH-U14S TR5-SP6 Cooler

          • Intel Arc B580 GPU

          • Fractal Design Torrent E-ATX Case

          • Seasonic PRIME TX-1600 1600W 80+

          • Titanium PSU

          • ASUS ProArt Display PA32QCV 31.5" 6K

          • HDR Monitor

      • LostWanderer@fedia.io
        link
        fedilink
        arrow-up
        7
        ·
        20 hours ago

        Honestly, his mind and the community is probably one of the best things out there at the moment. They live the Linux Kernel, while that thing he used does not think or understand anything. Eh, it would be better if they moved with care instead, as that is a good way to avoid bugs too. I don’t have a lot of faith in gassed up LLMs.

        • NotMyOldRedditName@lemmy.world
          link
          fedilink
          arrow-up
          3
          ·
          edit-2
          14 hours ago

          He’s doing it though. So that’s kind or moot. Fable is out there finding bugs in these things, so seems like if he is going to do it, using the thing that’s already making it more secure by finding multiple exploits is the right choice of what to use.

    • mindbleach@sh.itjust.works
      link
      fedilink
      arrow-up
      1
      ·
      13 hours ago

      I’d definitely like someone to champion an open-weights model under 32 GB. But part of that desire is - I’m not sure they’re there, yet. Local models are only a few months behind, but hoo boy, the last few months have been big.

      Coding models could be tiny, but distilled versions keep preserving pop-culture knowledge and world history, when reasoning through C++ requires essentially none of that. It needs the tokenization to recognize why a comment begins “Jesus Christ.” It’s fine for “treat the hash like Lot’s wife” to go completely over its head. Keep the weights that know a regex for e-mails, not the capitol of Florida. If it speaks a dead language I want it to be Algol.