• TauZero@mander.xyz
    link
    fedilink
    English
    arrow-up
    2
    ·
    19 hours ago

    The way I see it is they are doing inference, not transfiring bank account balances. I’d be curious to see some actual experimental data, but I’d expect LLMs to skip past bit flips same way you shrug and move on from spelling errors. At worst you can do your critical calculation in triplicate on your 6nm nodes (with redo upon dissensus) and reduce your bit error from 4/year (or 4000/year or whatever have you in orbit) to (4/year)^3

    • i_am_not_a_robot@discuss.tchncs.de
      link
      fedilink
      English
      arrow-up
      2
      ·
      3 hours ago

      A bit flip might change a 0 to a 1 or a 1 to an infinity. Even if you could just do everything three times, that triples the hardware and energy costs compared to terrestrial computing.

    • SleeplessCityLights@programming.dev
      link
      fedilink
      English
      arrow-up
      2
      ·
      4 hours ago

      I don’t think you don’t understand the difference between the amout of cosmic rays, which are basically any flying particle, on Earth compared to space. Small nodes would be dealing with multiple per cpu cycle. Multiple could be 1 million a second, I am trying to figure out a way to measure. It would be something like distance from atomsphere(rate of total particles) x probably of an object the size of a transitior getting hit(rate of collions). I could probably find the bit-flip rate for an off-the-shelf space resistant chip and infere the rate for the size I need, but there are other factors. A bit will not flip on every collision, shrinking transistors exponentially increases this.