• f314@lemmy.world
      link
      fedilink
      arrow-up
      5
      ·
      5 hours ago
      .container {
          display: grid;
          place-items: center;
      }
      

      The real answer is of course, as in most cases, “it depends.”

  • chiliedogg@lemmy.world
    link
    fedilink
    arrow-up
    22
    ·
    8 hours ago

    I think doing this exact post but changing the request could really speak to the inefficiency of AI.

    Something like “What is 8x12”, go through the whole sequence, and have it spit out “Eight times twelve is 114”

    • ikt@aussie.zoneOP
      link
      fedilink
      arrow-up
      9
      ·
      edit-2
      7 hours ago

      tbf they are getting significantly better, one of the best things that hasn’t really filtered through to the mainstream is MOE / mixture of experts

      the tldr is that back in the chatgpt4 days, wayyy back in the ye olden times of 2024, ai would essentially go through the entire library every single question to find an answer

      Now the libraries are getting massive but the queries are getting faster at responding because instead of going through the entire library for every question, they only need a part of it, just like in a library instead of querying all of human knowledge for what is 8x12, it just goes to the maths section saving a lot of power and time

      In the case of chat.mistral.ai it doesn’t even go through the library to maths, it just makes a quick python script and outputs the answer that way:

  • serpineslair@lemmy.world
    link
    fedilink
    English
    arrow-up
    19
    ·
    8 hours ago

    It’s shit a lot of people don’t think about tbh. Like imagine all the meaningless shit people have done on the internet, and that shit literally travels across the whole world using impressive feats of technology. I’m saving this post for later. 🤣

    • NeatNit@discuss.tchncs.de
      link
      fedilink
      arrow-up
      9
      ·
      8 hours ago

      Infrastructure is all about unbelievable feats of engineering that are taken for granted. Sewage systems, running water, electricity, roads, public transport, cars, physical mail, and grocery stores/supermarkets are all unbelievable achievements that we all take for granted to varying degrees, and that’s just off the top of my head. IP networking is just more of that. Absolutely crazy, and by design we don’t think about it.

      But AI (also depicted in this gif) is not in the same category IMO, for a lot of reasons.

      • Fergie434@lemmy.world
        link
        fedilink
        English
        arrow-up
        2
        ·
        4 hours ago

        Simply doing a traceroute to a website in another country a long time ago fascinated me. Seeing it hit all of the routers in other cities then across the ocean to another continent and back in less than 100ms blew my mind.

        Led me down that path and now I’ve been a network engineer for over 10 years.