• mecen@lemmy.ca
    link
    fedilink
    English
    arrow-up
    26
    ·
    edit-2
    5 小时前

    But think about Samsung, SK Hynix and Micron shareholders

  • brucethemoose@lemmy.world
    link
    fedilink
    English
    arrow-up
    99
    ·
    edit-2
    8 小时前

    The Chinese AI labs are really trying to pop the bubble, too.

    How?

    Well lemme ask you this. What if models 80-90% as good as Claude, with weights just thrown out there for any provider (or homelab) to host, flood the market? What if they’re so dirt cheap to run, they’re almost free, and don’t even need Nvidia GPUs? What they need fewer resources to run with each update, instead of more?

    …What if this already happened, and Big Tech is maddly lobbying to ban/censor them before people realize it, and that the “infinite scaling” thing is a big fat lie?

    That’s the state of things.

    • zeroConnection@programming.dev
      link
      fedilink
      English
      arrow-up
      10
      ·
      edit-2
      1 小时前

      Yep, the Chinese models are already up 10 times cheaper and now that Anthropic, OpenAI, and Google, all are increasing prices up to 10 more for models like Opus, it will make Chinese models anywhere from 50 to 100 times cheaper.

      American corps. are betting that since people have their workflow already established they won’t switch to other providers, but that’s not the case. There’s already a mass move to Chinese models.

      • madcaesar@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        9 分钟前

        People keep talking about Chinese models, where are they? How do I used them instead of Claude? Are they safe?

    • ImmersiveMatthew@sh.itjust.works
      link
      fedilink
      English
      arrow-up
      2
      ·
      35 分钟前

      Agreed. I am not longer paying token fees as I am running QWEN 3.6 27B MTP on my 4090 GPU and it is as good and as fast as the frontier models for agentic coding.

    • mlg@lemmy.world
      link
      fedilink
      English
      arrow-up
      16
      ·
      3 小时前

      In a way it has actually.

      Deepseek was big because not only did they publish the full model for everyone to use, but the MoE structure significantly brought down the hardware requirements in terms of processing power. As long as you have enough VRAM, you can run it on older hardware with no need for the latest Nvidia stuff.

      Now they got v4 which many have found to be within a 10% margin of Claude and ChatGPT.

      On top of that, China has cheapo VRAM GPUs available or soon to be released, like the MTT S80. Yeah it sucks as a Graphics card because the chip is behind, but you get 16Gb of GDDR6 for much cheaper than anything else.

      But its not a conspiracy to fight China. The infinite scaling was just Nvidia solidifying themselves as the monopoly because they want all AI infrastructure to be dependent on them, which is why they still illegally export to China, despite an export ban attempting to reduce their potential competition.

      Moore Threads (MTT) already has their own CUDA like system called MUSA, and I’m sure they’ll be happy to put in proper hardware support for new stuff like Bf16 and FP8/4. It’ll take a few years, but eventually China will catch up to the point where Nvidia gets shanked by cheaper hardware.

      • Truscape@lemmy.blahaj.zone
        link
        fedilink
        English
        arrow-up
        2
        ·
        33 分钟前

        Wasn’t there development of a linux translation layer for CUDA workloads to run on AMD GPUs? I haven’t heard about it in a while, but I’d imagine that’d help the situation.

      • brucethemoose@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        edit-2
        2 小时前

        MTT is just a pipe dream, last I checked. But Deepseek is actively being served, in mixed FP8/FP4, on racks of Huawei accelerators.

        I believe Baidu trained a model on them, too. But most training (like Deepseek’s) is still done on CUDA.


        …Also, be careful equating this stuff with any kind of “consumer friendly” hardware you or I could buy. That’s less likely. The Huawei accelerators (and other local Chinese hardware experiments) are geared towards huge servers serving requests in parallel.

    • 4am@lemmy.zip
      link
      fedilink
      English
      arrow-up
      42
      ·
      8 小时前

      Hyper scaling was always about cornering the computer market, It was never about providing us some vastly new and superior service.

      They should be strung up. And middle management needs to return to fucking school.

      It’s like Kyle Kulinski said “I’m starting to understand re-education camps now”

      • FauxLiving@lemmy.world
        link
        fedilink
        English
        arrow-up
        23
        ·
        edit-2
        5 小时前

        Hyper scaling was always about cornering the computer market, It was never about providing us some vastly new and superior service.

        Exactly, its a method of taking tens of billions of dollars in capital and buying a near monopoly. No other providers can compete if the hyperscalers buy all of the hardware, driving up the prices while also selling the service at a loss.

        Nobody working out of their garage with a cool idea for a better service can compete if they can’t get hardware and have to charge double what the hyperscalers are charging because they can’t burn capital for years.

        It’s a practice that should be considered illegal market manipulation, because that’s what it i

        e: extraneous ‘completely’

    • 1984@lemmy.today
      link
      fedilink
      English
      arrow-up
      4
      ·
      edit-2
      5 小时前

      The state of things is what if, that’s true. It has not happened. :)

      At some point, it should happen. Still not going to put a dent in the datacenter / dystopia rally though, since they will pick Nvidia and known brands.

    • Truscape@lemmy.blahaj.zone
      link
      fedilink
      English
      arrow-up
      1
      ·
      edit-2
      30 分钟前

      Failure rates and RMAs might be more common when manufactuerers save a buck. Samsung SSDs for example are expensive AF, but they have a good reputation for reliablility and lifespan.

      Of course, being diligent about backing up your data means that you might benefit from the savings with less worry about the risk. Or you could use the cheaper SSD for something like a Steam library where you may not care as much about long term data preservation.

      Word of warning though: super cheap end might end up with you getting scammed, or things like SSDs without DRAM caches, which are slower than even HDDs.

      • Dremor@lemmy.world
        link
        fedilink
        English
        arrow-up
        1
        ·
        21 分钟前

        As a personal example of Samsung reliability, my 11 years old samsung SSD is still kicking, despite being used as a cache for my Truenas homelab for half of it. This thing will outlive me 😆

    • CosmoNova@lemmy.world
      link
      fedilink
      English
      arrow-up
      2
      ·
      2 小时前

      From what I‘ve heard it‘s all about guarantees because SSDs have a tendency to just go bad sometimes. Some SSDs are more expensive because the manufacturer will offer a replacement for up to 5 years. You can expect these manufacturers to have better quality control too. They don‘t want to replace SSDs left and right after all.

      Take this with a grain of salt because I never actually had to get an SSD replaced myself. But I would only trust a manufacturer that‘s been in business with a good reputation for 5 to 10 years. Cheap storage sounds tempting but for me it‘s not worth risking to lose my data over. Yes I make backups but still.

    • UninvestedCuriosity@lemmy.world
      link
      fedilink
      English
      arrow-up
      4
      ·
      4 小时前

      It depends on the use case. I use teamgroup high capacity SSD drives for short load things on my homelab but they are super slow for any kind of extended writing due to a number of factors such as cache writes. I had to warranty two of 5 that died within a few weeks but it has been fine once the duds were replaced and they were easy about honoring the warranty.

      Again, fine for a homelab but I wouldn’t use them in my gaming rig where speed matters. For things like readimg of stored video and Linux isos, they work pretty good.

    • brucethemoose@lemmy.world
      link
      fedilink
      English
      arrow-up
      19
      ·
      edit-2
      6 小时前

      YMMV.

      You gotta look up reviews. Both buyer track records, and focused reviews that look at what controller/NAND they use.

      Many SSDs are basically the same as other brands internally. A few are wonky. It just depends.

  • TeamAssimilation@infosec.pub
    link
    fedilink
    English
    arrow-up
    52
    ·
    10 小时前

    Crazy how USA seems unable to keep up, and it appears its best chance of maintaining hegemony is bringing China down, not improving itself. Never expected to see this shift in my lifetime.

    • stumu415@lemmy.zip
      link
      fedilink
      English
      arrow-up
      21
      ·
      6 小时前

      Just look at the EV’s. The CEO of Ford was shocked about the quality and innovation of the Chinese cars. He’s driving a Xiaomi SU7 and refuses to give it up. At least Canada is now free of the US chains and letting Chinese EV’s in. The movement is unstoppable in the rest of the world. The only place resisting innovation is the US with its current regime.

      • SpaceMan9000@lemmy.world
        link
        fedilink
        English
        arrow-up
        4
        ·
        3 小时前

        His current job is also as a spoke person for Chinese electric vehicles. So take that with a grain of salt.

        • Alcoholicorn@mander.xyz
          link
          fedilink
          English
          arrow-up
          5
          ·
          60 分钟前

          His current job is also as a spoke person for Chinese electric vehicles

          The CEO of Ford? What are you talking about?

    • BarneyPiccolo@lemmings.world
      link
      fedilink
      English
      arrow-up
      12
      ·
      6 小时前

      It’s been coming for a long time. While the rest of us have been fighting among ourselves, China stayed out of it all, and improved their country. I’m not surprised that they’ve emerged as a powerhouse, while we volunteered to give a lunatic the nukes.

      • 1984@lemmy.today
        link
        fedilink
        English
        arrow-up
        8
        ·
        edit-2
        5 小时前

        Doesnt have anything to do with fighting with ourselves. America has never invested a lot of money into its own population and environment.

        • BarneyPiccolo@lemmings.world
          link
          fedilink
          English
          arrow-up
          9
          ·
          5 小时前

          A big part of that is because we blow the money on endless wars, which China doesn’t do.

          Add that to their good-faith commitment to invest in, and substantially improve, their country, compared to our lack of investment in our own nation, which you mentioned.

          I’m just saying, we shouldn’t be surprised. This is nothing new to anyone who’s been paying attention for a while.

            • Alcoholicorn@mander.xyz
              link
              fedilink
              English
              arrow-up
              2
              ·
              51 分钟前

              They had a few hundred troops there as part of a UN peace-keeping force, who left with the rest of the UN troops in 2020 when the new government asked them to.

          • 1984@lemmy.today
            link
            fedilink
            English
            arrow-up
            4
            ·
            edit-2
            4 小时前

            Yeah and the wars are created by America many times, because its huge profits for the military industrial complex and also serves as a way to increase the American presence in countries with resources like oil.

            The CIA is super good at what it does actually.

    • Telorand@reddthat.com
      link
      fedilink
      English
      arrow-up
      49
      ·
      10 小时前

      Not really that crazy when you consider that the people in charge could have had a sweetheart deal with manufacturers in China, but they cut off all trade partners and all soft power channels, because they’re drooling buffoons who won’t accept that the US shifted to a global economy decades ago nor do they grasp how global economies work—mainly because they fired every expert under the pretense of “government waste.”

      All they know how to do is grift and defraud, and the chance to maintain global hegemony is long past. It’s China’s time, now, and they know it.

      • Avid Amoeba@lemmy.ca
        link
        fedilink
        English
        arrow-up
        10
        ·
        5 小时前

        People trained in Marxian economics tend to understand capitalism better than stidents of mainstream capitalist economics. China’s using capitalism for what it’s good for - expanding the producive force of the economy, figuring out how to make new products efficiently, and making wide variety of consumer goods. The state still retains control over the capitalist sectors throurh various means. It also owns strategic sectors like banks, etc. The state is controlled via the CCP with membership of over 10% of the pop and growing. It’s an open question whether they’re gonna lose control over the capitalist sector or not but so far it’s subordinate to the state. In capitalist economies the state (and democracy} tend to be subordinate to capital.

      • lechekaflan@lemmy.world
        link
        fedilink
        English
        arrow-up
        5
        ·
        5 小时前

        Maoist but in name only, as the hardcore Maoists in Mainland China and elsewhere are balking at how the country has become, a hegemony set to replace another.

      • Azal@pawb.social
        link
        fedilink
        English
        arrow-up
        14
        ·
        7 小时前

        This is one of those troubles with the whole “communist” and “capitalist” things. None of them are actually truly what they say they are.

        China and USSR started competing hard core on the global scale in the capitalism games, and lets be honest, look at China now and it’s fully on the capitalism train while still calling communist.

        But that isn’t to say the US is any better on the capitalism wagon. The US is quite happy to drop capitalism if a company desires it. This is where we get our "too big to fail"s or companies that are given “loans” during the pandemic that they never have to pay back.

        It’s almost like the terms are a joke by the upper echelon to fuck with the rest of us.

        • brucethemoose@lemmy.world
          link
          fedilink
          English
          arrow-up
          5
          ·
          edit-2
          6 小时前

          Perhaps ideological purism was never a good idea?

          …Like history suggests?


          Hence my radical preference: “a la carte” economic systems. Shameless capitalism, frothing communism, anarchism, authoritarian technocracy, even theocratic systems, they all excel in certain sectors and not others. Sometimes, in nutty combinations.

          So why idealize one?

          A “mix” has been reality for a long time, anyway, but I think that should be embraced more explicitly. Get systems where they’re good instead of shoehorning them where they’re horrific.

        • sigmaklimgrindset@sopuli.xyz
          link
          fedilink
          English
          arrow-up
          13
          ·
          6 小时前

          Idk how people think China is communist when they have for-profit hospitals, that’s like one of the biggest no-nos in communism lol.

          Even the public hospitals are incentivized towards profit optimizing through over-prescription of medication (or useless stuff like homeopathy) in my experience. But last time I went through Chinese healthcare was all the way back in 2017, so things may have improved now (but I doubt it.)

  • TropicalDingdong@lemmy.world
    link
    fedilink
    English
    arrow-up
    126
    ·
    12 小时前

    Please, please bring the world back to sanity. I was like, literally saving up to expand my homelab when my main server went down and have been utterly slapped by prices.

  • 0ops@piefed.zip
    link
    fedilink
    English
    arrow-up
    25
    ·
    11 小时前

    I hope somebody starts to pick up demand for NVME drives too 🤞