• adb@lemmy.ml
    link
    fedilink
    English
    arrow-up
    15
    ·
    7 hours ago

    Yes, and let’s also not count all the investments in infrastructure because you know… like training and staff it’s not a real cost that’s essential to the business.

    Anyways, you wouldn’t happened to have heard that from Anthropocene or OpenAI?

    Somehow we don’t have any actual indisputable numbers (I wonder why) but it is actually quite controversial and some of those who have done deep research on the subject are saying inference IS run at a loss and it might not get profitable ever.

    https://www.ft.com/content/fce77ba4-6231-4920-9e99-693a6c38e7d5?syn-25a6b1a6=1

    • Pennomi@lemmy.world
      link
      fedilink
      English
      arrow-up
      5
      ·
      edit-2
      7 hours ago

      We do have numbers from comparably sized Chinese models.

      Yes, every AI company is bleeding money, they’re not healthy in any way. But inference by itself is profitable, based on everything that we know.

      Inference + amortizing the training costs is NOT profitable, which is what most people are talking about.

      This is easily fixed by not releasing a slightly different version every month.