• RedstoneValley@sh.itjust.works
      link
      fedilink
      arrow-up
      7
      ·
      16 hours ago

      Especially if you could use the space to display what the model is actually doing, like the thinking process or other current model states (prefill, decode, idly waiting for a slot…)

    • optional@sh.itjust.works
      link
      fedilink
      arrow-up
      3
      ·
      16 hours ago

      Wrong. If more processing power is used for displaying the spinner, then the actual task will take longer, thus the spinner will be displayed for a longer time, so the spinner becomes even more useful.