• glibg10b@lemmy.zip
    link
    fedilink
    arrow-up
    10
    ·
    22 hours ago

    Matrix multiplication, activation functions and softmax. Also some matrix addition sometimes. That’s literally it

    • agamemnonymous@sh.itjust.works
      link
      fedilink
      arrow-up
      1
      ·
      edit-2
      3 hours ago

      I mean yeah, the mechanism itself is straightforward, but isn’t a big thing that we don’t really know what it chooses for its… basis vectors? Something like that, I don’t do programming and I’m out of practice with matrices