chobeat@lemmy.ml to Technology@lemmy.worldEnglish · 3 days agoMeet the AI workers who tell their friends and family to stay away from AIwww.theguardian.comexternal-linkmessage-square38fedilinkarrow-up1275cross-posted to: technology@beehaw.orgtechnology@lemmy.mlhackernews@lemmy.bestiver.setechnology@lemmy.zipsolarpunk@slrpnk.net
arrow-up1275external-linkMeet the AI workers who tell their friends and family to stay away from AIwww.theguardian.comchobeat@lemmy.ml to Technology@lemmy.worldEnglish · 3 days agomessage-square38fedilinkcross-posted to: technology@beehaw.orgtechnology@lemmy.mlhackernews@lemmy.bestiver.setechnology@lemmy.zipsolarpunk@slrpnk.net
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up3·edit-23 days agoBloefz has a great setup. Used Mi50s are cheap. An RTX 3090 + a cheap HEDT/Server CPU is another popular homelab config. Newer models run reasonably quickly on them, with the attention/dense layers on the GPU and sparse parts on the CPU.
Bloefz has a great setup. Used Mi50s are cheap.
An RTX 3090 + a cheap HEDT/Server CPU is another popular homelab config. Newer models run reasonably quickly on them, with the attention/dense layers on the GPU and sparse parts on the CPU.