MadeInDex 📰🌎@lemmy.world to Technology@lemmy.worldEnglish · 2 days agoMark Zuckerberg Posts Deranged 6,500-Word Essay About Giving Everyone AI Superintelligencearchive.isexternal-linkmessage-square53fedilinkarrow-up1236cross-posted to: technology@lemmy.mltechnology@midwest.social
arrow-up1236external-linkMark Zuckerberg Posts Deranged 6,500-Word Essay About Giving Everyone AI Superintelligencearchive.isMadeInDex 📰🌎@lemmy.world to Technology@lemmy.worldEnglish · 2 days agomessage-square53fedilinkcross-posted to: technology@lemmy.mltechnology@midwest.social
minus-squareSeptimaeus@infosec.publinkfedilinkEnglisharrow-up3·24 hours agoI mean, you can have that today, in some form or other, since that’s just how local AI works.
minus-squareNouvellalia@lemmy.worldlinkfedilinkEnglisharrow-up2·20 hours agoTotally. It’s a bit pricey for anything like a genuine personal assistant right now though. $15k or so to get the basics.
minus-squareSeptimaeus@infosec.publinkfedilinkEnglisharrow-up2·edit-210 hours agoAtm the meta for local inference is unified memory and “routed” local agents (multiple smaller role-specific agents in a trench coat) The former is standout for cost efficiency (e.g., 4x RDMA 48gb Minis for a 192gb cluster @ $43/gb vs a $45k b200 alone) The latter is standout for many things, including resource efficiency on smaller machines
minus-squareNouvellalia@lemmy.worldlinkfedilinkEnglisharrow-up1·6 hours agoThat’ll surely work to automate simple mental labor or tasks, but I don’t think a swarm of minis is going to be able to provide impactful personal and psychosocial analysis of your life.
I mean, you can have that today, in some form or other, since that’s just how local AI works.
Totally. It’s a bit pricey for anything like a genuine personal assistant right now though. $15k or so to get the basics.
Atm the meta for local inference is unified memory and “routed” local agents (multiple smaller role-specific agents in a trench coat)
The former is standout for cost efficiency (e.g., 4x RDMA 48gb Minis for a 192gb cluster @ $43/gb vs a $45k b200 alone)
The latter is standout for many things, including resource efficiency on smaller machines
That’ll surely work to automate simple mental labor or tasks, but I don’t think a swarm of minis is going to be able to provide impactful personal and psychosocial analysis of your life.