themachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 16 hours agoScientist says RAM pricing has risen to normalized 2007 levels, AI shortage undid 20 years of progress in a matter of months — memory prices had been falling exponentially for decadeswww.tomshardware.comexternal-linkmessage-square59fedilinkarrow-up1297 cross-posted to: technology@lemmy.mltechnology@beehaw.orgpcmasterrace@lemmy.worldtechnology@midwest.social
arrow-up1297external-linkScientist says RAM pricing has risen to normalized 2007 levels, AI shortage undid 20 years of progress in a matter of months — memory prices had been falling exponentially for decadeswww.tomshardware.comthemachinestops@lemmy.dbzer0.com to Technology@lemmy.worldEnglish · 16 hours agomessage-square59fedilink cross-posted to: technology@lemmy.mltechnology@beehaw.orgpcmasterrace@lemmy.worldtechnology@midwest.social
minus-squareThomasWilliams@lemmy.worldlinkfedilinkEnglisharrow-up1·5 hours agoLower inference costs will lead to more demand for RAM
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up3·4 hours agoWill it though? I posit there’s a saturation point where there’s “enough” LLM in use, and we are not far from that. The whole pitch from Altman and such is scaling models up. But that’s not working.
Lower inference costs will lead to more demand for RAM
Will it though?
I posit there’s a saturation point where there’s “enough” LLM in use, and we are not far from that.
The whole pitch from Altman and such is scaling models up. But that’s not working.