☆ Yσɠƚԋσʂ ☆@lemmy.ml to Programmer Humor@lemmy.mlEnglish · 23 小时前OpenAI CEO Sam Altman says its “terrible to have everybody have a bunch of the world’s limited supply of DRAM” instead of shoving it all in datacentresfrvr.comexternal-linkmessage-square40fedilinkarrow-up154cross-posted to: programmer_humor@programming.dev
arrow-up154external-linkOpenAI CEO Sam Altman says its “terrible to have everybody have a bunch of the world’s limited supply of DRAM” instead of shoving it all in datacentresfrvr.com☆ Yσɠƚԋσʂ ☆@lemmy.ml to Programmer Humor@lemmy.mlEnglish · 23 小时前message-square40fedilinkcross-posted to: programmer_humor@programming.dev
minus-squareferric_carcinization@lemmy.mllinkfedilinkEnglisharrow-up2·6 小时前You don’t use local LLMs the whole time your computer is on. Still, there is no such thing as “wasted RAM”. The RAM programs aren’t “using” is used by the OS as cache. It is also possible to use VRAM as system RAM
You don’t use local LLMs the whole time your computer is on. Still, there is no such thing as “wasted RAM”. The RAM programs aren’t “using” is used by the OS as cache.
It is also possible to use VRAM as system RAM