OpenAI isn’t running ChatGPT on RTX 5090’s, they use data centre hardware like the nVidia NVL72, which are entirely useless for anyone else. You wouldn’t even be able to boot it as it uses more power while idling than a residential home has access to, and up to 150kW at full load.
That’s the last generation. They’re moving from Blackwell to Rubin chips now, and the 72-GPU Rubin servers use up to 230 kW.
The typical residential connection in the U.S. has a 24 to 48 kW electrical connection. A block of houses might not have enough power infrastructure to power just one of these server racks.
I still has some use, it’s just that it’s not as good but still useful for people who want to save money and gaming pc builds
OpenAI isn’t running ChatGPT on RTX 5090’s, they use data centre hardware like the nVidia NVL72, which are entirely useless for anyone else. You wouldn’t even be able to boot it as it uses more power while idling than a residential home has access to, and up to 150kW at full load.
That’s the last generation. They’re moving from Blackwell to Rubin chips now, and the 72-GPU Rubin servers use up to 230 kW.
The typical residential connection in the U.S. has a 24 to 48 kW electrical connection. A block of houses might not have enough power infrastructure to power just one of these server racks.
Those GPUs will be about as useful as a bitcoin miner for gaming. As in exactly not useful.
They may be really useful for running your own local LLM, as long as you don’t mind the hefty power bill and jet engine noise.
LLM coops might have a big future