They will give us the real cost later. But my guess is --- whatever the market will bear.
incomingpain · 10h ago
If running at home on a beefy video game setup, it's ~200watts or probably in the area of $100/year.
But you're not using it at full blast 24x7 most likely. You could be servicing a ton of people on that $100.
Now the big cloud AI will be using more power than that, and also have engineers for better efficiency. More efficient AI cards will be used. When chatgpt charges $20/month. They are covering all the electrical costs for sure.
bell-cot · 10h ago
Does the number actually matter? The richest / most powerful / most ruthless 0.00001% are hot for massive ramp-ups of AI. "Checks and balances" have gone the way of the 8-track tape.
(Yeah, I get that real numbers would really excite the folks whose on-line creds or incomes rely on them denouncing Bad Things. But without any power to change things - it's kinda like a bunch of 3rd-class passengers on the Titanic chanting "slow down, slow down". 100% feel-good, zero lives saved.)
But you're not using it at full blast 24x7 most likely. You could be servicing a ton of people on that $100.
Now the big cloud AI will be using more power than that, and also have engineers for better efficiency. More efficient AI cards will be used. When chatgpt charges $20/month. They are covering all the electrical costs for sure.
(Yeah, I get that real numbers would really excite the folks whose on-line creds or incomes rely on them denouncing Bad Things. But without any power to change things - it's kinda like a bunch of 3rd-class passengers on the Titanic chanting "slow down, slow down". 100% feel-good, zero lives saved.)