Scaling to PCIe 6 is more bandwidth yes. But HBF is supposed to be going far faster, is the perception.
ksec · 4h ago
I am thinking not only in terms of GPU, but Database usage as well.
And 80TB with 1TB/s? Thanks to AI hardware is getting interesting again.
nialse · 2h ago
Agreed. Looking forward to having this kind of performance at hand for next to no money in 10 years. (Not sarcasm.)
Consolidation has gone from having a data center with separate servers for all functions, to consolidating in a couple of racks, and will go on to being single server plus redundancy for most workloads you can imagine at some point in the future. Unless AI manages to convince us that we need the performance and cooling of 10:s of kWs per rack.
Some times I imagine that the IT of most companies, the part that is not ”in the cloud” that is, could run on a single server already. And maybe could even host the cloud functions if the admin know how hadn’t been lost to time.
Scaling to PCIe 6 is more bandwidth yes. But HBF is supposed to be going far faster, is the perception.
And 80TB with 1TB/s? Thanks to AI hardware is getting interesting again.
Consolidation has gone from having a data center with separate servers for all functions, to consolidating in a couple of racks, and will go on to being single server plus redundancy for most workloads you can imagine at some point in the future. Unless AI manages to convince us that we need the performance and cooling of 10:s of kWs per rack.
Some times I imagine that the IT of most companies, the part that is not ”in the cloud” that is, could run on a single server already. And maybe could even host the cloud functions if the admin know how hadn’t been lost to time.