Is power ultimately > compute constraint in AI?
Dell let slip during their earnings call that the Nvidia B100 Blackwell will have a 1000W draw, that's a 40% increase over the H100. The current compute bottleneck will start to disappear by the end of this year and be gone by the end of 2025. After that, it's all about power.
— Andrew Curran (@AndrewCurran_) March 11, 2024
