Shortly follows Microsoft’s similar preview
Google has given a sneak peak of its upcoming Nvidia Blackwell GB200 NVL racks for its artificial intelligence (AI) cloud platform.
The reveal shortly follows a similar preview from Microsoft, showing the GB200s are on their way to being deployed by the hyperscalers.
The images shared by Google show the liquid-cooled GB200 GPUs, each of which features one Grace CPU and one B200 AI GPU for up to 90 TFLOPS of FP64 compute.
The racks are customized, so the exact configuration is unknown. In a post on X, formerly known as Twitter, Google Cloud said: “We’ve been working closely with Nvidia to sustainable build compute infrastructure of the future.”
The image displays two racks standing side-by-side, connecting Nvidia’s Blackwell cards with the rest of Google’s infrastructure, including power distribution units, networking switches, and cooling distribution units.
While Nvidia recommends InfiniBand for connectivity, TechPowerUp speculates that as Google’s infrastructure is set up differently, it may be using ethernet switches.
Last week, Microsoft revealed that it has Nvidia Blackwell systems up and running. Microsoft’s deployment differs from Google’s in that the Google design uses additional rack space to distribute coolant to its local heat exchangers.
Nvidia announced the Blackwell GPU family in March of this year. The GPUs are manufactured using a custom-built, two-reticle limit 4NP TSMC process with GPU dies connected by 10TBps chip-to-chip link into a single, unified GPU.
The GPU has 208 billion transistors, an increase on the 80bn in the Hopper series, and includes a second-generation transformer engine and new four-bit floating point AI inference capabilities. It is estimated that an NVL72 GB200 machine with a 72 B200 graphics processor will require around 120kW of power.
In August, the Blackwell GPU family was reported to be facing delays due to an unexpected design flaw. Later that month, the company stated that the issue had been resolved.
https://www.datacenterdynamics.com/en/news/google-offers-sneak-peak-at-its-nvidia-blackwell-gb200-nvl-racks/