NVIDIA’s Partners Are Beginning to Tilt Toward Google’s TPU Ecosystem : US Pioneer Global VC DIFCHQ SFO NYC Singapore – Riyadh Swiss Our Mind

with Foxconn Reportedly Securing TPU Rack Orders

Foxconn, one of NVIDIA’s largest supply chain partners, has reportedly received orders for AI clusters around Google’s TPUs, marking a significant shift for the Taiwanese manufacturer.

Foxconn Will Ship Out NVIDIA’s AI Servers & Google’s TPU Racks, Playing On Both Sides of the Game

There’s no doubt that the buzz around ASICs, especially after the release of Google’s latest Ironwood TPU platform, has become increasingly mainstream. More importantly, Google’s TPUs are rumored to be on the verge of adoption among several companies, with a notable name being Meta. This is why TPUs are evolving into a platform that is now targeting external adoption. According to a report by the Taiwan Economic Daily, Foxconn has received orders for Google’s TPU compute trays and will also collaborate on Google’s ‘Intrinsic’ robotics plans.

Related Story NVIDIA Hits Back at Claims That Google’s TPUs Could Overtake Its AI Stack, Saying It Offers “Greater Performance and Versatility” Than ASICs

Industry insiders say that Google’s AI servers, built with its self-developed TPUs, are mainly divided into two racks: one rack for TPUs and the other for computing trays. According to Google’s proposed supply chain, for every rack of TPUs shipped, Foxconn will ship one rack of computing trays, resulting in a 1:1 supply ratio.
– Taiwan Economic Daily

Well, if you are unaware, Google’s 7th-generation TPUs aren’t just limited to a chip configuration; rather, the firm has scalable ‘rack’ infrastructure in place, which it calls the ‘Superpod’. It offers 9,216 chips per pod, resulting in a cumulative performance of 42.5 exaFLOPS in aggregate FP8 compute workloads, with the InterChip Interconnect (ICI). Google utilizes a 3D Torus layout for its TPUs, which enables high-density interconnect across large numbers of chips. The report claims that Foxconn will be responsible for producing computing trays for Google, based on the TPU rack orders it receives.

A labeled diagram of a server rack titled 'Rack Subsystems' shows components including 'Upper drip pan,' '416V AC Input & AC/DC Rectifiers,' 'ToR,' 'Optical Patch Panels,' 'Rack Monitoring Tray,' 'TPU Tray,' 'Host Tray,' 'Cable Managers,' 'ICI Optical Fiber,' 'ICI Copper cables,'

Since inferencing is being a lot more dominant within AI workloads, companies are rushing to restructure their compute portfolio to get the best inference performance, within optimal TCOs, which is why Google’s TPUs are being touted as the leading candidate in the AI application phase. Of course, this raises a whole debate about whether NVIDIA could be replaced by custom silicon from Big Tech, but for now, it’s essential to note that the supply chain is witnessing immense interest in TPU solutions from Google.

Follow Wccftech on Google to get more of our news coverage in your feeds.

https://wccftech.com/nvidia-key-supply-chain-partner-foxconn-has-reportedly-won-orders-for-google-tpu/amp/