Lambda has provided more insight into its use of Nvidia’s co-packaged optic (CPO) networking switches, detailing a deployment spanning 10,000-plus GPUs.
The neocloud was among the companies given initial access to the photonic technology, revealing last November it was trialing the InfiniBand-based Quantum-X Q3450-LD switch.
Now, it’s revealed that the photonic switches are being fully utilized to connect tens-of-thousands of Blackwell Ultra GPUs at its 142-megawatt campus in Quebec, Canada. The switches, which come in a four-unit (4U) form factor, pack 144 800 Gb/s (800G) ports with 18 removable external light sources.
According to Lambda, using CPO enabled it to operate at a lower median temperature of 36°C, compared with 51°C for conventional optics, with the cooler optics providing up to 15-times higher reliability.
In addition to operating at cooler temperatures, the light-based interconnect provided “identical throughput” to conventional means, while providing for more stable signal integrity with lower latency gaps as the network scaled up.
“Networking has to keep pace with the demands of increasingly large AI clusters. Bringing co-packaged optics into a deployment of this scale is an important step toward building the efficient and resilient infrastructure needed to support the next generation of AI,” Dave Ward, president of cloud services at Lambda, explained.
Prior to Jensen Huang’s abrupt departure as CEO of Nvidia, the chip giant had been banking on CPO driving growth in its already strong networking unit.
Back when he was still chief executive, Huang told this title that optical interconnects will power switch sales “several orders of magnitude more” than it currently ships today. Nvidia also recently unveiled plans to dramatically scale optics manufacturing capacity by some fifteen-fold in order to meet anticipated demand, with Huang telling SDxCentral that scale-up networking alone will be a key driver.
“In an AI factory, the network is a business accelerator. Every interruption stalls the job, and every watt counts,” Gilad Shainer, Nvidia’s SVP for networking, noted following Lambda’s update. “Nvidia Photonics cuts network power, improves resiliency, and delivers up to [15-times] higher reliability, so Lambda’s customers get more productive GPU hours from their investment.”
Comments