The NVIDIA DGX GH200’s massive shared memory space uses NVLink interconnect technology with the NVLink Switch System to combine 256 GH200 superchips, allowing them to ...
Now, Jensen has announced the DGX GH200 massive-memory supercomputer for generative AI. Powered by Grace Hopper and NVLink to train large AI models and drive AI innovation forward. What DGX did for smaller AI, the GH200 will do for massive AI builders. The GH200 is interconnected with NVLink to provide 1 exaflop of AI performance and 144 terabytes of shared memory — nearly 500x more than the previous generation NVIDIA DGX A100, introduced in 2020.
Massive AI needs the performance and lossless packet delivery of Infiniband, but prefers the lower-cost and ubiquitous Ethernet networking to run its data centers. As the figure below shows in the upper right, Ethernet’s bandwidth fluctuates considerably as the TCP/IP protocol is durable to frequent packet drops. And thats just not ok with big AI.NVIDIA
NVIDIA’s solution is to provide these customers with Spectrum-X, a combination of a new “Spectrum-4” Ethernet switch combined with the high performance BlueField-3 DPU. The combination of the Spectrum-4 switch, the BlueField NIC, and the NVIDIA networking software stack achieves 1.7x better overall AI performance and power efficiency, along with the consistency afforded by a lossless network. Thats right: NVIDIA is promising an Ethernet network that.
Could this change? Yes. Competition will always nibble at NVIDIA’s heels. AMD has a serious entry into the market coming soon, the MI300, later this year. RISC-V solutions like Tenstorrent and Esperanto are getting attention and traction, but not in the market where Jensen is focussed: massive Foundation Models. Intel could pull a rabbit out of the hat with Gaudi3 and/or the forever-late PonteVecchio GPU.
But as I have said in the past, considering NVIDIA’s superior hardware combined with the depth and breadth of NVIDIA’s software to optimize AI and HPC applications, all competitors combined could maybe get 10% of the market. In a $75B market, that could be plenty to float some more boats.
Österreich Neuesten Nachrichten, Österreich Schlagzeilen
Similar News:Sie können auch ähnliche Nachrichten wie diese lesen, die wir aus anderen Nachrichtenquellen gesammelt haben.
How to watch Nvidia’s Computex 2023 keynote (and what to expect)Here’s how to tune in live.
Weiterlesen »
3 investing tips as the federal debt ceiling 'X-date' approachesMany investors are bracing for economic fallout as the federal debt ceiling 'X-date' deadline approaches. Here's how to invest, according to advisors.
Weiterlesen »
KTTH Freedom Series: Seattle, Bellevue have dramatically different approaches to crimeMany see Seattle as the gritty big brother struggling to address drugs and crime while Bellevue is viewed as the shining city on the hill that seems to have the dog by the tail.
Weiterlesen »
Chip stocks AMD and Nvidia are among the most overbought stocks on Wall Street amid A.I. crazeInvestors piled into the artificial intelligence play this week after Nvidia's blockbuster quarter.
Weiterlesen »