Jensen Huang desires to carry generative AI to each knowledge middle, the Nvidia co-founder and CEO mentioned throughout Computex in Taipei right this moment. Through the speech, Huang’s first public speech in virtually 4 years he mentioned, he made a slew of bulletins, together with chip launch dates, its DGX GH200 tremendous pc and partnerships with main firms. Right here’s all of the information from the two-hour-long keynote.
Nvidia’s GForce RTX 4080 Ti GPU for players is now in full manufacturing and being produced in “massive portions” with companions in Taiwan.
2. Huang introduced the Nvidia Avatar Cloud Engine (ACE) for Video games, an customizable AI mannequin foundry service with pre-trained fashions for sport builders. It would give NPCs extra character by means of AI-powered language interactions.
3. Nvidia Cuda computing mannequin now serves 4 million builders and greater than 3,000 purposes. Cuda seen 40 million downloads, together with 25 million simply final 12 months alone.
4. Full quantity manufacturing of GPU server HGX H100 has begun and is being manufactured by “firms throughout Taiwan,” Huang mentioned. He added it’s the world’s first pc that has a transformer engine in it.
5. Huang referred to Nvidia’s 2019 acquisition of supercomputer chipmaker Mellanox for $6.9 billion as “one of many biggest strategic selections” it has ever made.
6. Manufacturing of the subsequent technology of Hopper GPUs will begin in August 2024, precisely two years after the primary technology began manufacture.
7. Nvidia’s GH200 Grace Hopper is now in full manufacturing. The superchip boosts 4 PetaFIOPS TE, 72 Arm CPUs linked by chip-to-chip hyperlink, 96GB HBM3 and 576 GPU reminiscence. Huang described because the world’s first accelerated computing processor that additionally has a large reminiscence: “that is a pc, not a chip.” It’s designed for high-resilience knowledge middle purposes.
8. If the Grace Hopper’s reminiscence will not be sufficient, Nvidia has the answer—the DGX GH200. It’s made by first connecting eight Grace Hoppers togethers with three NVLINK Switches, then connecting the pods collectively at 900GB collectively. Then lastly, 32 are joined collectively, with one other layer of switches, to attach a complete of 256 Grace Hopper chips. The ensuing ExaFLOPS Transformer Engine has 144 TB GPU reminiscence and capabilities as a large GPU. Huang mentioned the Grace Hopper is so quick it might probably run the 5G stack in software program. Google Cloud, Meta and Microsoft would be the first firms to have entry to the DGX GH200 and can carry out analysis into its capabilities.
9. Nvidia and SoftBank have entered right into a partnership to introduce the Grace Hopper superchip into SoftBank’s new distributed knowledge facilities in Japan. They may have the ability to host generative AI and wi-fi purposes in a multi-tenant widespread server platform, decreasing prices and vitality.
10. The SoftBank-Nvidia partnership shall be primarily based on Nvidia MGX reference structure, which is at the moment being utilized in partnership with firms in Taiwan. It offers system producers a modular reference structure to assist them construct greater than 100 server variations for AI, accelerated computing and omniverse makes use of. Corporations within the partnership embrace ASRock Rack, Asus, Gigabyte, Pegatron, QCT and Supermicro.
11. Huang introduced the Spectrum-X accelerated networking platform to extend the velocity of Ethernet-based clouds. It consists of the Spectrum 4 swap, which has 128 ports of 400GB per second and 51.2T per second. The swap is designed to allow a brand new sort of Ethernet, Huang mentioned, and was designed end-to-end to do adaptive routing, isolate efficiency and do in-fabric computing. It additionally consists of the Bluefield 3 Sensible Nic, which connects to the Spectrum 4 swap to carry out congestion management.
12. WPP, the biggest advert company on the earth, has partnered with Nvidia to develop a content material engine primarily based on Nvidia Omniverse. Will probably be able to producing pictures and video content material for use in promoting.
13. Robotic platform Nvidia Isaac ARM is now accessible for anybody who desires to construct robots, and is full-stack, from chips to sensors. Isaac ARM begins with a chip referred to as Nova Orin and is the primary robotics full-reference stack, mentioned Huang.
Thanks in massive to its significance in AI computing, Nvidia’s inventory has soared over the previous 12 months, and it’s at the moment has a market valuation of about $960 billion, making it one of the worthwhile firms on the earth (solely Apple, Microsoft, Saudi Aramco, Alphabet and Amazon are ranked increased).