NVIDIA’s New GH200 Grace Hopper Superchip
NVIDIA’s New GH200 Grace Hopper Superchip Platform Announcement Summary:
What? NVIDIA has launched its next-gen GH200 Grace Hopper Superchip platform, especially designed for accelerated computing and advanced AI tasks.
Specialty:
- It houses the world’s first HBM3e processor, which offers improved memory and bandwidth.
- It can connect multiple GPUs, resulting in impressive performance.
Performance:
- It’s designed for complex AI tasks like managing big language models and recommender systems.
- In its dual configuration, it offers up to 3.5x more memory and 3x more bandwidth compared to its predecessors. This setup includes a server with 144 Arm Neoverse cores, eight petaflops of AI performance, and 282GB of the latest HBM3e memory technology.
Advantages:
- This new platform can be easily scaled and implemented across entire data centers.
- It allows for the connection of GPUs to enhance performance without compromise.
- The Superchip can be linked with more Superchips using NVIDIA’s NVLink technology, allowing for better deployment of large AI models.
- The combined memory in a dual configuration can reach 1.2TB.
- The HBM3e memory is 50% faster than its predecessor, HBM3. This gives the platform the ability to run models that are 3.5x larger while also benefiting from 3x faster memory bandwidth.
Adoption:
- Many top manufacturers are already incorporating the previous version of the Grace Hopper Superchip into their systems.
- To promote widespread use, the new Superchip platform with HBM3e is fully compatible with the NVIDIA MGX server specification. This means manufacturers can easily integrate Grace Hopper into various server designs.
Availability:
- Systems based on this new platform are expected to be released by leading manufacturers in the second quarter of 2024.
For a more detailed look into the Grace Hopper platform, NVIDIA’s CEO Jensen Huang’s SIGGRAPH keynote address is available for viewing through the press release below.
investor.nvidia.com
World’s First HBM3e Processor Offers Groundbreaking Memory, Bandwidth; Ability to Connect Multiple GPUs for Exceptional Performance; Easily Scalable Server Design LOS ANGELES, Aug. 08, 2023 (GLOBE NEWSWIRE) - —SIGGRAPH-NVIDIA today announced the next-generation NVIDIA GH200 Grace Hopper™ platform — based … Continue reading
- 0 Replies
Sorry, there were no replies found.
Log in to reply.