NVIDIA on August 27 announced NVHBM as part of NVLink Fusion, a custom memory architecture that embeds the memory controller in the HBM base die rather than on the XPU die, freeing silicon area for compute.
NVHBM delivers up to 30% greater bandwidth and 15% lower power than standard HBM4E while freeing up to 25% more XPU die area. Amazon's Annapurna Labs became the first named partner, committing to support NVHBM in its Trainium4 chips.