NVIDIA published a blog post describing full-stack codesign approach to memory efficiency
Huang Dismisses 2029 Memory Glut Fears as NVIDIA Touts Memory Efficiency
Memory supply expectations shape investment and procurement decisions for the AI infrastructure buildout. The debate over whether a 2029 oversupply is coming puts pressure on memory chipmakers including SK Hynix, Samsung, and Micron.
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.
The full picture
NVIDIA CEO Jensen Huang pushed back against investor concern about a potential memory market oversupply by 2029, saying data centers can always absorb more memory. The concern was triggered by a South Korean opinion column published October 15 warning of a supply flood turning the market into a "red ocean" by 2029, with two experts cited in the column predicting the AI memory supercycle could end and the industry could enter a downturn by then. Memory stocks fell further after China's CXMT announced a new design architecture that raised investor fears it could take market share from SK Hynix, Samsung, and Micron. Separately, NVIDIA has described a full-stack codesign approach it says improves memory utilization across its hardware and software stack, citing techniques including NVFP4 precision, KV cache offloading via Dynamo software, and distributing model weights across up to 72 GPUs in an NVL72 system.
How it developed
Sources
Related
- Related storyNvidia Rubin memory cuts and HBM shortage
- The hyperscaler AI break-even gap
- Hyperscaler Q3 earnings and AI supply crunch
- Nvidia AI server prices and memory shortage
- Nvidia's NVHBM base die at TSMC
BackgroundCompute: the chips, clouds and data centers behind AI
Get the daily email
When stories like this move, I write about them in an email each morning.
One free email each morning, around 8 AM US Eastern.
Check your email.
I have sent you a confirmation link. One click and you are in.
Not in your inbox? Look in spam or promotions. If it's there, mark it "Not spam" so future editions land in your inbox.