Milk Road AI chart shows simultaneous price rises across A100, H100, H200, and B200; Nebius discloses Q2 revenue of $582M and a 30% price hike on older-generation GPUs
Nvidia GPU Rental Prices Rising Across All Four Generations Simultaneously
Rising prices across multiple GPU generations at once indicate that AI compute demand is broad, not confined to the newest hardware tier. This affects the cost base for organizations renting rather than owning GPU capacity for training and inference.
The full picture
Rental prices for Nvidia GPUs are rising or holding across four hardware generations simultaneously as of August 2026. The 2020-era A100 is renting at $1.65/hr and rising rather than declining, while H100 neocloud rates sit at $2.74/hr, H200 at $3.28/hr, and B200 at $5.61/hr with high volatility. H100 prices had fallen 64-75% from historical peaks near $8/hr and are stabilizing in a $2.19-$3.50/hr neocloud range depending on provider, while hyperscaler H100 rates remain higher. B200 pricing spiked above $6.00/hr during March 2026 before pulling back. JarvisLabs assessed a 10-20% further H100 decline as possible only if B200 supply expands broadly.
How it developed
Sources
Want this in your inbox?
I send a short email each morning with the stories that moved. If you would rather just read here, that works too.
Subscribe free