NVIDIA H100
More info
- Released
- Owner
- NVIDIA
- Type
- Datacenter GPU
The datacenter GPU that became the AI boom's bottleneck and NVIDIA's ticket to a trillion dollars.
Built on the Hopper architecture, launched 2022. 80 GB of HBM3, a Transformer Engine with FP8 support, and NVLink for wiring eight cards into one node. Successor to the A100, itself replaced by Blackwell (B200).
Through 2023–2024 lead times ran a year and the price sat around $30,000 per card — the entire industry's capacity was measured in "number of H100s". Export controls against China produced the cut-down H800 and H20 variants.