MI300X vs H100
More memory and FLOPS per dollar on AMD; CUDA and resale comps on NVIDIA.
The difference
On paper the MI300X wins: 192 GB of HBM3 against 80 GB, 5.3 TB/s against 3.35, and 1.3 times the dense FP8, at 750 W against 700 W. The H100’s advantages are CUDA and a deeper resale market.
Side by side
| Per GPU | H100 | MI300X | MI300X / H100 |
|---|---|---|---|
| Architecture, released | Hopper, Late 2022 | CDNA 3, December 2023 | |
| Memory | 80 GB HBM3 | 192 GB HBM3 | 2.40x |
| Memory bandwidth | 3.35 TB/s | 5.3 TB/s | 1.58x |
| BF16, dense TFLOPS | 989 | 1,307 | 1.32x |
| FP8, dense TFLOPS | 1,979 | 2,615 | 1.32x |
| FP4, dense TFLOPS | Not supported | Not supported | |
| FP64 (Tensor / matrix), TFLOPS | 67 | 163 | 2.44x |
| Max power per GPU | 700 W | 750 W | 1.07x |
| Power per 8 GPUs | About 10 kW | - | |
| GPU-to-GPU link | NVLink 4, 900 GB/s per GPU | Infinity Fabric, 7 links at 128 GB/s per GPU | |
| Scale-up domain | 8 GPUs (HGX board) | 8 GPUs per server | |
| Form factor, cooling | SXM5 module, 8-GPU HGX board; air | OAM module, 8-GPU platform; air | |
| Price per GPU, October 2026 | $14,250 (Used, typical realized sale) | - | |
| Launch price reported in the press | $25,000 to $40,000 per chip, analyst estimates (2024) | About $10,000 (Microsoft) to $15,000 (others), Citi (2024) | |
| Residual band, 2027 (conservative) | 11-19% of original price | - |
Tensor Core figures are dense. Prices as of October 2026.
Sources: American Compute, AMD, NVIDIA, CNBC, Tom's Hardware.
Where the MI300X leads
More memory and more FLOPS. AMD lists 2,614.9 dense FP8 TFLOPS against 1,979 for the H100 SXM, and eight MI300X GPUs carry 1.5 TB of HBM3 against 640 GB in an HGX H100. Analysts put the MI300X at about $10,000 to $15,000 a unit in early 2024, against $25,000 to $40,000 for the H100; neither vendor publishes a price.
Where the H100 leads
CUDA, and a deeper resale market. Teams with custom kernels pay a porting cost to move to ROCm that list prices do not show. We publish no MI300X resale benchmark, so an MI300X loan leans on the contract and an appraisal.
Sources: AMD, NVIDIA, Tom's Hardware, CNBC, American Compute.
Residual value and appraisals
| Year | H100 | MI300X |
|---|---|---|
| 2026 | 27-39% | - |
| 2027 | 11-19% | - |
| 2028 | 5-7% | - |
| 2029 | 2-3% | - |
| 2030 | 1% | - |
What a used unit is expected to fetch, as a share of its original price: the conservative band from our residual value report.
Discuss a transaction
Send us the equipment list and the loan or lease you have in mind. We will come back with an indication and the questions we would need answered.
Prefer email? hello@amcompute.com