Hardware directory
Find hardware for your model and compare its memory budget and inference speed.
162 matches / 162 total
Capacity includes the calculator’s safety margin. Largest checkpoint at Q4 · 4K · KV FP16 · batch 1
| Compare | Save | ||||||
|---|---|---|---|---|---|---|---|
| A100 80 GiB | Dedicated | 80 / 80 GiB | 2,039 GB/s | 400 W | 116.83B | ||
| AMD RX 6600 (8 GiB) | Dedicated | 8 / 8 GiB | 224 GB/s | 132 W | 8.83B | ||
| AMD RX 6600 XT (8 GiB) | Dedicated | 8 / 8 GiB | 256 GB/s | 160 W | 8.83B | ||
| AMD RX 6650 XT (8 GiB) | Dedicated | 8 / 8 GiB | 280 GB/s | 180 W | 8.83B | ||
| AMD RX 6700 (10 GiB) | Dedicated | 10 / 10 GiB | 320 GB/s | 175 W | 10.73B | ||
| AMD RX 6700 XT (12 GiB) | Dedicated | 12 / 12 GiB | 384 GB/s | 230 W | 15.71B | ||
| AMD RX 6750 XT (12 GiB) | Dedicated | 12 / 12 GiB | 432 GB/s | 250 W | 15.71B | ||
| AMD RX 6800 (16 GiB) | Dedicated | 16 / 16 GiB | 512 GB/s | 250 W | 20.91B | ||
| AMD RX 6800 XT (16 GiB) | Dedicated | 16 / 16 GiB | 512 GB/s | 300 W | 20.91B | ||
| AMD RX 6900 XT (16 GiB) | Dedicated | 16 / 16 GiB | 512 GB/s | 300 W | 20.91B | ||
| AMD RX 6950 XT (16 GiB) | Dedicated | 16 / 16 GiB | 576 GB/s | 335 W | 20.91B | ||
| AMD RX 7600 (8 GiB) | Dedicated | 8 / 8 GiB | 288 GB/s | 165 W | 8.83B | ||
| AMD RX 7600 XT (16 GiB) | Dedicated | 16 / 16 GiB | 288 GB/s | 190 W | 20.91B | ||
| AMD RX 7700 XT (12 GiB) | Dedicated | 12 / 12 GiB | 432 GB/s | 245 W | 15.71B | ||
| AMD RX 7800 XT (16 GiB) | Dedicated | 16 / 16 GiB | 624 GB/s | 263 W | 20.91B | ||
| AMD RX 7900 GRE (16 GiB) | Dedicated | 16 / 16 GiB | 576 GB/s | 260 W | 20.91B | ||
| AMD RX 7900 XT (20 GiB) | Dedicated | 20 / 20 GiB | 800 GB/s | 315 W | 27.78B | ||
| AMD RX 7900 XTX (24 GiB) | Dedicated | 24 / 24 GiB | 960 GB/s | 355 W | 34.39B | ||
| AMD RX 9060 XT (16 GiB) | Dedicated | 16 / 16 GiB | 320 GB/s | 180 W | 20.91B | ||
| AMD RX 9070 (16 GiB) | Dedicated | 16 / 16 GiB | 640 GB/s | 220 W | 20.91B | ||
| AMD RX 9070 XT (16 GiB) | Dedicated | 16 / 16 GiB | 640 GB/s | 304 W | 20.91B | ||
| AMD Ryzen AI 9 HX 370 (32 GiB system, 24 GiB GPU-accessible) | Unified | 32 / 24 GiB | 89.6 GB/s | 54 W | 34.39B | ||
| AMD Ryzen AI 9 HX 370 (64 GiB system, 48 GiB GPU-accessible) | Unified | 64 / 48 GiB | 102.4 GB/s | 54 W | 70.55B | ||
| AMD Ryzen AI 9 HX 370 (96 GiB system, 72 GiB GPU-accessible) | Unified | 96 / 72 GiB | 128 GB/s | 54 W | 72.71B | ||
| AMD Ryzen AI MAX+ 395 (128 GiB system, 96 GiB GPU-accessible) | Unified | 128 / 96 GiB | 256 GB/s | 120 W | 140.62B | ||
| Apple M1 Max 32 GiB | Unified | 32 / 24 GiB | 400 GB/s | — | 34.39B | ||
| Apple M1 Max 64 GiB | Unified | 64 / 48 GiB | 400 GB/s | — | 70.55B | ||
| Apple M2 Max (32 GiB) | Unified | 32 / 24 GiB | 400 GB/s | 100 W | 34.39B | ||
| Apple M2 Max (64 GiB) | Unified | 64 / 48 GiB | 400 GB/s | 100 W | 70.55B | ||
| Apple M2 Max (96 GiB) | Unified | 96 / 72 GiB | 400 GB/s | 100 W | 72.71B | ||
| Apple M2 Pro (16 GiB) | Unified | 16 / 12 GiB | 200 GB/s | 67 W | 15.71B | ||
| Apple M2 Ultra (64 GiB) | Unified | 64 / 48 GiB | 800 GB/s | 230 W | 70.55B | ||
| Apple M2 Ultra (128 GiB) | Unified | 128 / 96 GiB | 800 GB/s | 230 W | 140.62B | ||
| Apple M2 Ultra (192 GiB) | Unified | 192 / 144 GiB | 800 GB/s | 230 W | 140.62B | ||
| Apple M3 Max (36 GiB) | Unified | 36 / 27 GiB | 300 GB/s | 115 W | 34.39B | ||
| Apple M3 Max (48 GiB) | Unified | 48 / 36 GiB | 400 GB/s | 115 W | 46.7B | ||
| Apple M3 Max (64 GiB) | Unified | 64 / 48 GiB | 400 GB/s | 115 W | 70.55B | ||
| Apple M3 Max (96 GiB) | Unified | 96 / 72 GiB | 400 GB/s | 115 W | 72.71B | ||
| Apple M3 Max (128 GiB) | Unified | 128 / 96 GiB | 400 GB/s | 115 W | 140.62B | ||
| Apple M3 Pro (18 GiB) | Unified | 18 / 13.5 GiB | 150 GB/s | 75 W | 15.71B | ||
| Apple M3 Pro (36 GiB) | Unified | 36 / 27 GiB | 150 GB/s | 75 W | 34.39B | ||
| Apple M3 Ultra (256 GiB) | Unified | 256 / 192 GiB | 819.2 GB/s | 250 W | 235.74B | ||
| Apple M3 Ultra (512 GiB) | Unified | 512 / 384 GiB | 819.2 GB/s | 250 W | 480.15B | ||
| Apple M4 (16 GiB) | Unified | 16 / 12 GiB | 120 GB/s | 45 W | 15.71B | ||
| Apple M4 (24 GiB) | Unified | 24 / 18 GiB | 120 GB/s | 45 W | 23.57B | ||
| Apple M4 (32 GiB) | Unified | 32 / 24 GiB | 120 GB/s | 45 W | 34.39B | ||
| Apple M4 Max (64 GiB) | Unified | 64 / 48 GiB | 546 GB/s | 140 W | 70.55B | ||
| Apple M4 Max (96 GiB) | Unified | 96 / 72 GiB | 546 GB/s | 140 W | 72.71B | ||
| Apple M4 Max (128 GiB) | Unified | 128 / 96 GiB | 546 GB/s | 140 W | 140.62B | ||
| Apple M4 Pro (32 GiB) | Unified | 32 / 24 GiB | 273 GB/s | 85 W | 34.39B | ||
| Apple M4 Pro (48 GiB) | Unified | 48 / 36 GiB | 273 GB/s | 85 W | 46.7B | ||
| Apple M4 Pro (64 GiB) | Unified | 64 / 48 GiB | 273 GB/s | 85 W | 70.55B | ||
| Apple M5 (16 GiB) | Unified | 16 / 12 GiB | 153 GB/s | 50 W | 15.71B | ||
| Apple M5 (24 GiB) | Unified | 24 / 18 GiB | 153 GB/s | 50 W | 23.57B | ||
| Apple M5 (32 GiB) | Unified | 32 / 24 GiB | 153 GB/s | 50 W | 34.39B | ||
| Apple M5 Max (48 GiB) | Unified | 48 / 36 GiB | 614 GB/s | 150 W | 46.7B | ||
| Apple M5 Max (64 GiB) | Unified | 64 / 48 GiB | 614 GB/s | 150 W | 70.55B | ||
| Apple M5 Max (96 GiB) | Unified | 96 / 72 GiB | 614 GB/s | 150 W | 72.71B | ||
| Apple M5 Max 128 GiB | Unified | 128 / 96 GiB | 614 GB/s | 150 W | 140.62B | ||
| Apple M5 Pro (24 GiB) | Unified | 24 / 18 GiB | 307 GB/s | 95 W | 23.57B | ||
| Apple M5 Pro (48 GiB) | Unified | 48 / 36 GiB | 307 GB/s | 95 W | 46.7B | ||
| Apple M5 Pro (64 GiB) | Unified | 64 / 48 GiB | 307 GB/s | 95 W | 70.55B | ||
| GB200 Blackwell GPU 186 GiB | Dedicated | 186 / 186 GiB | 8,000 GB/s | 1200 W | 235.74B | ||
| GTX 1050 Ti 4 GiB | Dedicated | 4 / 4 GiB | 112.1 GB/s | 75 W | 3.84B | ||
| GTX 1060 3 GiB | Dedicated | 3 / 3 GiB | 192 GB/s | 120 W | 3.09B | ||
| GTX 1060 6 GiB | Dedicated | 6 / 6 GiB | 192 GB/s | 120 W | 7.62B | ||
| GTX 1070 8 GiB | Dedicated | 8 / 8 GiB | 256 GB/s | 150 W | 8.83B | ||
| GTX 1070 Ti 8 GiB | Dedicated | 8 / 8 GiB | 256 GB/s | 180 W | 8.83B | ||
| GTX 1080 8 GiB | Dedicated | 8 / 8 GiB | 320 GB/s | 180 W | 8.83B | ||
| GTX 1080 Ti 11 GiB | Dedicated | 11 / 11 GiB | 484 GB/s | 250 W | 15.71B | ||
| GTX 1630 4 GiB | Dedicated | 4 / 4 GiB | 96 GB/s | 75 W | 3.84B | ||
| GTX 1650 GDDR5 4 GiB | Dedicated | 4 / 4 GiB | 128 GB/s | 75 W | 3.84B | ||
| GTX 1650 GDDR6 4 GiB | Dedicated | 4 / 4 GiB | 192 GB/s | 75 W | 3.84B | ||
| GTX 1650 SUPER 4 GiB | Dedicated | 4 / 4 GiB | 192 GB/s | 100 W | 3.84B | ||
| GTX 1660 6 GiB | Dedicated | 6 / 6 GiB | 192 GB/s | 120 W | 7.62B | ||
| GTX 1660 SUPER 6 GiB | Dedicated | 6 / 6 GiB | 336 GB/s | 125 W | 7.62B | ||
| GTX 1660 Ti 6 GiB | Dedicated | 6 / 6 GiB | 288 GB/s | 120 W | 7.62B | ||
| H100 80 GiB | Dedicated | 80 / 80 GiB | 3,350 GB/s | 700 W | 116.83B | ||
| H200 SXM 141 GiB | Dedicated | 141 / 141 GiB | 4,800 GB/s | 700 W | 140.62B | ||
| Instinct MI210 (64 GiB) | Dedicated | 64 / 64 GiB | 1,638 GB/s | 300 W | 72.71B | ||
| Instinct MI250 128 GiB | Dedicated | 128 / 128 GiB | 3,200 GB/s | 500 W | 140.62B | ||
| L40S 48 GiB | Dedicated | 48 / 48 GiB | 864 GB/s | 350 W | 70.55B | ||
| Mac 16 GiB unified memory | Unified | 16 / 12 GiB | — | — | 15.71B | ||
| Mac 24 GiB unified memory | Unified | 24 / 18 GiB | — | — | 23.57B | ||
| Mac 36 GiB unified memory | Unified | 36 / 27 GiB | — | — | 34.39B | ||
| Mac 48 GiB unified memory | Unified | 48 / 36 GiB | — | — | 46.7B | ||
| Mac 64 GiB unified memory | Unified | 64 / 48 GiB | — | — | 70.55B | ||
| Mac 128 GiB unified memory | Unified | 128 / 96 GiB | — | — | 140.62B | ||
| Mac 192 GiB unified memory | Unified | 192 / 144 GiB | — | — | 140.62B | ||
| NVIDIA A2 (16 GiB) | Dedicated | 16 / 16 GiB | 200 GB/s | 60 W | 20.91B | ||
| NVIDIA A10G (24 GiB) | Dedicated | 24 / 24 GiB | 600 GB/s | 300 W | 34.39B | ||
| NVIDIA A16 GPU 16 GiB | Dedicated | 16 / 16 GiB | 200 GB/s | — | 20.91B | ||
| NVIDIA A30 24 GiB | Dedicated | 24 / 24 GiB | 933 GB/s | 165 W | 34.39B | ||
| NVIDIA A40 (48 GiB) | Dedicated | 48 / 48 GiB | 696 GB/s | 300 W | 70.55B | ||
| NVIDIA A100 (40 GiB) | Dedicated | 40 / 40 GiB | 1,555 GB/s | 400 W | 57.41B | ||
| NVIDIA A800 (40 GiB) | Dedicated | 40 / 40 GiB | 1,555.2 GB/s | 400 W | 57.41B | ||
| NVIDIA A800 (80 GiB) | Dedicated | 80 / 80 GiB | 1,935 GB/s | 400 W | 116.83B | ||
| NVIDIA B100 (192 GiB) | Dedicated | 192 / 192 GiB | 8,000 GB/s | 1000 W | 235.74B | ||
| NVIDIA B200 192 GiB (ApX) | Dedicated | 192 / 192 GiB | 8,000 GB/s | 1200 W | 235.74B | ||
| NVIDIA Blackwell B300 (288 GiB) | Dedicated | 288 / 288 GiB | 8,000 GB/s | 1000 W | 405.85B | ||
| NVIDIA GB10 Grace Blackwell (128 GiB) - DGX Spark | Unified | 128 / 128 GiB | 273.2 GB/s | 140 W | 140.62B | ||
| NVIDIA H20 (96 GiB) | Dedicated | 96 / 96 GiB | 4,000 GB/s | 400 W | 140.62B | ||
| NVIDIA H100 NVL (94 GiB) | Dedicated | 94 / 94 GiB | 3,938 GB/s | 700 W | 140.62B | ||
| NVIDIA H100 PCIe (80 GiB) | Dedicated | 80 / 80 GiB | 2,000 GB/s | 350 W | 116.83B | ||
| NVIDIA H200 NVL (141 GiB) | Dedicated | 141 / 141 GiB | 4,800 GB/s | 600 W | 140.62B | ||
| NVIDIA H800 (80 GiB) | Dedicated | 80 / 80 GiB | 2,000 GB/s | 700 W | 116.83B | ||
| NVIDIA HGX B200 180 GiB | Dedicated | 180 / 180 GiB | 7,700 GB/s | 1000 W | 235.74B | ||
| NVIDIA L4 24 GiB | Dedicated | 24 / 24 GiB | 300 GB/s | 72 W | 34.39B | ||
| NVIDIA L20 (48 GiB) | Dedicated | 48 / 48 GiB | 864 GB/s | 275 W | 70.55B | ||
| NVIDIA L40 (48 GiB) | Dedicated | 48 / 48 GiB | 864 GB/s | 300 W | 70.55B | ||
| NVIDIA RTX 2000 Ada Generation (16 GiB) | Dedicated | 16 / 16 GiB | 224 GB/s | 70 W | 20.91B | ||
| NVIDIA RTX 3070 Ti (8 GiB) | Dedicated | 8 / 8 GiB | 608 GB/s | 290 W | 8.83B | ||
| NVIDIA RTX 3080 (10 GiB) | Dedicated | 10 / 10 GiB | 760.3 GB/s | 320 W | 10.73B | ||
| NVIDIA RTX 3080 (12 GiB) | Dedicated | 12 / 12 GiB | 912 GB/s | 350 W | 15.71B | ||
| NVIDIA RTX 3080 Ti (12 GiB) | Dedicated | 12 / 12 GiB | 912.4 GB/s | 350 W | 15.71B | ||
| NVIDIA RTX 3090 Ti (24 GiB) | Dedicated | 24 / 24 GiB | 1,008 GB/s | 450 W | 34.39B | ||
| NVIDIA RTX 4070 SUPER (12 GiB) | Dedicated | 12 / 12 GiB | 504.2 GB/s | 220 W | 15.71B | ||
| NVIDIA RTX 4070 Ti (12 GiB) | Dedicated | 12 / 12 GiB | 504.2 GB/s | 285 W | 15.71B | ||
| NVIDIA RTX 4080 (16 GiB) | Dedicated | 16 / 16 GiB | 716.8 GB/s | 320 W | 20.91B | ||
| NVIDIA RTX 4080 SUPER (16 GiB) | Dedicated | 16 / 16 GiB | 736.3 GB/s | 320 W | 20.91B | ||
| NVIDIA RTX 4500 Ada Generation (24 GiB) | Dedicated | 24 / 24 GiB | 432 GB/s | 210 W | 34.39B | ||
| NVIDIA RTX 4500 Blackwell (32 GiB) | Dedicated | 32 / 32 GiB | 896 GB/s | 175 W | 46.7B | ||
| NVIDIA RTX 5000 Ada Generation (32 GiB) | Dedicated | 32 / 32 GiB | 576 GB/s | 250 W | 46.7B | ||
| NVIDIA RTX 5000 Blackwell (48 GiB) | Dedicated | 48 / 48 GiB | 1,344 GB/s | 250 W | 70.55B | ||
| NVIDIA RTX 5060 (8 GiB) | Dedicated | 8 / 8 GiB | 448 GB/s | 130 W | 8.83B | ||
| NVIDIA RTX 5060 Ti (8 GiB) | Dedicated | 8 / 8 GiB | 448 GB/s | 180 W | 8.83B | ||
| NVIDIA RTX 5060 Ti (16 GiB) | Dedicated | 16 / 16 GiB | 448 GB/s | 185 W | 20.91B | ||
| NVIDIA RTX 5070 (12 GiB) | Dedicated | 12 / 12 GiB | 672 GB/s | 220 W | 15.71B | ||
| NVIDIA RTX 5070 Ti (16 GiB) | Dedicated | 16 / 16 GiB | 896 GB/s | 300 W | 20.91B | ||
| NVIDIA RTX 5080 (16 GiB) | Dedicated | 16 / 16 GiB | 960 GB/s | 360 W | 20.91B | ||
| NVIDIA RTX 6000 Ada Generation (48 GiB) | Dedicated | 48 / 48 GiB | 960 GB/s | 300 W | 70.55B | ||
| NVIDIA RTX 6000 Blackwell (96 GiB) | Dedicated | 96 / 96 GiB | 1,792 GB/s | 500 W | 140.62B | ||
| NVIDIA RTX A4000 (16 GiB) | Dedicated | 16 / 16 GiB | 448 GB/s | 140 W | 20.91B | ||
| NVIDIA RTX A5000 (24 GiB) | Dedicated | 24 / 24 GiB | 768 GB/s | 230 W | 34.39B | ||
| NVIDIA RTX PRO 4000 Blackwell (24 GiB) | Dedicated | 24 / 24 GiB | 672 GB/s | 145 W | 34.39B | ||
| NVIDIA RTX PRO 4000 Blackwell SFF (24 GiB) | Dedicated | 24 / 24 GiB | 432 GB/s | 70 W | 34.39B | ||
| NVIDIA RTX PRO 5000 Blackwell (72 GiB) | Dedicated | 72 / 72 GiB | 1,344 GB/s | 300 W | 72.71B | ||
| NVIDIA Rubin R100 (288 GiB) | Dedicated | 288 / 288 GiB | 22,000 GB/s | 1000 W | 405.85B | ||
| NVIDIA T4 16 GiB | Dedicated | 16 / 16 GiB | 320 GB/s | 70 W | 20.91B | ||
| Radeon AI PRO R9700 (32 GiB) | Dedicated | 32 / 32 GiB | 643.2 GB/s | 300 W | 46.7B | ||
| Radeon PRO W6600 (8 GiB) | Dedicated | 8 / 8 GiB | 224 GB/s | 100 W | 8.83B | ||
| Radeon PRO W6800 (32 GiB) | Dedicated | 32 / 32 GiB | 512 GB/s | 250 W | 46.7B | ||
| Radeon PRO W7500 (8 GiB) | Dedicated | 8 / 8 GiB | 176 GB/s | 70 W | 8.83B | ||
| Radeon PRO W7600 (8 GiB) | Dedicated | 8 / 8 GiB | 288 GB/s | 130 W | 8.83B | ||
| Radeon PRO W7700 (16 GiB) | Dedicated | 16 / 16 GiB | 576 GB/s | 190 W | 20.91B | ||
| Radeon PRO W7800 (32 GiB) | Dedicated | 32 / 32 GiB | 576 GB/s | 260 W | 46.7B | ||
| Radeon PRO W7900 (48 GiB) | Dedicated | 48 / 48 GiB | 864 GB/s | 295 W | 70.55B | ||
| Radeon RX 580 8 GiB | Dedicated | 8 / 8 GiB | 256 GB/s | 185 W | 8.83B | ||
| RTX 3060 12 GiB | Dedicated | 12 / 12 GiB | 360 GB/s | 170 W | 15.71B | ||
| RTX 3060 Ti 8 GiB | Dedicated | 8 / 8 GiB | 448 GB/s | 200 W | 8.83B | ||
| RTX 3070 8 GiB | Dedicated | 8 / 8 GiB | 448 GB/s | 220 W | 8.83B | ||
| RTX 3090 24 GiB | Dedicated | 24 / 24 GiB | 936.2 GB/s | 350 W | 34.39B | ||
| RTX 4000 Ada Generation 20 GiB | Dedicated | 20 / 20 GiB | 360 GB/s | 130 W | 27.78B | ||
| RTX 4060 8 GiB | Dedicated | 8 / 8 GiB | 272 GB/s | 115 W | 8.83B | ||
| RTX 4060 Ti 8 GiB | Dedicated | 8 / 8 GiB | 288 GB/s | 160 W | 8.83B | ||
| RTX 4060 Ti 16 GiB | Dedicated | 16 / 16 GiB | 288 GB/s | 165 W | 20.91B | ||
| RTX 4070 12 GiB | Dedicated | 12 / 12 GiB | 504 GB/s | 200 W | 15.71B | ||
| RTX 4070 Ti Super 16 GiB | Dedicated | 16 / 16 GiB | 672.3 GB/s | 285 W | 20.91B | ||
| RTX 4090 24 GiB | Dedicated | 24 / 24 GiB | 1,008 GB/s | 450 W | 34.39B | ||
| RTX 4090 D 24 GiB | Dedicated | 24 / 24 GiB | 1,008 GB/s | 425 W | 34.39B | ||
| RTX 5090 32 GiB | Dedicated | 32 / 32 GiB | 1,792 GB/s | 575 W | 46.7B | ||
| RTX A6000 48 GiB | Dedicated | 48 / 48 GiB | 768 GB/s | 300 W | 70.55B |