Enterprise-ready security: ISO 27001 + SOC 2 Type I compliant.

Ultralytics Benchmarks

How YOLO26 performs on the Ultralytics Platform's NVIDIA GPUs — measured training throughput and inference latency, with memory, power, accuracy, and cost-efficiency, so you can pick the right GPU for your budget and timeline.

GPU Training Throughput

YOLO26 detection trained on COCO at 640px with auto-batch across every NVIDIA GPU on the Platform. Compare across devices or by model size, switch the chart metric, or filter by generation; the table is fully sortable.

Compare
Model
Chart metric
Generation
H200 SXM
Hopper
141 GB
490.6
221
40.2 GB
361 W
$4.39
402.3K
B300
Blackwell
288 GB
474.6
411
73.4 GB
457 W
$7.39
231.2K
H200 NVL
Hopper
143 GB
469.3
221
39.8 GB
283 W
$3.39
498.4K
H100 NVL
Hopper
94 GB
432.1
147
26.8 GB
274 W
$3.19
487.6K
H100 SXM
Hopper
80 GB
424.3
123
23.1 GB
315 W
$3.29
464.3K
RTX PRO 6000
Blackwell
96 GB
420.6
149
27.6 GB
319 W
$2.09
724.5K
B200
Blackwell
180 GB
404.9
281
50.4 GB
419 W
$5.89
247.5K
RTX 5090
Blackwell
32 GB
356
49
9.7 GB
304 W
$0.99
1.3M
RTX PRO 5000
Blackwell
48 GB
319.7
73
13.8 GB
220 W
$0.96
1.2M
RTX 4090
Ada
24 GB
306
35
13.5 GB
235 W
$0.69
1.6M
H100 PCIe
Hopper
80 GB
302.4
123
22.6 GB
197 W
$2.89
376.7K
RTX 6000 Ada
Ada
48 GB
294.8
73
13.9 GB
254 W
$0.77
1.4M
A100 SXM
Ampere
80 GB
286.8
123
23.1 GB
342 W
$1.49
692.9K
A100 PCIe
Ampere
80 GB
283.2
123
23.2 GB
328 W
$1.39
733.5K
L40S
Ada
48 GB
265.1
70
13.3 GB
258 W
$0.86
1.1M
L40
Ada
48 GB
255.5
68
13.1 GB
255 W
$0.99
929.1K
RTX PRO 4500
Blackwell
32 GB
249.7
49
11.0 GB
161 W
$0.64
1.4M
RTX A6000
Ampere
48 GB
209.9
73
13.9 GB
278 W
$0.49
1.5M
RTX PRO 4000
Blackwell
24 GB
193.9
35
7.0 GB
141 W
$0.57
1.2M
RTX 3090
Ampere
24 GB
184.8
35
13.3 GB
312 W
$0.46
1.4M
RTX A5000
Ampere
24 GB
171.2
35
7.1 GB
216 W
$0.27
2.3M
A40
Ampere
48 GB
161.2
70
13.4 GB
262 W
$0.44
1.3M
RTX A4500
Ampere
20 GB
149.2
30
9.1 GB
191 W
$0.25
2.1M
RTX 4000 Ada
Ada
20 GB
127.9
30
6.5 GB
98 W
$0.26
1.8M
L4
Ada
24 GB
116
33
10.2 GB
78 W
$0.39
1.1M
RTX 2000 Ada
Ada
16 GB
88
22
4.7 GB
60 W
$0.24
1.3M

Training methodology

We use training throughput — images processed per second during training — as the yardstick; it correlates directly with time-to-solution. Every result is measured on Ultralytics Platform GPUs — the same NVIDIA hardware you rent for cloud training in one click, from entry-level workstation cards up to flagship data-center GPUs. We train YOLO26 at all five sizes (n/s/m/l/x) so you can match a model to your hardware budget.

Settings. 2 epochs on 25% of COCO at 640px, AMP mixed precision, single GPU, with auto-batch (batch=-1) selecting the largest batch that fits in memory. We report the steady-state second epoch, which excludes first-epoch warmup (dataset caching, CUDA graph capture) and the end-of-run validation pass. Resolved batch size, peak VRAM (including the CUDA context), and peak board power are recorded directly from each GPU.

Cost-efficiency. Images per dollar = throughput × 3600 ÷ hourly price, using Ultralytics Platform on-demand pricing — it often reorders the ranking dramatically, as value cards out-earn flagship GPUs per dollar. Measured on ultralytics 8.4.68, torch 2.8, CUDA 12.8. See also the Train and Benchmark mode docs.

GPU Inference Speed

YOLO26 detection inference across formats (PyTorch, ONNX, TensorRT) and precisions (FP16, INT8) on every NVIDIA GPU on the Platform, timed at batch 1. Compare across devices or by model size, switch the format/precision and chart metric, or filter by generation; the sortable table also shows accuracy (mAP) and cost-efficiency.

Compare
Model
Format / precision
Chart metric
Generation
H200 NVL
Hopper
3.18
315
0.395
5.3 MB
1.32 GB
$3.39
334.1K
H100 NVL
Hopper
4.40
227
0.395
5.3 MB
1.21 GB
$3.19
256.5K
RTX 5090
Blackwell
4.41
227
0.395
5.3 MB
1.16 GB
$0.99
824K
RTX PRO 6000
Blackwell
4.55
220
0.395
5.3 MB
1.36 GB
$2.09
378.8K
L4
Ada
4.98
201
0.395
5.3 MB
0.85 GB
$0.39
1.9M
H200 SXM
Hopper
5.01
200
0.395
5.3 MB
1.30 GB
$4.39
163.8K
RTX PRO 5000
Blackwell
5.39
185
0.395
5.3 MB
1.01 GB
$0.96
695.3K
B300
Blackwell
5.44
184
0.395
5.3 MB
1.73 GB
$7.39
89.5K
Apple M5 Pro
Apple Silicon
MPS
5.67
177
0.395
5.3 MB
L40S
Ada
6.17
162
0.395
5.3 MB
1.17 GB
$0.86
678.6K
H100 SXM
Hopper
6.36
157
0.395
5.3 MB
1.18 GB
$3.29
172K
RTX 4090
Ada
6.67
150
0.395
5.3 MB
1.00 GB
$0.69
781.6K
RTX 6000 Ada
Ada
7.25
138
0.395
5.3 MB
1.19 GB
$0.77
645.2K
RTX PRO 4500
Blackwell
7.40
135
0.395
5.3 MB
0.88 GB
$0.64
760.5K
RTX A6000
Ampere
7.74
129
0.395
5.3 MB
0.87 GB
$0.49
948.5K
H100 PCIe
Hopper
7.92
126
0.395
5.3 MB
1.10 GB
$2.89
157.2K
A40
Ampere
7.96
126
0.395
5.3 MB
0.96 GB
$0.44
1M
RTX A5000
Ampere
8.25
121
0.395
5.3 MB
0.78 GB
$0.27
1.6M
B200
Blackwell
8.38
119
0.395
5.3 MB
$5.89
72.9K
RTX 2000 Ada
Ada
8.41
119
0.395
5.3 MB
0.62 GB
$0.24
1.8M
RTX PRO 4000
Blackwell
8.57
117
0.395
5.3 MB
0.83 GB
$0.57
737.1K
A100 SXM
Ampere
8.72
115
0.395
5.3 MB
1.34 GB
$1.49
276.9K
L40
Ada
8.76
114
0.395
5.3 MB
1.26 GB
$0.99
414.9K
RTX 4000 Ada
Ada
8.87
113
0.395
5.3 MB
0.61 GB
$0.26
1.6M
RTX 3090
Ampere
8.92
112
0.395
5.3 MB
0.84 GB
$0.46
877.3K
RTX A4500
Ampere
10.13
99
0.395
5.3 MB
0.61 GB
$0.25
1.4M
A100 PCIe
Ampere
11.04
91
0.395
5.3 MB
1.34 GB
$1.39
234.6K

Inference methodology

We use inference latency — milliseconds per image at batch 1 — as the yardstick; it's what real-time deployment cares about. Each YOLO26 size is exported to the format and precision shown, then we time steady-state prediction (warmup excluded, per-run times sigma-clipped) on the same Ultralytics Platform GPUs you deploy on.

Formats & precision. On NVIDIA GPUs: PyTorch FP16, ONNX FP16, and TensorRT FP16/INT8 (TensorRT 11.1.0.106 via NVIDIA ModelOpt). INT8 is calibrated on COCO128; accuracy (mAP50-95 on COCO val2017) is measured once per format/precision and shown per row, so the speed↔accuracy trade-off is explicit. INT8 pays off most on larger, compute-bound models — on the smallest models its quantization overhead can match or slightly trail FP16. ONNX inference runs on Ada/Ampere/Hopper GPUs (onnxruntime has no Blackwell kernels yet).

Apple Silicon. Mac devices (e.g. Apple M5 Pro) are profiled locally and merged into the table — pick a format to compare them directly against the cloud GPUs, or filter by the Apple Silicon generation. CoreML runs on the Neural Engine (the fastest Apple path, ~3× CPU), PyTorch on the MPS GPU, and ONNX on the CPU; each row's Backend column names the runtime. CoreML is timed with coremltools on the ANE — a relative host screen, not an iPhone-device number. Owned hardware has no rental price, so cost-efficiency (img/$) is GPU-only.

Cost-efficiency. Inferences per dollar = FPS × 3600 ÷ hourly price, using Ultralytics Platform on-demand pricing. Measured on ultralytics 8.4.71, torch 2.12, CUDA 13.2. See also the Predict and Benchmark mode docs.

Ready to build your next vision AI project?

Built on Ultralytics open source with 134.4k+ GitHub stars. Start training models in minutes.