Methodology
Provenance and ranking rules for the Inference Chip Index (TSK-JMZAF61X).
Data sources
- Repository: https://github.com/mlcommons/inference_results_v6.0
- Pinned commit:
4d3916ac9cf474b679cdfcf492d43a0559418ad1 - Division: Closed only · Workloads: llama3.1-8b, gpt-oss-120b, deepseek-r1
- Scenarios: Server, Interactive, Offline (when present)
Systems vs chips
Primary metric is the official submitted system Performance_Result. Per-accelerator derived values only when source establishes count — never inferred from name tokens like x8 or NVL72, and never the default ranking.
Comparability
Rankings never mix release, division, workload, scenario, accuracy target, metric, or unit. Quarantined / review-required rows (12) are excluded from rankings.