Inference Chip Index

Updates

Dataset manifest + changelog.

Current manifest

Dataset: inference-chip-index-v6.0-closed-llm-v1

Freshness: fresh · Generated: 2026-09-03T09:55:13Z

Accepted / quarantined: 155 / 12 · Slices: 9

Source commit: 4d3916ac9cf474b679cdfcf492d43a0559418ad1

Changelog

# Changelog — inference-chip-index dataset v1

## 2026-09-03 — importer + systems (TSK-WAN8H9G1)

- Source: `https://github.com/mlcommons/inference_results_v6.0` @ `4d3916ac9cf474b679cdfcf492d43a0559418ad1`
- Scope: Closed division; workloads llama3.1-8b, gpt-oss-120b, deepseek-r1; scenarios Server / Interactive / Offline
- Accepted (ranking-eligible): 155
- Quarantined (review-required): 12
- Systems: 57
- Slices: 9 (4 meet ≥3 results / ≥2 vendors / ≥2 families)
- summary_results.json SHA-256: `52fa813a27834e8de38eca9fd381688df1cf9cd95020d2bd9e951f6cc16384ae`
- Added `systems.json`, `quarantine-report.json`, `scripts/importer` (TS + tests), `DATA_SOURCES.md`, `docs/methodology-data.md`
- Quarantine policy: missing accelerator identity or non-positive source count fields; never infer count from name tokens (x8, NVL72, etc.)