PerfReasoning: How Well Do LLMs Reason on Hardware Performance?
arXiv cs.AIen
arXiv:2609.04476v1 Announce Type: new Abstract: Performance modeling is central to hardware design and software optimization, yet constructing these models requires structured reasoning about computation, data reuse, storage, and movement. We introduce PerfReasoning, a benchmark that evaluates LLMs both as direct performance reasoners and as generators of analytical performance-model code. Given workload, architecture, and mapping specifications, models compare mappings and predict off-chip traffic and buffer requirements. The strongest closed-source models exceed 90% on reasoning-based Q&A, and the best open-weight model reaches 82.4%. However, model construction is substantially harder: wh
This is a short summary published by AI Global Wire. The full article is owned and hosted by arXiv cs.AI — open it there to read it in full.
Read the full story at arXiv cs.AI- Verktyg
- Forskning
Related AI news
- Iris: Climbing to the Search FrontierarXiv cs.AI · September 7, 2026
- ResLearn-XR: Residual Learning for Network Traffic and Quality-of-Experience-Aware Modeling in Extended RealityarXiv cs.AI · September 7, 2026
- What Does Multi-Harness RL Learn? Credit Assignment and Portability in Coding AgentsarXiv cs.AI · September 7, 2026
- Does the Selected Object Reach the Reader? Auditing Identity Handoffs in Grounded Language-Model PipelinesarXiv cs.AI · September 7, 2026
- Harbor Adapters and Harbor-Index: Infrastructure and a Curated Meta-Dataset for Large-Scale Agentic EvaluationarXiv cs.AI · September 7, 2026
- A Removal Based Approach to Improve LLM Faithfulness at Test-TimearXiv cs.AI · September 7, 2026