New arXiv framework probes what LLM benchmarks demand inside the model
The paper starts from a complaint about how large language models are evaluated today. Current evaluations report performance at the dataset or task level. That shows what a model achieves, but it offers little insight into the internal processing behind the result.
The authors propose a task-centric framework for characterising the model-internal processing that a benchmark elicits. It combines attention- and activation-based signals with representation-based measures. They use it to place benchmarks on a continuum from retrieval-dominant to reasoning-dominant, and to surface failure modes that task-level scores conceal.
For the experiments, they evaluate 16 LLMs across 24 diverse benchmarks. They also run targeted internal-state analyses on representative models and tasks. From this they observe systematic differences in processing between knowledge-centric and reasoning-centric tasks.
The authors frame the contribution as a change in what evaluation asks. Instead of asking what score a model achieves, it asks which processing patterns are associated with that score. They say this could potentially support more targeted benchmark selection and more informed model choice. The code is open source at https://github.com/extraordinarylab/trace-kr.
Key facts
- The paper argues that task- or dataset-level scores show what a model achieves but say little about the internal processing behind it.
- The proposed task-centric framework combines attention- and activation-based signals with representation-based measures.
- It characterises benchmarks along a continuum from retrieval-dominant to reasoning-dominant and aims to expose failure modes hidden by task-level scores.
- The study evaluates 16 LLMs across 24 diverse benchmarks, plus targeted internal-state analyses on representative models and tasks.
- The authors report systematic differences in processing between knowledge-centric and reasoning-centric tasks; code is open-sourced at github.com/extraordinarylab/trace-kr.
Why it matters
Benchmark scores are the main way models are compared, yet a single number does not say what a model did internally to earn it. This work tries to describe the kind of processing a benchmark demands, from retrieval-dominant to reasoning-dominant. The authors present it as a shift from asking what score a model gets to asking what processing pattern lies behind that score.
Who it affects
People who choose benchmarks and people who choose models are the stated audience: the authors say the approach could support more targeted benchmark selection and more informed model choice. Researchers who build evaluations and study model internals are the other obvious readers.
How to use it
The authors open-source their code at https://github.com/extraordinarylab/trace-kr. The framework is meant to be applied to a benchmark to see which internal signals it elicits, alongside the usual task-level score.
How solid is it
This is an arXiv preprint, and the account here rests on its abstract. The evidence base is 16 LLMs across 24 benchmarks, with deeper internal-state analyses on representative models and tasks. The abstract names no specific scores or effect sizes, and it states the benefit for benchmark selection and model choice as potential, not demonstrated.
Risks and caveats
The abstract does not describe the direction or nature of the reported differences between knowledge-centric and reasoning-centric tasks. It does not name the specific failure modes that task-level scores conceal. The claim that the framework improves benchmark selection and model choice is hedged by the authors as "potentially".