What Do We Expect from LLMs? Mapping the Design of LLM Benchmarks

arXiv:2609.19182v1 Announce Type: new Abstract: Benchmarks are central to how progress in large language models LLMs is assessed and communicated. Yet model rankings alone reveal little about how evaluation requirements themselves are changing.