Rating the Raters: Rasch Measurement Theory for LLM Evaluation

arXiv:2608.27463v1 Announce Type: new Abstract: LLMs now sit on every side of evaluation: as examinees scored on benchmarks, judges of other models' outputs, and raters of humangenerated content.