ThermoQA: A Three-Tier Benchmark for Evaluating Thermodynamic Reasoning in Large Language Models

arXiv:2604.19758v1 Announce Type: new Abstract: We present ThermoQA, a benchmark of 293 openended engineering thermodynamics problems in three tiers: property lookups 110 Q, component analysis 101 Q, and full cycle analysis 82 Q. Ground truth is computed programmatically from CoolProp 7.2.