- Published on
Article · Measurement
Calibrating an LLM Judge Against Human Disagreement
A practical agreement experiment for measuring an LLM judge against human labels, including ambiguous cases, position bias, confidence, and release thresholds.
Article · Measurement