Posts tagged "evaluation"

Keep reproducible failures in a versioned evaluation set. Retire obsolete cases with a recorded reason, and separate requirement changes from attempts to improve a release score.

Compare important workflows as well as the overall evaluation result. Report case counts and uncertainty so an aggregate gain cannot hide a smaller critical regression.