Courses / Hiring Operations (processes & tooling)
33. Calibration Metrics Dashboard Item: Average Rubric Variance
One specific metric to track (e.g., average rubric variance) used to monitor interviewer alignment over time.
Hiring Operations (processes & tooling)
Calibration Metrics Dashboard Item: Average Rubric Variance
A single dashboard metric that measures how consistently interviewers score candidates against the rubric over time.
"I want to know if our interviewers are aligned or drifting so we don't lose hiring quality."
Average rubric variance is the mean of per-interview-question score variances across interviewers, showing how much scorers disagree on each rubric item. Lower values mean stronger alignment; rising values flag calibration issues.
"I want to know if our interviewers are aligned or drifting so we don't lose hiring quality."
Average rubric variance is the mean of per-interview-question score variances across interviewers, showing how much scorers disagree on each rubric item. Lower values mean stronger alignment; rising values flag calibration issues.