FluidReview is a great platform for ranking and evaluating applications, but can it normalize ranking results to accommodate for subjective differences between judges? Yes, it can! In this article we will show you how to add a Z-score to your ranking reports, which helps greatly during the analysis phase of your competition.
In this Article...
Naturally, different judges will rank applicants differently.
Suppose that one of your judges, let’s call him Tom, is particularly conservative with how he grades applications. On a scale of 1 to 10, Tom considers a “7” to be a great score. His philosophy is that nothing can ever be perfect, so a “7” is actually exceptional.
But what about the philosophy of a different judge; let’s call her Sandy. Sandy believes that “10” means “you did your best.” To her, a score of “7” isn’t very good at all.
So how can variances like these be normalized during the analysis phase? That’s what the Z-score, or standard score, is for.
Calculating and adding Z-scores to your FluidReview reports is very easy to do. First, begin by clicking Analyze results and then Reports.
And now, to create a new report, we click on either CSV Report or XLS Report.
Lastly, click on Indefinite information and select Standard (Z) Score.
Now your report will include the Z-score for each reviewer.