How Ranks Are Calculated

Troubleshooting

How Ranks Are Calculated

The rank shown in HireRoo test results is not a fixed conversion of a candidate's score into an S–D grade. It is a relative evaluation based on comparisons with candidates who answered the same questions and with test results across HireRoo.

As a result, candidates with the same score may receive different ranks depending on the questions in their tests and the comparison population when their results are finalized.

How a Rank Is Calculated

A rank is calculated in three steps.

1. Calculate the Relative Score for Each Question

First, each result is ranked against previous candidates who answered the same question. Results are ranked by score, from highest to lowest. If candidates have the same score, the candidate with the shorter elapsed time ranks higher.

The relative score for each question is calculated as follows:

Relative score = (1 − rank ÷ number of candidates in the comparison population) × 100

For example, a candidate who ranks 20th in a comparison population of 100 receives a relative score of 80. Comparing results within each question provides a common scale for tests containing questions of different formats and difficulty levels.

2. Calculate the Overall Relative Score

When a test contains multiple questions, HireRoo calculates the overall relative score as the simple average of the relative scores for those questions. Question score weights are not used in this calculation.

3. Assign an S–D Rank Based on the Overall Population

The overall relative score is compared with scored test results across HireRoo. The candidate's position within that population determines the rank.

Rank Position in the overall population
S Top 5%
A Top 25%, excluding S
B Top 50%, excluding S and A
C Top 75%, excluding S, A, and B
D Remaining 25%

An overall relative score of 95 or higher does not necessarily result in an S rank. The final rank is determined by the candidate's position in the overall population, not by the relative score alone.

Points to Keep in Mind

  • A rank is based on the comparison population when the result is finalized. The same score may therefore receive a different rank at a different time.
  • A displayed rank is generally not updated automatically when more results are added to the comparison population.
  • A rank is not displayed when there is not enough comparison data. As a guideline, at least half of the questions in the test must each have 30 or more scored results.
  • A rank indicates a candidate's relative position and does not directly determine whether they pass or fail. Use it together with score details, submitted answers, and other evaluation information.

Frequently Asked Questions

Why Can Candidates with the Same Score Have Different Ranks?

A rank is based not only on the score, but also on the candidate's position among people who answered each question. The questions, size and score distribution of the comparison population, and the time when the result was finalized can all cause candidates with the same score to receive different ranks.

Does a High Score Always Result in a High Rank?

Within the same question, a higher score results in a higher relative score. However, the final rank also depends on the relative score for each question and the candidate's position in the overall population, so the score alone does not determine the rank.

Why Is a Rank Not Displayed?

A rank is not displayed if scoring is incomplete or there are not enough results for comparison within the questions. As more comparison data becomes available, ranks can be displayed for test results finalized from that point onward.