On October 30, 2026, we renewed the AI Collaboration format report as a new report based on the Skill Index. The score and rank are now based on an evaluation of the process behind the candidate's work, and you can trace the evidence on one page. Deliverable Evaluation remains available as before. You can also switch to the legacy report.

SEI is the name of the Skill Index that HireRoo provides as its standard.

To learn how to read the new report, see AI Collaboration Format Reports.

Background

As working with AI becomes the norm, the requirement fulfillment rate (the test case pass rate) alone had become less effective at telling candidates' skills apart.

We therefore reviewed the report so that the deliverable is evaluated by the requirement fulfillment rate, while the judgments and behavior observed during the candidate's work are evaluated with the Skill Index, and that result is at the center of the report.

What's new

The score and rank now evaluate the process

Until now, the score came from Deliverable Evaluation (requirement fulfillment rate). The score and rank in the new report evaluate, using the Skill Index, the behavior observed during the candidate's work.

The score (0 to 100), rank, and evaluation coverage in the new report are evaluated per test, not per problem. Even when a test has multiple problems, the results of all AI Collaboration problems are combined into a single evaluation. They are based on your company's Skill Index if you have created and published one, and on the HireRoo standard Skill Index otherwise.

Trace the evidence on one page

From the overall score, you can drill down through skills and evaluation items to the results for each problem, all on the same page.

The candidate list shows the new score and new rank

During the transition period, they appear alongside the legacy score and legacy rank. The new score is based on the Skill Index and is calculated differently from the legacy score.

Deliverable Evaluation does not change

You can review the submitted deliverable as before, by the requirement fulfillment rate ("Requirement Fulfillment" in the legacy report).

Switch between the new and legacy reports

Select "View the new report" at the top of the legacy report to open the new report. From the new report, select "View the legacy report" to go back.

Scope

Test composition How the new report is handled
AI Collaboration format only New report by default (you can switch to the legacy report)
AI Collaboration format plus other formats Legacy report by default (you can switch to the new report)
No AI Collaboration format Legacy report is shown (you cannot switch to the new report)

For a test that includes both the AI Collaboration format and other formats, the new report covers only the AI Collaboration problems. Review the other formats' problems in the legacy report.

The same rules apply to tests taken in the past.

What stays the same

  • PDF: Even with the new report, PDFs are still exported with the content of the legacy report.
  • Technical review: As before, you can review it in the "Technical Review" tab. It is not included in the score or rank.
  • Sharing: Sharing from the share button works the same as before.