We have started offering Skill Development, a new feature that lets you assign internal tests to your members and evaluate their skills from the results. It is currently offered as a beta.

Internal tests can include AI Collaboration questions, and results are evaluated according to the SEI (Software Engineering Index).

For details, see Creating an Internal Test.

Background

Skill Assessment continuously measures AI Collaboration Skills from the AI tool usage logs of everyday work. We also received requests to check skills from how members work through a defined task.

Continuously watching everyday usage and assigning a task to measure skills at a point in time serve different purposes and are used differently. We therefore offer internal tests as Skill Development, separate from Skill Assessment.

What's new

Create internal tests

Create an internal test by choosing the questions and the time limit. You can include AI Collaboration questions, both those provided by HireRoo and AI Collaboration questions created by your company.

Assign them to members

Set a deadline and assign the internal test to members. You can select members one by one or select a whole group at once.

Assigned members receive an email with the internal test name, time limit, deadline, and a link to the test page. The same notice also appears in HireRoo's in-app notifications.

Assignments that have not been started yet can be unassigned from Internal Test Details.

Members take the test

Members open the internal test from the email link or from Skill Development › My Page in the sidebar. On My Page, members can see the internal tests assigned to them and their own results.

Review the results

When an attempt finishes, it is graded and evaluated according to the Skill Index. You can review results on the following screens.

Screen Description
Internal Test Overview Rank over time across the organization, the organization average for each skill, and examinees who need follow-up
Examinee List / Examinee Detail Each member's number of exams taken, last exam date, latest results, and exam history
Test list / Internal Test Details The progress of each internal test and the result of each attempt

In an attempt's results, you can see the evaluation for each skill and evaluation item according to the SEI, along with the observed facts behind the evaluation. You can also see how each question's requirements were met and a playback that replays what happened during the attempt.

If you have published your company version of the Skill Index, attempts are evaluated with it. For the Skill Index, see Viewing and Editing the Skill Index.

Scope

  • Skill Development appears in its own section of the sidebar, separate from Skill Assessment.
  • Members with Admin Authorization or Manager Authorization can create and assign internal tests and view other members' results. Members who took a test can view their own results on My Page.
  • Taking an internal test does not require a Skill Assessment invitation or setup.
  • Only AI Collaboration questions can be included.

Availability

A Skill Development contract is required to use Skill Development. For details, please contact your Customer Success representative.