Setting Up Skill Assessment

Overview

This article describes what administrators do to start using Skill Assessment. You add the members you want to measure, and measurement starts once each member finishes setup.

1. An administrator adds the members to be measured (by inviting or assigning them)
2. Each member sets up the hireroo CLI on their own machine
3. The administrator checks setup progress in the member list

For how Skill Assessment works and what is measured, see What is Skill Assessment?.

About the beta Skill Assessment is currently offered as a beta. A Skill Assessment contract is required to use it. For details, please contact your customer success representative.

The steps in this article are performed on the Member List under Skill Assessment in the sidebar (the screen is titled AI Monitoring). Members with administrator or manager permissions can view the member list.

Adding Members to Be Measured

There are two ways to add a member: invite and assign. Which one applies is decided automatically from the email address you enter.

With Talent permissions, a member can only review their own skill assessment. For details on permissions, see Member Authorization Types and How to Change Them.

Steps

1. In the sidebar, under Skill Assessment, click Member List.
2. Click Invite Member in the upper right.
3. In Email Address, enter the email address of the member you want to measure.
   • When you type part of a name or email address, matching Registered employees are suggested. Selecting a suggestion assigns that employee.
   • When you enter an email address that is not registered, a New invitation option for sending an invitation email is shown.
4. When you have entered everyone you want to add, click the button in the lower right. The button reads Send invitation if you are only inviting, Assign employee if you are only assigning, and Add Members if you are doing both.

When “Members have been added.” appears, you are done.

Adding Several Members at Once

You can enter multiple email addresses separated by commas. Even when you paste several addresses at once, addresses of registered employees are assigned and the rest are invited automatically.

If only some members could be added, “Some members could not be added. Only the members that could not be added are kept.” appears, and only the members that could not be added remain in the input field.

One Measurement per Person at a Time

Each person can have only one measurement at a time. You cannot assign a member again while their measurement has not been ended. To measure the same member again, end their current measurement first and then assign them.

Setup Performed by Members

Each added member sets up the hireroo CLI on their own machine. The setup steps are shown in three steps on the member's own My Page.

• If you invited the member: My Page appears once they accept the invitation from the invitation email. People without a HireRoo account start by creating one.
• If you assigned the member: No invitation email is sent. Let the member know that they are now being measured, and ask them to open My Page under Skill Assessment in the sidebar.

1. Install the CLI and run setup

Run the following command in a terminal to install the hireroo CLI. It does not affect the existing Claude Code / Codex setup.

macOS / Linux:

curl -fsSL https://cli.hireroo.io/install.sh | sh

Windows (PowerShell):

irm https://cli.hireroo.io/install.ps1 | iex

Next, run the following command and approve the authorization shown in the browser.

hireroo spider setup

2. Verify the connection

Run the Claude Code or Codex command shown on My Page to confirm that logs reach HireRoo. Either one is enough.

3. Wait for measurement to start

From then on, simply using Claude Code / Codex as usual is measured. My Page notes that “The first measurement usually completes in about an hour.”

Checking Setup Progress

The member list shows the following for each member.

The status changes as setup progresses.

You can filter the list by status and search by name or email address. If a member stays at Awaiting connection, or their Last log has not been updated for a long time, check with the member about their setup.

Administrator screens currently do not show individual members' scores or ranks.

Ending a Measurement and Deleting a Member

From the menu at the right end of each row in the member list, you can choose End measurement or Delete. Neither can be undone.

Ending a measurement

1. From the menu on the member's row, choose End measurement.
2. On the confirmation screen, click End measurement.

Ending stops the measurement agent, so AI activity is no longer recorded from then on. Data and scores already measured are kept. The status changes to Measurement ended.

Deleting a member

1. From the menu on the member's row, choose Delete.
2. On the confirmation screen, click Delete.

Deleting stops measurement for that member and also deletes the data already measured. To stop measurement while keeping the measured data and scores, use End measurement instead of Delete.

Points to Note

• Ending a measurement cannot be undone. To measure the same member again, assign them again.
• Assigning does not send an invitation email. Let the member know directly that they are now being measured.
• Measurement requires setup by the member. Adding a member as an administrator does not start measurement on its own.

Related Pages

• What is Skill Assessment?
• How Skill Assessment Measurement Logs Are Handled
• Member Authorization Types and How to Change Them