Overview

To start Skill Assessment measurement, install the hireroo CLI on the machine where you usually use AI tools, and run setup. After setup, simply using your AI tools as usual is measured.

About the beta Skill Assessment is currently offered as a beta.

The setup steps are shown in three steps under Skill Assessment › My Page in the sidebar.

  1. Install the CLI and run setup
  2. Verify the connection
  3. Wait for measurement to start

Open My Page in one of the following ways.

  • If you received an invitation email: My Page appears once you accept the invitation from the email. If you do not have a HireRoo account, you start by creating one.
  • If you did not receive an invitation email: Log in to HireRoo and open Skill Assessment › My Page in the sidebar. When an administrator adds a member who already uses HireRoo, no invitation email is sent.

Supported AI Tools

AI tool Support
Claude Code macOS / Linux / Windows
Codex CLI macOS / Linux / Windows
GitHub Copilot (Copilot CLI) macOS / Linux (not yet supported on Windows)
GitHub Copilot (VS Code) GitHub Copilot in VS Code

1. Install the CLI and run setup

Run the following command in a terminal to install the hireroo CLI.

macOS / Linux:

curl -fsSL https://cli.hireroo.io/install.sh | sh

Windows (PowerShell):

irm https://cli.hireroo.io/install.ps1 | iex

Next, run the following command.

hireroo spider setup

A browser opens and shows a HireRoo page. Log in if you are not logged in, and approve the authorization shown. You do not need to paste a token or anything else by hand. If the browser does not open automatically, open the URL shown in the terminal.

After authorization, the terminal shows the result for each AI tool's configuration file as [ok] or [failed].

If you use GitHub Copilot

The following is needed for the settings to take effect.

AI tool What to do
Copilot CLI Open a new terminal (or run source ~/.zshrc)
GitHub Copilot in VS Code Reload the window (Developer: Reload Window in the Command Palette)

2. Verify the connection

Copy the Claude Code or Codex command shown on My Page, paste it into a terminal, and run it. Either one is enough.

AI tool Command
Claude Code claude 'hello world'
Codex codex 'hello world'

Once the message you sent reaches HireRoo, My Page moves on to the next step.

3. Wait for measurement to start

Setup is now complete. From then on, simply using your AI tools as usual is measured. Once enough data has been collected, your score and usage appear on My Page. For what is shown, see Viewing Your Measurement Results on My Page.

Effect on Your Existing Settings

The hireroo CLI changes only the settings used to send AI tool usage logs to HireRoo. All other settings stay as they are.

AI tool Setting changed
Claude Code env in ~/.claude/settings.json
Codex CLI [otel] in ~/.codex/config.toml
Copilot CLI A block of export lines added to ~/.zshrc / ~/.bashrc
GitHub Copilot in VS Code github.copilot.chat.otel.* and github.copilot.chat.skillTool.enabled in VS Code's settings.json
  • Requests from your AI tools to AI providers do not change. They continue to go directly to the AI provider. HireRoo does not sit between AI tools and AI providers.
  • If you have configured your own usage log destination (OpenTelemetry), setup shows the current value beside the new one and asks [Y/n] before changing anything. If you answer anything other than yes, nothing is changed.
  • For GitHub Copilot in VS Code, setup turns on the skill feature (github.copilot.chat.skillTool.enabled). Uninstalling restores the original value.
  • Authentication information is stored in ~/.config/hireroo/credentials.json.

Reverting (Uninstalling)

Running the following command restores the changed settings to their values before setup and removes the stored authentication information. Other settings you changed yourself after setup stay as they are.

hireroo spider uninstall

After uninstalling, usage logs are no longer sent from that machine. If you want to stop measurement itself, see "I want to stop measurement" in the FAQ.