You can now create your own AI Collaboration questions and use them in your coding tests and in internal tests in Skill Development. Without asking HireRoo to author a question for you, you can prepare a question that matches your own technical stack and your own work, whenever you need one.

For details, see Creating Your Own AI Collaboration Questions.

Background

Until now, the only AI Collaboration questions available were the ones HireRoo provided. When a company needed a question that matched its own technical stack or business domain, it had to ask HireRoo, and the time between the request and the question going out constrained how the hiring process could be designed.

The problems you want candidates to solve are the ones in your actual development work. The engineers doing that work know those problems, but they had no way of turning them into questions.

This feature takes authoring out of HireRoo's hands and puts it in the hands of the companies that need the questions.

What's new

Author a question in a dedicated environment

From the Your questions tab on the question list, choose Create a question and a browser-based authoring environment starts up. It runs on the same image candidates take the question in, so you can run the code you write and check it on the spot.

You write the problem statement, the evaluation criteria, the initial code given to candidates, and the reference implementation inside this environment. It has an AI agent, so you can describe the question you want and have the agent write it.

Solve it yourself before publishing

Before a question is published, its author solves it in the same environment a candidate gets. Tell the AI agent in the environment to grade your work against the criteria, and it reports whether each criterion passed and why, so you can check that the question evaluates what you intended before it goes out.

Only a version that has been verified can be published.

Published, but only to your company

A published question becomes available for your own coding tests and for internal tests in Skill Development. Other companies cannot see it and it is never given to their candidates. Taking, evaluation, and reports work exactly as they do for the AI Collaboration questions HireRoo provides.

Keep editing after publication

A published question can be edited and published again as a new version. Coding tests that have already been delivered keep the previous version, so a problem statement never changes in the middle of a hiring process.

Scope

  • Only AI Collaboration questions can be created. Other question formats are not supported.
  • You can choose Go, TypeScript / Node.js, Python, Java, Ruby, C#, or PHP as the technical stack. For a question that does not involve writing code, choose "Documentation only". The question format and the technical stack cannot be changed later.
  • The problem statement and the evaluation criteria are required in both Japanese and English. The English can be produced by the AI agent in the authoring environment.
  • You can hold up to three authoring and verification environments at a time, counted together, each for up to 24 hours.
  • Using a question in an internal test requires a Skill Development contract.
  • Questions you create cannot be shared with or published to other companies.

Available plans

Available on the Professional plan or higher.