The "AI Interviewer" format is a question format in which an AI interviewer runs the test through a conversation with the candidate. On November 12, 2026, we released "Knowledge" as its first theme and published two questions: "[Demo] IT Fundamentals" and "AI Fundamentals".

The "Knowledge" theme of the AI Interviewer format is the replacement for the Quiz format, which will be discontinued at the end of June 2027.

Background

Most items in the Quiz format are multiple-choice. Because a multiple-choice item can be answered correctly by guessing, the correct answer rate alone could not tell whether a candidate understood the topic or just picked the right option.

In the "Knowledge" theme of the AI Interviewer format, after the candidate answers with an option, the interviewer asks follow-up questions and the candidate explains in their own words. In addition to whether the choice was correct, you can see how far the candidate understands.

What's Changed

Knowledge

In a Knowledge question, the candidate talks with the AI interviewer on a chat-only exam screen.

  • The interviewer presents the items one at a time. For a multiple-choice item, the candidate selects an option and presses "Answer". Once pressed, the answer is final and cannot be changed. For a free-text item, the candidate answers in writing.
  • For some items, the interviewer asks follow-up questions after the answer. The candidate answers in writing.
  • The interviewer does not tell the candidate whether an answer is correct and gives no hints.

Available questions

Question Content Items Suggested time limit
[Demo] IT Fundamentals Basic knowledge of web development and programming 11 (8 multiple-choice, 3 free-text) 30 minutes
AI Fundamentals How generative AI works, its limits, and how to use it safely at work 10 (multiple-choice) 30 minutes

Question list and test creation

"AI Interviewer" has been added to the "Question Format" filter in the question list. Selecting it shows only AI Interviewer questions.

When creating a test, you can select these questions just like questions in other formats. AI Interviewer questions have no AI model tier or AI usage limit settings. They also do not count toward the limit on AI Collaboration questions (2 questions) or the total AI usage limit.

Report

You can check the results of the AI Interviewer format in the SEI-based report. "Requirement Judgments" shows, for each item, whether the answer was correct and how far the follow-ups showed understanding, together with the exchanges used as evidence.

Specialized Knowledge added to SEI

We have added a sixth skill, "Specialized Knowledge", to HireRoo's standard skill index (SEI). Specialized Knowledge is evaluated only in questions of the AI Interviewer format's "Knowledge" theme. There is no change to the evaluation of the AI Collaboration format.

Demo test

In the demo test that candidates can try before the test, "[Demo] IT Fundamentals" is used as the AI Interviewer Knowledge question.