We have released the "Interview Guide," a new feature that prepares the questions to ask in a deep-dive interview, organized by evaluation criterion, based on a candidate's AI Collaboration format submission.

Background

Before a deep-dive interview, the interviewer needs to read through the submitted code and the candidate's exchanges with the AI agent and decide where to dig in. This preparation tends to depend on each interviewer's experience, which led to the problem that the quality of the interview changes depending on who conducts it.

The Interview Guide reduces the burden and inconsistency of this preparation by generating questions tied to the code the candidate actually wrote and to the candidate's exchanges with the AI, based on an Evaluation Criteria Sheet that describes "what you want to measure."

For details on the feature, see What is the Interview Guide?.

What's New

Define "what to measure" with an Evaluation Criteria Sheet

In the Evaluation Criteria Sheets in Company Settings, write in Markdown what your company wants to measure. You can create as many sheets as you need, for example one per role or hiring track, and each time you generate an Interview Guide, you can choose whether to use a sheet from Company Settings or provide a sheet for that report only.

Questions are generated automatically from the submission

Generated questions come from one of three sources: "Artifact-sourced," tied directly to the candidate's code and dialogue log with the AI; "Not confirmed," which ask about criteria that could not be confirmed from the submission; and "Constraint change," which ask the question with some of the task's constraints swapped out. Each question comes with answer guidelines and a model answer, making it easier to check the candidate's understanding on the spot.

Narrow down questions and take notes during the interview

Interviewers choose which of the prepared questions to use and can take notes during the interview linked to each criterion. Question text, answer guidelines, model answers, and notes are shown to your company only and do not appear on any screen shared with the candidate.

Review side by side with the submission

You can display the Interview Guide and the submission side by side. From the evidence link attached to a question, you can jump straight to the relevant code range or dialogue turn.

Export as Markdown

You can copy the questions you chose to use in the interview as Markdown, grouped by evaluation criterion, and paste them as is into the document you use to run the interview.

Scope

The Interview Guide is available for the AI Collaboration format only. It cannot be used with the Coding Format, Practical Format, Quiz Format, or Live Coding. It can also be generated only after the submission has been scored.

Available Plans

Whether the Interview Guide is available to you depends on your contract. For availability, please contact your Customer Success representative.