Procedure for creating questions
Detailed explanations and other information about each item are included with each step.
The data is temporarily saved at each step (you can save during the process), so you can refer to it again from the draft when resuming, or you can save it once and update the data later.
- Click "Create Question" from the upper right corner of the "Question List" screen. When the modal appears, select "Database".
- Question Format
- Select "Database.
- Time Limit
- Set the time limit according to the content of the question you are creating. It is recommended to create questions while referring to other questions; it is best to design questions so that one question will take around 30 minutes.
- Difficulty Level
- Select from "Easy," "Normal," and "Difficult. It is recommended that you choose this difficulty level based on the relative level of the already existing questions. Enter the following information in the Enter Question Summary step.
- Question Format
- Enter the following information in the Schema Definition step
- ⚠️ If you change the schema definition once it has been saved after entering the following information, you will need to delete the information once it has been saved, as it will affect the entries in the subsequent steps. Please be careful when making changes.
- The input fields are as follows
- Table and column names
- Multiple tables can be added. You can also design the column names required for each table, along with the type. Multiple columns can be added to a single table.
- Column Definition for Expected Query Output Results
- Describe the final output when solving the problem. If you want multiple values to be output, add columns and define multiple columns.
- Table and column names
- Enter the following information in the Add Test Case step
- Enter the test case. The test cases entered here will be used to automatically score the candidate's submitted code, so the more detailed the case, the more accurate the automatic scoring.
- There are two types of test cases. One is a test case that measures the percentage of correct answers, and the report screen corresponds to the percentage of correct answers section here. By adding a variety of cases, including edge cases, you can see to what extent the candidate's code has been taken into account.
- The other test case is a performance test case, which measures the execution speed of the code based on the input values. By inputting test cases so that the input gradually increases, it is possible to measure how much the code deteriorates (or not) when the number of executions increases.
- Additional input items for test cases are as follows
- Do not display while testing : If this is ON, candidates will not be able to use the corresponding test case while testing.
- Title : It is very effective to give a clear title to each case to easily understand which case passed (or failed) on the report screen when checking.
- Details : As with the title, you can check the details of the case on the report screen. Details can be entered in Markdown format.
- Language addition (optional)
- Add test case : Multiple test cases can be added.
- Set table values : A modal is opened and you can enter values for each table.
- Preview contents : The column name, type, and data of the table can be viewed in the preview.
- Performance input items are as follows
- Label: Used as a label for the performance graph displayed in the report screen.
- Add Test Case : Add a performance test case.
- Enter the following information in the Enter answer step.
- The language of the added answer code will be the only language available to the candidate. The additional codes will also increase the accuracy of the readability score. For more information on readability, please see below.
-
Time complexity
-
Spatial Amount : Sets the amount of time and space for the answers to be added, see here for more information on Big-O Complexity.
-
Title
-
Details
-
Add answer : You can add multiple answers. In this case, select an answer label (optimal, standard, or honest) and add the answer.
-
Add language (optional)
- Add answer code
- Add a programming language to be answered.
- Enter the answer code that satisfies the function definitions and test cases entered in the previous steps.
- Answer codes can be added for each currently supported language, and only the languages added will be available to the candidate when answering.
- If you wish to reset the answer to the initial template code, you can do so by clicking on the "Reset to Template Code" button.
- Once the solution code has been entered, the test case entered in the previous step can be executed. You can check the execution result, etc. Confirm that it can be executed without any problems and proceed to the next step. The input items are as follows.
-
- The language of the added answer code will be the only language available to the candidate. The additional codes will also increase the accuracy of the readability score. For more information on readability, please see below.
- Add hints in the "Other" field (optional).
- Enter a hint that the candidate can refer to if he/she gets stuck during the coding test.
- The entry fields are as follows
- Details : The text of the hint. Details can be entered in Markdown format.
- Add hints : Multiple hints can be added.
- Add language (optional)
- Finally, click "Save and Next. The modal that appears allows you to specify the version of the question and save it for use.