It can sometimes happen that a question constructed in the manager environment, turns out to be incorrect after test take. Think of the choosing the wrong correct answer for a multiple choice question or the absence of correct assessment criteria for an open question.
For most question types it is possible to change the answer model afterwards, in the test player environment. Unfortunately, it is not yet possible to change the answer model for worksheet questions and the "I don't know the answer" option.
An answer model change is always done on the version of the question used.
There are several ways to adjust the answer model of a question:
- Per candidate
- Per blueprint
- Per test moment
Warning!
Besides changing the answer model afterwards in the test player, it is important that the incorrect question is also adjusted in the manager environment. To do this, go to the manager environment and find the question. Then click on the button 'x versions, x remarks', in that overview the adjustment will be displayed. Next to the adjustment is a button 'Open the question version with the adjusted answer model'. The adjustment made is then processed and the question can be saved.
Per candidate
When the answer model of the question needs to be adjusted for 1 candidate only, go to the result page of this test. Each question (as long as the user has these permissions) has an icon (pencil) for adjusting the answer model.
Per blueprint
Once the per candidate route has been followed, you can switch to blueprint on that screen by clicking on the 'Edit result for all candidates who took the same test' link.
Another option is by going to 'Results > Analyses', select the blueprint tab. Go to the interaction analysis, on the 'Analyse questions' tab, the answer model for the blueprint can be edited.
The answer model change will be applied to all results of candidates that made a test based on this blueprint (also older results).
Per test moment
By going to 'Results > Analyses', and then to the test moment tab, select the appropriate test moment, then choose the 'Analyse questions' tab. On that tab, choose the option 'Show interaction analysis' to adjust the answer model for the test moment. The answer model change will be applied on all results of candidates that were connected to this test moment. On this page you can still choose to make this adjustment for all results that took the test based on this blueprint.
Options when changing the answer model
First of all you have to choose what kind of adjustment you want to make. There are 3 available options:
- By adjusting the correct/incorrect answers. In this case, what is correct or incorrect can be adjusted.
- By accepting all answers to this question. By choosing this option, every answer given will be counted as correct.
- By withdrawing this question. This option ensures that the question no longer counts in the result. As a consequence, the maximum total score on the test will also be adjusted.
Next, the status of the adjustment should be chosen. Again, there are 3 options:
- Inactive: This adjustment will not be applied as long as the status is inactive.
- Concept: When an adjustment is in concept, it is applied on the 'Analyses' tab, but will not be visible on 'All Results'. Thus, this status shows the result of the modification in the analyses already.
- Active: This adjustment is immediately actively implemented and will be applied everywhere.
Tip!
A frequently requested answer model change is the possibility to approve a second answer option in a multiple-choice question. To do this, you need the option "by changing the response model". It's not possible to add another option as "correct"; after all, in a multiple-choice question, only one option is correct. You can, however, assign points to a second (or third) answer option by selecting "score mapping" in the answer model—this changes the question's scoring type, allowing you to assign points to other answer options as well. The answer option will still be visually highlighted in red, but the correct number of points will be added to the result.
Warning!
An answer model change can't be removed. It can only be changed to inactive.
If the correct/incorrect answers are chosen to be adjusted, the adjustment can be made below. In the case of open-ended questions, below it is asked whether the correction rounds should be reopened. For example, if a new assessment criterion is added, Remindo will already set this to happen, this cannot be undone. But when only a textual change in the assessment criteria has been applied, it is not necessary to reopen the correction round in all cases.
The example at the bottom of the page will show what the effects of this modification will be for the results.
Warning!
When saving an answer model adjustment, a reason for the adjustment should always be given. It is important to know that when a candidate has access to the result, he or she will also see the answer model adjustment made, including the reason for the adjustment. So do not mention internal matters here.
Warning!
Only one answer model adjustment can be active per question. If, for example, a second adjustment is made for the same question within a test moment, the first adjustment will become inactive. If the first adjustment was not complete, it is better to edit this adjustment instead of creating a new one.
Disclaimer: This text was automatically translated from the Dutch version.