Feedback categories

Description

Optionally, feedback categories can be added to a blueprint. This allows you to provide feedback on parts of test, next to the result for the entire test.

Examples of usage:

• When a test consists of different content components and a result is required for each component, such as in a language test with components such as 'writing skills', 'reading skills' and 'listening skills' (feedback categories are based on questions in rules of a test).
• When a test contains questions at different levels and a score is required for each level, e.g., 'Level 1', 'Level 2', and 'Level 3', or Bloom's taxonomy levels (feedback categories are based on question properties).
• When a test consists of open and closed question types and you want to know the result per question type (feedback is based on questions in rules of the test)

Visibility of results on feedback component

This additional information with results about parts of the test can be made visible to different users. It can be displayed to candidates and supervisors, or only to supervisors, so they know, for example, which aspects of the learning content require more attention. This can be configured in the visibility settings of the feedback categories. It's also possible to show candidates only the results on the feedback categories without showing them the results at the question level or the total test result.

If the candidate is allowed to see (parts of) the feedback, it will look like this:

• On the dashboard, the candidate can access the feedback report using the i-icon.

• If the candidate also has access to the results page, the feedback report will also be displayed at the top of the result page. The questions will be displayed below the feedback report.

Cut-off score

Each feedback category can have its own cut-off score. This allows a score to be determined for each feedback category within a test. This allows test coordinators, for example, to assign different cut-off scores to a feedback category with only multiple-choice questions and another to a feedback category with other question types.

In the blueprint settings, you can specify whether the test result is determined using the standard cut-off score or using a calculation based on the feedback categories, also known as the composite caesura. With a composite caesura, a test result is calculated based on the results of the feedback categories (instead of on the total score). In addition, a weighting can be assigned to each feedback category for calculating the total test result.

Add feedback categories

Below you find a step-by-step that explains how to add feedback categories to the blueprint. 

In onderstaand stappenplan wordt uitgelegd hoe je terugkoppelingsonderdelen kunt toevoegen aan de toetsmatrijs.

Adjust feedback categories afterwards

If, after the test, it turns out that the feedback categories were not configured as desired, you can adjust them. This can be done in the Manager environment (provided the delivery settings allow you to adjust the cut-off score, but also in the Player environment (via the subscription settings of a test moment). If you only want to change it for a single test moment, it's best to do so in the Player environment. If you want to change it for all test moments based on this blueprint (from a specific moment in time), choose to make the change in the Manager environment. The explanation is below.

In the Manager environment, you can adjust/add/remove feedback categories. Once this is done and the test matrix has been saved, you can go to the 'History' tab. In the top right corner, you'll find the 'Push settings' button. Click this and choose a datum from which you want all feedback reports updated in the Player environment.