The article explains how to add a blueprint, highlighting two types: rule-based, which allows specifying question selection and order, and matrix-based, which organizes questions by learning objectives and criteria. It also covers three test types—practice, graded practice, and exam—affecting a.o. feedback and security. The blueprint type cannot be changed after selection. A step-by-step guide for adding a blueprint in the Manager environment is provided.
Introduction
A test is compiled using a blueprint. Based on a single blueprint, various tests can be administered over time. Before adding a new blueprint, it is important to be aware of a number of options:
Type of blueprint
- Based on rules
- Based on a matrix
Type of test
- Practice
- Graded practice
- Exam
Type of blueprint
Blueprint based on rules
With a rule-based blueprint, a blueprint is constructed based on one or more 'rules'. Criteria (based on question properties) can also be added per rule that the selection of questions must meet, and the order in which questions are presented can be specified.
The rule-based blueprint is generally perceived as easier to set up than a matrix-based blueprint.
Choose a rule-based blueprint if you:
- want to be able to specify which questions will be included in the test;
- want to select questions in your test based on question properties;
- want to be able to determine the order of questions (shuffled as a predetermined order);
- want a test with a random set of questions.
For more information about this type of test matrix, see the article "Blueprint based on rules".
Matrix-based blueprint
With a matrix-based blueprint, the test is constructed in a matrix (table) based on learning objectives or assessment goals horizontally (for which categories are selected in the question bank) and criteria vertically. For each combination, there is a cell in which one can specify how many questions should be asked. Every matrix-based blueprint results in a random test take where the selection of questions is randomized and the order of questions is shuffled by default. However, it is possible to generate a variant of the blueprint based on the matrix with a fixed set of questions. In that case, the blueprint really serves like a blueprint!
Choose a matrix-based test matrix if you:
- work based on assessment terms and specific criteria for questions (e.g., Bloom's taxonomy);
- want to provide each candidate with a random set of questions based on criteria;
- want to provide authors with an 'empty' set of questions that already have the correct question properties so that they can write them according to those criteria;
- if the order of questions does not need to be fixed.
A blueprint based on a matrix is not available by default in every environment. An admin can enable it.
For more information about this type of blueprint see the article "Blueprint based on a matrix".
Type of test
There are different types of tests, two formative and one summative test type:
- Practice (formative)
- Graded practice (formative)
- Exam (summative)
The choice of test type influences the test take, for example whether the candidate can receive immediate feedback on their answer after each question (possible for practice and graded practices) or not (exam), but also, for instance, on the security options (more security is possible for summative tests).
For more information about the different types of tests, go to the article 'Test moment types'.
Warning!
It is not possible to modify the blueprint type after selection. Furthermore, it is only possible to switch between 'practice' and 'practice test' (both formative), but not from a formative test to a summative 'exam'. Please keep this in mind when creating the blueprint. Should this occur, it can be easily resolved by creating a variant of the blueprint with the correct settings. This must then be disconnected (+ archive the original). You can then continue working with the test matrix.
Step-by-step plan to add a new blueprint
-
In the Manager environment, a new blueprint can be added via the "Tests" button.
- Next, select the study to which the blueprint should be linked. It is also possible to choose "All studies".
- Select "+ Add new test matrix" at the top left.
- A pop-up with settings will open; for more information, see the article "Blueprint settings". The options marked with an asterisk (*) in Remindo must be completed.
- After completing the settings, the blueprint can be saved.
- Questions can be added under the "Content" tab. Depending on the type of blueprint selected, questions are added to the blueprint differently; see: