This section covers everything you need to know about building your assessment content, from managing your Scoresheet and Question Banks to authoring detailed items, configuring scoring scales, and linking competency frameworks.
1. The Scoresheet Bank & Scoresheet Types
- Accessing the Bank: Navigate to Assessments>>>Scoresheet Bank from the top menu and you will be taken to the Scoresheet Bank page. From here you can add, edit, delete and preview Scoresheets that can be used in your Assessments.
- Choosing a Scoresheet Type: When you click Add, you will be able to choose one of three scoresheet types.
- Assessment: Scoresheet for general assessment such as OSCEs, MMIs and support for Self Assessments.
- MCQ: Scoresheet for MCQs, SBAs, EMQs, EAQs, SAQs and VSAQs.
- Object: Scoresheet to be used at an Object Station in an OSCE or MMI and to be completed by the Candidate.
- Scoresheet Bank Options: You can access options for Scoresheets in the Scoresheet Bank by selecting appropriate Scoresheets and choosing an option from the dropdown including Delete, Design Complete, Design Incomplete, Attach to an Assessment Period or Remove from Assessment Period and clicking Go.
2. Assessment Scoresheet Options & Item Types
- Scoresheet Options: Click the Scoresheet Name to go to the Scoresheet Options page where you can add Instructions which can be shared with candidates as part of their personalised feedback. Here you can also add accompanying Media for each role by clicking on Media Management, add Content Tags to group scoresheets, and add a Competency Framework. You have more options available to you within each Scoresheet such as Preview Form, Unformat and Clone. Please ensure to click Update for your Scoresheet Options to take effect.
- Adding Sections: Click the Scoresheet Sections tab where you can begin to add Sections and scoring Items. Click New Section from the Choose Action dropdown and add a Section Title if you wish. You can also choose to add Sections from a previous Scoresheet from the Scoresheet Bank and all the scoring items within each of those Sections will be added. Choose what position the Section appears on the Scoresheet by changing the Section Order, set-up Assessor feedback options as appropriate, and click Add Section.
- Adding Items: Click New Item to add your first Item and you will be able to specify the Item text in the rich text editor and choose one of the following options:
- Numeric Likert Scale: Indicate the number of scoring Likert values you want in the scale. If you check the “Grade this item using values below” you are only allowed to specify numeric values for each value that you create and the highest value will accumulate as part of the Scoresheet total. You can also enable flags for any point you want a flag to be shown if scored and click a flag again to disable it.
- Numeric Value Entry: Specify Label text and a Range of Values e.g. between 0-5, 0-10, 0-20 etc.
- Numeric Slider Scale: Specify a Range of Values e.g. between 0-10, 0-20, 0-100, etc.
- Checkbox (Indicator Only): Specify a Checked Value (Non Grade). Please note this Checked Value will be available as specified but as it is not a scoring option it will not contribute to your Scoresheet total.
3. Cloning Items & Linking Competencies
- Clone Item: Once you have added your first Item to a Scoresheet, you can continue to add new items by clicking New Item, or choose from the Clone Item options to clone any item already in the Scoresheet. When you Clone an Item, the scoring values and descriptors will be cloned from the selected Item and you can add Item text, add flags and link competency domains as appropriate.
- Link Competencies: You can tag each Item to specific competency domains by clicking Link Competencies and checking the relevant domains for each Item.
4. MCQ Scoresheet Options, Pages & Questions
- MCQ Scoresheet Options: Click the Scoresheet Name to go to the Scoresheet Options page where you can add Instructions, Content Tags, and a Competency Framework, as well as utilise Preview Form, Unformat and Clone options. Ensure you click Update for your Scoresheet Options to take effect.
- Adding Pages: Click the Scoresheet Pages tab where you can begin to add Pages and Questions. Click Add Page from the Choose Action dropdown and add a Page Title if you wish. You can also choose to add Pages from a previous Scoresheet from the Scoresheet Bank and all the Questions on each of those Pages will be added. You can change the Page Order number to adjust its position.
- Adding Questions: Click New Question to add your first Question and choose from Single Best Answer, Multiple Correct Answers, Extended Match, Ranking Extended Match, Very Short Answer Questions, Short Answer Questions, or Essay Answer. You will be able to specify a Question Name, stem text in the rich text editor, link Competencies and specify Marks available per Question as well as any number of answer options depending on the Question type chosen.
- Cloning Questions: You also have the option to clone any Question in the Scoresheet already by choosing from the Clone options. When you Clone a Question, the scoring values and descriptors will be cloned from the selected Item and you can add a new Question Name, stem text, link competency domains and scoring options as appropriate.
5. Object Scoresheets
- Purpose: The Object Scoresheet type can be added to an OSCE or MMI for Stations that do not have Assessors and it is suitable for data entry or written scenarios on a circuit where Candidates input their answers on a computer or tablet.
- Creation & Invigilation: Similar to the MCQ Scoresheet type steps, you can create an Object Scoresheet with any number of Pages and any number of Questions on each for Candidates to complete under the supervision of an Invigilator.
- Station Configuration: Invigilators can configure an Object Station at a Station on the platform by logging in similar to Assessors and toggling the Invigilating this Station switch and clicking Set & Continue to move to the Candidate List.
6. The Question Bank
- Accessing the Bank: Navigate to Assessments>>>Question Bank from the top menu and you will be taken to the Question Bank page. From here you can add, edit and delete Questions that can be used in knowledge assessments.
- Searching & Filtering: You can search by keyword, Scoresheet type, Question type, Competency Framework, Branch, Period and/or Assessment event to narrow down your search.
- Question Options & Performance: You can access options for each Question in the Question Bank including Duplicate, Manage, Preview and View Performance. You can view performance for multiple Questions by selecting the ones you want to include and selecting Questions Performance and clicking Go.
Posted in user guides
