This final section covers everything you need to execute your assessment on the day, monitor live progress, view raw data, and distribute personalised feedback reports to your candidates.
1. Assessment Accessibility & Opening Windows
- Set to Accessible: When you are ready to run your assessment, you will need to ensure that both the assessment and appropriate sessions are set to Accessible so that they are available for participants to join.
- Date Windows: MCQ, Self Recording and Evidence Verification assessments have additional settings for Assessment Window Open and Close Dates which need to be specified in order for Candidates to be able to access them from their Qpercom dashboard.
- Post-Assessment Security: Once your Assessment has concluded, you should make your assessment and sessions inaccessible for security.
2. Monitoring Assessments
- Monitor Dashboard: You can monitor activity for all Assessments by clicking on the Monitor Assessment Sessions icon.
- Scoresheet Activity: You will be able to see Scoresheet activity in each Rotation with specific progress indicators:
- Purple representing a newly opened scoresheet.
- Orange progress bar showing how much of a Scoresheet each Assessor has completed.
- Green progress bar showing a fully completed Scoresheet.
3. Detailed Analysis
- Access the Histogram: You can view detailed information for each Assessment on the Analysis page by clicking on the histogram beside an Assessment event.
- Rules Tab: You can set optional assessment event rules to be incorporated into your final outcomes on this tab. Available rules include Global Rating Scale Maximum Number of Fails (Allowed), Competencies Maximum Number of Fails (Allowed), Minimum Number of Stations to Pass, Fail Overall on Number of Red Flags, Multi-Assessor Scores Per Station (1 Scoresheet), Multi-Assessor Divergence Threshold (Conditionally Formatted) and Multi-Assessor Item Divergence Threshold (Conditionally Formatted). You have a number of station level rules you can set also including the ability to pass %s per station, exclude a station from scoring, exclude a station from divergence and set fail on number of flags. Finally you can also set a pass % per competency domain on this tab. To enable your rules, ensure you click Save Rules before navigating away from the Rules tab.
- Raw Data Tab: You can view flashing scores in orange as well as completed scores in red (fail based on the current rules) and green (pass based on the current rules) on the Raw Data tab.
- Summary Tab: The Summary tab will give you an overview of how many scoresheets have been completed for each Assessment.
- Detailed Tab: The Detailed tab will give you an overview of each individual scoresheet in your assessment event and the individual score candidates get for each item on the scoresheet. At the bottom of this tab, a scoresheet items mean graph is displayed to show how each item discriminates.
- Competencies Tab: The Competencies tab will give you an overview of how candidates do within each individual competency domain tagged in your assessment event. If you have enabled the Competencies Maximum Number of Fails (Allowed) rule, the grade column will inform you of which candidates fail the assessment event based on the number of competency domains failed.
- Assessors Tab: The Assessors tab will give you an overview of all assessors participating in your assessment event and their mean scoring %.
- Graphs Tab: The Graphs tab will give you an overview of your assessment event in various graphs.
- Alerts Tab: The Alerts tab will give you a list of alerts for your assessment event.
- Appeals Tab: The Appeals tab will give you a list and status of all appeals for your assessment event and each appeal can be managed from this tab.
- QA/Export Tab: The QA/Export tab tab will give you options to export your raw data in Excel format. You can sort your data on the Raw Data tab before using the checkboxes provided and clicking Export to File. You can also access advanced analysis with standard setting options like Borderline Regression and Standard Error of Measurement by clicking on Advanced Analysis.
4. Generating Feedback Reports
- Access Send Feedback: You can generate personalised Feedback Reports by navigating to Assessments>>>Send Feedback from the top menu.
- Select Template: Select a feedback template where you can Edit your message to something appropriate for your assessment event.
- Choose Candidates: Choose the Assessment Period and Assessment you want to generate feedback for and a list of all Stations and Candidates will be listed for that event.
- Refine Inclusions: Use the checkbox filters to include or exclude the pieces of information you want Candidates to receive.
- Generate: Click Generate Feedback and personalised feedback will appear for Candidates with valid email addresses.
5. Previewing, Downloading & Publishing Feedback
- Preview Feedback: You can preview the generated reports by clicking on each Candidate ID. If you want to adjust what appears in the feedback reports, change the checkbox filters and click Generate Feedback again.
- Download Feedback (.zip): Once you are happy with the feedback generated, you can Download Feedback (.zip) to your device for one-to-one feedback sessions where you do not want Candidates to retain a copy of their feedback.
- Publish to Candidate Portfolio: Alternatively you can Publish to Candidate Portfolio so Candidates can retain a copy of their feedback. Candidates will receive their feedback report by email as well as a copy being added to their Logbook on their Qpercom Dashboard to view when they next login.
Congratulations on successfully running your assessment!
