In close collaboration with the National University of Singapore, a Multiple Examiners feature for high stake examinations was developed and implemented between 2013 -2014. This feature is now available to any other partner who may be interested.
Examiner variability is a key concern is any assessment scenario. Although OSCE’s are well known due to their assumed robust nature OMIS provides instant psychometric analysis instantly while the examination is still ongoing. Results of Generalizability Theory analysis show that despite it being a robust exam examiners variability is the major source of variation. This multi-examiners feature allows two or more examiners to assess one or more stations. Stations are specifically assigned to named examiners and examiners weighting can be set according to experience or expertise in the field of examination. OMIS will calculate the weighted average between examiners and no-more discussion is required about a mutually agreed mark. Variability now gets a face and further analysis between multi-examiners in high stakes (final) exams becomes within reach.