The Standard Error of Measurement (SEM) indicates the amount of error around the observed score. The observed score, the score we retrieve, store and analyse from an OSCE, is in fact the result of the true score and error around this true score. If we want a reliable decision around passing or failing a station […]
An Online Management Information System for Objective Structured Clinical Examinations
A few words about this paper… During 2006 – 2008, David Cunningham, as an intern, and myself as a lecturer, were engaged with teaching & learning in the National University of Ireland, Galway, in the School of Medicine (Medical Informatics & Medical Education in those days). Our OSCE procedures involving the planning and execution of […]
Back to the Future 1: Electronic Marking of Objective Structured Clinical Examinations and Admission Interviews Using an Online Management Information System in Schools of Health Sciences
A few words on this paper… ‘Back to the Future’ refers to the 1985 American science fiction film directed by Robert Zemeckis, featuring Micheal J. Fox as teenager Marty McFly. Marty, a 17-year-old high school student, is accidentally sent thirty years into the past in a time-traveling DeLorean invented by his close friend, the maverick […]
Reliability and validity of OSCE checklists used to assess the communication skills of undergraduate medical students: A systematic review
A few words about this paper… In 2011, Winny from Indonesia approached me to ask whether he could join us for a PhD track. It would be an opportunity to investigate the wide range of communications stations used within our School of Medicine. Data was collected using our OSCE Management Information System. A systematic review […]
Calibration of Communication Skills Items in OSCE Checklists according to the MAAS-Global
A few words about this paper… After the discovery that about 17 different styles of communications skills are used in the field of communication skills training in medical education, it was apparent we needed to validate the communication skills items included in OSCE checklists. Within our own School of Medicine, in the College of Medicine, […]
True communication skills assessment in interdepartmental OSCE stations: Standard setting using the MAAS-Global and EduG
A few words about this paper… In medical education it is extremely helpful to compare outcomes. To be able to compare communication skills outcomes between students, years of study or between institutions is very challenging. If the measurement of particular learning outcomes is not standardised, just as using a standardised measurement tape to measure length, […]
Measuring situation awareness in medical education objective structured clinical examination guides
A few words about this paper… This paper was written by two undergraduate medical students. This is another good example of student participation in undergraduate medical education research. John and Margaret performed a pilot according to Markus’s initial observation that aspects of Situation Awareness could be measured in OSCEs. Both students used the station OSCE […]
Situational awareness within objective structured clinical examination stations in undergraduate medical training – A literature search
A few words about this paper… A great new PhD track was launched with Markus Fischer’s idea to look into situation awareness (SA). The latter term is known from the aviation industry and requires pilots to be aware of all critical situations that may occur while flying a plane. More and more evidence is emerging […]
Borderline Regression Analysis in Assessment
Borderline regression analysis (BRA) is an absolute, examinee-centered standard setting method widely used to standard set OSCE exams, Yousuf, Violato, and Zuberi (2015). Candidates are awarded a “global score” for a station in a circuit, based on the examiner’s professional judgment of their ability. Borderline Regression Method is illustrated above using item score on the […]