Perception of Students and Examiners about Objective Structured Clinical Examination in a Teaching Hospital in Ethiopia

Evaluating the Role of Objective Structured Clinical Examination as a Summative Assessment Tool in Undergraduate and Postgraduate Psychiatry Residents

BACKGROUND

The Objective Structured Clinical Examination (OSCE) is the gold standard and universal format to assess medical students' clinical competence in a comprehensive, reliable, and valid manner. OSCE is gaining global popularity for assessing medical students in various specialties. Our country uses it in multiple disciplines, but its application in psychiatry remains limited. OSCE is a resource-demanding assessment method that can face numerous challenges. A comprehensive assessment of perceptions regarding OSCE can help identify areas that need improvement. Therefore, this study was conducted to assess the perceptions of students and examiners toward OSCE in psychiatry.

AIMS AND OBJECTIVES

This study aims to evaluate the role of Objective Structured Clinical Examination as a summative assessment tool in assessing competency in undergraduate (as part of their ward leaving examinations in psychiatry) and postgraduate psychiatry residents (as part of their six-monthly assessments) and analyze the perceptions of students as well as of the faculty members regarding OSCE.

METHODS

Six MD students and 49 MBBS students took the OSCE as part of their ward-level exams in psychiatry. In the presence of four faculty members of the psychiatry department, students completed their six-month summative exams. The OSCE was held at separate times for UG and PG students. UG and PG students utilized different stations (PG students had a harder level). A 10-item questionnaire was given to examiners and students at the end of the OSCE to get their opinions regarding the OSCE. Furthermore, data gathered from the faculty through an open-ended questionnaire was compiled and displayed thematically. Since the Likert scale survey generated ordinal data, the statistical analysis was conducted using the median, interquartile range (IQR), and chi-square test. The chi-square test was used to compare the variables. A P-value of less than 0.05 was deemed statistically noteworthy.

RESULTS

Four faculty members and fifty-five students in all answered the questionnaire. Regarding the OSCE's characteristics, validity, reliability, and transparency, the majority of students expressed positive opinions. In a similar vein, most examiners had positive perceptions pertaining to OSCE's administration, structure, and procedures. Certain areas, such as "improved confidence in teaching clinical skills" and "improved confidence in giving students structured feedback," were also emphasized by thematic analysis of faculty members.

CONCLUSION

In general, both students and examiners had extremely favorable perceptions of and embraced the OSCE. Improved faculty orientation and student preparation for the OSCE may help allay anxiety and overcome hesitation related to the exam.

Designing and implementing an OMMID midwifery professional competence mixed test: A multimethod, multiphasic study

The assessment of professional competence is essential to ensure the achievement of competence standards. The goal of this study is to design and implement a professional competence test model to make the test unified, comprehensive, and fair. This research was a multimethod, multiphasic study. The first qualitative phase of the nominal group technique was conducted to design the test model with specific guidelines. The second phase was a mixed-method parallel field trial conducted on 161 senior midwifery bachelor students in universities of Iran. The test was conducted following the traditional method in the control group and OMMID model in the intervention group. This model consists of three parts: the MCQs (multiple choice questions), OSCE (objective structured clinical examination), and clinically-oriented tests, which included Mini-CEX (mini-clinical evaluation exercise) and DOPS (direct observation of procedural skills). Data were collected using questionnaires and interviews, and the results were assessed qualitatively and quantitatively. The OMMID model and the associated guideline were designed. Qualitative data analysis resulted in six main themes, including organizing, structure, tension due to change, fairness, unification, and outcome. The OMMID model did not increase students' anxiety and stress and did not decrease their satisfaction. The merits of this model include having a centralized guideline, using multiple evaluation methods, comprehensive evaluation of necessary skills, promotion of fairness, and increased student satisfaction.

Autonomic stress response of physiotherapy student in the different scenarios of an objective structured clinical examination

The aim of the present research was to analyse modifications in the autonomic stress response of Physiotherapy students undergoing a 12-scenario Objective Structured Clinical Evaluation (OSCE). A total of 86 last year students of the Physiotherapy bachelor's degree (27.29 years (SD = 6.66); 36 females and 50 males) randomly assigned were monitored during the complete OSCE to measure heart rate variability (HRV) in temporal, frequency, and non-linear domains. The HRV analysed showed a large anticipatory stress response of students maintained during the entire evaluation. The stress response varied regarding OSCE station complexity and demands and the highest sympathetic response was not found in higher emotional scenarios.The autonomic modulation monitoring allows teachers to design OSCE scenarios more adapted to the students, limiting the effect of the stress response to allow a better performance.