Developing doctors: what are the attitudes and perceptions of year 1 and 2 medical students towards a new integrated formative objective structured clinical examination?

Stress and value: the student perspective on utilizing real vs. actor patients in objective structured clinical examinations

BACKGROUND

Studies have shown objective structured clinical examinations (OSCEs) to be one of the most reliable tools in assessing clinical performance; however in Pediatrics they primarily use manikins, simulators or parent actors which limits the comprehensiveness of the assessment. In our Pediatric Clerkship, medical students are evaluated using a standardized rubric during a clinical evaluation exercise (CEX) with real patients. This study assessed medical students' perceived stress levels and the educational value of the CEX compared an OSCE. We hypothesized there would be equal stress and value for students with the CEX experience compared to the OSCE.

METHODS

Third year students anonymously completed questionnaires after required Pediatric CEX and Internal Medicine OSCE evaluations from July 2016-June 2017. The questionnaire included questions from the Intrinsic Motivation Inventory, a validated tool used to assess feelings of stress and perceived value of an exercise.

RESULTS

A total of 147 and 145 questionnaires were completed after the CEX and OSCE. There were no differences between groups regarding levels of "nervousness" (p = 0.543) and "relaxation" (p = 0.055); students felt more "at ease" (p = 0.002) and less "pressure" (p < 0.001) during the CEX. Students perceived the CEX to be more useful and important to improve skills compared to the OSCE for the history taking, physical exam and interpersonal skills.

CONCLUSIONS

Our results indicate that the CEX was associated with lower stress levels and had higher perceived value when compared to the OSCE. This study supports the usefulness of incorporating real patients into the clinical evaluation of medical students.

Early formative objective structured clinical examinations for students in the pre-clinical years of medical education: A non-randomized controlled prospective pilot study

BACKGROUND

The value of formative objective structured clinical examinations (OSCEs) during the pre-clinical years of medical education remains unclear. We aimed to assess the effectiveness of a formative OSCE program for medical students in their pre-clinical years on subsequent performance in summative OSCE.

METHODS

We conducted a non-randomized controlled prospective pilot study that included all medical students from the last year of the pre-clinical cycle of the Université Paris-Cité Medical School, France, in 2021. The intervention group received the formative OSCE program, which consisted of four OSCE sessions, followed by debriefing and feedback, whereas the control group received the standard teaching program. The main objective of this formative OSCE program was to develop skills in taking a structured medical history and communication. All participants took a final summative OSCE. The primary endpoint was the summative OSCE mark in each group. A questionnaire was also administered to the intervention-group students to collect their feedback. A qualitative analysis, using a convenience sample, was conducted by gathering data pertaining to the process through on-site participative observation of the formative OSCE program.

RESULTS

Twenty students were included in the intervention group; 776 in the control group. We observed a significant improvement with each successive formative OSCE session in communication skills and in taking a structured medical history (p<0.0001 for both skills). Students from the intervention group performed better in a summative OSCE that assessed the structuring of a medical history (median mark 16/20, IQR [15; 17] versus 14/20, [13; 16], respectively, p = 0.012). Adjusted analyses gave similar results. The students from the intervention group reported a feeling of improved competence and a reduced level of stress at the time of the evaluation, supported by the qualitative data showing the benefits of the formative sessions.

CONCLUSION

Our findings suggest that an early formative OSCE program is suitable for the pre-clinical years of medical education and is associated with improved student performance in domains targeted by the program.

Formative Objective Structured Clinical Examinations (OSCEs) as an Assessment Tool in UK Undergraduate Medical Education: A Review of Its Utility

The Objective Structured Clinical Examination (OSCE) is a globally established clinical examination; it is often considered the gold standard in evaluating clinical competence within medicine and other healthcare professionals' educations alike. The OSCE consists of a circuit of multiple stations testing a multitude of clinical competencies expected of undergraduate students at certain levels throughout training. Despite its widespread use, the evidence regarding formative renditions of the examination in medical training is highly variable; thus, its suitability as an assessment has been challenged for various reasons. Classically, Van Der Vleuten's formula of utility has been adopted in the appraisal of assessment methods as means of testing, including the OSCE. This review aims to provide a comprehensive overview of the literature surrounding the formative use of OSCEs in undergraduate medical training, whilst specifically focusing on the constituents of the equation and means of mitigating factors that compromise its objectivity.

Objective structured clinical examination: Challenges and opportunities from students’ perspective

Background

Objective structured clinical examination (OSCE) has been used in evaluating clinical competence in health professions education around the world. Despite its implementation in Iraq for around a decade, limited studies investigated the challenges and opportunities to improve the standard and quality of this examination from student’s perspective.

Methods

This qualitative study was based on an online open-ended questionnaire survey that was carried out in the College of Medicine, Hawler Medical University, Iraq at the beginning of the 2018–2019 academic year. A convenience sample of 180 students in the clinical phase (4th, 5th, and 6th) year of study were invited to participate.

Results

A total of 141 students responded to the online questionnaire. The participants were generally happy with the OSCE, and they recognized many positive aspects, including the role of the OSCE in increasing confidence, engagement and motivating learning, the role of the OSCE in achieving a higher level of learning, the content validity of the OSCE, and the quality of the OSCE. The main weak points of the OSCE identified by the students included unfairness, gender discrimination, duration of the OSCE, and the behavior of the examiners. Suggestions to improve the OSCE examination included improving the examiners’ behavior, with the focus on the training of the examiners, and avoiding discrimination among students.

Conclusions

Most of the students were generally satisfied with the current OSCE examination. The main concern of the students was related to the organization of the OSCE. Valuable suggestions were raised to improve the OSCE quality including examiners’ and simulated patients’ training.

Midwifery students' experiences of objective structured clinical examinations: A qualitative evidence synthesis

OBJECTIVES

To identify and synthesise the evidence of midwifery students' views and experiences of Objective Structured Clinical Examinations (OSCEs).

DESIGN

A qualitative evidence synthesis was undertaken using Thomas and Harden's synthesis methods and reported according to the ENTEREQ guidelines.

DATA SOURCES

PubMED, CINAHL Plus, Embase, ERIC, PsycINFO, Social Science Citation Index (via Web of Science) and Scopus were searched from inception to 19th February 2020 and an updated search was performed on 12th May 2021 to identify qualitative and mixed method studies, reporting qualitative data of undergraduate midwifery students' views and experiences of OSCEs.

REVIEW METHODS

Studies were independently screened by title and abstract according to a predetermined inclusion and exclusion criteria. Full text review was then conducted independently by two authors. Studies providing qualitative data on undergraduate midwifery students' views and experiences of OSCEs during their midwifery registration education programmes were included. Quality appraisal was performed using the Critical Appraisal Skills Programme (CASP) tool. Data synthesis was performed using Thomas and Harden's thematic synthesis method.

RESULTS

Eleven studies were identified and included. Thematic synthesis identified 13 descriptive themes which translated into four analytical themes that represented midwifery students' views and experiences of OSCEs: the preparation phase, the assessment phase, the feedback phase and the translation phase.

CONCLUSIONS

This synthesis offers insight into undergraduate midwifery students' views and experiences of OSCEs and how they are experienced across four phases. This is determined to be a useful structure to guide midwifery educators and researchers in their consideration of the student experience of OSCEs in the future. Midwifery students in this synthesis reported high levels of nervousness, anxiety, and stress during the OSCE process. The findings reveal that there are a number of controllable factors impacting on midwifery students' feelings of safety in the assessment environment, and that these should be addressed to maximise the advantages that the OSCE has to offer in terms of learning and preparation for clinical practice.

Perception of Students and Examiners about Objective Structured Clinical Examination in a Teaching Hospital in Ethiopia

INTRODUCTION

The objective structured clinical examination (OSCE) has become a standard assessment tool in undergraduate medical school training. It is considered an objective assessment of practical skill of students. OSCE is a resource demanding assessment method that can have numerous challenges. Comprehensive assessment of perception regarding OSCE can help identify areas that need improvement. The aim of this study was to assess the perception of students and examiners towards OSCE.

METHODS

A cross-sectional study was conducted on students and examiners undertaking OSCE from May 1 to July 30, 2021, using a structured questionnaire. Comparison of variables was done using Mann-Whitney U-Test and Chi-square test. P-value <0.05 was considered statistically significant.

RESULTS

A total of 141 students and 39 examiners participated in the study. The majority of the students and examiners had a positive response regarding the attributes, structure, organization and validity of OSCE. It was recommended to be used in future exams compared to other assessments by 38.3% of students and 51.3% of examiners. There were certain challenges reported by students and included stressfulness of the exam (51.1%), inadequate time (27.6%), and unsatisfactory orientation (30.5%). One-third of examiners considered it stressful, while 20.5% considered the time provided to be inadequate. Equipment to conduct the exam was considered inadequate by 39.1% and 56.4% of students and examiners, respectively. Around 80.1% of students recommended mock sessions and 23.1% of examiners did not have any prior training on OSCE.

CONCLUSION

An overall positive perception of OSCE by students and examiners was seen. Certain challenges that need improvements were identified. Continuing evaluation and refinement of OSCE by departments is needed. We recommend further wide-scale national evaluation of the OSCE examination system of medical students.

Tutor-Student Partnership in Practice OSCE to Enhance Medical Education

BACKGROUND

Training of examiners is essential to ensure the quality of objective structured clinical examination (OSCE). We aimed to study a perceived effectiveness of tutor-student partnership in a practice OSCE module by novice OSCE tutors and medical students.

METHOD

We implemented a practice OSCE at a medical faculty in France with novice tutors and third year medical students as partners. Each tutor (n = 44) served as a partner for the group of 5 students in the conception of the scenario and as an evaluator of the tutored station. Students (n = 303) were involved in the conception of a case and the roles of a physician, evaluator and a simulated patient. Data were obtained through self-assessment questionnaires. Descriptive statistics were used to analyze items of the questionnaires. Free-form answers were coded and analyzed thematically.

RESULTS

A total of 36 tutors (82%) and 185 students (61%) responded to the questionnaires. The intervention was well perceived. Thirty-two percent of the tutors reported some difficulties in the assessment of student performance and were disposed to receive further training. Fifty-five percent of the students considered the participation in the OSCE case development appropriate to their level of knowledge, and 70% perceived it as beneficial allowing them to set their learning goals.

CONCLUSION

This initiative provides a relevant method beneficial to OSCE tutors, medical students, and the faculty. Tutors learn how to assess student performance according to expected achievement levels. It allows students to be engaged as partners in co-creation of learning and teaching.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s40670-021-01421-9.

The 3-D Skills Model: a Randomised Controlled Pilot Study Comparing a Novel 1-1 Near-Peer Teaching Model to a Formative OSCE with Self-regulated Practice

INTRODUCTION

Near-peer teaching is a popular pedagogical teaching tool, with well-recognised benefits for students and tutors. There are multiple existing models to structure these interventions, but it is often unclear how they translate to academic attainment. We designed a novel near-peer teaching model that expands on previous research.

METHODS

Our model was piloted in a formative Objective Structured Clinical Examination (OSCE) setting, trialled on 22 pre-clinical medical students to establish feasibility, acceptability and descriptive outcomes that could inform the design of a larger study. Students were randomly assigned to intervention or control cohorts. Each cohort undertook 5 min formative OSCE assessments with either 3 additional minutes of structured teaching or 3 min of self-regulated practice before reattempting the first OSCE station. Checklist marking sheets for 1^st and 2^nd sittings were collected by independent external markers, in addition to a global assessment rating in which we used the Borderline Regression Method to establish the station pass mark.

RESULTS

A quantitative and qualitative result analysis was performed, demonstrating that students gained on average 3 additional marks after teaching with this model. Students and student-tutors reported increased confidence, high course satisfaction and evidence of reflective practice.

DISCUSSION

We established acceptability and feasibility outcomes. The descriptive outcomes will support the design of a larger, adequately powered study required to demonstrate translation to summative exam performance.

SUPPLEMENTARY INFORMATION

The online version contains supplementary material available at 10.1007/s40670-021-01369-w.

Perception of Medical Undergraduate Students about an Electronic Practical Examination In Orthopaedics During the COVID-19 Pandemic

BACKGROUND/PURPOSE OF STUDY

No study has evaluated the perception of medical undergraduate students to the electronic objective structured practical examination (e-OSPE) in orthopaedics. The aim of the present study is to evaluate the feasibility and perception of the medical undergraduate students to e-OSPE conducted by the department of Orthopaedics to assess problem-solving and clinical decision-making skills of medical undergraduate students.

METHODS

Medical undergraduate students of second and third year at our medical college who completed the orthopaedic clinical posting and appeared for the orthopaedic practical examination during the second wave of the COVID-19 pandemic were included in this prospective observational study. Students appearing for the exams from 20th March 2021 to 26th June 2021 were invited to complete the questionnaire immediately after the e-OSPE. Internal consistency of the survey questions was assessed using Cronbach's alpha.

RESULTS

272 out of 312 eligible students completed the survey and the survey response rate was 87.2%. Nine groups of medical undergraduate students gave the orthopaedic practical exams from 20th March 2021 to 26th June 2021. 91.2% students felt that the e-OSPE represented a valid modality of evaluation of essential orthopaedic practical knowledge during the COVID-19 pandemic. The overall reliability of the 19 questions included in our survey was very high (Internal consistency: Cronbach's alpha = 0.88).

CONCLUSION

The e-OSPE was well received by the medical undergraduate students at our institute and the students had a positive perception about the new examination technique used in orthopaedics during the COVID-19 pandemic.

Exploring wellbeing in first year medical students amidst a curriculum change

BACKGROUND

The support of student wellbeing features highly in all higher education institutional agendas. For medical students good physical and mental health can help prevent burnout, equip students for their future healthcare setting and indirectly improve patient care. At the University of Nottingham (UK), we were keen to explore undergraduate medical students perceived wellbeing before, during, and after an early years' (years 1-3) curriculum change. A restructure of the curriculum enabled personal wellbeing sessions to be embedded and directly linked to the pastoral support system.

METHODS

Students' perceived wellbeing was assessed through a questionnaire distributed to three cohorts of first year students at the start and end of the autumn semester.

RESULTS

The data showed a clear improvement of perceived physical health at the end of the first semester following the curriculum change, alongside increased mood and ability to relax. A surprising outcome of this study was that students reported increased stress levels at the end of the semester, which we believe may be attributed to the change in assessment within the new curriculum. Our medical students are now facing end of year summative examinations, but are acutely aware of their progress as they undertake frequent formative assessments during the year. We propose that comparison of performance with peers is having a direct impact on perceived stress in these cohorts.

CONCLUSIONS

The study has shown that embedding wellbeing in the curriculum can have positive effects even within a changing curriculum. The importance of evolving wellbeing provision and support based on the needs of the student population is essential and probably never more in need than at this moment in time.

Stress, anxiety, self-efficacy, and the meanings that physical therapy students attribute to their experience with an objective structured clinical examination

BACKGROUND

Excessive stress and anxiety can impair learning. The objective structured clinical examination (OSCE) is a valuable tool to assess and promote the acquisition of clinical skills. However, significant OSCE-related stress and anxiety are frequently reported. The aim of this study was to investigate the relationships between physiological stress, self-reported levels of anxiety due to an OSCE, self-efficacy, and the meanings that physical therapy students attribute to their experience with the exam.

DESIGN

Concurrent mixed methods study.

METHODS

A total of 32 students took part in this study. All were enrolled in the third semester of a 10-semester Physical Therapy Bachelor Program. Salivary cortisol levels, self-reported anxiety (State-Trait Anxiety Inventory, STAI) were measured before the OSCE. Exam scores and self-efficacy ratings were also recorded. Correlations between variables were tested with the Pearson correlation, with ɑ at 0.05. Semi-structured interviews were used to explore the personal perspectives of students. Thematic analysis was used to investigate emergent themes.

RESULTS

Trait anxiety scores were significantly higher than normative values (p < 0.001). A high proportion of students showed high (STAI> 49) state anxiety (37.5%) and trait anxiety (65.6%). Salivary cortisol was not associated anxiety (p > 0.05). Neither stress nor anxiety correlated with OSCE scores. A moderate and significant direct correlation was found for self-efficacy scores and OSCE scores (r = 0.475, p = 0.007). Students reported that confidence had a calming effect and led to better self-perceived performance. They also reported that the OSCE can provide meaningful learning experiences despite being stressful.

CONCLUSIONS

A high proportion of our students reported a stable/lingering negative affect. However, neither stress nor anxiety related to OSCE scores. Students' confidence in their capabilities was correlated with their performance. Their subjective reports suggest that self-confidence may have protected them from the negative effects of stress and anxiety on academic performance.

Formative assessment scores in tutorial sessions correlates with OSCE and progress testing scores in a PBL medical curriculum

BACKGROUND

Effective assessments programs are a challenge in problem-based learning (PBL). One of the main principles of this educational setting is the Formative Assessment (FA). We hypothesized that students' performance assessed by FA in tutorial sessions in a PBL curriculum is related to other summative assessments.

OBJECTIVE

To investigate the correlation among FA in tutorial sessions with grades obtained in Objective Structured Clinical Evaluation (OSCE) and Progress Testing (PT) to better understand the assessment process in PBL medical teaching approach and to predict student's future performance.

DESIGN

An observational cross-sectional study was conducted comparing FA, OSCE and PT scores from 4th to 8th semester medical students. Correlation analyses were performed using pooled and separate data from the 4th and 8th semesters.

RESULTS

From the 5th to 8th semester, OSCE scores were smaller compared to the FA, while PT scores were lower in all stages. In the pooled data, the correlation analysis showed a significant positive relationship between grades on FA and OSCE, FA and PT and OSCE and PT. A significant correlation among the three assessments strategies was also detected in the 8^th semester, but not in the 4th semester.

CONCLUSIONS

Assessment strategies in PBL approach, including FA, OSCE and PT, have positive correlations, which increases as the medical course becomes more complex.

Situational awareness within objective structured clinical examination stations in undergraduate medical training - a literature search

BACKGROUND

Medical students may not be able to identify the essential elements of situational awareness (SA) necessary for clinical reasoning. Recent studies suggest that students have little insight into cognitive processing and SA in clinical scenarios. Objective Structured Clinical Examinations (OSCEs) could be used to assess certain elements of situational awareness. The purpose of this paper is to review the literature with a view to identifying whether levels of SA based on Endsley's model can be assessed utilising OSCEs during undergraduate medical training.

METHODS

A systematic search was performed pertaining to SA and OSCEs, to identify studies published between January 1975 (first paper describing an OSCE) and February 2017, in peer reviewed international journals published in English. PUBMED, EMBASE, PsycINFO Ovid and SCOPUS were searched for papers that described the assessment of SA using OSCEs among undergraduate medical students. Key search terms included "objective structured clinical examination", "objective structured clinical assessment" or "OSCE" and "non-technical skills", "sense-making", "clinical reasoning", "perception", "comprehension", "projection", "situation awareness", "situational awareness" and "situation assessment". Boolean operators (AND, OR) were used as conjunctions to narrow the search strategy, resulting in the limitation of papers relevant to the research interest. Areas of interest were elements of SA that can be assessed by these examinations.

RESULTS

The initial search of the literature retrieved 1127 publications. Upon removal of duplicates and papers relating to nursing, paramedical disciplines, pharmacy and veterinary education by title, abstract or full text, 11 articles were eligible for inclusion as related to the assessment of elements of SA in undergraduate medical students.

DISCUSSION

Review of the literature suggests that whole-task OSCEs enable the evaluation of SA associated with clinical reasoning skills. If they address the levels of SA, these OSCEs can provide supportive feedback and strengthen educational measures associated with higher diagnostic accuracy and reasoning abilities.

CONCLUSION

Based on the findings, the early exposure of medical students to SA is recommended, utilising OSCEs to evaluate and facilitate SA in dynamic environments.

Integrated Medical Curriculum: Advantages and Disadvantages

Most curricula for medical education have been integrated horizontally and vertically--vertically between basic and clinical sciences. The Flexnerian curriculum has disappeared to permit integration between basic sciences and clinical sciences, which are taught throughout the curriculum. We have proposed a different form of integration where the horizontal axis represents the defined learning outcomes and the vertical axis represents the teaching of the sciences throughout the courses. We believe that a mere integration of basic and clinical sciences is not enough because it is necessary to emphasize the importance of humanism as well as health population sciences in medicine. It is necessary to integrate basic and clinical sciences, humanism, and health population in the vertical axis, not only in the early years but also throughout the curriculum, presupposing the use of active teaching methods based on problems or cases in small groups.