Developing a novel international undergraduate surgical masterclass during a financial crisis: our 4-year experience

Teaching and Assessment of Medical Students During Complex Multifactorial Team-Based Tasks: The "Virtual on Call" Case Study

Abstract

Although considerable efforts have been made to incorporate simulation-based learning (SBL) in undergraduate medical education, to date, most of the medical school curricula still focus on pure knowledge or individual assessment of objective structured clinical examination skills (OSCE). To this end, we designed a case study named "iG4 (integrated generation 4) virtual on-call (iVOC)". We aimed to simulate an on-call shift in a high-fidelity virtual hospital setting in order to assess delegates' team-based performance on tasks related to patient handovers (prioritisation, team allocation).

Methods

A total of 41 clinical year medical students were split into 3 cohorts, each of which included 3 groups of 4 or 5 people. The groups consisted of a structured mix of educational and cultural backgrounds of students to achieve homogeneity. Each performing group received the handover for 5 patients in the virtual hospital and had to identify and deal with the acutely unwell ones within 15 minutes. We used TEAMTM tool to assess team-based performances.

Results

The mean handover performance was 5.44/10 ± 2.24 which was the lowest across any performance marker. The overall global performance across any team was 6.64/10 ± 2.11. The first rotating team's global performance for each cycle was 6.44/10 ± 2.01, for the second 7.89/10 ± 2.09 and for the third 6.78/10 ± 1.64 (p = 0.099 between groups).

Conclusion

This is one of the first reported, high-fidelity, globally reproducible SBL settings to assess the capacity of students to work as part of a multinational team, highlighting several aspects that need to be addressed during undergraduate studies. Medical schools should consider similar efforts with the aim to incorporate assessment frameworks for individual performances of students as part of a team, which can be a stepping-stone for enhancing safety in clinical practice.

In vivo Simulation-Based Learning for Undergraduate Medical Students: Teaching and Assessment

An increasing emphasis on simulation has become evident in the last three decades following fundamental shifts in the medical profession. Simulation-based learning (SBL) is a wide term that encompasses several means for imitating a skill, attitude, or procedure to train personnel in a safe and adaptive environment. A classic example has been the use of live animal tissue, named in vivo SBL. We aimed to review all published evidence on in vivo SBL for undergraduate medical students; this includes both teaching concepts as well as focused assessment of students on those concepts. We performed a systematic review of published evidence on MEDLINE. We also incorporated evidence from a series of systematic reviews (eviCORE) focused on undergraduate education which have been outputs from our dedicated research network (eMERG). In vivo SBL has been shown to be valuable at undergraduate level and should be considered as a potential educational tool. Strict adherence to 3R (Reduce, Refine, Replace) principles in order to reduce animal tissue usage, should always be the basis of any curriculum. In vivo SBL could potentially grant an extra mile towards medical students' inspiration and aspiration to become safe surgeons; however, it should be optimised and supported by a well-designed curriculum which enhances learning via multi-level fidelity SBL.

Student Views on a Novel Holistic Surgical Education Curriculum (iG4): A Multi-national Survey in a Changing Landscape

AIM

Essential Skills in the Management of Surgical Cases (ESMSC Marathon Course™₎ Integrated Generation 4 (iG4) is the first reported multifaceted undergraduate surgical course aiming to provide holistic surgical teaching. In this prospective observational study, we explored students' views on the iG4 curriculum, and identified how it can potentially address modern challenges in surgical training.

MATERIAL AND METHODS

Medical students were invited to apply to the course online and were screened against pre-defined criteria. A multi-national structured questionnaire incorporating five domains related to the course curriculum and our dedicated research network, was designed and distributed to participants after successful completion of the course.

RESULTS

Forty-one students from European and Asian medical schools completed the course and filled in the survey. The median overall evaluation score of the course was 4.73 out of 5 (interquartile range=4.21-4.72) and all students found that iG4 served the vision of holistic surgical education. ESMSC had a positive motivational effect towards following a career in surgery (p=0.012) and 92.7% of students declared that it should be an essential part of a future medical school curriculum. There was no statistically significant difference (p>0.05) in results between participants of different countries of study, year of studies or age group.

CONCLUSION

The ESMSC Marathon Course™ is perceived as a unique course model, with an established educational value and a positive motivational effect towards surgery. It might potentially be implemented in future medical school curricula as an essential element of undergraduate surgical education. The iG4 curriculum has opened a new exciting horizon of opportunities for advancing undergraduate holistic surgical education.

A Novel Multi-faceted Course Blueprint to Support Outcome-based Holistic Surgical Education: The Integrated Generation 4 Model (iG4)

BACKGROUND/AIM

We present a novel multi-faceted, internationally adaptable course curriculum blueprint, which provides holistic surgical education at the undergraduate level.

MATERIALS AND METHODS

The Integrated Generation 4 (iG4) course (Essential Skills in the Management of Surgical Cases - ESMSC Marathon course) curriculum consists of four essential learning components: core skills-based learning, case-based discussions, basic science workshops and soft-skills. These are all clustered in a specialty-led network architecture. Every cluster consists of modules from the four learning cores, while network nodes are modules that are mutually shared by more than one clusters.

RESULTS

We produced a standardized blueprint of 50 modules based on the 4 learning cores, covering 9 surgical specialties. This resulted in a curriculum map where every module is described using 3 parameters: χ axis (skills component), y axis (knowledge component), z axis (specialty component).

CONCLUSION

iG4 proof of concept sets the ground for a novel, reproducible and standardised effort to produce a portfolio of undergraduate surgical skills serving the vision of holistic surgical education.

ABC of Surgical Teaching: Time to Consider a Global Blueprint for Holistic Education

BACKGROUND

Educating and equipping students and trainees into clinicians capable of meeting healthcare demands and service provision needs is essential. Unprecedented events like COVID-19 pandemic, highlight urgent need for reformation of training to ensure high quality education is maintained. To this end, we describe an innovative and globally adaptable blueprint for establishing a surgical curriculum, aiming to optimize preparation of future surgeons.

METHODS

We used a structured protocol to synthesize evidence from previous systematic reviews focused on surgical education alongside a series of focused original educational studies. This approach allowed incorporation of prospectively applied novel ideas into the existing landscape of published evidence. All material used for this proof of concept derives from the outputs of a dedicated research network for surgical education (eMERG).

RESULTS

We propose the foundation blueprint framework called "Omnigon iG4" as a globally applicable model. It allows adaptation to individual local educational environments for designing, appraising and/or refining surgical curricula. We also describe the "Omnigon iG4 Hexagon Pragmatic Model," a novel perspective model which assesses the performance of our blueprint in a multi-layer fashion. This "Hexagon" model is the first to introduce pragmatic outcomes in curricula performance assessment.

CONCLUSIONS

This proof of concept, "Omnigon iG4," proposes an adaptable version of a curriculum blueprint. The framework allows educators to establish a surgical curriculum with the ability to map out competencies, permitting full control over their intended learning outcomes. This can form the basis for developing globally adaptable multifaceted Simulation-Based learning (SBL) courses or even surgical curricula for undergraduates.

Team performance training for medical students: Low vs high fidelity simulation

Objectives

The aim of this study is to evaluate a simulation-based team performance course for medical students and compare its low- and high-fidelity components.

Study design

This is a prospective crossover observational study. Groups participated in one low- and one high-fidelity session twice. Low-fidelity scenarios included management of an emergency case on a simulated-patient, whereas high-fidelity scenarios constituted of multiple-trauma cases where simulated-patients wore a hyper-realistic suit. Team performance was assessed objectively, using the TEAM™ tool, and subjectively using questionnaires. Questionnaires were also used to assess presence levels, stress levels and evaluate the course.

Results

Participants’ team performance was higher in the low-fidelity intervention as assessed by the TEAM™ tool. An overall mean increase in self-assessed confidence towards non-technical skills attitudes was noted after the course, however there was no difference in self-assessed performance between the two interventions. Both reported mean stress and presence levels were higher for the high-fidelity module. Evaluation scores for all individual items of the questionnaire were ≥4.60 in both NTS modules. Students have assessed the high-fidelity module higher (4.88 out of 5, SD = 0.29) compared to low-fidelity module (4.74 out of 5, SD = 0.67).

Conclusions

Both the low- and high-fidelity interventions demonstrated an improvement in team performance of the attending medical students. The high-fidelity intervention was more realistic, yet more stressful. Furthermore, it proved to be superior in harvesting leadership, teamwork and task management skills. Both modules were evaluated highly by the students, however, future research should address retention of the taught skills and adaptability of such interventions.

•

The high-fidelity intervention was superior in harvesting leadership, teamwork and task management skills, yet more stressful.

•

We set the group to develop a novel group of team-based OSCE performance.

•

The next step is to adapt such taught skills to different specialties and implement initiatives in the medical school curricula.

A prospective study integrating a curriculum of interventional radiology in undergraduate education: a tetra-core simulation model

Background

Interventional radiology (IR) is underrepresented in undergraduate medical curricula across Europe. By continuing to challenge the boundaries of IR, a rise in the demand for radiologists has been inevitable – a trend not met by a corresponding rise in the supply of radiologists. On tracing the roots of this shortage, lack of awareness of the specialty within medical trainees coupled with a global lack of IR teaching in undergraduate education seem to constitute major exacerbating factors. The purpose of this study was to identify gaps in the field of IR education and address these by implementing an international IR simulation-based course for undergraduates.

Results

Implementation of a multi-modality simulation-based course consisted of seven modules incorporating technical and non-technical skills, basic science and applied clinical science modules. Of all participants, 90.7% (N = 68) never had previous IR teaching experience and only 28% (N = 21) had a previous placement in an IR department. Following the course, confidence improvement was statistically significant both in IR skills (1/5, p < 0.01) and knowledge (1/5, p < 0.01)]. The majority (90.7%) said they would benefit with more exposure to IR. In terms of the students’ motivation for a career in IR, 32% (N = 24) reported that they would more likely consider a career in IR after completing the course.

Conclusion

Delivery of a tetra-core simulation course with the aim to address the gaps in undergraduate IR education has had a positive impact on students’ skills, confidence levels as well as motivation. We propose reviewing the curricula across medical schools in Europe to identify gaps and address any inadequacies; for this, we consider our simulation course an excellent starting point.

Retrospective qualitative study evaluating the application of IG4 curriculum: an adaptable concept for holistic surgical education

OBJECTIVES

Faced with a costly and demanding learning curve of surgical skills acquisition, the growing necessity for improved surgical curricula has now become irrefutable. We took this opportunity to formulate a teaching framework with the capacity to provide holistic surgical education at the undergraduate level.

SETTING

Data collection was conducted in all the relevant healthcare centres the participants worked in. Where this was not possible, interviews were held in quiet public places.

PARTICIPANTS

We performed an in-depth retrospective evaluation of a proposed curriculum, through semi-structured interviews with 10 participants. A targeted sampling technique was employed in order to identify senior academics with specialist knowledge in surgical education. Recruitment was ceased on reaching data saturation after which thematic data analysis was performed using NVivo 11.

RESULTS

Thematic analysis yielded a total of 4 main themes and 29 daughter nodes. Majority of study participants agreed that the current landscape of basic surgical education is deficient at multiple levels. While simulation cannot replace surgical skills acquisition taking place in operating rooms, it can be catalytic in the transition of students to postgraduate training. Our study concluded that a standardised format of surgical teaching is essential, and that the Integrated Generation 4 (IG4) framework provides an excellent starting point.

CONCLUSIONS

Through expert opinion, IG4 has been validated for its capacity to effectively accommodate learning in a safer and more efficacious environment. Moreover, we support that through dissemination of IG4, we can instil a sense of motivation to students as well as develop robust data sets, which will be amenable to data analysis through the application of more sophisticated methodologies.

Advancing Medical Students' Non-technical Skills in a Group-Based Setting

Aim of the study: Introduction of non-technical skill (NTS) modules in undergraduate medical curricula is essential to prevent errors that occur due to inadequate communication and malfunctioning teams. We primarily aimed to observe medical students' NTS performance improvement in a group-based setting and compare it across participants of different countries of study. Secondarily, we aimed to assess students' views on such initiatives. Material and Methods: We designed a pilot module for assessing and improving a group's NTS performance. This was based on three main pillars: simulation-based learning, constructive feedback and objective assessment. Senior medical students from EU universities were invited to apply online. Delegates were divided according to their country of study and participated in two surgical scenarios. Groups had two attempts at each scenario and feedback was given in between. Performance was assessed using a modified version of the Individual Teamwork Observation and Feedback Tool (iTOFT). Participant feedback was collected at the end of the module. Results: Eighty delegates were recruited and finished the study. A mean increase performance of 0.81 out of 3 was noted between attempts in trauma-case scenarios and 0.88 out of 3 in ward round scenarios. Overall performance improvement was similar across all groups (p > 0.05). Feedback of delegates was encouragingly positive. Conclusions: The reported improvement and positive feedback received highlight that such an intervention can be implemented in medical school curricula of all countries. Our module design, along with the use of iTOFT, should act as the basis for future development of group-based learning and assessment in undergraduate medical education.

Self-confidence and clinical skills: the case of students who study medicine in English in a non-English speaking setting

BACKGROUND

An increasing number of international students has been enrolling in medical studies in the English language offered by the countries of Eastern Europe. Development of practical skills is likely more challenging when students learn in the English language, while their patients are non-English speaking persons.

AIMS

To evaluate self-perception of practical skills of medical students in the English language program.

METHODS

From December 2016 to December 2017, a total of 52 students from the Studies in English program of two universities in Serbia were included in the study. Data were obtained by a previously validated questionnaire.

RESULTS

Participants were most confident when measuring blood pressure, checking the arterial pulse, and taking history. Students were the least confident when placing urinary catheters, performing rectal examinations, and suturing wounds. Male students reported higher confidence in "Major interventions" compared to females (p = 0.004), and no difference between male and female students was found in the total skill score of "knowledge of Serbian language" (p = 0.339). Adjusted analysis showed that a higher grade point average remains associated with a more confident perception of one's practical skills (B 26.48, 95% confidence interval 8.98-43.98). Rasch analysis showed that because the scores were distributed around the mean value between "not confident at all" and "quite confident," the majority of students had similar perceptions of their skills.

CONCLUSION

Active supervision by teaching staff is also recommended in an attempt to rectify the lack of confidence at performing a range of clinical procedures which is present among international students.

Increasing motivation and engagement in neurosurgery for medical students through practical simulation-based learning

Background

Simulation-based learning (SBL) is an essential adjunct to modern surgical education. Our study aimed to evaluate the educational benefit and motivational impact of a pilot practical neurosurgical module.

Materials and methods

38 clinical medical students from several EU Medical Schools attended an international surgical course focused on teaching and learning basic surgical skills. We designed a pilot neurosurgical workshop instructing students to insert an intracranial pressure bolt using an ex vivo pig model. Each delegate was assessed by two consultant neurosurgeons using a validated assessment tool. Structured questionnaires were distributed on completion of the module.

Results

Delegate performance increased (p < 0.001) with no difference in performance improvement across year of study (p = 0.676) or medical school (p = 0.647). All delegates perceived this workshop as a potential addition to their education (median 5/5, IQR = 0), and indicated that the course provided motivational value towards a neurosurgical career (median 4/5, IQR = 1), with no difference seen between year of study or medical school (p > 0.05).

Conclusion

Our pilot neurosurgical workshop demonstrated the educational value of practical SBL learning for motivating students towards a surgical career. Homogeneous views across year of study and medical school underline the value of developing a unified strategy to develop and standardise undergraduate surgical teaching with a practical focus.

Optimizing engagement of undergraduate students in medical education research: The eMERG training network

Background

The practice of evidence-based medicine and critical appraisal are essential for the modern doctor. Early engagement of medical students in research methodology is considered as a rising need for most medical school curricula; however, few peer-reviewed initiatives have been reported so far. We developed a Medical Education Research Group (eMERG) as part of a novel undergraduate surgical masterclass, which aimed to train undergraduate students on basic research methodology, as well as to motivate them to pursue a clinical and academic career in surgical specialties.

Methods: eMERG consists of an international structured network of senior academics, consultant-level clinicians, senior and junior trainees who support undergraduate trainees. Students are selected from a competitive pool of applicants. Several small prospective studies in skills-based education, as well as systematic reviews on similar topics, have run under the umbrella of this framework, in the form of scholarship awards. Structured feedback questionnaires were distributed to evaluate the experience of the first three years.

Results

12 students have participated in this pilot initiative. 11 manuscripts have been submitted for publication and 8 were accepted following peer-review in MEDLINE-indexed journals. Delegates perceived this experience as an excellent training opportunity which improved their research productivity. Delegates also stated engagement in research developed interest in the relevant surgical speciality, impacting their career aspirations.

Conclusions

eMERG is one of the first reported European educational research networks for undergraduates. Research outcomes and students' perceptions conclude that eMERG enhances engagement with research methodology and motivation towards a career in surgery.

•

eMERG is a pilot international research training network where medical students receive support to conduct research in Medical Education.

•

eMERG structure can serve as a novel model to convey research experience from one generation to another, and in the same time, motivate and aspire students to develop leadership skills.

•

eMERG was developed in a financial crisis environment with promising research outputs and positive students' feedback.