1
|
Tesfai FM, Nagi J, Morrison I, Boal M, Olaitan A, Chandrasekaran D, Stoyanov D, Lanceley A, Francis N. Objective assessment tools in laparoscopic or robotic-assisted gynecological surgery: A systematic review. Acta Obstet Gynecol Scand 2024; 103:1480-1497. [PMID: 38610108 PMCID: PMC11266631 DOI: 10.1111/aogs.14840] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2024] [Revised: 02/28/2024] [Accepted: 03/19/2024] [Indexed: 04/14/2024]
Abstract
INTRODUCTION There is a growing emphasis on proficiency-based progression within surgical training. To enable this, clearly defined metrics for those newly acquired surgical skills are needed. These can be formulated in objective assessment tools. The aim of the present study was to systematically review the literature reporting on available tools for objective assessment of minimally invasive gynecological surgery (simulated) performance and evaluate their reliability and validity. MATERIAL AND METHODS A systematic search (1989-2022) was conducted in MEDLINE, Embase, PubMed, Web of Science in accordance with PRISMA. The trial was registered with the Prospective Register of Systematic Reviews (PROSPERO) ID: CRD42022376552. Randomized controlled trials, prospective comparative studies, prospective single-group (with pre- and post-training assessment) or consensus studies that reported on the development, validation or usage of assessment tools of surgical performance in minimally invasive gynecological surgery, were included. Three independent assessors assessed study setting and validity evidence according to a contemporary framework of validity, which was adapted from Messick's validity framework. Methodological quality of included studies was assessed using the modified medical education research study quality instrument (MERSQI) checklist. Heterogeneity in data reporting on types of tools, data collection, study design, definition of expertise (novice vs. experts) and statistical values prevented a meaningful meta-analysis. RESULTS A total of 19 746 titles and abstracts were screened of which 72 articles met the inclusion criteria. A total of 37 different assessment tools were identified of which 13 represented manual global assessment tools, 13 manual procedure-specific assessment tools and 11 automated performance metrices. Only two tools showed substantive evidence of validity. Reliability and validity per tool were provided. No assessment tools showed direct correlation between tool scores and patient related outcomes. CONCLUSIONS Existing objective assessment tools lack evidence on predicting patient outcomes and suffer from limitations in transferability outside of the research environment, particularly for automated performance metrics. Future research should prioritize filling these gaps while integrating advanced technologies like kinematic data and AI for robust, objective surgical skill assessment within gynecological advanced surgical training programs.
Collapse
Affiliation(s)
- Freweini Martha Tesfai
- The Griffin InstituteNorthwick Park & St Marks' HospitalLondonUK
- EGA Institute for Women's HealthUniversity College LondonLondonUK
- Wellcome/EPSRC Center for Interventional and Surgical Sciences (WEISS)University College LondonLondonUK
| | | | - Iona Morrison
- Yeovil District HospitalSomerset Foundation NHS TrustYeovilUK
| | - Matt Boal
- The Griffin InstituteNorthwick Park & St Marks' HospitalLondonUK
- EGA Institute for Women's HealthUniversity College LondonLondonUK
- Wellcome/EPSRC Center for Interventional and Surgical Sciences (WEISS)University College LondonLondonUK
| | | | - Dhivya Chandrasekaran
- EGA Institute for Women's HealthUniversity College LondonLondonUK
- Department of Gynecological OncologyUniversity College of London HospitalsLondonUK
| | - Danail Stoyanov
- EGA Institute for Women's HealthUniversity College LondonLondonUK
- Wellcome/EPSRC Center for Interventional and Surgical Sciences (WEISS)University College LondonLondonUK
| | - Anne Lanceley
- EGA Institute for Women's HealthUniversity College LondonLondonUK
| | - Nader Francis
- The Griffin InstituteNorthwick Park & St Marks' HospitalLondonUK
- EGA Institute for Women's HealthUniversity College LondonLondonUK
- Yeovil District HospitalSomerset Foundation NHS TrustYeovilUK
| |
Collapse
|
2
|
Saeed S, Kashif U, Zaki S, Samad K, Yousuf MZ, Raza M, Jabbar S, I Khan U. Teaching Clinical Skills Using Online Modality through Modified Peyton's Framework: An Experience from a Medical University in Pakistan. JOURNAL OF ADVANCES IN MEDICAL EDUCATION & PROFESSIONALISM 2023; 11:15-23. [PMID: 36685146 PMCID: PMC9846095 DOI: 10.30476/jamp.2022.95986.1669] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Subscribe] [Scholar Register] [Received: 06/29/2022] [Accepted: 10/22/2022] [Indexed: 06/17/2023]
Abstract
INTRODUCTION Medical institutions worldwide faced an unprecedented situation during COVID-19 of identifying alternative strategies to sustain the continuum of learning process. This led to several innovations in the traditional medical curriculum. This study explored the effectiveness and feasibility of using the Peyton's framework modified for a virtual platform (Microsoft Teams) for teaching clinical skills to first and second-year medical students at The Aga Khan University, Karachi, Pakistan. METHODS In 2020-2021, the modified Peyton's framework was integrated in the clinical skills (CS) curriculum for all first- and second-year students (N=200). For evaluation, a mixed-method design was used, with pre-and post-session questionnaires. Students' satisfaction was obtained through the standard session evaluation tool of the university. For the qualitative arm, to explore the instructors' experiences, purposive sampling was used (n=8) and a focused group discussion (FGD) was conducted. Finally, performance of the students at the end of year summative Objective Structured Clinical Examination (OSCE) was compared with the students of previous year. Quantitative data were analysed using STATA® version 15.1, using paired t-test to compare the differences in OSCE scores in selected CS stations. A p-value of <0.05 was considered significant for all tests. The FGD was transcribed and analysed through manual content analysis. RESULTS Nine clinical skills (that included history and examination skills) were taught using the virtual platform. There was a significant improvement in post-session questionnaires in seven of these skills (p value <0.01). Session evaluations showed that most students were satisfied with the learning experience. The instructors showed that the online teaching offered a promising platform for teaching history taking skills. The OSCE scores showed mixed results, with significant improvement in two out of four repeated stations by using paired t-test [abdominal exam (87.33 ± 8.99, <0.001); and precordial examination (88.45 ± 8.36, 0.001)]. CONCLUSIONS Modifying Peyton's framework to a virtual platform allowed us to sustain the continuum of clinical education during the COVID-19 pandemic. The results support the use of a blended learning environment for teaching clinical skills.
Collapse
Affiliation(s)
- Sana Saeed
- Department of Pediatrics and Child Health and Department for Educational Development, The Aga Khan University, Karachi, Pakistan
| | - Urooj Kashif
- Department of Obstetrics and Gynecology, The Aga Khan University, Karachi, Pakistan
| | - Samar Zaki
- Department of Family Medicine, The Aga Khan University, Karachi, Pakistan
| | - Khalid Samad
- Department of Anesthesiology, The Aga Khan University, Karachi, Pakistan
| | - Muhammad Zuhair Yousuf
- Department of Biological & Biomedical Sciences, The Aga Khan University, Karachi, Pakistan
| | - Mahanoor Raza
- Department of Pediatrics and Child Health and Department for Educational Development, The Aga Khan University, Karachi, Pakistan
| | - Shahjahan Jabbar
- Office of Undergraduate Medical Education, The Aga Khan University, Karachi, Pakistan
| | - Unab I Khan
- Department of Family Medicine, The Aga Khan University, Karachi, Pakistan
| |
Collapse
|
3
|
Le M, Boettcher J, Vincent D, Elrod J, Mietzsch S, Romero P, Perez A, Reinshagen K, Boettcher M. The Spaced Learning Concept in Combination With Halsted and Peyton - A Randomized Controlled Study. JOURNAL OF SURGICAL EDUCATION 2022; 79:1228-1236. [PMID: 35577726 DOI: 10.1016/j.jsurg.2022.04.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 03/12/2022] [Accepted: 04/11/2022] [Indexed: 06/15/2023]
Abstract
BACKGROUND Several motor learning models have been used to teach highly complex procedural skills in medical education. Two approaches are often employed amongst health care professionals: Halsted's "See one - do one - teach one" concept and Peyton's Four-step approach. Peyton's deconstruction of the learning process into 4 sub-steps was reported to be preferable for learning/acquiring/teaching complex clinical skills. However, a new increasingly popular technique is known as the spaced learning method. In a previous study, we were able to confirm that the spaced learning concept is superior for laparoscopic suturing and knot tying compared to conventional training curricula, this current study aimed to assess the influence of spaced learning in combination with Halsted's and Peyton's tutoring approaches on laparoscopic knot tying of medical students. METHODS After randomization, 20 medical students were either assigned to Halsted's or Peyton's teaching approach and trained one-on-one (teacher-student). Additionally, all subjects were trained according to the spaced learning concept, containing 40 minutes of content-blocks, followed by a 20-minute break involving coordinated, standardized physical activity. This was repeated three times. Primary endpoints were time, knot quality, precision, knot strength, as well as overall laparoscopic knotting performance and competency. To evaluate the motivation of the subjects, an 18-item questionnaire was utilized to measure four motivational factors (anxiety, probability of success, interest, and challenge). RESULTS All trainees significantly improved after training in all knot attributes. Trainees assigned to Halsted's method were able to significantly outperform the Peyton group in knot quantity within 30 minutes (p = 0.013), time/knot (p = 0.033), performance score (p = 0.009), and precision (p = 0.032). No significant difference between Halsted and Peyton was found for knot strength and quality. Furthermore, no significant difference was identified comparing motivation pre- and post-training. However, subjects in the Peyton appeared to be significantly more anxious after training. CONCLUSION Combining spaced learning technique with Halsted's "see one - do one - teach one" appears to be superior to Peyton's Four-step approach in conjunction with spaced learning in surgical naïve students. We recommend further studies evaluating the combination of spaced learning with Halsted and Peyton's instructional methods.
Collapse
Affiliation(s)
- Melanie Le
- Department of Pediatric Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Johannes Boettcher
- Department of Pediatric Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany; Department of Child and Adolescent Psychiatry and Psychotherapy, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Deirdre Vincent
- Department of Pediatric Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Julia Elrod
- Department of Pediatric Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Stefan Mietzsch
- Department of Pediatric Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Philipp Romero
- Department of Pediatric Surgery, University Hospital Heidelberg, Heidelberg, Germany
| | - Anna Perez
- Section Neonatology and Pediatric Intensive Care, Center of Obstetrics and Pediatrics, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Konrad Reinshagen
- Department of Pediatric Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Michael Boettcher
- Department of Pediatric Surgery, University Medical Center Hamburg-Eppendorf, Hamburg, Germany.
| |
Collapse
|
4
|
Wolf M, Seiler B, Vogelsang V, Sydney Hopf L, Moll-Koshrawi P, Vettorazzi E, Ebenebe CU, Singer D, Deindl P. Teaching fiberoptic-assisted tracheoscopy in very low birth weight infants: A randomized controlled simulator study. Front Pediatr 2022; 10:956920. [PMID: 36160788 PMCID: PMC9492998 DOI: 10.3389/fped.2022.956920] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Accepted: 08/15/2022] [Indexed: 11/13/2022] Open
Abstract
OBJECTIVE We developed a fiberoptic-assisted tracheoscopy (FAST) method to avoid direct laryngoscopy during surfactant replacement therapy and compared two training approaches on a very low birth weight (VLBW) infant simulator. DESIGN This prospective randomized controlled study was conducted at the Department of Neonatology and Pediatric Intensive Care Medicine of the University Medical Center Hamburg-Eppendorf, Germany. PARTICIPANTS We recruited physicians, trainees, students, and nurses without prior experience in endoscopic techniques. INTERVENTIONS Participants were assigned randomly to a group that received instructions according to Peyton's Four-Step Approach and a control group that received standard bedside teaching only. MAIN OUTCOME MEASURES Primary endpoints were the total and the component times required to place the bronchoscope and the method success. RESULTS We recruited 186 participants. Compared with the control group, the Peyton group had a lower mean (±standard deviation) FAST completion time (33.2 ± 27.5 s vs. 79.5 ± 47.9 s, p < 0.001; d = 1.12) and a higher FAST success rate (95% vs. 84%, p = 0.036, V = 0.18). CONCLUSION After standardized training, the vast majority of novices completed FAST successfully. Peyton's four-step approach resulted in faster and more successful performance than standardized training.
Collapse
Affiliation(s)
- Monika Wolf
- Department of Neonatology and Pediatric Intensive Care Medicine, University Medical Center Hamburg-Eppendorf, University Children's Hospital, Hamburg, Germany
| | - Berenike Seiler
- Department of Neonatology and Pediatric Intensive Care Medicine, University Medical Center Hamburg-Eppendorf, University Children's Hospital, Hamburg, Germany
| | - Valentina Vogelsang
- Department of Neonatology and Pediatric Intensive Care Medicine, University Medical Center Hamburg-Eppendorf, University Children's Hospital, Hamburg, Germany
| | - Luke Sydney Hopf
- Department of Pediatrics, University Medical Center Hamburg-Eppendorf, University Children's Hospital, Hamburg, Germany
| | - Parisa Moll-Koshrawi
- Department of Anesthesiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Eik Vettorazzi
- Institute of Medical Biometry and Epidemiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
| | - Chinedu Ulrich Ebenebe
- Department of Neonatology and Pediatric Intensive Care Medicine, University Medical Center Hamburg-Eppendorf, University Children's Hospital, Hamburg, Germany
| | - Dominique Singer
- Department of Neonatology and Pediatric Intensive Care Medicine, University Medical Center Hamburg-Eppendorf, University Children's Hospital, Hamburg, Germany
| | - Philipp Deindl
- Department of Neonatology and Pediatric Intensive Care Medicine, University Medical Center Hamburg-Eppendorf, University Children's Hospital, Hamburg, Germany
| |
Collapse
|
5
|
Jeanmonod R, Rammohan G, Grimaldi M, Pester J, Stankewicz H, Patterson R, Minor M, Baker K, Melanson S, Jeanmonod D. Resident comfort teaching and performing pediatric airway procedures after instruction using the Peyton method, standard simulation, or digital platforms. INTERNATIONAL JOURNAL OF ACADEMIC MEDICINE 2021. [DOI: 10.4103/ijam.ijam_51_21] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
|
6
|
Giacomino K, Caliesch R, Sattelmayer KM. The effectiveness of the Peyton's 4-step teaching approach on skill acquisition of procedures in health professions education: A systematic review and meta-analysis with integrated meta-regression. PeerJ 2020; 8:e10129. [PMID: 33083149 PMCID: PMC7549471 DOI: 10.7717/peerj.10129] [Citation(s) in RCA: 41] [Impact Index Per Article: 8.2] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2020] [Accepted: 09/17/2020] [Indexed: 01/14/2023] Open
Abstract
Background Acquisition of procedures is an important element in health professions education. Traditionally procedures are taught using a "see one - do one" approach. That is a teacher demonstrates and describes a procedure and afterwards the students practice the procedure. A more recent teaching approach for the acquisition of procedural skills was presented by Walker and Peyton. Peyton's teaching approach is a stepwise teaching approach and consists of the following four steps: demonstration, deconstruction, comprehension and performance. The aims of this study were (i) to systematically evaluate the effectiveness of Peyton's 4-step teaching approach on the acquisition of procedural skills in health professions education and (ii) to evaluate whether studies with fewer students per teacher showed a larger between group difference than studies with more students per teacher. Methods We searched in Medline, PsycInfo, Embase and ERIC for eligible studies. Records were screened by two independent reviewers. A random effects meta-analysis was performed to evaluate skill acquisition and time needed to perform the procedures at post-acquisition and retention tests. A meta-regression was used to explore the effect of the number of students per teacher on the estimated effect of the educational interventions. Results An effect size of 0.45 SMD (95% CI [0.15; 0.75]) at post-acquisition and 0.7 SMD (95% CI [-0.09; 1.49]) at retention testing were in favour of Peyton's teaching approach for skill acquisition. The groups using Peyton's teaching approach needed considerably less time to perform the procedure at post-acquisition (SMD: -0.8; 95% [CI -2.13 to 1.62]) and retention (SMD: -2.65; 95% CI [-7.77 to 2.47]) testing. The effectiveness of Peyton's teaching approach was less clear in subgroup analyses using peer teachers. Meta-regression showed that the number of students per teacher was an important moderator variable. Conclusion Peyton's teaching approach is an effective teaching approach for skill acquisition of procedural skills in health professions education. When peer students or student tutors are used as teachers the effectiveness of Peyton's teaching approach is less clear. Peyton's teaching approach is more effective when small groups with few students per teacher are used.
Collapse
Affiliation(s)
- Katia Giacomino
- School of Health Sciences, HES-SO Valais-Wallis, Leukerbad, Switzerland
| | - Rahel Caliesch
- School of Health Sciences, HES-SO Valais-Wallis, Leukerbad, Switzerland
| | | |
Collapse
|