The learning curve for a colonoscopy simulator in the absence of any feedback: no feedback, no learning

Training in basic gastrointestinal endoscopic procedures: a European Society of Gastrointestinal Endoscopy (ESGE) and European Society of Gastroenterology and Endoscopy Nurses and Associates (ESGENA) Position Statement

This ESGE Position Statement provides structured and evidence-based guidance on the essential requirements and processes involved in training in basic gastrointestinal (GI) endoscopic procedures. The document outlines definitions; competencies required, and means to their assessment and maintenance; the structure and requirements of training programs; patient safety and medicolegal issues. 1:  ESGE and ESGENA define basic endoscopic procedures as those procedures that are commonly indicated, generally accessible, and expected to be mastered (technically and cognitively) by the end of any core training program in gastrointestinal endoscopy. 2:  ESGE and ESGENA consider the following as basic endoscopic procedures: diagnostic upper and lower GI endoscopy, as well as a limited range of interventions such as: tissue acquisition via cold biopsy forceps, polypectomy for lesions ≤ 10 mm, hemostasis techniques, enteral feeding tube placement, foreign body retrieval, dilation of simple esophageal strictures, and India ink tattooing of lesion location. 3:  ESGE and ESGENA recommend that training in GI endoscopy should be subject to stringent formal requirements that ensure all ESGE key performance indicators (KPIs) are met. 4:  Training in basic endoscopic procedures is a complex process and includes the development and acquisition of cognitive, technical/motor, and integrative skills. Therefore, ESGE and ESGENA recommend the use of validated tools to track the development of skills and assess competence. 5:  ESGE and ESGENA recommend incorporating a multimodal approach to evaluating competence in basic GI endoscopic procedures, including procedural thresholds and the measurement and documentation of established ESGE KPIs. 7:  ESGE and ESGENA recommend the continuous monitoring of ESGE KPIs during GI endoscopy training to ensure the trainee's maintenance of competence. 9:  ESGE and ESGENA recommend that GI endoscopy training units fulfil the ESGE KPIs for endoscopy units and, furthermore, be capable of providing the dedicated personnel, infrastructure, and sufficient case volume required for successful training within a structured training program. 10:  ESGE and ESGENA recommend that trainers in basic GI endoscopic procedures should be endoscopists with formal educational training in the teaching of endoscopy, which allows them to successfully and safely teach trainees.

Needs assessment of basic gastrointestinal endoscopy training: A qualitative study in Indonesia

Background and Aim

Gastointestinal endoscopy is a complex practical skill, and training and experience are required to ensure the accuracy and safety of the procedures. Therefore, proper endoscopy training is needed to provide highly skilled endoscopists. This study explores the learning experience and assesses the need for endoscopy training in Indonesia from an endoscopy trainee's point of view. Limitations from the current training model and the trainees' suggestions hopefully will become a foundation for the future endoscopy training model in Indonesia.

Methods

A total of 132 current endoscopy trainees and graduates of endoscopy training from various centers in Indonesia completed an online qualitative survey regarding their endoscopy training experience, their satisfaction with the current training method, barriers to achieving competency, and their suggestions for future training. Data were subjected to descriptive and qualitative analysis using content analysis.

Results

We found variations in the trainee's learning experience regarding the training supervision, feedback, and assessment methods. The most common endoscopy training methods were observation and direct practice with supervision. There was only a low proportion of simulator use (25%). The most found concept in barriers to achieving competency was "insufficient number of patients." Meanwhile, the most found concept in suggestions for future training methods was "increasing the variety of cases and procedures."

Conclusion

Our findings suggest that there are still variations in endoscopy training methods in Indonesia. Therefore, we propose to design a standardized endoscopy training program to ensure the competence of endoscopy trainees and better care for endoscopic patients. Simulators might be used to increase the trainees' competence in settings with low numbers of patients or cases.

Application of mobile-based web app to enhance simple suturing skills of nurse practitioners

BACKGROUND

Suturing is a crucial clinical skill for nurse practitioners (NPs), but the effectiveness of traditional training methods (e.g., physical suture kits combined with video content) is low.

OBJECTIVE

This study compared the effectiveness and usability of a mobile-based web app (MoWa) developed for NPs to learn simple suturing skills with those of traditional instructional video-based training.

METHODS

The MoWa system utilizes mobile devices to simulate hands-on suturing and provides learning guidance and feedback to support self-learning with a physical suturing kit. Fifty-four suturing novices (NPs) were recruited as participants, divided into an experimental group (EG: 28 participants) and a control group (CG: 26 participants), and instructed to self-learn for 3 weeks. Learning effectiveness and system usability were evaluated through a pretest and posttest.

RESULTS

The EG exhibited significant improvements in learning outcomes, self-confidence, self-efficacy, and learning anxiety and expressed satisfaction with the MoWa system. Furthermore, the EG also considerably enhanced learning outcomes, self-efficacy, and learning anxiety compared to the CG, with no significant difference in self-confidence.

CONCLUSION

The MoWa system combined with deliberate practice is an effective strategy for supporting suturing skills training.

Simulation-based bronchoscopy training: Randomized trial comparing worked example to video introduction

INTRODUCTION

Learning the complex skill of bronchoscopy involves the integration of cognitive domains and motor skills. The development of simulators has opened up new possibilities in bronchoscopy training. This study aimed at evaluating how effective the modeling example methodology is in training this skill and assessed its effect on cognitive load in learning.

METHODS

Forty-seven medical students participating in a simulator-based bronchoscopy training program were randomly allocated to a control group, receiving a video lesson, and the modeling example group. They were evaluated by the simulator's metrics at different time points: pre-, posttest, and 15 days and 12 months after training. Cognitive load was assessed with the modified Paas scale.

RESULTS

Simulation-based training was effective for both groups, based on simulator metrics (p < .05). The modeling example group outperformed the control group in all measures at posttest and after 15 days (p < .001). After 12 months, there was a decline in skill in both groups, but the modeling example group performed better (p < .001). Simulation-based training reduced cognitive load, more strongly so in the modeling example group (p < .001).

CONCLUSION

The modeling example group showed substantial benefits over the control group, both in reducing the cognitive load in learning and in retaining knowledge and skill after 15 days and 12 months.

A journey towards pediatric gastrointestinal endoscopy and its training: a narrative review

Background and aims

Gastrointestinal (GI) endoscopy in pediatric setting has unique features and, therefore, requires an approach that is tailored to pediatric practice. There is still heterogeneity between training programs worldwide in terms of duration, number of procedures and assessment during and at the end of the training process.

Methods

We conducted a narrative review aiming to describe and summarize the existing literature on the various training methods for pediatric GI endoscopy to highlight the significance of specific pediatric endoscopy training.

Results

Simulation-based tools have been implemented in several training programs, providing a safer learning environment for trainees, especially in their earlier stages of training. Assessment of competence is gradually shifting from the sole evaluation of procedural numbers towards the development of more reliable and valid tools that can accurately measure technical competence. Despite such seismic shift, there is still a need for a standardized and comprehensive pediatric-oriented endoscopy curriculum that incorporates acquisition of procedural skills education and is built on the current competency-based model of training. All the above must sink their roots in trainees and to ensure that the endoscopists of tomorrow are capable of delivering high quality of care for children undergoing endoscopy.

Conclusion

It is crucial to parallelly focus on the way trainers teach trainees. In this context, the implementation of "train the trainers" courses has improved important quality meters in GI endoscopy. Future research should put the focus on the potential subsequent favorable benefits of these changes on child health.

The effects of virtual reality-based bronchoscopy simulator on learning outcomes of medical trainees: A systematic review

Background and Aims

Conventional medical training routes of bronchoscopy may decrease patients' comfort and increase procedure-related morbidity. Virtual reality (VR)-based bronchoscopy is a beneficial and safe solution for teaching trainees. The aim of this systematic review was to study the effectiveness of VR-based bronchoscopy simulators on the learning outcomes of medical trainees.

Methods

Well-known sources (i.e., Scopus, ISI Web of Science, and Medline via PubMed) were systematically searched using Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines on December, 2021. Peer-reviewed English papers that used VR-based simulation for bronchoscopy training were included. The articles that were studying other technologies, or those that were unrelated to the topic, were excluded. The risk of bias was assessed using the Joanna Briggs Institute checklists for quasi-experimental studies and randomized controlled trials (RCTs).

Results

Out of 343 studies, 8 of them met our inclusion criteria. An appropriate control group and statistical analysis were the most common and unavoidable sources of bias in included non-RCTs, and lack of blinding in participants was the most common source of bias in RCTs. The included studies evaluated learning outcomes regarding dexterity (N = 5), speed (N = 3), the accuracy of procedures (N = 1), and the need for verbal assistance (N = 1). Based on the results, 100% (5/5) and 66% (2/3) of studies showed that the use of VR-based simulation on the learning outcomes of medical trainees led to improvement in manual ability (i.e., dexterity) and swiftness of execution (i.e., speed in performance), respectively. Additionally, improving the accuracy of subjects' performance, and reducing the need for verbal guidance and physical assistance was reported in studies that evaluated these variables.

Conclusion

VR bronchoscopy simulator as a training method for teaching medical trainees, especially for novices has the potential to improve medical trainees' performance and reduce complications. Further studies are needed to evaluate the positive effects of VR-based simulation on the learning outcomes of medical trainees.

JAG consensus statements for training and certification in flexible sigmoidoscopy

Introduction

Joint Advisory Group (JAG) certification in endoscopy is awarded when trainees attain minimum competency standards for independent practice. A national evidence-based review was undertaken to update standards for training and certification in flexible sigmoidoscopy (FS).

Methods

A modified Delphi process was conducted between 2019 and 2020 with multisociety representation from experts and trainees. Following literature review and Grading of Recommendations, Assessment, Development and Evaluations appraisal, recommendation statements on FS training and certification were formulated and subjected to anonymous voting to obtain consensus. Accepted statements were peer-reviewed by national stakeholders for incorporation into the JAG FS certification pathway.

Results

In total, 41 recommendation statements were generated under the domains of: definition of competence (13), acquisition of competence (17), assessment of competence (7) and postcertification support (4). The consensus process led to revised criteria for colonoscopy certification, comprising: (A) achieving key performance indicators defined within British Society of Gastroenterology standards (ie, rectal retroversion >90%, polyp retrieval rate >90%, patient comfort <10% with moderate-severe discomfort); (B) minimum procedure count ≥175; (C) performing 15+ procedures over the preceding 3 months; (D) attendance of the JAG Basic Skills in Lower gastrointestinal Endoscopy course; (E) satisfying requirements for formative direct observation of procedural skill (DOPS) and direct observation of polypectomy skill (SMSA level 1); (F) evidence of reflective practice as documented on the JAG Endoscopy Training System reflection tool and (G) successful performance in summative DOPS.

Conclusion

The UK standards for training and certification in FS have been updated to support training, uphold standards in FS and polypectomy, and provide support to the newly independent practitioner.

JAG consensus statements for training and certification in colonoscopy

Introduction

In the UK, endoscopy certification is awarded when trainees attain minimum competency standards for independent practice. A national evidence-based review was undertaken to update and develop standards and recommendations for colonoscopy training and certification.

Methods

Under the oversight of the Joint Advisory Group (JAG), a modified Delphi process was conducted between 2019 and 2020 with multisociety expert representation. Following literature review and Grading of Recommendations, Assessment, Development and Evaluations appraisal, recommendation statements on colonoscopy training and certification were formulated and subjected to anonymous voting to obtain consensus. Accepted statements were peer reviewed by JAG and relevant stakeholders for incorporation into the updated colonoscopy certification pathway.

Results

In total, 45 recommendation statements were generated under the domains of: definition of competence (13), acquisition of competence (20), assessment of competence (8) and postcertification support (4). The consensus process led to revised criteria for colonoscopy certification, comprising: (1) achieving key performance indicators defined within British Society of Gastroenterology standards (ie, unassisted caecal intubation rate >90%, rectal retroversion >90%, polyp detection rate >15%+, polyp retrieval rate >90%, patient comfort <10% with moderate–severe discomfort); (2) minimum procedure count 280+; (3) performing 15+ procedures over the preceding 3 months; (4) attendance of the JAG Basic Skills in Colonoscopy course; (5) terminal ileal intubation rates of 60%+ in inflammatory bowel disease; (6) satisfying requirements for formative direct observation of procedure skills (DOPS) and direct observation of polypectomy skills (Size, Morphology, Site, Access (SMSA) level 2); (7) evidence of reflective practice as documented on the JAG Endoscopy Training System reflection tool; (8) successful performance in summative DOPS.

Conclusion

The UK standards for training and certification in colonoscopy have been updated, culminating in a single-stage certification process with emphasis on polypectomy competency (SMSA Level 2+). These standards are intended to support training, improve standards of colonoscopy and polypectomy, and provide support to the newly independent practitioner.

Endoscopy training in the Netherlands: a national survey among gastroenterology residents

Background and study aims  Training in endoscopy is a key objective of gastroenterology residency. There is currently no standardized or systematic training approach. This study evaluated and compared the current status of gastrointestinal endoscopy training programs in all teaching hospitals in the Netherlands from a resident perspective. Materials and methods  A national online survey with open and closed questions on gastrointestinal endoscopy training was administered to all gastroenterology residents (N = 180) in the eight educational regions in the Netherlands. Results  One hundred residents who had already started endoscopy training were included in the analyses. Sixty-five residents (65 %) were satisfied with their endoscopy training program. Participation in a preclinical endoscopy course was mandatory in seven of eight educational regions. Residents from the region without a mandatory endoscopy training course were significantly less likely to be satisfied with their endoscopy training program (32 %, P  = .011). Criteria used to determine the level of supervision differed greatly between teaching hospitals (e. g. assessed endoscopy competence, predefined period of time or number of procedures). Only 26 residents (26 %) reported uniformity in teaching methods and styles between different supervising gastroenterologists in their teaching hospital. Conclusions  Although most gastroenterology residents were satisfied with the endoscopy training program and endoscopy supervision in their teaching hospital, this study identified considerable local and regional variability. Future studies should be conducted to evaluate the trainers' perspective and trainers' behavior during endoscopy training sessions, which might eventually lead to the development of best practices regarding endoscopy training, including standardization of training programs and supervision methods.

Simulation-based mastery learning in gastrointestinal endoscopy training

Simulation-based mastery learning (SBML) is an emerging form of competency-based training that has been proposed as the next standard method for procedural task training, including that in gastrointestinal endoscopy. Current basic gastrointestinal endoscopy training relies on the number of procedures performed, and it has been criticized for its lack of objective standards that result in variable skills among trainees and its association with patient safety risk. Thus, incorporating simulators into a competency-based curriculum seems ideal for gastrointestinal endoscopy training. The curriculum for SBML in gastrointestinal endoscopy is currently being developed and has promising potential to translate into the clinical performance. Unlike the present apprenticeship model of “see one, do one, teach one,” SBML integrates a competency-based curriculum with specific learning objectives alongside simulation-based training. This allows trainees to practice essential skills repeatedly, receive feedback from experts, and gradually develop their abilities to achieve mastery. Moreover, trainees and trainers need to understand the learning targets of the program so that trainees can focus their learning on the necessary skills and trainers can provide structured feedback based on the expected outcomes. In addition to learning targets, an assessment plan is essential to provide trainees with future directions for their improvement and ensure patient safety by issuing a passing standard. Finally, the SBML program should be planned and managed by a specific team and conducted within a developed and tested curriculum. This review discusses the current state of gastrointestinal endoscopy training and the role of SBML in that field.

Does your team know how to respond safely to an operating room fire? Outcomes of a virtual reality, AI-enhanced simulation training

BACKGROUND

Operating room (OR) fires are rare but devastating events requiring immediate and effective response. Virtual Reality (VR) simulation training can provide a safe environment for practice of skills in such highly stressful situation. This study assessed interprofessional participants' ability to respond to VR-simulated OR fire scenarios, attitudes, numbers of attempt of the VR simulation do participants need to successfully respond to OR fires and does prior experience, confidence level, or professional role predict the number of attempts needed to demonstrate safety and pass the simulation.

METHODS

180 surgical team members volunteered to participate in this study at Beth Israel Deaconess Medical Center, Boston, MA. Each participant completed five VR OR simulation trials; the final two trials incorporated AI assistance. Primary outcomes were performance scores, number of attempts needed to pass, and pre- and post-survey results describing participant confidence and experiences. Differences across professional or training role were assessed using chi-square tests and analyses of variance. Differences in pass rates over time were assessed using repeated measures logistic regression.

RESULTS

One hundred eighty participants completed simulation testing; 170 (94.4%) completed surveys. Participants included surgeons (17.2%), anesthesiologists (10.0%), allied health professionals (41.7%), and medical trainees (31.1%). Prior to training, 45.4% of participants reported feeling moderately or very confident in their ability to respond to an OR fire. Eight participants (4.4%) responded safely on the first simulation attempt. Forty-three participants (23.9%) passed by the third attempt (VR only); an additional 97 participants (53.9%) passed within the 4-5th attempt (VR with AI assistance).

CONCLUSIONS

Providers are unprepared to respond to OR fires. VR-based simulation training provides a practical platform for individuals to improve their knowledge and performance in the management of OR fires with a 79% pass rate in our study. A VR AI approach to teaching this essential skill is innovative, feasible, and effective.

Pediatric Endoscopy Quality Improvement Network Quality Standards and Indicators for Pediatric Endoscopists and Endoscopists in Training: A Joint NASPGHAN/ESPGHAN Guideline

INTRODUCTION

High-quality pediatric endoscopy requires reliable performance of procedures by competent individual providers who consistently uphold all standards determined to assure optimal patient outcomes. Establishing consensus expectations for ongoing monitoring and assessment of individual pediatric endoscopists is a method for confirming the highest possible quality of care for such procedures worldwide. We aim to provide guidance to define and measure quality of endoscopic care for children.

METHODS

With support from the North American and European Societies of Pediatric Gastroenterology Hepatology and Nutrition (NASPGHAN and ESPGHAN), an international working group of the Pediatric Endoscopy Quality Improvement Network (PEnQuIN) used the methodological strategy of the Appraisal of Guidelines for REsearch and Evaluation (AGREE) II instrument to develop standards and indicators relevant for assessing the quality of endoscopists. Consensus was sought via an iterative online Delphi process and finalized at an in-person conference. The quality of evidence and strength of recommendations were rated according to the GRADE (Grading of Recommendation Assessment, Development, and Evaluation) approach.

RESULTS

The PEnQuIN working group achieved consensus on 6 standards that all providers who perform pediatric endoscopy should uphold and 2 standards for pediatric endoscopists in training, with 7 corresponding indicators that can be used to identify high-quality endoscopists. Additionally, these can inform continuous quality improvement at the provider level. Minimum targets for defining high-quality pediatric ileocolonoscopy were set for 2 key indicators: cecal intubation rate (≥90%) and terminal ileal intubation rate (≥85%).

DISCUSSION

It is recommended that all individual providers performing or training to perform pediatric endoscopy initiate and engage with these international endoscopist-related standards and indicators developed by PEnQuIN.

JAG consensus statements for training and certification in oesophagogastroduodenoscopy

INTRODUCTION

Training and quality assurance in oesophagogastroduodenoscopy (OGD) is important to ensure competent practice. A national evidence-based review was undertaken to update and develop standards and recommendations for OGD training and certification.

METHODS

Under the oversight of the Joint Advisory Group (JAG), a modified Delphi process was conducted with stakeholder representation from British Society of Gastroenterology, Association of Upper Gastrointestinal Surgeons, trainees and trainers. Recommendations on OGD training and certification were formulated following literature review and appraised using Grading of Recommendations Assessment, Development and Evaluation. These were subjected to electronic voting to achieve consensus. Accepted statements were incorporated into the updated certification pathway.

RESULTS

In total, 32 recommendation statements were generated for the following domains: definition of competence (4 statements), acquisition of competence (12 statements), assessment of competence (10 statements) and post-certification support (6 statements). The consensus process led to following certification criteria: (1) performing ≥250 hands-on procedures; (2) attending a JAG-accredited basic skills course; (3) attainment of relevant minimal performance standards defined by British Society of Gastroenterology/Association of Upper Gastrointestinal Surgeons of Great Britain and Ireland, (4) achieving physically unassisted D2 intubation and J-manoeuvre in ≥95% of recent procedures, (5) satisfactory performance in formative and summative direct observation of procedural skills assessments.

CONCLUSION

The JAG standards for diagnostic OGD have been updated following evidence-based consensus. These standards are intended to support training, improve competency assessment to uphold standards of practice and provide support to the newly-independent practitioner.

The Use of Feedback in Improving the Knowledge, Attitudes and Skills of Medical Students: a Systematic Review and Meta-analysis of Randomized Controlled Trials

This study aims to investigate the effectiveness of the use of different feedback modalities in improving the knowledge, attitudes, and skills of medical students compared to students receiving no feedback or unstructured feedback. A systematic review and meta-analysis of randomized controlled trials was conducted based on a search of the Cochrane, ERIC, PubMed, Scopus, and Web of Science databases. A total of 26 studies were included for the systematic review and 13 for the meta-analysis. The meta-analysis revealed that the use of feedback was associated with better results compared to control groups (SMD = 0.80 [0.56-1.04], p < 0.001), and also when only high-quality studies were included (SMD = 0.86 [0.56-1.16], p < 0.001). Our findings revealed high heterogeneity in the use of feedback in medical education. However, the results of most of the studies and of the meta-analysis were positive, showing that feedback had a positive influence on the education-learning process of the students. PROSPERO registration: CRD42018112688.

Mastering microsurgery: A novel benchmarking tool for microsurgical training

INTRODUCTION AND OBJECTIVE

The shift of surgical training from apprenticeship model towards competency-based training requires objective assessments of microsurgical skills to achieve mastery. Our objective was to create a novel platform to provide feedback to surgical trainees relative to competency expected at their level of exposure.

METHODS

A 5-day simulated microsurgery course was run between 2013 and 2016 with 118 participants. Video recordings of end-to-end micro-anastomoses were collected on days 1, 3, and 5, along with analysis of hand motion . Videos were assessed to calculate the QMUL Global Rating Scale (QMUL GRS). Two charts were created to track the acquisition of microsurgical skills. One to plot the number of hand movements and the other for QMUL GRS, against the participants' cumulative number of micro-anastomoses performed. Participant data were used to calculate a skills acquisition line for each quartile, analogous to percentiles on a growth chart.

RESULTS

For a cumulative number of 0 prior micro-anastomoses, the GRS score at the 25th, 50th, and 75th percentile was 45.5, 55, and 62, respectively. As the number of cumulative anastomoses increased, there was a distinct increase in the GRS score to 89.5, 93, and 92 for the group with 55-100 previous micro-anastomoses. This was in keeping with a decreased number of hand movements with increasing experience.

CONCLUSION

In conclusion, our tool allows trainees to track where they lie in the skill spectrum relative to prior experience which permits the provision of focused training to trainees at lower percentiles, which has potential to translate to improved clinical outcomes.

Evaluating learning curves and competence in colorectal EMR among advanced endoscopy fellows: a pilot multicenter prospective trial using cumulative sum analysis

BACKGROUND AND AIMS

Data on colorectal EMR (C-EMR) training are lacking. We aimed to evaluate C-EMR training among advanced endoscopy fellows (AEFs) by using a standardized assessment tool (STAT).

METHODS

This multicenter prospective study used a STAT to grade AEF training in C-EMR during their 12-month fellowship. Cumulative sum analysis was used to establish learning curves and competence for cognitive and technical components of C-EMR and overall performance. Sensitivity analysis was performed by varying failure rates. AEFs completed a self-assessment questionnaire to assess their comfort level with performing C-EMR at the completion of their fellowship.

RESULTS

Six AEFs (189 C-EMRs; mean per AEF, 31.5 ± 18.5) were included. Mean polyp size was 24.3 ± 12.6 mm, and mean procedure time was 22.6 ± 16.1 minutes. Learning curve analyses revealed that less than 50% of AEFs achieved competence for key cognitive and technical C-EMR endpoints. All 6 AEFs reported feeling comfortable performing C-EMR independently at the end of their training, although only 2 of them achieved competence in their overall performance. The minimum threshold to achieve competence in these 2 AEFs was 25 C-EMRs.

CONCLUSIONS

A relatively low proportion of AEFs achieved competence on key cognitive and technical aspects of C-EMR during their 12-month fellowship. The relatively low number of C-EMRs performed by AEFs may be insufficient to achieve competence, in spite of their self-reported readiness for independent practice. These pilot data serve as an initial framework for competence threshold, and suggest the need for validated tools for formal C-EMR training assessment.

Virtual reality operating room with AI guidance: design and validation of a fire scenario

BACKGROUND

Operating room (OR) fires are uncommon but disastrous events. Inappropriate handling of OR fires can result in injuries, even death. Aiming to simulate OR fire emergencies and effectively train clinicians to react appropriately, we have developed an artificial intelligence (AI)-based OR fire virtual trainer based on the principle of the "fire triangle" and SAGES FUSE curriculum. The simulator can predict the user's actions in the virtual OR and provide them with timely feedback to assist with training. We conducted a study investigating the validity of the AI-assisted OR fire trainer at the 2019 SAGES Learning Center.

METHODS

Fifty-three participants with varying medical experience were voluntarily recruited to participate in our Institutional Review Board approved study. All participants were asked to contain a fire within the virtual OR. Participants were then asked to fill out a 7-point Likert questionnaire consisting of ten questions regarding the face validation of the AI-assisted OR fire simulator. Shapiro-Wilk tests were conducted to test normality of the scores for each trial. A Friedman's ANOVA with post hoc tests was used to evaluate the effect of multiple trials on performance.

RESULTS

On a 7-point scale, eight of the ten questions were rated a mean of 6 or greater (72.73%), especially those relating to the usefulness of the simulator for OR fire-containing training. 79.25% of the participants rated the degree of usefulness of AI guidance over 6 out of 7. The performance of individuals improved significantly over the five trials, χ2(4) = 119.89, p < .001, and there was a significant linear trend of performance r = .97, p = 0.006. A pairwise analysis showed that only after the introduction of AI did performance improve significantly.

CONCLUSIONS

The AI-guided OR fire trainer offers the potential to assess OR personnel and teach the proper response to an iatrogenic fire scenario in a safe, repeatable, immersive environment.

Evidence-Based Debriefing

Ongoing shifts in the healthcare system require practitioners who possess metacognitive skills to evaluate their decisions and the thinking and rationale guiding those decisions. In an effort to design learning activities that support metacognition in nursing education, undergraduate and graduate faculty, are embracing simulation-based education (SBE) as an effective teaching and learning strategy. SBE includes prebriefing, the simulation scenario, and debriefing, all of which are supported by psychological safety. Prebriefing precedes the entire learning process and is integral to engagement in the simulation and to the effectiveness of the debriefing. Debriefing provides educators with the opportunity to explore and develop those metacognitive skills with learners. In this chapter on evidence-based debriefing, the authors will explore the evidence and theories surrounding best practices in SBE, specifically the prebriefing and debriefing components of the learning experience. The chapter explores the theoretical foundation of SBE and theory-based debriefing; educational best practices of prebriefing as an integral part of an effective debriefing; theory-based debriefing models; research evidence of debriefing outcomes; evaluation of the prebriefing and debriefing process; and finally, provides recommendations on the priorities for further research in debriefing. Within this chapter, the term educator is inclusive of undergraduate, graduate, and professional development nurse educators and reflects the educator role in SBE.

Association Between Hospital Debriefing Practices With Adherence to Resuscitation Process Measures and Outcomes for In-Hospital Cardiac Arrest

Background Identifying actionable resuscitation practices that vary across hospitals could improve adherence to process measures or outcomes after in-hospital cardiac arrest (IHCA). We sought to examine whether hospital debriefing frequency after IHCA varies across hospitals and whether hospitals which routinely perform debriefing have higher rates of process-of-care compliance or survival. Methods We conducted a nationwide survey of hospital resuscitation practices in April of 2018, which were then linked to data from the Get With The Guidelines-Resuscitation national registry for IHCA. Hospitals were categorized according to their reported frequency of debriefing immediately after IHCA; rarely (0%-20% of all IHCA cases), occasionally (21%-80%), and frequently (81%-100%). Hospital-level rates of timely defibrillation (≤2 minutes), epinephrine administration (≤5 minutes), survival to discharge, return of spontaneous circulation, and neurologically intact survival were comparted for patients with IHCA from 2015 to 2017. Results Overall, there were 193 hospitals comprising 44 477 IHCA events. Mean patient age was 65±16, 41% were females, and 68% were of White race. Across hospitals, 84 (43.5%) rarely performed debriefings immediately after an IHCA, 82 (42.5%) performed debriefing sessions occasionally, and 27 (14.0%) performed debriefing frequently. There was no association between higher reported debriefing frequency and hospital rates of timely defibrillation and epinephrine administration. Mean hospital rates of risk-standardized survival to discharge were similar across debriefing frequency groups (rarely 25.6%; occasionally 26.0%; frequently 25.2%, P=0.72), as were hospital rates of risk-adjusted return of spontaneous circulation (rarely 72.2%; occasionally 73.0%; frequently 70.0%, P=0.06) and neurologically intact survival (rarely 21.9%, occasionally 22.2%, frequently 21.1%, P=0.75). Conclusions In a large contemporary nationwide quality improvement registry, hospitals varied widely in how often they conducted debriefings immediately after IHCA. However, hospital debriefing frequency was not associated with better adherence to timely delivery of epinephrine or defibrillation or higher rates of IHCA survival.

The status of training in new technologies in advanced endoscopy: from defining competence to credentialing and privileging

The landscape of advanced endoscopy continues to evolve as new technologies and techniques become available. Although postgraduate advanced endoscopy fellowships have traditionally centered on ERCP and diagnostic EUS, the breadth of training has increased over the years in response to the ever-growing demand for therapeutic endoscopy. The increasing diversity and complexity of emerging endoscopic techniques accompanied by the shift in focus toward competency-based medical education requires innovative changes to the curriculum that will ensure adequate training yet without compromising best patient practices. The purpose of this review is to highlight the expansive array of advanced endoscopic procedures and the challenges of both defining and measuring competence during training. All authors are interventional endoscopists at their respective institutions performing these complex procedures, as well as training fellows in these techniques. We share our perspectives based on our experience navigating through these issues at our institutions and discuss strategies to standardize training and how to potentially incorporate these measures in the process of credentialing and privileging in endoscopy.

Comparison of different feedback modalities for the training of procedural skills in Oral and maxillofacial surgery: a blinded, randomized and controlled study

BACKGROUND

The feedback given to students plays an important role in their efficiency related to learning practical skills. In the present study, diverse feedback modalities have been investigated. Our hypothesis is that individualized and unsupervised video feedback can produce a similar learning experience as performing practical skills in an oral and maxillofacial surgery setting with conventional direct expert feedback (control group).

METHODS

This prospective, randomized, controlled, and blinded study compared direct expert feedback (DEF), individualized video feedback (IVF) and unsupervised video feedback (UVF). The participants were fourth-year dental students from University Goethe in Frankfurt. The students were assigned to one of the three feedback methods (n = 20 per group) using simple randomization. All participants watched an instruction video for an interdental ('Ernst') ligature and periphery venous catheterization. Next, the students were video recorded performing the tasks by themselves (pre-test). Following this, every student received feedback using one of the above-mentioned feedback modalities. The participants then performed the same task again while being video recorded (post-test) to measure the acquired competence. Six weeks later, the students participated in an objective structured clinical examination (OSCE) to evaluate their long-term knowledge retention. All examiners were blinded regarding the students' instructional approach and their affiliation in terms of the learning group.

RESULTS

For the interdental ligature, we found significant improvements in performance in each feedback modality group between the pre-test and post-test (p < 0.001). UVF had the strongest effect on performance time. The comparison between each group in the post-test showed no significant differences between the three groups.

CONCLUSION

This study showed that IVF and UVF can be considered an alternative or adjunct to conventional methods (i.e. DEF) when learning procedural skills in oral and maxillofacial surgery. However, DEF showed to be the most effective method of feedback and therefore preferable in teaching.

Modern Plastic Surgical Practice: Technical Competence Alone Is Not Enough

Annually, an estimated 234 million major surgical operations occur worldwide, with concomitant seven million complications and one million deaths. It is now well established that technical competence is necessary, but not sufficient for modern surgical practice and outcomes. Breakdown in non-technical skills has been attributed as a key root cause for near misses and patient harm in the operating room. This article discusses the multi-faceted skills-set that is necessary for the modern surgeon to succeed and for optimal patient outcomes. This includes technical skills, non-technical skills, with a focus on key CanMEDS framework domains, including leadership, communication, evidence-based surgery and mentorship.

Neurophysiological changes in visuomotor sequence learning provide insight in general learning processes: Measures of brain activity, skin conductance, heart rate and respiration

Prior research has shown neurophysiological measures of learning yield large effect sizes, suggesting that these measures have high potential in providing insight into learning. Yet, most literature on learning and neurophysiological measures focused on a single outcome measure, neglecting the interplay between different types of measures. Additionally, it is not yet clear which measures change robustly in a way specific to the learning process. The current study assessed implicit visuomotor sequence learning through multiple neurophysiological outcome measures. In two experiments participants were presented with an arm-movement version of the Serial Reaction Time Task with blocks in which targets were selected in a repeating sequence and blocks in which targets were selected randomly. While participants were executing this task, measures of EEG, skin conductance, heart rate (variability) and respiration, in addition to measures of behavioral performance, were collected. Although behavioral performance was sensitive to sequence learning, as demonstrated by faster responses in sequence than in random blocks, neurophysiology was not sensitive to sequence learning. However, in both experiments, skin conductance level and parietal EEG alpha and gamma power were sensitive to task induction and changed during sequence blocks in the direction of a pre-task baseline and were related to behavioral performance. In general, models including only EEG parietal gamma power were just as powerful in explaining behavioral measures during learning as models including a combination of neurophysiological outcome measures. The findings of the current study demonstrate that neurophysiology is not sensitive to implicit sequence learning specifically, but that general learning effects on a visuomotor learning task are reflected in measures of neurophysiology. Additionally, the findings highlight that a combination of neurophysiological outcome measures is not necessarily better in explaining task learning than a single measure.

Exploring Use of Endoscopy Simulation in North American Pediatric Gastroenterology Fellowship Training Programs

OBJECTIVES

Increasing evidence supports simulation-based training; however, limited data exist regarding its use in pediatric gastroenterology (GI). We explored the use of simulation-based endoscopy training in pediatric GI fellowship programs across North America.

METHODS

GI fellowship program directors (PDs) from the United States and Canada were surveyed between August to November 2018. The pretested, electronic survey comprised 3 sections: program demographics; details of current simulation-based training; and PDs' perceptions of endoscopy simulation. Responses were analyzed using descriptive statistics.

RESULTS

Forty-three of 71 (61%) PDs responded (6 Canadian, 37 US). Programs were predominantly academic (95%) and enrolled 1.87 ± 1.01 fellows/yr. Twenty-four programs (56%) reported using simulation for endoscopy training, whereas 8 (19%) used simulation for nonprocedural education. Only 2 programs (5%) used endoscopy simulation for assessment. Of those using simulation (n = 24), upper endoscopy and colonoscopy were trained most frequently, and mechanical simulators were used most commonly. Eight programs (33%) required simulation training prior to clinical performance. Although 10 programs (42%) provided protected training time, only 2 (8%) tracked hours. Three programs (13%) reported having an organized curriculum and 6 (25%) train their endoscopic trainers. Cost, time constraints, and lack of a standardized curriculum were perceived as key barriers to integration. Most PDs reported a need for endoscopy simulation to train both technical and nontechnical skills; however, they felt simulation cannot replace clinical experience.

CONCLUSION

PDs recognize the potential importance of endoscopy simulation, particularly for novices; however, only 56% report using it. Perceived barriers indicate the need for inexpensive portable simulators and a validated pediatric simulation curriculum to promote uptake.

Endoscopic simulators

BACKGROUND AND AIMS

Simulation refers to educational tools that allow for repetitive instruction in a nonpatient care environment that is risk-free. In GI endoscopy, simulators include ex vivo animal tissue models, live animal models, mechanical models, and virtual reality (VR) computer simulators.

METHODS

After a structured search of the peer-reviewed medical literature, this document reviews commercially available GI endoscopy simulation systems and clinical outcomes of simulation in endoscopy.

RESULTS

Mechanical simulators and VR simulators are frequently used early in training, whereas ex vivo and in vivo animal models are more commonly used for advanced endoscopy training. Multiple studies and systematic reviews show that simulation-based training appears to provide novice endoscopists with some advantage over untrained peers with regard to endpoints such as independent procedure completion and performance time, among others. Data also suggest that simulation training may accelerate the acquisition of specific technical skills in colonoscopy and upper endoscopy early in training. However, the available literature suggests that the benefits of simulator training appear to attenuate and cease after a finite period. Further studies are needed to determine if meeting competency metrics using simulation will predict actual clinical competency.

CONCLUSIONS

Simulation training is a promising modality that may aid in endoscopic education. However, for widespread incorporation of simulators into gastroenterology training programs to occur, simulators must show a sustained advantage over traditional mentored teaching in a cost-effective manner. Because most studies evaluating simulation have focused on novice learners, the role of simulation training in helping practicing endoscopists gain proficiency using new techniques and devices should be further explored.

Challenges & Issues: Evidence-Based Clinical Skills Teaching and Learning: What Do We Really Know?

The recent programmatic focus on skills development in veterinary medicine means that many programs are devoting increased time to formal clinical skills teaching. This expansion makes it essential that we use the time as effectively as possible. This review examines current practices and veterinary training principles using the broader field of evidence-based motor skills learning as a lens. In many areas, current practices may be hindering learning. Proposed practices include using videos and discussions for pre-laboratory training, focusing on a single complex skill at a time, using more near-peer instructors rather than faculty, including assessments in each teaching or practice session, and encouraging supervised distributed practice by incorporating practice sessions into the formal curriculum. Ensuring mastery of a few core skills rather than exposure to many may be the new goal. Further research is urgently needed on block versus spiral curricula, optimum instructor-to-student ratios, learning and practice schedules, hours required for proficiency, and the benefits of exercise on motor skills learning.

Simulation in endoscopy: Practical educational strategies to improve learning

In gastrointestinal endoscopy, simulation-based training can help endoscopists acquire new skills and accelerate the learning curve. Simulation creates an ideal environment for trainees, where they can practice specific skills, perform cases at their own pace, and make mistakes with no risk to patients. Educators also benefit from the use of simulators, as they can structure training according to learner needs and focus solely on the trainee. Not all simulation-based training, however, is effective. To maximize benefits from this instructional modality, educators must be conscious of learners' needs, the potential benefits of training, and associated costs. Simulation should be integrated into training in a manner that is grounded in educational theory and empirical data. In this review, we focus on four best practices in simulation-based education: deliberate practice with mastery learning, feedback and debriefing, contextual learning, and innovative educational strategies. For each topic, we provide definitions, supporting evidence, and practical tips for implementation.

Virtual reality simulation in endoscopy training: Current evidence and future directions

Virtual reality simulation is becoming the standard when beginning endoscopic training. It offers various benefits including learning in a low-stakes environment, improvement of patient safety and optimization of valuable endoscopy time. This is a review of the evidence surrounding virtual reality simulation and its efficacy in teaching endoscopic techniques. There have been 21 randomized controlled trials (RCTs) that have investigated virtual reality simulation as a teaching tool in endoscopy. 10 RCTs studied virtual reality in colonoscopy, 3 in flexible sigmoidoscopy, 5 in esophagogastroduodenoscopy, and 3 in endoscopic retrograde cholangiopancreatography. RCTs reported many outcomes including distance advanced in colonoscopy, comprehensive assessment of technical and non-technical skills, and patient comfort. Generally, these RCTs reveal that trainees with virtual reality simulation based learning improve in all of these areas in the beginning of the learning process. Virtual reality simulation was not effective as a replacement of conventional teaching methods. Additionally, feedback was shown to be an essential part of the learning process. Overall, virtual reality endoscopic simulation is emerging as a necessary augment to conventional learning given the ever increasing importance of patient safety and increasingly valuable endoscopy time; although work is still needed to study the nuances surrounding its integration into curriculum.

An automatic skill evaluation framework for robotic surgery training

BACKGROUND

To provide feedback to surgeons in robotic surgery training, many surgical skill evaluation methods have been developed. However, they hardly focus on the performance of the surgical motion segments. This paper proposes a method of specifying a trainee's skill weakness in the surgical training.

METHODS

This paper proposed an automatic skill evaluation framework by comparing the trainees' operations with the template operation in each surgical motion segment, which is mainly based on dynamic time warping (DTW) and continuous hidden Markov model (CHMM).

RESULTS

The feasibility of this proposed framework has been preliminarily verified. For specifying the skill weakness in instrument handling and efficiency, the result of this proposed framework was significantly correlated with that of manual scoring.

CONCLUSION

The automatic skill evaluation framework has shown its superiority in efficiency, objectivity, and being targeted, which can be used in robotic surgery training.

Virtual reality simulation training for health professions trainees in gastrointestinal endoscopy

BACKGROUND

Endoscopy has traditionally been taught with novices practicing on real patients under the supervision of experienced endoscopists. Recently, the growing awareness of the need for patient safety has brought simulation training to the forefront. Simulation training can provide trainees with the chance to practice their skills in a learner-centred, risk-free environment. It is important to ensure that skills gained through simulation positively transfer to the clinical environment. This updated review was performed to evaluate the effectiveness of virtual reality (VR) simulation training in gastrointestinal endoscopy.

OBJECTIVES

To determine whether virtual reality simulation training can supplement and/or replace early conventional endoscopy training (apprenticeship model) in diagnostic oesophagogastroduodenoscopy, colonoscopy, and/or sigmoidoscopy for health professions trainees with limited or no prior endoscopic experience.

SEARCH METHODS

We searched the following health professions, educational, and computer databases until 12 July 2017: the Cochrane Central Register of Controlled Trials, Ovid MEDLINE, Ovid Embase, Scopus, Web of Science, BIOSIS Previews, CINAHL, AMED, ERIC, Education Full Text, CBCA Education, ACM Digital Library, IEEE Xplore, Abstracts in New Technology and Engineering, Computer and Information Systems Abstracts, and ProQuest Dissertations and Theses Global. We also searched the grey literature until November 2017.

SELECTION CRITERIA

We included randomised and quasi-randomised clinical trials comparing VR endoscopy simulation training versus any other method of endoscopy training with outcomes measured on humans in the clinical setting, including conventional patient-based training, training using another form of endoscopy simulation, or no training. We also included trials comparing two different methods of VR training.

DATA COLLECTION AND ANALYSIS

Two review authors independently assessed the eligibility and methodological quality of trials, and extracted data on the trial characteristics and outcomes. We pooled data for meta-analysis where participant groups were similar, studies assessed the same intervention and comparator, and had similar definitions of outcome measures. We calculated risk ratio for dichotomous outcomes with 95% confidence intervals (CI). We calculated mean difference (MD) and standardised mean difference (SMD) with 95% CI for continuous outcomes when studies reported the same or different outcome measures, respectively. We used GRADE to rate the quality of the evidence.

MAIN RESULTS

We included 18 trials (421 participants; 3817 endoscopic procedures). We judged three trials as at low risk of bias. Ten trials compared VR training with no training, five trials with conventional endoscopy training, one trial with another form of endoscopy simulation training, and two trials compared two different methods of VR training. Due to substantial clinical and methodological heterogeneity across our four comparisons, we did not perform a meta-analysis for several outcomes. We rated the quality of evidence as moderate, low, or very low due to risk of bias, imprecision, and heterogeneity.Virtual reality endoscopy simulation training versus no training: There was insufficient evidence to determine the effect on composite score of competency (MD 3.10, 95% CI -0.16 to 6.36; 1 trial, 24 procedures; low-quality evidence). Composite score of competency was based on 5-point Likert scales assessing seven domains: atraumatic technique, colonoscope advancement, use of instrument controls, flow of procedure, use of assistants, knowledge of specific procedure, and overall performance. Scoring range was from 7 to 35, a higher score representing a higher level of competence. Virtual reality training compared to no training likely provides participants with some benefit, as measured by independent procedure completion (RR 1.62, 95% CI 1.15 to 2.26; 6 trials, 815 procedures; moderate-quality evidence). We evaluated overall rating of performance (MD 0.45, 95% CI 0.15 to 0.75; 1 trial, 18 procedures), visualisation of mucosa (MD 0.60, 95% CI 0.20 to 1.00; 1 trial, 55 procedures), performance time (MD -0.20 minutes, 95% CI -0.71 to 0.30; 2 trials, 29 procedures), and patient discomfort (SMD -0.16, 95% CI -0.68 to 0.35; 2 trials, 145 procedures), all with very low-quality evidence. No trials reported procedure-related complications or critical flaws (e.g. bleeding, luminal perforation) (3 trials, 550 procedures; moderate-quality evidence).Virtual reality endoscopy simulation training versus conventional patient-based training: One trial reported composite score of competency but did not provide sufficient data for quantitative analysis. Virtual reality training compared to conventional patient-based training resulted in fewer independent procedure completions (RR 0.45, 95% CI 0.27 to 0.74; 2 trials, 174 procedures; low-quality evidence). We evaluated performance time (SMD 0.12, 95% CI -0.55 to 0.80; 2 trials, 34 procedures), overall rating of performance (MD -0.90, 95% CI -4.40 to 2.60; 1 trial, 16 procedures), and visualisation of mucosa (MD 0.0, 95% CI -6.02 to 6.02; 1 trial, 18 procedures), all with very low-quality evidence. Virtual reality training in combination with conventional training appears to be advantageous over VR training alone. No trials reported any procedure-related complications or critical flaws (3 trials, 72 procedures; very low-quality evidence).Virtual reality endoscopy simulation training versus another form of endoscopy simulation: Based on one study, there were no differences between groups with respect to composite score of competency, performance time, and visualisation of mucosa. Virtual reality training in combination with another form of endoscopy simulation training did not appear to confer any benefit compared to VR training alone.Two methods of virtual reality training: Based on one study, a structured VR simulation-based training curriculum compared to self regulated learning on a VR simulator appears to provide benefit with respect to a composite score evaluating competency. Based on another study, a progressive-learning curriculum that sequentially increases task difficulty provides benefit with respect to a composite score of competency over the structured VR training curriculum.

AUTHORS' CONCLUSIONS

VR simulation-based training can be used to supplement early conventional endoscopy training for health professions trainees with limited or no prior endoscopic experience. However, we found insufficient evidence to advise for or against the use of VR simulation-based training as a replacement for early conventional endoscopy training. The quality of the current evidence was low due to inadequate randomisation, allocation concealment, and/or blinding of outcome assessment in several trials. Further trials are needed that are at low risk of bias, utilise outcome measures with strong evidence of validity and reliability, and examine the optimal nature and duration of training.

Training in Endoscopy

PURPOSE OF THE REVIEW

Progress towards the goal of high-quality endoscopy across health economies has been founded on high-quality structured training programmes linked to credentialing practice and ongoing performance monitoring. This review appraises the recent literature on training interventions, which may benefit performance and competency acquisition in novice endoscopy trainees.

RECENT FINDINGS

Increasing data on the learning curves for different endoscopic procedures has highlighted variations in performance amongst trainees. These differences may be dependent on the trainee, trainer and training programme. Evidence of the benefit of knowledge-based training, simulation training, hands-on courses and clinical training is available to inform the planning of ideal training pathway elements. The validation of performance assessment measures and global competency tools now also provides evidence on the effectiveness of training programmes to influence the learning curve. The impact of technological advances and intelligent metrics from national databases is also predicted to drive improvements and efficiencies in training programme design and monitoring of post-training outcomes. Training in endoscopy may be augmented through a series of pre-training and in-training interventions. In conjunction with performance metrics, these evidence-based interventions could be implemented into training pathways to optimise and quality assure training in endoscopy.

Individualised Expert Feedback is Not Essential for Improving Basic Clinical Skills Performance in Novice Learners: A Randomized Trial

OBJECTIVE

To determine whether unsupervised video feedback (UVF) is as effective as direct expert feedback (DEF) in improving clinical skills performance for medical students learning basic surgical skills-intravenous cannulation, catheterization, and suturing.

BACKGROUND

Feedback is a vital component of the learning process, yet great variation persists in its quality, quantity, and methods of delivery. The use of video technology to assist in the provision of feedback has been adopted increasingly.

METHODS

A prospective, blinded randomized trial comparing DEF, an expert reviewing students' performances with subsequent improvement suggestions, and UVF, students reviewing their own performance with an expert teaching video, was carried out. Medical students received an initial teaching lecture on intravenous cannulation, catheterization, and suturing and were then recorded performing the task. They subsequently received either DEF or UVF before reperforming the task. Students' recordings were additionally scored by 2 blinded experts using a validated proforma.

RESULTS

A total of 71 medical students were recruited. Cannulation scores improved 4.3% with DEF and 9.5% with UVF (p = 0.044), catheterization scores improved 8.7% with DEF and 8.9% with UVF (p = 0.96), and suturing improved 15.6% with DEF and 13.2% with UVF (p = 0.54). Improvement from baseline scores was significant in all cases (p < 0.05).

CONCLUSION

Video-assisted feedback allows a significant improvement in clinical skills for novices. No significant additional benefit was demonstrated from DEF, and a similar improvement can be obtained using a generic expert video and allowing students to review their own performance. This could have significant implications for the design and delivery of such training.

Combining different methods improves assessment of competence in colonoscopy

OBJECTIVES

To develop a reliable method of assessing competence in colonoscopy based on multiple sources.

MATERIALS AND METHODS

Physicians with varying degrees of experience in colonoscopy performed two colonoscopies each in a standardized simulated environment. Their performances were assessed under direct observation by an expert rater and by automatic computerized analysis of operator movements and scope movements, respectively. Reliability (Cronbach's alpha) for subjective assessment, time to cecum, analysis of operator movement and analysis of scope movements were calculated. Composite score calculations were used to explore different combinations of the measures.

RESULTS

Twenty physicians were included in the study. The reliability (Cronbach's alpha) were 0.92, 0.57, 0.87 and 0.55 for the subjective score assessed under direct observation, time to cecum, distance between operator's hands and colonoscopy progression score, respectively. Equal weight (=25%) to all four methods resulted in a reliability of 0.91 and optimal weighting of the methods (55%, 10%, 25% and 10%, respectively) resulted in a maximum reliability of 0.95.

CONCLUSION

Combining subjective expert ratings with automated objective assessments results in a less biased and more reliable assessment of competence in colonoscopy.

Simulation in cardiac catheterization laboratory: Need of the hour to improve the clinical skills

Simulation is an effective teaching tool to decrease the learning curve for novices without compromising patient safety. Simulation helps interventionalist in mentally translating a two dimentional, black and white image into a usable three dimentional model. It also bridges the gap in training diverse team members on new procedures and products. All simulators have collision detection, i.e., virtual contact forces generated from collision which updates haptic output with new calculations.

Justify Your Answer: The Role of Written Think Aloud in Script Concordance Testing

Construct: Clinical reasoning assessment is a growing area of interest in the medical education literature. Script concordance testing (SCT) evaluates clinical reasoning in conditions of uncertainty and has emerged as an innovative tool in the domain of clinical reasoning assessment. SCT quantifies the degree of concordance between a learner and an experienced clinician and attempts to capture the breadth of responses of expert clinicians, acknowledging the significant yet acceptable variation in practice under situations of uncertainty.

BACKGROUND

SCT has been shown to be a valid and reliable clinical reasoning assessment tool. However, as SCT provides only quantitative information, it may not provide a complete assessment of clinical reasoning.

APPROACH

Think aloud (TA) is a qualitative research tool used in clinical reasoning assessment in which learners verbalize their thought process around an assigned task. This study explores the use of TA, in the form of written reflection, in SCT to assess resident clinical reasoning, hypothesizing that the information obtained from the written TA would enrich the quantitative data obtained through SCT. Ninety-one pediatric postgraduate trainees and 21 pediatricians from 4 Canadian training centers completed an online test consisting of 24 SCT cases immediately followed by retrospective written TA. Six of 24 cases were selected to gather TA data. These cases were chosen to allow all phases of clinical decision making (diagnosis, investigation, and treatment) to be represented in the TA data. Inductive thematic analysis was employed when systematically reviewing TA responses.

RESULTS

Three main benefits of adding written TA to SCT were identified: (a) uncovering instances of incorrect clinical reasoning despite a correct SCT response, (b) revealing sound clinical reasoning in the context of a suboptimal SCT response, and (c) detecting question misinterpretation.

CONCLUSIONS

Written TA can optimize SCT by demonstrating when correct examinee responses are based on guessing or uncertainty rather than robust clinical rationale. TA can also enhance SCT by allowing examinees to provide justification for responses that otherwise would have been considered incorrect and by identifying questions that are frequently misinterpreted to avoid including them in future examinations. TA also has significant value in differentiating between acceptable variations in expert clinician responses and deviance associated with faulty rationale or question misinterpretation; this could improve SCT reliability. A written TA protocol appears to be a valuable tool to assess trainees' clinical reasoning and can strengthen the quantitative assessment provided by SCT.

Old habits die hard: a case study on how new ways of teaching colonoscopy affect the habitus of experienced clinicians

OBJECTIVES

The purpose of this study is to explore the habitual constraints and opportunities that affect how experienced clinicians learn new skills and, in particular, how new ways of teaching can influence these.

METHODS

  We conducted a case study based on a specialized training program for colonoscopy services in Denmark. Data was obtained from a short-term ethnographic fieldwork and in-depth interviews during this program. Participants were 12 experienced colonoscopists and three expert colonoscopy trainers from Denmark and UK. The analysis of data involved categorization, inductive coding, and theoretical reading inspired by sociological theory.

RESULTS

The experienced clinicians' responsiveness to training was shaped by an underlying logic of colonoscopy practice that was characterized by tacit skills, routine work, lower status, skepticism and self-protectiveness. In order to overcome these habitual constraints, the trainers applied a pedagogical approach based on four methods: 1) intellectualization: 'academization' of skills and competencies, 2) sensing and scaffolding: hands-on experiences and learning by doing, 3) asymmetry: accentuating the authority and respect of the trainer, and 4) relation-building: building relationship and engagement between trainer and clinician. This multi-dimensional approach to teaching enabled the trainers to affect the clinicians' logic of practice and to create buy-in (so-called illusio).

CONCLUSIONS

Clinical skills include socially constructed behaviors and unconscious competences which affect experienced clinicians' responsiveness to continuing medical education. This study suggests four educational strategies that may help trainers to establish new logics of practice in experienced clinicians and to improve the clinicians' conscious competence.

Training and Assessment of Hysteroscopic Skills: A Systematic Review

OBJECTIVE

The aim of this systematic review was to identify studies on hysteroscopic training and assessment.

DESIGN

PubMed, Excerpta Medica, the Cochrane Library, and Web of Science were searched in January 2015. Manual screening of references and citation tracking were also performed. Studies on hysteroscopic educational interventions were selected without restrictions on study design, populations, language, or publication year. A qualitative data synthesis including the setting, study participants, training model, training characteristics, hysteroscopic skills, assessment parameters, and study outcomes was performed by 2 authors working independently. Effect sizes were calculated when possible. Overall, 2 raters independently evaluated sources of validity evidence supporting the outcomes of the hysteroscopy assessment tools.

RESULTS

A total of 25 studies on hysteroscopy training were identified, of which 23 were performed in simulated settings. Overall, 10 studies used virtual-reality simulators and reported effect sizes for technical skills ranging from 0.31 to 2.65; 12 used inanimate models and reported effect sizes for technical skills ranging from 0.35 to 3.19. One study involved live animal models; 2 studies were performed in clinical settings. The validity evidence supporting the assessment tools used was low. Consensus between the 2 raters on the reported validity evidence was high (94%).

CONCLUSIONS

This systematic review demonstrated large variations in the effect of different tools for hysteroscopy training. The validity evidence supporting the assessment of hysteroscopic skills was limited.

Working memory is limited: improving knowledge transfer by optimising simulation through cognitive load theory

This analysis explores how to optimise knowledge transfer in healthcare simulation by applying cognitive load theory to curriculum design and delivery for both novice and expert learners. This is particularly relevant for interprofessional learning which is team-based, as each participant comes to the simulation experience with different levels of expertise. Healthcare simulation can offer opportunities to create complex and dynamic experiences that replicate real clinical situations. Understanding Cognitive Load Theory can foster the acquisition of complex knowledge, skills and abilities required to deliver excellence in patient care without overwhelming a learner's ability to handle new materials due to working memory limitations. The 2 aspects of working memory that will be explored in this paper are intrinsic load and extrinsic load. These will be addressed in terms of the learner's level of expertise and how to consider these elements to enhance the learning environment in simulation scenario development and delivery. By applying the concepts of Cognitive Load Theory, this paper offers educators a method to tailor their curricula to navigate working memory and optimise the opportunity for knowledge transfer.

Learning curve for endoscopy training: Is it all about numbers?

Endoscopy training is an important component of postgraduate gastroenterology and general surgery programs. Proficiency in endoscopy requires the development of several tangible and intangible skills. Much attention has traditionally been paid to establishing a threshold, or minimum procedural volume during the training period, which is necessary for a trainee to achieve competence in endoscopy by the conclusion of his or her program. However, despite several attempts to characterize this target, it has become clear in recent years that training programs need to consider other factors rather than relying on this measure as the sole marker of trainee competency. Here, we present a review of general concepts in endoscopy skills acquisition that affect the learning curve, the evolving definition of competency as it relates to procedural volume, the role of simulation in endoscopy training, and the concept of massed versus spaced delivery of endoscopy training.

Simulator training in gastrointestinal endoscopy - From basic training to advanced endoscopic procedures

Simulator-based gastrointestinal endoscopy training has gained acceptance over the last decades and has been extensively studied. Several types of simulators have been validated and it has been demonstrated that the use of simulators in the early training setting accelerates the learning curve in acquiring basic skills. Current GI endoscopy simulators lack the degree of realism that would be necessary to provide training to achieve full competency or to be applicable in certification. Virtual Reality and mechanical simulators are commonly used in basic flexible endoscopy training, whereas ex vivo and in vivo models are used in training the most advanced endoscopic procedures. Validated models for the training of more routine therapeutic interventions like polypectomy, EMR, stenting and haemostasis are lacking or scarce and developments in these areas should be encouraged.

Distributed practice. The more the merrier? A randomised bronchoscopy simulation study

INTRODUCTION

The distribution of practice affects the acquisition of skills. Distributed practice has shown to be more effective for skills acquisition than massed training. However, it remains unknown as to which is the most effective distributed practice schedule for learning bronchoscopy skills through simulation training. This study compares two distributed practice schedules: One-day distributed practice and weekly distributed practice.

METHOD

Twenty physicians in training were randomly assigned to one-day distributed or weekly distributed bronchoscopy simulation practice. Performance was assessed with a pre-test, a post-test after each practice session, and a 4-week retention test using previously validated simulator measures. Data were analysed with repeated measures ANOVA.

RESULTS

No interaction was found between group and test (F(4,72) <1.68, p>0.16), except for the measure 'percent-segments-entered', and no main effect of group was found for any of the measures (F(1,72)< 0.87, p>0.36), which indicates that there was no difference between the learning curves of the one-day distributed practice schedule and the weekly distributed practice schedule.

DISCUSSION

We found no difference in effectiveness of bronchoscopy skills acquisition between the one-day distributed practice and the weekly distributed practice. This finding suggests that the choice of bronchoscopy training practice may be guided by what best suits the clinical practice.

Training and competence assessment in GI endoscopy: a systematic review

INTRODUCTION

Training procedural skills in GI endoscopy once focused on threshold numbers. As threshold numbers poorly reflect individual competence, the focus gradually shifts towards a more individual approach. Tools to assess and document individual learning progress are being developed and incorporated in dedicated training curricula. However, there is a lack of consensus and training guidelines differ worldwide, which reflects uncertainties on optimal set-up of a training programme.

AIMS

The primary aim of this systematic review was to evaluate the currently available literature for the use of training and assessment methods in GI endoscopy. Second, we aimed to identify the role of simulator-based training as well as the value of continuous competence assessment in patient-based training. Third, we aimed to propose a structured training curriculum based on the presented evidence.

METHODS

A literature search was carried out in the available medical and educational literature databases. The results were systematically reviewed and studies were included using a predefined protocol with independent assessment by two reviewers and a final consensus round.

RESULTS

The literature search yielded 5846 studies. Ninety-four relevant studies on simulators, assessment methods, learning curves and training programmes for GI endoscopy met the inclusion criteria. Twenty-seven studies on simulator validation were included. Good validity was demonstrated for four simulators. Twenty-three studies reported on simulator training and learning curves, including 17 randomised control trials. Increased performance on a virtual reality (VR) simulator was shown in all studies. Improved performance in patient-based assessment was demonstrated in 14 studies. Four studies reported on the use of simulators for assessment of competence levels. Current simulators lack the discriminative power to determine competence levels in patient-based endoscopy. Eight out of 14 studies on colonoscopy, endoscopic retrograde cholangiopancreatography and endosonography reported on learning curves in patient-based endoscopy and proved the value of this approach for measuring performance. Ten studies explored the numbers needed to gain competence, but the proposed thresholds varied widely between them. Five out of nine studies describing the development and evaluation of assessment tools for GI endoscopy provided insight into the performance of endoscopists. Five out of seven studies proved that intense training programmes result in good performance.

CONCLUSIONS

The use of validated VR simulators in the early training setting accelerates the learning of practical skills. Learning curves are valuable for the continuous assessment of performance and are more relevant than threshold numbers. Future research will strengthen these conclusions by evaluating simulation-based as well as patient-based training in GI endoscopy. A complete curriculum with the assessment of competence throughout training needs to be developed for all GI endoscopy procedures.