Applying Educational Theory to Simulation-Based Training and Assessment in Surgery

Impact of Simulation Training on Core Skill Competency of Undergraduate Medical Students

INTRODUCTION

Simulation based medical training (SBMT) is gaining traction for undergraduate learning and development. We designed, implemented, and independently assessed the impact of an SBMT programme on competency in surgical history taking and clinical examination for senior clinical students.

METHODS

With institutional ethical approval and initial pilot study of student volunteers that ensured format appropriateness, we implemented an SBMT programme weekly for ten weeks during the core surgery module of our Medicine degree programme. Groups of 5 students collaboratively undertook an observed focused history and physical examination while simultaneously directing care on a simulated surgical patient (actor) with acute abdominal pain. This was conducted in a nonclinical, standardised, tutor-supervised environment and followed by a group debriefing led by both the simulated patient and tutor discussing student interaction and competency. All students undertook Southampton Medical Assessment Tool (SMAT) on a surgical inpatient prior to (baseline) and within 2 weeks after SBMT. Students without simulation training functioned as a control group and randomized cluster sampling was utilised for group selection. Second assessments were by independent surgical academics blinded to student group. Feedback was collected via anonymous questionnaire from those who undertook SBMT.

RESULTS

One hundred students took part, fifty of whom undertook SBMT. Global mean SMAT scores were similar between the control and intervention group at baseline (p > 0.05). Scores on the second assessment were significantly higher (p = 0.0006) for those who had undertaken SBMT vs. controls; 94% of students taking SBMT reported benefit via questionnaire with 85% stating increased confidence in history-taking and 78% reporting improved abdominal examination.

CONCLUSIONS

Undergraduate simulation training at scale is feasible and positively impacts undergraduate student core task competency.

What is the impact of simulation-based training for paediatric procedures on patient outcomes, cost and latent safety threats?

BACKGROUND

Simulation-based training (SBT) provides a safe space for medical trainees to experience realistic scenarios. SBT has been found to improve trainee performance in paediatric procedures. However, limited evidence exists regarding its effects on higher-level outcomes. This scoping review aims to identify studies that investigate the impact of SBT for procedural skills on T3 (patient outcomes) and T4 level outcomes (latent safety threats [LSTs], and hospital level costs) in paediatrics.

METHODS

Full-text articles were included if they focused on medical trainees, used simulation training for paediatric procedures and reported T3/T4 level outcomes. Six databases were searched from January 2011 to September 2022. Search strategies were developed with the assistance of a librarian. Three independent reviewers performed pilot screenings before title/abstract and full-text screenings. A data extraction sheet was created to gather information on interventions, outcomes, research design, and other study characteristics.

FINDINGS

After title/abstract screening of 4,076 sources, 50 were included for full-text review, with 15 articles selected for data extraction. Four were randomised control studies (RCTs), fourteen focused on T3 level outcomes including mortality rates, and one measured LSTs. There were no studies reporting cost-related data. Three of the studies focused on bag-and-mask ventilation, and eight mentioned the use of mannequins.

DISCUSSION

We highlight the potential effectiveness of simulation-based training of paediatric procedural skills in improving patient outcomes, such as reduced mortality rates and incidence of illness/injury.

CONCLUSION

Though the quality of research designs was low, researchers used different simulation modalities and outcome measures and showed a positive impact of SBT(e.g., decreased mortality rates).

Taking the Pulse of the Current State of Simulation

Simulation in health-care professions has grown in the last few decades. We provide an overview of the history of simulation in other fields, the trajectory of simulation in health professions education, and research in medical education, including the learning theories and tools to assess and evaluate simulation programs. We also propose future directions for simulation and research in health professions education.

The simulation design in health and nursing: A scoping review

AIMS

The aims of this study were to map the components of the simulation design in health and nursing and to propose a classification based on their definitions to support the planning of simulation-based experiences.

DESIGN

Scoping review.

METHOD

Searches were performed in the databases LILACS, Embase, MEDLINE/PubMed, SCOPUS, Web of Science, Google Scholar and ProQuest Thesis and Dissertation were performed, without time limitation, to identify studies about simulation design.

RESULTS

This study mapped 19 components of the simulation design found in 26 studies included, which can contribute to the development of simulation-based experiences, classified into structural, methodological and theoretical-pedagogical components. The simulation design can be described according to its fundamental components: structural-define the basic formulation of a simulation in terms of infrastructure and conceptual framework; methodological-define the participants, roles and the instruction format; and theoretical-pedagogical-define the educational references used to support the simulation strategy.

Teaching with Technology-Matching Pedagogy with Purpose in Radiology Education

The response to pandemic-related teaching disruption has revealed dynamic levels of learning and teaching flexibility and rapid technology adoption of radiology educators and trainees. Shutdowns and distancing requirements accelerated the adoption of technology as an educational tool, in some instances supplanting in-person education entirely. Despite the limitations of remote interaction, many educational advantages were recognized that can be leveraged in developing distance learning paradigms. The specific strategies employed should match modern learning science, enabling both students and educators to mutually grow as lifelong learners. As panel members of the "COVID: Faculty perspective" Task Force of the Association of University Radiologists Radiology Research Alliance, we present a review of key learning principles which educators can use to identify techniques that enhance resident learning and present an organized framework for applying technology-aided techniques aligned with modern learning principles. Our aim is to facilitate the purposeful integration of learning tools into the training environment by matching these tools to established educational frameworks. With these frameworks in mind, radiology educators have the opportunity to re-think the balance between traditional curricular design and modern digital teaching tools and models.

Research on the Mixed Education Mode for the Safety Engineering Major during the Coronavirus (COVID-19) Epidemic

During the COVID-19 epidemic, many countries faced a critical situation in terms of the global economy and human social activities, including education. In China, the coronavirus is better controlled. Chinese university students have returned to school to study. Despite previous research on online education and learning, the readiness of students for the online and offline learning models implemented at this particular time is not well understood. This paper discusses a hybrid education model for undergraduate students in the safety engineering major. Questionnaires are administered to faculty and students from different colleges and universities in the same major to statistically summarize the influencing factors of mixed or hybrid education. The system dynamics (SD) model is constructed and simulated to determine that using online in the tenth to fifteenth, twenty-fifth to thirtieth, and fortieth to forty-fifth min of classroom teaching (50 min in total) can effectively increase students' interest and engagement in learning. More hands-on activities should also be considered to enhance students' motivation to acquire knowledge, and consideration could be given to encourage interaction among students. This study will be continuously improved by a follow-up study of undergraduate student performance. This study has important implications for educators implementing online and offline blended instruction.

Teaching EndoFLIP Impedance Planimetry to Practicing Endoscopists: An "Into the Fire" Approach to Simulation

Background. There are growing interests from practicing endoscopists to implement the functional lumen imaging probe (FLIP) impedance planimetry system. We present a simulation-based curriculum using an "into the fire" approach with hands-on pre- and post-tests to teach the use of this technology. Methods. The curriculum consists of a series of pre-tests, didactic content, mentored hands-on instructions, and post-tests. Pre- and post-testing included a knowledge-based written test, a confidence survey, and an assessment form specific to the hands-on performance of FLIP. Result. Twenty-two practicing physicians completed the curriculum. After course completion, participants had improved knowledge-based written test scores from 6.8±1.7 to 8.9±0.9 (P<0.001), confidence scores from 10.0±5.9 to 22.1±2.6 (P<0.001), and hands-on performance score from 11.4±3.4 to 23.1±2.0 (P<0.001) with significant improvement in all components of the hands-on skills. Conclusion. Our simulation curriculum is effective in improving confidence, knowledge, and technical proficiency when teaching the use of FLIP to practicing physicians.

Training Surgeons to Perform Arthroscopic All-Inside Meniscal Repair: A Randomized Controlled Trial Evaluating the Effectiveness of a Novel Cognitive Task Analysis Teaching Tool, Imperial College London/University College London Meniscus Repair Cognitive Task Analysis (IUMeRCTA)

BACKGROUND

All-inside meniscal repair is an increasingly common technique for the surgical treatment of meniscal tears. There are currently no standardized techniques for training residents in this procedure. Cognitive task analysis (CTA) is a method of analyzing and standardizing key steps in a procedure that allows training to be conducted in a validated and reproducible manner.

PURPOSE

(1) To design a digital CTA teaching tool for a standardized all-inside meniscal repair. (2) To evaluate whether CTA-trained residents would perform better in a meniscal repair task compared with a control group who underwent traditional apprenticeship methods of training.

STUDY DESIGN

Controlled laboratory study.

METHODS

Three expert knee surgeons were interviewed using a modified Delphi method to generate a consensus among the ideal technical steps, cognitive decision points, and common errors and solutions for an all-inside meniscal repair. This written information was then combined with visual and audio components and integrated onto a digital platform to create the Imperial College London/University College London Meniscus Repair Cognitive Task Analysis (IUMeRCTA) tool. Eighteen novice residents were randomized into an intervention group (digital CTA tool) and control group (equipment instruction manual). Both groups performed an all-inside meniscal repair on high-fidelity, phantom knee models and were assessed by expert surgeons, blinded to the interventions, using a validated global rating scale (GRS). After a power calculation, median GRS scores were compared between groups using the Mann-Whitney U test; significance was set at P < .05.

RESULTS

For the IUMeRCTA tool design, the procedure was divided into 55 steps across 9 phases: (1) preoperative planning, (2) theater and patient setup, (3) portal placement, (4) meniscal examination, (5) tear reduction, (6) suture planning, (7) suture insertion, (8) repair completion, and (9) postoperative care and rehabilitation. For the trial, the intervention group (mean ± SD GRS, 32 ± 2.9) performed significantly better than did the control group (GRS, 24 ± 3.3; P < .001).

CONCLUSION

This is the first CTA tool to demonstrate objective benefits in training novices to perform an arthroscopic all-inside meniscal repair.

CLINICAL RELEVANCE

The IUMeRCTA tool is an easily accessible and effective adjunct to traditional teaching that enhances learning the all-inside meniscal repair for novice surgeons.

Low versus high level of physical resemblance in simulation for the acquisition of basic surgical skill: a meta-analysis

Background

Many studies explored the use of simulation in basic surgical education, with a variety of devices, contexts and outcomes, with sometimes contradictory results.

Objectives

The objectives of this meta-analysis were to focus the effect that the level of physical resemblance in a simulation has on the development of basic surgical skill in undergraduate medical students and to provide a foundation for the design and implementation of a simulation, with respect to its effectiveness and alignment with the learning outcomes.

Study selection

We searched PubMed and Scopus database for comparative randomised studies between simulations with a different level of resemblance. The result was synthesised as the standardised mean difference, under a random effect model.

Findings

We selected 12 out of 2091 retrieved studies, reporting on 373 undergraduate students (mean of subjects 15.54±6.89). The outcomes were the performance of simple skills and the time to complete a task. Two studies reported a scoring system; seven studies reported time for a task; and three studies reported both. The total number of measures included in the meta-analysis was 456 for score and 504 for time. The pooled effect size did not show any significant advantage in a simulation of a high level of physical resemblance over a lower level, both for the scoring system (−0.19, 95% CI −0.44 to 0.06) and for time (−0.14, 95% CI −0.54 to 0.27).

Conclusion

Simulations with a low level of physical resemblance showed the same effect as the simulation using a higher level of resemblance on the development of basic surgical skills in undergraduate students.

COVID-19: experience and development of simulation for training in a London District General Hospital

The world is facing an unprecedented crisis in the form of the coronavirus disease-2019 (COVID-19) pandemic. Clinicians and their working environments are under considerable pressures that have not previously been encountered. Consequently, clinicians have had to change their practice significantly to enable safe care for their patients, whilst ensuring their own safety. The majority of COVID-19 simulation to date has been either virtual or in-situ, with the aim of training specific departments. With this in mind, as the Hillingdon Hospital Education Team, we developed a simulation that would provide generic training on COVID-19 for staff across our Trust in various departments and roles. Our aim was to teach staff how to manage patients whilst protecting themselves during this pandemic.

Teaching peroral endoscopic pyloromyotomy (POP) to practicing endoscopists: An "into-the-fire" approach to simulation

BACKGROUND

Peroral endoscopic pyloromyotomy, or gastric peroral endoscopic myotomy, is a novel endoscopic procedure for the treatment of refractory gastroparesis. We present a simulation-based curriculum using an "into-the-fire" approach with hands-on pre- and post-tests to teach this procedure.

METHODS

Six, 1-day peroral endoscopic pyloromyotomy courses were taught by an expert surgical endoscopist in 2018 to 2019. The curriculum is composed of a series of pretraining tests, lectures, mentored hands-on instruction, and post-training tests using porcine models. Both pre- and post-testing included a confidence survey, a knowledge-based written test, and a specific assessment form for the peroral endoscopic pyloromyotomy procedure. Participants' scores were analyzed using paired t tests.

RESULTS

Twenty-eight practicing physicians participated. After completing the curriculum, participants had improved confidence scores (10.5 ± 5.2 vs 19.4 ± 3.6; P < .001), written test scores (6.8 ± 1.6 vs 8.0 ± 1.1; P < .001), and hands-on performance scores (23.6 ± 3.4 vs 29.3 ± 1.4; P < .001) with marked improvement in all components of the peroral endoscopic pyloromyotomy procedure. Postcourse surveys showed 93% of participants had performed or intended to perform the peroral endoscopic pyloromyotomy procedure within the next year.

CONCLUSION

Our simulation curriculum with an into-the-fire approach to teach peroral endoscopic pyloromyotomy is effective in improving practitioner knowledge, confidence, and technical skills, leading to an increase in the adoption of this procedure.

Medical Education During the Coronavirus Disease-2019 Pandemic: Learning From a Distance

As paradigms of clinical care delivery have been significantly impacted by the novel coronavirus disease-2019 pandemic, so has the structure, delivery, and future of medical education. Both undergraduate and graduate medical education have seen disruptions ranging from fully virtual delivery of educational content and limited clinical care for medical students to increased clinical demands with redeployment for residents and fellows. Adherence to social distancing has led to the adoption and implementation of already available technologies in medical education, including video conferencing softwares and social media platforms. Efficient and effective use of these technologies requires an understanding not only of these platforms and their features but also of their inherent limitations. During a time of uncertainty and increased clinical demands, the approach to medical education must be thoughtful with attention to wellness of both the educator and learner. In this review, we discuss the influence of the pandemic on the existing medical education landscape, outline existing and proposed adaptations to social distancing, and describe challenges that lie ahead.

Surgical cricothyroidostomy. Analysis and comparison between teaching and validation models of simulator models

OBJECTIVE

to compare the acquisition and retention of knowledge about surgical cricothyroidostomy by the rapid four-step technique (RFST), when taught by expository lecture, low fidelity and high-fidelity simulation models.

METHODS

ninety medical students at UFPR in the first years of training were randomized assigned into 3 groups, submitted to different teaching methods: 1) expository lectures, 2) low-fidelity simulator model, developed by the research team or 3) high-fidelity simulator model (commercial). The procedure chosen was surgical cricothyroidostomy using the RFST. Soon after lectures, the groups were submitted to a multiple-choice test with 20 questions (P1). Four months later, they underwent another test (P2) with similar content. Analysis of Variance was used to compare the grades of each group in P1 with their grades in P2, and the grades of the 3 groups 2 by 2 in P1 and P2. A multiple comparisons test (post-hoc) was used to check differences within each factor (test and group). Statistical significance was considered when p<0.05. Statistical analysis was performed in the statistical software R version 3.6.1.

RESULTS

each group was composed of 30 medical students, without demographic differences between them. The mean scores of the groups of the expositive lecture, of the simulator of low fidelity model and of high-fidelity simulator model in P1 were, respectively, 75.00, 76.09, and 68.79, (p<0.05). In P2 the grades were 69.84, 75.32, 69.46, respectively, (p>0.05).

CONCLUSIONS

the simulation of low fidelity model was more effective in learning and knowledge retention, being feasible for RFST cricothyroidostomy training in inexperienced students.

Face, content, construct validity and training effect of touch surgery™ as a surgical decision-making trainer for novices in open appendicectomy

BACKGROUND

Laparoscopic surgery has become the gold standard for many operations with significant benefits in morbidity and hospital recovery time. One such procedure is appendicectomy, which is overwhelmingly performed using the laparoscopic approach in the modern era. This has also meant that the number of cases involving traditional open appendicectomy has declined despite surgeons being expected to be able to convert to the open technique if required. One method to rehearse for theatre is the use of software applications. This paper investigates the validity of Touch Surgery™ as an education tool for surgical decision-making for novices, as well as its training effect in open appendicectomy.

METHOD

70 participants will be recruited, consisting of 60 medical students (novices) and 10 surgical consultants (experts). For face, content, and construct validity, first attempt scores on the Touch Surgery™ Open Appendicectomy Test Module will be compared between novices and experts. For the training effect and knowledge decline elements of the study, novices will be further randomised into either the low intervention (control) group who will complete the simulation once, or to the high intervention group who will complete the simulation six times, with both novice groups asked to repeat the test one week later. All participants will also be requested to complete questionnaires regarding the stimulation.

A Multicenter Randomized Controlled Trial Evaluating the Effectiveness of Cognitive Training for Anterior Approach Total Hip Arthroplasty

BACKGROUND

For total hip arthroplasty (THA), cognitive training prior to performing real surgery may be an effective adjunct alongside simulation to shorten the learning curve. This study sought to create a cognitive training tool (CTT) to perform anterior approach (AA)-THA, which was validated by expert surgeons, and test its use as a training tool compared with conventional material.

METHODS

We employed a modified Delphi method with 4 expert surgeons from 3 international centers of excellence. Surgeons were independently observed performing THA before undergoing semistructured cognitive task analysis (CTA) and before completing successive rounds of surveys until a consensus was reached. Thirty-six surgical residents (postgraduate year [PGY]-1 through PGY-4) were randomized to cognitive training or training with a standard operation manual with surgical videos before performing a simulated AA-THA.

RESULTS

The consensus CTA defined THA in 11 phases, in which were embedded 46 basic steps, 36 decision points, and 42 critical errors and linked strategies. This CTA was mapped onto an open-access web-based CTT. Surgeons who prepared with the CTT performed a simulated THA 35% more quickly (time, mean 28 versus 38 minutes) with 69% fewer errors in instrument selection (mean 29 versus 49 instances), and required 92% fewer prompts (mean 13 versus 25 instances). They were more accurate in acetabular cup orientation (inclination error, mean 8° versus 10°; anteversion error, mean 14° versus 22°).

CONCLUSIONS

This validated CTT for arthroplasty provides structure for competency-based learning. It is more effective at preparing orthopaedic trainees for a complex procedure than conventional materials, as well as for learning sequence, instrumentation utilization, and motor skills.

CLINICAL RELEVANCE

Cognitive training combines education on decision-making, knowledge, and technical skill. It is an inexpensive technique to teach surgeons to perform hip arthroplasty and is more effective than current preparation methods.

Artificial Intelligence in Medical Education: Best Practices Using Machine Learning to Assess Surgical Expertise in Virtual Reality Simulation

OBJECTIVE

Virtual reality simulators track all movements and forces of simulated instruments, generating enormous datasets which can be further analyzed with machine learning algorithms. These advancements may increase the understanding, assessment and training of psychomotor performance. Consequently, the application of machine learning techniques to evaluate performance on virtual reality simulators has led to an increase in the volume and complexity of publications which bridge the fields of computer science, medicine, and education. Although all disciplines stand to gain from research in this field, important differences in reporting exist, limiting interdisciplinary communication and knowledge transfer. Thus, our objective was to develop a checklist to provide a general framework when reporting or analyzing studies involving virtual reality surgical simulation and machine learning algorithms. By including a total score as well as clear subsections of the checklist, authors and reviewers can both easily assess the overall quality and specific deficiencies of a manuscript.

DESIGN

The Machine Learning to Assess Surgical Expertise (MLASE) checklist was developed to help computer science, medicine, and education researchers ensure quality when producing and reviewing virtual reality manuscripts involving machine learning to assess surgical expertise.

SETTING

This study was carried out at the McGill Neurosurgical Simulation and Artificial Intelligence Learning Centre.

PARTICIPANTS

The authors applied the checklist to 12 articles using machine learning to assess surgical expertise in virtual reality simulation, obtained through a systematic literature review.

RESULTS

Important differences in reporting were found between medical and computer science journals. The medical journals proved stronger in discussion quality and weaker in areas related to study design. The opposite trends were observed in computer science journals.

CONCLUSIONS

This checklist will aid in narrowing the knowledge divide between computer science, medicine, and education: helping facilitate the burgeoning field of machine learning assisted surgical education.

Integrating Robotic Technology Into Resident Training: Challenges and Recommendations From the Front Lines

PURPOSE

To develop recommendations for improving the integration of robotic technology into today's apprentice-based resident training.

METHOD

During a national meeting in 2017, 24 robotic surgeons were interviewed about their experiences integrating robotic technology into resident training. Qualitative thematic analysis of interview notes and recordings revealed themes related to challenges and recommendations.

RESULTS

Four themes emerged, each corresponding to a general recommendation for integrating robotic technology into training. The first, surgical techniques versus tools, contrasts faculty's sequential mastery-surgical techniques first, then the robotic tool-with residents' simultaneous learning. The recommendation is to create separate learning opportunities for focused skill acquisition. The second theme, timing of exposure to the robotic tool, describes trainees' initial focus on tool use for basic surgical steps. The recommendation is to increase access to basic robotic cases. The third theme covers the relationship of laparoscopic and robotic surgery. The recommendation is to emphasize similar and dissimilar features during all minimally invasive surgical cases. The fourth theme, use of the dual console (which enables two consoles to operate the robot, the primary determines the secondary's functionality), highlights the unique teaching opportunities this console creates. The recommendation is for surgeons to give verbal guidance so residents completely understand surgical techniques.

CONCLUSIONS

Surgical educators should consider technique versus tool, timing of exposure to the tool, overlapping and varying features of robotic and laparoscopic surgery, and use of the dual console as they develop curricula to ensure thorough acquisition and synthesis of all elements of robotic surgery.

Computer Simulation and Maxillary All-on-Four Surgery

Maxillary all-on-four implant reconstruction requires training beyond normal dental implant training. It conjoins technical surgical acumen, anatomic and complex spatial relationship understanding, thorough awareness of dental prosthodontic principles, and excellent patient management skills. Acquisition of appropriate training to the level of competence in an era of greater patient expectations and increased vigilance for patient safety and overall quality of care is limited. Repeated purposeful practice in performing complex psychomotor tasks is of paramount importance in achieving competence. Surgical simulation may assist surgical learners to acquire familiarity with relevant anatomic variations, instrumentation, surgical techniques, and management of intraoperative and postoperative complications.

Simprovisation: A model for student-led simulation

BACKGROUND

Simulation is well established in medical education, with scenarios designed by faculty members to elicit specific learning outcomes. We describe and evaluate a learner-led style of simulation-based education that puts learners in control of the day. Simprovisation harnesses the principles of socially constructed learning and andragogy, encouraging learners to address their own learning requirements. Participants are divided into two groups. They are asked to consider their learning needs and are provided with resources and faculty member support to write two simulation scenarios. Faculty members remain available to guide scenario writing and offer 'micro-teaching' on required topics. The groups then swap and participate in the scenarios written for them by the opposite group. Each scenario is followed by a structured debriefing, providing opportunities for participants to share their learning from the scenarios. Simprovisation harnesses the principles of socially constructed learning and andragogy, encouraging learners to address their own learning requirements METHODS: We delivered Simprovisation to 62 participants ranging from fourth-year medical students to junior doctors. We conducted pre- and post-course questionnaire surveys and invited participants to focus groups to discuss their experiences.

RESULTS

Our feedback questionnaire shows 100% of 58 respondents found Simprovisation useful, and 95% were able to meet at least two out of three self-determined learning outcomes. Thematic analysis of focus group transcriptions showed that participants valued group-based work and setting their own learning objectives. They found writing simulation scenarios to be challenging, but a valuable source of learning, and reported being more engaged compared with previous simulation study days.

CONCLUSIONS

Simprovisation is an innovative style of simulation-based education that allows learners to effectively define and address their own learning needs.

How Educational Theory Can Inform the Training and Practice of Plastic Surgeons

It is important to optimize our current learning and teaching models, particularly in a climate of decreased clinical exposure. With technical advancements and clinical care now more accountable, traditional methods of skill acquisition need to be revisited. The past decade has seen changes in plastic surgery curricula. There has also been a shift toward competency-based training programs reflecting the growing emphasis on outcomes-based surgical education. This review explores the role of educational theory in promoting effective learning in practical skills teaching. Key models of educational theory are presented and their application to plastic surgery training to an expert level are highlighted. These models include (1) learning within communities of practice (Lave and Wenger’s theory); (2) the role of the zone of proximal development and importance of the availability of expert assistance (Vygotsky’s theory); (3) skill acquisition and retention (Dreyfus’ and Dreyfus’, and Fitts’ and Posner’s theories); (4) development of expertise after repeated practice and regular reinforcement (Ericsson’s theory); and (5) the assessment of competence (Miller’s triangle). Future plastic surgeons need to possess a thorough understanding of the technical and nontechnical skills required to manage patients effectively. Surgical educators are therefore compelled to develop practical training programs that can teach each of these skills in a safe, learner-centric manner. It is hoped that new approaches to surgical skills training are designed in light of our understanding of educational theory to optimize the training of the next generation of plastic surgeons.

Simulation-Based Mastery Learning of Flexible Bronchoscopy: Deciding Factors for Completion

BACKGROUND

Several studies have shown the beneficial effects of mastery learning of a simulation-based course, but not all trainees complete it.

OBJECTIVES

The purpose of this study was to find deciding factors for the completion of a simulation-based mastery learning course with distributive practice in flexible bronchoscopy.

METHODS

Seventy-seven trainees who signed up for the course were invited to a survey for deciding factors of completing the course. Sixty-two (81%) trainees answered the survey.

RESULTS

Male trainees were more likely to complete the course. The most important factor for completion was clinical relevance, and the most important factor for not completing the course was being "too busy."

CONCLUSION

Several deciding factors for completing the course were identified. Successful simulation-based mastery learning courses should be clinically relevant, and the trainees should be provided protected time to complete the training. The instructional design should also be adapted systematically for male and female trainees to achieve the necessary competencies.

A novel approach to assess clinical competence of postgraduate year 1 surgery residents

BACKGROUND

An increased demand for accountability and transparency in medicine have initiated a shift toward a more objective and standardized approach for postgraduate medical training.

OBJECTIVE

To develop and evaluate an objective method to assess clinical competence of postgraduate year 1 surgery residents.

DESIGN

Thirty-one postgraduate year 1 surgery residents, who had been trained in the Surgical School of Peking University First Hospital for one year, participated in an objective structured clinical examination as a final assessment of their clinical competence. A test station of irregular wound repair (debridement and suture) was specially designed to test the residents' surgical integrative competence in a complex-trauma treatment procedure. A modified global rating scale, in combination with wound area measurement, was applied to evaluate residents' surgical performance. The validity of the subjective global rating scale was evaluated by the objective measurement results from the software.

RESULTS

The global rating scale score had no obvious correlation with the area of the removed tissue and the residual wound area after the suture. There was significant difference in the debridement time and the residual wound area between 0-3 and >3 total stitches. There were significant differences in the area of the removed tissue between 0 and 1-2 grey stitches and 0 and 3-4 grey stitches, and in the residual wound area after suture between 0 and 3-4 grey stitches and 1-2 and 3-4 grey stitches.

CONCLUSIONS

An irregular wound repair procedure could be an effective method to assess the integrative competence of surgery residents. The training for surgical thinking in the early stage of junior residents needs to be strengthened. The entire measurement process was more complex and time-consuming than expected. The possibility of measurement by simply counting the numbers of the key spots might be explored in the future.

ABBREVIATIONS

ACS/APDS American College of Surgeons/Association of Program Directors in Surgery; GRS Global rating scale; LSD-T Least significant difference-test; OSATS Objective structured assessment of technical skills; OSCE Objective structured clinical examination; PBT Proficiency based training; PGY1 Postgraduate Year 1.

Is Teaching Simple Surgical Skills Using an Operant Learning Program More Effective Than Teaching by Demonstration?

BACKGROUND

A surgical procedure is a complex behavior that can be constructed from foundation or component behaviors. Both the component and the composite behaviors built from them are much more likely to recur if it they are reinforced (operant learning). Behaviors in humans have been successfully reinforced using the acoustic stimulus from a mechanical clicker, where the clicker serves as a conditioned reinforcer that communicates in a way that is language- and judgment-free; however, to our knowledge, the use of operant-learning principles has not been formally evaluated for acquisition of surgical skills.

QUESTIONS/PURPOSES

Two surgical tasks were taught and compared using two teaching strategies: (1) an operant learning methodology using a conditioned, acoustic reinforcer (a clicker) for positive reinforcement; and (2) a more classical approach using demonstration alone. Our goal was to determine whether a group that is taught a surgical skill using an operant learning procedure would more precisely perform that skill than a group that is taught by demonstration alone.

METHODS

Two specific behaviors, "tying the locking, sliding knot" and "making a low-angle drill hole," were taught to the 2014 Postgraduate Year (PGY)-1 class and first- and second-year medical students, using an operant learning procedure incorporating precise scripts along with acoustic feedback. The control groups, composed of PGY-1 and -2 nonorthopaedic surgical residents and first- and second-year medical students, were taught using demonstration alone. The precision and speed of each behavior was recorded for each individual by a single experienced surgeon, skilled in operant learning. The groups were then compared.

RESULTS

The operant learning group achieved better precision tying the locking, sliding knot than did the control group. Twelve of the 12 test group learners tied the knot and precisely performed all six component steps, whereas only four of the 12 control group learners tied the knot and correctly performed all six component steps (the test group median was 10 [range, 10-10], the control group median was 0 [range, 0-10], p = 0.004). However, the median "time to tie the first knot" for the test group was longer than for the control group (test group median 271 seconds [range, 184-626 seconds], control group median 163 seconds [range 93-900 seconds], p = 0.017), whereas the "time to tie 10 of the locking, sliding knots" was the same for both groups (test group mean 95 seconds ± SD = 15 [range, 67-120 seconds], control group mean 95 seconds ± SD = 28 [range, 62-139 seconds], p = 0.996). For the low-angle drill hole test, the test group more consistently achieved the ideal six-step behavior for precisely drilling the low-angle hole compared with the control group (p = 0.006 for the median number of technique success comparison with an odds ratio [at the 95% confidence interval] of 82.3 [29.1-232.8]). The mean time to drill 10 low-angle holes was not different between the test group (mean 193 seconds ± SD = 26 [range, 153-222 seconds]) and the control group (mean 146 seconds ± SD = 63 [range, 114-294 seconds]) (p = 0.084).

CONCLUSIONS

Operant learning occurs as the behavior is constructed and is highly reinforced with the result measured, not in the time saved, but in the ultimate outcome of an accurately built complex behavior.

LEVEL OF EVIDENCE

Level II, therapeutic study.