Ventilation tube insertion simulation: a literature review and validity assessment of five training models

Gathering validity evidence for a 3D-printed simulator for training of myringotomy and ventilation tube insertion

Objectives

This study aimed to gather validity evidence according to Messick's framework for a novel 3D-printed simulator for myringotomy with ventilation tube insertion for use in technical skills training of otorhinolaryngology (ORL) residents.

Methods

The study included 15 junior ORL residents (trainees) and 13 experienced teaching otolaryngologists (experts). Experts and trainees first received an identically structured introduction to the procedure, simulator, and simulation setup. Five procedures performed by each participant were video-recorded and ordered randomly for blinded rating by two independent raters. The rating tools used were a global rating scale (GBRS) and a task-specific checklist. Validity evidence was collected according to Messick's framework. Differences in time consumption and performance scores were analyzed. Finally, a pass/fail standard was established using the contrasting groups' method.

Results

Trainees used significantly more time per procedure (109 s, 95% CI: 99-120) than experts (82 s, 95% CI: 71-93; p < .001). Adjusted for repetition and rater leniency, experts achieved an average GBRS score of 18.8 (95% CI: 18.3-19.2) out of 20 points, whereas trainees achieved an average of 17.1 points (95% CI: 16.6-17.5; p < .001). In contrast to the task-specific checklist, the GBRS score discriminated between repetition number and participant experience. The pass/fail standard for the GBRS was established at 18.4 points.

Conclusion

We established educational validity evidence for a novel 3D-printed model for simulation-based training of ventilation tube insertion and established a reliable pass/fail standard.

Level of Evidence

1b.

A novel approach to myringotomy simulation

Objective

In the wake of the 2019 coronavirus disease pandemic, elective cases and opportunities for clinical application have decreased, and the need for useful simulation models has become more apparent for developing surgical skills. A novel myringotomy with ventilatory tube insertion simulation model was created.

Methods

Residents across all levels at our institution participated in the simulation. Participants were evaluated in terms of: time of procedure, microscope positioning, cerumen removal, identification of middle ear effusion type, canal wall trauma, tympanic membrane damage and tube placement.

Results

Eleven residents participated. Scores ranged from 14 to 34, out of a maximum of 40. The average score among junior and senior residents was 24 and 31, respectively. The simulation was felt to be representative of the operating theatre experience.

Conclusion

This study demonstrates a low-cost simulation model that captures several important, nuanced aspects of myringotomy with tube insertion, often overlooked in previously reported simulations.

Current Evidence for Simulation-Based Training and Assessment of Myringotomy and Ventilation Tube Insertion: A Systematic Review

OBJECTIVE

Myringotomy and ventilation tube insertion (MT) is a key procedure in otorhinolaryngology and can be trained using simulation models. We aimed to systematically review the literature on models for simulation-based training and assessment of MT and supporting educational evidence.

DATABASES REVIEWED

PubMed, Embase, Cochrane Library, Web of Science, Directory of Open Access Journals.

METHODS

Inclusion criteria were MT training and/or skills assessment using all types of training modalities and learners. Studies were divided into 1) descriptive and 2) educational interventional/observational in the analysis. For descriptive studies, we provide an overview of available models including materials and cost. Educational studies were appraised using Kirkpatrick's level of educational outcomes, Messick's framework of validity, and a structured quality assessment tool.

RESULTS

Forty-six studies were included consisting of 21 descriptive studies and 25 educational studies. Thirty-one unique physical and three virtual reality simulation models were identified. The studies report moderate to high realism of the different simulators and trainees and educators perceive them beneficial in training MT skills. Overall, simulation-based training is found to reduce procedure time and errors, and increase performance as measured using different assessment tools. None of the studies used a contemporary validity framework and the current educational evidence is limited.

CONCLUSION

Numerous simulation models and assessment tools have been described in the literature but educational evidence and systematic implementation into training curricula is scarce. There is especially a need to establish the effect of simulation-based training of MT in transfer to the operating room and on patient outcomes.

Investigating the learning curve in endoscopic compared to microscopic myringotomy and ventilation tube insertion

OBJECTIVE

Rate of learning is often cited as a deterrent in the use of endoscopic ear surgery. This study investigated the learning curves of novice surgeons performing simulated ear surgery using either an endoscope or a microscope.

METHODS

A prospective multi-site clinical research study was conducted. Seventy-two medical students were randomly allocated to the endoscope or microscope group, and performed 10 myringotomy and ventilation tube insertions. Trial times were used to produce learning curves. From these, slope (learning rate) and asymptote (optimal proficiency) were ascertained.

RESULTS

There was no significant difference between the learning curves (p = 0.41). The learning rate value was 68.62 for the microscope group and 78.71 for the endoscope group. The optimal proficiency (seconds) was 32.83 for the microscope group and 27.87 for the endoscope group.

CONCLUSION

The absence of a significant difference shows that the learning rates of each technique are statistically indistinguishable. This suggests that surgeons are not justified when citing 'steep learning curve' in arguments against the use of endoscopes in middle-ear surgery.

Low cost, easy-to-replicate myringotomy tube insertion simulation model

INTRODUCTION

Simulation is an established part of modern surgical education. Several training centers have proposed different simulation models for myringotomy tube (MT) placement and validated their effectiveness in medical student and resident training. None is widely used. Early models were simple tubes that lacked important microsurgical elements. Newer simulators are more comprehensive, but are difficult and expensive to build. We present a MT placement simulator that is low cost, easy to construct with basic power tools and allows for acquisition of the most necessary MT placement skills.

METHODS

The model incudes a rotating spherical "head", a 4 mm oval speculum, a drilled-out working shaft similar in size to the external auditory canal, and a realistic paper tympanic membrane target, set at an anatomically correct angle. To evaluate the model's efficacy, we assessed the performance of 10 surgically naïve medical student volunteers before training and after 30 min of instruction with the model. Their speed was recorded and operative performance was assessed using a validated Global Rating Scale.

RESULTS

After 30 min of practice on the model, there was significant improvement in MT placement skill scores and significant decrease in time for tube placement (p < 0.05).

CONCLUSION

This MT placement simulation model is inexpensive and easy to build. Unlike existing planar models, it simulates patient head orientation, and requires realistic hand positioning on a 4 mm speculum. Practice with the model for 30 min resulted in statistically significant improvement in MT placement skill scores for inexperienced student surgeons.

Creating a Validated Simulation Training Curriculum in Otolaryngology

Purpose of Review

Simulation-based training is an integral component of surgical training. It allows practice of technical skills within a safe environment without compromising patient safety. This article seeks to review current virtual and non-virtual reality simulation models within the literature and review their validation status.

Recent Findings

Many simulation models exist within otolaryngology and are currently being used for education. New models are also continuously being developed; however, validity should be proven for the models before incorporating their use for educational purposes. Validity should be determined by experts and trainees themselves.

Summary

A validated simulation curriculum should be incorporated within the otolaryngology training programme. A curriculum based on the current training programme at our institution serves as an exemplar for local adoption.

Optimal Timing of Entry-Level Otolaryngology Simulation

Objective

Appropriate timing of subspecialty simulation is critical to maximize learner benefit and guide resource utilization. We aimed to determine optimal timing of a simulation-based curriculum designed to teach entry-level procedural skills for otolaryngology residency.

Study Design

Simulation curriculum intervention tested among 3 comparison groups of varying clinical levels.

Setting

Academic otolaryngology training program and medical school.

Subjects and Methods

We developed a simulation-based technical skills curriculum incorporating the following task trainers: flexible laryngoscopy, peritonsillar abscess drainage, and myringotomy and tube insertion. Preclinical medical students (n = 40), subintern rotators (n = 35), and midyear interns (n = 8) completed the simulation-based curriculum. Pre- and postintervention knowledge/confidence and “level appropriateness” were rated on a 5-point Likert scale, and effect size was calculated.

Results

Overall self-reported knowledge/confidence levels improved in all 3 groups preintervention (1.05, 2.15, 3.17) to postintervention (2.79, 3.45, 4.38, respectively; all P < .01). Preclinical medical students uniformly reported very little to no familiarity with the procedures prior to the curriculum, while interns approached independence following the intervention. Large effect sizes were seen in all tasks for preclinical students (d = 3.13), subinterns (d = 1.46), and interns (d = 2.14). Five-point Likert scale measures of level appropriateness (1 = too challenging, 5 = too easy) for preclinical students, subinterns, and interns were 2.70 (95% CI, 2.56-2.84), 3.11 (95% CI, 2.97-3.25), and 3.75 (95% CI, 3.35-4.15), respectively.

Conclusion

Subinternship may represent the optimal timing for entry-level skills simulation training. The proposed curriculum shows utility for clinical levels ranging from medical students to postgraduate year 1 resident levels, with large effect sizes for all tested groups.