Gathering validity evidence for a 3D-printed simulator for training of myringotomy and ventilation tube insertion

Objectives

This study aimed to gather validity evidence according to Messick's framework for a novel 3D-printed simulator for myringotomy with ventilation tube insertion for use in technical skills training of otorhinolaryngology (ORL) residents.

Methods

The study included 15 junior ORL residents (trainees) and 13 experienced teaching otolaryngologists (experts). Experts and trainees first received an identically structured introduction to the procedure, simulator, and simulation setup. Five procedures performed by each participant were video-recorded and ordered randomly for blinded rating by two independent raters. The rating tools used were a global rating scale (GBRS) and a task-specific checklist. Validity evidence was collected according to Messick's framework. Differences in time consumption and performance scores were analyzed. Finally, a pass/fail standard was established using the contrasting groups' method.

Results

Trainees used significantly more time per procedure (109 s, 95% CI: 99-120) than experts (82 s, 95% CI: 71-93; p < .001). Adjusted for repetition and rater leniency, experts achieved an average GBRS score of 18.8 (95% CI: 18.3-19.2) out of 20 points, whereas trainees achieved an average of 17.1 points (95% CI: 16.6-17.5; p < .001). In contrast to the task-specific checklist, the GBRS score discriminated between repetition number and participant experience. The pass/fail standard for the GBRS was established at 18.4 points.

Conclusion

We established educational validity evidence for a novel 3D-printed model for simulation-based training of ventilation tube insertion and established a reliable pass/fail standard.

Level of Evidence

1b.

A three-dimensionally printed otological model for cholesteatoma mastoidectomy training

PURPOSE

To relate the creation and expert validation (face and content validity) of an affordable three-dimensional (3-D) printed model of temporal bones with chronic otitis media with cholesteatoma (COMC) as a simulator for mastoidectomy.

METHODS

We performed computed tomography (CT) of the temporal bones of a patient with COMC followed at the University of São Paulo (USP) Hospital with 3-D Slicer to create a 3-D model of the affected bone using light-curing resin and silicone (cholesteatoma). The final 3-D printed images were scored by 10 otologists using a customized version of the Michigan Standard Simulation Scale Experience (MiSSES). Internal consistency and inter-rater reliability were assessed using Cronbach's α and intraclass correlations.

RESULTS

Otologists consistently scored the model positively for fidelity, educational value, reactions, and the overall model quality. Nine otologists agreed that the model was a good educational device for surgical training of COMC. All experts deemed the model ready-or nearly ready-for use. The final cost of the model, including raw materials and manufacturing, was 120 USD.

CONCLUSIONS

Using 3-D printing technology, we created the first anatomically accurate, low-cost, disease-reproducing 3-D model of temporal bones for mastoidectomy training for cholesteatoma.

Thinking Beyond the Temporal Bone Lab: A Systematic Process for Expanding Surgical Simulation in Otolaryngology Training

The COVID-19 pandemic led to a temporary lapse in the development of otolaryngology trainee operative skills due to the cancellation of elective procedures and redeployment of trainees and attendings to COVID-19 units. Although transient, this disruption provided an opportunity for otolaryngology programs to develop contingency plans and formalize nascent simulation training curricula. Integration of formal simulation training alongside current didactic and surgical education may offset lost exposure during surgically lean times while providing the framework and resources for enhanced baseline training. Here, we provide an up-to-date overview of surgical simulation models in otolaryngology and identify easily implementable, low-cost, low fidelity models for junior trainees. By taking advantage of rapid advancements in technology and a paradigm shift to a more hands-on approach in medical education, formal simulation training may prove to be a beneficial tool at all stages of residency training, allowing for expanded peer-mentored skill development and providing a safe haven during unforeseen disruptions in surgical case volume.

Current Evidence for Simulation-Based Training and Assessment of Myringotomy and Ventilation Tube Insertion: A Systematic Review

OBJECTIVE

Myringotomy and ventilation tube insertion (MT) is a key procedure in otorhinolaryngology and can be trained using simulation models. We aimed to systematically review the literature on models for simulation-based training and assessment of MT and supporting educational evidence.

DATABASES REVIEWED

PubMed, Embase, Cochrane Library, Web of Science, Directory of Open Access Journals.

METHODS

Inclusion criteria were MT training and/or skills assessment using all types of training modalities and learners. Studies were divided into 1) descriptive and 2) educational interventional/observational in the analysis. For descriptive studies, we provide an overview of available models including materials and cost. Educational studies were appraised using Kirkpatrick's level of educational outcomes, Messick's framework of validity, and a structured quality assessment tool.

RESULTS

Forty-six studies were included consisting of 21 descriptive studies and 25 educational studies. Thirty-one unique physical and three virtual reality simulation models were identified. The studies report moderate to high realism of the different simulators and trainees and educators perceive them beneficial in training MT skills. Overall, simulation-based training is found to reduce procedure time and errors, and increase performance as measured using different assessment tools. None of the studies used a contemporary validity framework and the current educational evidence is limited.

CONCLUSION

Numerous simulation models and assessment tools have been described in the literature but educational evidence and systematic implementation into training curricula is scarce. There is especially a need to establish the effect of simulation-based training of MT in transfer to the operating room and on patient outcomes.

Three-dimensional printing in otolaryngology education: a systematic review

PURPOSE

The progressive expansion of the technology that facilitates the development of three-dimensional (3D) printing within the field of otorhinolaryngology has opened up a new study front in medicine. The objective of this study is to systematically review scientific publications describing the development of 3D models having applications in otorhinolaryngology, with emphasis on subareas with a large number of publications, as well as the countries in which the publications are concentrated.

METHODS

In this literature review, specific criteria were used to search for publications on 3D models. The review considered articles published in English on the development of 3D models to teach otorhinolaryngology. The studies with presurgical purposes or without validation of the task by surgeons were excluded from this review.

RESULTS

This review considered 39 articles published in 10 countries between 2012 and 2021. The works published prior to 2012 were not considered as per the inclusion criteria for the research. Among the 39 simulators selected for review, otology models comprised a total of 15 publications (38%); they were followed by rhinology, with 12 (31%); laryngology, with 8 (21%); and head and neck surgery, with 4 publications (10%).

CONCLUSION

The use of 3D technology and printing is well established in the context of surgical education and simulation models. The importance of developing new technological tools to enhance 3D printing and the current limitations in obtaining appropriate animal and cadaver models signify the necessity of investing more in 3D models.

A three-dimensional printed myringotomy, tympanostomy and ventilation tube placement simulator

OBJECTIVE

Tympanostomy is one of the most commonly performed surgical procedures in otolaryngology, and its complexity is challenging for trainee surgeons. Investing in medical education is a cornerstone of good patient safety practices. For trainees, use of simulators before operating on actual patients helps mitigate risks. This study aimed to develop a three-dimensional printed model simulator for myringotomy, tympanostomy and ventilation tube placement.

METHODS

An articulated model with a detachable portion, base and plastic bag to simulate the external auditory canal, middle ear and tympanic membrane, respectively, was modelled and printed.

RESULTS

The final simulator was made from acrylonitrile butadiene styrene polymer and measured 4 × 4 × 12 cm. It was designed to mimic the angulation of patient anatomy in the myringotomy position and simulate the texture and colour of the tissues of interest. The cost was low, and testing with an operating microscope and endoscope yielded satisfactory results. The advent of three-dimensional printing technology has made surgical simulation more accessible and less expensive, providing several advantages for medical education.

CONCLUSION

The proposed model fulfilled expectations as a safe, inexpensive, reproducible, user-friendly and accessible surgical education tool that can be improved and reassessed for further research.