McConnell RA, Kim S, Ahmad NA, Falk GW, Forde KA, Ginsberg GG, Jaffe DL, Makar GA, Long WB, Panganamamula KV, Kochman ML. Poor discriminatory function for endoscopic skills on a computer-based simulator.
Gastrointest Endosc 2012;
76:993-1002. [PMID:
22968094 DOI:
10.1016/j.gie.2012.07.024]
[Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/16/2012] [Accepted: 07/12/2012] [Indexed: 01/06/2023]
Abstract
BACKGROUND
Computer-based endoscopy simulators may enable trainees to learn and develop technical skills before performing on patients. Simulators require validation as adequate models of live endoscopy before being used for training or assessment purposes.
OBJECTIVE
To evaluate content and criterion validity of the CAE EndoscopyVR Simulator colonoscopy and EGD modules as predictors of clinical endoscopic skills.
DESIGN
Prospective, observational, non-randomized, parallel cohort study.
SETTING
Single academic center with accredited gastroenterology training program.
PARTICIPANTS
Five novice first-year gastroenterology fellows and 6 expert gastroenterology attending physicians.
INTERVENTION
Participants performed 18 simulated colonoscopies and 6 simulated EGDs. The simulator recorded objective performance parameters. Participants then completed feedback surveys.
MAIN OUTCOME MEASUREMENTS
The 57 objective performance parameters measured by the endoscopy simulator were compared between the two study groups. Novice and expert survey responses were analyzed.
RESULTS
Significant differences between novice and expert performance were detected in only 19 of 57 (33%) performance metrics. Eight of these 19 (42%) were time-related metrics, such as total procedure time, time to anatomic landmarks, and time spent in contact with GI mucosa. Of 49 non-time related measures, the few additional statistically significant differences between novices and experts involved air insufflation, sedation management, endoscope force, and patient comfort. These findings are of uncertain clinical significance. Survey data found multiple aspects of the simulation to be unrealistic compared with human endoscopy.
LIMITATIONS
Small sample size.
CONCLUSION
The CAE EndoscopyVR Simulator displays poor content and criterion validity and is thereby incapable of predicting skill during in vivo endoscopy.
Collapse