Assessment of Screening Colonoscopy Competency in Colon and Rectal Surgery Fellows: A Single Institution Experience

Two-Person Colonoscopy as a Training Approach to Non-sedation Colonoscopy

BACKGROUND

Reported learning curves of colonoscopy vary from 94 to 275 cases and focus on one-person colonoscopy. Our aim was to evaluate the learning curve of two-person non-sedation colonoscopy for trainees in a single tertiary care hospital.

PATIENTS AND METHODS

We conducted a retrospective study in 1264 patients who underwent diagnostic or screening colonoscopies in a single institution from August 2012 to January 2013. Most of the patients (1174/1264) did not receive sedation during the procedure. All procedures were performed under two-person control. Two third-year residents who received previous colonoscopic training via a plastic model were the trainees.

RESULTS

In comparison to the performance of 5 staff members, the colonoscopic outcomes showed no significant differences in the completion rates (77.2% vs. 79.8%, P = .382), average polyp numbers (.9 ± 1.7 vs. 1.0 ± 1.8, P = .453), polyp detection rates (43.5% vs. 46.3%, P = .434), or intubation lengths (96.4 ± 29.3 vs. 96.3 ± 26.7 cm, P = .939). The total procedure times for the 2 groups were 17.2 ± 10.6 minutes (trainees) and 12.9 ± 7.8 minutes (staff) (P < .001).

CONCLUSION

Trainees achieved acceptable outcomes over an 81-97 case learning curve under a two-person non-sedation colonoscopy technique, an approach with potential as a transition to single-operator colonoscopy.

Colorectal Surgery Resident Participation in Screening Colonoscopies: How Does It Impact Quality?

BACKGROUND

Performing colonoscopies is an integral component of colorectal surgery residency training. There exists a paucity of literature regarding colonoscopy quality metrics with colorectal trainee involvement.

OBJECTIVE

This study aimed to investigate the effect of colorectal surgery resident participation on quality metrics in screening colonoscopy.

DESIGN

Screening colonoscopies performed between August 1, 2016, and July 31, 2018, were queried from a prospectively maintained institutional database. Data were cross-checked with resident case logs to verify colonoscopies with resident participation.

SETTING

This study was conducted by the colorectal surgery department at a tertiary level hospital in the United States.

PATIENTS

Consecutive, asymptomatic patients aged ≥45 years, undergoing screening colonoscopy, were selected.

MAIN OUTCOME MEASURES

The quality parameters measured included overall, male, and female adenoma detection rates; total examination time; withdrawal time; cecal intubation rate; quality of bowel preparation; complications; and medication dosage.

RESULTS

A total of 4594 patients were included in the study with a mean age of 60.5 ± 8.4 years (range, 45-91); 51.7% were women. Overall, 4186 of the colonoscopies were performed without resident participation, and 408 were performed with resident participation. Scope insertion, withdrawal, and total examination times were longer in the resident group. Cecal intubation rate, polypectomy rate, sex-specific and overall adenoma detection rates, and complication rates were similar between the groups. In the multivariate model, trainee involvement had no significant impact on adenoma detection rate. In addition, the trainee group utilized a higher mean dose of fentanyl.

LIMITATIONS

The retrospective nature of the data with possible coding errors of the database and the inability to quantify the amount of resident participation and to clarify the degree of attending surgeon assistance and oversight were limitations of the study.

CONCLUSIONS

Colorectal surgery resident participation in screening colonoscopy takes longer and appears safe, while achieving all national quality metrics without compromising adenoma detection rates. Changes in colonoscopy scheduling in regard to length of time may prove beneficial when there is resident participation. See Video Abstract at http://links.lww.com/DCR/B43. PARTICIPACIÓN DE LOS RESIDENTES DE CIRUGÍA COLORRECTAL EN COLONOSCOPIAS DE CRIBADO: ¿CÓMO AFECTA LA CALIDAD?: La realización de colonoscopias es un componente integral del entrenamiento de residencia en cirugía colorrectal. Existe una escasez de literatura con respecto a las medidas de calidad de la colonoscopia con la participación de los aprendices colorrectales.Investigar el efecto de la participación de residentes de cirugía colorrectal en las medidas de calidad en la colonoscopia de cribado.Las colonoscopias de cribado realizadas entre el 1 de agosto de 2016 y el 31 de julio de 2018 se consultaron desde una base de datos institucional mantenida prospectivamente. Los datos se cotejaron con registros de casos de residentes para verificar las colonoscopias con participación de residentes.Departamento de cirugía colorrectal en un hospital de tercer nivel de los Estados Unidos.Pacientes consecutivos, asintomáticos, edad ≥45 años, sometidos a colonoscopia de detección.Parámetros de calidad que incluyen tasas generales de detección de adenoma en hombres y mujeres, tiempo total de examen, tiempo de retiro, tasa de intubación cecal, calidad de la preparación intestinal, complicaciones y dosis de medicamentos.Se incluyeron un total de 4.594 pacientes en el estudio con una edad media de 60,5 ± 8,4 años (rango, 45-91) y 51,7% mujeres. En total 4,186 de las colonoscopias se realizaron sin participación de los residentes y 408 se realizaron con la participación de los residentes. Los tiempos de inserción, retiro y examen total del alcance fueron más largos en el grupo residentes. La tasa de intubación cecal, la tasa de polipectomía, las tasas de detección de adenoma específicos de género y generales, y las tasas de complicaciones fueron similares entre los grupos. En el modelo multivariado, la participación de los aprendices no tuvo un impacto significativo en la tasa de detección de adenoma. Además, el grupo de aprendices utilizó una dosis media más alta de fentanilo.Carácter retrospectivo de los datos con posibles errores de codificación de la base de datos. Incapacidad para cuantificar la cantidad de participación de los residentes y para aclarar el grado de asistencia y supervisión del cirujano.La participación de los residentes de cirugía colorrectal en la colonoscopia de cribado lleva más tiempo y parece segura, mientras se logran todas las medidas de calidad nacionales sin comprometer las tasas de detección de adenoma. Los cambios en la programación de la colonoscopia con respecto al período de tiempo pueden ser beneficiosos cuando hay participación de residentes. Vea el resumen del video en http://links.lww.com/DCR/B43.

Variability in cecal intubation rate by calculation method: a call for standardization of key performance indicators in endoscopy

BACKGROUND AND AIMS

The cecal intubation rate (CIR) is a widely accepted key performance indicator (KPI) in colonoscopy but lacks a universal calculation method. We aimed to assess whether differences in CIR calculation methods could have an impact on perceived trainee outcomes.

METHODS

A systematic review of CIR calculation methods was conducted on major societal guidelines (United Kingdom, European Society of Gastrointestinal Endoscopy [ESGE] and American Society for Gastrointestinal Endoscopy [ASGE]) and trainee-inclusive studies. Trainees awarded colonoscopy certification between June 2011 and 2016 were identified from the United Kingdom e-portfolio and selected as a validation cohort. For each trainee, both the crude and unassisted CIR were calculated for 50 post-certification procedures using definitions from the 3 international guidelines. The resulting CIRs, and the proportions of endoscopists failing to meet the minimum standard of CIR ≥90%, were then compared across these definitions.

RESULTS

Across the 3 guidelines and 37 eligible studies identified, differences in CIR calculation methodology were demonstrated. These related to adjustment criteria (18 studies) and whether unassisted CIR was stipulated (18 studies). In the validation cohort of 733 trainees (36,650 procedures), the median crude CIR ranged from 96% (ESGE) to 98% (ASGE) (P < .001) and whether unassisted CIR was specified (ESGE, 94%; ASGE, 96%; P < .001). The proportion of trainees failing to achieve CIR ≥90% varied significantly across the different definitions, from 4.9% for the crude ASGE definition to 18.6% for the unassisted ESGE definition (P < .001).

CONCLUSIONS

CIR calculation methods vary among guidelines and research studies; this has an impact on trainee performance measures. With CIR used as an example, this study highlights the need for standardized definitions and calculations of KPIs in endoscopy.

Who Performs Colonoscopy? Workforce Trends Over Space and Time

PURPOSE

With the increased availability of colonoscopy to average risk persons due to insurance coverage benefit changes, we sought to identify changes in the colonoscopy workforce. We used outpatient discharge records from South Carolina between 2001 and 2010 to examine shifts over time and in urban versus rural areas in the types of medical providers who perform colonoscopy, and the practice settings in which they occur, and to explore variation in colonoscopy volume across facility and provider types.

METHODS

Using an all-payer outpatient discharge records database from South Carolina, we conducted a retrospective analysis of all colonoscopy procedures performed between 2001 and 2010.

FINDINGS

We identified a major shift in the type of facilities performing colonoscopy in South Carolina since 2001, with substantial gains in ambulatory surgery settings (2001: 15, 2010: 34, +127%) versus hospitals (2001: 58, 2010: 59, +2%), particularly in urban areas (2001: 12, 2010: 27, +125%). The number of internists (2001: 46, 2010: 76) and family physicians (2001: 34, 2010: 106) performing colonoscopies also increased (+65% and +212%, respectively), while their annual procedures volumes stayed fairly constant. Significant variation in annual colonoscopy volume was observed across medical specialties (P < .001), with nongastroenterologists having lower volumes versus gastroenterologists and colon and rectal surgeons.

CONCLUSIONS

There have been substantial changes over time in the number of facilities and physicians performing colonoscopy in South Carolina since 2001, particularly in urban counties. Findings suggest nongastroenterologists are meeting a need for colonoscopies in rural areas.

Assessing Resident Surgical Volume Before and After Initiation of a Female Pelvic Medicine and Reconstructive Surgery Fellowship

OBJECTIVES

The effect of fellowship programs on resident training for gynecologic surgery volume has not been clearly defined. The purpose of our study is to assess resident surgical volume for laparoscopic and vaginal hysterectomy before and after initiation of a female pelvic medicine and reconstructive surgery (FPMRS) fellowship.

DESIGN

A retrospective review of Accreditation Council for Graduate Medical Education Resident Case Logs of obstetrics and gynecology residents who graduated in the 3 years before and after initiation of a FPMRS fellowship was performed. Mean values of vaginal and laparoscopic hysterectomies were compared using two-tailed t-tests with statistical significance set at p < 0.05.

SETTING

Obstetrics and gynecology resident case logs at the Ronald Reagan University of California Los Angeles (UCLA) Medical Center were assessed. The UCLA Medical Center, located in Los Angeles, CA, is a tertiary referral center with a graduating class of 7 obstetrics and gynecology residents yearly.

PARTICIPANTS

Obstetrics and gynecology residents who graduated from residency 3 years before and after imitation of a FPMRS fellowship were included. In the 3 years before the start of the fellowship, 20 residents graduated, whereas 21 residents graduated after the start of the fellowship.

RESULTS

Residents who graduated in the 3 years after the start of the FPMRS fellowship, finished with 4.6 less vaginal hysterectomies compared with residents who graduated before the fellowship (p = 0.022). Residents who graduated in the 3 years after the start of the FPMRS fellowship finished with 3.2 more laparoscopic hysterectomies compared with residents who graduated before the fellowship although this was not significant (p = 0.25).

CONCLUSIONS

Resident surgical volume was significantly decreased for vaginal hysterectomy after the initiation of a FPMRS fellowship, whereas laparoscopic hysterectomy volume was not significantly changed. Longer follow-up and a national assessment are necessary to determine the broader effect of fellowship training on resident surgical experience.

Training and competence assessment in GI endoscopy: a systematic review

INTRODUCTION

Training procedural skills in GI endoscopy once focused on threshold numbers. As threshold numbers poorly reflect individual competence, the focus gradually shifts towards a more individual approach. Tools to assess and document individual learning progress are being developed and incorporated in dedicated training curricula. However, there is a lack of consensus and training guidelines differ worldwide, which reflects uncertainties on optimal set-up of a training programme.

AIMS

The primary aim of this systematic review was to evaluate the currently available literature for the use of training and assessment methods in GI endoscopy. Second, we aimed to identify the role of simulator-based training as well as the value of continuous competence assessment in patient-based training. Third, we aimed to propose a structured training curriculum based on the presented evidence.

METHODS

A literature search was carried out in the available medical and educational literature databases. The results were systematically reviewed and studies were included using a predefined protocol with independent assessment by two reviewers and a final consensus round.

RESULTS

The literature search yielded 5846 studies. Ninety-four relevant studies on simulators, assessment methods, learning curves and training programmes for GI endoscopy met the inclusion criteria. Twenty-seven studies on simulator validation were included. Good validity was demonstrated for four simulators. Twenty-three studies reported on simulator training and learning curves, including 17 randomised control trials. Increased performance on a virtual reality (VR) simulator was shown in all studies. Improved performance in patient-based assessment was demonstrated in 14 studies. Four studies reported on the use of simulators for assessment of competence levels. Current simulators lack the discriminative power to determine competence levels in patient-based endoscopy. Eight out of 14 studies on colonoscopy, endoscopic retrograde cholangiopancreatography and endosonography reported on learning curves in patient-based endoscopy and proved the value of this approach for measuring performance. Ten studies explored the numbers needed to gain competence, but the proposed thresholds varied widely between them. Five out of nine studies describing the development and evaluation of assessment tools for GI endoscopy provided insight into the performance of endoscopists. Five out of seven studies proved that intense training programmes result in good performance.

CONCLUSIONS

The use of validated VR simulators in the early training setting accelerates the learning of practical skills. Learning curves are valuable for the continuous assessment of performance and are more relevant than threshold numbers. Future research will strengthen these conclusions by evaluating simulation-based as well as patient-based training in GI endoscopy. A complete curriculum with the assessment of competence throughout training needs to be developed for all GI endoscopy procedures.

Competency Testing for Pediatric Cardiology Fellows Learning Transthoracic Echocardiography: Implementation, Fellow Experience, and Lessons Learned

There is currently great interest in measuring trainee competency at all levels of medical education. In 2007, we implemented a system for assessing cardiology fellows' progress in attaining imaging skills. This paradigm could be adapted for use by other cardiology programs.

METHODS

Evaluation consisted of a two-part exercise performed after years 1 and 2 of pediatric cardiology training. Part 1: a directly observed evaluation of technical skills as fellows imaged a normal subject (year 1) and a patient with complex heart disease (year 2). Part 2: fellows interpreted and wrote reports for two echocardiograms illustrating congenital heart disease. These were graded for accuracy and facility with communicating pertinent data. After 5 years of testing, fellows were surveyed about their experience. In 5 years, 40 fellows were tested at least once. Testing identified four fellows who underperformed on the technical portion and four on the interpretive portion. Surveys were completed by 33 fellows (83 %). Most (67 %) felt that intermittent observation by faculty was inadequate for assessing skills and that procedural volume was a poor surrogate for competency (58 %). Posttest feedback was constructive and valuable for 90, and 70 % felt the process helped them set goals for skill improvement. Overall, fellows felt this testing was fair and should continue. Fellow performance and responses identified programmatic issues that were creating barriers to learning. We describe a practical test to assess competency for cardiology fellows learning echocardiography. This paradigm is feasible, has excellent acceptance among trainees, and identifies trainees who need support. Materials developed could be easily adapted to help track upcoming ACGME-mandated metrics.

An analysis of the learning curve to achieve competency at colonoscopy using the JETS database

OBJECTIVE

The number of colonoscopies required to reach competency is not well established. The primary aim of this study was to determine the number of colonoscopies trainees need to perform to attain competency, defined by a caecal intubation rate (CIR) ≥90%. As competency depends on completion, we also investigated trainee factors that were associated with colonoscopy completion.

DESIGN

The Joint Advisory Group on GI Endoscopy in the UK has developed a trainee e-portfolio from which colonoscopy data were retrieved. Inclusion criteria were all trainees who had performed a total of ≥20 colonoscopies and had performed ≤50 colonoscopies prior to submission of data to the e-portfolio. The primary outcome measure was colonoscopy completion. The number of colonoscopies required to achieve CIR ≥90% was calculated by the moving average method and learning curve cumulative summation (LC-Cusum) analysis. To determine factors which determine colonoscopy completion, a mixed effect logistic regression model was developed which allowed for nesting of patients within trainees and nesting of patients within hospitals, with various patient, trainee and training factors entered as fixed effects.

RESULTS

297 trainees undertook 36 730 colonoscopies. By moving average analysis, the cohort of trainees reached a CIR of 90% at 233 procedures. By LC-Cusum analysis, 41% of trainees were competent after 200 procedures. Of the trainee factors, the number of colonoscopies, intensity of training and previous flexible sigmoidoscopy experience were significant factors associated with colonoscopy completion.

CONCLUSIONS

This is the largest study to date investigating the number of procedures required to achieve competency in colonoscopy. The current training certification benchmark in the UK of 200 procedures does not appear to be an inappropriate minimum requirement. The LC-Cusum chart provides real time feedback on individual learning curves for trainees. The association of training intensity and flexible sigmoidoscopy experience with colonoscopy completion could be exploited in training programmes.

Training and teaching innovations in colonoscopy

Optimization of training and teaching methods in colonoscopy at all levels of experience is critical to ensure consistent high-quality procedures in practice. Competency in colonoscopy may not be achieved until more than 250 colonoscopies are performed by trainees. Such tools as computer-based endoscopic simulators can aid in accelerating the early phases of training in colonoscopy, and magnetic endoscopic imaging technology can guide the position of the colonoscope and aid with loop reduction. Periodic feedback and retraining experienced endoscopists can improve the detection of colonic lesions.