The assessment of endosonographers in training

UK and Ireland Joint Advisory Group (JAG) consensus statements for training and certification in diagnostic endoscopic ultrasound (EUS)

BACKGROUND AND AIMS

International endoscopy societies vary in their approach for credentialing individuals in endoscopic ultrasound (EUS) to enable independent practice; however, there is no consensus in this or its implementation. In 2019, the Joint Advisory Group on GI Endoscopy (JAG) commissioned a working group to examine the evidence relating to this process for EUS. The aim of this was to develop evidence-based recommendations for EUS training and certification in the UK.

METHODS

Under the oversight of the JAG quality assurance team, a modified Delphi process was conducted which included major stakeholders from the UK and Ireland. A formal literature review was made, initial questions for study were proposed and recommendations for training and certification in EUS were formulated after a rigorous assessment using the Grading of Recommendation Assessment, Development and Evaluation tool and subjected to electronic voting to identify accepted statements. These were peer reviewed by JAG and relevant stakeholder societies before consensus on the final EUS certification pathway was achieved.

RESULTS

39 initial questions were proposed of which 33 were deemed worthy of assessment and finally formed the key recommendations. The statements covered four key domains, such as: definition of competence (13 statements), acquisition of competence (10), assessment of competence (5) and postcertification mentorship (5). Key recommendations include: (1) minimum of 250 hands-on cases before an assessment for competency can be made, (2) attendance at the JAG basic EUS course, (3) completing a minimum of one formative direct observation of procedural skills (DOPS) every 10 cases to allow the learning curve in EUS training to be adequately studied, (4) competent performance in summative DOPS assessments and (5) a period of mentorship over a 12-month period is recommended as minimum to support and mentor new service providers.

CONCLUSIONS

An evidence-based certification pathway has been commissioned by JAG to support and quality assure EUS training. This will form the basis to improve quality of training and safety standards in EUS in the UK and Ireland.

Analysis of the variation in learning curves for achieving competency in convex EUS training: a prospective cohort study using a standardized assessment tool

BACKGROUND AND AIMS

The need for mastering standard imaging techniques for convex EUS in the biliopancreatic regions has been increasing; however, large variations in the aptitude for achieving EUS competency hinder expert development. Therefore, we investigated the factors influencing the achievement of expert competency in EUS using a new assessment tool for multiple imaging items.

METHODS

Between January 2018 and February 2022, 3277 consecutive EUS procedures conducted by 5 beginners (EUS procedures <250), 7 intermediate trainees (250-749), and 2 experts (≥750) were prospectively evaluated. Immediately after each EUS procedure, the success or failure of imaging for each item was recorded using a newly developed EUS assessment tool that requires 17 items to be photographed. After correcting for missing values using multiple imputation, learning curves of EUS scores were created, and a competency was set based on expert scores. Finally, a comparative analysis between high and low performers was performed to extract factors influencing EUS scores.

RESULTS

Although 3 of 7 intermediates (43%; mean, 317 cases) achieved competency, none of the beginners achieved competency. During a comparative analysis, although no significant difference in the number of EUS procedures performed was observed between the high and low performers, the former had significantly higher scores in the written test (theoretical knowledge).

CONCLUSIONS

Our results showed that theoretical knowledge, rather than the number of EUS cases, may be a possible influencing factor for distinguishing high and low performers after treating 250 cases. (Clinical trial registration number: UMIN 000043271.).

Automatic Pancreatic Cyst Lesion Segmentation on EUS Images Using a Deep-Learning Approach

The automatic segmentation of the pancreatic cyst lesion (PCL) is essential for the automated diagnosis of pancreatic cyst lesions on endoscopic ultrasonography (EUS) images. In this study, we proposed a deep-learning approach for PCL segmentation on EUS images. We employed the Attention U-Net model for automatic PCL segmentation. The Attention U-Net was compared with the Basic U-Net, Residual U-Net, and U-Net++ models. The Attention U-Net showed a better dice similarity coefficient (DSC) and intersection over union (IoU) scores than the other models on the internal test. Although the Basic U-Net showed a higher DSC and IoU scores on the external test than the Attention U-Net, there was no statistically significant difference. On the internal test of the cross-over study, the Attention U-Net showed the highest DSC and IoU scores. However, there was no significant difference between the Attention U-Net and Residual U-Net or between the Attention U-Net and U-Net++. On the external test of the cross-over study, all models showed no significant difference from each other. To the best of our knowledge, this is the first study implementing segmentation of PCL on EUS images using a deep-learning approach. Our experimental results show that a deep-learning approach can be applied successfully for PCL segmentation on EUS images.

GAPS-EUS: a new and reliable tool for the assessment of basic skills and performance in EUS among endosonography trainees

Objective

Endosonography (EUS) is a useful but complex diagnostic modality which requires advanced endoscopy training and guidance by a supervisor. Since learning curves vary among individuals, assessment of the actual competence among EUS trainees is important.

Design/methods

We designed a novel assessment tool entitled Global Assessment of Performance and Skills in EUS (GAPS-EUS) for assessing skills among EUS trainees. Five quality indicators were marked on a five-grade scale by the supervisor (Observer Score) and by the trainee (Trainee Score). Trainees were included in two high-volume centres (Gothenburg, Sweden, and Bologna, Italy). Outcomes were feasibility, patient safety, reliability, and validity of GAPS-EUS in trainee-performed EUS procedures.

Results

Twenty-two EUS-trainees were assessed in a total of 157 EUS procedures with a completion rate of 157/157 (100 %) and a patient adverse event rate of 2/157 (1.3 %; gastroenteritis n=1, fever n=1). GAPS-EUS showed a high measurement reliability (Cronbach’s alpha coefficient=0.87) and a high inter-rater reliability comparing the supervisor and the trainee (r=0.83, r²=0.69, p<0.001). The construct of GAPS-EUS was verified by comparing low-level and high-level performance procedures and the content validity by recording that the EUS-FNA manoeuvre resulted in a lower score than other aspects of EUS 3.07 (95% CI 2.91 to 3.23) vs 3.51 (95% CI 3.37 to 3.65) (p<0.001). External validity was confirmed via similar findings in both centres.

Conclusion

GAPS-EUS is an easy-to-use and reliable tool with a recorded high validity for the assessment of competence among trainees in EUS. It can be recommended to centres involved in the education of future endosonographers.

Trial registration number

NCT02455570.

Training in advanced bilio-pancreatic endoscopy

As the clinical applications of endoscopic retrograde cholangiopancreatography (ERCP) and endoscopic ultrasound (EUS) take more and more root in everyday practice and these endoscopic procedures become increasingly more complex and interventional with a higher chance for complications, the demand for expert bilio-pancreatic endoscopists continues to increase. In response to this growing need, specific postgraduate fellowships have been developed, however the standardization of training programs and the assessment of the achieved competence still remains an open debate. ERCP and EUS competency often requires training beyond the scope of a standard GI fellowship program, which lasts at least 1-2 years, and there are some differences in the way to face the issues of advanced bilio-pancreatic endoscopy training between Europe, America and the Asian regions. Today there is no role for the self-teaching of ERCP and EUS through trial and error without supervision and, in the near future, it is necessary to critically revise current training guidelines, to establish a standardized curriculum for advanced bilio-pancreatic endoscopists and to implement universally validated skill assessment tools, able to ensure constant and targeted feedback to trainees.

The Role of Endoscopic Ultrasound for Esophageal Varices

Esophageal varices are caused by the development of collateral circulation in the esophagus as a result of portal hypertension. It is important to administer appropriate preventive treatment because bleeding varices can be fatal. Esophageal varices have complex and diverse hemodynamics, and there are various variations for each case. Endoscopic ultrasound (EUS) can estimate the hemodynamics of each case. Therefore, observation by EUS in esophageal varices provides useful information, such as safe and effective treatment selection, prediction of recurrence, and appropriate follow-up after treatment. Although treatment for the esophagogastric varices can be performed without EUS imaging, understanding the local hemodynamics of the varices using EUS prior to treatment will lead to more safe and effective treatment. EUS observation is an indispensable tool for thorough variceal care.