1
|
Robles-Medranda C, Baquerizo-Burgos J, Puga-Tejada M, Del Valle R, Mendez JC, Egas-Izquierdo M, Arevalo-Mora M, Cunto D, Alcívar-Vasquez J, Pitanga-Lukashok H, Tabacelia D. Development of convolutional neural network models that recognize normal anatomic structures during real-time radial-array and linear-array EUS (with videos). Gastrointest Endosc 2024; 99:271-279.e2. [PMID: 37827432 DOI: 10.1016/j.gie.2023.10.028] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/11/2023] [Revised: 09/05/2023] [Accepted: 10/05/2023] [Indexed: 10/14/2023]
Abstract
BACKGROUND AND AIMS EUS is a high-skill technique that requires numerous procedures to achieve competence. However, training facilities are limited worldwide. Convolutional neural network (CNN) models have been previously implemented for object detection. We developed 2 EUS-based CNN models for normal anatomic structure recognition during real-time linear- and radial-array EUS evaluations. METHODS The study was performed from February 2020 to June 2022. Consecutive patient videos of linear- and radial-array EUS videos were recorded. Expert endosonographers identified and labeled 20 normal anatomic structures within the videos for training and validation of the CNN models. Initial CNN models (CNNv1) were developed from 45 videos and the improved models (CNNv2) from an additional 102 videos. CNN model performance was compared with that of 2 expert endosonographers. RESULTS CNNv1 used 45,034 linear-array EUS frames and 21,063 radial-array EUS frames. CNNv2 used 148,980 linear-array EUS frames and 128,871 radial-array EUS frames. Linear-array CNNv1 and radial-array CNNv1 achieved a 75.65% and 71.36% mean average precision (mAP) with a total loss of .19 and .18, respectively. Linear-array CNNv2 obtained an 88.7% mAP with a .06 total loss, whereas radial-array CNNv2 achieved an 83.5% mAP with a .07 total loss. CNNv2 accurately detected all studied normal anatomic structures with a >98% observed agreement during clinical validation. CONCLUSIONS The proposed CNN models accurately recognize the normal anatomic structures in prerecorded videos and real-time EUS. Prospective trials are needed to evaluate the impact of these models on the learning curves of EUS trainees.
Collapse
Affiliation(s)
- Carlos Robles-Medranda
- Gastroenterology and Endoscopy Division, Instituto Ecuatoriano de Enfermedades Digestivas, Guayaquil, Ecuador
| | - Jorge Baquerizo-Burgos
- Gastroenterology and Endoscopy Division, Instituto Ecuatoriano de Enfermedades Digestivas, Guayaquil, Ecuador
| | - Miguel Puga-Tejada
- Gastroenterology and Endoscopy Division, Instituto Ecuatoriano de Enfermedades Digestivas, Guayaquil, Ecuador
| | - Raquel Del Valle
- Gastroenterology and Endoscopy Division, Instituto Ecuatoriano de Enfermedades Digestivas, Guayaquil, Ecuador
| | - Juan C Mendez
- Research and Development Department, mdconsgroup, Guayaquil, Ecuador
| | - Maria Egas-Izquierdo
- Gastroenterology and Endoscopy Division, Instituto Ecuatoriano de Enfermedades Digestivas, Guayaquil, Ecuador
| | - Martha Arevalo-Mora
- Gastroenterology and Endoscopy Division, Instituto Ecuatoriano de Enfermedades Digestivas, Guayaquil, Ecuador
| | - Domenica Cunto
- Gastroenterology and Endoscopy Division, Instituto Ecuatoriano de Enfermedades Digestivas, Guayaquil, Ecuador
| | - Juan Alcívar-Vasquez
- Gastroenterology and Endoscopy Division, Instituto Ecuatoriano de Enfermedades Digestivas, Guayaquil, Ecuador
| | - Hannah Pitanga-Lukashok
- Gastroenterology and Endoscopy Division, Instituto Ecuatoriano de Enfermedades Digestivas, Guayaquil, Ecuador
| | - Daniela Tabacelia
- Gastroenterology and Hepatology, Elias Emergency University Hospital, Bucharest, Romania; Faculty of Medicine, Carol Davila University of Medicine and Pharmacy, Bucharest, Romania
| |
Collapse
|
2
|
Wu HL, Yao LW, Shi HY, Wu LL, Li X, Zhang CX, Chen BR, Zhang J, Tan W, Cui N, Zhou W, Zhang JX, Xiao B, Gong RR, Ding Z, Yu HG. Validation of a real-time biliopancreatic endoscopic ultrasonography analytical device in China: a prospective, single-centre, randomised, controlled trial. Lancet Digit Health 2023; 5:e812-e820. [PMID: 37775472 DOI: 10.1016/s2589-7500(23)00160-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/03/2023] [Revised: 06/16/2023] [Accepted: 08/09/2023] [Indexed: 10/01/2023]
Abstract
BACKGROUND Endoscopic ultrasonography (EUS) is a key procedure for the diagnosis of biliopancreatic diseases. However, the performance among EUS endoscopists varies greatly and leads to blind spots during the operation, which can impair the health outcomes of patients. We previously developed an artificial intelligence (AI) device that accurately identified EUS standard stations and significantly reduced the difficulty of ultrasonography image interpretation. In this study, we updated the device (named EUS-IREAD) and validated its performance in improving the quality of EUS procedures. METHODS In this single-centre, randomised, controlled trial, we updated EUS-IREAD so it consisted of five learning models to identify eight EUS stations and 24 anatomical structures. The trial was done at the Renmin Hospital of Wuhan University (Wuhan, China) and included patients aged 18 years or older with suspected biliopancreatic (pancreas and biliopancreatic duct) lesions due to clinical symptoms, radiological findings, or laboratory findings, and with a high risk of pancreatic cancer. Patients were randomly assigned (1:1) by a dedicated research assistant using a computer-generated random number series (with a block size of four) to undergo the EUS procedure with or without the assistance of EUS-IREAD. Endoscopists in the EUS-IREAD-assisted group were required to observe all standard stations and anatomical structures according to the prompts by the AI device. Data collectors, the independent data anaylsis team, and patients were masked to group allocation. The primary outcome was the missed scanning rate of standard stations between the two groups, which was assessed in patients who underwent EUS procedure in accordance with the assigned intervention (per protocol). This trial is registered with ClinicalTrials.gov, NCT05457101. FINDINGS Between July 9, 2022, and Feb 28, 2023, 290 patients (mean age 55·93 years [SD 14·06], 152 [52%] male, and 138 [48%] female) were randomly assigned and analysed, including 144 in the EUS-IREAD-assisted group and 146 in the control group. The EUS-IREAD-assisted group had a lower missed scanning rate of stations than the control group (4·5% [SD 0·8] vs 14·3% [1·0], -9·8% [95% CI -12·2 to -7·5]; odds ratio 3·6 [95% Cl 2·6 to 4·9]; p<0·0001). No significant adverse event was found during the study. INTERPRETATION Our study confirms the capability of EUS-IREAD to monitor the blind spots and reduce the missed rate of stations and structures during EUS procedures. The EUS-IREAD has the potential to play an essential part in EUS quality control. FUNDING Innovation Team Project of Health Commission of Hubei Province and College-enterprise Deepening Reform Project of Wuhan University.
Collapse
Affiliation(s)
- Hui Ling Wu
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Li Wen Yao
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Hui Ying Shi
- Department of Gastroenterology, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Lian Lian Wu
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Xun Li
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Chen Xia Zhang
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Bo Ru Chen
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Jun Zhang
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Wei Tan
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Ning Cui
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Wei Zhou
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Ji Xiang Zhang
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Bing Xiao
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Rong Rong Gong
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China
| | - Zhen Ding
- Endoscopy Center, The First Affiliated Hospital, Sun Yat-sen University, Guangzhou, Guangdong, China.
| | - Hong Gang Yu
- Department of Gastroenterology, Hubei Provincial Clinical Research Center for Digestive Disease Minimally Invasive Incision, and Key Laboratory of Hubei Province for Digestive System Disease, Renmin Hospital of Wuhan University, Wuhan, China.
| |
Collapse
|
3
|
Chiba M, Kato M, Kinoshita Y, Akasu T, Matsui H, Shimamoto N, Tomita Y, Abe T, Kanazawa K, Tsukinaga S, Nakano M, Torisu Y, Toyoizumi H, Suka M, Sumiyama K. Analysis of the variation in learning curves for achieving competency in convex EUS training: a prospective cohort study using a standardized assessment tool. Gastrointest Endosc 2023; 97:722-731.e7. [PMID: 36343675 DOI: 10.1016/j.gie.2022.10.042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/28/2022] [Revised: 10/29/2022] [Accepted: 10/31/2022] [Indexed: 11/06/2022]
Abstract
BACKGROUND AND AIMS The need for mastering standard imaging techniques for convex EUS in the biliopancreatic regions has been increasing; however, large variations in the aptitude for achieving EUS competency hinder expert development. Therefore, we investigated the factors influencing the achievement of expert competency in EUS using a new assessment tool for multiple imaging items. METHODS Between January 2018 and February 2022, 3277 consecutive EUS procedures conducted by 5 beginners (EUS procedures <250), 7 intermediate trainees (250-749), and 2 experts (≥750) were prospectively evaluated. Immediately after each EUS procedure, the success or failure of imaging for each item was recorded using a newly developed EUS assessment tool that requires 17 items to be photographed. After correcting for missing values using multiple imputation, learning curves of EUS scores were created, and a competency was set based on expert scores. Finally, a comparative analysis between high and low performers was performed to extract factors influencing EUS scores. RESULTS Although 3 of 7 intermediates (43%; mean, 317 cases) achieved competency, none of the beginners achieved competency. During a comparative analysis, although no significant difference in the number of EUS procedures performed was observed between the high and low performers, the former had significantly higher scores in the written test (theoretical knowledge). CONCLUSIONS Our results showed that theoretical knowledge, rather than the number of EUS cases, may be a possible influencing factor for distinguishing high and low performers after treating 250 cases. (Clinical trial registration number: UMIN 000043271.).
Collapse
Affiliation(s)
- Masafumi Chiba
- Department of Endoscopy, The Jikei University School of Medicine, Tokyo, Japan
| | - Masayuki Kato
- Department of Endoscopy, The Jikei University School of Medicine, Tokyo, Japan
| | - Yuji Kinoshita
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, The Jikei University School of Medicine, Tokyo, Japan
| | - Takafumi Akasu
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, The Jikei University School of Medicine, Tokyo, Japan
| | - Hiroaki Matsui
- Department of Endoscopy, The Jikei University School of Medicine, Tokyo, Japan
| | - Nana Shimamoto
- Department of Endoscopy, The Jikei University School of Medicine, Tokyo, Japan
| | - Youichi Tomita
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, The Jikei University School of Medicine, Tokyo, Japan
| | - Takahiro Abe
- Department of Endoscopy, The Jikei University School of Medicine, Tokyo, Japan
| | - Keisuke Kanazawa
- Department of Endoscopy, The Jikei University School of Medicine, Tokyo, Japan
| | - Shintaro Tsukinaga
- Department of Endoscopy, The Jikei University School of Medicine, Tokyo, Japan
| | - Masanori Nakano
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, The Jikei University School of Medicine, Tokyo, Japan
| | - Yuichi Torisu
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, The Jikei University School of Medicine, Tokyo, Japan
| | - Hirobumi Toyoizumi
- Department of Endoscopy, The Jikei University School of Medicine, Tokyo, Japan
| | - Machi Suka
- Department of Public Health and Environmental Medicine, The Jikei University School of Medicine, Tokyo, Japan
| | - Kazuki Sumiyama
- Department of Endoscopy, The Jikei University School of Medicine, Tokyo, Japan
| |
Collapse
|
4
|
Young E, Philpott H, Singh R. Endoscopic diagnosis and treatment of gastric dysplasia and early cancer: Current evidence and what the future may hold. World J Gastroenterol 2021; 27:5126-5151. [PMID: 34497440 PMCID: PMC8384753 DOI: 10.3748/wjg.v27.i31.5126] [Citation(s) in RCA: 33] [Impact Index Per Article: 11.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/31/2021] [Revised: 07/07/2021] [Accepted: 08/05/2021] [Indexed: 02/06/2023] Open
Abstract
Gastric cancer accounts for a significant proportion of worldwide cancer-related morbidity and mortality. The well documented precancerous cascade provides an opportunity for clinicians to detect and treat gastric cancers at an endoscopically curable stage. In high prevalence regions such as Japan and Korea, this has led to the implementation of population screening programs. However, guidelines remain ambiguous in lower prevalence regions. In recent years, there have been many advances in the endoscopic diagnosis and treatment of early gastric cancer and precancerous lesions. More advanced endoscopic imaging has led to improved detection and characterization of gastric lesions as well as superior accuracy for delineation of margins prior to resection. In addition, promising early data on artificial intelligence in gastroscopy suggests a future role for this technology in maximizing the yield of advanced endoscopic imaging. Data on endoscopic resection (ER) are particularly robust in Japan and Korea, with high rates of curative ER and markedly reduced procedural morbidity. However, there is a shortage of data in other regions to support the applicability of protocols from these high prevalence countries. Future advances in endoscopic therapeutics will likely lead to further expansion of the current indications for ER, as both technology and proceduralist expertise continue to grow.
Collapse
Affiliation(s)
- Edward Young
- Department of Gastroenterology, Lyell McEwin Hospital, Elizabeth Vale 5112, SA, Australia
- Faculty of Health and Medical Sciences, University of Adelaide, Adelaide 5000, SA, Australia
| | - Hamish Philpott
- Department of Gastroenterology, Lyell McEwin Hospital, Elizabeth Vale 5112, SA, Australia
| | - Rajvinder Singh
- Department of Gastroenterology, Lyell McEwin Hospital, Elizabeth Vale 5112, SA, Australia
- Faculty of Health and Medical Sciences, University of Adelaide, Adelaide 5000, SA, Australia
| |
Collapse
|