Artificial intelligence and computer-aided diagnosis in colonoscopy: current evidence and future directions

Aliado - A design concept of AI for decision support in oncological liver surgery

BACKGROUND

The interest in artificial intelligence (AI) is increasing. Systematic reviews suggest that there are many machine learning algorithms in surgery, however, only a minority of the studies integrate AI applications in clinical workflows. Our objective was to design and evaluate a concept to use different kinds of AI for decision support in oncological liver surgery along the treatment path.

METHODS

In an exploratory co-creation between design experts, surgeons, and data scientists, pain points along the treatment path were identified. Potential designs for AI-assisted solutions were developed and iteratively refined. Finally, an evaluation of the design concept was performed with n = 20 surgeons to get feedback on the different functionalities and evaluate the usability with the System Usability Scale (SUS). Participating surgeons had a mean of 14.0 ± 5.0 years of experience after graduation.

RESULTS

The design concept was named "Aliado". Five different scenarios were identified where AI could support surgeons. Mean score of SUS was 68.2 ( ± 13.6 SD). The highest valued functionalities were "individualized prediction of survival, short-term mortality and morbidity", and "individualized recommendation of surgical strategy".

CONCLUSION

Aliado is a design prototype that shows how AI could be integrated into the clinical workflow. Even without a fleshed out user interface, the SUS already yielded borderline good results. Expert surgeons rated the functionalities favorably, and most of them expressed their willingness to work with a similar application in the future. Thus, Aliado can serve as a surgical vision of how an ideal AI-based assistance could look like.

Integrating artificial intelligence (S-Detect software) and contrast-enhanced ultrasound for enhanced diagnosis of thyroid nodules: A comprehensive evaluation study

PURPOSE

This study aims to assess the diagnostic efficacy of Korean Thyroid imaging reporting and data system (K-TIRADS), S-Detect software and contrast-enhanced ultrasound (CEUS) when employed individually, as well as their combined application, for the evaluation of thyroid nodules, with the objective of identifying the optimal method for diagnosing thyroid nodules.

METHODS

Two hundred and sixty eight cases pathologically proven of thyroid nodules were retrospectively enrolled. Each nodule was classified according to K-TIRADS. S-Detect software was utilized for intelligent analysis. CEUS was employed to acquire contrast-enhanced features.

RESULTS

The area under curve (AUC) values for diagnosing benign and malignant thyroid nodules using K-TIRADS alone, S-Detect software alone, CEUS alone, the combined application of K-TIRADS and CEUS, the combined application of S-Detect software and CEUS were 0.668, 0.668, 0.719, 0.741, and 0.759, respectively (p < 0.001). The sensitivity rate of S-Detect software was 89.9% (p < 0.001). It was the highest of the five diagnostic methods above.

CONCLUSION

The utilization of S-Detect software can be served as a powerful tool for early screening. Notably, the combined utilization of S-Detect software with CEUS demonstrates superior diagnostic performance compared to employing K-TIRADS, S-Detect software, CEUS used individually, as well as the combined application of K-TIRADS with CEUS.

Accuracy of Computer-aided Diagnosis in Colonoscopy Varies According to Polyp Location: A Systematic Review and Meta-analysis

BACKGROUND & AIMS

Computer-aided diagnosis (CADx) assists endoscopists in differentiating between neoplastic and non-neoplastic polyps during colonoscopy. This study aimed to evaluate the impact of polyp location (proximal vs. distal colon) on the diagnostic performance of CADx for ≤5 mm polyps.

METHODS

We searched for studies evaluating the performance of real-time CADx alone (ie, independently of endoscopist judgement) for predicting the histology of colorectal polyps ≤5 mm. The primary endpoints were CADx sensitivity and specificity in the proximal and distal colon. Secondary outcomes were the negative predictive value (NPV), positive predictive value (PPV), and the accuracy of the CADx alone. Distal colon was limited to the rectum and sigmoid.

RESULTS

We included 11 studies for analysis with a total of 7782 polyps ≤5 mm. CADx specificity was significantly lower in the proximal colon compared with the distal colon (62% vs 85%; risk ratio (RR), 0.74; 95% confidence interval [CI], 0.72-0.84). Conversely, sensitivity was similar (89% vs 87%); RR, 1.00; 95% CI, 0.97-1.03). The NPV (64% vs 93%; RR, 0.71; 95% CI, 0.64-0.79) and accuracy (81% vs 86%; RR, 0.95; 95% CI, 0.91-0.99) were significantly lower in the proximal than distal colon, whereas PPV was higher in the proximal colon (87% vs 76%; RR, 1.11; 95% CI, 1.06-1.17).

CONCLUSION

The diagnostic performance of CADx for polyps in the proximal colon is inadequate, exhibiting significantly lower specificity compared with its performance for distal polyps. Although current CADx systems are suitable for use in the distal colon, they should not be employed for proximal polyps until more performant systems are developed specifically for these lesions.

Deep learning analysis for differential diagnosis and risk classification of gastrointestinal tumors

OBJECTIVES

Recently, artificial intelligence (AI) has been applied to clinical diagnosis. Although AI has already been developed for gastrointestinal (GI) tract endoscopy, few studies have applied AI to endoscopic ultrasound (EUS) images. In this study, we used a computer-assisted diagnosis (CAD) system with deep learning analysis of EUS images (EUS-CAD) and assessed its ability to differentiate GI stromal tumors (GISTs) from other mesenchymal tumors and their risk classification performance.

MATERIALS AND METHODS

A total of 101 pathologically confirmed cases of subepithelial lesions (SELs) arising from the muscularis propria layer, including 69 GISTs, 17 leiomyomas and 15 schwannomas, were examined. A total of 3283 EUS images were used for training and five-fold-cross-validation, and 827 images were independently tested for diagnosing GISTs. For the risk classification of 69 GISTs, including very-low-, low-, intermediate- and high-risk GISTs, 2,784 EUS images were used for training and three-fold-cross-validation.

RESULTS

For the differential diagnostic performance of GIST among all SELs, the accuracy, sensitivity, specificity and area under the receiver operating characteristic (ROC) curve were 80.4%, 82.9%, 75.3% and 0.865, respectively, whereas those for intermediate- and high-risk GISTs were 71.8%, 70.2%, 72.0% and 0.771, respectively.

CONCLUSIONS

The EUS-CAD system showed a good diagnostic yield in differentiating GISTs from other mesenchymal tumors and successfully demonstrated the GIST risk classification feasibility. This system can determine whether treatment is necessary based on EUS imaging alone without the need for additional invasive examinations.

Artificial intelligence and endo-histo-omics: new dimensions of precision endoscopy and histology in inflammatory bowel disease

Integrating artificial intelligence into inflammatory bowel disease (IBD) has the potential to revolutionise clinical practice and research. Artificial intelligence harnesses advanced algorithms to deliver accurate assessments of IBD endoscopy and histology, offering precise evaluations of disease activity, standardised scoring, and outcome prediction. Furthermore, artificial intelligence offers the potential for a holistic endo-histo-omics approach by interlacing and harmonising endoscopy, histology, and omics data towards precision medicine. The emerging applications of artificial intelligence could pave the way for personalised medicine in IBD, offering patient stratification for the most beneficial therapy with minimal risk. Although artificial intelligence holds promise, challenges remain, including data quality, standardisation, reproducibility, scarcity of randomised controlled trials, clinical implementation, ethical concerns, legal liability, and regulatory issues. The development of standardised guidelines and interdisciplinary collaboration, including policy makers and regulatory agencies, is crucial for addressing these challenges and advancing artificial intelligence in IBD clinical practice and trials.

Gut microbes on the risk of advanced adenomas

BACKGROUND

More than 90% of colorectal cancer (CRC) arises from advanced adenomas (AA) and gut microbes are closely associated with the initiation and progression of both AA and CRC.

OBJECTIVE

To analyze the characteristic microbes in AA.

METHODS

Fecal samples were collected from 92 AA and 184 negative control (NC). Illumina HiSeq X sequencing platform was used for high-throughput sequencing of microbial populations. The sequencing results were annotated and compared with NCBI RefSeq database to find the microbial characteristics of AA. R-vegan package was used to analyze α diversity and β diversity. α diversity included box diagram, and β diversity included Principal Component Analysis (PCA), principal co-ordinates analysis (PCoA), and non-metric multidimensional scaling (NMDS). The AA risk prediction models were constructed based on six kinds of machine learning algorithms. In addition, unsupervised clustering methods were used to classify bacteria and viruses. Finally, the characteristics of bacteria and viruses in different subtypes were analyzed.

RESULTS

The abundance of Prevotella sp900557255, Alistipes putredinis, and Megamonas funiformis were higher in AA, while the abundance of Lilyvirus, Felixounavirus, and Drulisvirus were also higher in AA. The Catboost based model for predicting the risk of AA has the highest accuracy (bacteria test set: 87.27%; virus test set: 83.33%). In addition, 4 subtypes (B1V1, B1V2, B2V1, and B2V2) were distinguished based on the abundance of gut bacteria and enteroviruses (EVs). Escherichia coli D, Prevotella sp900557255, CAG-180 sp000432435, Phocaeicola plebeiuA, Teseptimavirus, Svunavirus, Felixounavirus, and Jiaodavirus are the characteristic bacteria and viruses of 4 subtypes. The results of Catboost model indicated that the accuracy of prediction improved after incorporating subtypes. The accuracy of discovery sets was 100%, 96.34%, 100%, and 98.46% in 4 subtypes, respectively.

CONCLUSION

Prevotella sp900557255 and Felixounavirus have high value in early warning of AA. As promising non-invasive biomarkers, gut microbes can become potential diagnostic targets for AA, and the accuracy of predicting AA can be improved by typing.

Deep learning model based on endoscopic images predicting treatment response in locally advanced rectal cancer undergo neoadjuvant chemoradiotherapy: a multicenter study

PURPOSE

Neoadjuvant chemoradiotherapy has been the standard practice for patients with locally advanced rectal cancer. However, the treatment response varies greatly among individuals, how to select the optimal candidates for neoadjuvant chemoradiotherapy is crucial. This study aimed to develop an endoscopic image-based deep learning model for predicting the response to neoadjuvant chemoradiotherapy in locally advanced rectal cancer.

METHODS

In this multicenter observational study, pre-treatment endoscopic images of patients from two Chinese medical centers were retrospectively obtained and a deep learning-based tumor regression model was constructed. Treatment response was evaluated based on the tumor regression grade and was defined as good response and non-good response. The prediction performance of the deep learning model was evaluated in the internal and external test sets. The main outcome was the accuracy of the treatment prediction model, measured by the AUC and accuracy.

RESULTS

This deep learning model achieved favorable prediction performance. In the internal test set, the AUC and accuracy were 0.867 (95% CI: 0.847-0.941) and 0.836 (95% CI: 0.818-0.896), respectively. The prediction performance was fully validated in the external test set, and the model had an AUC of 0.758 (95% CI: 0.724-0.834) and an accuracy of 0.807 (95% CI: 0.774-0.843).

CONCLUSION

The deep learning model based on endoscopic images demonstrated exceptional predictive power for neoadjuvant treatment response, highlighting its potential for guiding personalized therapy.

REAL-Colon: A dataset for developing real-world AI applications in colonoscopy

Detection and diagnosis of colon polyps are key to preventing colorectal cancer. Recent evidence suggests that AI-based computer-aided detection (CADe) and computer-aided diagnosis (CADx) systems can enhance endoscopists' performance and boost colonoscopy effectiveness. However, most available public datasets primarily consist of still images or video clips, often at a down-sampled resolution, and do not accurately represent real-world colonoscopy procedures. We introduce the REAL-Colon (Real-world multi-center Endoscopy Annotated video Library) dataset: a compilation of 2.7 M native video frames from sixty full-resolution, real-world colonoscopy recordings across multiple centers. The dataset contains 350k bounding-box annotations, each created under the supervision of expert gastroenterologists. Comprehensive patient clinical data, colonoscopy acquisition information, and polyp histopathological information are also included in each video. With its unprecedented size, quality, and heterogeneity, the REAL-Colon dataset is a unique resource for researchers and developers aiming to advance AI research in colonoscopy. Its openness and transparency facilitate rigorous and reproducible research, fostering the development and benchmarking of more accurate and reliable colonoscopy-related algorithms and models.

Artificial intelligence for dysplasia detection during surveillance colonoscopy in patients with ulcerative colitis: A cross-sectional, non-inferiority, diagnostic test comparison study

BACKGROUND AND STUDY AIM

High-definition virtual chromoendoscopy, along with targeted biopsies, is recommended for dysplasia surveillance in ulcerative colitis patients at risk for colorectal cancer. Computer-aided detection (CADe) systems aim to improve colonic adenoma detection, however their efficacy in detecting polyps and adenomas in this context remains unclear. This study evaluates the CADe Discovery™ system's effectiveness in detecting colonic dysplasia in ulcerative colitis patients at risk for colorectal cancer.

PATIENTS AND METHODS

A prospective cross-sectional, non-inferiority, diagnostic test comparison study was conducted on ulcerative colitis patients undergoing colorectal cancer surveillance colonoscopy between January 2021 and April 2021. Patients underwent virtual chromoendoscopy (VCE) with iSCAN 1 and 3 with optical enhancement. One endoscopist, blinded to CADe Discovery™ system results, examined colon sections, while a second endoscopist concurrently reviewed CADe images. Suspicious areas detected by both techniques underwent resection. Proportions of dysplastic lesions and patients with dysplasia detected by VCE or CADe were calculated.

RESULTS

Fifty-two patients were included, and 48 lesions analyzed. VCE and CADe each detected 9 cases of dysplasia (21.4% and 20.0%, respectively; p=0.629) in 8 patients and 7 patients (15.4% vs. 13.5%, respectively; p=0.713). Sensitivity, specificity, positive and negative predictive values, and diagnostic accuracy for dysplasia detection using VCE or CADe were 90% and 90%, 13% and 5%, 21% and 2%, 83% and 67%, and 29.2% and 22.9%, respectively.

CONCLUSIONS

The CADe Discovery™ system shows similar diagnostic performance to VCE with iSCAN in detecting colonic dysplasia in ulcerative colitis patients at risk for colorectal cancer.

Deep learning assists detection of esophageal cancer and precursor lesions in a prospective, randomized controlled study

Endoscopy is the primary modality for detecting asymptomatic esophageal squamous cell carcinoma (ESCC) and precancerous lesions. Improving detection rate remains challenging. We developed a system based on deep convolutional neural networks (CNNs) for detecting esophageal cancer and precancerous lesions [high-risk esophageal lesions (HrELs)] and validated its efficacy in improving HrEL detection rate in clinical practice (trial registration ChiCTR2100044126 at www.chictr.org.cn). Between April 2021 and March 2022, 3117 patients ≥50 years old were consecutively recruited from Taizhou Hospital, Zhejiang Province, and randomly assigned 1:1 to an experimental group (CNN-assisted endoscopy) or a control group (unassisted endoscopy) based on block randomization. The primary endpoint was the HrEL detection rate. In the intention-to-treat population, the HrEL detection rate [28 of 1556 (1.8%)] was significantly higher in the experimental group than in the control group [14 of 1561 (0.9%), P = 0.029], and the experimental group detection rate was twice that of the control group. Similar findings were observed between the experimental and control groups [28 of 1524 (1.9%) versus 13 of 1534 (0.9%), respectively; P = 0.021]. The system's sensitivity, specificity, and accuracy for detecting HrELs were 89.7, 98.5, and 98.2%, respectively. No adverse events occurred. The proposed system thus improved HrEL detection rate during endoscopy and was safe. Deep learning assistance may enhance early diagnosis and treatment of esophageal cancer and may become a useful tool for esophageal cancer screening.

Artificial Intelligence in the Diagnosis of Colorectal Cancer: A Literature Review

BACKGROUND

The aim of this review is to explore the role of artificial intelligence in the diagnosis of colorectal cancer, how it impacts CRC morbidity and mortality, and why its role in clinical medicine is limited.

METHODS

A targeted, non-systematic review of the published literature relating to colorectal cancer diagnosis was performed with PubMed databases that were scouted to help provide a more defined understanding of the recent advances regarding artificial intelligence and their impact on colorectal-related morbidity and mortality. Articles were included if deemed relevant and including information associated with the keywords.

RESULTS

The advancements in artificial intelligence have been significant in facilitating an earlier diagnosis of CRC. In this review, we focused on evaluating genomic biomarkers, the integration of instruments with artificial intelligence, MR and hyperspectral imaging, and the architecture of neural networks. We found that these neural networks seem practical and yield positive results in initial testing. Furthermore, we explored the use of deep-learning-based majority voting methods, such as bag of words and PAHLI, in improving diagnostic accuracy in colorectal cancer detection. Alongside this, the autonomous and expansive learning ability of artificial intelligence, coupled with its ability to extract increasingly complex features from images or videos without human reliance, highlight its impact in the diagnostic sector. Despite this, as most of the research involves a small sample of patients, a diversification of patient data is needed to enhance cohort stratification for a more sensitive and specific neural model. We also examined the successful application of artificial intelligence in predicting microsatellite instability, showcasing its potential in stratifying patients for targeted therapies.

CONCLUSIONS

Since its commencement in colorectal cancer, artificial intelligence has revealed a multitude of functionalities and augmentations in the diagnostic sector of CRC. Given its early implementation, its clinical application remains a fair way away, but with steady research dedicated to improving neural architecture and expanding its applicational range, there is hope that these advanced neural software could directly impact the early diagnosis of CRC. The true promise of artificial intelligence, extending beyond the medical sector, lies in its potential to significantly influence the future landscape of CRC's morbidity and mortality.

A Framework for the Evaluation of Human Machine Interfaces of Robot-Assisted Colonoscopy

The Human Machine Interface (HMI) of intraluminal robots has a crucial impact on the clinician's performance. It increases or decreases the difficulty of the tasks, and is connected to the users' physical and mental stress.

OBJECTIVE

This article presents a framework to compare and evaluate different HMIs for robotic colonoscopy, with the objective of identifying the optimal HMI that minimises the clinician's effort and maximises the clinical outcomes.

METHODS

The framework comprises a 1) a virtual simulator (clinically validated), 2) wearable sensors measuring the cognitive load, 3) a data collection unit of metrics correlated to the clinical performance, and 4) questionnaires exploring the users' impressions and perceived stress. The framework was tested with 42 clinicians investigating the optimal device for tele-operated control of robotic colonoscopes. Two control devices were selected and compared: a haptic serial-kinematic device and a standard videogame joypad.

RESULTS

The haptic device was preferred by the endoscopists, but the joypad enabled better clinical performance and reduced cognitive and physical load.

CONCLUSION

The framework can be used to evaluate different aspects of a HMI, both hardware and software, and determine the optimal HMI that can reduce the burden on clinicians while improving the clinical outcome.

SIGNIFICANCE

The findings of this study, and of future studies performed with this framework, can inform the design and development of HMIs for intraluminal robots, leading to improved clinical performance, reduced physical and mental stress for clinicians, and ultimately better patient outcomes.

Artificial Intelligence-assisted Analysis of Pan-enteric Capsule Endoscopy in Patients with Suspected Crohn's Disease: A Study on Diagnostic Performance

BACKGROUND AND AIM

Pan-enteric capsule endoscopy [PCE] is a highly sensitive but time-consuming tool for detecting pathology. Artificial intelligence [AI] algorithms might offer a possibility to assist in the review and reduce the analysis time of PCE. This study examines the agreement between PCE assessments aided by AI technology and standard evaluations, in patients suspected of Crohn's disease [CD].

METHOD

PCEs from a prospective, blinded, multicentre study, including patients suspected of CD, were processed by the deep learning solution AXARO® [Augmented Endoscopy, Paris, France]. Based on the image output, two observers classified the patient's PCE as normal or suggestive of CD, ulcerative colitis, or cancer. The primary outcome was per-patient sensitivities and specificities for detecting CD and inflammatory bowel disease [IBD]. Complete reading of PCE served as the reference standard.

RESULTS

A total of 131 patients' PCEs were analysed, with a median recording time of 303 min. The AXARO® framework reduced output to a median of 470 images [2.1%] per patient, and the pooled median review time was 3.2 min per patient. For detecting CD, the observers had a sensitivity of 96% and 92% and a specificity of 93% and 90%, respectively. For the detection of IBD, both observers had a sensitivity of 97% and had a specificity of 91% and 90%, respectively. The negative predictive value was 95% for CD and 97% for IBD.

CONCLUSIONS

Using the AXARO® framework reduced the initial review time substantially while maintaining high diagnostic accuracy-suggesting its use as a rapid tool to rule out IBD in PCEs of patients suspected of Crohn's disease.

Artificial intelligence for colorectal neoplasia detection during colonoscopy: a systematic review and meta-analysis of randomized clinical trials

BACKGROUND

The use of artificial intelligence (AI) in detecting colorectal neoplasia during colonoscopy holds the potential to enhance adenoma detection rates (ADRs) and reduce adenoma miss rates (AMRs). However, varied outcomes have been observed across studies. Thus, this study aimed to evaluate the potential advantages and disadvantages of employing AI-aided systems during colonoscopy.

METHODS

Using Medical Subject Headings (MeSH) terms and keywords, a comprehensive electronic literature search was performed of the Embase, Medline, and the Cochrane Library databases from the inception of each database until October 04, 2023, in order to identify randomized controlled trials (RCTs) comparing AI-assisted with standard colonoscopy for detecting colorectal neoplasia. Primary outcomes included AMR, ADR, and adenomas detected per colonoscopy (APC). Secondary outcomes comprised the poly missed detection rate (PMR), poly detection rate (PDR), and poly detected per colonoscopy (PPC). We utilized random-effects meta-analyses with Hartung-Knapp adjustment to consolidate results. The prediction interval (PI) and I2 statistics were utilized to quantify between-study heterogeneity. Moreover, meta-regression and subgroup analyses were performed to investigate the potential sources of heterogeneity. This systematic review and meta-analysis is registered with PROSPERO (CRD42023428658).

FINDINGS

This study encompassed 33 trials involving 27,404 patients. Those undergoing AI-aided colonoscopy experienced a significant decrease in PMR (RR, 0.475; 95% CI, 0.294-0.768; I2 = 87.49%) and AMR (RR, 0.495; 95% CI, 0.390-0.627; I2 = 48.76%). Additionally, a significant increase in PDR (RR, 1.238; 95% CI, 1.158-1.323; I2 = 81.67%) and ADR (RR, 1.242; 95% CI, 1.159-1.332; I2 = 78.87%), along with a significant increase in the rates of PPC (IRR, 1.388; 95% CI, 1.270-1.517; I2 = 91.99%) and APC (IRR, 1.390; 95% CI, 1.277-1.513; I2 = 86.24%), was observed. This resulted in 0.271 more PPCs (95% CI, 0.144-0.259; I2 = 65.61%) and 0.202 more APCs (95% CI, 0.144-0.259; I2 = 68.15%).

INTERPRETATION

AI-aided colonoscopy significantly enhanced the detection of colorectal neoplasia detection, likely by reducing the miss rate. However, future studies should focus on evaluating the cost-effectiveness and long-term benefits of AI-aided colonoscopy in reducing cancer incidence.

FUNDING

This work was supported by the Heilongjiang Provincial Natural Science Foundation of China (LH2023H096), the Postdoctoral research project in Heilongjiang Province (LBH-Z22210), the National Natural Science Foundation of China's General Program (82072640) and the Outstanding Youth Project of Heilongjiang Natural Science Foundation (YQ2021H023).

CCRA: A colon cleanliness rating algorithm based on colonoscopy video analysis

Objective

A Colon Cleanliness Rating Algorithm (CCRA) based on colonoscopy image analysis is proposed in this paper, in order to solve the problem that the results of Colon Cleanliness (or Bowel Preparation Quality) rating caused by manual inspection are inconsistent.

Methods

Firstly, CCRA intercepts images from the colonoscopy video. Secondly, each colonoscopy image's stool area is segmented by U-Net to obtain the 2-classification segmentation results. Finally, the colon cleanliness is obtained by comparing the average area of the stool area with the standard proportion.

Results

After testing, the pixel accuracy of the U-Net model is 97.02 %, IoU is 83.67 %, accuracy is 92.17 %, recall is 90.21 %, F1-Score is 90.95 %. The accuracy of CCRA is 92.45 %-99.275.

Conclusion

The experimental results show that the CCRA proposed in this paper can quickly and accurately output the colon cleanliness rating of patients without manpower.

A comprehensive survey of intestine histopathological image analysis using machine vision approaches

Colorectal Cancer (CRC) is currently one of the most common and deadly cancers. CRC is the third most common malignancy and the fourth leading cause of cancer death worldwide. It ranks as the second most frequent cause of cancer-related deaths in the United States and other developed countries. Histopathological images contain sufficient phenotypic information, they play an indispensable role in the diagnosis and treatment of CRC. In order to improve the objectivity and diagnostic efficiency for image analysis of intestinal histopathology, Computer-aided Diagnosis (CAD) methods based on machine learning (ML) are widely applied in image analysis of intestinal histopathology. In this investigation, we conduct a comprehensive study on recent ML-based methods for image analysis of intestinal histopathology. First, we discuss commonly used datasets from basic research studies with knowledge of intestinal histopathology relevant to medicine. Second, we introduce traditional ML methods commonly used in intestinal histopathology, as well as deep learning (DL) methods. Then, we provide a comprehensive review of the recent developments in ML methods for segmentation, classification, detection, and recognition, among others, for histopathological images of the intestine. Finally, the existing methods have been studied, and the application prospects of these methods in this field are given.

Enhancing Cervical Pre-Cancerous Classification Using Advanced Vision Transformer

One of the most common types of cancer among in women is cervical cancer. Incidence and fatality rates are steadily rising, particularly in developing nations, due to a lack of screening facilities, experienced specialists, and public awareness. Visual inspection is used to screen for cervical cancer after the application of acetic acid (VIA), histopathology test, Papanicolaou (Pap) test, and human papillomavirus (HPV) test. The goal of this research is to employ a vision transformer (ViT) enhanced with shifted patch tokenization (SPT) techniques to create an integrated and robust system for automatic cervix-type identification. A vision transformer enhanced with shifted patch tokenization is used in this work to learn the distinct features between the three different cervical pre-cancerous types. The model was trained and tested on 8215 colposcopy images of the three types, obtained from the publicly available mobile-ODT dataset. The model was tested on 30% of the whole dataset and it showed a good generalization capability of 91% accuracy. The state-of-the art comparison indicated the outperformance of our model. The experimental results show that the suggested system can be employed as a decision support tool in the detection of the cervical pre-cancer transformation zone, particularly in low-resource settings with limited experience and resources.

Computer-aided diagnosis for optical diagnosis of diminutive colorectal polyps including sessile serrated lesions: a real-time comparison with screening endoscopists

BACKGROUND : We aimed to compare the accuracy of the optical diagnosis of diminutive colorectal polyps, including sessile serrated lesions (SSLs), between a computer-aided diagnosis (CADx) system and endoscopists during real-time colonoscopy. METHODS : We developed the POLyp Artificial Recognition (POLAR) system, which was capable of performing real-time characterization of diminutive colorectal polyps. For pretraining, the Microsoft-COCO dataset with over 300 000 nonpolyp object images was used. For training, eight hospitals prospectively collected 2637 annotated images from 1339 polyps (i. e. publicly available online POLAR database). For clinical validation, POLAR was tested during colonoscopy in patients with a positive fecal immunochemical test (FIT), and compared with the performance of 20 endoscopists from eight hospitals. Endoscopists were blinded to the POLAR output. Primary outcome was the comparison of accuracy of the optical diagnosis of diminutive colorectal polyps between POLAR and endoscopists (neoplastic [adenomas and SSLs] versus non-neoplastic [hyperplastic polyps]). Histopathology served as the reference standard. RESULTS : During clinical validation, 423 diminutive polyps detected in 194 FIT-positive individuals were included for analysis (300 adenomas, 41 SSLs, 82 hyperplastic polyps). POLAR distinguished neoplastic from non-neoplastic lesions with 79 % accuracy, 89 % sensitivity, and 38 % specificity. The endoscopists achieved 83 % accuracy, 92 % sensitivity, and 44 % specificity. The optical diagnosis accuracy between POLAR and endoscopists was not significantly different (P = 0.10). The proportion of polyps in which POLAR was able to provide an optical diagnosis was 98 % (i. e. success rate). CONCLUSIONS : We developed a CADx system that differentiated neoplastic from non-neoplastic diminutive polyps during endoscopy, with an accuracy comparable to that of screening endoscopists and near-perfect success rate.

Diagnostic value of deep learning-assisted endoscopic ultrasound for pancreatic tumors: a systematic review and meta-analysis

Background and aims

Endoscopic ultrasonography (EUS) is commonly utilized in the diagnosis of pancreatic tumors, although as this modality relies primarily on the practitioner's visual judgment, it is prone to result in a missed diagnosis or misdiagnosis due to inexperience, fatigue, or distraction. Deep learning (DL) techniques, which can be used to automatically extract detailed imaging features from images, have been increasingly beneficial in the field of medical image-based assisted diagnosis. The present systematic review included a meta-analysis aimed at evaluating the accuracy of DL-assisted EUS for the diagnosis of pancreatic tumors diagnosis.

Methods

We performed a comprehensive search for all studies relevant to EUS and DL in the following four databases, from their inception through February 2023: PubMed, Embase, Web of Science, and the Cochrane Library. Target studies were strictly screened based on specific inclusion and exclusion criteria, after which we performed a meta-analysis using Stata 16.0 to assess the diagnostic ability of DL and compare it with that of EUS practitioners. Any sources of heterogeneity were explored using subgroup and meta-regression analyses.

Results

A total of 10 studies, involving 3,529 patients and 34,773 training images, were included in the present meta-analysis. The pooled sensitivity was 93% (95% confidence interval [CI], 87-96%), the pooled specificity was 95% (95% CI, 89-98%), and the area under the summary receiver operating characteristic curve (AUC) was 0.98 (95% CI, 0.96-0.99).

Conclusion

DL-assisted EUS has a high accuracy and clinical applicability for diagnosing pancreatic tumors.

Systematic review registration

https://www.crd.york.ac.uk/prospero/display_record.php?ID=CRD42023391853, identifier CRD42023391853.

Effectiveness and application of artificial intelligence for endoscopic screening of colorectal cancer: the future is now

INTRODUCTION

Artificial intelligence (AI) in gastrointestinal endoscopy includes systems designed to interpret medical images and increase sensitivity during examination. This may be a promising solution to human biases and may provide support during diagnostic endoscopy.

AREAS COVERED

This review aims to summarize and evaluate data supporting AI technologies in lower endoscopy, addressing their effectiveness, limitations, and future perspectives.

EXPERT OPINION

Computer-aided detection (CADe) systems have been studied with promising results, allowing for an increase in adenoma detection rate (ADR), adenoma per colonoscopy (APC), and a reduction in adenoma miss rate (AMR). This may lead to an increase in the sensitivity of endoscopic examinations and a reduction in the risk of interval-colorectal cancer. In addition, computer-aided characterization (CADx) has also been implemented, aiming to distinguish adenomatous and non-adenomatous lesions through real-time assessment using advanced endoscopic imaging techniques. Moreover, computer-aided quality (CADq) systems have been developed with the aim of standardizing quality measures in colonoscopy (e.g. withdrawal time and adequacy of bowel cleansing) both to improve the quality of examinations and set a reference standard for randomized controlled trials.

AI-Assisted Ultrasound for the Early Diagnosis of Antibody-Negative Autoimmune Thyroiditis

The prevalence of antibody-negative chronic autoimmune thyroiditis (SN-CAT) is increasing. The early diagnosis of SN-CAT can effectively prevent its further development. Thyroid ultrasound can diagnose autoimmune thyroiditis and predict hypothyroidism. Primary hypothyroidism with a hypoechoic pattern suggested by thyroid ultrasound and negative thyroid serum antibodies is the main basis for the diagnosis of SN-CAT. However, for early SN-CAT, only hypoechoic thyroid changes and serological antibodies are currently available. This study explored how to achieve an accurate and early diagnosis of SN-CAT and prevent the development of SN-CAT combined with hypothyroidism. The diagnosis of a hypoechoic thyroid by artificial intelligence is expected to be a breakthrough in the accurate diagnosis of SN-CAT.

Research trends on artificial intelligence and endoscopy in digestive diseases: A bibliometric analysis from 1990 to 2022

BACKGROUND

Recently, artificial intelligence (AI) has been widely used in gastrointestinal endoscopy examinations.

AIM

To comprehensively evaluate the application of AI-assisted endoscopy in detecting different digestive diseases using bibliometric analysis.

METHODS

Relevant publications from the Web of Science published from 1990 to 2022 were extracted using a combination of the search terms “AI” and “endoscopy”. The following information was recorded from the included publications: Title, author, institution, country, endoscopy type, disease type, performance of AI, publication, citation, journal and H-index.

RESULTS

A total of 446 studies were included. The number of articles reached its peak in 2021, and the annual citation numbers increased after 2006. China, the United States and Japan were dominant countries in this field, accounting for 28.7%, 16.8%, and 15.7% of publications, respectively. The Tada Tomohiro Institute of Gastroenterology and Proctology was the most influential institution. “Cancer” and “polyps” were the hotspots in this field. Colorectal polyps were the most concerning and researched disease, followed by gastric cancer and gastrointestinal bleeding. Conventional endoscopy was the most common type of examination. The accuracy of AI in detecting Barrett’s esophagus, colorectal polyps and gastric cancer from 2018 to 2022 is 87.6%, 93.7% and 88.3%, respectively. The detection rates of adenoma and gastrointestinal bleeding from 2018 to 2022 are 31.3% and 96.2%, respectively.

CONCLUSION

AI could improve the detection rate of digestive tract diseases and a convolutional neural network-based diagnosis program for endoscopic images shows promising results.

Identifying key mechanisms leading to visual recognition errors for missed colorectal polyps using eye-tracking technology

BACKGROUND AND AIM

Lack of visual recognition of colorectal polyps may lead to interval cancers. The mechanisms contributing to perceptual variation, particularly for subtle and advanced colorectal neoplasia, have scarcely been investigated. We aimed to evaluate visual recognition errors and provide novel mechanistic insights.

METHODS

Eleven participants (seven trainees and four medical students) evaluated images from the UCL polyp perception dataset, containing 25 polyps, using eye-tracking equipment. Gaze errors were defined as those where the lesion was not observed according to eye-tracking technology. Cognitive errors occurred when lesions were observed but not recognized as polyps by participants. A video study was also performed including 39 subtle polyps, where polyp recognition performance was compared with a convolutional neural network.

RESULTS

Cognitive errors occurred more frequently than gaze errors overall (65.6%), with a significantly higher proportion in trainees (P = 0.0264). In the video validation, the convolutional neural network detected significantly more polyps than trainees and medical students, with per-polyp sensitivities of 79.5%, 30.0%, and 15.4%, respectively.

CONCLUSIONS

Cognitive errors were the most common reason for visual recognition errors. The impact of interventions such as artificial intelligence, particularly on different types of perceptual errors, needs further investigation including potential effects on learning curves. To facilitate future research, a publicly accessible visual perception colonoscopy polyp database was created.

A Review of the Technology, Training, and Assessment Methods for the First Real-Time AI-Enhanced Medical Device for Endoscopy

Artificial intelligence (AI) has the potential to assist in endoscopy and improve decision making, particularly in situations where humans may make inconsistent judgments. The performance assessment of the medical devices operating in this context is a complex combination of bench tests, randomized controlled trials, and studies on the interaction between physicians and AI. We review the scientific evidence published about GI Genius, the first AI-powered medical device for colonoscopy to enter the market, and the device that is most widely tested by the scientific community. We provide an overview of its technical architecture, AI training and testing strategies, and regulatory path. In addition, we discuss the strengths and limitations of the current platform and its potential impact on clinical practice. The details of the algorithm architecture and the data that were used to train the AI device have been disclosed to the scientific community in the pursuit of a transparent AI. Overall, the first AI-enabled medical device for real-time video analysis represents a significant advancement in the use of AI for endoscopies and has the potential to improve the accuracy and efficiency of colonoscopy procedures.

Intelligent oncology: The convergence of artificial intelligence and oncology

With increasingly explored ideologies and technologies for potential applications of artificial intelligence (AI) in oncology, we here describe a holistic and structured concept termed intelligent oncology. Intelligent oncology is defined as a cross-disciplinary specialty which integrates oncology, radiology, pathology, molecular biology, multi-omics and computer sciences, aiming to promote cancer prevention, screening, early diagnosis and precision treatment. The development of intelligent oncology has been facilitated by fast AI technology development such as natural language processing, machine/deep learning, computer vision, and robotic process automation. While the concept and applications of intelligent oncology is still in its infancy, and there are still many hurdles and challenges, we are optimistic that it will play a pivotal role for the future of basic, translational and clinical oncology.

Artificial intelligence and automation in endoscopy and surgery

Modern endoscopy relies on digital technology, from high-resolution imaging sensors and displays to electronics connecting configurable illumination and actuation systems for robotic articulation. In addition to enabling more effective diagnostic and therapeutic interventions, the digitization of the procedural toolset enables video data capture of the internal human anatomy at unprecedented levels. Interventional video data encapsulate functional and structural information about a patient's anatomy as well as events, activity and action logs about the surgical process. This detailed but difficult-to-interpret record from endoscopic procedures can be linked to preoperative and postoperative records or patient imaging information. Rapid advances in artificial intelligence, especially in supervised deep learning, can utilize data from endoscopic procedures to develop systems for assisting procedures leading to computer-assisted interventions that can enable better navigation during procedures, automation of image interpretation and robotically assisted tool manipulation. In this Perspective, we summarize state-of-the-art artificial intelligence for computer-assisted interventions in gastroenterology and surgery.

A Medical Image Segmentation Method Based on Improved UNet 3+ Network

In recent years, segmentation details and computing efficiency have become more important in medical image segmentation for clinical applications. In deep learning, UNet based on a convolutional neural network is one of the most commonly used models. UNet 3+ was designed as a modified UNet by adopting the architecture of full-scale skip connections. However, full-scale feature fusion can result in excessively redundant computations. This study aimed to reduce the network parameters of UNet 3+ while further improving the feature extraction capability. First, to eliminate redundancy and improve computational efficiency, we prune the full-scale skip connections of UNet 3+. In addition, we use the attention module called Convolutional Block Attention Module (CBAM) to capture more essential features and thus improve the feature expression capabilities. The performance of the proposed model was validated by three different types of datasets: skin cancer segmentation, breast cancer segmentation, and lung segmentation. The parameters are reduced by about 36% and 18% compared to UNet and UNet 3+, respectively. The results show that the proposed method not only outperformed the comparison models in a variety of evaluation metrics but also achieved more accurate segmentation results. The proposed models have lower network parameters that enhance feature extraction and improve segmentation performance efficiently. Furthermore, the models have great potential for application in medical imaging computer-aided diagnosis.

Current Technologies for Detection of COVID-19: Biosensors, Artificial Intelligence and Internet of Medical Things (IoMT): Review

Despite the fact that COVID-19 is no longer a global pandemic due to development and integration of different technologies for the diagnosis and treatment of the disease, technological advancement in the field of molecular biology, electronics, computer science, artificial intelligence, Internet of Things, nanotechnology, etc. has led to the development of molecular approaches and computer aided diagnosis for the detection of COVID-19. This study provides a holistic approach on COVID-19 detection based on (1) molecular diagnosis which includes RT-PCR, antigen-antibody, and CRISPR-based biosensors and (2) computer aided detection based on AI-driven models which include deep learning and transfer learning approach. The review also provide comparison between these two emerging technologies and open research issues for the development of smart-IoMT-enabled platforms for the detection of COVID-19.

Computer-aided classification of colorectal segments during colonoscopy: a deep learning approach based on images of a magnetic endoscopic positioning device

OBJECTIVE

Assessment of the anatomical colorectal segment of polyps during colonoscopy is important for treatment and follow-up strategies, but is largely operator dependent. This feasibility study aimed to assess whether, using images of a magnetic endoscope imaging (MEI) positioning device, a deep learning approach can be useful to objectively divide the colorectum into anatomical segments.

METHODS

Models based on the VGG-16 based convolutional neural network architecture were developed to classify the colorectum into anatomical segments. These models were pre-trained on ImageNet data and further trained using prospectively collected data of the POLAR study in which endoscopists were using MEI (3930 still images and 90,151 video frames). Five-fold cross validation with multiple runs was used to evaluate the overall diagnostic accuracies of the models for colorectal segment classification (divided into a 5-class and 2-class colorectal segment division). The colorectal segment assignment by endoscopists was used as the reference standard.

RESULTS

For the 5-class colorectal segment division, the best performing model correctly classified the colorectal segment in 753 of the 1196 polyps, corresponding to an overall accuracy of 63%, sensitivity of 63%, specificity of 89% and kappa of 0.47. For the 2-class colorectal segment division, 1112 of the 1196 polyps were correctly classified, corresponding to an accuracy of 93%, sensitivity of 93%, specificity of 90% and kappa of 0.82.

CONCLUSION

The diagnostic performance of a deep learning approach for colorectal segment classification based on images of a MEI device is yet suboptimal (clinicaltrials.gov: NCT03822390).

Efficacy of a computer-aided detection system in a fecal immunochemical test-based organized colorectal cancer screening program: a randomized controlled trial (AIFIT study)

BACKGROUND

Computer-aided detection (CADe) increases adenoma detection in primary screening colonoscopy. The potential benefit of CADe in a fecal immunochemical test (FIT)-based colorectal cancer (CRC) screening program is unknown. This study assessed whether use of CADe increases the adenoma detection rate (ADR) in a FIT-based CRC screening program.

METHODS

In a multicenter, randomized trial, FIT-positive individuals aged 50-74 years undergoing colonoscopy, were randomized (1:1) to receive high definition white-light (HDWL) colonoscopy, with or without a real-time deep-learning CADe by endoscopists with baseline ADR > 25 %. The primary outcome was ADR. Secondary outcomes were mean number of adenomas per colonoscopy (APC) and advanced adenoma detection rate (advanced-ADR). Subgroup analysis according to baseline endoscopists' ADR (≤ 40 %, 41 %-45 %, ≥ 46 %) was also performed.

RESULTS

800 individuals (median age 61.0 years [interquartile range 55-67]; 409 men) were included: 405 underwent CADe-assisted colonoscopy and 395 underwent HDWL colonoscopy alone. ADR and APC were significantly higher in the CADe group than in the HDWL arm: ADR 53.6 % (95 %CI 48.6 %-58.5 %) vs. 45.3 % (95 %CI 40.3 %-50.45 %; RR 1.18; 95 %CI 1.03-1.36); APC 1.13 (SD 1.54) vs. 0.90 (SD 1.32; P  = 0.03). No significant difference in advanced-ADR was found (18.5 % [95 %CI 14.8 %-22.6 %] vs. 15.9 % [95 %CI 12.5 %-19.9 %], respectively). An increase in ADR was observed in all endoscopist groups regardless of baseline ADR.

CONCLUSIONS

Incorporating CADe significantly increased ADR and APC in the framework of a FIT-based CRC screening program. The impact of CADe appeared to be consistent regardless of endoscopist baseline ADR.

PHF3 Technique: A Pyramid Hybrid Feature Fusion Framework for Severity Classification of Ulcerative Colitis Using Endoscopic Images

Evaluating the severity of ulcerative colitis (UC) through the Mayo endoscopic subscore (MES) is crucial for understanding patient conditions and providing effective treatment. However, UC lesions present different characteristics in endoscopic images, exacerbating interclass similarities and intraclass differences in MES classification. In addition, inexperience and review fatigue in endoscopists introduces nontrivial challenges to the reliability and repeatability of MES evaluations. In this paper, we propose a pyramid hybrid feature fusion framework (PHF3) as an auxiliary diagnostic tool for clinical UC severity classification. Specifically, the PHF3 model has a dual-branch hybrid architecture with ResNet50 and a pyramid vision Transformer (PvT), where the local features extracted by ResNet50 represent the relationship between the intestinal wall at the near-shot point and its depth, and the global representations modeled by the PvT capture similar information in the cross-section of the intestinal cavity. Furthermore, a feature fusion module (FFM) is designed to combine local features with global representations, while second-order pooling (SOP) is applied to enhance discriminative information in the classification process. The experimental results show that, compared with existing methods, the proposed PHF3 model has competitive performance. The area under the receiver operating characteristic curve (AUC) of MES 0, MES 1, MES 2, and MES 3 reached 0.996, 0.972, 0.967, and 0.990, respectively, and the overall accuracy reached 88.91%. Thus, our proposed method is valuable for developing an auxiliary assessment system for UC severity.

Artificial Intelligence in Orthopedic Radiography Analysis: A Narrative Review

Artificial intelligence (AI) in medicine is a rapidly growing field. In orthopedics, the clinical implementations of AI have not yet reached their full potential. Deep learning algorithms have shown promising results in computed radiographs for fracture detection, classification of OA, bone age, as well as automated measurements of the lower extremities. Studies investigating the performance of AI compared to trained human readers often show equal or better results, although human validation is indispensable at the current standards. The objective of this narrative review is to give an overview of AI in medicine and summarize the current applications of AI in orthopedic radiography imaging. Due to the different AI software and study design, it is difficult to find a clear structure in this field. To produce more homogeneous studies, open-source access to AI software codes and a consensus on study design should be aimed for.

Computer-Aided Detection Improves Adenomas per Colonoscopy for Screening and Surveillance Colonoscopy: A Randomized Trial

BACKGROUND & AIMS

Colonoscopy for colorectal cancer screening is endoscopist dependent, and colonoscopy quality improvement programs aim to improve efficacy. This study evaluated the clinical benefit and safety of using a computer-aided detection (CADe) device in colonoscopy procedures.

METHODS

This randomized study prospectively evaluated the use of a CADe device at 5 academic and community centers by US board-certified gastroenterologists (n = 22). Participants aged ≥40 scheduled for screening or surveillance (≥3 years) colonoscopy were included; exclusion criteria included incomplete procedure, diagnostic indication, inflammatory bowel disease, and familial adenomatous polyposis. Patients were randomized by endoscopist to the standard or CADe colonoscopy arm using computer-generated, random-block method. The 2 primary endpoints were adenomas per colonoscopy (APC), the total number of adenomas resected divided by the total number of colonoscopies; and true histology rate (THR), the proportion of resections with clinically significant histology divided by the total number of polyp resections. The primary analysis used a modified intention-to-treat approach.

RESULTS

Between January and September 2021, 1440 participants were enrolled to be randomized. After exclusion of participants who did not meet the eligibility criteria, 677 in the standard arm and 682 in the CADe arm were included in a modified intention-to-treat analysis. APC increased significantly with use of the CADe device (standard vs CADe: 0.83 vs 1.05, P = .002; total number of adenomas, 562 vs 719). There was no decrease in THR with use of the CADe device (standard vs CADe: 71.7% vs 67.4%, P for noninferiority < .001; total number of non-neoplastic lesions, 284 vs 375). Adenoma detection rate was 43.9% and 47.8% in the standard and CADe arms, respectively (P = .065).

CONCLUSIONS

For experienced endoscopists performing screening and surveillance colonoscopies in the United States, the CADe device statistically improved overall adenoma detection (APC) without a concomitant increase in resection of non-neoplastic lesions (THR).

CLINICALTRIALS

gov registration: NCT04754347.

Diagnostic accuracy of S-Detect in distinguishing benign and malignant thyroid nodules: A meta-analysis

Objectives

In this meta-analysis study, the main objective was to determine the accuracy of S-detect in effectively distinguishing malignant thyroid nodules from benign thyroid nodules.

Methods

We searched the PubMed, Cochrane Library, and CBM databases from inception to August 1, 2021. Meta-analysis was conducted using STATA version 14.0 and Meta-Disc version 1.4 softwares. We calculated summary statistics for sensitivity (Sen), specificity (Spe), positive and negative likelihood ratio (LR⁺/LR⁻), diagnostic odds ratio(DOR), and receiver operating characteristic (SROC) curves. Cochran’s Q-statistic and I² test were used to evaluate potential heterogeneity between studies. A sensitivity analysis was performed to evaluate the influence of single studies on the overall estimate. We also performed meta-regression analyses to investigate the potential sources of heterogeneity.

Results

In this study, a total of 17 studies meeting the requirements of the standard were used. The number of benign and malignant nodules analyzed and evaluated in this paper was 1595 and 1118 respectively. This paper mainly completes the required histological confirmation through s-detect. The pooled Sen and pooled Spe were 0.87 and 0.74, respectively, (95%CI = 0.84–0.89) and (95%CI = 0.66–0.81). Furthermore, the pooled LR⁺ and negative LR⁻ were determined to be 3.37 (95%CI = 2.53–4.50) and 0.18 (95%CI = 0.15–0.21), respectively. The experimental results showed that the pooled DOR of thyroid nodules was 18.83 (95% CI = 13.21–26.84). In addition, area under SROC curve was determined to be 0.89 (SE = 0.0124). It should be pointed out that there is no evidence of bias (i.e. t = 0.25, P = 0.80).

Conclusions

Through this meta-analysis, it can be seen that the accuracy of s-detect is relatively high for the effective distinction between malignant thyroid nodules and benign thyroid nodules.

Deep learning-based artificial intelligence model for identifying swallow types in esophageal high-resolution manometry

BACKGROUND

This study aimed to build and evaluate a deep learning, artificial intelligence (AI) model to automatically classify swallow types based on raw data from esophageal high-resolution manometry (HRM).

METHODS

HRM studies on patients with no history of esophageal surgery were collected including 1,741 studies with 26,115 swallows labeled by swallow type (normal, hypercontractile, weak-fragmented, failed, and premature) by an expert interpreter per the Chicago Classification. The dataset was stratified and split into train/validation/test datasets for model development. Long short-term memory (LSTM), a type of deep-learning AI model, was trained and evaluated. The overall performance and detailed per-swallow type performance were analyzed. The interpretations of the supine swallows in a single study were further used to generate an overall classification of peristalsis.

KEY RESULTS

The LSTM model for swallow type yielded accuracies from the train/validation/test datasets of 0.86/0.81/0.83. The model's interpretation for study-level classification of peristalsis yielded accuracy of 0.88 in the test dataset. Among model misclassification, 535/698 (77%) swallows and 25/35 (71%) studies were to adjacent categories, for example, normal to weak or normal to ineffective, respectively.

CONCLUSIONS AND INFERENCES

A deep-learning AI model can automatically and accurately identify the Chicago Classification swallow types and peristalsis classification from raw HRM data. While future work to refine this model and incorporate overall manometric diagnoses are needed, this study demonstrates the role that AI will serve in the interpretation and classification of esophageal HRM studies.

A novel AI device for real-time optical characterization of colorectal polyps

Accurate in-vivo optical characterization of colorectal polyps is key to select the optimal treatment regimen during colonoscopy. However, reported accuracies vary widely among endoscopists. We developed a novel intelligent medical device able to seamlessly operate in real-time using conventional white light (WL) endoscopy video stream without virtual chromoendoscopy (blue light, BL). In this work, we evaluated the standalone performance of this computer-aided diagnosis device (CADx) on a prospectively acquired dataset of unaltered colonoscopy videos. An international group of endoscopists performed optical characterization of each polyp acquired in a prospective study, blinded to both histology and CADx result, by means of an online platform enabling careful video assessment. Colorectal polyps were categorized by reviewers, subdivided into 10 experts and 11 non-experts endoscopists, and by the CADx as either “adenoma” or “non-adenoma”. A total of 513 polyps from 165 patients were assessed. CADx accuracy in WL was found comparable to the accuracy of expert endoscopists (CADx_WL/Exp; OR 1.211 [0.766–1.915]) using histopathology as the reference standard. Moreover, CADx accuracy in WL was found superior to the accuracy of non-expert endoscopists (CADx_WL/NonExp; OR 1.875 [1.191–2.953]), and CADx accuracy in BL was found comparable to it (CADx_BL/CADx_WL; OR 0.886 [0.612–1.282]). The proposed intelligent device shows the potential to support non-expert endoscopists in systematically reaching the performances of expert endoscopists in optical characterization.

MiWEndo: Evaluation of a Microwave Colonoscopy Algorithm for Early Colorectal Cancer Detection in Ex Vivo Human Colon Models

This study assesses the efficacy of detecting colorectal cancer precursors or polyps in an ex vivo human colon model with a microwave colonoscopy algorithm. Nowadays, 22% of polyps go undetected with conventional colonoscopy, and the risk of cancer after a negative colonoscopy can be up to 7.9%. We developed a microwave colonoscopy device that consists of a cylindrical ring-shaped switchable microwave antenna array that can be attached to the tip of a conventional colonoscope as an accessory. The accessory is connected to an external unit that allows successive measurements of the colon and processes the measurements with a microwave imaging algorithm. An acoustic signal is generated when a polyp is detected. Fifteen ex vivo freshly excised human colons with cancer (n = 12) or polyps (n = 3) were examined with the microwave-assisted colonoscopy system simulating a real colonoscopy exploration. After the experiment, the dielectric properties of the specimens were measured with a coaxial probe and the samples underwent a pathology analysis. The results show that all the neoplasms were detected with a sensitivity of 100% and specificity of 87.4%.

Deep learning-based automatic segmentation of images in cardiac radiography: A promising challenge

BACKGROUND

Due to the advancement of medical imaging and computer technology, machine intelligence to analyze clinical image data increases the probability of disease prevention and successful treatment. When diagnosing and detecting heart disease, medical imaging can provide high-resolution scans of every organ or tissue in the heart. The diagnostic results obtained by the imaging method are less susceptible to human interference. They can process numerous patient information, assist doctors in early detection of heart disease, intervene and treat patients, and improve the understanding of heart disease symptoms and clinical diagnosis of great significance. In a computer-aided diagnosis system, accurate segmentation of cardiac scan images is the basis and premise of subsequent thoracic function analysis and 3D image reconstruction.

EXISTING TECHNIQUES

This paper systematically reviews automatic methods and some difficulties for cardiac segmentation in radiographic images. Combined with recent advanced deep learning techniques, the feasibility of using deep learning network models for image segmentation is discussed, and the commonly used deep learning frameworks are compared.

DEVELOPED INSIGHTS

There are many standard methods for medical image segmentation, such as traditional methods based on regions and edges and methods based on deep learning. Because of characteristics of non-uniform grayscale, individual differences, artifacts and noise of medical images, the above image segmentation methods have certain limitations. It is tough to obtain the needed results sensitivity and accuracy when performing heart segmentation. The deep learning model proposed has achieved good results in image segmentation. Accurate segmentation improves the accuracy of disease diagnosis and reduces subsequent irrelevant computations.

SUMMARY

There are two requirements for accurate segmentation of radiological images. One is to use image segmentation to improve the development of computer-aided diagnosis. The other is to achieve complete segmentation of the heart. When there are lesions or deformities in the heart, there will be some abnormalities in the radiographic images, and the segmentation algorithm needs to segment the heart altogether. The quantity of processing inside a certain range will no longer be a restriction for real-time detection with the advancement of deep learning and the enhancement of hardware device performance.

Polyp detection and false-positive rates by computer-aided analysis of withdrawal-phase videos of colonoscopy of the right-sided colon segment in a randomized controlled trial comparing water exchange and air insufflation

BACKGROUND AND AIMS

Water exchange (WE) improves lesion detection but misses polyps because of human limitations. Computer-aided detection (CADe) identifies additional polyps overlooked by the colonoscopist. Additional polyp detection rate (APDR) is the proportion of patients with at least 1 additional polyp detected by CADe. The number of false positives (because of feces and air bubble) per colonoscopy (FPPC) is a major CADe limitation, which might be reduced by salvage cleaning with WE. We compared the APDR and FPPC by CADe between videos of WE and air insufflation in the right-sided colon.

METHODS

CADe used a convolutional neural network with transfer learning. We edited and coded withdrawal-phase videos in a randomized controlled trial that compared right-sided colon findings between air insufflation and WE. Two experienced blinded endoscopists analyzed the CADe-overlaid videos and identified additional polyps by consensus. An artifact triggered by CADe but not considered a polyp by the reviewers was defined as a false positive. The primary outcome was APDR.

RESULTS

Two hundred forty-five coded videos of colonoscopies inserted with WE (n = 123) and air insufflation (n = 122) methods were analyzed. The APDR in the WE group was significantly higher (37 [30.1%] vs 15 [12.3%], P = .001). The mean [standard deviation] FPPC related to feces (1.78 [1.67] vs 2.09 [2.09], P = .007) and bubbles (.53 [.89] vs 1.25 [2.45], P = .001) in the WE group were significantly lower.

CONCLUSIONS

CADe showed significantly higher APDR and lower number of FPPC related to feces and bubbles in the WE group. The results support the hypothesis that the strengths of CADe and WE complement the weaknesses of each other in optimizing polyp detection.

Cancer in sub-Saharan Africa: a Lancet Oncology Commission

In sub-Saharan Africa (SSA), urgent action is needed to curb a growing crisis in cancer incidence and mortality. Without rapid interventions, data estimates show a major increase in cancer mortality from 520 348 in 2020 to about 1 million deaths per year by 2030. Here, we detail the state of cancer in SSA, recommend key actions on the basis of analysis, and highlight case studies and successful models that can be emulated, adapted, or improved across the region to reduce the growing cancer crises. Recommended actions begin with the need to develop or update national cancer control plans in each country. Plans must include childhood cancer plans, managing comorbidities such as HIV and malnutrition, a reliable and predictable supply of medication, and the provision of psychosocial, supportive, and palliative care. Plans should also engage traditional, complementary, and alternative medical practices employed by more than 80% of SSA populations and pathways to reduce missed diagnoses and late referrals. More substantial investment is needed in developing cancer registries and cancer diagnostics for core cancer tests. We show that investments in, and increased adoption of, some approaches used during the COVID-19 pandemic, such as hypofractionated radiotherapy and telehealth, can substantially increase access to cancer care in Africa, accelerate cancer prevention and control efforts, increase survival, and save billions of US dollars over the next decade. The involvement of African First Ladies in cancer prevention efforts represents one practical approach that should be amplified across SSA. Moreover, investments in workforce training are crucial to prevent millions of avoidable deaths by 2030. We present a framework that can be used to strategically plan cancer research enhancement in SSA, with investments in research that can produce a return on investment and help drive policy and effective collaborations. Expansion of universal health coverage to incorporate cancer into essential benefits packages is also vital. Implementation of the recommended actions in this Commission will be crucial for reducing the growing cancer crises in SSA and achieving political commitments to the UN Sustainable Development Goals to reduce premature mortality from non-communicable diseases by a third by 2030.

Preparation of image databases for artificial intelligence algorithm development in gastrointestinal endoscopy

Over the past decade, technological advances in deep learning have led to the introduction of artificial intelligence (AI) in medical imaging. The most commonly used structure in image recognition is the convolutional neural network, which mimics the action of the human visual cortex. The applications of AI in gastrointestinal endoscopy are diverse. Computer-aided diagnosis has achieved remarkable outcomes with recent improvements in machine-learning techniques and advances in computer performance. Despite some hurdles, the implementation of AI-assisted clinical practice is expected to aid endoscopists in real-time decision-making. In this summary, we reviewed state-of-the-art AI in the field of gastrointestinal endoscopy and offered a practical guide for building a learning image dataset for algorithm development.

The Feasibility of Applying Artificial Intelligence to Gastrointestinal Endoscopy to Improve the Detection Rate of Early Gastric Cancer Screening

Convolutional neural networks in the field of artificial intelligence show great potential in image recognition. It assisted endoscopy to improve the detection rate of early gastric cancer. The 5-year survival rate for advanced gastric cancer is less than 30%, while the 5-year survival rate for early gastric cancer is more than 90%. Therefore, earlier screening for gastric cancer can lead to a better prognosis. However, the detection rate of early gastric cancer in China has been extremely low due to many factors, such as the presence of gastric cancer without obvious symptoms, difficulty identifying lesions by the naked eye, and a lack of experience among endoscopists. The introduction of artificial intelligence can help mitigate these shortcomings and greatly improve the accuracy of screening. According to relevant reports, the sensitivity and accuracy of artificial intelligence trained on deep cirrocumulus neural networks are better than those of endoscopists, and evaluations also take less time, which can greatly reduce the burden on endoscopists. In addition, artificial intelligence can also perform real-time detection and feedback on the inspection process of the endoscopist to standardize the operation of the endoscopist. AI has also shown great potential in training novice endoscopists. With the maturity of AI technology, AI has the ability to improve the detection rate of early gastric cancer in China and reduce the death rate of gastric cancer related diseases in China.

Artificial Intelligence and Computer Aided Diagnosis in Chronic Low Back Pain: A Systematic Review

Low Back Pain (LBP) is currently the first cause of disability in the world, with a significant socioeconomic burden. Diagnosis and treatment of LBP often involve a multidisciplinary, individualized approach consisting of several outcome measures and imaging data along with emerging technologies. The increased amount of data generated in this process has led to the development of methods related to artificial intelligence (AI), and to computer-aided diagnosis (CAD) in particular, which aim to assist and improve the diagnosis and treatment of LBP. In this manuscript, we have systematically reviewed the available literature on the use of CAD in the diagnosis and treatment of chronic LBP. A systematic research of PubMed, Scopus, and Web of Science electronic databases was performed. The search strategy was set as the combinations of the following keywords: “Artificial Intelligence”, “Machine Learning”, “Deep Learning”, “Neural Network”, “Computer Aided Diagnosis”, “Low Back Pain”, “Lumbar”, “Intervertebral Disc Degeneration”, “Spine Surgery”, etc. The search returned a total of 1536 articles. After duplication removal and evaluation of the abstracts, 1386 were excluded, whereas 93 papers were excluded after full-text examination, taking the number of eligible articles to 57. The main applications of CAD in LBP included classification and regression. Classification is used to identify or categorize a disease, whereas regression is used to produce a numerical output as a quantitative evaluation of some measure. The best performing systems were developed to diagnose degenerative changes of the spine from imaging data, with average accuracy rates >80%. However, notable outcomes were also reported for CAD tools executing different tasks including analysis of clinical, biomechanical, electrophysiological, and functional imaging data. Further studies are needed to better define the role of CAD in LBP care.

Artificial Intelligence and the Future of Gastroenterology and Hepatology

The integration of artificial intelligence (AI) into gastroenterology and hepatology (GI) will inevitably transform the practice of GI in the coming decade. While the application of AI in health care is not new, advancements are occurring rapidly, and the future landscape of AI is beginning to come into focus. From endoscopic assistance via computer vision technology to the predictive capabilities of the vast information contained in the electronic health records, AI promises to optimize and expedite clinical and procedural practice and research in GI. The extensive body of literature already available on AI applications in gastroenterology may seem daunting at first; however, this review aims to provide a breakdown of the key studies conducted thus far and demonstrate the many potential ways this technology may impact the field. This review will also take a look into the future and imagine how GI can be transformed over the coming years, as well as potential limitations and pitfalls that must be overcome to realize this future.