1
|
Chen Y, Feng L, Huang Z, Zou W, Luo G, Dai G, Zhao W, Cai W, Luo M. Comparison of Diatrizoate and Iohexol for Patient Acceptance and Fecal-Tagging Performance in Noncathartic CT Colonography. J Comput Assist Tomogr 2024; 48:55-63. [PMID: 37558647 DOI: 10.1097/rct.0000000000001526] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/11/2023]
Abstract
OBJECTIVE The aim of this study was to compare diatrizoate and iohexol regarding patient acceptance and fecal-tagging performance in noncathartic computed tomography colonography. METHODS This study enrolled 284 volunteers with fecal tagging by either diatrizoate or iohexol at an iodine concentration of 13.33 mg/mL and an iodine load of 24 g. Patient acceptance was rated on a 4-point scale of gastrointestinal discomfort. Two gastrointestinal radiologists jointly analyzed image quality, fecal-tagging density and homogeneity, and residual contrast agent in the small intestine. The results were compared by the generalized estimating equation method. RESULTS Patient acceptance was comparable between the 2 groups (3.95 ± 0.22 vs 3.96 ± 0.20, P = 0.777). The diatrizoate group had less residual fluid and stool than the iohexol group ( P = 0.019, P = 0.004, respectively). There was no significant difference in colorectal distention, residual fluid, and stool tagging quality between the 2 groups (all P 's > 0.05). The mean 2-dimensional image quality score was 4.59 ± 0.68 with diatrizoate and 3.60 ± 1.14 with iohexol ( P < 0.001). The attenuation of tagged feces was 581 ± 66 HU with diatrizoate and 1038 ± 117 HU with iohexol ( P < 0.001). Residual contrast agent in the small intestine was assessed at 55.3% and 62.3% for the diatrizoate group and iohexol group, respectively ( P = 0.003). CONCLUSIONS Compared with iohexol, diatrizoate had better image quality, proper fecal-tagging density, and more homogeneous tagging along with comparable excellent patient acceptance, and might be more suitable for fecal tagging in noncathartic computed tomography colonography.
Collapse
Affiliation(s)
- Yanshan Chen
- From the Department of Radiology, the Six Affiliated Hospital, Sun Yat-sen University, Guangzhou
| | | | | | - Wenbin Zou
- From the Department of Radiology, the Six Affiliated Hospital, Sun Yat-sen University, Guangzhou
| | - Guibo Luo
- Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, MA
| | - Guochao Dai
- Department of Radiology, the First People's Hospital of Kashi Area, Kashi
| | - Weidong Zhao
- Department of Radiology, the Second Hospital of Shanxi Medical University, Taiyuan, China
| | - Wenli Cai
- Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, MA
| | - Mingyue Luo
- From the Department of Radiology, the Six Affiliated Hospital, Sun Yat-sen University, Guangzhou
| |
Collapse
|
2
|
Yang M, Wohlfahrt P, Shen C, Bouchard H. Dual- and multi-energy CT for particle stopping-power estimation: current state, challenges and potential. Phys Med Biol 2023; 68. [PMID: 36595276 DOI: 10.1088/1361-6560/acabfa] [Citation(s) in RCA: 10] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2022] [Accepted: 12/15/2022] [Indexed: 12/23/2022]
Abstract
Range uncertainty has been a key factor preventing particle radiotherapy from reaching its full physical potential. One of the main contributing sources is the uncertainty in estimating particle stopping power (ρs) within patients. Currently, theρsdistribution in a patient is derived from a single-energy CT (SECT) scan acquired for treatment planning by converting CT number expressed in Hounsfield units (HU) of each voxel toρsusing a Hounsfield look-up table (HLUT), also known as the CT calibration curve. HU andρsshare a linear relationship with electron density but differ in their additional dependence on elemental composition through different physical properties, i.e. effective atomic number and mean excitation energy, respectively. Because of that, the HLUT approach is particularly sensitive to differences in elemental composition between real human tissues and tissue surrogates as well as tissue variations within and among individual patients. The use of dual-energy CT (DECT) forρsprediction has been shown to be effective in reducing the uncertainty inρsestimation compared to SECT. The acquisition of CT data over different x-ray spectra yields additional information on the material elemental composition. Recently, multi-energy CT (MECT) has been explored to deduct material-specific information with higher dimensionality, which has the potential to further improve the accuracy ofρsestimation. Even though various DECT and MECT methods have been proposed and evaluated over the years, these approaches are still only scarcely implemented in routine clinical practice. In this topical review, we aim at accelerating this translation process by providing: (1) a comprehensive review of the existing DECT/MECT methods forρsestimation with their respective strengths and weaknesses; (2) a general review of uncertainties associated with DECT/MECT methods; (3) a general review of different aspects related to clinical implementation of DECT/MECT methods; (4) other potential advanced DECT/MECT applications beyondρsestimation.
Collapse
Affiliation(s)
- Ming Yang
- The University of Texas MD Anderson Cancer Center, Department of Radiation Physics, 1515 Holcombe Blvd Houston, TX 77030, United States of America
| | - Patrick Wohlfahrt
- Massachusetts General Hospital and Harvard Medical School, Department of Radiation Oncology, Boston, MA 02115, United States of America
| | - Chenyang Shen
- University of Texas Southwestern Medical Center, Department of Radiation Oncology, 2280 Inwood Rd Dallas, TX 75235, United States of America
| | - Hugo Bouchard
- Département de physique, Université de Montréal, Complexe des sciences, 1375 Avenue Thérèse-Lavoie-Roux, Montréal, Québec H2V0B3, Canada.,Centre de recherche du Centre hospitalier de l'Université de Montréal, 900 Rue Saint-Denis, Montréal, Québec, H2X 0A9, Canada.,Département de radio-oncologie, Centre hospitalier de l'Université de Montréal, 1051 Rue Sanguinet, Montréal, Québec H2X 3E4, Canada
| |
Collapse
|
3
|
Hadjiiski L, Cha K, Chan HP, Drukker K, Morra L, Näppi JJ, Sahiner B, Yoshida H, Chen Q, Deserno TM, Greenspan H, Huisman H, Huo Z, Mazurchuk R, Petrick N, Regge D, Samala R, Summers RM, Suzuki K, Tourassi G, Vergara D, Armato SG. AAPM task group report 273: Recommendations on best practices for AI and machine learning for computer-aided diagnosis in medical imaging. Med Phys 2023; 50:e1-e24. [PMID: 36565447 DOI: 10.1002/mp.16188] [Citation(s) in RCA: 19] [Impact Index Per Article: 19.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 11/13/2022] [Accepted: 11/22/2022] [Indexed: 12/25/2022] Open
Abstract
Rapid advances in artificial intelligence (AI) and machine learning, and specifically in deep learning (DL) techniques, have enabled broad application of these methods in health care. The promise of the DL approach has spurred further interest in computer-aided diagnosis (CAD) development and applications using both "traditional" machine learning methods and newer DL-based methods. We use the term CAD-AI to refer to this expanded clinical decision support environment that uses traditional and DL-based AI methods. Numerous studies have been published to date on the development of machine learning tools for computer-aided, or AI-assisted, clinical tasks. However, most of these machine learning models are not ready for clinical deployment. It is of paramount importance to ensure that a clinical decision support tool undergoes proper training and rigorous validation of its generalizability and robustness before adoption for patient care in the clinic. To address these important issues, the American Association of Physicists in Medicine (AAPM) Computer-Aided Image Analysis Subcommittee (CADSC) is charged, in part, to develop recommendations on practices and standards for the development and performance assessment of computer-aided decision support systems. The committee has previously published two opinion papers on the evaluation of CAD systems and issues associated with user training and quality assurance of these systems in the clinic. With machine learning techniques continuing to evolve and CAD applications expanding to new stages of the patient care process, the current task group report considers the broader issues common to the development of most, if not all, CAD-AI applications and their translation from the bench to the clinic. The goal is to bring attention to the proper training and validation of machine learning algorithms that may improve their generalizability and reliability and accelerate the adoption of CAD-AI systems for clinical decision support.
Collapse
Affiliation(s)
- Lubomir Hadjiiski
- Department of Radiology, University of Michigan, Ann Arbor, Michigan, USA
| | - Kenny Cha
- U.S. Food and Drug Administration, Silver Spring, Maryland, USA
| | - Heang-Ping Chan
- Department of Radiology, University of Michigan, Ann Arbor, Michigan, USA
| | - Karen Drukker
- Department of Radiology, University of Chicago, Chicago, Illinois, USA
| | - Lia Morra
- Department of Control and Computer Engineering, Politecnico di Torino, Torino, Italy
| | - Janne J Näppi
- 3D Imaging Research, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Berkman Sahiner
- U.S. Food and Drug Administration, Silver Spring, Maryland, USA
| | - Hiroyuki Yoshida
- 3D Imaging Research, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, Boston, Massachusetts, USA
| | - Quan Chen
- Department of Radiation Medicine, University of Kentucky, Lexington, Kentucky, USA
| | - Thomas M Deserno
- Peter L. Reichertz Institute for Medical Informatics of TU Braunschweig and Hannover Medical School, Braunschweig, Germany
| | - Hayit Greenspan
- Department of Biomedical Engineering, Faculty of Engineering, Tel Aviv, Israel & Department of Radiology, Ichan School of Medicine, Tel Aviv University, Mt Sinai, New York, New York, USA
| | - Henkjan Huisman
- Radboud Institute for Health Sciences, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Zhimin Huo
- Tencent America, Palo Alto, California, USA
| | - Richard Mazurchuk
- Division of Cancer Prevention, National Cancer Institute, National Institutes of Health, Bethesda, Maryland, USA
| | | | - Daniele Regge
- Radiology Unit, Candiolo Cancer Institute, FPO-IRCCS, Candiolo, Italy.,Department of Surgical Sciences, University of Turin, Turin, Italy
| | - Ravi Samala
- U.S. Food and Drug Administration, Silver Spring, Maryland, USA
| | - Ronald M Summers
- Radiology and Imaging Sciences, National Institutes of Health Clinical Center, Bethesda, Maryland, USA
| | - Kenji Suzuki
- Institute of Innovative Research, Tokyo Institute of Technology, Tokyo, Japan
| | | | - Daniel Vergara
- Department of Radiology, Yale New Haven Hospital, New Haven, Connecticut, USA
| | - Samuel G Armato
- Department of Radiology, University of Chicago, Chicago, Illinois, USA
| |
Collapse
|
4
|
Grosu S, Wiemker R, An C, Obmann MM, Wong E, Yee J, Yeh BM. Comparison of the performance of conventional and spectral-based tagged stool cleansing algorithms at CT colonography. Eur Radiol 2022; 32:7936-7945. [PMID: 35486170 DOI: 10.1007/s00330-022-08831-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2022] [Revised: 03/15/2022] [Accepted: 04/20/2022] [Indexed: 01/03/2023]
Abstract
OBJECTIVES To compare the performance of conventional versus spectral-based electronic stool cleansing for iodine-tagged CT colonography (CTC) using a dual-layer spectral detector scanner. METHODS We retrospectively evaluated iodine contrast stool-tagged CTC scans of 30 consecutive patients (mean age: 69 ± 8 years) undergoing colorectal cancer screening obtained on a dual-layer spectral detector CT scanner. One reader identified locations of electronic cleansing artifacts (n = 229) on conventional and spectral cleansed images. Three additional independent readers evaluated these locations using a conventional cleansing algorithm (Intellispace Portal) and two experimental spectral cleansing algorithms (i.e., fully transparent and translucent tagged stool). For each cleansed image set, readers recorded the severity of over- and under-cleansing artifacts on a 5-point Likert scale (0 = none to 4 = severe) and readability compared to uncleansed images. Wilcoxon's signed-rank tests were used to assess artifact severity, type, and readability (worse, unchanged, or better). RESULTS Compared with conventional cleansing (66% score ≥ 2), the severity of overall cleansing artifacts was lower in transparent (60% score ≥ 2, p = 0.011) and translucent (50% score ≥ 2, p < 0.001) spectral cleansing. Under-cleansing artifact severity was lower in transparent (49% score ≥ 2, p < 0.001) and translucent (39% score ≥ 2, p < 0.001) spectral cleansing compared with conventional cleansing (60% score ≥ 2). Over-cleansing artifact severity was worse in transparent (17% score ≥ 2, p < 0.001) and translucent (14% score ≥ 2, p = 0.023) spectral cleansing compared with conventional cleansing (9% score ≥ 2). Overall readability was significantly improved in transparent (p < 0.001) and translucent (p < 0.001) spectral cleansing compared with conventional cleansing. CONCLUSIONS Spectral cleansing provided more robust electronic stool cleansing of iodine-tagged stool at CTC than conventional cleansing. KEY POINTS • Spectral-based electronic cleansing of tagged stool at CT colonography provides higher quality images with less perception of artifacts than does conventional cleansing. • Spectral-based electronic cleansing could potentially advance minimally cathartic approach for CT colonography. Further clinical trials are warranted.
Collapse
Affiliation(s)
- Sergio Grosu
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, 513 Parnassus Avenue, San Francisco, CA, 94143, USA.
- Department of Radiology, University Hospital, LMU Munich, Marchioninistraße 15, 81377, Munich, Germany.
| | - Rafael Wiemker
- Philips Research Laboratories Hamburg, Röntgenstraße 24, 22335, Hamburg, Germany
| | - Chansik An
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, 513 Parnassus Avenue, San Francisco, CA, 94143, USA
| | - Markus M Obmann
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, 513 Parnassus Avenue, San Francisco, CA, 94143, USA
- Department of Radiology and Nuclear Imaging, University Hospital Basel, Petersgraben 4, CH - 4051, Basel, Switzerland
| | - Eddy Wong
- CT/AMI Clinical Science, Philips Healthcare, 100 Park Avenue, Orange Village, OH, 44122, USA
| | - Judy Yee
- Department of Radiology, Montefiore Medical Center, Albert Einstein College of Medicine, 111 E 210th Street, Bronx, NY, 10467-2401, USA
| | - Benjamin M Yeh
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, 513 Parnassus Avenue, San Francisco, CA, 94143, USA
| |
Collapse
|
5
|
Tachibana R, Näppi JJ, Hironaka T, Yoshida H. Self-Supervised Adversarial Learning with a Limited Dataset for Electronic Cleansing in Computed Tomographic Colonography: A Preliminary Feasibility Study. Cancers (Basel) 2022; 14:4125. [PMID: 36077662 PMCID: PMC9454562 DOI: 10.3390/cancers14174125] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2022] [Revised: 08/15/2022] [Accepted: 08/18/2022] [Indexed: 11/17/2022] Open
Abstract
Existing electronic cleansing (EC) methods for computed tomographic colonography (CTC) are generally based on image segmentation, which limits their accuracy to that of the underlying voxels. Because of the limitations of the available CTC datasets for training, traditional deep learning is of limited use in EC. The purpose of this study was to evaluate the technical feasibility of using a novel self-supervised adversarial learning scheme to perform EC with a limited training dataset with subvoxel accuracy. A three-dimensional (3D) generative adversarial network (3D GAN) was pre-trained to perform EC on CTC datasets of an anthropomorphic phantom. The 3D GAN was then fine-tuned to each input case by use of the self-supervised scheme. The architecture of the 3D GAN was optimized by use of a phantom study. The visually perceived quality of the virtual cleansing by the resulting 3D GAN compared favorably to that of commercial EC software on the virtual 3D fly-through examinations of 18 clinical CTC cases. Thus, the proposed self-supervised 3D GAN, which can be trained to perform EC on a small dataset without image annotations with subvoxel accuracy, is a potentially effective approach for addressing the remaining technical problems of EC in CTC.
Collapse
Affiliation(s)
- Rie Tachibana
- 3D Imaging Research, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, 25 New Chardon Street, Suite 400C, Boston, MA 02114, USA
- Information Science & Technology Department, National Institute of Technology, Oshima College, 1091-1 Komatsu Suo-Oshima, Oshima, Yamaguchi 742-2193, Japan
| | - Janne J. Näppi
- 3D Imaging Research, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, 25 New Chardon Street, Suite 400C, Boston, MA 02114, USA
| | - Toru Hironaka
- 3D Imaging Research, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, 25 New Chardon Street, Suite 400C, Boston, MA 02114, USA
| | - Hiroyuki Yoshida
- 3D Imaging Research, Department of Radiology, Massachusetts General Hospital and Harvard Medical School, 25 New Chardon Street, Suite 400C, Boston, MA 02114, USA
| |
Collapse
|
6
|
Diagnostic accuracy of ultra-low-dose CT colonography for the detection of colorectal polyps: a feasibility study. Jpn J Radiol 2022; 40:831-839. [PMID: 35344130 DOI: 10.1007/s11604-022-01266-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/12/2021] [Accepted: 03/10/2022] [Indexed: 10/18/2022]
Abstract
PURPOSE The aim of this feasibility study was to evaluate the diagnostic accuracy of ultra-low-dose CT colonography using iterative reconstruction algorithms with reference to standard colonoscopy. MATERIALS AND METHODS Prior to this study, a phantom study was performed to investigate the optimal protocol for ultra-low-dose CT colonography. A total of 206 patients with average/high risk of colorectal cancer were recruited. After undergoing full bowel preparation, the patients were scanned in the prone and supine positions with the CT conditions set to 120 kV, standard deviation 45 to 50, and an adaptive iterative reconstruction algorithm applied. Two expert readers read the images independently. The main outcome measures were the per-patient and per-polyp accuracies for the detection of polyps ≥ 10 mm, with colonoscopy results as the reference standard. RESULTS Two hundred patients (102 females, mean age 67.5 years) underwent both ultra-low-dose CT colonography and colonoscopy on the same day. The mean radiation exposure dose was 0.64 ± 0.34 mSv. On colonoscopy, 39 patients had 45 polyps ≥ 10 mm (non-polypoid morphology 7), including 4 cancers. Per-patient sensitivity, specificity, and accuracy of CT colonography for polyps ≥ 10 mm were 0.74, 0.96, and 0.92 for reader one, and 0.74, 0.99, and 0.94 for reader two, respectively. Per-polyp sensitivities for polyps ≥ 10 mm were 0.73 for reader one and 0.71 for reader two. On subgroup analysis by morphology, non-polypoid polyps ≥ 10 mm were not detected by both readers. CONCLUSION Extreme ultra-low-dose CT colonography had an insufficient diagnostic performance for the detection of polyps ≥ 10 mm, because it was unable to detect non-polypoid polyps. This study showed that the problem with ultra-low-dose CT colonography was the lack of detectability of small-size polyps, especially non-polypoid polyps. To use ultra-low-dose CT colonography clinically, it is necessary to resolve the problems identified by this study.
Collapse
|
7
|
Automatic Detection and Segmentation of Colorectal Cancer with Deep Residual Convolutional Neural Network. EVIDENCE-BASED COMPLEMENTARY AND ALTERNATIVE MEDICINE 2022; 2022:3415603. [PMID: 35341149 PMCID: PMC8947925 DOI: 10.1155/2022/3415603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/16/2021] [Accepted: 02/07/2022] [Indexed: 11/22/2022]
Abstract
Early and automatic detection of colorectal tumors is essential for cancer analysis, and the same is implemented using computer-aided diagnosis (CAD). A computerized tomography (CT) image of the colon is being used to identify colorectal carcinoma. Digital imaging and communication in medicine (DICOM) is a standard medical imaging format to process and analyze images digitally. Accurate detection of tumor cells in the complex digestive tract is necessary for optimal treatment. The proposed work is divided into two phases. The first phase involves the segmentation, and the second phase is the extraction of the colon lesions with the observed segmentation parameters. A deep convolutional neural network (DCNN) based residual network approach for the colon and polyps' segmentation from the CT images is applied over the 2D CT images. The residual stack block is being added to the hidden layers with short skip nuance, which helps to retain spatial information. ResNet-enabled CNN is employed in the current work to achieve complete boundary segmentation of the colon cancer region. The results obtained through segmentation serve as features for further extraction and classification of benign as well as malignant colon cancer. Performance evaluation metrics indicate that the proposed network model has effectively segmented and classified colorectal tumors with dice scores of 91.57% (on average), sensitivity = 98.28, specificity = 98.68, and accuracy = 98.82.
Collapse
|
8
|
Adam SZ, Rabinowich A, Kessner R, Blachar A. Spectral CT of the abdomen: Where are we now? Insights Imaging 2021; 12:138. [PMID: 34580788 PMCID: PMC8476679 DOI: 10.1186/s13244-021-01082-7] [Citation(s) in RCA: 35] [Impact Index Per Article: 11.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/30/2021] [Accepted: 08/16/2021] [Indexed: 12/14/2022] Open
Abstract
Spectral CT adds a new dimension to radiological evaluation, beyond assessment of anatomical abnormalities. Spectral data allows for detection of specific materials, improves image quality while at the same time reducing radiation doses and contrast media doses, and decreases the need for follow up evaluation of indeterminate lesions. We review the different acquisition techniques of spectral images, mainly dual-source, rapid kV switching and dual-layer detector, and discuss the main spectral results available. We also discuss the use of spectral imaging in abdominal pathologies, emphasizing the strengths and pitfalls of the technique and its main applications in general and in specific organs.
Collapse
Affiliation(s)
- Sharon Z Adam
- Department of Diagnostic Radiology, Tel Aviv Sourasky Medical Center, 6 Weizmann St., 6423906, Tel Aviv, Israel. .,Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel.
| | - Aviad Rabinowich
- Department of Diagnostic Radiology, Tel Aviv Sourasky Medical Center, 6 Weizmann St., 6423906, Tel Aviv, Israel.,Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Rivka Kessner
- Department of Diagnostic Radiology, Tel Aviv Sourasky Medical Center, 6 Weizmann St., 6423906, Tel Aviv, Israel.,Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel
| | - Arye Blachar
- Department of Diagnostic Radiology, Tel Aviv Sourasky Medical Center, 6 Weizmann St., 6423906, Tel Aviv, Israel.,Sackler School of Medicine, Tel Aviv University, Tel Aviv, Israel
| |
Collapse
|
9
|
Zhou SK, Greenspan H, Davatzikos C, Duncan JS, van Ginneken B, Madabhushi A, Prince JL, Rueckert D, Summers RM. A review of deep learning in medical imaging: Imaging traits, technology trends, case studies with progress highlights, and future promises. PROCEEDINGS OF THE IEEE. INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS 2021; 109:820-838. [PMID: 37786449 PMCID: PMC10544772 DOI: 10.1109/jproc.2021.3054390] [Citation(s) in RCA: 219] [Impact Index Per Article: 73.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 10/04/2023]
Abstract
Since its renaissance, deep learning has been widely used in various medical imaging tasks and has achieved remarkable success in many medical imaging applications, thereby propelling us into the so-called artificial intelligence (AI) era. It is known that the success of AI is mostly attributed to the availability of big data with annotations for a single task and the advances in high performance computing. However, medical imaging presents unique challenges that confront deep learning approaches. In this survey paper, we first present traits of medical imaging, highlight both clinical needs and technical challenges in medical imaging, and describe how emerging trends in deep learning are addressing these issues. We cover the topics of network architecture, sparse and noisy labels, federating learning, interpretability, uncertainty quantification, etc. Then, we present several case studies that are commonly found in clinical practice, including digital pathology and chest, brain, cardiovascular, and abdominal imaging. Rather than presenting an exhaustive literature survey, we instead describe some prominent research highlights related to these case study applications. We conclude with a discussion and presentation of promising future directions.
Collapse
Affiliation(s)
- S Kevin Zhou
- School of Biomedical Engineering, University of Science and Technology of China and Institute of Computing Technology, Chinese Academy of Sciences
| | - Hayit Greenspan
- Biomedical Engineering Department, Tel-Aviv University, Israel
| | - Christos Davatzikos
- Radiology Department and Electrical and Systems Engineering Department, University of Pennsylvania, USA
| | - James S Duncan
- Departments of Biomedical Engineering and Radiology & Biomedical Imaging, Yale University
| | | | - Anant Madabhushi
- Department of Biomedical Engineering, Case Western Reserve University and Louis Stokes Cleveland Veterans Administration Medical Center, USA
| | - Jerry L Prince
- Electrical and Computer Engineering Department, Johns Hopkins University, USA
| | - Daniel Rueckert
- Klinikum rechts der Isar, TU Munich, Germany and Department of Computing, Imperial College, UK
| | | |
Collapse
|
10
|
Hegde N, Shishir M, Shashank S, Dayananda P, Latte MV. A Survey on Machine Learning and Deep Learning-based Computer-Aided Methods for Detection of Polyps in CT Colonography. Curr Med Imaging 2021; 17:3-15. [PMID: 32294045 DOI: 10.2174/2213335607999200415141427] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2019] [Revised: 02/09/2020] [Accepted: 02/27/2020] [Indexed: 11/22/2022]
Abstract
BACKGROUND Colon cancer generally begins as a neoplastic growth of tissue, called polyps, originating from the inner lining of the colon wall. Most colon polyps are considered harmless but over the time, they can evolve into colon cancer, which, when diagnosed in later stages, is often fatal. Hence, time is of the essence in the early detection of polyps and the prevention of colon cancer. METHODS To aid this endeavor, many computer-aided methods have been developed, which use a wide array of techniques to detect, localize and segment polyps from CT Colonography images. In this paper, a comprehensive state-of-the-art method is proposed and categorize this work broadly using the available classification techniques using Machine Learning and Deep Learning. CONCLUSION The performance of each of the proposed approach is analyzed with existing methods and also how they can be used to tackle the timely and accurate detection of colon polyps.
Collapse
Affiliation(s)
- Niharika Hegde
- JSS Academy of Technical Education, Bangalore-560060, Karnataka, India
| | - M Shishir
- JSS Academy of Technical Education, Bangalore-560060, Karnataka, India
| | - S Shashank
- JSS Academy of Technical Education, Bangalore-560060, Karnataka, India
| | - P Dayananda
- JSS Academy of Technical Education, Bangalore-560060, Karnataka, India
| | | |
Collapse
|
11
|
A generative flow-based model for volumetric data augmentation in 3D deep learning for computed tomographic colonography. Int J Comput Assist Radiol Surg 2020; 16:81-89. [PMID: 33150471 PMCID: PMC7822776 DOI: 10.1007/s11548-020-02275-z] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2020] [Accepted: 09/30/2020] [Indexed: 01/08/2023]
Abstract
Purpose Deep learning can be used for improving the performance of computer-aided detection (CADe) in various medical imaging tasks. However, in computed tomographic (CT) colonography, the performance is limited by the relatively small size and the variety of the available training datasets. Our purpose in this study was to develop and evaluate a flow-based generative model for performing 3D data augmentation of colorectal polyps for effective training of deep learning in CADe for CT colonography. Methods We developed a 3D-convolutional neural network (3D CNN) based on a flow-based generative model (3D Glow) for generating synthetic volumes of interest (VOIs) that has characteristics similar to those of the VOIs of its training dataset. The 3D Glow was trained to generate synthetic VOIs of polyps by use of our clinical CT colonography case collection. The evaluation was performed by use of a human observer study with three observers and by use of a CADe-based polyp classification study with a 3D DenseNet. Results The area-under-the-curve values of the receiver operating characteristic analysis of the three observers were not statistically significantly different in distinguishing between real polyps and synthetic polyps. When trained with data augmentation by 3D Glow, the 3D DenseNet yielded a statistically significantly higher polyp classification performance than when it was trained with alternative augmentation methods. Conclusion The 3D Glow-generated synthetic polyps are visually indistinguishable from real colorectal polyps. Their application to data augmentation can substantially improve the performance of 3D CNNs in CADe for CT colonography. Thus, 3D Glow is a promising method for improving the performance of deep learning in CADe for CT colonography.
Collapse
|
12
|
Mang T, Bräuer C, Gryspeerdt S, Scharitzer M, Ringl H, Lefere P. Electronic cleansing of tagged residue in CT colonography: what radiologists need to know. Insights Imaging 2020; 11:47. [PMID: 32170498 PMCID: PMC7070139 DOI: 10.1186/s13244-020-00848-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/23/2019] [Accepted: 02/11/2020] [Indexed: 12/29/2022] Open
Abstract
CT colonography (CTC) is the radiological examination of choice for the diagnosis of colorectal neoplasia. Faecal tagging is considered a mandatory part of bowel preparation. However, the colonic mucosa, obscured by tagged residue, is not accessible to endoluminal 3D views and requires time-consuming 2D evaluation. Electronic cleansing (EC) software algorithms can overcome this limitation by digitally subtracting tagged residue from the colonic lumen. Ideally, this enables a seamless 3D endoluminal evaluation. Despite this benefit, EC is a potential source of a wide range of artefacts. Accurate EC requires proper CTC examination technique and faecal tagging. The digital subtraction process has been shown to affect the relevant morphological features of both colonic anatomy and colonic lesions, if submerged under faecal residue. This article summarises the potential effects of EC on CTC imaging, the consequences for reporting and patient management, and strategies to avoid pitfalls. Furthermore, potentially negative effects on clinical reporting and patient management are shown, and problem-solving techniques, as well as recommendations for the appropriate use of EC techniques, are presented. Radiologists using EC should be familiar with EC-related effects on polyp size and also with correct measurement techniques.
Collapse
Affiliation(s)
- Thomas Mang
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Währinger Gürtel 18-20, A-1090, Vienna, Austria.
| | - Christian Bräuer
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Währinger Gürtel 18-20, A-1090, Vienna, Austria
| | - Stefaan Gryspeerdt
- Department of Radiology, AZ Delta, Bruggesteenweg 90, B-8800, Roeselare, Belgium
| | - Martina Scharitzer
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Währinger Gürtel 18-20, A-1090, Vienna, Austria
| | - Helmut Ringl
- Department of Radiology, Danube Hospital Vienna, Langobardenstrasse 122, A-1220, Wien, Austria
| | - Philippe Lefere
- Department of Radiology, AZ Delta, Bruggesteenweg 90, B-8800, Roeselare, Belgium
| |
Collapse
|
13
|
Enhancement of Deep Learning in Image Classification Performance Using Xception with the Swish Activation Function for Colorectal Polyp Preliminary Screening. MATHEMATICS 2019. [DOI: 10.3390/math7121170] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/06/2023]
Abstract
One of the leading forms of cancer is colorectal cancer (CRC), which is responsible for increasing mortality in young people. The aim of this paper is to provide an experimental modification of deep learning of Xception with Swish and assess the possibility of developing a preliminary colorectal polyp screening system by training the proposed model with a colorectal topogram dataset in two and three classes. The results indicate that the proposed model can enhance the original convolutional neural network model with evaluation classification performance by achieving accuracy of up to 98.99% for classifying into two classes and 91.48% for three classes. For testing of the model with another external image, the proposed method can also improve the prediction compared to the traditional method, with 99.63% accuracy for true prediction of two classes and 80.95% accuracy for true prediction of three classes.
Collapse
|