1
|
Paramasamy J, Mandal S, Blomjous M, Mulders T, Bos D, Aerts JGJV, Vanapalli P, Challa V, Sathyamurthy S, Devi R, Jain R, Visser JJ. Validation of a commercially available CAD-system for lung nodule detection and characterization using CT-scans. Eur Radiol 2024:10.1007/s00330-024-10969-0. [PMID: 39042303 DOI: 10.1007/s00330-024-10969-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2024] [Revised: 05/27/2024] [Accepted: 06/30/2024] [Indexed: 07/24/2024]
Abstract
OBJECTIVES This study aims to externally validate a commercially available Computer-Aided Detection (CAD)-system for the automatic detection and characterization of solid, part-solid, and ground-glass lung nodules (LN) on CT scans. METHODS This retrospective study encompasses 263 chest CT scans performed between January 2020 and December 2021 at a Dutch university hospital. All scans were read by a radiologist (R1) and compared with the initial radiology report. Conflicting scans were assessed by an adjudicating radiologist (R2). All scans were also processed by CAD. The standalone performance of CAD in terms of sensitivity and false-positive (FP)-rate for detection was calculated together with the sensitivity for characterization, including texture, calcification, speculation, and location. The R1's detection sensitivity was also assessed. RESULTS A total of 183 true nodules were identified in 121 nodule-containing scans (142 non-nodule-containing scans), of which R1 identified 165/183 (90.2%). CAD detected 149 nodules, of which 12 were not identified by R1, achieving a sensitivity of 149/183 (81.4%) with an FP-rate of 49/121 (0.405). CAD's detection sensitivity for solid, part-solid, and ground-glass LNs was 82/94 (87.2%), 42/47 (89.4%), and 25/42 (59.5%), respectively. The classification accuracy for solid, part-solid, and ground-glass LNs was 81/82 (98.8%), 16/42 (38.1%), and 18/25 (72.0%), respectively. Additionally, CAD demonstrated overall classification accuracies of 137/149 (91.9%), 123/149 (82.6%), and 141/149 (94.6%) for calcification, spiculation, and location, respectively. CONCLUSIONS Although the overall detection rate of this system slightly lags behind that of a radiologist, CAD is capable of detecting different LNs and thereby has the potential to enhance a reader's detection rate. While promising characterization performances are obtained, the tool's performance in terms of texture classification remains a subject of concern. CLINICAL RELEVANCE STATEMENT Numerous lung nodule computer-aided detection-systems are commercially available, with some of them solely being externally validated based on their detection performance on solid nodules. We encourage researchers to assess performances by incorporating all relevant characteristics, including part-solid and ground-glass nodules. KEY POINTS Few computer-aided detection (CAD) systems are externally validated for automatic detection and characterization of lung nodules. A detection sensitivity of 81.4% and an overall texture classification sensitivity of 77.2% were measured utilizing CAD. CAD has the potential to increase single reader detection rate, however, improvement in texture classification is required.
Collapse
Affiliation(s)
- Jasika Paramasamy
- Department of Radiology and Nuclear Medicine, Erasmus Medical Center, Dr. Molewaterplein 40, 3015 GD, Rotterdam, The Netherlands
| | - Souvik Mandal
- Qure.ai, Level 7, Oberoi Commerz II, Goregaon East, Mumbai, 400063, India
| | - Maurits Blomjous
- Department of Radiology and Nuclear Medicine, Erasmus Medical Center, Dr. Molewaterplein 40, 3015 GD, Rotterdam, The Netherlands
| | - Ties Mulders
- Department of Radiology and Nuclear Medicine, Erasmus Medical Center, Dr. Molewaterplein 40, 3015 GD, Rotterdam, The Netherlands
| | - Daniel Bos
- Department of Radiology and Nuclear Medicine, Erasmus Medical Center, Dr. Molewaterplein 40, 3015 GD, Rotterdam, The Netherlands
| | - Joachim G J V Aerts
- Department of Radiology and Nuclear Medicine, Erasmus Medical Center, Dr. Molewaterplein 40, 3015 GD, Rotterdam, The Netherlands
| | - Prakash Vanapalli
- Qure.ai, Level 7, Oberoi Commerz II, Goregaon East, Mumbai, 400063, India
| | - Vikash Challa
- Qure.ai, Level 7, Oberoi Commerz II, Goregaon East, Mumbai, 400063, India
| | | | - Ranjana Devi
- Qure.ai, Level 7, Oberoi Commerz II, Goregaon East, Mumbai, 400063, India
| | - Ritvik Jain
- Qure.ai, Level 7, Oberoi Commerz II, Goregaon East, Mumbai, 400063, India
| | - Jacob J Visser
- Department of Radiology and Nuclear Medicine, Erasmus Medical Center, Dr. Molewaterplein 40, 3015 GD, Rotterdam, The Netherlands.
| |
Collapse
|
2
|
Kim J. [Studies and Real-World Experience Regarding the Clinical Application of Artificial Intelligence Software for Lung Nodule Detection]. JOURNAL OF THE KOREAN SOCIETY OF RADIOLOGY 2024; 85:705-713. [PMID: 39130781 PMCID: PMC11310431 DOI: 10.3348/jksr.2024.0044] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/28/2024] [Revised: 07/10/2024] [Accepted: 07/24/2024] [Indexed: 08/13/2024]
Abstract
This article discusses studies and real-world experiences related to the clinical application of artificial intelligence-based computer-aided detection (AI-CAD) software (LuCAS-plus, Monitor Corporation) in detecting pulmonary nodules. During clinical trials for lung cancer screening, AI-CAD exhibited performance comparable to that of medical professionals in terms of sensitivity and specificity. Studies revealed that applying AI-CAD for diagnosing pulmonary metastases led to high detection rates. The use of a nodule matching algorithm in diagnosing pulmonary metastases significantly reduced false non-metastasis results. In clinical settings, implementing AI-CAD enhanced the efficiency of pulmonary nodule detection, saving time and effort during CT reading. Overall, AI-CAD is expected to offer substantial support for lung cancer screening and the interpretation of chest CT scans for malignant tumor surveillance.
Collapse
|
3
|
Peters AA, Solomon JB, von Stackelberg O, Samei E, Alsaihati N, Valenzuela W, Debic M, Heidt C, Huber AT, Christe A, Heverhagen JT, Kauczor HU, Heussel CP, Ebner L, Wielpütz MO. Influence of CT dose reduction on AI-driven malignancy estimation of incidental pulmonary nodules. Eur Radiol 2024; 34:3444-3452. [PMID: 37870625 PMCID: PMC11126495 DOI: 10.1007/s00330-023-10348-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Revised: 08/10/2023] [Accepted: 09/03/2023] [Indexed: 10/24/2023]
Abstract
OBJECTIVES The purpose of this study was to determine the influence of dose reduction on a commercially available lung cancer prediction convolutional neuronal network (LCP-CNN). METHODS CT scans from a cohort provided by the local lung cancer center (n = 218) with confirmed pulmonary malignancies and their corresponding reduced dose simulations (25% and 5% dose) were subjected to the LCP-CNN. The resulting LCP scores (scale 1-10, increasing malignancy risk) and the proportion of correctly classified nodules were compared. The cohort was divided into a low-, medium-, and high-risk group based on the respective LCP scores; shifts between the groups were studied to evaluate the potential impact on nodule management. Two different malignancy risk score thresholds were analyzed: a higher threshold of ≥ 9 ("rule-in" approach) and a lower threshold of > 4 ("rule-out" approach). RESULTS In total, 169 patients with 196 nodules could be included (mean age ± SD, 64.5 ± 9.2 year; 49% females). Mean LCP scores for original, 25% and 5% dose levels were 8.5 ± 1.7, 8.4 ± 1.7 (p > 0.05 vs. original dose) and 8.2 ± 1.9 (p < 0.05 vs. original dose), respectively. The proportion of correctly classified nodules with the "rule-in" approach decreased with simulated dose reduction from 58.2 to 56.1% (p = 0.34) and to 52.0% for the respective dose levels (p = 0.01). For the "rule-out" approach the respective values were 95.9%, 96.4%, and 94.4% (p = 0.12). When reducing the original dose to 25%/5%, eight/twenty-two nodules shifted to a lower, five/seven nodules to a higher malignancy risk group. CONCLUSION CT dose reduction may affect the analyzed LCP-CNN regarding the classification of pulmonary malignancies and potentially alter pulmonary nodule management. CLINICAL RELEVANCE STATEMENT Utilization of a "rule-out" approach with a lower malignancy risk threshold prevents underestimation of the nodule malignancy risk for the analyzed software, especially in high-risk cohorts. KEY POINTS • LCP-CNN may be affected by CT image parameters such as noise resulting from low-dose CT acquisitions. • CT dose reduction can alter pulmonary nodule management recommendations by affecting the outcome of the LCP-CNN. • Utilization of a lower malignancy risk threshold prevents underestimation of pulmonary malignancies in high-risk cohorts.
Collapse
Affiliation(s)
- Alan A Peters
- Diagnostic and Interventional Radiology, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany.
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse, 3010, Bern, Switzerland.
- Translational Lung Research Center Heidelberg (TLRC), German Center for Lung Research (DZL), Im Neuenheimer Feld 156, 69120, Heidelberg, Germany.
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, Thoraxklinik at University of Heidelberg, Röntgenstraße 1, 69126, Heidelberg, Germany.
| | - Justin B Solomon
- Carl E. Ravin Advanced Imaging Laboratories, Medical Physics Graduate Program, Clinical Imaging Physics Group, Department of Radiology, Duke University Medical Center, Durham, NC, USA
| | - Oyunbileg von Stackelberg
- Diagnostic and Interventional Radiology, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
- Translational Lung Research Center Heidelberg (TLRC), German Center for Lung Research (DZL), Im Neuenheimer Feld 156, 69120, Heidelberg, Germany
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, Thoraxklinik at University of Heidelberg, Röntgenstraße 1, 69126, Heidelberg, Germany
| | - Ehsan Samei
- Carl E. Ravin Advanced Imaging Laboratories, Medical Physics Graduate Program, Clinical Imaging Physics Group, Department of Radiology, Duke University Medical Center, Durham, NC, USA
| | - Njood Alsaihati
- Carl E. Ravin Advanced Imaging Laboratories, Medical Physics Graduate Program, Clinical Imaging Physics Group, Department of Radiology, Duke University Medical Center, Durham, NC, USA
| | - Waldo Valenzuela
- University Institute for Diagnostic and Interventional Neuroradiology, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse, 3010, Bern, Switzerland
| | - Manuel Debic
- Diagnostic and Interventional Radiology, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
- Translational Lung Research Center Heidelberg (TLRC), German Center for Lung Research (DZL), Im Neuenheimer Feld 156, 69120, Heidelberg, Germany
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, Thoraxklinik at University of Heidelberg, Röntgenstraße 1, 69126, Heidelberg, Germany
| | - Christian Heidt
- Diagnostic and Interventional Radiology, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
- Translational Lung Research Center Heidelberg (TLRC), German Center for Lung Research (DZL), Im Neuenheimer Feld 156, 69120, Heidelberg, Germany
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, Thoraxklinik at University of Heidelberg, Röntgenstraße 1, 69126, Heidelberg, Germany
| | - Adrian T Huber
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse, 3010, Bern, Switzerland
| | - Andreas Christe
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse, 3010, Bern, Switzerland
| | - Johannes T Heverhagen
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse, 3010, Bern, Switzerland
- Department of BioMedical Research, Experimental Radiology, University of Bern, Bern, Switzerland
- Department of Radiology, The Ohio State University, Columbus, OH, USA
| | - Hans-Ulrich Kauczor
- Diagnostic and Interventional Radiology, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
- Translational Lung Research Center Heidelberg (TLRC), German Center for Lung Research (DZL), Im Neuenheimer Feld 156, 69120, Heidelberg, Germany
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, Thoraxklinik at University of Heidelberg, Röntgenstraße 1, 69126, Heidelberg, Germany
| | - Claus P Heussel
- Diagnostic and Interventional Radiology, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
- Translational Lung Research Center Heidelberg (TLRC), German Center for Lung Research (DZL), Im Neuenheimer Feld 156, 69120, Heidelberg, Germany
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, Thoraxklinik at University of Heidelberg, Röntgenstraße 1, 69126, Heidelberg, Germany
| | - Lukas Ebner
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, Freiburgstrasse, 3010, Bern, Switzerland
| | - Mark O Wielpütz
- Diagnostic and Interventional Radiology, Heidelberg University Hospital, Im Neuenheimer Feld 420, 69120, Heidelberg, Germany
- Translational Lung Research Center Heidelberg (TLRC), German Center for Lung Research (DZL), Im Neuenheimer Feld 156, 69120, Heidelberg, Germany
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, Thoraxklinik at University of Heidelberg, Röntgenstraße 1, 69126, Heidelberg, Germany
| |
Collapse
|
4
|
Bassi M, Vaz Sousa R, Zacchini B, Centofanti A, Ferrante F, Poggi C, Carillo C, Pecoraro Y, Amore D, Diso D, Anile M, De Giacomo T, Venuta F, Vannucci J. Lung Cancer Surgery in Octogenarians: Implications and Advantages of Artificial Intelligence in the Preoperative Assessment. Healthcare (Basel) 2024; 12:803. [PMID: 38610225 PMCID: PMC11011722 DOI: 10.3390/healthcare12070803] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2024] [Revised: 04/02/2024] [Accepted: 04/04/2024] [Indexed: 04/14/2024] Open
Abstract
The general world population is aging and patients are often diagnosed with early-stage lung cancer at an advanced age. Several studies have shown that age is not itself a contraindication for lung cancer surgery, and therefore, more and more octogenarians with early-stage lung cancer are undergoing surgery with curative intent. However, octogenarians present some peculiarities that make surgical treatment more challenging, so an accurate preoperative selection is mandatory. In recent years, new artificial intelligence techniques have spread worldwide in the diagnosis, treatment, and therapy of lung cancer, with increasing clinical applications. However, there is still no evidence coming out from trials specifically designed to assess the potential of artificial intelligence in the preoperative evaluation of octogenarian patients. The aim of this narrative review is to investigate, through the analysis of the available international literature, the advantages and implications that these tools may have in the preoperative assessment of this particular category of frail patients. In fact, these tools could represent an important support in the decision-making process, especially in octogenarian patients in whom the diagnostic and therapeutic options are often questionable. However, these technologies are still developing, and a strict human-led process is mandatory.
Collapse
Affiliation(s)
- Massimiliano Bassi
- Division of Thoracic Surgery, Department of General Surgery and Surgical Specialties “Paride Stefanini”, Policlinico Umberto I, Sapienza University of Rome, 00161 Rome, Italy
| | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
5
|
Yoon SH, Oh DY, Kim HJ, Jang S, Kim M, Kim J, Lee KW, Lee KJ, Kim J. Usefulness of longitudinal nodule-matching algorithm in computer-aided diagnosis of new pulmonary metastases on cancer surveillance CT scans. Quant Imaging Med Surg 2024; 14:1493-1506. [PMID: 38415154 PMCID: PMC10895128 DOI: 10.21037/qims-23-1174] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2023] [Accepted: 11/29/2023] [Indexed: 02/29/2024]
Abstract
Background Detecting new pulmonary metastases by comparing serial computed tomography (CT) scans is crucial, but a repetitive and time-consuming task that burdens the radiologists' workload. This study aimed to evaluate the usefulness of a nodule-matching algorithm with deep learning-based computer-aided detection (DL-CAD) in diagnosing new pulmonary metastases on cancer surveillance CT scans. Methods Among patients who underwent pulmonary metastasectomy between 2014 and 2018, 65 new pulmonary metastases missed by interpreting radiologists on cancer surveillance CT (Time 2) were identified after a retrospective comparison with the previous CT (Time 1). First, DL-CAD detected nodules in Time 1 and Time 2 CT images. All nodules detected at Time 2 were initially considered metastasis candidates. Second, the nodule-matching algorithm was used to assess the correlation between the nodules from the two CT scans and to classify the nodules at Time 2 as "new" or "pre-existing". Pre-existing nodules were excluded from metastasis candidates. We evaluated the performance of DL-CAD with the nodule-matching algorithm, based on its sensitivity, false-metastasis candidates per scan, and positive predictive value (PPV). Results A total of 475 lesions were detected by DL-CAD at Time 2. Following a radiologist review, the lesions were categorized as metastases (n=54), benign nodules (n=392), and non-nodules (n=29). Upon comparison of nodules at Time 1 and 2 using the nodule-matching algorithm, all metastases were classified as new nodules without any matching errors. Out of 421 benign lesions, 202 (48.0%) were identified as pre-existing and subsequently excluded from the pool of metastasis candidates through the nodule-matching algorithm. As a result, false-metastasis candidates per CT scan decreased by 47.9% (from 7.1 to 3.7, P<0.001) and the PPV increased from 11.4% to 19.8% (P<0.001), while maintaining sensitivity. Conclusions The nodule-matching algorithm improves the diagnostic performance of DL-CAD for new pulmonary metastases, by lowering the number of false-metastasis candidates without compromising sensitivity.
Collapse
Affiliation(s)
- Sung Hyun Yoon
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Dong Yul Oh
- Monitor Corporation, Seoul, Republic of Korea
| | - Hyo Jin Kim
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Sowon Jang
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Minseon Kim
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Jihang Kim
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Kyung Won Lee
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Kyong Joon Lee
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
- Monitor Corporation, Seoul, Republic of Korea
| | - Junghoon Kim
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| |
Collapse
|
6
|
Zhang L, Shao Y, Chen G, Tian S, Zhang Q, Wu J, Bai C, Yang D. An artificial intelligence-assisted diagnostic system for the prediction of benignity and malignancy of pulmonary nodules and its practical value for patients with different clinical characteristics. Front Med (Lausanne) 2023; 10:1286433. [PMID: 38196835 PMCID: PMC10774219 DOI: 10.3389/fmed.2023.1286433] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Accepted: 12/12/2023] [Indexed: 01/11/2024] Open
Abstract
Objectives This study aimed to explore the value of an artificial intelligence (AI)-assisted diagnostic system in the prediction of pulmonary nodules. Methods The AI system was able to make predictions of benign or malignant nodules. 260 cases of solitary pulmonary nodules (SPNs) were divided into 173 malignant cases and 87 benign cases based on the surgical pathological diagnosis. A stratified data analysis was applied to compare the diagnostic effectiveness of the AI system to distinguish between the subgroups with different clinical characteristics. Results The accuracy of AI system in judging benignity and malignancy of the nodules was 75.77% (p < 0.05). We created an ROC curve by calculating the true positive rate (TPR) and the false positive rate (FPR) at different threshold values, and the AUC was 0.755. Results of the stratified analysis were as follows. (1) By nodule position: the AUC was 0.677, 0.758, 0.744, 0.982, and 0.725, respectively, for the nodules in the left upper lobe, left lower lobe, right upper lobe, right middle lobe, and right lower lobe. (2) By nodule size: the AUC was 0.778, 0.771, and 0.686, respectively, for the nodules measuring 5-10, 10-20, and 20-30 mm in diameter. (3) The predictive accuracy was higher for the subsolid pulmonary nodules than for the solid ones (80.54 vs. 66.67%). Conclusion The AI system can be applied to assist in the prediction of benign and malignant pulmonary nodules. It can provide a valuable reference, especially for the diagnosis of subsolid nodules and small nodules measuring 5-10 mm in diameter.
Collapse
Affiliation(s)
- Lichuan Zhang
- Department of Respiratory Medicine, Affiliated Zhongshan Hospital of Dalian University, Dalian, China
| | - Yue Shao
- Department of Respiratory Medicine, Affiliated Zhongshan Hospital of Dalian University, Dalian, China
| | - Guangmei Chen
- Department of Respiratory Medicine, Affiliated Zhongshan Hospital of Dalian University, Dalian, China
| | - Simiao Tian
- Department of Respiratory Medicine, Affiliated Zhongshan Hospital of Dalian University, Dalian, China
| | - Qing Zhang
- Department of Respiratory Medicine, Affiliated Zhongshan Hospital of Dalian University, Dalian, China
| | - Jianlin Wu
- Department of Respiratory Medicine, Affiliated Zhongshan Hospital of Dalian University, Dalian, China
| | - Chunxue Bai
- Department of Pulmonary and Critical Care Medicine, Zhongshan Hospital Fudan University, Shanghai, China
- Department of Pulmonary and Critical Care Medicine, Zhongshan Hospital (Xiamen), Fudan University, Xiamen, China
- Shanghai Respiratory Research Institution, Shanghai, China
| | - Dawei Yang
- Department of Pulmonary and Critical Care Medicine, Zhongshan Hospital Fudan University, Shanghai, China
- Department of Pulmonary and Critical Care Medicine, Zhongshan Hospital (Xiamen), Fudan University, Xiamen, China
- Shanghai Respiratory Research Institution, Shanghai, China
| |
Collapse
|
7
|
Dong Y, Li X, Yang Y, Wang M, Gao B. A Synthesizing Semantic Characteristics Lung Nodules Classification Method Based on 3D Convolutional Neural Network. Bioengineering (Basel) 2023; 10:1245. [PMID: 38002369 PMCID: PMC10669569 DOI: 10.3390/bioengineering10111245] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 09/30/2023] [Accepted: 10/11/2023] [Indexed: 11/26/2023] Open
Abstract
Early detection is crucial for the survival and recovery of lung cancer patients. Computer-aided diagnosis system can assist in the early diagnosis of lung cancer by providing decision support. While deep learning methods are increasingly being applied to tasks such as CAD (Computer-aided diagnosis system), these models lack interpretability. In this paper, we propose a convolutional neural network model that combines semantic characteristics (SCCNN) to predict whether a given pulmonary nodule is malignant. The model synthesizes the advantages of multi-view, multi-task and attention modules in order to fully simulate the actual diagnostic process of radiologists. The 3D (three dimensional) multi-view samples of lung nodules are extracted by spatial sampling method. Meanwhile, semantic characteristics commonly used in radiology reports are used as an auxiliary task and serve to explain how the model interprets. The introduction of the attention module in the feature fusion stage improves the classification of lung nodules as benign or malignant. Our experimental results using the LIDC-IDRI (Lung Image Database Consortium and Image Database Resource Initiative) show that this study achieves 95.45% accuracy and 97.26% ROC (Receiver Operating Characteristic) curve area. The results show that the method we proposed not only realize the classification of benign and malignant compared to standard 3D CNN approaches but can also be used to intuitively explain how the model makes predictions, which can assist clinical diagnosis.
Collapse
Affiliation(s)
| | - Xiaoqin Li
- Faculty of Environment and Life, Beijing University of Technology, Beijing 100124, China; (Y.D.); (Y.Y.); (M.W.); (B.G.)
| | | | | | | |
Collapse
|
8
|
Patel K, Huang S, Rashid A, Varghese B, Gholamrezanezhad A. A Narrative Review of the Use of Artificial Intelligence in Breast, Lung, and Prostate Cancer. Life (Basel) 2023; 13:2011. [PMID: 37895393 PMCID: PMC10608739 DOI: 10.3390/life13102011] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Revised: 09/30/2023] [Accepted: 09/30/2023] [Indexed: 10/29/2023] Open
Abstract
Artificial intelligence (AI) has been an important topic within radiology. Currently, AI is used clinically to assist with the detection of lesions through detection systems. However, a number of recent studies have demonstrated the increased value of neural networks in radiology. With an increasing number of screening requirements for cancers, this review aims to study the accuracy of the numerous AI models used in the detection and diagnosis of breast, lung, and prostate cancers. This study summarizes pertinent findings from reviewed articles and provides analysis on the relevancy to clinical radiology. This study found that whereas AI is showing continual improvement in radiology, AI alone does not surpass the effectiveness of a radiologist. Additionally, it was found that there are multiple variations on how AI should be integrated with a radiologist's workflow.
Collapse
Affiliation(s)
- Kishan Patel
- Department of Radiology, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA (A.G.)
| | - Sherry Huang
- Department of Urology, University of Pittsburgh Medical Center, Pittsburgh, PA 15213, USA
| | - Arnav Rashid
- Department of Biological Sciences, Dana and David Dornsife College of Letters, Arts and Sciences, University of Southern California, Los Angeles, CA 90089, USA
| | - Bino Varghese
- Department of Radiology, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA (A.G.)
| | - Ali Gholamrezanezhad
- Department of Radiology, Keck School of Medicine, University of Southern California, Los Angeles, CA 90033, USA (A.G.)
| |
Collapse
|
9
|
Chen J, Cao R, Jiao S, Dong Y, Wang Z, Zhu H, Luo Q, Zhang L, Wang H, Yin X. Application value of a computer-aided diagnosis and management system for the detection of lung nodules. Quant Imaging Med Surg 2023; 13:6929-6941. [PMID: 37869302 PMCID: PMC10585542 DOI: 10.21037/qims-22-1297] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 08/22/2023] [Indexed: 10/24/2023]
Abstract
Background Computer-aided diagnosis (CAD) systems can help reduce radiologists' workload. This study assessed the value of a CAD system for the detection of lung nodules on chest computed tomography (CT) images. Methods The study retrospectively analyzed the CT images of patients who underwent routine health checkups between August 2019 and November 2019 at 3 hospitals in China. All images were first assessed by 2 radiologists manually in a blinded manner, which was followed by assessment with the CAD system. The location and classification of the lung nodules were determined. The final diagnosis was made by a panel of experts, including 2 associate chief radiologists and 1 chief radiologist at the radiology department. The sensitivity for nodule detection and false-positive nodules per case were calculated. Results A total of 1,002 CT images were included in the study, and the process was completed for 999 images. The sensitivity of the CAD system and manual detection was 90.19% and 49.88% (P<0.001), respectively. Similar sensitivity was observed between manual detection and the CAD system in lung nodules >15 mm (P=0.08). The false-positive nodules per case for the CAD system were 0.30±0.84 and those for manual detection were 0.24±0.68 (P=0.12). The sensitivity of the CAD system was higher than that of the radiologists, but the increase in the false-positive rate was only slight. Conclusions In addition to reducing the workload for medical professionals, a CAD system developed using a deep-learning model was highly effective and accurate in detecting lung nodules and did not demonstrate a meaningfully higher the false-positive rate.
Collapse
Affiliation(s)
- Jingwen Chen
- Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Rong Cao
- Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | | | | | - Zilong Wang
- Department of R&D, VoxelCloud, Shanghai, China
| | - Hua Zhu
- Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Qian Luo
- Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Lei Zhang
- Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Han Wang
- Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| | - Xiaorui Yin
- Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China
| |
Collapse
|
10
|
Thanoon MA, Zulkifley MA, Mohd Zainuri MAA, Abdani SR. A Review of Deep Learning Techniques for Lung Cancer Screening and Diagnosis Based on CT Images. Diagnostics (Basel) 2023; 13:2617. [PMID: 37627876 PMCID: PMC10453592 DOI: 10.3390/diagnostics13162617] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2023] [Revised: 07/26/2023] [Accepted: 08/02/2023] [Indexed: 08/27/2023] Open
Abstract
One of the most common and deadly diseases in the world is lung cancer. Only early identification of lung cancer can increase a patient's probability of survival. A frequently used modality for the screening and diagnosis of lung cancer is computed tomography (CT) imaging, which provides a detailed scan of the lung. In line with the advancement of computer-assisted systems, deep learning techniques have been extensively explored to help in interpreting the CT images for lung cancer identification. Hence, the goal of this review is to provide a detailed review of the deep learning techniques that were developed for screening and diagnosing lung cancer. This review covers an overview of deep learning (DL) techniques, the suggested DL techniques for lung cancer applications, and the novelties of the reviewed methods. This review focuses on two main methodologies of deep learning in screening and diagnosing lung cancer, which are classification and segmentation methodologies. The advantages and shortcomings of current deep learning models will also be discussed. The resultant analysis demonstrates that there is a significant potential for deep learning methods to provide precise and effective computer-assisted lung cancer screening and diagnosis using CT scans. At the end of this review, a list of potential future works regarding improving the application of deep learning is provided to spearhead the advancement of computer-assisted lung cancer diagnosis systems.
Collapse
Affiliation(s)
- Mohammad A. Thanoon
- Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, University Kebangsaan Malaysia, Bangi 43600, Malaysia;
- System and Control Engineering Department, College of Electronics Engineering, Ninevah University, Mosul 41002, Iraq
| | - Mohd Asyraf Zulkifley
- Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, University Kebangsaan Malaysia, Bangi 43600, Malaysia;
| | - Muhammad Ammirrul Atiqi Mohd Zainuri
- Department of Electrical, Electronic and Systems Engineering, Faculty of Engineering and Built Environment, University Kebangsaan Malaysia, Bangi 43600, Malaysia;
| | - Siti Raihanah Abdani
- School of Computing Sciences, College of Computing, Informatics and Media, Universiti Teknologi MARA, Shah Alam 40450, Malaysia;
| |
Collapse
|
11
|
Peters AA, Christe A, von Stackelberg O, Pohl M, Kauczor HU, Heußel CP, Wielpütz MO, Ebner L. "Will I change nodule management recommendations if I change my CAD system?"-impact of volumetric deviation between different CAD systems on lesion management. Eur Radiol 2023; 33:5568-5577. [PMID: 36894752 PMCID: PMC10326095 DOI: 10.1007/s00330-023-09525-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2022] [Revised: 11/17/2022] [Accepted: 02/05/2023] [Indexed: 03/11/2023]
Abstract
OBJECTIVES To evaluate and compare the measurement accuracy of two different computer-aided diagnosis (CAD) systems regarding artificial pulmonary nodules and assess the clinical impact of volumetric inaccuracies in a phantom study. METHODS In this phantom study, 59 different phantom arrangements with 326 artificial nodules (178 solid, 148 ground-glass) were scanned at 80 kV, 100 kV, and 120 kV. Four different nodule diameters were used: 5 mm, 8 mm, 10 mm, and 12 mm. Scans were analyzed by a deep-learning (DL)-based CAD and a standard CAD system. Relative volumetric errors (RVE) of each system vs. ground truth and the relative volume difference (RVD) DL-based vs. standard CAD were calculated. The Bland-Altman method was used to define the limits of agreement (LOA). The hypothetical impact on LungRADS classification was assessed for both systems. RESULTS There was no difference between the three voltage groups regarding nodule volumetry. Regarding the solid nodules, the RVE of the 5-mm-, 8-mm-, 10-mm-, and 12-mm-size groups for the DL CAD/standard CAD were 12.2/2.8%, 1.3/ - 2.8%, - 3.6/1.5%, and - 12.2/ - 0.3%, respectively. The corresponding values for the ground-glass nodules (GGN) were 25.6%/81.0%, 9.0%/28.0%, 7.6/20.6%, and 6.8/21.2%. The mean RVD for solid nodules/GGN was 1.3/ - 15.2%. Regarding the LungRADS classification, 88.5% and 79.8% of all solid nodules were correctly assigned by the DL CAD and the standard CAD, respectively. 14.9% of the nodules were assigned differently between the systems. CONCLUSIONS Patient management may be affected by the volumetric inaccuracy of the CAD systems and hence demands supervision and/or manual correction by a radiologist. KEY POINTS • The DL-based CAD system was more accurate in the volumetry of GGN and less accurate regarding solid nodules than the standard CAD system. • Nodule size and attenuation have an effect on the measurement accuracy of both systems; tube voltage has no effect on measurement accuracy. • Measurement inaccuracies of CAD systems can have an impact on patient management, which demands supervision by radiologists.
Collapse
Affiliation(s)
- Alan A Peters
- Department of Diagnostic and Interventional Radiology, University Hospital of Heidelberg, Im Neuenheimer Feld 672, Heidelberg, Germany.
- Translational Lung Research Center Heidelberg (TLRC), German Lung Research Center (DZL), Marsilius-Arkaden 130, 69120, Heidelberg, Germany.
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, University Hospital of Heidelberg, Thoraxklinik Heidelberg, Roentgenstrasse 1, 69126, Heidelberg, Germany.
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, 3010, Freiburgstrasse, Switzerland.
| | - Andreas Christe
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, 3010, Freiburgstrasse, Switzerland
| | - Oyunbileg von Stackelberg
- Department of Diagnostic and Interventional Radiology, University Hospital of Heidelberg, Im Neuenheimer Feld 672, Heidelberg, Germany
- Translational Lung Research Center Heidelberg (TLRC), German Lung Research Center (DZL), Marsilius-Arkaden 130, 69120, Heidelberg, Germany
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, University Hospital of Heidelberg, Thoraxklinik Heidelberg, Roentgenstrasse 1, 69126, Heidelberg, Germany
| | - Moritz Pohl
- Institute of Medical Biometry, University of Heidelberg, Im Neuenheimer Feld 130.3, 69120, Heidelberg, Germany
| | - Hans-Ulrich Kauczor
- Department of Diagnostic and Interventional Radiology, University Hospital of Heidelberg, Im Neuenheimer Feld 672, Heidelberg, Germany
- Translational Lung Research Center Heidelberg (TLRC), German Lung Research Center (DZL), Marsilius-Arkaden 130, 69120, Heidelberg, Germany
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, University Hospital of Heidelberg, Thoraxklinik Heidelberg, Roentgenstrasse 1, 69126, Heidelberg, Germany
| | - Claus Peter Heußel
- Department of Diagnostic and Interventional Radiology, University Hospital of Heidelberg, Im Neuenheimer Feld 672, Heidelberg, Germany
- Translational Lung Research Center Heidelberg (TLRC), German Lung Research Center (DZL), Marsilius-Arkaden 130, 69120, Heidelberg, Germany
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, University Hospital of Heidelberg, Thoraxklinik Heidelberg, Roentgenstrasse 1, 69126, Heidelberg, Germany
| | - Mark O Wielpütz
- Department of Diagnostic and Interventional Radiology, University Hospital of Heidelberg, Im Neuenheimer Feld 672, Heidelberg, Germany
- Translational Lung Research Center Heidelberg (TLRC), German Lung Research Center (DZL), Marsilius-Arkaden 130, 69120, Heidelberg, Germany
- Department of Diagnostic and Interventional Radiology With Nuclear Medicine, University Hospital of Heidelberg, Thoraxklinik Heidelberg, Roentgenstrasse 1, 69126, Heidelberg, Germany
| | - Lukas Ebner
- Department of Diagnostic, Interventional and Pediatric Radiology, Inselspital, Bern University Hospital, University of Bern, 3010, Freiburgstrasse, Switzerland
| |
Collapse
|
12
|
Iqbal S, N. Qureshi A, Li J, Mahmood T. On the Analyses of Medical Images Using Traditional Machine Learning Techniques and Convolutional Neural Networks. ARCHIVES OF COMPUTATIONAL METHODS IN ENGINEERING : STATE OF THE ART REVIEWS 2023; 30:3173-3233. [PMID: 37260910 PMCID: PMC10071480 DOI: 10.1007/s11831-023-09899-9] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 12/01/2022] [Accepted: 02/19/2023] [Indexed: 06/02/2023]
Abstract
Convolutional neural network (CNN) has shown dissuasive accomplishment on different areas especially Object Detection, Segmentation, Reconstruction (2D and 3D), Information Retrieval, Medical Image Registration, Multi-lingual translation, Local language Processing, Anomaly Detection on video and Speech Recognition. CNN is a special type of Neural Network, which has compelling and effective learning ability to learn features at several steps during augmentation of the data. Recently, different interesting and inspiring ideas of Deep Learning (DL) such as different activation functions, hyperparameter optimization, regularization, momentum and loss functions has improved the performance, operation and execution of CNN Different internal architecture innovation of CNN and different representational style of CNN has significantly improved the performance. This survey focuses on internal taxonomy of deep learning, different models of vonvolutional neural network, especially depth and width of models and in addition CNN components, applications and current challenges of deep learning.
Collapse
Affiliation(s)
- Saeed Iqbal
- Department of Computer Science, Faculty of Information Technology & Computer Science, University of Central Punjab, Lahore, Punjab 54000 Pakistan
- Faculty of Information Technology, Beijing University of Technology, Beijing, 100124 Beijing China
| | - Adnan N. Qureshi
- Department of Computer Science, Faculty of Information Technology & Computer Science, University of Central Punjab, Lahore, Punjab 54000 Pakistan
| | - Jianqiang Li
- Faculty of Information Technology, Beijing University of Technology, Beijing, 100124 Beijing China
- Beijing Engineering Research Center for IoT Software and Systems, Beijing University of Technology, Beijing, 100124 Beijing China
| | - Tariq Mahmood
- Artificial Intelligence and Data Analytics (AIDA) Lab, College of Computer & Information Sciences (CCIS), Prince Sultan University, Riyadh, 11586 Kingdom of Saudi Arabia
| |
Collapse
|
13
|
Ng CKC. Diagnostic Performance of Artificial Intelligence-Based Computer-Aided Detection and Diagnosis in Pediatric Radiology: A Systematic Review. CHILDREN (BASEL, SWITZERLAND) 2023; 10:children10030525. [PMID: 36980083 PMCID: PMC10047006 DOI: 10.3390/children10030525] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/31/2023] [Revised: 02/13/2023] [Accepted: 03/07/2023] [Indexed: 03/30/2023]
Abstract
Artificial intelligence (AI)-based computer-aided detection and diagnosis (CAD) is an important research area in radiology. However, only two narrative reviews about general uses of AI in pediatric radiology and AI-based CAD in pediatric chest imaging have been published yet. The purpose of this systematic review is to investigate the AI-based CAD applications in pediatric radiology, their diagnostic performances and methods for their performance evaluation. A literature search with the use of electronic databases was conducted on 11 January 2023. Twenty-three articles that met the selection criteria were included. This review shows that the AI-based CAD could be applied in pediatric brain, respiratory, musculoskeletal, urologic and cardiac imaging, and especially for pneumonia detection. Most of the studies (93.3%, 14/15; 77.8%, 14/18; 73.3%, 11/15; 80.0%, 8/10; 66.6%, 2/3; 84.2%, 16/19; 80.0%, 8/10) reported model performances of at least 0.83 (area under receiver operating characteristic curve), 0.84 (sensitivity), 0.80 (specificity), 0.89 (positive predictive value), 0.63 (negative predictive value), 0.87 (accuracy), and 0.82 (F1 score), respectively. However, a range of methodological weaknesses (especially a lack of model external validation) are found in the included studies. In the future, more AI-based CAD studies in pediatric radiology with robust methodology should be conducted for convincing clinical centers to adopt CAD and realizing its benefits in a wider context.
Collapse
Affiliation(s)
- Curtise K C Ng
- Curtin Medical School, Curtin University, GPO Box U1987, Perth, WA 6845, Australia
- Curtin Health Innovation Research Institute (CHIRI), Faculty of Health Sciences, Curtin University, GPO Box U1987, Perth, WA 6845, Australia
| |
Collapse
|
14
|
Cui X, Zheng S, Zhang W, Fan S, Wang J, Song F, Liu X, Zhu W, Ye Z. Prediction of histologic types in solid lung lesions using preoperative contrast-enhanced CT. Eur Radiol 2023:10.1007/s00330-023-09432-3. [PMID: 36723725 DOI: 10.1007/s00330-023-09432-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2022] [Revised: 10/31/2022] [Accepted: 01/02/2023] [Indexed: 02/02/2023]
Abstract
OBJECTIVES This study aimed to develop and validate a predicting model for the histologic classification of solid lung lesions based on preoperative contrast-enhanced CT. METHODS A primary dataset of 1012 patients from Tianjin Medical University Cancer Institute and Hospital (TMUCIH) was randomly divided into a development cohort (708) and an internal validation cohort (304). Patients from the Second Hospital of Shanxi Medical University (SHSMU) were set as an external validation cohort (212). Two clinical factors (age, gender) and twenty-one characteristics on contrast-enhanced CT were used to construct a multinomial multivariable logistic regression model for the classification of seven common histologic types of solid lung lesions. The area under the receiver operating characteristic curve was used to assess the diagnostic performance of the model in the development and validation cohorts, separately. RESULTS Multivariable analysis showed that two clinical factors and twenty-one characteristics on contrast-enhanced CT were predictive in lung lesion histologic classification. The mean AUC of the proposed model for histologic classification was 0.95, 0.94, and 0.92 in the development, internal validation, and external validation cohort, respectively. When determining the malignancy of lung lesions based on histologic types, the mean AUC of the model was 0.88, 0.86, and 0.90 in three cohorts. CONCLUSIONS We demonstrated that by utilizing both clinical and CT characteristics on contrast-enhanced CT images, the proposed model could not only effectively stratify histologic types of solid lung lesions, but also enabled accurate assessment of lung lesion malignancy. Such a model has the potential to avoid unnecessary surgery for patients and to guide clinical decision-making for preoperative treatment. KEY POINTS • Clinical and CT characteristics on contrast-enhanced CT could be used to differentiate histologic types of solid lung lesions. • Predicting models using preoperative contrast-enhanced CT could accurately assessment of tumor malignancy based on predicted histologic types.
Collapse
Affiliation(s)
- Xiaonan Cui
- Department of Radiology, Key Laboratory of Cancer Prevention and Therapy, Tianjin Medical University Cancer Institute & Hospital, National Clinical Research Center for Cancer, Huan-Hu-Xi Road, Ti-Yuan-Bei, He Xi District, Tianjin , Tianjin, 300060, People's Republic of China
| | - Sunyi Zheng
- Artificial Intelligence and Biomedical Image Analysis Lab, School of Engineering, Westlake University, Hangzhou, People's Republic of China.,Institute of Advanced Technology, Westlake Institute for Advanced Study, Hangzhou, People's Republic of China
| | - Wenjia Zhang
- Department of Radiology, The Second Hospital of Shanxi Medical University, Taiyuan, People's Republic of China
| | - Shuxuan Fan
- Department of Radiology, Key Laboratory of Cancer Prevention and Therapy, Tianjin Medical University Cancer Institute & Hospital, National Clinical Research Center for Cancer, Huan-Hu-Xi Road, Ti-Yuan-Bei, He Xi District, Tianjin , Tianjin, 300060, People's Republic of China
| | - Jing Wang
- Department of Epidemiology and Health Statistics, School of Public Health, Hangzhou Medical College, Hangzhou, People's Republic of China
| | - Feipeng Song
- Department of Radiology, The Second Hospital of Shanxi Medical University, Taiyuan, People's Republic of China
| | - Xu Liu
- Department of Radiology, The Second Hospital of Shanxi Medical University, Taiyuan, People's Republic of China
| | - Weijie Zhu
- Department of Radiology, Key Laboratory of Cancer Prevention and Therapy, Tianjin Medical University Cancer Institute & Hospital, National Clinical Research Center for Cancer, Huan-Hu-Xi Road, Ti-Yuan-Bei, He Xi District, Tianjin , Tianjin, 300060, People's Republic of China
| | - Zhaoxiang Ye
- Department of Radiology, Key Laboratory of Cancer Prevention and Therapy, Tianjin Medical University Cancer Institute & Hospital, National Clinical Research Center for Cancer, Huan-Hu-Xi Road, Ti-Yuan-Bei, He Xi District, Tianjin , Tianjin, 300060, People's Republic of China.
| |
Collapse
|
15
|
Artificial intelligence in lung cancer: current applications and perspectives. Jpn J Radiol 2023; 41:235-244. [PMID: 36350524 PMCID: PMC9643917 DOI: 10.1007/s11604-022-01359-x] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Accepted: 10/30/2022] [Indexed: 11/10/2022]
Abstract
Artificial intelligence (AI) has been a very active research topic over the last years and thoracic imaging has particularly benefited from the development of AI and in particular deep learning. We have now entered a phase of adopting AI into clinical practice. The objective of this article was to review the current applications and perspectives of AI in thoracic oncology. For pulmonary nodule detection, computer-aided detection (CADe) tools have been commercially available since the early 2000s. The more recent rise of deep learning and the availability of large annotated lung nodule datasets have allowed the development of new CADe tools with fewer false-positive results per examination. Classical machine learning and deep-learning methods were also used for pulmonary nodule segmentation allowing nodule volumetry and pulmonary nodule characterization. For pulmonary nodule characterization, radiomics and deep-learning approaches were used. Data from the National Lung Cancer Screening Trial (NLST) allowed the development of several computer-aided diagnostic (CADx) tools for diagnosing lung cancer on chest computed tomography. Finally, AI has been used as a means to perform virtual biopsies and to predict response to treatment or survival. Thus, many detection, characterization and stratification tools have been proposed, some of which are commercially available.
Collapse
|
16
|
de Margerie-Mellon C, Chassagnon G. Artificial intelligence: A critical review of applications for lung nodule and lung cancer. Diagn Interv Imaging 2023; 104:11-17. [PMID: 36513593 DOI: 10.1016/j.diii.2022.11.007] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2022] [Accepted: 11/22/2022] [Indexed: 12/14/2022]
Abstract
Artificial intelligence (AI) is a broad concept that usually refers to computer programs that can learn from data and perform certain specific tasks. In the recent years, the growth of deep learning, a successful technique for computer vision tasks that does not require explicit programming, coupled with the availability of large imaging databases fostered the development of multiple applications in the medical imaging field, especially for lung nodules and lung cancer, mostly through convolutional neural networks (CNN). Some of the first applications of AI is this field were dedicated to automated detection of lung nodules on X-ray and computed tomography (CT) examinations, with performances now reaching or exceeding those of radiologists. For lung nodule segmentation, CNN-based algorithms applied to CT images show excellent spatial overlap index with manual segmentation, even for irregular and ground glass nodules. A third application of AI is the classification of lung nodules between malignant and benign, which could limit the number of follow-up CT examinations for less suspicious lesions. Several algorithms have demonstrated excellent capabilities for the prediction of the malignancy risk when a nodule is discovered. These different applications of AI for lung nodules are particularly appealing in the context of lung cancer screening. In the field of lung cancer, AI tools applied to lung imaging have been investigated for distinct aims. First, they could play a role for the non-invasive characterization of tumors, especially for histological subtype and somatic mutation predictions, with a potential therapeutic impact. Additionally, they could help predict the patient prognosis, in combination to clinical data. Despite these encouraging perspectives, clinical implementation of AI tools is only beginning because of the lack of generalizability of published studies, of an inner obscure working and because of limited data about the impact of such tools on the radiologists' decision and on the patient outcome. Radiologists must be active participants in the process of evaluating AI tools, as such tools could support their daily work and offer them more time for high added value tasks.
Collapse
Affiliation(s)
- Constance de Margerie-Mellon
- Université Paris Cité, Laboratory of Imaging Biomarkers, Center for Research on Inflammation, UMR 1149, INSERM, 75018 Paris, France; Department of Radiology, Hôpital Saint-Louis APHP, 75010 Paris, France
| | - Guillaume Chassagnon
- Université Paris Cité, Faculté de Médecine, 75006 Paris, France; Department of Radiology, Hôpital Cochin APHP, 75014 Paris, France
| |
Collapse
|
17
|
Li B, Jiang L, Lin D, Dong J. Registered Clinical Trials for Artificial Intelligence in Lung Disease: A Scoping Review on ClinicalTrials.gov. Diagnostics (Basel) 2022; 12:diagnostics12123046. [PMID: 36553052 PMCID: PMC9777443 DOI: 10.3390/diagnostics12123046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/17/2022] [Revised: 11/06/2022] [Accepted: 11/14/2022] [Indexed: 12/12/2022] Open
Abstract
Clinical trials are the most effective tools to evaluate the advantages of various diagnostic and treatment modalities. AI used in medical issues, including screening, diagnosis, and treatment decisions, improves health outcomes and patient experiences. This study's objective was to investigate the traits of registered trials on artificial intelligence for lung disease. Clinical studies on AI for lung disease that were present in the ClinicalTrials.gov database were searched, and fifty-three registered trials were included. Forty-six (72.1%) were observational trials, compared to seven (27.9%) that were interventional trials. Only eight trials (15.4%) were completed. Thirty (56.6%) trials were accepting applicants. Clinical studies often included a large number of cases; for example, 24 (32.0%) trials included samples of 100-1000 cases, while 14 (17.5%) trials included samples of 1000-2000 cases. Of the interventional trials, twenty (15.7%) were retrospective studies and twenty (65.7%) were prospective studies.
Collapse
Affiliation(s)
- Bingjie Li
- Department of Thoracic Oncology and State Key Laboratory of Biotherapy, Cancer Center, West China Hospital, Sichuan University, Chengdu 610017, China
| | - Lisha Jiang
- Department of Nuclear Medicine, West China Hospital, Sichuan University, Chengdu 610017, China
| | - Dan Lin
- Lung Cancer Center, West China Hospital, Sichuan University, Chengdu 610017, China
| | - Jingsi Dong
- Lung Cancer Center, West China Hospital, Sichuan University, Chengdu 610017, China
- Correspondence:
| |
Collapse
|
18
|
Cellina M, Cè M, Khenkina N, Sinichich P, Cervelli M, Poggi V, Boemi S, Ierardi AM, Carrafiello G. Artificial Intellgence in the Era of Precision Oncological Imaging. Technol Cancer Res Treat 2022; 21:15330338221141793. [PMID: 36426565 PMCID: PMC9703524 DOI: 10.1177/15330338221141793] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022] Open
Abstract
Rapid-paced development and adaptability of artificial intelligence algorithms have secured their almost ubiquitous presence in the field of oncological imaging. Artificial intelligence models have been created for a variety of tasks, including risk stratification, automated detection, and segmentation of lesions, characterization, grading and staging, prediction of prognosis, and treatment response. Soon, artificial intelligence could become an essential part of every step of oncological workup and patient management. Integration of neural networks and deep learning into radiological artificial intelligence algorithms allow for extrapolating imaging features otherwise inaccessible to human operators and pave the way to truly personalized management of oncological patients.Although a significant proportion of currently available artificial intelligence solutions belong to basic and translational cancer imaging research, their progressive transfer to clinical routine is imminent, contributing to the development of a personalized approach in oncology. We thereby review the main applications of artificial intelligence in oncological imaging, describe the example of their successful integration into research and clinical practice, and highlight the challenges and future perspectives that will shape the field of oncological radiology.
Collapse
Affiliation(s)
- Michaela Cellina
- Radiology Department, Fatebenefratelli Hospital, Milano, Italy,Michaela Cellina, MD, Radiology Department, Fatebenefratelli Hospital, ASST Fatebenefratelli Sacco, Milano, Piazza Principessa Clotilde 3, 20121, Milano, Italy.
| | - Maurizio Cè
- Postgraduate School in Radiodiagnostics, Università degli Studi di Milano, Milan, Italy
| | - Natallia Khenkina
- Postgraduate School in Radiodiagnostics, Università degli Studi di Milano, Milan, Italy
| | - Polina Sinichich
- Postgraduate School in Radiodiagnostics, Università degli Studi di Milano, Milan, Italy
| | - Marco Cervelli
- Postgraduate School in Radiodiagnostics, Università degli Studi di Milano, Milan, Italy
| | - Vittoria Poggi
- Postgraduate School in Radiodiagnostics, Università degli Studi di Milano, Milan, Italy
| | - Sara Boemi
- Postgraduate School in Radiodiagnostics, Università degli Studi di Milano, Milan, Italy
| | | | - Gianpaolo Carrafiello
- Postgraduate School in Radiodiagnostics, Università degli Studi di Milano, Milan, Italy,Radiology Department, Fondazione IRCCS Cà Granda, Milan, Italy
| |
Collapse
|
19
|
Katase S, Ichinose A, Hayashi M, Watanabe M, Chin K, Takeshita Y, Shiga H, Tateishi H, Onozawa S, Shirakawa Y, Yamashita K, Shudo J, Nakamura K, Nakanishi A, Kuroki K, Yokoyama K. Development and performance evaluation of a deep learning lung nodule detection system. BMC Med Imaging 2022; 22:203. [PMID: 36419044 PMCID: PMC9682774 DOI: 10.1186/s12880-022-00938-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2022] [Accepted: 11/14/2022] [Indexed: 11/25/2022] Open
Abstract
BACKGROUND Lung cancer is the leading cause of cancer-related deaths throughout the world. Chest computed tomography (CT) is now widely used in the screening and diagnosis of lung cancer due to its effectiveness. Radiologists must identify each small nodule shadow from 3D volume images, which is very burdensome and often results in missed nodules. To address these challenges, we developed a computer-aided detection (CAD) system that automatically detects lung nodules in CT images. METHODS A total of 1997 chest CT scans were collected for algorithm development. The algorithm was designed using deep learning technology. In addition to evaluating detection performance on various public datasets, its robustness to changes in radiation dose was assessed by a phantom study. To investigate the clinical usefulness of the CAD system, a reader study was conducted with 10 doctors, including inexperienced and expert readers. This study investigated whether the use of the CAD as a second reader could prevent nodular lesions in lungs that require follow-up examinations from being overlooked. Analysis was performed using the Jackknife Free-Response Receiver-Operating Characteristic (JAFROC). RESULTS The CAD system achieved sensitivity of 0.98/0.96 at 3.1/7.25 false positives per case on two public datasets. Sensitivity did not change within the range of practical doses for a study using a phantom. A second reader study showed that the use of this system significantly improved the detection ability of nodules that could be picked up clinically (p = 0.026). CONCLUSIONS We developed a deep learning-based CAD system that is robust to imaging conditions. Using this system as a second reader increased detection performance.
Collapse
Affiliation(s)
- Shichiro Katase
- grid.411205.30000 0000 9340 2869Department of Radiology, Faculty of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Akimichi Ichinose
- grid.410862.90000 0004 1770 2279Imaging Technology Center, ICT Strategy Division, Fujifilm Corporation, 2-26-30, Nishi-Azabu, Minato-ku, Tokyo, Japan
| | - Mahiro Hayashi
- grid.411205.30000 0000 9340 2869Department of Radiology, Faculty of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Masanaka Watanabe
- grid.411205.30000 0000 9340 2869Department of Radiology, Faculty of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Kinka Chin
- grid.411205.30000 0000 9340 2869Department of Radiology, Faculty of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Yuhei Takeshita
- grid.411205.30000 0000 9340 2869Department of Radiology, Faculty of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Hisae Shiga
- grid.411205.30000 0000 9340 2869Department of Radiology, Faculty of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Hidekatsu Tateishi
- grid.411205.30000 0000 9340 2869Department of Radiology, Faculty of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Shiro Onozawa
- grid.411205.30000 0000 9340 2869Department of Radiology, Faculty of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Yuya Shirakawa
- grid.459686.00000 0004 0386 8956Department of Radiology, Kyorin University Hospital, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Koji Yamashita
- grid.459686.00000 0004 0386 8956Department of Radiology, Kyorin University Hospital, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Jun Shudo
- grid.459686.00000 0004 0386 8956Department of Radiology, Kyorin University Hospital, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Keigo Nakamura
- grid.410862.90000 0004 1770 2279Imaging Technology Center, ICT Strategy Division, Fujifilm Corporation, 2-26-30, Nishi-Azabu, Minato-ku, Tokyo, Japan
| | - Akihito Nakanishi
- grid.459686.00000 0004 0386 8956Department of Radiology, Kyorin University Hospital, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Kazunori Kuroki
- grid.411205.30000 0000 9340 2869Department of Radiology, Faculty of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| | - Kenichi Yokoyama
- grid.411205.30000 0000 9340 2869Department of Radiology, Faculty of Medicine, Kyorin University, 6-20-2, Shinkawa, Mitaka-shi, Tokyo, Japan
| |
Collapse
|
20
|
Artificial Intelligence (AI) for Lung Nodules, From the AJR Special Series on AI Applications. AJR Am J Roentgenol 2022; 219:703-712. [PMID: 35544377 DOI: 10.2214/ajr.22.27487] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/13/2022]
Abstract
Interest in artificial intelligence (AI) applications for lung nodules continues to grow among radiologists, particularly with the expanding eligibility criteria and clinical utilization of lung cancer screening CT. AI has been heavily investigated for detecting and characterizing lung nodules and for guiding prognostic assessment. AI tools have also been used for image postprocessing (e.g., rib suppression on radiography or vessel suppression on CT) and for noninterpretive aspects of reporting and workflow, including management of nodule follow-up. Despite growing interest in and rapid development of AI tools and FDA approval of AI tools for pulmonary nodule evaluation, integration into clinical practice has been limited. Challenges to clinical adoption have included concerns about generalizability, regulatory issues, technical hurdles in implementation, and human skepticism. Further validation of AI tools for clinical use and demonstration of benefit in terms of patient-oriented outcomes also are needed. This article provides an overview of potential applications of AI tools in the imaging evaluation of lung nodules and discusses the challenges faced by practices interested in clinical implementation of such tools.
Collapse
|
21
|
Development of Deep Learning-based Automatic Scan Range Setting Model for Lung Cancer Screening Low-dose CT Imaging. Acad Radiol 2022; 29:1541-1551. [PMID: 35131147 DOI: 10.1016/j.acra.2021.12.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2021] [Revised: 12/02/2021] [Accepted: 12/03/2021] [Indexed: 12/14/2022]
Abstract
RATIONALE AND OBJECTIVES To develop an automatic setting of a deep learning-based system for detecting low-dose computed tomography (CT) lung cancer screening scan range and compare its efficiency with the radiographer's performance. MATERIALS AND METHODS This retrospective study was performed using 1984 lung cancer screening low-dose CT scans obtained between November 2019 and May 2020. Among 1984 CT scans, 600 CT scans were considered suitable for an observational study to explore the relationship between the scout landmarks and the actual lung boundaries. Further, 1144 CT scans data set was used for the development of a deep learning-based algorithm. This data set was split into an 8:2 ratio divided into a training set (80%, n = 915) and a validation set (20%, n = 229). The performance of the deep learning algorithm was evaluated in the test set (n = 240) using actual lung boundaries and radiographers' scan ranges. RESULTS The mean differences between the upper and lower boundaries of the deep learning-based algorithm and the actual lung boundaries were 4.72 ± 3.15 mm and 16.50 ± 14.06 mm, respectively. The accuracy and over-scanning of the scan ranges generated by the system were 97.08% (233/240) and 0% (0/240) for the upper boundary, and 96.25% (231/240) and 29.58% (71/240) for the lower boundary. CONCLUSION The developed deep learning-based algorithm system can effectively predict lung cancer screening low-dose CT scan range with high accuracy using only the frontal scout.
Collapse
|
22
|
Lee JH, Hwang EJ, Kim H, Park CM. A narrative review of deep learning applications in lung cancer research: from screening to prognostication. Transl Lung Cancer Res 2022; 11:1217-1229. [PMID: 35832457 PMCID: PMC9271435 DOI: 10.21037/tlcr-21-1012] [Citation(s) in RCA: 7] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/20/2021] [Accepted: 05/16/2022] [Indexed: 01/17/2023]
Abstract
Background and Objective Deep learning (DL) algorithms have been developed for various tasks, including lung nodule detection on chest radiographs or lung cancer computed tomography screening, potential candidate selection in lung cancer screening, malignancy prediction for indeterminate pulmonary nodules, lung cancer staging, treatment response prediction, prognostication, and prediction of genetic mutations in lung cancer. Furthermore, these DL algorithms have been applied in various clinical settings in order for them to be generalized in real-world clinical practice. Multiple DL algorithms have been corroborated to be on par with experts or current clinical prediction models for several specific tasks. However, no article has yet comprehensively reviewed DL algorithms dedicated to lung cancer research. This narrative review presents an overview of the literature dealing with DL techniques applied in lung cancer research and briefly summarizes the results according to the DL algorithms’ clinical use cases. Methods we performed a narrative review by searching the Embase and OVID-MEDLINE databases for articles published in English from October, 2016 until September, 2021 and reviewing the bibliographies of key references to identify important literature related to DL in lung cancer research. The background, development, results, and clinical implications of each DL algorithm are briefly discussed. Lastly, we end this review article by highlighting future directions in lung cancer research using DL techniques. Key Content and Findings DL algorithms have been introduced to show comparable or higher performance than human experts in various clinical settings. Specifically, they have been actively applied to detect lung nodules in chest radiographs or computed tomography (CT) examinations, optimize candidate selection for lung cancer screening (LCS), predict the malignancy of lung nodules, stage lung cancer, and predict treatment response, patients’ prognoses, and genetic mutations in lung cancers. Conclusions DL algorithms have corroborated their potential value for various tasks, ranging from lung cancer screening to prognostication of lung cancer patients. Future research is warranted for the clinical application of these algorithms in daily clinical practice and verification of their real-world clinical usefulness.
Collapse
Affiliation(s)
- Jong Hyuk Lee
- Department of Radiology, Seoul National University Hospital, Seoul, Korea.,Department of Radiology, Seoul National University College of Medicine, Seoul, Korea.,Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Korea
| | - Eui Jin Hwang
- Department of Radiology, Seoul National University Hospital, Seoul, Korea.,Department of Radiology, Seoul National University College of Medicine, Seoul, Korea.,Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Korea
| | - Hyungjin Kim
- Department of Radiology, Seoul National University Hospital, Seoul, Korea.,Department of Radiology, Seoul National University College of Medicine, Seoul, Korea.,Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Korea
| | - Chang Min Park
- Department of Radiology, Seoul National University Hospital, Seoul, Korea.,Department of Radiology, Seoul National University College of Medicine, Seoul, Korea.,Institute of Radiation Medicine, Seoul National University Medical Research Center, Seoul, Korea.,Institute of Medical and Biological Engineering, Medical Research Center, Seoul National University, Seoul, Korea
| |
Collapse
|
23
|
Peters AA, Huber AT, Obmann VC, Heverhagen JT, Christe A, Ebner L. Diagnostic validation of a deep learning nodule detection algorithm in low-dose chest CT: determination of optimized dose thresholds in a virtual screening scenario. Eur Radiol 2022; 32:4324-4332. [PMID: 35059804 DOI: 10.1007/s00330-021-08511-7] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/28/2021] [Revised: 12/06/2021] [Accepted: 12/09/2021] [Indexed: 12/17/2022]
Abstract
OBJECTIVES This study was conducted to evaluate the effect of dose reduction on the performance of a deep learning (DL)-based computer-aided diagnosis (CAD) system regarding pulmonary nodule detection in a virtual screening scenario. METHODS Sixty-eight anthropomorphic chest phantoms were equipped with 329 nodules (150 ground glass, 179 solid) with four sizes (5 mm, 8 mm, 10 mm, 12 mm) and scanned with nine tube voltage/current combinations. The examinations were analyzed by a commercially available DL-based CAD system. The results were compared by a comparison of proportions. Logistic regression was performed to evaluate the impact of tube voltage, tube current, nodule size, nodule density, and nodule location. RESULTS The combination with the lowest effective dose (E) and unimpaired detection rate was 80 kV/50 mAs (sensitivity: 97.9%, mean false-positive rate (FPR): 1.9, mean CTDIvol: 1.2 ± 0.4 mGy, mean E: 0.66 mSv). Logistic regression revealed that tube voltage and current had the greatest impact on the detection rate, while nodule size and density had no significant influence. CONCLUSIONS The optimal tube voltage/current combination proposed in this study (80 kV/50 mAs) is comparable to the proposed combinations in similar studies, which mostly dealt with conventional CAD software. Modification of tube voltage and tube current has a significant impact on the performance of DL-based CAD software in pulmonary nodule detection regardless of their size and composition. KEY POINTS • Modification of tube voltage and tube current has a significant impact on the performance of deep learning-based CAD software. • Nodule size and composition have no significant impact on the software's performance. • The optimal tube voltage/current combination for the examined software is 80 kV/50 mAs.
Collapse
Affiliation(s)
- Alan A Peters
- Department of Diagnostic, Interventional and Pediatric Radiology (DIPR), Bern University Hospital, University of Bern, Inselspital Bern, 3010, Switzerland.
| | - Adrian T Huber
- Department of Diagnostic, Interventional and Pediatric Radiology (DIPR), Bern University Hospital, University of Bern, Inselspital Bern, 3010, Switzerland
| | - Verena C Obmann
- Department of Diagnostic, Interventional and Pediatric Radiology (DIPR), Bern University Hospital, University of Bern, Inselspital Bern, 3010, Switzerland
| | - Johannes T Heverhagen
- Department of Diagnostic, Interventional and Pediatric Radiology (DIPR), Bern University Hospital, University of Bern, Inselspital Bern, 3010, Switzerland.,Department of BioMedical Research, Experimental Radiology, University of Bern, 3008, Bern, Switzerland.,Department of Radiology, The Ohio State University, Columbus, OH, USA
| | - Andreas Christe
- Department of Diagnostic, Interventional and Pediatric Radiology (DIPR), Bern University Hospital, University of Bern, Inselspital Bern, 3010, Switzerland
| | - Lukas Ebner
- Department of Diagnostic, Interventional and Pediatric Radiology (DIPR), Bern University Hospital, University of Bern, Inselspital Bern, 3010, Switzerland
| |
Collapse
|
24
|
Min Y, Hu L, Wei L, Nie S. Computer-aided detection of pulmonary nodules based on convolutional neural networks: a review. Phys Med Biol 2022; 67. [DOI: 10.1088/1361-6560/ac568e] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2021] [Accepted: 02/18/2022] [Indexed: 02/08/2023]
Abstract
Abstract
Computer-aided detection (CADe) technology has been proven to increase the detection rate of pulmonary nodules that has important clinical significance for the early diagnosis of lung cancer. In this study, we systematically review the latest techniques in pulmonary nodule CADe based on deep learning models with convolutional neural networks in computed tomography images. First, the brief descriptions and popular architecture of convolutional neural networks are introduced. Second, several common public databases and evaluation metrics are briefly described. Third, state-of-the-art approaches with excellent performances are selected. Subsequently, we combine the clinical diagnostic process and the traditional four steps of pulmonary nodule CADe into two stages, namely, data preprocessing and image analysis. Further, the major optimizations of deep learning models and algorithms are highlighted according to the progressive evaluation effect of each method, and some clinical evidence is added. Finally, various methods are summarized and compared. The innovative or valuable contributions of each method are expected to guide future research directions. The analyzed results show that deep learning-based methods significantly transformed the detection of pulmonary nodules, and the design of these methods can be inspired by clinical imaging diagnostic procedures. Moreover, focusing on the image analysis stage will result in improved returns. In particular, optimal results can be achieved by optimizing the steps of candidate nodule generation and false positive reduction. End-to-end methods, with greater operating speeds and lower computational consumptions, are superior to other methods in CADe of pulmonary nodules.
Collapse
|
25
|
Cui X, Zheng S, Heuvelmans MA, Du Y, Sidorenkov G, Fan S, Li Y, Xie Y, Zhu Z, Dorrius MD, Zhao Y, Veldhuis RNJ, de Bock GH, Oudkerk M, van Ooijen PMA, Vliegenthart R, Ye Z. Performance of a deep learning-based lung nodule detection system as an alternative reader in a Chinese lung cancer screening program. Eur J Radiol 2021; 146:110068. [PMID: 34871936 DOI: 10.1016/j.ejrad.2021.110068] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2021] [Revised: 10/03/2021] [Accepted: 11/22/2021] [Indexed: 11/03/2022]
Abstract
OBJECTIVE To evaluate the performance of a deep learning-based computer-aided detection (DL-CAD) system in a Chinese low-dose CT (LDCT) lung cancer screening program. MATERIALS AND METHODS One-hundred-and-eighty individuals with a lung nodule on their baseline LDCT lung cancer screening scan were randomly mixed with screenees without nodules in a 1:1 ratio (total: 360 individuals). All scans were assessed by double reading and subsequently processed by an academic DL-CAD system. The findings of double reading and the DL-CAD system were then evaluated by two senior radiologists to derive the reference standard. The detection performance was evaluated by the Free Response Operating Characteristic curve, sensitivity and false-positive (FP) rate. The senior radiologists categorized nodules according to nodule diameter, type (solid, part-solid, non-solid) and Lung-RADS. RESULTS The reference standard consisted of 262 nodules ≥ 4 mm in 196 individuals; 359 findings were considered false positives. The DL-CAD system achieved a sensitivity of 90.1% with 1.0 FP/scan for detection of lung nodules regardless of size or type, whereas double reading had a sensitivity of 76.0% with 0.04 FP/scan (P = 0.001). The sensitivity for detection of nodules ≥ 4 - ≤ 6 mm was significantly higher with DL-CAD than with double reading (86.3% vs. 58.9% respectively; P = 0.001). Sixty-three nodules were only identified by the DL-CAD system, and 27 nodules only found by double reading. The DL-CAD system reached similar performance compared to double reading in Lung-RADS 3 (94.3% vs. 90.0%, P = 0.549) and Lung-RADS 4 nodules (100.0% vs. 97.0%, P = 1.000), but showed a higher sensitivity in Lung-RADS 2 (86.2% vs. 65.4%, P < 0.001). CONCLUSIONS The DL-CAD system can accurately detect pulmonary nodules on LDCT, with an acceptable false-positive rate of 1 nodule per scan and has higher detection performance than double reading. This DL-CAD system may assist radiologists in nodule detection in LDCT lung cancer screening.
Collapse
Affiliation(s)
- Xiaonan Cui
- Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Centre of Cancer, Key Laboratory of Cancer Prevention and Therapy, Department of Radiology, Tianjin, People's Republic of China; University of Groningen, University Medical Center Groningen, Department of Radiology, Groningen, the Netherlands
| | - Sunyi Zheng
- Westlake University, Artificial Intelligence and Biomedical Image Analysis Lab, School of Engineering, Hangzhou, People's Republic of China; Institute of Advanced Technology, Westlake Institute for Advanced Study, Hangzhou, People's Republic of China; University of Groningen, University Medical Center Groningen, Department of Radiation Oncology, Groningen, the Netherlands
| | - Marjolein A Heuvelmans
- University of Groningen, University Medical Center Groningen, Department of Epidemiology, Groningen, the Netherlands
| | - Yihui Du
- University of Groningen, University Medical Center Groningen, Department of Epidemiology, Groningen, the Netherlands
| | - Grigory Sidorenkov
- University of Groningen, University Medical Center Groningen, Department of Epidemiology, Groningen, the Netherlands
| | - Shuxuan Fan
- Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Centre of Cancer, Key Laboratory of Cancer Prevention and Therapy, Department of Radiology, Tianjin, People's Republic of China
| | - Yanju Li
- Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Centre of Cancer, Key Laboratory of Cancer Prevention and Therapy, Department of Radiology, Tianjin, People's Republic of China
| | - Yongsheng Xie
- Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Centre of Cancer, Key Laboratory of Cancer Prevention and Therapy, Department of Radiology, Tianjin, People's Republic of China
| | - Zhongyuan Zhu
- Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Centre of Cancer, Key Laboratory of Cancer Prevention and Therapy, Department of Radiology, Tianjin, People's Republic of China
| | - Monique D Dorrius
- University of Groningen, University Medical Center Groningen, Department of Radiology, Groningen, the Netherlands
| | - Yingru Zhao
- Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Centre of Cancer, Key Laboratory of Cancer Prevention and Therapy, Department of Radiology, Tianjin, People's Republic of China
| | - Raymond N J Veldhuis
- University of Twente, Faculty of Electrical Engineering Mathematics and Computer Science, the Netherlands
| | - Geertruida H de Bock
- University of Groningen, University Medical Center Groningen, Department of Epidemiology, Groningen, the Netherlands
| | - Matthijs Oudkerk
- University of Groningen, Faculty of Medical Sciences, the Netherlands
| | - Peter M A van Ooijen
- University of Groningen, University Medical Center Groningen, Department of Radiation Oncology, Groningen, the Netherlands; University of Groningen, University Medical Center Groningen, Machine Learning Lab, Data Science Center in Health, Groningen, the Netherlands
| | - Rozemarijn Vliegenthart
- University of Groningen, University Medical Center Groningen, Department of Radiology, Groningen, the Netherlands
| | - Zhaoxiang Ye
- Tianjin Medical University Cancer Institute and Hospital, National Clinical Research Centre of Cancer, Key Laboratory of Cancer Prevention and Therapy, Department of Radiology, Tianjin, People's Republic of China.
| |
Collapse
|
26
|
Winder M, Owczarek AJ, Chudek J, Pilch-Kowalczyk J, Baron J. Are We Overdoing It? Changes in Diagnostic Imaging Workload during the Years 2010-2020 including the Impact of the SARS-CoV-2 Pandemic. Healthcare (Basel) 2021; 9:healthcare9111557. [PMID: 34828603 PMCID: PMC8621920 DOI: 10.3390/healthcare9111557] [Citation(s) in RCA: 24] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/16/2021] [Revised: 11/09/2021] [Accepted: 11/10/2021] [Indexed: 12/30/2022] Open
Abstract
Since the 1990s, there has been a significant increase in the number of imaging examinations as well as a related increase in the healthcare expenditure and the exposure of the population to X-rays. This study aimed to analyze the workload trends in radiology during the last decade, including the impact of COVID-19 in a single university hospital in Poland and to identify possible solutions to the challenges that radiology could face in the future. We compared the annual amount of computed tomography (CT), radiography (X-ray), and ultrasound (US) examinations performed between the years 2010 and 2020 and analyzed the changes in the number of practicing radiologists in Poland. The mean number of patients treated in our hospital was 60,727 per year. During the last decade, the number of CT and US examinations nearly doubled (from 87.4 to 155.7 and from 52.1 to 86.5 per 1000 patients in 2010 and 2020 respectively), while X-ray examinations decreased from 115.1 to 96.9 per 1000 patients. The SARS-CoV-2 pandemic did not change the workload trends as more chest examinations were performed. AI, which contributed to the COVID-19 diagnosis, could aid radiologists in the future with the growing workload by increasing the efficiency of radiology departments as well as by potentially minimizing the related costs.
Collapse
Affiliation(s)
- Mateusz Winder
- Department of Radiology and Nuclear Medicine, Medical University of Silesia, 40-055 Katowice, Poland; (J.P.-K.); (J.B.)
- Correspondence: ; Tel.: +48-32-789-47-51
| | - Aleksander Jerzy Owczarek
- Health Promotion and Obesity Management Unit, Department of Pathophysiology, Medical University of Silesia, 40-055 Katowice, Poland;
| | - Jerzy Chudek
- Department of Internal Medicine and Oncological Chemotherapy, Medical University of Silesia, 40-055 Katowice, Poland;
| | - Joanna Pilch-Kowalczyk
- Department of Radiology and Nuclear Medicine, Medical University of Silesia, 40-055 Katowice, Poland; (J.P.-K.); (J.B.)
| | - Jan Baron
- Department of Radiology and Nuclear Medicine, Medical University of Silesia, 40-055 Katowice, Poland; (J.P.-K.); (J.B.)
| |
Collapse
|
27
|
Yu N, Yu H, Li H, Ma N, Hu C, Wang J. A Robust Deep Learning Segmentation Method for Hematoma Volumetric Detection in Intracerebral Hemorrhage. Stroke 2021; 53:167-176. [PMID: 34601899 DOI: 10.1161/strokeaha.120.032243] [Citation(s) in RCA: 7] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
Abstract
BACKGROUND AND PURPOSE Hematoma volume (HV) is a significant diagnosis for determining the clinical stage and therapeutic approach for intracerebral hemorrhage (ICH). The aim of this study is to develop a robust deep learning segmentation method for the fast and accurate HV analysis using computed tomography. METHODS A novel dimension reduction UNet (DR-UNet) model was developed for computed tomography image segmentation and HV measurement. Two data sets, 512 ICH patients with 12 568 computed tomography slices in the retrospective data set and 50 ICH patients with 1257 slices in the prospective data set, were used for network training, validation, and internal and external testing. Moreover, 13 irregular hematoma cases, 11 subdural and epidural hematoma cases, and 50 different HV cases into 3 groups (<30, 30-60, and >60 mL) were selected to further evaluate the robustness of DR-UNet. The image segmentation performance of DR-UNet was compared with those of UNet, the fuzzy clustering method, and the active contour method. The HV measurement performance was compared using DR-UNet, UNet, and the Coniglobus formula method. RESULTS Using DR-UNet, the segmentation model achieved a performance similar to that of expert clinicians in 2 independent test data sets containing internal testing data (Dice of 0.861±0.139) and external testing data (Dice of 0.874±0.130). The HV measurement derived from DR-UNet was strongly correlated with that from manual segmentation (R2=0.9979; P<0.0001). In the irregularly shaped hematoma group and the subdural and epidural hematoma group, DR-UNet was more robust than UNet in both hematoma segmentation and HV measurement. There is no statistical significance in segmentation accuracy among 3 different HV groups. CONCLUSIONS DR-UNet can segment hematomas from the computed tomography scans of ICH patients and quantify the HV with better accuracy and greater efficiency than the main existing methods and with similar performance to expert clinicians. Due to robust performance and stable segmentation on different ICHs, DR-UNet could facilitate the development of deep learning systems for a variety of clinical applications.
Collapse
Affiliation(s)
- Nannan Yu
- Department of Artificial Intelligence, School of Electrical Engineering and Automation, Jiangsu Normal University, Xuzhou, China (N.Y., H.Y.)
| | - He Yu
- Department of Artificial Intelligence, School of Electrical Engineering and Automation, Jiangsu Normal University, Xuzhou, China (N.Y., H.Y.)
| | - Haonan Li
- Department of Biotechnology, College of Basic Medical Sciences, Dalian Medical University, China (H.L., J.W.)
| | - Nannan Ma
- Radiology Department, Xuzhou Central Hospital, China (N.M., C.H.)
| | - Chunai Hu
- Radiology Department, Xuzhou Central Hospital, China (N.M., C.H.)
| | - Jia Wang
- Department of Biotechnology, College of Basic Medical Sciences, Dalian Medical University, China (H.L., J.W.)
| |
Collapse
|
28
|
Park S, Park H, Lee SM, Ahn Y, Kim W, Jung K, Seo JB. Application of computer-aided diagnosis for Lung-RADS categorization in CT screening for lung cancer: effect on inter-reader agreement. Eur Radiol 2021; 32:1054-1064. [PMID: 34331112 DOI: 10.1007/s00330-021-08202-3] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/10/2021] [Revised: 06/19/2021] [Accepted: 07/06/2021] [Indexed: 12/19/2022]
Abstract
OBJECTIVES To evaluate the effects of computer-aided diagnosis (CAD) on inter-reader agreement in Lung Imaging Reporting and Data System (Lung-RADS) categorization. METHODS Two hundred baseline CT scans covering all Lung-RADS categories were randomly selected from the National Lung Cancer Screening Trial. Five radiologists independently reviewed the CT scans and assigned Lung-RADS categories without CAD and with CAD. The CAD system presented up to five of the most risk-dominant nodules with measurements and predicted Lung-RADS category. Inter-reader agreement was analyzed using multirater Fleiss κ statistics. RESULTS The five readers reported 139-151 negative screening results without CAD and 126-142 with CAD. With CAD, readers tended to upstage (average, 12.3%) rather than downstage Lung-RADS category (average, 4.4%). Inter-reader agreement of five readers for Lung-RADS categorization was moderate (Fleiss kappa, 0.60 [95% confidence interval, 0.57, 0.63]) without CAD, and slightly improved to substantial (Fleiss kappa, 0.65 [95% CI, 0.63, 0.68]) with CAD. The major cause for disagreement was assignment of different risk-dominant nodules in the reading sessions without and with CAD (54.2% [201/371] vs. 63.6% [232/365]). The proportion of disagreement in nodule size measurement was reduced from 5.1% (102/2000) to 3.1% (62/2000) with the use of CAD (p < 0.001). In 31 cancer-positive cases, substantial management discrepancies (category 1/2 vs. 4A/B) between reader pairs decreased with application of CAD (pooled sensitivity, 85.2% vs. 91.6%; p = 0.004). CONCLUSIONS Application of CAD demonstrated a minor improvement in inter-reader agreement of Lung-RADS category, while showing the potential to reduce measurement variability and substantial management change in cancer-positive cases. KEY POINTS • Inter-reader agreement of five readers for Lung-RADS categorization was minimally improved by application of CAD, with a Fleiss kappa value of 0.60 to 0.65. • The major cause for disagreement was assignment of different risk-dominant nodules in the reading sessions without and with CAD (54.2% vs. 63.6%). • In 31 cancer-positive cases, substantial management discrepancies between reader pairs, referring to a difference in follow-up interval of at least 9 months (category 1/2 vs. 4A/B), were reduced in half by application of CAD (32/310 to 16/310) (pooled sensitivity, 85.2% vs. 91.6%; p = 0.004).
Collapse
Affiliation(s)
- Sohee Park
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43 Gil, Songpa-gu, Seoul, 138-736, Korea
| | | | - Sang Min Lee
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43 Gil, Songpa-gu, Seoul, 138-736, Korea.
| | - Yura Ahn
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43 Gil, Songpa-gu, Seoul, 138-736, Korea
| | - Wooil Kim
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43 Gil, Songpa-gu, Seoul, 138-736, Korea.,Department of Radiology and Medical Imaging, University of Virginia Health System, Charlottesville, VA, USA
| | | | - Joon Beom Seo
- Department of Radiology and Research Institute of Radiology, University of Ulsan College of Medicine, Asan Medical Center, 88 Olympic-ro 43 Gil, Songpa-gu, Seoul, 138-736, Korea
| |
Collapse
|
29
|
Hsu HH, Ko KH, Chou YC, Wu YC, Chiu SH, Chang CK, Chang WC. Performance and reading time of lung nodule identification on multidetector CT with or without an artificial intelligence-powered computer-aided detection system. Clin Radiol 2021; 76:626.e23-626.e32. [PMID: 34023068 DOI: 10.1016/j.crad.2021.04.006] [Citation(s) in RCA: 15] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2020] [Accepted: 04/15/2021] [Indexed: 10/21/2022]
Abstract
AIM To compare the performance and reading time of different readers using automatic artificial intelligence (AI)-powered computer-aided detection (CAD) to detect lung nodules in different reading modes. MATERIALS AND METHODS One hundred and fifty multidetector computed tomography (CT) datasets containing 340 nodules ≤10 mm in diameter were collected retrospectively. A CAD with vessel-suppressed function was used to interpret the images. Three junior and three senior readers were assigned to read (1) CT images without CAD, (2) second-read using CAD in which CAD was applied only after initial unassisted assessment, and (3) a concurrent read with CAD in which CAD was applied at the start of assessment. Diagnostic performances and reading times were compared using analysis of variance. RESULTS For all readers, the mean sensitivity improved from 64% (95% confidence interval [CI]: 62%, 66%) for the without-CAD mode to 82% (95% CI: 80%, 84%) for the second-reading mode and to 80% (95% CI: 79%, 82%) for the concurrent-reading mode (p<0.001). There was no significant difference between the two modes in terms of the mean sensitivity, specificity, and area under the receiver operating characteristic curve (AUC) for both junior and senior readers and all readers (p>0.05). The reading time of all readers was significantly shorter for the concurrent-reading mode (124 ± 25 seconds) compared to without CAD (156 ± 34 seconds; p<0.001) and the second-reading mode (197 ± 46 seconds; p<0.001). CONCLUSION In CAD for lung nodules at CT, the second-reading mode and concurrent-reading mode may improve detection performance for all readers in both screening and clinical routine practice. Concurrent use of CAD is more efficient for both junior and senior readers.
Collapse
Affiliation(s)
- H-H Hsu
- Department of Radiology, Tri-Service General Hospital, National Defense Medical Center, Taipei, Taiwan.
| | - K-H Ko
- Department of Radiology, Tri-Service General Hospital, National Defense Medical Center, Taipei, Taiwan
| | - Y-C Chou
- School of Public Health, National Defense Medical Center, Taipei, Taiwan
| | - Y-C Wu
- Department of Radiology, Tri-Service General Hospital, National Defense Medical Center, Taipei, Taiwan
| | - S-H Chiu
- Department of Radiology, Tri-Service General Hospital, National Defense Medical Center, Taipei, Taiwan
| | - C-K Chang
- Department of Radiology, Tri-Service General Hospital, National Defense Medical Center, Taipei, Taiwan
| | - W-C Chang
- Department of Radiology, Tri-Service General Hospital, National Defense Medical Center, Taipei, Taiwan
| |
Collapse
|
30
|
Chillakuru YR, Kranen K, Doppalapudi V, Xiong Z, Fu L, Heydari A, Sheth A, Seo Y, Vu T, Sohn JH. High precision localization of pulmonary nodules on chest CT utilizing axial slice number labels. BMC Med Imaging 2021; 21:66. [PMID: 33836677 PMCID: PMC8034095 DOI: 10.1186/s12880-021-00594-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2020] [Accepted: 03/08/2021] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Reidentification of prior nodules for temporal comparison is an important but time-consuming step in lung cancer screening. We develop and evaluate an automated nodule detector that utilizes the axial-slice number of nodules found in radiology reports to generate high precision nodule predictions. METHODS 888 CTs from Lung Nodule Analysis were used to train a 2-dimensional (2D) object detection neural network. A pipeline of 2D object detection, 3D unsupervised clustering, false positive reduction, and axial-slice numbers were used to generate nodule candidates. 47 CTs from the National Lung Cancer Screening Trial (NLST) were used for model evaluation. RESULTS Our nodule detector achieved a precision of 0.962 at a recall of 0.573 on the NLST test set for any nodule. When adjusting for unintended nodule predictions, we achieved a precision of 0.931 at a recall 0.561, which corresponds to 0.06 false positives per CT. Error analysis revealed better detection of nodules with soft tissue attenuation compared to ground glass and undeterminable attenuation. Nodule margins, size, location, and patient demographics did not differ between correct and incorrect predictions. CONCLUSIONS Utilization of axial-slice numbers from radiology reports allowed for development of a lung nodule detector with a low false positive rate compared to prior feature-engineering and machine learning approaches. This high precision nodule detector can reduce time spent on reidentification of prior nodules during lung cancer screening and can rapidly develop new institutional datasets to explore novel applications of computer vision in lung cancer imaging.
Collapse
Affiliation(s)
- Yeshwant Reddy Chillakuru
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 505 Parnassus Ave, San Francisco, CA, 94143, USA.,George Washington University School of Medicine, 2300 I St NW, Washington, DC, 20052, USA
| | - Kyle Kranen
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Vishnu Doppalapudi
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Zhangyuan Xiong
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Letian Fu
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Aarash Heydari
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Aditya Sheth
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Youngho Seo
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Thienkhai Vu
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 505 Parnassus Ave, San Francisco, CA, 94143, USA
| | - Jae Ho Sohn
- Department of Radiology and Biomedical Imaging, University of California San Francisco, 505 Parnassus Ave, San Francisco, CA, 94143, USA.
| |
Collapse
|
31
|
Aggarwal R, Sounderajah V, Martin G, Ting DSW, Karthikesalingam A, King D, Ashrafian H, Darzi A. Diagnostic accuracy of deep learning in medical imaging: a systematic review and meta-analysis. NPJ Digit Med 2021; 4:65. [PMID: 33828217 PMCID: PMC8027892 DOI: 10.1038/s41746-021-00438-z] [Citation(s) in RCA: 237] [Impact Index Per Article: 79.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2020] [Accepted: 02/25/2021] [Indexed: 12/19/2022] Open
Abstract
Deep learning (DL) has the potential to transform medical diagnostics. However, the diagnostic accuracy of DL is uncertain. Our aim was to evaluate the diagnostic accuracy of DL algorithms to identify pathology in medical imaging. Searches were conducted in Medline and EMBASE up to January 2020. We identified 11,921 studies, of which 503 were included in the systematic review. Eighty-two studies in ophthalmology, 82 in breast disease and 115 in respiratory disease were included for meta-analysis. Two hundred twenty-four studies in other specialities were included for qualitative review. Peer-reviewed studies that reported on the diagnostic accuracy of DL algorithms to identify pathology using medical imaging were included. Primary outcomes were measures of diagnostic accuracy, study design and reporting standards in the literature. Estimates were pooled using random-effects meta-analysis. In ophthalmology, AUC's ranged between 0.933 and 1 for diagnosing diabetic retinopathy, age-related macular degeneration and glaucoma on retinal fundus photographs and optical coherence tomography. In respiratory imaging, AUC's ranged between 0.864 and 0.937 for diagnosing lung nodules or lung cancer on chest X-ray or CT scan. For breast imaging, AUC's ranged between 0.868 and 0.909 for diagnosing breast cancer on mammogram, ultrasound, MRI and digital breast tomosynthesis. Heterogeneity was high between studies and extensive variation in methodology, terminology and outcome measures was noted. This can lead to an overestimation of the diagnostic accuracy of DL algorithms on medical imaging. There is an immediate need for the development of artificial intelligence-specific EQUATOR guidelines, particularly STARD, in order to provide guidance around key issues in this field.
Collapse
Affiliation(s)
- Ravi Aggarwal
- Institute of Global Health Innovation, Imperial College London, London, UK
| | | | - Guy Martin
- Institute of Global Health Innovation, Imperial College London, London, UK
| | - Daniel S W Ting
- Singapore Eye Research Institute, Singapore National Eye Center, Singapore, Singapore
| | | | - Dominic King
- Institute of Global Health Innovation, Imperial College London, London, UK
| | - Hutan Ashrafian
- Institute of Global Health Innovation, Imperial College London, London, UK.
| | - Ara Darzi
- Institute of Global Health Innovation, Imperial College London, London, UK
| |
Collapse
|
32
|
Perl RM, Grimmer R, Hepp T, Horger MS. Can a Novel Deep Neural Network Improve the Computer-Aided Detection of Solid Pulmonary Nodules and the Rate of False-Positive Findings in Comparison to an Established Machine Learning Computer-Aided Detection? Invest Radiol 2021; 56:103-108. [PMID: 32796198 DOI: 10.1097/rli.0000000000000713] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
OBJECTIVE The aim of this study was to compare the performance of 2 approved computer-aided detection (CAD) systems for detection of pulmonary solid nodules (PSNs) in an oncologic cohort. The first CAD system is based on a conventional machine learning approach (VD10F), and the other is based on a deep 3D convolutional neural network (CNN) CAD software (VD20A). METHODS AND MATERIALS Nine hundred sixty-seven patients with a total of 2451 PSNs were retrospectively evaluated using the 2 different CAD systems. All patients had thin-slice chest computed tomography (0.6 mm) using 100 kV and 100 mAs and a high-resolution kernel (I50f). The CAD images generated by VD10F were transferred to the PACS for evaluation. The images generated by VD20A were evaluated using a Web browser-based viewer. Finally, a senior radiologist who was blinded for the CAD results examined the thin-slice images of every patient (ground truth). RESULTS A total of 2451 PSNs were detected by the senior radiologist. CAD-VD10F detected 1401 true-positive, 143 false-negative, 565 false-positive (FP), and 342 true-negative PSNs, resulting in sensitivity of 90.7%, specificity of 37.7%, positive predictive value of 0.71, and negative predictive value of 0.70. CAD-VD20A detected 1381 true-positive, 163 false-negative, 337 FP, and 570 true-negative PSNs, resulting in sensitivity of 89.4%, specificity of 62.8%, positive predictive value of 0.80, and negative predictive value 0.77, respectively. The rate of FP per scan was 0.6 for CAD-VD10F and 0.3 for CAD-VD20A. CONCLUSIONS The new deep learning-based CAD software (VD20A) shows similar sensitivity with the conventional CAD software (VD10F), but a significantly higher specificity.
Collapse
Affiliation(s)
- Regine Mariette Perl
- From the Department of Diagnostic and Interventional Radiology, University Hospital of Tuebingen, Tuebingen
| | | | | | - Marius Stefan Horger
- From the Department of Diagnostic and Interventional Radiology, University Hospital of Tuebingen, Tuebingen
| |
Collapse
|
33
|
Joy Mathew C, David AM, Joy Mathew CM. Artificial Intelligence and its future potential in lung cancer screening. EXCLI JOURNAL 2021; 19:1552-1562. [PMID: 33408594 PMCID: PMC7783473 DOI: 10.17179/excli2020-3095] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/27/2020] [Accepted: 12/05/2020] [Indexed: 12/18/2022]
Abstract
Artificial intelligence (AI) simulates intelligent behavior as well as critical thinking comparable to a human being and can be used to analyze and interpret complex medical data. The application of AI in imaging diagnostics reduces the burden of radiologists and increases the sensitivity of lung cancer screening so that the morbidity and mortality associated with lung cancer can be decreased. In this article, we have tried to evaluate the role of artificial intelligence in lung cancer screening, as well as the future potential and efficiency of AI in the classification of nodules. The relevant studies between 2010-2020 were selected from the PubMed database after excluding animal studies and were analyzed for the contribution of AI. Techniques such as deep learning and machine learning allow automatic characterization and classification of nodules with high precision and promise an advanced lung cancer screening method in the future. Even though several combination models with high performance have been proposed, an effectively validated model for routine use still needs to be improvised. Combining the performance of artificial intelligence with a radiologist's expertise offers a successful outcome with higher accuracy. Thus, we can conclude that higher sensitivity, specificity, and accuracy of lung cancer screening and classification of nodules is possible through the integration of artificial intelligence and radiology. The validation of models and further research is to be carried out to determine the feasibility of this integration.
Collapse
Affiliation(s)
- Christopher Joy Mathew
- Acute Medicine Department, Conquest Hospital, East Sussex Healthcare NHS Trust, United Kingdom
| | - Ashwini Maria David
- Jubilee Mission Medical College and Research Institute, Kerala University of Health Sciences, Kerala, India
| | | |
Collapse
|
34
|
Hänggi JM, Spinnler S, Christodoulides E, Gramespacher E, Taube W, Doherty A. Sedentary Behavior in Children by Wearable Cameras: Development of an Annotation Protocol. Am J Prev Med 2020; 59:880-886. [PMID: 33160796 DOI: 10.1016/j.amepre.2020.06.033] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/20/2020] [Revised: 06/16/2020] [Accepted: 06/25/2020] [Indexed: 12/20/2022]
Abstract
INTRODUCTION There is increasing evidence that not all types of sedentary behavior have the same harmful effects on children's health. Hence, there has been a growing interest in the use of wearable cameras. The aim of this study is to develop a protocol to categorize children's wearable camera data into sedentary behavior components. METHODS Wearable camera data were collected in 3 different samples of children in 2014. A development sample (3 children aged 4-8 years) was used to design the annotation protocol. A training sample (4 children aged 10 years) was used to train 3 different coders. The independent reliability sample (14 children aged 9-11 years) was used for independent coding of wearable camera images and to estimate inter-rater agreement. Data were analyzed in 2018. Cohen's κ was calculated for every rater pair on a per-participant basis. Means and SDs were then calculated across per-participant κ scores. RESULTS A total of 41,651 images from 14 participants were considered for analysis. Inter-rater agreement over all raters over all the sedentary behavior components was almost perfect (mean κ=0.85, 95% CI=0.83, 0.87). Inter-rater reliability for screen-based sedentary behavior (mean κ=0.72, 95% CI=0.62, 0.82) and nonscreen sedentary behavior (κ=0.69, 95% CI=0.65, 0.72) showed substantial agreement. Inter-rater reliability for location (κ=0.91, 95% CI=0.88, 0.93) showed almost perfect agreement. CONCLUSIONS A reliable annotation protocol to categorize wearable camera data of children into sedentary behavior components was developed. Once applied to larger samples in children, this protocol can ultimately help to better understand the potential harms of screen time and sedentary behavior in children.
Collapse
Affiliation(s)
- Johanna M Hänggi
- School of Education, University of Applied Sciences Northwestern Switzerland, Brugg, Switzerland; Movement and Sports Science, Department of Neurosciences and Movement Sciences, University of Fribourg, Fribourg, Switzerland.
| | - Simon Spinnler
- Department of Sport, Exercise and Health, University of Basel, Basel, Switzerland
| | - Efstathios Christodoulides
- Sport and Exercise Science, School of Science, University of Central Lancashire (UCLan) Cyprus, Larnaca, Cyprus
| | - Elke Gramespacher
- School of Education, University of Applied Sciences Northwestern Switzerland, Brugg, Switzerland
| | - Wolfgang Taube
- Movement and Sports Science, Department of Neurosciences and Movement Sciences, University of Fribourg, Fribourg, Switzerland
| | - Aiden Doherty
- Big Data Institute, Li Ka Shing Centre for Health Information and Discovery, University of Oxford, Oxford, United Kingdom; National Institute of Health Research Oxford Biomedical Research Centre, Oxford University Hospitals NHS Foundation Trust, John Radcliffe Hospital, Oxford, United Kingdom
| |
Collapse
|
35
|
Liu Z, Li L, Li T, Luo D, Wang X, Luo D. Does a Deep Learning-Based Computer-Assisted Diagnosis System Outperform Conventional Double Reading by Radiologists in Distinguishing Benign and Malignant Lung Nodules? Front Oncol 2020; 10:545862. [PMID: 33163395 PMCID: PMC7581733 DOI: 10.3389/fonc.2020.545862] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/26/2020] [Accepted: 09/14/2020] [Indexed: 01/10/2023] Open
Abstract
Background In differentiating indeterminate pulmonary nodules, multiple studies indicated the superiority of deep learning–based computer-assisted diagnosis system (DL-CADx) over conventional double reading by radiologists, which needs external validation. Therefore, our aim was to externally validate the performance of a commercial DL-CADx in differentiating benign and malignant lung nodules. Methods In this retrospective study, 233 patients with 261 pathologically confirmed lung nodules were enrolled. Double reading was used to rate each nodule using a four-scale malignancy score system, including unlikely (0–25%), malignancy cannot be completely excluded (25–50%), highly likely (50–75%), and considered as malignant (75–100%), with any disagreement resolved through discussion. DL-CADx automatically rated each nodule with a malignancy likelihood ranging from 0 to 100%, which was then quadrichotomized accordingly. Intraclass correlation coefficient (ICC) was used to evaluate the agreement in malignancy risk rating between DL-CADx and double reading, with ICC value of <0.5, 0.5 to 0.75, 0.75 to 0.9, and >0.9 indicating poor, moderate, good, and perfect agreement, respectively. With malignancy likelihood >50% as cut-off value for malignancy and pathological results as gold standard, sensitivity, specificity, and accuracy were calculated for double reading and DL-CADx, separately. Results Among the 261 nodules, 247 nodules were successfully detected by DL-CADx with detection rate of 94.7%. Regarding malignancy rating, DL-CADx was in moderate agreement with double reading (ICC = 0.555, 95% CI 0.424 to 0.655). DL-CADx misdiagnosed 40 true malignant nodules as benign nodules and 30 true benign nodules as malignant nodules with sensitivity, specificity, and accuracy of 79.2, 45.5, and 71.7%, respectively. In contrast, double reading achieved better performance with 16 true malignant nodules misdiagnosed as benign nodules and 26 true benign nodules as malignant nodules with sensitivity, specificity, and accuracy of 91.7, 52.7, and 83.0%, respectively. Conclusion Compared with double reading, DL-CADx we used still shows inferior performance in differentiating malignant and benign nodules.
Collapse
Affiliation(s)
- Zhou Liu
- Department of Radiology, National Cancer Center, National Clinical Research Center for Cancer, Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Shenzhen, China
| | - Li Li
- Department of Radiology, National Cancer Center, National Clinical Research Center for Cancer, Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Shenzhen, China
| | - Tianran Li
- Department of Radiology, National Cancer Center, National Clinical Research Center for Cancer, Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Shenzhen, China
| | - Douqiang Luo
- Department of Radiology, National Cancer Center, National Clinical Research Center for Cancer, Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Shenzhen, China.,Department of Radiology, National Cancer Center, National Clinical Research Center for Cancer, Cancer Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, China
| | - Xiaoliang Wang
- Department of Pathology, National Cancer Center, National Clinical Research Center for Cancer, Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Shenzhen, China
| | - Dehong Luo
- Department of Radiology, National Cancer Center, National Clinical Research Center for Cancer, Cancer Hospital & Shenzhen Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Shenzhen, China.,Department of Radiology, National Cancer Center, National Clinical Research Center for Cancer, Cancer Hospital, Chinese Academy of Medical Sciences, Peking Union Medical College, Beijing, China
| |
Collapse
|
36
|
The Use of Artificial Intelligence in the Differentiation of Malignant and Benign Lung Nodules on Computed Tomograms Proven by Surgical Pathology. Cancers (Basel) 2020; 12:cancers12082211. [PMID: 32784681 PMCID: PMC7464412 DOI: 10.3390/cancers12082211] [Citation(s) in RCA: 16] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2020] [Revised: 08/04/2020] [Accepted: 08/05/2020] [Indexed: 01/23/2023] Open
Abstract
The purpose of this work was to evaluate the performance of an existing commercially available artificial intelligence (AI) software system in differentiating malignant and benign lung nodules. The AI tool consisted of a vessel-suppression function and a deep-learning-based computer-aided-detection (VS-CAD) analyzer. Fifty patients (32 females, mean age 52 years) with 75 lung nodules (47 malignant and 28 benign) underwent low-dose computed tomography (LDCT) followed by surgical excision and the pathological analysis of their 75 nodules within a 3 month time frame. All 50 cases were then processed by the AI software to generate corresponding VS images and CAD outcomes. All 75 pathologically proven lung nodules were well delineated by vessel-suppressed images. Three (6.4%) of the 47 lung cancer cases, and 11 (39.3%) of the 28 benign nodules were ignored and not detected by the AI without showing a CAD analysis summary. The AI system/radiologists produced a sensitivity and specificity (shown in %) of 93.6/89.4 and 39.3/82.1 in distinguishing malignant from benign nodules, respectively. AI sensitivity was higher than that of radiologists, though not statistically significant (p = 0.712). Specificity obtained by the radiologists was significantly higher than that of the VS-CAD AI (p = 0.003). There was no significant difference between the malignant and benign lesions with respect to age, gender, pure ground-glass pattern, the diameter and location of the nodules, or nodules <6 vs. ≥6 mm. However, more part-solid nodules were proven to be malignant than benign (90.9% vs. 9.1%), and more solid nodules were proven to be benign than malignant (86.7% vs. 13.3%) with statistical significance (p = 0.001 and <0.001, respectively). A larger cohort and prospective study are required to validate the AI performance.
Collapse
|
37
|
Automated detection of pulmonary embolism in CT pulmonary angiograms using an AI-powered algorithm. Eur Radiol 2020; 30:6545-6553. [DOI: 10.1007/s00330-020-06998-0] [Citation(s) in RCA: 22] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2019] [Revised: 03/12/2020] [Accepted: 05/29/2020] [Indexed: 12/19/2022]
|
38
|
Efficiency of a computer-aided diagnosis (CAD) system with deep learning in detection of pulmonary nodules on 1-mm-thick images of computed tomography. Jpn J Radiol 2020; 38:1052-1061. [PMID: 32592003 DOI: 10.1007/s11604-020-01009-0] [Citation(s) in RCA: 19] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2020] [Accepted: 06/18/2020] [Indexed: 12/17/2022]
Abstract
PURPOSE To evaluate the performance of a deep learning-based computer-aided diagnosis (CAD) system at detecting pulmonary nodules on CT by comparing radiologists' readings with and without CAD. MATERIALS AND METHODS A total of 120 chest CT images were randomly selected from patients with suspected lung cancer. The gold standard of nodules ≥ 3 mm was established by a panel of three expert radiologists. Two less experienced radiologists read the images without and afterward with CAD system. Their reading times were recorded. RESULTS The radiologists' sensitivity increased from 20.9% to 38.0% with the introduction of CAD. The positive predictive value (PPV) decreased from 70.5% to 61.8%, and the F1-score increased from 32.2% to 47.0%. The sensitivity significantly increased from 13.7% to 32.4% for small nodules (3-6 mm) and from 33.3% to 47.6% for medium nodules (6-10 mm). CAD alone showed a sensitivity of 70.3%, a PPV of 57.9%, and an F1-score of 63.5%. Reading time decreased by 11.3% with the use of CAD. CONCLUSION CAD improved the less experienced radiologists' sensitivity in detecting pulmonary nodules of all sizes, especially including a significant improvement in the detection of clinically important-sized medium nodules (6-10 mm) as well as small nodules (3-6 mm) and reduced their reading time.
Collapse
|
39
|
The Performance of Deep Learning Algorithms on Automatic Pulmonary Nodule Detection and Classification Tested on Different Datasets That Are Not Derived from LIDC-IDRI: A Systematic Review. Diagnostics (Basel) 2019; 9:diagnostics9040207. [PMID: 31795409 PMCID: PMC6963966 DOI: 10.3390/diagnostics9040207] [Citation(s) in RCA: 28] [Impact Index Per Article: 5.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2019] [Revised: 11/25/2019] [Accepted: 11/28/2019] [Indexed: 12/27/2022] Open
Abstract
The aim of this study was to systematically review the performance of deep learning technology in detecting and classifying pulmonary nodules on computed tomography (CT) scans that were not from the Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) database. Furthermore, we explored the difference in performance when the deep learning technology was applied to test datasets different from the training datasets. Only peer-reviewed, original research articles utilizing deep learning technology were included in this study, and only results from testing on datasets other than the LIDC-IDRI were included. We searched a total of six databases: EMBASE, PubMed, Cochrane Library, the Institute of Electrical and Electronics Engineers, Inc. (IEEE), Scopus, and Web of Science. This resulted in 1782 studies after duplicates were removed, and a total of 26 studies were included in this systematic review. Three studies explored the performance of pulmonary nodule detection only, 16 studies explored the performance of pulmonary nodule classification only, and 7 studies had reports of both pulmonary nodule detection and classification. Three different deep learning architectures were mentioned amongst the included studies: convolutional neural network (CNN), massive training artificial neural network (MTANN), and deep stacked denoising autoencoder extreme learning machine (SDAE-ELM). The studies reached a classification accuracy between 68–99.6% and a detection accuracy between 80.6–94%. Performance of deep learning technology in studies using different test and training datasets was comparable to studies using same type of test and training datasets. In conclusion, deep learning was able to achieve high levels of accuracy, sensitivity, and/or specificity in detecting and/or classifying nodules when applied to pulmonary CT scans not from the LIDC-IDRI database.
Collapse
|
40
|
Angelini E, Dahan S, Shah A. Unravelling machine learning: insights in respiratory medicine. Eur Respir J 2019; 54:13993003.01216-2019. [DOI: 10.1183/13993003.01216-2019] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/20/2019] [Accepted: 09/26/2019] [Indexed: 12/20/2022]
|