Performance of a deep learning-based lung nodule detection system as an alternative reader in a Chinese lung cancer screening program

Performance of AI for preoperative CT assessment of lung metastases: Retrospective analysis of 167 patients

OBJECTIVES

To evaluate the performance of artificial intelligence (AI) in the preoperative detection of lung metastases on CT.

MATERIALS AND METHODS

Patients who underwent lung metastasectomy in our institution between 2016 and 2020 were enrolled, their preoperative CT reports having been performed before an AI solution (Veye Lung Nodules, version 3.9.2, Aidence) became available as a second reader in our department. All CT scans were retrospectively processed by AI. The sensitivities of unassisted radiologists (original CT radiology reports), AI reports alone and both combined were compared. Ground truth was established by a consensus reading of two radiologists, who analyzed whether the nodules mentioned in the pathology report were retrospectively visible on CT. Multivariate analysis was performed to identify nodule characteristics associated with detectability.

RESULTS

A total of 167 patients (men: 62.9 %; median age, 59 years [47-68]) with 475 resected nodules were included. AI detected an average of 4 nodules (0-17) per CT, of which 97 % were true nodules. The combination of radiologist plus AI (92.4 %) had significantly higher sensitivity than unassisted radiologists (80.4 %) (p < 0.001). In 27/57 (47.4 %) patients who had multiple preoperative CT scans, AI detected lung nodules earlier than the radiologist. Vascular contact was associated with non-detection by radiologists (OR:0.32[0.19, 0.54], p < 0.001), whilst the presence of cavitation (OR:0.26[0.13, 0.54], p < 0.001) or pleural contact (OR:0.10[0.04, 0.22], p < 0.001) was associated with non-detection by AI.

CONCLUSION

AI significantly increases the sensitivity of preoperative detection of lung metastases and enables earlier detection, with a significant potential benefit for patient management.

Impact of artificial intelligence assistance on pulmonary nodule detection and localization in chest CT: a comparative study among radiologists of varying experience levels

The study aimed to evaluate the impact of AI assistance on pulmonary nodule detection rates among radiology residents and senior radiologists, along with assessing the effectiveness of two different commercialy available AI software systems in improving detection rates and LungRADS classification in chest CT. The study cohort included 198 participants with 221 pulmonary nodules. Residents' mean detection rate increased significantly from 64 to 77% with AI assist, while seniors' detection rate remained largely unchanged (85% vs. 86%). Residents showed significant improvement in segmental nodule localization with AI assistance, seniors did not. Software 2 slightly outperformed software 1 in increasing detection rates (67-77% vs. 80-86%), but neither significantly affected LungRADS classification. The study suggests that clinical experience mitigates the need for additional AI software, with the combination of CAD with residents being the most beneficial approach. Both software systems performed similarly, with software 2 showing a slightly higher but non-significant increase in detection rates.

Non-small-cell lung cancer

Non-small-cell lung cancer (NSCLC) is one of the most frequent cancer types and is responsible for the majority of cancer-related deaths worldwide. The management of NSCLC has improved considerably, especially in the past 10 years. The systematic screening of populations at risk with low-dose CT, the implementation of novel surgical and radiotherapeutic techniques and a deeper biological understanding of NSCLC that has led to innovative systemic treatment options have improved the prognosis of patients with NSCLC. In non-metastatic NSCLC, the combination of various perioperative strategies and adjuvant immunotherapy in locally advanced disease seem to enhance cure rates. In metastatic NSCLC, the implementation of novel drugs might prolong disease control together with preserving quality of life. The further development of predictive clinical and genetic markers will be essential for the next steps in individualized treatment concepts.

Early Detection and Interception of Lung Cancer

Recent advances in lung cancer treatment have led to dramatic improvements in 5-year survival rates. And yet, lung cancer remains the leading cause of cancer-related mortality, in large part, because it is often diagnosed at an advanced stage, when cure is no longer possible. Lung cancer screening (LCS) is essential for intercepting the disease at an earlier stage. Unfortunately, LCS has been poorly adopted in the United States, with less than 5% of eligible patients being screened nationally. This article will describe the data supporting LCS, the obstacles to LCS implementation, and the promising opportunities that lie ahead.

Validation of a commercially available CAD-system for lung nodule detection and characterization using CT-scans

OBJECTIVES

This study aims to externally validate a commercially available Computer-Aided Detection (CAD)-system for the automatic detection and characterization of solid, part-solid, and ground-glass lung nodules (LN) on CT scans.

METHODS

This retrospective study encompasses 263 chest CT scans performed between January 2020 and December 2021 at a Dutch university hospital. All scans were read by a radiologist (R1) and compared with the initial radiology report. Conflicting scans were assessed by an adjudicating radiologist (R2). All scans were also processed by CAD. The standalone performance of CAD in terms of sensitivity and false-positive (FP)-rate for detection was calculated together with the sensitivity for characterization, including texture, calcification, speculation, and location. The R1's detection sensitivity was also assessed.

RESULTS

A total of 183 true nodules were identified in 121 nodule-containing scans (142 non-nodule-containing scans), of which R1 identified 165/183 (90.2%). CAD detected 149 nodules, of which 12 were not identified by R1, achieving a sensitivity of 149/183 (81.4%) with an FP-rate of 49/121 (0.405). CAD's detection sensitivity for solid, part-solid, and ground-glass LNs was 82/94 (87.2%), 42/47 (89.4%), and 25/42 (59.5%), respectively. The classification accuracy for solid, part-solid, and ground-glass LNs was 81/82 (98.8%), 16/42 (38.1%), and 18/25 (72.0%), respectively. Additionally, CAD demonstrated overall classification accuracies of 137/149 (91.9%), 123/149 (82.6%), and 141/149 (94.6%) for calcification, spiculation, and location, respectively.

CONCLUSIONS

Although the overall detection rate of this system slightly lags behind that of a radiologist, CAD is capable of detecting different LNs and thereby has the potential to enhance a reader's detection rate. While promising characterization performances are obtained, the tool's performance in terms of texture classification remains a subject of concern.

CLINICAL RELEVANCE STATEMENT

Numerous lung nodule computer-aided detection-systems are commercially available, with some of them solely being externally validated based on their detection performance on solid nodules. We encourage researchers to assess performances by incorporating all relevant characteristics, including part-solid and ground-glass nodules.

KEY POINTS

Few computer-aided detection (CAD) systems are externally validated for automatic detection and characterization of lung nodules. A detection sensitivity of 81.4% and an overall texture classification sensitivity of 77.2% were measured utilizing CAD. CAD has the potential to increase single reader detection rate, however, improvement in texture classification is required.

Pricing and cost-saving potential for deep-learning computer-aided lung nodule detection software in CT lung cancer screening

OBJECTIVE

An increasing number of commercial deep learning computer-aided detection (DL-CAD) systems are available but their cost-saving potential is largely unknown. This study aimed to gain insight into appropriate pricing for DL-CAD in different reading modes to be cost-saving and to determine the potentially most cost-effective reading mode for lung cancer screening.

METHODS

In three representative settings, DL-CAD was evaluated as a concurrent, pre-screening, and second reader. Scoping review was performed to estimate radiologist reading time with and without DL-CAD. Hourly cost of radiologist time was collected for the USA (€196), UK (€127), and Poland (€45), and monetary equivalence of saved time was calculated. The minimum number of screening CTs to reach break-even was calculated for one-time investment of €51,616 for DL-CAD.

RESULTS

Mean reading time was 162 (95% CI: 111-212) seconds per case without DL-CAD, which decreased by 77 (95% CI: 47-107) and 104 (95% CI: 71-136) seconds for DL-CAD as concurrent and pre-screening reader, respectively, and increased by 33-41 s for DL-CAD as second reader. This translates into €1.0-4.3 per-case cost for concurrent reading and €0.8-5.7 for pre-screening reading in the USA, UK, and Poland. To achieve break-even with a one-time investment, the minimum number of CT scans was 12,300-53,600 for concurrent reader, and 9400-65,000 for pre-screening reader in the three countries.

CONCLUSIONS

Given current pricing, DL-CAD must be priced substantially below €6 in a pay-per-case setting or used in a high-workload environment to reach break-even in lung cancer screening. DL-CAD as pre-screening reader shows the largest potential to be cost-saving.

CRITICAL RELEVANCE STATEMENT

Deep-learning computer-aided lung nodule detection (DL-CAD) software must be priced substantially below 6 euro in a pay-per-case setting or must be used in high-workload environments with one-time investment in order to achieve break-even. DL-CAD as a pre-screening reader has the greatest cost savings potential.

KEY POINTS

• DL-CAD must be substantially below €6 in a pay-per-case setting to reach break-even. • DL-CAD must be used in a high-workload screening environment to achieve break-even. • DL-CAD as a pre-screening reader shows the largest potential to be cost-saving.

Artificial Intelligence and Machine Learning in Lung Cancer Screening

Recent advances in artificial intelligence and machine learning (AI/ML) hold substantial promise to address some of the current challenges in lung cancer screening and improve health equity. This article reviews the status and future directions of AI/ML tools in the lung cancer screening workflow, focusing on determining screening eligibility, radiation dose reduction and image denoising for low-dose chest computed tomography (CT), lung nodule detection, lung nodule classification, and determining optimal screening intervals. AI/ML tools can assess for chronic diseases on CT, which creates opportunities to improve population health through opportunistic screening.

Developments in Image Processing Using Deep Learning and Reinforcement Learning

The growth in the volume of data generated, consumed, and stored, which is estimated to exceed 180 zettabytes in 2025, represents a major challenge both for organizations and for society in general. In addition to being larger, datasets are increasingly complex, bringing new theoretical and computational challenges. Alongside this evolution, data science tools have exploded in popularity over the past two decades due to their myriad of applications when dealing with complex data, their high accuracy, flexible customization, and excellent adaptability. When it comes to images, data analysis presents additional challenges because as the quality of an image increases, which is desirable, so does the volume of data to be processed. Although classic machine learning (ML) techniques are still widely used in different research fields and industries, there has been great interest from the scientific community in the development of new artificial intelligence (AI) techniques. The resurgence of neural networks has boosted remarkable advances in areas such as the understanding and processing of images. In this study, we conducted a comprehensive survey regarding advances in AI design and the optimization solutions proposed to deal with image processing challenges. Despite the good results that have been achieved, there are still many challenges to face in this field of study. In this work, we discuss the main and more recent improvements, applications, and developments when targeting image processing applications, and we propose future research directions in this field of constant and fast evolution.

A new lung cancer detection method based on the chest CT images using Federated Learning and blockchain systems

With an estimated five million fatal cases each year, lung cancer is one of the significant causes of death worldwide. Lung diseases can be diagnosed with a Computed Tomography (CT) scan. The scarcity and trustworthiness of human eyes is the fundamental issue in diagnosing lung cancer patients. The main goal of this study is to detect malignant lung nodules in a CT scan of the lungs and categorize lung cancer according to severity. In this work, cutting-edge Deep Learning (DL) algorithms were used to detect the location of cancerous nodules. Also, the real-life issue is sharing data with hospitals around the world while bearing in mind the organizations' privacy issues. Besides, the main problems for training a global DL model are creating a collaborative model and maintaining privacy. This study presented an approach that takes a modest amount of data from multiple hospitals and uses blockchain-based Federated Learning (FL) to train a global DL model. The data were authenticated using blockchain technology, and FL trained the model internationally while maintaining the organization's anonymity. First, we presented a data normalization approach that addresses the variability of data obtained from various institutions using various CT scanners. Furthermore, using a CapsNets method, we classified lung cancer patients in local mode. Finally, we devised a way to train a global model cooperatively utilizing blockchain technology and FL while maintaining anonymity. We also gathered data from real-life lung cancer patients for testing purposes. The suggested method was trained and tested on the Cancer Imaging Archive (CIA) dataset, Kaggle Data Science Bowl (KDSB), LUNA 16, and the local dataset. Finally, we performed extensive experiments with Python and its well-known libraries, such as Scikit-Learn and TensorFlow, to evaluate the suggested method. The findings showed that the method effectively detects lung cancer patients. The technique delivered 99.69 % accuracy with the smallest possible categorization error.

Lung cancer screening

Randomised controlled trials, including the National Lung Screening Trial (NLST) and the NELSON trial, have shown reduced mortality with lung cancer screening with low-dose CT compared with chest radiography or no screening. Although research has provided clarity on key issues of lung cancer screening, uncertainty remains about aspects that might be critical to optimise clinical effectiveness and cost-effectiveness. This Review brings together current evidence on lung cancer screening, including an overview of clinical trials, considerations regarding the identification of individuals who benefit from lung cancer screening, management of screen-detected findings, smoking cessation interventions, cost-effectiveness, the role of artificial intelligence and biomarkers, and current challenges, solutions, and opportunities surrounding the implementation of lung cancer screening programmes from an international perspective. Further research into risk models for patient selection, personalised screening intervals, novel biomarkers, integrated cardiovascular disease and chronic obstructive pulmonary disease assessments, smoking cessation interventions, and artificial intelligence for lung nodule detection and risk stratification are key opportunities to increase the efficiency of lung cancer screening and ensure equity of access.

Single CT Appointment for Double Lung and Colorectal Cancer Screening: Is the Time Ripe?

Annual screening of lung cancer (LC) with chest low-dose computed tomography (CT) and screening of colorectal cancer (CRC) with CT colonography every 5 years are recommended by the United States Prevention Service Task Force. We review epidemiological and pathological data on LC and CRC, and the features of screening chest low-dose CT and CT colonography comprising execution, reading, radiation exposure and harm, and the cost effectiveness of the two CT screening interventions. The possibility of combining chest low-dose CT and CT colonography examinations for double LC and CRC screening in a single CT appointment is then addressed. We demonstrate how this approach appears feasible and is already reasonable as an opportunistic screening intervention in 50–75-year-old subjects with smoking history and average CRC risk. In addition to the crucial role Computer Assisted Diagnosis systems play in decreasing the test reading times and the need to educate radiologists in screening chest LDCT and CT colonography, in view of a single CT appointment for double screening, the following uncertainties need to be solved: (1) the schedule of the screening CT; (2) the effectiveness of iterative reconstruction and deep learning algorithms affording an ultra-low-dose CT acquisition technique and (3) management of incidental findings. Resolving these issues will imply new cost-effectiveness analyses for LC screening with chest low dose CT and for CRC screening with CT colonography and, especially, for the double LC and CRC screening with a single-appointment CT.

Lung Cancer Nodules Detection via an Adaptive Boosting Algorithm Based on Self-Normalized Multiview Convolutional Neural Network

Lung cancer is the deadliest cancer killing almost 1.8 million people in 2020. The new cases are expanding alarmingly. Early lung cancer manifests itself in the form of nodules in the lungs. One of the most widely used techniques for both lung cancer early and noninvasive diagnosis is computed tomography (CT). However, the intensive workload of radiologists to read a large number of scans for nodules detection gives rise to issues like false detection and missed detection. To overcome these issues, we proposed an innovative strategy titled adaptive boosting self-normalized multiview convolution neural network (AdaBoost-SNMV-CNN) for lung cancer nodules detection across CT scans. In AdaBoost-SNMV-CNN, MV-CNN function as a baseline learner while the scaled exponential linear unit (SELU) activation function normalizes the layers by considering their neighbors' information and a special drop-out technique (α-dropout). The proposed method was trained and tested using the widely Lung Image Database Consortium and Image Database Resource Initiative (LIDC-IDRI) and Early Lung Cancer Action Program (ELCAP) datasets. AdaBoost-SNMV-CNN achieved an accuracy of 92%, sensitivity of 93%, and specificity of 92% for lung nodules detection on the LIDC-IDRI dataset. Meanwhile, on the ELCAP dataset, the accuracy for detecting lung nodules was 99%, sensitivity 100%, and specificity 98%. AdaBoost-SNMV-CNN outperformed the majority of the model in accuracy, sensitivity, and specificity. The multiviews confer the model's good generalization and learning ability for diverse features of lung nodules, the model architecture is simple, and has a minimal computational time of around 10² minutes. We believe that AdaBoost-SNMV-CNN has good accuracy for the detection of lung nodules and anticipate its potential application in the noninvasive clinical diagnosis of lung cancer. This model can be of good assistance to the radiologist and will be of interest to researchers involved in the designing and development of advanced systems for the detection of lung nodules to accomplish the goal of noninvasive diagnosis of lung cancer.