Detection of Subsolid Nodules in Lung Cancer Screening: Complementary Sensitivity of Visual Reading and Computer-Aided Diagnosis

Lung cancer screening: where do we stand?

Lung cancer screening (LCS) programmes have emerged over recent years around the world. LCS programmes present differences in delivery, inclusion criteria and resource allocation. On a national scale, only a few LCS programmes have been fully established, but more are anticipated to follow. Evidence has shown that, in combination with a low-dose chest computed tomography scan, smoking cessation should be offered as part of a LCS programme for improved patient outcomes. Promising tools in LCS include further refined risk prediction models, the use of biomarkers, artificial intelligence and radiomics. However, these tools require further study and clinical validation is required prior to routine implementation.

ERS International Congress 2022: highlights from the Thoracic Oncology Assembly

Thoracic malignancies are associated with a substantial public health burden. Lung cancer is the leading cause of cancer-related mortality worldwide, with significant impact on patients' quality of life. Following 2 years of virtual European Respiratory Society (ERS) Congresses due to the COVID-19 pandemic, the 2022 hybrid ERS Congress in Barcelona, Spain allowed peers from all over the world to meet again and present their work. Thoracic oncology experts presented best practices and latest developments in lung cancer screening, lung cancer diagnosis and management. Early lung cancer diagnosis, subsequent pros and cons of aggressive management, identification and management of systemic treatments' side-effects, and the application of artificial intelligence and biomarkers across all aspects of the thoracic oncology pathway were among the areas that triggered specific interest and will be summarised here.

The Effects of Artificial Intelligence Assistance on the Radiologists' Assessment of Lung Nodules on CT Scans: A Systematic Review

To reduce the number of missed or misdiagnosed lung nodules on CT scans by radiologists, many Artificial Intelligence (AI) algorithms have been developed. Some algorithms are currently being implemented in clinical practice, but the question is whether radiologists and patients really benefit from the use of these novel tools. This study aimed to review how AI assistance for lung nodule assessment on CT scans affects the performances of radiologists. We searched for studies that evaluated radiologists' performances in the detection or malignancy prediction of lung nodules with and without AI assistance. Concerning detection, radiologists achieved with AI assistance a higher sensitivity and AUC, while the specificity was slightly lower. Concerning malignancy prediction, radiologists achieved with AI assistance generally a higher sensitivity, specificity and AUC. The radiologists' workflows of using the AI assistance were often only described in limited detail in the papers. As recent studies showed improved performances of radiologists with AI assistance, AI assistance for lung nodule assessment holds great promise. To achieve added value of AI tools for lung nodule assessment in clinical practice, more research is required on the clinical validation of AI tools, impact on follow-up recommendations and ways of using AI tools.

Artificial Intelligence in CT and MR Imaging for Oncological Applications

Cancer care increasingly relies on imaging for patient management. The two most common cross-sectional imaging modalities in oncology are computed tomography (CT) and magnetic resonance imaging (MRI), which provide high-resolution anatomic and physiological imaging. Herewith is a summary of recent applications of rapidly advancing artificial intelligence (AI) in CT and MRI oncological imaging that addresses the benefits and challenges of the resultant opportunities with examples. Major challenges remain, such as how best to integrate AI developments into clinical radiology practice, the vigorous assessment of quantitative CT and MR imaging data accuracy, and reliability for clinical utility and research integrity in oncology. Such challenges necessitate an evaluation of the robustness of imaging biomarkers to be included in AI developments, a culture of data sharing, and the cooperation of knowledgeable academics with vendor scientists and companies operating in radiology and oncology fields. Herein, we will illustrate a few challenges and solutions of these efforts using novel methods for synthesizing different contrast modality images, auto-segmentation, and image reconstruction with examples from lung CT as well as abdome, pelvis, and head and neck MRI. The imaging community must embrace the need for quantitative CT and MRI metrics beyond lesion size measurement. AI methods for the extraction and longitudinal tracking of imaging metrics from registered lesions and understanding the tumor environment will be invaluable for interpreting disease status and treatment efficacy. This is an exciting time to work together to move the imaging field forward with narrow AI-specific tasks. New AI developments using CT and MRI datasets will be used to improve the personalized management of cancer patients.

Computer-Aided Detection of Subsolid Nodules on Chest Computed Tomography: Assessment of Visualization on Vessel-Suppressed Images

OBJECTIVES

This study aimed to clarify the performance of automatic detection of subsolid nodules by commercially available software on computed tomography (CT) images of various slice thicknesses and compare it with visualization on the accompanying vessel-suppression CT (VS-CT) images.

METHODS

A total of 95 subsolid nodules from 84 CT examinations of 84 patients were included. The reconstructed CT image series of each case with 3-, 2-, and 1-mm slice thicknesses were loaded into a commercially available software application (ClearRead CT) for automatic detection of subsolid nodules and generation of VS-CT images. Automatic nodule detection sensitivity was assessed for 95 nodules on each series of images acquired at 3 slice thicknesses. Four radiologists subjectively evaluated visual assessment of the nodules on VS-CT.

RESULTS

ClearRead CT automatically detected 69.5% (66/95 nodules), 68.4% (65/95 nodules), and 70.5% (67/95 nodules) of all subsolid nodules in 3-, 2-, and 1-mm slices, respectively. The detection rate was higher for part-solid nodules than for pure ground-glass nodules at all slice thicknesses. In the visualization assessment on VS-CT, 3 nodules at each slice thickness (3.2%) were judged as invisible, while 26 of 29 (89.7%), 27 of 30 (90.0%), and 25 of 28 (89.3%) nodules, which were missed by computer-aided detection, were judged as visible in 3-, 2-, and 1-mm slices, respectively.

CONCLUSIONS

The automatic detection rate of subsolid nodules by ClearRead CT was approximately 70% at all slice thicknesses. More than 95% of subsolid nodules were visualized on VS-CT, including nodules undetected by the automated software. Computed tomography acquisition at slices thinner than 3 mm did not confer any benefits.

Artificial intelligence: A critical review of applications for lung nodule and lung cancer

Artificial intelligence (AI) is a broad concept that usually refers to computer programs that can learn from data and perform certain specific tasks. In the recent years, the growth of deep learning, a successful technique for computer vision tasks that does not require explicit programming, coupled with the availability of large imaging databases fostered the development of multiple applications in the medical imaging field, especially for lung nodules and lung cancer, mostly through convolutional neural networks (CNN). Some of the first applications of AI is this field were dedicated to automated detection of lung nodules on X-ray and computed tomography (CT) examinations, with performances now reaching or exceeding those of radiologists. For lung nodule segmentation, CNN-based algorithms applied to CT images show excellent spatial overlap index with manual segmentation, even for irregular and ground glass nodules. A third application of AI is the classification of lung nodules between malignant and benign, which could limit the number of follow-up CT examinations for less suspicious lesions. Several algorithms have demonstrated excellent capabilities for the prediction of the malignancy risk when a nodule is discovered. These different applications of AI for lung nodules are particularly appealing in the context of lung cancer screening. In the field of lung cancer, AI tools applied to lung imaging have been investigated for distinct aims. First, they could play a role for the non-invasive characterization of tumors, especially for histological subtype and somatic mutation predictions, with a potential therapeutic impact. Additionally, they could help predict the patient prognosis, in combination to clinical data. Despite these encouraging perspectives, clinical implementation of AI tools is only beginning because of the lack of generalizability of published studies, of an inner obscure working and because of limited data about the impact of such tools on the radiologists' decision and on the patient outcome. Radiologists must be active participants in the process of evaluating AI tools, as such tools could support their daily work and offer them more time for high added value tasks.

[Low-dose Spiral Computed Tomography in Lung Cancer Screening]

Lung cancer is one of the malignant tumors with the highest morbidity and mortality in the world. The low early diagnosis rate and poor prognosis of patients have caused serious social burden. Regular screening of high-risk population by low-dose spiral computed tomography (LDCT) can significantly improve the early diagnosis rate of lung cancer and bring new opportunities for the diagnosis and treatment of lung cancer. In recent years, LDCT lung cancer screening programs have been carried out in many countries around the world and achieved good results, but there are still some controversies in the selection of screening subjects, screening frequency, cost effectiveness and other aspects. In this paper, the key factors of LDCT lung cancer screening, screening effect, pulmonary nodule management and artificial intelligence contribution to the development of LDCT will be reviewed, and the application progress of LDCT in lung cancer screening will be discussed.
.

Low-dose computed tomography lung cancer screening: Clinical evidence and implementation research

Lung cancer causes more deaths than breast, cervical, and colorectal cancer combined. Nevertheless, population-based lung cancer screening is still not considered standard practice in most countries worldwide. Early lung cancer detection leads to better survival outcomes: patients diagnosed with stage 1A lung cancer have a >75% 5-year survival rate, compared to <5% at stage 4. Low-dose computed tomography (LDCT) thorax imaging for the secondary prevention of lung cancer has been studied at length, and has been shown to significantly reduce lung cancer mortality in high-risk populations. The US National Lung Screening Trial reported a 20% overall reduction in lung cancer mortality when comparing LDCT to chest X-ray, and the Nederlands-Leuvens Longkanker Screenings Onderzoek (NELSON) trial more recently reported a 24% reduction when comparing LDCT to no screening. Hence, the focus has now shifted to implementation research. Consequently, the 4-IN-THE-LUNG-RUN consortium based in five European countries, has set up a large-scale multicenter implementation trial. Successful implementation of and accessibility to LDCT lung cancer screening are dependent on many factors, not limited to population selection, recruitment strategy, computed tomography screening frequency, lung-nodule management, participant compliance, and cost effectiveness. This review provides an overview of current evidence for LDCT lung cancer screening, and draws attention to major factors that need to be addressed to successfully implement standardized, effective, and accessible screening throughout Europe. Evidence shows that through the appropriate use of risk-prediction models and a more personalized approach to screening, efficacy could be improved. Furthermore, extending the screening interval for low-risk individuals to reduce costs and associated harms is a possibility, and through the use of volumetric-based measurement and follow-up, false positive results can be greatly reduced. Finally, smoking cessation programs could be a valuable addition to screening programs and artificial intelligence could offer a solution to the added workload pressures radiologists are facing.

Impact of Concurrent Use of Artificial Intelligence Tools on Radiologists Reading Time: A Prospective Feasibility Study

RATIONAL AND OBJECTIVES

This study investigated how an AI tool impacted radiologists reading time for non-contrast chest CT exams.

MATERIALS AND METHODS

An AI tool was implemented into the PACS reading workflow of non-contrast chest CT exams between April and May 2020. The reading time was recorded for one CONSULTANT RADIOLOGIST and one RADIOLOGY RESIDENT by an external observer. After each case radiologists answered questions regarding additional findings and perceived case overview. Reading times were recorded for 25 cases without and 20 cases with AI tool assistance for each reader. Differences in reading time with and without the AI tool were assessed using Welch's t-test for non-inferiority with non-inferiority limits defined as 100 seconds for the consultant and 200 seconds for the resident.

RESULTS

The mean reading time for the radiology resident was not significantly affected by the AI tool (without AI 370s vs with AI 437s; +67s 95% CI -28s to +163s, p = 0.16). The reading time for the radiology consultant was also not significantly affected by the AI tool (without AI 366s vs with AI 380s; +13s (95% CI - -57s to 84s, p = 0.70). The AI tool led to additional actionable findings in 5/40 (12.5%) studies and better overview in 18/20 (90%) of studies for the resident.

CONCLUSION

A PACS based implementation of an AI tool for concurrent reading of chest CT exams did not increase reading time with additional actionable findings made as well as a perceived better case overview for the radiology resident.

European lung cancer screening: valuable trial evidence for optimal practice implementation

Lung cancer screening (LCS) by low-dose computed tomography is a strategy for secondary prevention of lung cancer. In the last two decades, LCS trials showed several options to practice secondary prevention in association with primary prevention, however, the translation from trial to practice is everything but simple. In 2020, the European Society of Radiology and European Respiratory Society published their joint statement paper on LCS. This commentary aims to provide the readership with detailed description about hurdles and potential solutions that could be encountered in the practice of LCS.

[Chinese Experts Consensus on Artificial Intelligence Assisted Management for Pulmonary Nodule (2022 Version)]

Low-dose computed tomography (CT) for lung cancer screening has been proven to reduce lung cancer deaths in the screening group compared with the control group. The increasing number of pulmonary nodules being detected by CT scans significantly increase the workload of the radiologists for scan interpretation. Artificial intelligence (AI) has the potential to increase the efficiency of pulmonary nodule discrimination and has been tested in preliminary studies for nodule management. As more and more artificial AI products are commercialized, the consensus statement has been organized in a collaborative effort by Thoracic Surgery Committee, Department of Simulated Medicine, Wu Jieping Medical Foundation to aid clinicians in the application of AI-assisted management for pulmonary nodules.
.

Computer Simulations of Case Difficulty in Digital Breast Tomosynthesis Using Virtual Clinical Trials

PURPOSE

Virtual clinical trials (VCTs) require computer simulations of representative patients and images to evaluate and compare changes in performance of imaging technologies. The simulated images are usually interpreted by model observers whose performance depends upon the selection of imaging cases used in training evaluation models. This work proposes an efficient method to simulate and calibrate soft tissue lesions, which matches the detectability threshold of virtual and human readings.

METHODS

Anthropomorphic breast phantoms were used to evaluate the simulation of four mass models (I-IV) that vary in shape and composition of soft tissue. Ellipsoidal (I) and spiculated (II-IV) masses were simulated using composite voxels with partial volumes. Digital breast tomosynthesis projections and reconstructions of a clinical system were simulated. Channelized Hotelling observers (CHOs) were evaluated using reconstructed slices of masses that varied in shape, composition, and density of surrounded tissue. The detectability threshold of each mass model was evaluated using receiver operating characteristic (ROC) curves calculated with the CHO's scores.

RESULTS

The area under the curve (AUC) of each calibrated mass model were within the 95% confidence interval (mean AUC [95% CI]) reported in a previous reader study (0.93 [0.89, 0.97]). The mean AUC [95% CI] obtained were 0.94 [0.93, 0.96], 0.92 [0.90, 0.93], 0.92 [0.90, 0.94], 0.93 [0.92, 0.95] for models I to IV, respectively. The mean AUC results varied substantially as a function of shape, composition, and density of surrounded tissue.

CONCLUSIONS

For successful VCTs, lesions composed of soft tissue should be calibrated to simulate imaging cases that match the case difficulty predicted by human readers. Lesion composition, shape, and size are parameters that should be carefully selected to calibrate VCTs. This article is protected by copyright. All rights reserved.

Current and emerging artificial intelligence applications in chest imaging: a pediatric perspective

Artificial intelligence (AI) applications for chest radiography and chest CT are among the most developed applications in radiology. More than 40 certified AI products are available for chest radiography or chest CT. These AI products cover a wide range of abnormalities, including pneumonia, pneumothorax and lung cancer. Most applications are aimed at detecting disease, complemented by products that characterize or quantify tissue. At present, none of the thoracic AI products is specifically designed for the pediatric population. However, some products developed to detect tuberculosis in adults are also applicable to children. Software is under development to detect early changes of cystic fibrosis on chest CT, which could be an interesting application for pediatric radiology. In this review, we give an overview of current AI products in thoracic radiology and cover recent literature about AI in chest radiography, with a focus on pediatric radiology. We also discuss possible pediatric applications.

Computer-aided diagnosis system versus conventional reading system in low-dose (< 2 mSv) computed tomography: comparative study for patients at risk of lung cancer

BACKGROUND

Computer-aided diagnosis in low-dose (≤ 3 mSv) computed tomography (CT) is a potential screening tool for lung nodules, with quality interpretation and less inter-observer variability among readers. Therefore, we aimed to determine the screening potential of CT using a radiation dose that does not exceed 2 mSv.

OBJECTIVE

We aimed to compare the diagnostic parameters of low-dose (< 2 mSv) CT interpretation results using a computer-aided diagnosis system for lung cancer screening with those of a conventional reading system used by radiologists.

DESIGN AND SETTING

We conducted a comparative study of chest CT images for lung cancer screening at three private institutions.

METHODS

A database of low-dose (< 2 mSv) chest CT images of patients at risk of lung cancer was viewed with the conventional reading system (301 patients and 226 nodules) or computer-aided diagnosis system without any subsequent radiologist review (944 patients and 1,048 nodules).

RESULTS

The numbers of detected and solid nodules per patient (both P < 0.0001) were higher using the computer-aided diagnosis system than those using the conventional reading system. The nodule size was reported as the maximum size in any plane in the computer-aided diagnosis system. Higher numbers of patients (102 [11%] versus 20 [7%], P = 0.0345) and nodules (154 [15%] versus 17 [8%], P = 0.0035) were diagnosed with cancer using the computer-aided diagnosis system.

CONCLUSIONS

The computer-aided diagnosis system facilitates the diagnosis of cancerous nodules, especially solid nodules, in low-dose (< 2 mSv) CT among patients at risk for lung cancer.

Artificial intelligence for detection and characterization of pulmonary nodules in lung cancer CT screening: ready for practice?

Lung cancer computed tomography (CT) screening trials using low-dose CT have repeatedly demonstrated a reduction in the number of lung cancer deaths in the screening group compared to a control group. With various countries currently considering the implementation of lung cancer screening, recurring discussion points are, among others, the potentially high false positive rates, cost-effectiveness, and the availability of radiologists for scan interpretation. Artificial intelligence (AI) has the potential to increase the efficiency of lung cancer screening. We discuss the performance levels of AI algorithms for various tasks related to the interpretation of lung screening CT scans, how they compare to human experts, and how AI and humans may complement each other. We discuss how AI may be used in the lung cancer CT screening workflow according to the current evidence and describe the additional research that will be required before AI can take a more prominent role in the analysis of lung screening CT scans.

The radiologist's role in lung cancer screening

Lung cancer is still the deadliest cancer in men and women worldwide. This high mortality is related to diagnosis in advanced stages, when curative treatment is no longer an option. Large randomized controlled trials have shown that lung cancer screening (LCS) with low-dose computed tomography (CT) can detect lung cancers at earlier stages and reduce lung cancer-specific mortality. The recent publication of the significant reduction of cancer-related mortality by 26% in the Dutch-Belgian NELSON LCS trial has increased the likelihood that implementation of LCS in Europe will move forward. Radiologists are important stakeholders in numerous aspects of the LCS pathway. Their role goes beyond nodule detection and nodule management. Being part of a multidisciplinary team, radiologists are key players in numerous aspects of implementation of a high quality LCS program. In this non-systematic review we discuss the multifaceted role of radiologists in LCS.

Screen-detected solid nodules: from detection of nodule to structured reporting

Lung cancer screening (LCS) is gaining some interest worldwide after positive results from International trials. Unlike other screening practices, LCS is performed by an extremely sensitive test, namely low-dose computed tomography (LDCT) that can detect the smallest nodules in lung parenchyma. Up-to-date detection approaches, such as computer aided detection systems, have been increasingly employed for lung nodule automatic identification and are largely used in most LCS programs as a complementary tool to visual reading. Solid nodules of any size are represented in the vast majority of subjects undergoing LDCT. However, less than 1% of solid nodules will be diagnosed lung cancer. This fact calls for specific characterization of nodules to avoid false positives, overinvestigation, and reduce the risks associated with nodule work up. Recent research has been exploring the potential of artificial intelligence, including deep learning techniques, to enhance the accuracy of both detection and characterisation of lung nodule. Computer aided detection and diagnosis algorithms based on artificial intelligence approaches have demonstrated the ability to accurately detect and characterize parenchymal nodules, reducing the number of false positives, and to outperform some of the currently used risk models for prediction of lung cancer risk, potentially reducing the proportion of surveillance CT scans. These forthcoming approaches will eventually integrate a new reasoning for development of future guidelines, which are expected to evolve into precision and personalized stratification of lung cancer risk stratification by continuous fashion, as opposed to the current format with a limited number of risk classes within fixed thresholds of nodule size. This review aims to detail the standard of reference for optimal management of solid nodules by low-dose computed and its projection into the fine selection of candidates for work up.

Challenges and opportunities for artificial intelligence in oncological imaging

Imaging plays a key role in oncology, including the diagnosis and detection of cancer, determining clinical management, assessing treatment response, and complications of treatment or disease. The current use of clinical oncology is predominantly qualitative in nature with some relatively crude size-based measurements of tumours for assessment of disease progression or treatment response; however, it is increasingly understood that there may be significantly more information about oncological disease that can be obtained from imaging that is not currently utilized. Artificial intelligence (AI) has the potential to harness quantitative techniques to improve oncological imaging. These may include improving the efficiency or accuracy of traditional roles of imaging such as diagnosis or detection. These may also include new roles for imaging such as risk-stratifying patients for different types of therapy or determining biological tumour subtypes. This review article outlines several major areas in oncological imaging where there may be opportunities for AI technology. These include (1) screening and detection of cancer, (2) diagnosis and risk stratification, (3) tumour segmentation, (4) precision oncology, and (5) predicting prognosis and assessing treatment response. This review will also address some of the potential barriers to AI research in oncological imaging.

Lung Cancer Screening: Evidence, Risks, and Opportunities for Implementation

BACKGROUND

 Lung cancer is the most common cause of cancer death worldwide. Several trials with different screening approaches have recognized the role of lung cancer screening with low-dose CT for reducing lung cancer mortality. The efficacy of lung cancer screening depends on many factors and implementation is still pending in most European countries.

METHODS

 This review aims to portray current evidence on lung cancer screening with a focus on the potential for opportunities for implementation strategies. Pillars of lung cancer screening practice will be discussed according to the most updated literature (PubMed search until November 16, 2020).

RESULTS AND CONCLUSION

 The NELSON trial showed reduction of lung cancer mortality, thus confirming previous results of independent European studies, notably by volume of lung nodules. Heterogeneity in patient recruitment could influence screening efficacy, hence the importance of risk models and community-based screening. Recruitment strategies develop and adapt continuously to address the specific needs of the heterogeneous population of potential participants, the most updated evidence comes from the UK. The future of lung cancer screening is a tailored approach with personalized continuous stratification of risk, aimed at reducing costs and risks.

KEY POINTS

  · Secondary prevention of lung cancer by low-dose computed tomography showed a reduction of lung cancer mortality.. · Semi-automated volume measurement and use of volume doubling time should be the reference method for optimization of risks, namely controlling measurement variability and the false-positive rate.. · A conservative approach with surveillance of subsolid nodules can be one of the strategies to reduce the risk of overdiagnosis and overtreatment.. · The goal of a tailored approach with personalized risk stratification aims to reduce costs and risks. A longer interval between rounds is one option for participants at lower risk..

CITATION FORMAT

· Tringali G, Milanese G, Ledda RE et al. Lung Cancer Screening: Evidence, Risks, and Opportunities for Implementation. Fortschr Röntgenstr 2021; 193: 1153 - 1161.

Computer-aided Detection of Subsolid Nodules at Chest CT: Improved Performance with Deep Learning-based CT Section Thickness Reduction

Background Studies on the optimal CT section thickness for detecting subsolid nodules (SSNs) with computer-aided detection (CAD) are lacking. Purpose To assess the effect of CT section thickness on CAD performance in the detection of SSNs and to investigate whether deep learning-based super-resolution algorithms for reducing CT section thickness can improve performance. Materials and Methods CT images obtained with 1-, 3-, and 5-mm-thick sections were obtained in patients who underwent surgery between March 2018 and December 2018. Patients with resected synchronous SSNs and those without SSNs (negative controls) were retrospectively evaluated. The SSNs, which ranged from 6 to 30 mm, were labeled ground-truth lesions. A deep learning-based CAD system was applied to SSN detection on CT images of each section thickness and those converted from 3- and 5-mm section thickness into 1-mm section thickness by using the super-resolution algorithm. The CAD performance on each section thickness was evaluated and compared by using the jackknife alternative free response receiver operating characteristic figure of merit. Results A total of 308 patients (mean age ± standard deviation, 62 years ± 10; 183 women) with 424 SSNs (310 part-solid and 114 nonsolid nodules) and 182 patients without SSNs (mean age, 65 years ± 10; 97 men) were evaluated. The figures of merit differed across the three section thicknesses (0.92, 0.90, and 0.89 for 1, 3, and 5 mm, respectively; P = .04) and between 1- and 5-mm sections (P = .04). The figures of merit varied for nonsolid nodules (0.78, 0.72, and 0.66 for 1, 3, and 5 mm, respectively; P < .001) but not for part-solid nodules (range, 0.93-0.94; P = .76). The super-resolution algorithm improved CAD sensitivity on 3- and 5-mm-thick sections (P = .02 for 3 mm, P < .001 for 5 mm). Conclusion Computer-aided detection (CAD) of subsolid nodules performed better at 1-mm section thickness CT than at 3- and 5-mm section thickness CT, particularly with nonsolid nodules. Application of a super-resolution algorithm improved the sensitivity of CAD at 3- and 5-mm section thickness CT. © RSNA, 2021 Online supplemental material is available for this article. See also the editorial by Goo in this issue.

Effect of CT reconstruction settings on the performance of a deep learning based lung nodule CAD system

PURPOSE

To study the effect of different reconstruction parameter settings on the performance of a commercially available deep learning based pulmonary nodule CAD system.

MATERIALS AND METHODS

We performed a retrospective analysis of 24 chest CT scans, reconstructed at 16 different reconstruction settings for two different iterative reconstruction algorithms (SAFIRE and ADMIRE) varying in slice thickness, kernel size and iterative reconstruction level strength using a commercially available deep learning pulmonary nodule CAD system. The DL-CAD software was evaluated at 25 different sensitivity threshold settings and nodules detected by the DL-CAD software were matched against a reference standard based on the consensus reading of three radiologists.

RESULTS

A total of 384 CT reconstructions was analysed from 24 patients, resulting in a total of 5786 found nodules. We matched the detected nodules against the reference standard, defined by a team of thoracic radiologists, and showed a gradual drop in recall, and an improvement in precision when the iterative strength levels were increased for a constant kernel size. The optimal DL-CAD threshold setting for use in our clinical workflow was found to be 0.88 with an F₂ of 0.73 ± 0.053.

CONCLUSIONS

The DL-CAD system behaves differently on IR data than on FBP data, there is a gradual drop in recall, and growth in precision when the iterative strength levels are increased. As a result, caution should be taken when implementing deep learning software in a hospital with multiple CT scanners and different reconstruction protocols. To the best of our knowledge, this is the first study that demonstrates this result from a DL-CAD system on clinical data.

Diagnostic Performance of Ultrasound Computer-Aided Diagnosis Software Compared with That of Radiologists with Different Levels of Expertise for Thyroid Malignancy: A Multicenter Prospective Study

The aim of the work described here was to evaluate the diagnostic performance of ultrasound thyroid computer-aided diagnosis (CAD) software. This multicenter prospective study included 494 patients (565 thyroid nodules) who underwent surgery or biopsy after ultrasonography at four hospitals from January 2019 to September 2019. The diagnostic performance metrics of different readers were calculated and compared with the pathologic results. The sensitivity of CAD was outstanding and was equivalent to that of a senior radiologist (90.51% vs. 88.47%, p > 0.05). The area under the curve of CAD was equivalent to that of a junior radiologist (0.748 vs. 0.739, p > 0.05). However, the specificity was only 49.63%, which was lower than those of the three radiologists (75.56%, 85.93% and 90.37% for the junior, intermediate and senior radiologists, respectively). The diagnostic performance of the junior radiologist was significantly improved with the aid of CAD (junior + CAD). The sensitivity and area under the curve of junior + CAD were improved from 72.20% to 89.93% and from 0.739 to 0.816, respectively (both p values <0.05), and the positive predictive value, negative predictive value and κ coefficient improved from 76.3% to 78.6%, 82.0% to 86.8% and 0.394 to 0.511, respectively. Though specificity slightly decreased from 75.56% to 73.33%, the difference was not statistically significant (p > 0.05). In general, the clinical application value of CAD is promising, and its instrumental value for junior radiologists is significant.

Shades of Gray: Subsolid Nodule Considerations and Management

Subsolid nodules are common on chest CT imaging and may be either benign or malignant. Their varied features and broad differential diagnoses present management challenges. Although subsolid nodules often represent lung adenocarcinomas, other possibilities are common and influence management. Practice guidelines exist for subsolid nodule management for both incidentally and screening-detected nodules, incorporating patient and nodule characteristics. This review highlights the similarities and differences among these algorithms, with the intent of providing a resource for comparison and aid in choosing management options.

Lung cancer screening by nodule volume in Lung-RADS v1.1: negative baseline CT yields potential for increased screening interval

Objectives

The 2019 Lung CT Screening Reporting & Data System version 1.1 (Lung-RADS v1.1) introduced volumetric categories for nodule management. The aims of this study were to report the distribution of Lung-RADS v1.1 volumetric categories and to analyse lung cancer (LC) outcomes within 3 years for exploring personalized algorithm for lung cancer screening (LCS).

Methods

Subjects from the Multicentric Italian Lung Detection (MILD) trial were retrospectively selected by National Lung Screening Trial (NLST) criteria. Baseline characteristics included selected pre-test metrics and nodule characterization according to the volume-based categories of Lung-RADS v1.1. Nodule volume was obtained by segmentation with dedicated semi-automatic software. Primary outcome was diagnosis of LC, tested by univariate and multivariable models. Secondary outcome was stage of LC. Increased interval algorithms were simulated for testing rate of delayed diagnosis (RDD) and reduction of low-dose computed tomography (LDCT) burden.

Results

In 1248 NLST-eligible subjects, LC frequency was 1.2% at 1 year, 1.8% at 2 years and 2.6% at 3 years. Nodule volume in Lung-RADS v1.1 was a strong predictor of LC: positive LDCT showed an odds ratio (OR) of 75.60 at 1 year (p < 0.0001), and indeterminate LDCT showed an OR of 9.16 at 2 years (p = 0.0068) and an OR of 6.35 at 3 years (p = 0.0042). In the first 2 years after negative LDCT, 100% of resected LC was stage I. The simulations of low-frequency screening showed a RDD of 13.6–21.9% and a potential reduction of LDCT burden of 25.5–41%.

Conclusions

Nodule volume by semi-automatic software allowed stratification of LC risk across Lung-RADS v1.1 categories. Personalized screening algorithm by increased interval seems feasible in 80% of NLST eligible.

Key Points

• Using semi-automatic segmentation of nodule volume, Lung-RADS v1.1 selected 10.8% of subjects with positive CT and 96.87 relative risk of lung cancer at 1 year, compared to negative CT.

• Negative low-dose CT by Lung-RADS v1.1 was found in 80.6% of NLST eligible and yielded 40 times lower relative risk of lung cancer at 2 years, compared to positive low-dose CT; annual screening could be preference sensitive in this group.

• Semi-automatic segmentation of nodule volume and increased screening interval by volumetric Lung-RADS v1.1 could retrospectively suggest a 25.5–41% reduction of LDCT burden, at the cost of 13.6–21.9% rate of delayed diagnosis.

Electronic supplementary material

The online version of this article (10.1007/s00330-020-07275-w) contains supplementary material, which is available to authorized users.

Computer-Aided Diagnosis of Pulmonary Fibrosis Using Deep Learning and CT Images

OBJECTIVES

The objective of this study is to assess the performance of a computer-aided diagnosis (CAD) system (INTACT system) for the automatic classification of high-resolution computed tomography images into 4 radiological diagnostic categories and to compare this with the performance of radiologists on the same task.

MATERIALS AND METHODS

For the comparison, a total of 105 cases of pulmonary fibrosis were studied (54 cases of nonspecific interstitial pneumonia and 51 cases of usual interstitial pneumonia). All diagnoses were interstitial lung disease board consensus diagnoses (radiologically or histologically proven cases) and were retrospectively selected from our database. Two subspecialized chest radiologists made a consensual ground truth radiological diagnosis, according to the Fleischner Society recommendations. A comparison analysis was performed between the INTACT system and 2 other radiologists with different years of experience (readers 1 and 2). The INTACT system consists of a sequential pipeline in which first the anatomical structures of the lung are segmented, then the various types of pathological lung tissue are identified and characterized, and this information is then fed to a random forest classifier able to recommend a radiological diagnosis.

RESULTS

Reader 1, reader 2, and INTACT achieved similar accuracy for classifying pulmonary fibrosis into the original 4 categories: 0.6, 0.54, and 0.56, respectively, with P > 0.45. The INTACT system achieved an F-score (harmonic mean for precision and recall) of 0.56, whereas the 2 readers, on average, achieved 0.57 (P = 0.991). For the pooled classification (2 groups, with and without the need for biopsy), reader 1, reader 2, and CAD had similar accuracies of 0.81, 0.70, and 0.81, respectively. The F-score was again similar for the CAD system and the radiologists. The CAD system and the average reader reached F-scores of 0.80 and 0.79 (P = 0.898).

CONCLUSIONS

We found that a computer-aided detection algorithm based on machine learning was able to classify idiopathic pulmonary fibrosis with similar accuracy to a human reader.

ESR/ERS statement paper on lung cancer screening

In Europe, lung cancer ranks third among the most common cancers, remaining the biggest killer. Since the publication of the first European Society of Radiology and European Respiratory Society joint white paper on lung cancer screening (LCS) in 2015, many new findings have been published and discussions have increased considerably. Thus, this updated expert opinion represents a narrative, non-systematic review of the evidence from LCS trials and description of the current practice of LCS as well as aspects that have not received adequate attention until now. Reaching out to the potential participants (persons at high risk), optimal communication and shared decision-making will be key starting points. Furthermore, standards for infrastructure, pathways and quality assurance are pivotal, including promoting tobacco cessation, benefits and harms, overdiagnosis, quality, minimum radiation exposure, definition of management of positive screen results and incidental findings linked to respective actions as well as cost-effectiveness. This requires a multidisciplinary team with experts from pulmonology and radiology as well as thoracic oncologists, thoracic surgeons, pathologists, family doctors, patient representatives and others. The ESR and ERS agree that Europe's health systems need to adapt to allow citizens to benefit from organised pathways, rather than unsupervised initiatives, to allow early diagnosis of lung cancer and reduce the mortality rate. Now is the time to set up and conduct demonstration programmes focusing, among other points, on methodology, standardisation, tobacco cessation, education on healthy lifestyle, cost-effectiveness and a central registry.

ESR/ERS statement paper on lung cancer screening

In Europe, lung cancer ranks third among the most common cancers, remaining the biggest killer. Since the publication of the first European Society of Radiology and European Respiratory Society joint white paper on lung cancer screening (LCS) in 2015, many new findings have been published and discussions have increased considerably. Thus, this updated expert opinion represents a narrative, non-systematic review of the evidence from LCS trials and description of the current practice of LCS as well as aspects that have not received adequate attention until now. Reaching out to the potential participants (persons at high risk), optimal communication and shared decision-making will be key starting points. Furthermore, standards for infrastructure, pathways and quality assurance are pivotal, including promoting tobacco cessation, benefits and harms, overdiagnosis, quality, minimum radiation exposure, definition of management of positive screen results and incidental findings linked to respective actions as well as cost-effectiveness. This requires a multidisciplinary team with experts from pulmonology and radiology as well as thoracic oncologists, thoracic surgeons, pathologists, family doctors, patient representatives and others. The ESR and ERS agree that Europe's health systems need to adapt to allow citizens to benefit from organised pathways, rather than unsupervised initiatives, to allow early diagnosis of lung cancer and reduce the mortality rate. Now is the time to set up and conduct demonstration programmes focusing, among other points, on methodology, standardisation, tobacco cessation, education on healthy lifestyle, cost-effectiveness and a central registry.Key Points• Pulmonologists and radiologists both have key roles in the set up of multidisciplinary LCS teams with experts from many other fields.• Pulmonologists identify people eligible for LCS, reach out to family doctors, share the decision-making process and promote tobacco cessation.• Radiologists ensure appropriate image quality, minimum dose and a standardised reading/reporting algorithm, together with a clear definition of a "positive screen".• Strict algorithms define the exact management of screen-detected nodules and incidental findings.• For LCS to be (cost-)effective, it has to target a population defined by risk prediction models.

Artificial intelligence applications for thoracic imaging

Artificial intelligence is a hot topic in medical imaging. The development of deep learning methods and in particular the use of convolutional neural networks (CNNs), have led to substantial performance gain over the classic machine learning techniques. Multiple usages are currently being evaluated, especially for thoracic imaging, such as such as lung nodule evaluation, tuberculosis or pneumonia detection or quantification of diffuse lung diseases. Chest radiography is a near perfect domain for the development of deep learning algorithms for automatic interpretation, requiring large annotated datasets, in view of the high number of procedures and increasing data availability. Current algorithms are able to detect up to 14 common anomalies, when present as isolated findings. Chest computed tomography is another major field of application for artificial intelligence, especially in the perspective of large scale lung cancer screening. It is important for radiologists to apprehend, contribute actively and lead this new era of radiology powered by artificial intelligence. Such a perspective requires understanding new terms and concepts associated with machine learning. The objective of this paper is to provide useful definitions for understanding the methods used and their possibilities, and report current and future developments for thoracic imaging. Prospective validation of AI tools will be required before reaching routine clinical implementation.

Evaluation of an AI-Powered Lung Nodule Algorithm for Detection and 3D Segmentation of Primary Lung Tumors

Automated detection and segmentation is a prerequisite for the deployment of image-based secondary analyses, especially for lung tumors. However, currently only applications for lung nodules ≤3 cm exist. Therefore, we tested the performance of a fully automated AI-based lung nodule algorithm for detection and 3D segmentation of primary lung tumors in the context of tumor staging using the CT component of FDG-PET/CT and including all T-categories (T1-T4). FDG-PET/CTs of 320 patients with histologically confirmed lung cancer performed between 01/2010 and 06/2016 were selected. First, the main primary lung tumor within each scan was manually segmented using the CT component of the PET/CTs as reference. Second, the CT series were transferred to a platform with AI-based algorithms trained on chest CTs for detection and segmentation of lung nodules. Detection and segmentation performance were analyzed. Factors influencing detection rates were explored with binominal logistic regression and radiomic analysis. We also processed 94 PET/CTs negative for pulmonary nodules to investigate frequency and reasons of false-positive findings. The ratio of detected tumors was best in the T1-category (90.4%) and decreased continuously: T2 (70.8%), T3 (29.4%), and T4 (8.8%). Tumor contact with the pleura was a strong predictor of misdetection. Segmentation performance was excellent for T1 tumors (r = 0.908, p < 0.001) and tumors without pleural contact (r = 0.971, p < 0.001). Volumes of larger tumors were systematically underestimated. There were 0.41 false-positive findings per exam. The algorithm tested facilitates a reliable detection and 3D segmentation of T1/T2 lung tumors on FDG-PET/CTs. The detection and segmentation of more advanced lung tumors is currently imprecise due to the conception of the algorithm for lung nodules <3 cm. Future efforts should therefore focus on this collective to facilitate segmentation of all tumor types and sizes to bridge the gap between CAD applications for screening and staging of lung cancer.