Lung cancer screening with CT: Evaluation of radiologists and different computer assisted detection software (CAD) as first and second readers for lung nodule detection at different dose levels

Influence of CT dose reduction on AI-driven malignancy estimation of incidental pulmonary nodules

OBJECTIVES

The purpose of this study was to determine the influence of dose reduction on a commercially available lung cancer prediction convolutional neuronal network (LCP-CNN).

METHODS

CT scans from a cohort provided by the local lung cancer center (n = 218) with confirmed pulmonary malignancies and their corresponding reduced dose simulations (25% and 5% dose) were subjected to the LCP-CNN. The resulting LCP scores (scale 1-10, increasing malignancy risk) and the proportion of correctly classified nodules were compared. The cohort was divided into a low-, medium-, and high-risk group based on the respective LCP scores; shifts between the groups were studied to evaluate the potential impact on nodule management. Two different malignancy risk score thresholds were analyzed: a higher threshold of ≥ 9 ("rule-in" approach) and a lower threshold of > 4 ("rule-out" approach).

RESULTS

In total, 169 patients with 196 nodules could be included (mean age ± SD, 64.5 ± 9.2 year; 49% females). Mean LCP scores for original, 25% and 5% dose levels were 8.5 ± 1.7, 8.4 ± 1.7 (p > 0.05 vs. original dose) and 8.2 ± 1.9 (p < 0.05 vs. original dose), respectively. The proportion of correctly classified nodules with the "rule-in" approach decreased with simulated dose reduction from 58.2 to 56.1% (p = 0.34) and to 52.0% for the respective dose levels (p = 0.01). For the "rule-out" approach the respective values were 95.9%, 96.4%, and 94.4% (p = 0.12). When reducing the original dose to 25%/5%, eight/twenty-two nodules shifted to a lower, five/seven nodules to a higher malignancy risk group.

CONCLUSION

CT dose reduction may affect the analyzed LCP-CNN regarding the classification of pulmonary malignancies and potentially alter pulmonary nodule management.

CLINICAL RELEVANCE STATEMENT

Utilization of a "rule-out" approach with a lower malignancy risk threshold prevents underestimation of the nodule malignancy risk for the analyzed software, especially in high-risk cohorts.

KEY POINTS

• LCP-CNN may be affected by CT image parameters such as noise resulting from low-dose CT acquisitions. • CT dose reduction can alter pulmonary nodule management recommendations by affecting the outcome of the LCP-CNN. • Utilization of a lower malignancy risk threshold prevents underestimation of pulmonary malignancies in high-risk cohorts.

Incorporation of CAD (computer-aided detection) with thin-slice lung CT in routine 18F-FDG PET/CT imaging read-out protocol for detection of lung nodules

OBJECTIVE

To evaluate the detection rate and performance of 18F-FDG PET alone (PET), the combination of PET and low-dose thick-slice CT (PET/lCT), PET and diagnostic thin-slice CT (PET/dCT), and additional computer-aided detection (PET/dCT/CAD) for lung nodules (LN)/metastases in tumor patients. Along with this, assessment of inter-reader agreement and time requirement for different techniques were evaluated as well.

METHODS

In 100 tumor patients (56 male, 44 female; age range: 22-93 years, mean age: 60 years) 18F-FDG PET images, low-dose CT with shallow breathing (5 mm slice thickness), and diagnostic thin-slice CT (1 mm slice thickness) in full inspiration were retrospectively evaluated by three readers with variable experience (junior, mid-level, and senior) for the presence of lung nodules/metastases and additionally analyzed with CAD. Time taken for each analysis and number of the nodules detected were assessed. Sensitivity, specificity, positive and negative predictive value, accuracy, and Receiver operating characteristic (ROC) analysis of each technique was calculated. Histopathology and/or imaging follow-up served as reference standard for the diagnosis of metastases.

RESULTS

Three readers, on an average, detected 40 LN in 17 patients with PET only, 121 LN in 37 patients using ICT, 283 LN in 60 patients with dCT, and 282 LN in 53 patients with CAD. On average, CAD detected 49 extra LN, missed by the three readers without CAD, whereas CAD overall missed 53 LN. There was very good inter-reader agreement regarding the diagnosis of metastases for all four techniques (kappa: 0.84-0.93). The average time required for the evaluation of LN in PET, lCT, dCT, and CAD was 25, 31, 60, and 40 s, respectively; the assistance of CAD lead to average 33% reduction in time requirement for evaluation of lung nodules compared to dCT. The time-saving effect was highest in the less experienced reader. Regarding the diagnosis of metastases, sensitivity and specificity combined of all readers were 47.8%/96.2% for PET, 80.0%/81.9% for PET/lCT, 100%/56.7% for PET/dCT, and 95.6%/64.3% for PET/CAD. No significant difference was observed regarding the ROC AUC (area under the curve) between the imaging methods.

CONCLUSION

Implementation of CAD for the detection of lung nodules/metastases in routine 18F-FDG PET/CT read-out is feasible. The combination of diagnostic thin-slice CT and CAD significantly increases the detection rate of lung nodules in tumor patients compared to the standard PET/CT read-out. PET combined with low-dose CT showed the best balance between sensitivity and specificity regarding the diagnosis of metastases per patient. CAD reduces the time required for lung nodule/metastasis detection, especially for less experienced readers.

"Will I change nodule management recommendations if I change my CAD system?"-impact of volumetric deviation between different CAD systems on lesion management

OBJECTIVES

To evaluate and compare the measurement accuracy of two different computer-aided diagnosis (CAD) systems regarding artificial pulmonary nodules and assess the clinical impact of volumetric inaccuracies in a phantom study.

METHODS

In this phantom study, 59 different phantom arrangements with 326 artificial nodules (178 solid, 148 ground-glass) were scanned at 80 kV, 100 kV, and 120 kV. Four different nodule diameters were used: 5 mm, 8 mm, 10 mm, and 12 mm. Scans were analyzed by a deep-learning (DL)-based CAD and a standard CAD system. Relative volumetric errors (RVE) of each system vs. ground truth and the relative volume difference (RVD) DL-based vs. standard CAD were calculated. The Bland-Altman method was used to define the limits of agreement (LOA). The hypothetical impact on LungRADS classification was assessed for both systems.

RESULTS

There was no difference between the three voltage groups regarding nodule volumetry. Regarding the solid nodules, the RVE of the 5-mm-, 8-mm-, 10-mm-, and 12-mm-size groups for the DL CAD/standard CAD were 12.2/2.8%, 1.3/ - 2.8%, - 3.6/1.5%, and - 12.2/ - 0.3%, respectively. The corresponding values for the ground-glass nodules (GGN) were 25.6%/81.0%, 9.0%/28.0%, 7.6/20.6%, and 6.8/21.2%. The mean RVD for solid nodules/GGN was 1.3/ - 15.2%. Regarding the LungRADS classification, 88.5% and 79.8% of all solid nodules were correctly assigned by the DL CAD and the standard CAD, respectively. 14.9% of the nodules were assigned differently between the systems.

CONCLUSIONS

Patient management may be affected by the volumetric inaccuracy of the CAD systems and hence demands supervision and/or manual correction by a radiologist.

KEY POINTS

• The DL-based CAD system was more accurate in the volumetry of GGN and less accurate regarding solid nodules than the standard CAD system. • Nodule size and attenuation have an effect on the measurement accuracy of both systems; tube voltage has no effect on measurement accuracy. • Measurement inaccuracies of CAD systems can have an impact on patient management, which demands supervision by radiologists.

Implementation of artificial intelligence in thoracic imaging-a what, how, and why guide from the European Society of Thoracic Imaging (ESTI)

This statement from the European Society of Thoracic imaging (ESTI) explains and summarises the essentials for understanding and implementing Artificial intelligence (AI) in clinical practice in thoracic radiology departments. This document discusses the current AI scientific evidence in thoracic imaging, its potential clinical utility, implementation and costs, training requirements and validation, its' effect on the training of new radiologists, post-implementation issues, and medico-legal and ethical issues. All these issues have to be addressed and overcome, for AI to become implemented clinically in thoracic radiology. KEY POINTS: • Assessing the datasets used for training and validation of the AI system is essential. • A departmental strategy and business plan which includes continuing quality assurance of AI system and a sustainable financial plan is important for successful implementation. • Awareness of the negative effect on training of new radiologists is vital.

Influence of Lung Reconstruction Algorithms on Interstitial Lung Pattern Recognition on CT

Despite current recommendations, there is no recent scientific study comparing the influence of CT reconstruction kernels on lung pattern recognition in interstitial lung disease (ILD).To evaluate the sensitivity of lung (i70) and soft (i30) CT kernel algorithms for the diagnosis of ILD patterns.We retrospectively extracted between 15-25 pattern annotations per case (1 annotation = 15 slices of 1 mm) from 23 subjects resulting in 408 annotation stacks per lung kernel and soft kernel reconstructions. Two subspecialized chest radiologists defined the ground truth in consensus. 4 residents, 2 fellows, and 2 general consultants in radiology with 3 to 13 years of experience in chest imaging performed a blinded readout. In order to account for data clustering, a generalized linear mixed model (GLMM) with random intercept for reader and nested for patient and image and a kernel/experience interaction term was used to analyze the results.The results of the GLMM indicated, that the odds of correct pattern recognition is 12 % lower with lung kernel compared to soft kernel; however, this was not statistically significant (OR 0.88; 95%-CI, 0.73-1.06; p = 0.187). Furthermore, the consultants' odds of correct pattern recognition was 78 % higher than the residents' odds, although this finding did not reach statistical significance either (OR 1.78; 95%-CI, 0.62-5.06; p = 0.283). There was no significant interaction between the two fixed terms kernel and experience. Intra-rater agreement between lung and soft kernel was substantial (κ = 0.63 ± 0.19). The mean inter-rater agreement for lung/soft kernel was κ = 0.37 ± 0.17/κ = 0.38 ± 0.17.There is no significant difference between lung and soft kernel reconstructed CT images for the correct pattern recognition in ILD. There are non-significant trends indicating that the use of soft kernels and a higher level of experience lead to a higher probability of correct pattern identification. · There is no significant difference between lung and soft kernel reconstructed CT images for the correct pattern recognition in interstitial lung disease.. · There are even non-significant tendencies that the use of soft kernels lead to a higher probability of correct pattern identification.. · These results challenge the current recommendations and the routinely performed separate lung kernel reconstructions for lung parenchyma analysis.. CITATION FORMAT: · Klaus JB, Christodoulidis S, Peters AA et al. Influence of Lung Reconstruction Algorithms on Interstitial Lung Pattern Recognition on CT. Fortschr Röntgenstr 2023; 195: 47 - 54.

Low-dose computed tomography lung cancer screening: Clinical evidence and implementation research

Lung cancer causes more deaths than breast, cervical, and colorectal cancer combined. Nevertheless, population-based lung cancer screening is still not considered standard practice in most countries worldwide. Early lung cancer detection leads to better survival outcomes: patients diagnosed with stage 1A lung cancer have a >75% 5-year survival rate, compared to <5% at stage 4. Low-dose computed tomography (LDCT) thorax imaging for the secondary prevention of lung cancer has been studied at length, and has been shown to significantly reduce lung cancer mortality in high-risk populations. The US National Lung Screening Trial reported a 20% overall reduction in lung cancer mortality when comparing LDCT to chest X-ray, and the Nederlands-Leuvens Longkanker Screenings Onderzoek (NELSON) trial more recently reported a 24% reduction when comparing LDCT to no screening. Hence, the focus has now shifted to implementation research. Consequently, the 4-IN-THE-LUNG-RUN consortium based in five European countries, has set up a large-scale multicenter implementation trial. Successful implementation of and accessibility to LDCT lung cancer screening are dependent on many factors, not limited to population selection, recruitment strategy, computed tomography screening frequency, lung-nodule management, participant compliance, and cost effectiveness. This review provides an overview of current evidence for LDCT lung cancer screening, and draws attention to major factors that need to be addressed to successfully implement standardized, effective, and accessible screening throughout Europe. Evidence shows that through the appropriate use of risk-prediction models and a more personalized approach to screening, efficacy could be improved. Furthermore, extending the screening interval for low-risk individuals to reduce costs and associated harms is a possibility, and through the use of volumetric-based measurement and follow-up, false positive results can be greatly reduced. Finally, smoking cessation programs could be a valuable addition to screening programs and artificial intelligence could offer a solution to the added workload pressures radiologists are facing.

Diagnostic validation of a deep learning nodule detection algorithm in low-dose chest CT: determination of optimized dose thresholds in a virtual screening scenario

OBJECTIVES

This study was conducted to evaluate the effect of dose reduction on the performance of a deep learning (DL)-based computer-aided diagnosis (CAD) system regarding pulmonary nodule detection in a virtual screening scenario.

METHODS

Sixty-eight anthropomorphic chest phantoms were equipped with 329 nodules (150 ground glass, 179 solid) with four sizes (5 mm, 8 mm, 10 mm, 12 mm) and scanned with nine tube voltage/current combinations. The examinations were analyzed by a commercially available DL-based CAD system. The results were compared by a comparison of proportions. Logistic regression was performed to evaluate the impact of tube voltage, tube current, nodule size, nodule density, and nodule location.

RESULTS

The combination with the lowest effective dose (E) and unimpaired detection rate was 80 kV/50 mAs (sensitivity: 97.9%, mean false-positive rate (FPR): 1.9, mean CTDIvol: 1.2 ± 0.4 mGy, mean E: 0.66 mSv). Logistic regression revealed that tube voltage and current had the greatest impact on the detection rate, while nodule size and density had no significant influence.

CONCLUSIONS

The optimal tube voltage/current combination proposed in this study (80 kV/50 mAs) is comparable to the proposed combinations in similar studies, which mostly dealt with conventional CAD software. Modification of tube voltage and tube current has a significant impact on the performance of DL-based CAD software in pulmonary nodule detection regardless of their size and composition.

KEY POINTS

• Modification of tube voltage and tube current has a significant impact on the performance of deep learning-based CAD software. • Nodule size and composition have no significant impact on the software's performance. • The optimal tube voltage/current combination for the examined software is 80 kV/50 mAs.

European lung cancer screening: valuable trial evidence for optimal practice implementation

Lung cancer screening (LCS) by low-dose computed tomography is a strategy for secondary prevention of lung cancer. In the last two decades, LCS trials showed several options to practice secondary prevention in association with primary prevention, however, the translation from trial to practice is everything but simple. In 2020, the European Society of Radiology and European Respiratory Society published their joint statement paper on LCS. This commentary aims to provide the readership with detailed description about hurdles and potential solutions that could be encountered in the practice of LCS.

Outstanding negative prediction performance of solid pulmonary nodule volume AI for ultra-LDCT baseline lung cancer screening risk stratification

OBJECTIVE

To evaluate performance of AI as a standalone reader in ultra-low-dose CT lung cancer baseline screening, and compare it to that of experienced radiologists.

METHODS

283 participants who underwent a baseline ultra-LDCT scan in Moscow Lung Cancer Screening, between February 2017-2018, and had at least one solid lung nodule, were included. Volumetric nodule measurements were performed by five experienced blinded radiologists, and independently assessed using an AI lung cancer screening prototype (AVIEW LCS, v1.0.34, Coreline Soft, Co. ltd, Seoul, Korea) to automatically detect, measure, and classify solid nodules. Discrepancies were stratified into two groups: positive-misclassification (PM); nodule classified by the reader as a NELSON-plus /EUPS-indeterminate/positive nodule, which at the reference consensus read was < 100 mm3, and negative-misclassification (NM); nodule classified as a NELSON-plus /EUPS-negative nodule, which at consensus read was ≥ 100 mm3.

RESULTS

1149 nodules with a solid-component were detected, of which 878 were classified as solid nodules. For the largest solid nodule per participant (n = 283); 61 [21.6 %; 53 PM, 8 NM] discrepancies were reported for AI as a standalone reader, compared to 43 [15.1 %; 22 PM, 21 NM], 36 [12.7 %; 25 PM, 11 NM], 29 [10.2 %; 25 PM, 4 NM], 28 [9.9 %; 6 PM, 22 NM], and 50 [17.7 %; 15 PM, 35 NM] discrepancies for readers 1, 2, 3, 4, and 5 respectively.

CONCLUSION

Our results suggest that through the use of AI as an impartial reader in baseline lung cancer screening, negative-misclassification results could exceed that of four out of five experienced radiologists, and radiologists' workload could be drastically diminished by up to 86.7%.

Development of a diagnostic model for malignant solitary pulmonary nodules based on radiomics features

Background

This study proposed a precise diagnostic model for malignant solitary pulmonary nodules (SPNs). This model can be used to identify objective and quantifiable image features and guide the clinical treatment strategy adopted for SPNs. This model will help clinicians optimize management strategies for SPN.

Methods

In this retrospective study, the clinical data of 455 patients of SPN with defined pathological diagnosis between September 2016 and August 2019 were collected and analyzed. The data included pathological diagnosis, preoperative computed tomography (CT) diagnosis, gender, age, smoking history, family history of tumor, previous history, and contact history data. The quantitative image features and radiomic information of the SPNs were provided using computer-aided detection (CAD) “digital lung” software. The Chi-squared test was used to assess the accuracy between CAD and conventional CT in the diagnosis of SPNs. The diagnostic model for benign or malignant SPNs was developed using a multivariate logistic regression analysis that comprises 6 radiomic factors (irregularity, average diameter, COPD910, proportion of emphysema, proportion of fat, and average density of related blood vessels). The area under the receiver operating characteristic curve was used to evaluate the performance of the model in determining SPN risk of malignancy.

Results

There was a statistical difference in the accuracy of CAD and conventional CT in diagnosing SPNs. According to the golden standard pathological diagnosis, the diagnostic accuracy of CAD (81%) was higher than that of conventional CT (63.7%) (P<0.05). Six variables (i.e., irregularity, the mean diameter, COPD910, the proportion of emphysema, the proportion of fat, and the vascular density) were identified using multivariable logistic regression to establish the diagnostic model for distinguish benign or malignant SPNs. The area under the receiver operating characteristic (ROC) curve (AUC) of the diagnostic model was 0.876 (95% CI: 0.8445–0.9076), and its sensitivity and specificity were 81.25% and 82.56% respectively.

Conclusions

The proposed diagnostic model, which comprises 6 radiomic factors, is accurate and effective at diagnosing benign or malignant SPNs.

Assisted versus Manual Interpretation of Low-Dose CT Scans for Lung Cancer Screening: Impact on Lung-RADS Agreement

Purpose To compare the inter- and intraobserver agreement and reading times achieved when assigning Lung Imaging Reporting and Data System (Lung-RADS) categories to baseline and follow-up lung cancer screening studies by using a dedicated CT lung screening viewer with integrated nodule detection and volumetric support with those achieved by using a standard picture archiving and communication system (PACS)-like viewer. Materials and Methods Data were obtained from the National Lung Screening Trial (NLST). By using data recorded by NLST radiologists, scans were assigned to Lung-RADS categories. For each Lung-RADS category (1 or 2, 3, 4A, and 4B), 40 CT scans (20 baseline scans and 20 follow-up scans) were randomly selected for 160 participants (median age, 61 years; interquartile range, 58-66 years; 61 women) in total. Seven blinded observers independently read all CT scans twice in a randomized order with a 2-week washout period: once by using the standard PACS-like viewer and once by using the dedicated viewer. Observers were asked to assign a Lung-RADS category to each scan and indicate the risk-dominant nodule. Inter- and intraobserver agreement was analyzed by using Fleiss κ values and Cohen weighted κ values, respectively. Reading times were compared by using a Wilcoxon signed rank test. Results The interobserver agreement was moderate for the standard viewer and substantial for the dedicated viewer, with Fleiss κ values of 0.58 (95% CI: 0.55, 0.60) and 0.66 (95% CI: 0.64, 0.68), respectively. The intraobserver agreement was substantial, with a mean Cohen weighted κ value of 0.67. The median reading time was significantly reduced from 160 seconds with the standard viewer to 86 seconds with the dedicated viewer (P < .001). Conclusion Lung-RADS interobserver agreement increased from moderate to substantial when using the dedicated CT lung screening viewer. The median reading time was substantially reduced when scans were read by using the dedicated CT lung screening viewer. Keywords: CT, Thorax, Lung, Computer Applications-Detection/Diagnosis, Observer Performance, Technology Assessment Supplemental material is available for this article. © RSNA, 2021.

A segmentation tool for pulmonary nodules in lung cancer screening: Testing and clinical usage

PURPOSE

With the future goal of defining a large dataset based on low-dose CT with labelled pulmonary lesions for lung cancer screening (LCS) research, the aim of this work is to propose and evaluate into a clinical context a tool for semi-automatic segmentation able to facilitate the process of labels collection from a LCS study (COSMOS, Continuous Observation of SMOking Subjects).

METHODS

Considering a preliminary set of manual annotations, a segmentation model based on a 2D-Unet was trained from scratch. Contour quality of the final 2D-Unet was assessed on an internal test set of manual annotations and on a subset of the public available LIDC dataset used as external test set. The tool for semi-automatic segmentation was then designed integrating the tested model into a Graphical User Interface. According to the opinion of two clinical users, the percentage of lesions properly contoured through the tool was quantified (Acceptance Rate, AR). The variability between segmentations derived by the two readers was estimated as mean percentage of difference (MPD) between the two sets of volumes and comparing the likelihood of malignancy derived from Volume Doubling Time (VDT).

RESULTS

Performance in test sets were found similar (DICE ~ 0.75(0.15)). Accordingly, a good mean AR (80.1%) resulted from the two readers. Variability in terms of MPD was equal to 23.6% while 2.7% was the VDTs percentage of disagreement.

CONCLUSIONS

A semi-automatic segmentation tool was developed and its applicability evaluated into a clinical context demonstrating the efficacy of the tool in facilitating the collection of labelled data.

Application of computer-aided diagnosis for Lung-RADS categorization in CT screening for lung cancer: effect on inter-reader agreement

OBJECTIVES

To evaluate the effects of computer-aided diagnosis (CAD) on inter-reader agreement in Lung Imaging Reporting and Data System (Lung-RADS) categorization.

METHODS

Two hundred baseline CT scans covering all Lung-RADS categories were randomly selected from the National Lung Cancer Screening Trial. Five radiologists independently reviewed the CT scans and assigned Lung-RADS categories without CAD and with CAD. The CAD system presented up to five of the most risk-dominant nodules with measurements and predicted Lung-RADS category. Inter-reader agreement was analyzed using multirater Fleiss κ statistics.

RESULTS

The five readers reported 139-151 negative screening results without CAD and 126-142 with CAD. With CAD, readers tended to upstage (average, 12.3%) rather than downstage Lung-RADS category (average, 4.4%). Inter-reader agreement of five readers for Lung-RADS categorization was moderate (Fleiss kappa, 0.60 [95% confidence interval, 0.57, 0.63]) without CAD, and slightly improved to substantial (Fleiss kappa, 0.65 [95% CI, 0.63, 0.68]) with CAD. The major cause for disagreement was assignment of different risk-dominant nodules in the reading sessions without and with CAD (54.2% [201/371] vs. 63.6% [232/365]). The proportion of disagreement in nodule size measurement was reduced from 5.1% (102/2000) to 3.1% (62/2000) with the use of CAD (p < 0.001). In 31 cancer-positive cases, substantial management discrepancies (category 1/2 vs. 4A/B) between reader pairs decreased with application of CAD (pooled sensitivity, 85.2% vs. 91.6%; p = 0.004).

CONCLUSIONS

Application of CAD demonstrated a minor improvement in inter-reader agreement of Lung-RADS category, while showing the potential to reduce measurement variability and substantial management change in cancer-positive cases.

KEY POINTS

• Inter-reader agreement of five readers for Lung-RADS categorization was minimally improved by application of CAD, with a Fleiss kappa value of 0.60 to 0.65. • The major cause for disagreement was assignment of different risk-dominant nodules in the reading sessions without and with CAD (54.2% vs. 63.6%). • In 31 cancer-positive cases, substantial management discrepancies between reader pairs, referring to a difference in follow-up interval of at least 9 months (category 1/2 vs. 4A/B), were reduced in half by application of CAD (32/310 to 16/310) (pooled sensitivity, 85.2% vs. 91.6%; p = 0.004).

Artificial intelligence for detection and characterization of pulmonary nodules in lung cancer CT screening: ready for practice?

Lung cancer computed tomography (CT) screening trials using low-dose CT have repeatedly demonstrated a reduction in the number of lung cancer deaths in the screening group compared to a control group. With various countries currently considering the implementation of lung cancer screening, recurring discussion points are, among others, the potentially high false positive rates, cost-effectiveness, and the availability of radiologists for scan interpretation. Artificial intelligence (AI) has the potential to increase the efficiency of lung cancer screening. We discuss the performance levels of AI algorithms for various tasks related to the interpretation of lung screening CT scans, how they compare to human experts, and how AI and humans may complement each other. We discuss how AI may be used in the lung cancer CT screening workflow according to the current evidence and describe the additional research that will be required before AI can take a more prominent role in the analysis of lung screening CT scans.

The radiologist's role in lung cancer screening

Lung cancer is still the deadliest cancer in men and women worldwide. This high mortality is related to diagnosis in advanced stages, when curative treatment is no longer an option. Large randomized controlled trials have shown that lung cancer screening (LCS) with low-dose computed tomography (CT) can detect lung cancers at earlier stages and reduce lung cancer-specific mortality. The recent publication of the significant reduction of cancer-related mortality by 26% in the Dutch-Belgian NELSON LCS trial has increased the likelihood that implementation of LCS in Europe will move forward. Radiologists are important stakeholders in numerous aspects of the LCS pathway. Their role goes beyond nodule detection and nodule management. Being part of a multidisciplinary team, radiologists are key players in numerous aspects of implementation of a high quality LCS program. In this non-systematic review we discuss the multifaceted role of radiologists in LCS.

High precision localization of pulmonary nodules on chest CT utilizing axial slice number labels

BACKGROUND

Reidentification of prior nodules for temporal comparison is an important but time-consuming step in lung cancer screening. We develop and evaluate an automated nodule detector that utilizes the axial-slice number of nodules found in radiology reports to generate high precision nodule predictions.

METHODS

888 CTs from Lung Nodule Analysis were used to train a 2-dimensional (2D) object detection neural network. A pipeline of 2D object detection, 3D unsupervised clustering, false positive reduction, and axial-slice numbers were used to generate nodule candidates. 47 CTs from the National Lung Cancer Screening Trial (NLST) were used for model evaluation.

RESULTS

Our nodule detector achieved a precision of 0.962 at a recall of 0.573 on the NLST test set for any nodule. When adjusting for unintended nodule predictions, we achieved a precision of 0.931 at a recall 0.561, which corresponds to 0.06 false positives per CT. Error analysis revealed better detection of nodules with soft tissue attenuation compared to ground glass and undeterminable attenuation. Nodule margins, size, location, and patient demographics did not differ between correct and incorrect predictions.

CONCLUSIONS

Utilization of axial-slice numbers from radiology reports allowed for development of a lung nodule detector with a low false positive rate compared to prior feature-engineering and machine learning approaches. This high precision nodule detector can reduce time spent on reidentification of prior nodules during lung cancer screening and can rapidly develop new institutional datasets to explore novel applications of computer vision in lung cancer imaging.

Lung Cancer Screening: Evidence, Risks, and Opportunities for Implementation

BACKGROUND

 Lung cancer is the most common cause of cancer death worldwide. Several trials with different screening approaches have recognized the role of lung cancer screening with low-dose CT for reducing lung cancer mortality. The efficacy of lung cancer screening depends on many factors and implementation is still pending in most European countries.

METHODS

 This review aims to portray current evidence on lung cancer screening with a focus on the potential for opportunities for implementation strategies. Pillars of lung cancer screening practice will be discussed according to the most updated literature (PubMed search until November 16, 2020).

RESULTS AND CONCLUSION

 The NELSON trial showed reduction of lung cancer mortality, thus confirming previous results of independent European studies, notably by volume of lung nodules. Heterogeneity in patient recruitment could influence screening efficacy, hence the importance of risk models and community-based screening. Recruitment strategies develop and adapt continuously to address the specific needs of the heterogeneous population of potential participants, the most updated evidence comes from the UK. The future of lung cancer screening is a tailored approach with personalized continuous stratification of risk, aimed at reducing costs and risks.

KEY POINTS

  · Secondary prevention of lung cancer by low-dose computed tomography showed a reduction of lung cancer mortality.. · Semi-automated volume measurement and use of volume doubling time should be the reference method for optimization of risks, namely controlling measurement variability and the false-positive rate.. · A conservative approach with surveillance of subsolid nodules can be one of the strategies to reduce the risk of overdiagnosis and overtreatment.. · The goal of a tailored approach with personalized risk stratification aims to reduce costs and risks. A longer interval between rounds is one option for participants at lower risk..

CITATION FORMAT

· Tringali G, Milanese G, Ledda RE et al. Lung Cancer Screening: Evidence, Risks, and Opportunities for Implementation. Fortschr Röntgenstr 2021; 193: 1153 - 1161.

Intergroupe francophone de cancérologie thoracique, Société de pneumologie de langue française, and Société d'imagerie thoracique statement paper on lung cancer screening

Following the American National Lung Screening Trial results in 2011 a consortium of French experts met to edit a statement. Recent results of other randomized trials gave the opportunity for our group to meet again in order to edit updated guidelines. After literature review, we provide here a new update on lung cancer screening in France. Notably, in accordance with all international guidelines, the experts renew their recommendation in favor of individual screening for lung cancer in France as per the conditions laid out in this document. In addition, the experts recommend the very rapid organization and funding of prospective studies, which, if conclusive, will enable the deployment of lung cancer screening organized at the national level.

Computer-aided Detection of Subsolid Nodules at Chest CT: Improved Performance with Deep Learning-based CT Section Thickness Reduction

Background Studies on the optimal CT section thickness for detecting subsolid nodules (SSNs) with computer-aided detection (CAD) are lacking. Purpose To assess the effect of CT section thickness on CAD performance in the detection of SSNs and to investigate whether deep learning-based super-resolution algorithms for reducing CT section thickness can improve performance. Materials and Methods CT images obtained with 1-, 3-, and 5-mm-thick sections were obtained in patients who underwent surgery between March 2018 and December 2018. Patients with resected synchronous SSNs and those without SSNs (negative controls) were retrospectively evaluated. The SSNs, which ranged from 6 to 30 mm, were labeled ground-truth lesions. A deep learning-based CAD system was applied to SSN detection on CT images of each section thickness and those converted from 3- and 5-mm section thickness into 1-mm section thickness by using the super-resolution algorithm. The CAD performance on each section thickness was evaluated and compared by using the jackknife alternative free response receiver operating characteristic figure of merit. Results A total of 308 patients (mean age ± standard deviation, 62 years ± 10; 183 women) with 424 SSNs (310 part-solid and 114 nonsolid nodules) and 182 patients without SSNs (mean age, 65 years ± 10; 97 men) were evaluated. The figures of merit differed across the three section thicknesses (0.92, 0.90, and 0.89 for 1, 3, and 5 mm, respectively; P = .04) and between 1- and 5-mm sections (P = .04). The figures of merit varied for nonsolid nodules (0.78, 0.72, and 0.66 for 1, 3, and 5 mm, respectively; P < .001) but not for part-solid nodules (range, 0.93-0.94; P = .76). The super-resolution algorithm improved CAD sensitivity on 3- and 5-mm-thick sections (P = .02 for 3 mm, P < .001 for 5 mm). Conclusion Computer-aided detection (CAD) of subsolid nodules performed better at 1-mm section thickness CT than at 3- and 5-mm section thickness CT, particularly with nonsolid nodules. Application of a super-resolution algorithm improved the sensitivity of CAD at 3- and 5-mm section thickness CT. © RSNA, 2021 Online supplemental material is available for this article. See also the editorial by Goo in this issue.

Lung cancer LDCT screening and mortality reduction - evidence, pitfalls and future perspectives

In the past decade, the introduction of molecularly targeted agents and immune-checkpoint inhibitors has led to improved survival outcomes for patients with advanced-stage lung cancer; however, this disease remains the leading cause of cancer-related mortality worldwide. Two large randomized controlled trials of low-dose CT (LDCT)-based lung cancer screening in high-risk populations - the US National Lung Screening Trial (NLST) and NELSON - have provided evidence of a statistically significant mortality reduction in patients. LDCT-based screening programmes for individuals at a high risk of lung cancer have already been implemented in the USA. Furthermore, implementation programmes are currently underway in the UK following the success of the UK Lung Cancer Screening (UKLS) trial, which included the Liverpool Health Lung Project, Manchester Lung Health Check, the Lung Screen Uptake Trial, the West London Lung Cancer Screening pilot and the Yorkshire Lung Screening trial. In this Review, we focus on the current evidence on LDCT-based lung cancer screening and discuss the clinical developments in high-risk populations worldwide; additionally, we address aspects such as cost-effectiveness. We present a framework to define the scope of future implementation research on lung cancer screening programmes referred to as Screening Planning and Implementation RAtionale for Lung cancer (SPIRAL).

Does a Deep Learning-Based Computer-Assisted Diagnosis System Outperform Conventional Double Reading by Radiologists in Distinguishing Benign and Malignant Lung Nodules?

Background

In differentiating indeterminate pulmonary nodules, multiple studies indicated the superiority of deep learning–based computer-assisted diagnosis system (DL-CADx) over conventional double reading by radiologists, which needs external validation. Therefore, our aim was to externally validate the performance of a commercial DL-CADx in differentiating benign and malignant lung nodules.

Methods

In this retrospective study, 233 patients with 261 pathologically confirmed lung nodules were enrolled. Double reading was used to rate each nodule using a four-scale malignancy score system, including unlikely (0–25%), malignancy cannot be completely excluded (25–50%), highly likely (50–75%), and considered as malignant (75–100%), with any disagreement resolved through discussion. DL-CADx automatically rated each nodule with a malignancy likelihood ranging from 0 to 100%, which was then quadrichotomized accordingly. Intraclass correlation coefficient (ICC) was used to evaluate the agreement in malignancy risk rating between DL-CADx and double reading, with ICC value of <0.5, 0.5 to 0.75, 0.75 to 0.9, and >0.9 indicating poor, moderate, good, and perfect agreement, respectively. With malignancy likelihood >50% as cut-off value for malignancy and pathological results as gold standard, sensitivity, specificity, and accuracy were calculated for double reading and DL-CADx, separately.

Results

Among the 261 nodules, 247 nodules were successfully detected by DL-CADx with detection rate of 94.7%. Regarding malignancy rating, DL-CADx was in moderate agreement with double reading (ICC = 0.555, 95% CI 0.424 to 0.655). DL-CADx misdiagnosed 40 true malignant nodules as benign nodules and 30 true benign nodules as malignant nodules with sensitivity, specificity, and accuracy of 79.2, 45.5, and 71.7%, respectively. In contrast, double reading achieved better performance with 16 true malignant nodules misdiagnosed as benign nodules and 26 true benign nodules as malignant nodules with sensitivity, specificity, and accuracy of 91.7, 52.7, and 83.0%, respectively.

Conclusion

Compared with double reading, DL-CADx we used still shows inferior performance in differentiating malignant and benign nodules.

Circulating tumour cells as a potential biomarker for lung cancer screening: a prospective cohort study

BACKGROUND

Lung cancer screening with low-dose chest CT (LDCT) reduces the mortality of eligible individuals. Blood signatures might act as a standalone screening tool, refine the selection of patients at risk, or help to classify undetermined nodules detected on LDCT. We previously showed that circulating tumour cells (CTCs) could be detected, using the isolation by size of epithelial tumour cell technique (ISET), long before the cancer was diagnosed radiologically. We aimed to test whether CTCs could be used as a biomarker for lung cancer screening.

METHODS

We did a prospective, multicentre, cohort study in 21 French university centres. Participants had to be eligible for lung cancer screening as per National Lung Screening Trial criteria and have chronic obstructive pulmonary disease with a fixed airflow limitation defined as post-bronchodilator FEV1/FVC ratio of less than 0·7. Any cancer, other than basocellular skin carcinomas, detected within the previous 5 years was the main exclusion criterion. Participants had three screening rounds at 1-year intervals (T0 [baseline], T1, and T2), which involved LDCT, clinical examination, and a blood test for CTCs detection. Participants and investigators were masked to the results of CTC detection, and cytopathologists were masked to clinical and radiological findings. Our primary objective was to test the diagnostic performance of CTC detection using the ISET technique in lung cancer screening, compared with cancers diagnosed by final pathology, or follow up if pathology was unavailable as the gold standard. This study is registered with ClinicalTrials.gov identifier, number NCT02500693.

FINDINGS

Between Oct 30, 2015, and Feb 2, 2017, we enrolled 614 participants, predominantly men (437 [71%]), aged 65·1 years (SD 6·5), and heavy smokers (52·7 pack-years [SD 21·5]). 81 (13%) participants dropped out between baseline and T1, and 56 (11%) did between T1 and T2. Nodules were detected on 178 (29%) of 614 baseline LDCTs. 19 participants (3%) were diagnosed with a prevalent lung cancer at T0 and 19 were diagnosed with incident lung cancer (15 (3%) of 533 at T1 and four (1%) of 477 at T2). Extrapulmonary cancers were diagnosed in 27 (4%) of participants. Overall 28 (2%) of 1187 blood samples were not analysable. At baseline, the sensitivity of CTC detection for lung cancer detection was 26·3% (95% CI 11·8-48·8). ISET was unable to predict lung cancer or extrapulmonary cancer development.

INTERPRETATION

CTC detection using ISET is not suitable for lung cancer screening.

FUNDING

French Government, Conseil Départemental 06, Fondation UNICE, Fondation Aveni, Fondation de France, Ligue Contre le Cancer-Comité des Alpes-Maritimes, ARC (Canc'Air Genexposomics), Claire de Divonne-Pollner, Enca Faidhi, Basil Faidhi, Fabienne Mourou, Michel Mourou, Leonid Fridlyand, cogs4cancer, and the Fondation Masikini.

COVIDiag: a clinical CAD system to diagnose COVID-19 pneumonia based on CT findings

Objectives

CT findings of COVID-19 look similar to other atypical and viral (non-COVID-19) pneumonia diseases. This study proposes a clinical computer-aided diagnosis (CAD) system using CT features to automatically discriminate COVID-19 from non-COVID-19 pneumonia patients.

Methods

Overall, 612 patients (306 COVID-19 and 306 non-COVID-19 pneumonia) were recruited. Twenty radiological features were extracted from CT images to evaluate the pattern, location, and distribution of lesions of patients in both groups. All significant CT features were fed in five classifiers namely decision tree, K-nearest neighbor, naïve Bayes, support vector machine, and ensemble to evaluate the best performing CAD system in classifying COVID-19 and non-COVID-19 cases.

Results

Location and distribution pattern of involvement, number of the lesion, ground-glass opacity (GGO) and crazy-paving, consolidation, reticular, bronchial wall thickening, nodule, air bronchogram, cavity, pleural effusion, pleural thickening, and lymphadenopathy are the significant features to classify COVID-19 from non-COVID-19 groups. Our proposed CAD system obtained the sensitivity, specificity, and accuracy of 0.965, 93.54%, 90.32%, and 91.94%, respectively, using ensemble (COVIDiag) classifier.

Conclusions

This study proposed a COVIDiag model obtained promising results using CT radiological routine features. It can be considered an adjunct tool by the radiologists during the current COVID-19 pandemic to make an accurate diagnosis.

Key Points

• Location and distribution of involvement, number of lesions, GGO and crazy-paving, consolidation, reticular, bronchial wall thickening, nodule, air bronchogram, cavity, pleural effusion, pleural thickening, and lymphadenopathy are the significant features between COVID-19 from non-COVID-19 groups.

• The proposed CAD system, COVIDiag, could diagnose COVID-19 pneumonia cases with an AUC of 0.965 (sensitivity = 93.54%; specificity = 90.32%; and accuracy = 91.94%).

• The AUC, sensitivity, specificity, and accuracy obtained by radiologist diagnosis are 0.879, 87.10%, 88.71%, and 87.90%, respectively.

Electronic supplementary material

The online version of this article (10.1007/s00330-020-07087-y) contains supplementary material, which is available to authorized users.

Distinction and Potential Prediction of Lung Metastasis in Patients with Malignant Primary Osseous Spinal Neoplasms

STUDY DESIGN

Retrospective analysis.

OBJECTIVE

The aim of this study was to develop and validate a nomogram for the prediction of lung metastasis in patients with malignant primary spinal tumors.

SUMMARY OF BACKGROUND DATA

In patients with malignant primary spinal tumors, lung metastasis is usually found by computed tomography (CT) and is considered to be an essential factor affecting the prognosis and survival.

METHODS

We retrospectively collected 580 malignant primary osseous spinal neoplasms patients from the Surveillance, Epidemiology, and End Results (SEER) database between 2010 and 2015. The least absolute shrinkage and selection operator (LASSO) and multivariate logistic analysis were used to identify independent factors. These prognostic factors were included in the nomograms. The nomograms were validated based on its calibration, discrimination, and clinical utility. The overall survival of the patients was analyzed using the Kaplan-Meier method and the survival differences were tested by the log-rank test.

RESULTS

We randomly divided all these patients (n = 580) into a training cohort (n = 408) and a validation cohort (n = 172). The results showed that the risk of lung metastasis was independently influenced by histologic type, use of surgery, clinical T stage, clinical N stage, and tumor extension (all P < 0.05). The nomogram consisted of five clinical features and provided good calibration and discrimination in the training and validation cohort, with an area under the curve of 0.858 and 0.811, respectively. Decision curve analysis showed that the nomogram was clinically useful. The Kaplan-Meier curves showed a significant difference between the higher and lower risk of lung metastasis groups (P < 0.001).

CONCLUSION

Nomograms were developed to predict the risk of lung metastasis in patients with malignant primary spinal tumors. The nomogram showed favorable discrimination and calibration values, which may help optimize treatment decision-making for patients.

LEVEL OF EVIDENCE

4.

External validation of radiomics-based predictive models in low-dose CT screening for early lung cancer diagnosis

PURPOSE

Low-dose CT screening allows early lung cancer detection, but is affected by frequent false positive results, inter/intra observer variation and uncertain diagnoses of lung nodules. Radiomics-based models have recently been introduced to overcome these issues, but limitations in demonstrating their generalizability on independent datasets are slowing their introduction to clinic. The aim of this study is to evaluate two radiomics-based models to classify malignant pulmonary nodules in low-dose CT screening, and to externally validate them on an independent cohort. The effect of a radiomics features harmonization technique is also investigated to evaluate its impact on the classification of lung nodules from a multicenter data.

METHODS

Pulmonary nodules from two independent cohorts were considered in this study; the first cohort (110 subjects, 113 nodules) was used to train prediction models, and the second cohort (72 nodules) to externally validate them. Literature-based radiomics features were extracted and, after feature selection, used as predictive variables in models for malignancy identification. An in-house prediction model based on artificial neural network (ANN) was implemented and evaluated, along with an alternative model from the literature, based on a support vector machine (SVM) classifier coupled with a least absolute shrinkage and selection operator (LASSO). External validation was performed on the second cohort to evaluate models' generalization ability. Additionally, the impact of the Combat harmonization method was investigated to compensate for multicenter datasets variabilities. A new training of the models based on harmonized features was performed on the first cohort, then tested separately on the harmonized and non-harmonized features of the second cohort.

RESULTS

Preliminary results showed a good accuracy of the investigated models in distinguishing benign from malignant pulmonary nodules with both sets of radiomics features (i.e., non-harmonized and harmonized). The performance of the models, quantified in terms of Area Under the Curve (AUC), was > 0.89 in the training set and > 0.82 in the external validation set for all the investigated scenarios, outperforming the clinical standard (AUC of 0.76). Slightly higher performance was observed for the SVM-LASSO model than the ANN in the external dataset, although they did not result significantly different. For both harmonized and non-harmonized features, no statistical difference was found between Receiver operating characteristic (ROC) curves related to training and test set for both models.

CONCLUSIONS

Although no significant improvements were observed when applying the Combat harmonization method, both in-house and literature-based models were able to classify lung nodules with good generalization to an independent dataset, thus showing their potential as tools for clinical decision-making in lung cancer screening.

Optimization of a chest computed tomography protocol for detecting pure ground glass opacity nodules: A feasibility study with a computer-assisted detection system and a lung cancer screening phantom

Objective

This study aimed to optimize computed tomography (CT) parameters for detecting ground glass opacity nodules (GGNs) using a computer-assisted detection (CAD) system and a lung cancer screening phantom.

Methods

A lung cancer screening phantom containing 15 artificial GGNs (−630 Hounsfield unit [HU], 2–10 mm) in the left lung was examined with a CT scanner. Three tube voltages of 80, 100, and 120 kVp were used in combination with five tube currents of 25, 50, 100, 200, and 400 mA; additionally, three slice thicknesses of 0.625, 1.25, and 2.5 mm and four reconstruction algorithms of adaptive statistical iterative reconstruction (ASIR-V) of 30, 60, and 90% were used. For each protocol, accuracy of the CAD system was evaluated for nine target GGNs of 6, 8, or 10 mm in size. The cut-off size was set to 5 mm to minimize false positives.

Results

Among the 180 combinations of tube voltage, tube current, slice thickness, and reconstruction algorithms, combination of 80 kVp, 200 mA, and 1.25-mm slice thickness with an ASIR-V of 90% had the best performance in the detection of GGNs with six true positives and no false positives. Other combinations had fewer than five true positives. In particular, any combinations with a 0.625-mm slice thickness had 0 true positive and at least one false positive result.

Conclusion

Low-voltage chest CT with a thin slice thickness and a high iterative reconstruction algorithm improve the detection rate of GGNs with a CAD system in a phantom model, and may have potential in lung cancer screening.

Evaluating the performance of a deep learning-based computer-aided diagnosis (DL-CAD) system for detecting and characterizing lung nodules: Comparison with the performance of double reading by radiologists

Background

The study was conducted to evaluate the performance of a state‐of‐the‐art commercial deep learning‐based computer‐aided diagnosis (DL‐CAD) system for detecting and characterizing pulmonary nodules.

Methods

Pulmonary nodules in 346 healthy subjects (male: female = 221:125, mean age 51 years) from a lung cancer screening program conducted from March to November 2017 were screened using a DL‐CAD system and double reading independently, and their performance in nodule detection and characterization were evaluated. An expert panel combined the results of the DL‐CAD system and double reading as the reference standard.

Results

The DL‐CAD system showed a higher detection rate than double reading, regardless of nodule size (86.2% vs. 79.2%; P < 0.001): nodules ≥ 5 mm (96.5% vs. 88.0%; P = 0.008); nodules < 5 mm (84.3% vs. 77.5%; P < 0.001). However, the false positive rate (per computed tomography scan) of the DL‐CAD system (1.53, 529/346) was considerably higher than that of double reading (0.13, 44/346; P < 0.001). Regarding nodule characterization, the sensitivity and specificity of the DL‐CAD system for distinguishing solid nodules > 5 mm (90.3% and 100.0%, respectively) and ground‐glass nodules (100.0% and 96.1%, respectively) were close to that of double reading, but dropped to 55.5% and 93%, respectively, when discriminating part solid nodules.

Conclusion

Our DL‐CAD system detected significantly more nodules than double reading. In the future, false positive findings should be further reduced and characterization accuracy improved.

Performance and clinical impact of machine learning based lung nodule detection using vessel suppression in melanoma patients

PURPOSE

To evaluate performance and the clinical impact of a novel machine learning based vessel-suppressing computer-aided detection (CAD) software in chest computed tomography (CT) of patients with malignant melanoma.

MATERIALS AND METHODS

We retrospectively included consecutive malignant melanoma patients with a chest CT between 01/2015 and 01/2016. Machine learning based CAD software was used to reconstruct additional vessel-suppressed axial images. Three radiologists independently reviewed a maximum of 15 lung nodules per patient. Vessel-suppressed reconstructions were reviewed independently and results were compared. Follow-up CT examinations and clinical follow-up were used to assess the outcome. Impact of additional nodules on clinical management was assessed.

RESULTS

In 46 patients, vessel-suppressed axial images led to the detection of additional nodules in 25/46 (54.3%) patients. CT or clinical follow up was available in 25/25 (100%) patients with additionally detected nodules. 2/25 (8%) of these patients developed new pulmonary metastases. None of the additionally detected nodules were found to be metastases. None of the lung nodules detected by the radiologists was missed by the CAD software. The mean diameter of the 92 additional nodules was 1.5 ± 0.8 mm. The additional nodules did not affect therapeutic management. However, in 14/46 (30.4%) of patients the additional nodules might have had an impact on the radiological follow-up recommendations.

CONCLUSION

Machine learning based vessel suppression led to the detection of significantly more lung nodules in melanoma patients. Radiological follow-up recommendations were altered in 30% of the patients. However, all lung nodules turned out to be non-malignant on follow-up.

Lung cancer screening: nodule identification and characterization

The accurate identification and characterization of small pulmonary nodules at low-dose CT is an essential requirement for the implementation of effective lung cancer screening. Individual reader detection performance is influenced by nodule characteristics and technical CT parameters but can be improved by training, the application of CT techniques, and by computer-aided techniques. However, the evaluation of nodule detection in lung cancer screening trials differs from the assessment of individual readers as it incorporates multiple readers, their inter-observer variability, reporting thresholds, and reflects the program accuracy in identifying lung cancer. Understanding detection and interpretation errors in screening trials aids in the implementation of lung cancer screening in clinical practice. Indeed, as CT screening moves to ever lower radiation doses, radiologists must be cognisant of new technical challenges in nodule assessment. Screen detected lung cancers demonstrate distinct morphological features from incidentally or symptomatically detected lung cancers. Hence characterization of screen detected nodules requires an awareness of emerging concepts in early lung cancer appearances and their impact on radiological assessment and malignancy prediction models. Ultimately many nodules remain indeterminate, but further imaging evaluation can be appropriate with judicious utilization of contrast enhanced CT or MRI techniques or functional evaluation by PET-CT.

Pulmonary Nodule Management in Lung Cancer Screening: A Pictorial Review of Lung-RADS Version 1.0

The number of screening-detected lung nodules is expected to increase as low-dose computed tomography screening is implemented nationally. Standardized guidelines for image acquisition, interpretation, and screen-detected nodule workup are essential to ensure a high standard of medical care and that lung cancer screening is implemented safely and cost effectively. In this article, we review the current guidelines for pulmonary nodule management in the lung cancer screening setting.

A comparison of computer-assisted detection (CAD) programs for the identification of colorectal polyps: performance and sensitivity analysis, current limitations and practical tips for radiologists

AIM

To directly compare the accuracy and speed of analysis of two commercially available computer-assisted detection (CAD) programs in detecting colorectal polyps.

MATERIALS AND METHOD

In this retrospective single-centre study, patients who had colorectal polyps identified on computed tomography colonography (CTC) and subsequent lower gastrointestinal endoscopy, were analysed using two commercially available CAD programs (CAD1 and CAD2). Results were compared against endoscopy to ascertain sensitivity and positive predictive value (PPV) for colorectal polyps. Time taken for CAD analysis was also calculated.

RESULTS

CAD1 demonstrated a sensitivity of 89.8%, PPV of 17.6% and mean analysis time of 125.8 seconds. CAD2 demonstrated a sensitivity of 75.5%, PPV of 44.0% and mean analysis time of 84.6 seconds.

CONCLUSION

The sensitivity and PPV for colorectal polyps and CAD analysis times can vary widely between current commercially available CAD programs. There is still room for improvement. Generally, there is a trade-off between sensitivity and PPV, and so further developments should aim to optimise both. Information on these factors should be made routinely available, so that an informed choice on their use can be made. This information could also potentially influence the radiologist's use of CAD results.

Pulmonary quantitative CT imaging in focal and diffuse disease: current research and clinical applications

The frenetic development of imaging technology-both hardware and software-provides exceptional potential for investigation of the lung. In the last two decades, CT was exploited for detailed characterization of pulmonary structures and description of respiratory disease. The introduction of volumetric acquisition allowed increasingly sophisticated analysis of CT data by means of computerized algorithm, namely quantitative CT (QCT). Hundreds of thousands of CTs have been analysed for characterization of focal and diffuse disease of the lung. Several QCT metrics were developed and tested against clinical, functional and prognostic descriptors. Computer-aided detection of nodules, textural analysis of focal lesions, densitometric analysis and airway segmentation in obstructive pulmonary disease and textural analysis in interstitial lung disease are the major chapters of this discipline. The validation of QCT metrics for specific clinical and investigational needs prompted the translation of such metrics from research field to patient care. The present review summarizes the state of the art of QCT in both focal and diffuse lung disease, including a dedicated discussion about application of QCT metrics as parameters for clinical care and outcomes in clinical trials.

The effect of radiation dose reduction on computer-aided detection (CAD) performance in a low-dose lung cancer screening population

PURPOSE

Lung cancer screening with low-dose CT has recently been approved for reimbursement, heralding the arrival of such screening services worldwide. Computer-aided detection (CAD) tools offer the potential to assist radiologists in detecting nodules in these screening exams. In lung screening, as in all CT exams, there is interest in further reducing radiation dose. However, the effects of continued dose reduction on CAD performance are not fully understood. In this work, we investigated the effect of reducing radiation dose on CAD lung nodule detection performance in a screening population.

METHODS

The raw projection data files were collected from 481 patients who underwent low-dose screening CT exams at our institution as part of the National Lung Screening Trial (NLST). All scans were performed on a multidetector scanner (Sensation 64, Siemens Healthcare, Forchheim Germany) according to the NLST protocol, which called for a fixed tube current scan of 25 effective mAs for standard-sized patients and 40 effective mAs for larger patients. The raw projection data were input to a reduced-dose simulation software to create simulated reduced-dose scans corresponding to 50% and 25% of the original protocols. All raw data files were reconstructed at the scanner with 1 mm slice thickness and B50 kernel. The lungs were segmented semi-automatically, and all images and segmentations were input to an in-house CAD algorithm trained on higher dose scans (75-300 mAs). CAD findings were compared to a reference standard generated by an experienced reader. Nodule- and patient-level sensitivities were calculated along with false positives per scan, all of which were evaluated in terms of the relative change with respect to dose. Nodules were subdivided based on size and solidity into categories analogous to the LungRADS assessment categories, and sub-analyses were performed.

RESULTS

From the 481 patients in this study, 82 had at least one nodule (prevalence of 17%) and 399 did not (83%). A total of 118 nodules were identified. Twenty-seven nodules (23%) corresponded to LungRADS category 4 based on size and composition, while 18 (15%) corresponded to LungRADS category 3 and 73 (61%) corresponded to LungRADS category 2. For solid nodules ≥8 mm, patient-level median sensitivities were 100% at all three dose levels, and mean sensitivities were 72%, 63%, and 63% at original, 50%, and 25% dose, respectively. Overall mean patient-level sensitivities for nodules ranging from 3 to 45 mm were 38%, 37%, and 38% at original, 50%, and 25% dose due to the prevalence of smaller nodules and nonsolid nodules in our reference standard. The mean false-positive rates were 3, 5, and 13 per case.

CONCLUSIONS

CAD sensitivity decreased very slightly for larger nodules as dose was reduced, indicating that reducing the dose to 50% of original levels may be investigated further for use in CT screening. However, the effect of dose was small relative to the effect of the nodule size and solidity characteristics. The number of false positives per scan increased substantially at 25% dose, illustrating the importance of tuning CAD algorithms to very challenging, high-noise screening exams.

Effects of Iterative Reconstruction Algorithms on Computer-assisted Detection (CAD) Software for Lung Nodules in Ultra-low-dose CT for Lung Cancer Screening

RATIONALE AND OBJECTIVES

This study aimed to evaluate the effects of iterative reconstruction (IR) algorithms on computer-assisted detection (CAD) software for lung nodules in ultra-low-dose computed tomography (ULD-CT) for lung cancer screening.

MATERIALS AND METHODS

We selected 85 subjects who underwent both a low-dose CT (LD-CT) scan and an additional ULD-CT scan in our lung cancer screening program for high-risk populations. The LD-CT scans were reconstructed with filtered back projection (FBP; LD-FBP). The ULD-CT scans were reconstructed with FBP (ULD-FBP), adaptive iterative dose reduction 3D (AIDR 3D; ULD-AIDR 3D), and forward projected model-based IR solution (FIRST; ULD-FIRST). CAD software for lung nodules was applied to each image dataset, and the performance of the CAD software was compared among the different IR algorithms.

RESULTS

The mean volume CT dose indexes were 3.02 mGy (LD-CT) and 0.30 mGy (ULD-CT). For overall nodules, the sensitivities of CAD software at 3.0 false positives per case were 78.7% (LD-FBP), 9.3% (ULD-FBP), 69.4% (ULD-AIDR 3D), and 77.8% (ULD-FIRST). Statistical analysis showed that the sensitivities of ULD-AIDR 3D and ULD-FIRST were significantly higher than that of ULD-FBP (P < .001).

CONCLUSIONS

The performance of CAD software in ULD-CT was improved by using IR algorithms. In particular, the performance of CAD in ULD-FIRST was almost equivalent to that in LD-FBP.

A method for evaluating the performance of computer-aided detection of pulmonary nodules in lung cancer CT screening: detection limit for nodule size and density

OBJECTIVE

We propose the application of virtual nodules to evaluate the performance of computer-aided detection (CAD) of lung nodules in cancer screening using low-dose CT.

METHODS

The virtual nodules were generated based on the spatial resolution measured for a CT system used in an institution providing cancer screening and were fused into clinical lung images obtained at that institution, allowing site specificity. First, we validated virtual nodules as an alternative to artificial nodules inserted into a phantom. In addition, we compared the results of CAD analysis between the real nodules (n = 6) and the corresponding virtual nodules. Subsequently, virtual nodules of various sizes and contrasts between nodule density and background density (ΔCT) were inserted into clinical images (n = 10) and submitted for CAD analysis.

RESULTS

In the validation study, 46 of 48 virtual nodules had the same CAD results as artificial nodules (kappa coefficient = 0.913). Real nodules and the corresponding virtual nodules showed the same CAD results. The detection limits of the tested CAD system were determined in terms of size and density of peripheral lung nodules; we demonstrated that a nodule with a 5-mm diameter was detected when the nodule had a ΔCT > 220 HU.

CONCLUSION

Virtual nodules are effective in evaluating CAD performance using site-specific scan/reconstruction conditions. Advances in knowledge: Virtual nodules can be an effective means of evaluating site-specific CAD performance. The methodology for guiding the detection limit for nodule size/density might be a useful evaluation strategy.

Diagnostic Performance of Ultra-Low-Dose Computed Tomography for Detecting Asbestos-Related Pleuropulmonary Diseases: Prospective Study in a Screening Setting

Objective

To evaluate the diagnostic performance of Ultra-Low-Dose Chest CT (ULD CT) for the detection of any asbestos-related lesions (primary endpoint) and specific asbestos-related abnormalities, i.e. non-calcified and calcified pleural plaques, diffuse pleural thickening, asbestosis and significant lung nodules (secondary endpoints).

Material and Methods

55 male patients (55.7±8.1 years old) with occupational asbestos exposure for at least 15 years and where CT screening was indicated were prospectively included. They all underwent a standard unenhanced chest CT (120kV, automated tube current modulation), considered as the reference, and an ULD CT (135kV, 10mA), both with iterative reconstruction.

Two chest radiologists independently and blindly read the examinations, following a detailed protocol. Sensitivity, specificity, positive predictive value, negative predictive value, accuracy and error rate of ULD CT were calculated using the exact method of Pearson with a confidence interval of 95%.

Results

Radiation dose was 17.9±1.2mGy.cm (0.25mSv) for the ULD-CT versus 288.8 ±151mGy.cm (4mSv); p <2.2e^-16.

Prevalence of abnormalities was 20%. The ULD CT’s diagnostic performance in joint reading was high for the primary endpoint (sensitivity = 90.9%, specificity = 100%, positive predictive value = 100%, negative predictive value = 97.8%), high for lung nodules, diffuse pleural thickening and calcified pleural plaques (sensitivity, specificity, PPV and NPV = 100%) and fair for asbestosis (sensitivity = 75%, specificity = 100%, PPV = 00%, NPV = 98.1%).

Intra-reader accuracy between the ULD CT and the reference CT for the primary endpoint was 98% for the senior and 100% for the junior radiologist. Inter-reader agreement for the primary endpoint was almost perfect (Cohen’s Kappa of 0.81).

Conclusion

ULD CT in the screening of asbestos exposure related diseases has 90.9% sensitivity and 100% specificity, and could therefore be proposed as a first line examination.

Maximum-Intensity-Projection and Computer-Aided-Detection Algorithms as Stand-Alone Reader Devices in Lung Cancer Screening Using Different Dose Levels and Reconstruction Kernels

OBJECTIVE

The objective of our study was to evaluate lung nodule detection rates on standard and microdose chest CT with two different computer-aided detection systems (SyngoCT-CAD, VA 20, Siemens Healthcare [CAD1]; Lung CAD, IntelliSpace Portal DX Server, Philips Healthcare [CAD2]) as well as maximum-intensity-projection (MIP) images. We also assessed the impact of different reconstruction kernels.

MATERIALS AND METHODS

Standard and microdose CT using three reconstruction kernels (i30, i50, i70) was performed with an anthropomorphic chest phantom. We placed 133 ground-glass and 133 solid nodules (diameters of 5 mm, 8 mm, 10 mm, and 12 mm) in 55 phantoms. Four blinded readers evaluated the MIP images; one recorded the results of CAD1 and CAD2. Sensitivities for CAD and MIP nodule detection on standard dose and microdose CT were calculated for each reconstruction kernel.

RESULTS

Dose for microdose CT was significantly less than that for standard-dose CT (0.1323 mSv vs 1.65 mSv; p < 0.0001). CAD1 delivered superior results compared with CAD2 for standard-dose and microdose CT (p < 0.0001). At microdose level, the best stand-alone sensitivity (97.6%) was comparable with CAD1 sensitivity (96.0%; p = 0.36; both with i30 reconstruction kernel). Pooled sensitivities for all nodules, doses, and reconstruction kernels on CAD1 ranged from 88.9% to 97.3% versus 49.6% to 73.9% for CAD2. The best sensitivity was achieved with standard-dose CT, i50 kernel, and CAD1 (97.3%) versus 96% with microdose CT, i30 or i50 kernel, and CAD1. MIP images and CAD1 had similar performance at both dose levels (p = 0.1313 and p = 0.48).

CONCLUSION

Submillisievert CT is feasible for detecting solid and ground-glass nodules that require soft-tissue kernels for MIP and CAD systems to achieve acceptable sensitivities. MIP reconstructions remain a valuable adjunct to the interpretation of chest CT for increasing sensitivity and have the advantage of significantly lower false-positive rates.

Effect of radiation dose reduction and iterative reconstruction on computer-aided detection of pulmonary nodules: Intra-individual comparison

OBJECTIVE

To evaluate the effect of radiation dose reduction and iterative reconstruction (IR) on the performance of computer-aided detection (CAD) for pulmonary nodules.

METHODS

In this prospective study twenty-five patients were included who were scanned for pulmonary nodule follow-up. Image acquisition was performed at routine dose and three reduced dose levels in a single session by decreasing mAs-values with 45%, 60% and 75%. Tube voltage was fixed at 120 kVp for patients ≥ 80 kg and 100 kVp for patients < 80 kg. Data were reconstructed with filtered back projection (FBP), iDose(4) (levels 1,4,6) and IMR (levels 1-3). All noncalcified solid pulmonary nodules ≥ 4 mm identified by two radiologists in consensus served as the reference standard. Subsequently, nodule volume was measured with CAD software and compared to the reference consensus. The numbers of true-positives, false-positives and missed pulmonary nodules were evaluated as well as the sensitivity.

RESULTS

Median effective radiation dose was 2.2 mSv at routine dose and 1.2, 0.9 and 0.6 mSv at respectively 45%, 60% and 75% reduced dose. A total of 28 pulmonary nodules were included. With FBP at routine dose, 89% (25/28) of the nodules were correctly identified by CAD. This was similar at reduced dose levels with FBP, iDose(4) and IMR. CAD resulted in a median number of false-positives findings of 11 per scan with FBP at routine dose (93% of the CAD marks) increasing to 15 per scan with iDose(4) (95% of the CAD marks) and 26 per scan (96% of the CAD marks) with IMR at the lowest dose level.

CONCLUSION

CAD can identify pulmonary nodules at submillisievert dose levels with FBP, hybrid and model-based IR. However, the number of false-positive findings increased using hybrid and especially model-based IR at submillisievert dose while dose reduction did not affect the number of false-positives with FBP.

Lung nodule and cancer detection in computed tomography screening

Fundamental to the diagnosis of lung cancer in computed tomography (CT) scans is the detection and interpretation of lung nodules. As the capabilities of CT scanners have advanced, higher levels of spatial resolution reveal tinier lung abnormalities. Not all detected lung nodules should be reported; however, radiologists strive to detect all nodules that might have relevance to cancer diagnosis. Although medium to large lung nodules are detected consistently, interreader agreement and reader sensitivity for lung nodule detection diminish substantially as the nodule size falls below 8 to 10 mm. The difficulty in establishing an absolute reference standard presents a challenge to the reliability of studies performed to evaluate lung nodule detection. In the interest of improving detection performance, investigators are using eye tracking to analyze the effectiveness with which radiologists search CT scans relative to their ability to recognize nodules within their search path in order to determine whether strategies might exist to improve performance across readers. Beyond the viewing of transverse CT reconstructions, image processing techniques such as thin-slab maximum-intensity projections are used to substantially improve reader performance. Finally, the development of computer-aided detection has continued to evolve with the expectation that one day it will serve routinely as a tireless partner to the radiologist to enhance detection performance without significant prolongation of the interpretive process. This review provides an introduction to the current understanding of these varied issues as we enter the era of widespread lung cancer screening.

[Computed tomography with computer-assisted detection of pulmonary nodules in dogs and cats]

OBJECTIVE

The aim of this study was to assess the potential benefit of computer-assisted detection (CAD) of pulmonary nodules in veterinary medicine. Therefore, the CAD rate was compared to the detection rates of two individual examiners in terms of its sensitivity and false-positive findings.

MATERIALS AND METHODS

We included 51 dogs and 16 cats with pulmonary nodules previously diagnosed by computed tomography. First, the number of nodules ≥ 3 mm was recorded for each patient by two independent examiners. Subsequently, each examiner used the CAD software for automated nodule detection. With the knowledge of the CAD results, a final consensus decision on the number of nodules was achieved. The software used was a commercially available CAD program.

RESULTS

The sensitivity of examiner 1 was 89.2%, while that of examiner 2 reached 87.4%. CAD had a sensitivity of 69.4%. With CAD, the sensitivity of examiner 1 increased to 94.7% and that of examiner 2 to 90.8%.

CONCLUSION AND CLINICAL RELEVANCE

The CAD-system, which we used in our study, had a moderate sensitivity of 69.4%. Despite its severe limitations, with a high level of false-positive and false-negative results, CAD increased the examiners' sensitivity. Therefore, its supportive role in diagnostics appears to be evident.