Automatic lung segmentation in COVID-19 patients: Impact on quantitative computed tomography analysis

A multicenter evaluation of a deep learning software (LungQuant) for lung parenchyma characterization in COVID-19 pneumonia

BACKGROUND

The role of computed tomography (CT) in the diagnosis and characterization of coronavirus disease 2019 (COVID-19) pneumonia has been widely recognized. We evaluated the performance of a software for quantitative analysis of chest CT, the LungQuant system, by comparing its results with independent visual evaluations by a group of 14 clinical experts. The aim of this work is to evaluate the ability of the automated tool to extract quantitative information from lung CT, relevant for the design of a diagnosis support model.

METHODS

LungQuant segments both the lungs and lesions associated with COVID-19 pneumonia (ground-glass opacities and consolidations) and computes derived quantities corresponding to qualitative characteristics used to clinically assess COVID-19 lesions. The comparison was carried out on 120 publicly available CT scans of patients affected by COVID-19 pneumonia. Scans were scored for four qualitative metrics: percentage of lung involvement, type of lesion, and two disease distribution scores. We evaluated the agreement between the LungQuant output and the visual assessments through receiver operating characteristics area under the curve (AUC) analysis and by fitting a nonlinear regression model.

RESULTS

Despite the rather large heterogeneity in the qualitative labels assigned by the clinical experts for each metric, we found good agreement on the metrics compared to the LungQuant output. The AUC values obtained for the four qualitative metrics were 0.98, 0.85, 0.90, and 0.81.

CONCLUSIONS

Visual clinical evaluation could be complemented and supported by computer-aided quantification, whose values match the average evaluation of several independent clinical experts.

KEY POINTS

We conducted a multicenter evaluation of the deep learning-based LungQuant automated software. We translated qualitative assessments into quantifiable metrics to characterize coronavirus disease 2019 (COVID-19) pneumonia lesions. Comparing the software output to the clinical evaluations, results were satisfactory despite heterogeneity of the clinical evaluations. An automatic quantification tool may contribute to improve the clinical workflow of COVID-19 pneumonia.

Quantitative Imaging Metrics for the Assessment of Pulmonary Pathophysiology: An Official American Thoracic Society and Fleischner Society Joint Workshop Report

Multiple thoracic imaging modalities have been developed to link structure to function in the diagnosis and monitoring of lung disease. Volumetric computed tomography (CT) renders three-dimensional maps of lung structures and may be combined with positron emission tomography (PET) to obtain dynamic physiological data. Magnetic resonance imaging (MRI) using ultrashort-echo time (UTE) sequences has improved signal detection from lung parenchyma; contrast agents are used to deduce airway function, ventilation-perfusion-diffusion, and mechanics. Proton MRI can measure regional ventilation-perfusion ratio. Quantitative imaging (QI)-derived endpoints have been developed to identify structure-function phenotypes, including air-blood-tissue volume partition, bronchovascular remodeling, emphysema, fibrosis, and textural patterns indicating architectural alteration. Coregistered landmarks on paired images obtained at different lung volumes are used to infer airway caliber, air trapping, gas and blood transport, compliance, and deformation. This document summarizes fundamental "good practice" stereological principles in QI study design and analysis; evaluates technical capabilities and limitations of common imaging modalities; and assesses major QI endpoints regarding underlying assumptions and limitations, ability to detect and stratify heterogeneous, overlapping pathophysiology, and monitor disease progression and therapeutic response, correlated with and complementary to, functional indices. The goal is to promote unbiased quantification and interpretation of in vivo imaging data, compare metrics obtained using different QI modalities to ensure accurate and reproducible metric derivation, and avoid misrepresentation of inferred physiological processes. The role of imaging-based computational modeling in advancing these goals is emphasized. Fundamental principles outlined herein are critical for all forms of QI irrespective of acquisition modality or disease entity.

Artificial intelligence for differentiating COVID-19 from other viral pneumonias on CT: comparative analysis of different models based on quantitative and radiomic approaches

BACKGROUND

To develop a pipeline for automatic extraction of quantitative metrics and radiomic features from lung computed tomography (CT) and develop artificial intelligence (AI) models supporting differential diagnosis between coronavirus disease 2019 (COVID-19) and other viral pneumonia (non-COVID-19).

METHODS

Chest CT of 1,031 patients (811 for model building; 220 as independent validation set (IVS) with positive swab for severe acute respiratory syndrome coronavirus-2 (647 COVID-19) or other respiratory viruses (384 non-COVID-19) were segmented automatically. A Gaussian model, based on the HU histogram distribution describing well-aerated and ill portions, was optimised to calculate quantitative metrics (QM, n = 20) in both lungs (2L) and four geometrical subdivisions (GS) (upper front, lower front, upper dorsal, lower dorsal; n = 80). Radiomic features (RF) of first (RF1, n = 18) and second (RF2, n = 120) order were extracted from 2L using PyRadiomics tool. Extracted metrics were used to develop four multilayer-perceptron classifiers, built with different combinations of QM and RF: Model1 (RF1-2L); Model2 (QM-2L, QM-GS); Model3 (RF1-2L, RF2-2L); Model4 (RF1-2L, QM-2L, GS-2L, RF2-2L).

RESULTS

The classifiers showed accuracy from 0.71 to 0.80 and area under the receiving operating characteristic curve (AUC) from 0.77 to 0.87 in differentiating COVID-19 versus non-COVID-19 pneumonia. Best results were associated with Model3 (AUC 0.867 ± 0.008) and Model4 (AUC 0.870 ± 0.011. For the IVS, the AUC values were 0.834 ± 0.008 for Model3 and 0.828 ± 0.011 for Model4.

CONCLUSIONS

Four AI-based models for classifying patients as COVID-19 or non-COVID-19 viral pneumonia showed good diagnostic performances that could support clinical decisions.

A deep learning-based application for COVID-19 diagnosis on CT: The Imaging COVID-19 AI initiative

BACKGROUND

Recently, artificial intelligence (AI)-based applications for chest imaging have emerged as potential tools to assist clinicians in the diagnosis and management of patients with coronavirus disease 2019 (COVID-19).

OBJECTIVES

To develop a deep learning-based clinical decision support system for automatic diagnosis of COVID-19 on chest CT scans. Secondarily, to develop a complementary segmentation tool to assess the extent of lung involvement and measure disease severity.

METHODS

The Imaging COVID-19 AI initiative was formed to conduct a retrospective multicentre cohort study including 20 institutions from seven different European countries. Patients with suspected or known COVID-19 who underwent a chest CT were included. The dataset was split on the institution-level to allow external evaluation. Data annotation was performed by 34 radiologists/radiology residents and included quality control measures. A multi-class classification model was created using a custom 3D convolutional neural network. For the segmentation task, a UNET-like architecture with a backbone Residual Network (ResNet-34) was selected.

RESULTS

A total of 2,802 CT scans were included (2,667 unique patients, mean [standard deviation] age = 64.6 [16.2] years, male/female ratio 1.3:1). The distribution of classes (COVID-19/Other type of pulmonary infection/No imaging signs of infection) was 1,490 (53.2%), 402 (14.3%), and 910 (32.5%), respectively. On the external test dataset, the diagnostic multiclassification model yielded high micro-average and macro-average AUC values (0.93 and 0.91, respectively). The model provided the likelihood of COVID-19 vs other cases with a sensitivity of 87% and a specificity of 94%. The segmentation performance was moderate with Dice similarity coefficient (DSC) of 0.59. An imaging analysis pipeline was developed that returned a quantitative report to the user.

CONCLUSION

We developed a deep learning-based clinical decision support system that could become an efficient concurrent reading tool to assist clinicians, utilising a newly created European dataset including more than 2,800 CT scans.

Diagnostic Performance in Differentiating COVID-19 from Other Viral Pneumonias on CT Imaging: Multi-Reader Analysis Compared with an Artificial Intelligence-Based Model

Growing evidence suggests that artificial intelligence tools could help radiologists in differentiating COVID-19 pneumonia from other types of viral (non-COVID-19) pneumonia. To test this hypothesis, an R-AI classifier capable of discriminating between COVID-19 and non-COVID-19 pneumonia was developed using CT chest scans of 1031 patients with positive swab for SARS-CoV-2 (n = 647) and other respiratory viruses (n = 384). The model was trained with 811 CT scans, while 220 CT scans (n = 151 COVID-19; n = 69 non-COVID-19) were used for independent validation. Four readers were enrolled to blindly evaluate the validation dataset using the CO-RADS score. A pandemic-like high suspicion scenario (CO-RADS 3 considered as COVID-19) and a low suspicion scenario (CO-RADS 3 considered as non-COVID-19) were simulated. Inter-reader agreement and performance metrics were calculated for human readers and R-AI classifier. The readers showed good agreement in assigning CO-RADS score (Gwet's AC2 = 0.71, p < 0.001). Considering human performance, accuracy = 78% and accuracy = 74% were obtained in the high and low suspicion scenarios, respectively, while the AI classifier achieved accuracy = 79% in distinguishing COVID-19 from non-COVID-19 pneumonia on the independent validation dataset. The R-AI classifier performance was equivalent or superior to human readers in all comparisons. Therefore, a R-AI classifier may support human readers in the difficult task of distinguishing COVID-19 from other types of viral pneumonia on CT imaging.

Two-dimensional reciprocal cross entropy multi-threshold combined with improved firefly algorithm for lung parenchyma segmentation of COVID-19 CT image

The lesions of COVID-19 CT image show various kinds of ground-glass opacity and consolidation, which are distributed in left lung, right lung or both lungs. The lung lobes are uneven and it have similar gray value to the surrounding arteries, veins, and bronchi. The lesions of COVID-19 have different sizes and shapes in different periods. Accurate segmentation of lung parenchyma in CT image is a key step in COVID-19 detection and diagnosis. Aiming at the unideal effect of traditional image segmentation methods on lung parenchyma segmentation in CT images, a lung parenchyma segmentation method based on two-dimensional reciprocal cross entropy multi-threshold combined with improved firefly algorithm is proposed. Firstly, the optimal threshold method is used to realize the initial segmentation of the lung, so that the segmentation threshold can change adaptively according to the detailed information of lung lobes, trachea, bronchi and ground-glass opacity. Then the lung parenchyma is further processed to obtain the lung parenchyma template, and then the defective template is repaired combined with the improved Freeman chain code and Bezier curve. Finally, the lung parenchyma is extracted by multiplying the template with the lung CT image. The accuracy of lung parenchyma segmentation has been improved in the contrast clarity of CT image and the consistency of lung parenchyma regional features, with an average segmentation accuracy rate of 97.4%. The experimental results show that for COVID-19 and suspected cases, the method has an ideal segmentation effect, and it has good accuracy and robustness.

Atlas-Based Lung Segmentation Combined With Automatic Densitometry Characterization In COVID-19 Patients: Training, Validation And First Application In A Longitudinal Study

Purpose

To develop and validate an automated segmentation tool for COVID-19 lung CTs. To combine it with densitometry information in identifying Aerated, Intermediate and Consolidated Volumes in admission (CT1) and follow up CT (CT3).

Materials and Methods

An Atlas was trained on manually segmented CT1 of 250 patients and validated on 10 CT1 of the training group, 10 new CT1 and 10 CT3, by comparing DICE index between automatic (AUTO), automatic-corrected (AUTOMAN) and manual (MAN) contours. A previously developed automatic method was applied on HU lung density histograms to quantify Aerated, Intermediate and Consolidated Volumes. Volumes of subregions in validation CT1 and CT3 were quantified for each method.

Results

In validation CT1/CT3, manual correction of automatic contours was not necessary in 40% of cases. Mean DICE values for both lungs were 0.94 for AUTOVsMAN and 0.96 for AUTOMANVsMAN. Differences between Aerated and Intermediate Volumes quantified with AUTOVsMAN contours were always < 6%. Consolidated Volumes showed larger differences (mean: −95 ± 72 cc). If considering AUTOMANVsMAN volumes, differences got further smaller for Aerated and Intermediate, and were drastically reduced for consolidated Volumes (mean: −36 ± 25 cc). The average time for manual correction of automatic lungs contours on CT1 was 5 ± 2 min.

Conclusions

An Atlas for automatic segmentation of lungs in COVID-19 patients was developed and validated. Combined with a previously developed method for lung densitometry characterization, it provides a fast, operator-independent way to extract relevant quantitative parameters with minimal manual intervention.