Comparison of manual and automated size measurements of lung metastases on MDCT images: Potential influence on therapeutic decisions

Factors influencing the outcome of volumetry tools for pulmonary nodule analysis: a systematic review and attempted meta-analysis

Health systems worldwide are implementing lung cancer screening programmes to identify early-stage lung cancer and maximise patient survival. Volumetry is recommended for follow-up of pulmonary nodules and outperforms other measurement methods. However, volumetry is known to be influenced by multiple factors. The objectives of this systematic review (PROSPERO CRD42022370233) are to summarise the current knowledge regarding factors that influence volumetry tools used in the analysis of pulmonary nodules, assess for significant clinical impact, identify gaps in current knowledge and suggest future research. Five databases (Medline, Scopus, Journals@Ovid, Embase and Emcare) were searched on the 21st of September, 2022, and 137 original research studies were included, explicitly testing the potential impact of influencing factors on the outcome of volumetry tools. The summary of these studies is tabulated, and a narrative review is provided. A subset of studies (n = 16) reporting clinical significance were selected, and their results were combined, if appropriate, using meta-analysis. Factors with clinical significance include the segmentation algorithm, quality of the segmentation, slice thickness, the level of inspiration for solid nodules, and the reconstruction algorithm and kernel in subsolid nodules. Although there is a large body of evidence in this field, it is unclear how to apply the results from these studies in clinical practice as most studies do not test for clinical relevance. The meta-analysis did not improve our understanding due to the small number and heterogeneity of studies testing for clinical significance. CRITICAL RELEVANCE STATEMENT: Many studies have investigated the influencing factors of pulmonary nodule volumetry, but only 11% of these questioned their clinical relevance in their management. The heterogeneity among these studies presents a challenge in consolidating results and clinical application of the evidence. KEY POINTS: • Factors influencing the volumetry of pulmonary nodules have been extensively investigated. • Just 11% of studies test clinical significance (wrongly diagnosing growth). • Nodule size interacts with most other influencing factors (especially for smaller nodules). • Heterogeneity among studies makes comparison and consolidation of results challenging. • Future research should focus on clinical applicability, screening, and updated technology.

Artificial intelligence software in pulmonary nodule assessment

Background:

This study tests the impact of the addition of autonomous computed tomography (CT) interpreting software to radiologist assessment of pulmonary nodules.

Methods:

Computed tomography scans for nodule assessment were identified retrospectively. Lung cancer risk factors, initial radiologist (RAD) report, Philips Lung Nodule software report (computer-aided nodule (CAD)) and radiologist report following the review of CT images and CAD (RAD + CAD) were collected. Follow-up recommendations based on current guidelines were derived from each report.

Results:

In all, 100 patients were studied. Median maximal diameter of the largest nodule reported by RAD and RAD + CAD were similar at 10.0 and 9.0 mm, respectively ( p = 0.06) but were reported as larger by CAD at 11.8 mm ( p < 0.001). Follow-up recommendations derived from RAD + CAD were less intensive in 23 (23%) and more intensive in 34 (34%) than that of RAD.

Discussion:

This study suggests that autonomous software use can alter radiologist assessment of pulmonary nodules such that suggested follow-up is altered.

Vessel suppressed chest Computed Tomography for semi-automated volumetric measurements of solid pulmonary nodules

OBJECTIVE

To evaluate whether vessel-suppressed computed tomography (VSCT) can be reliably used for semi-automated volumetric measurements of solid pulmonary nodules, as compared to standard CT (SCT) MATERIAL AND METHODS: Ninety-three SCT were elaborated by dedicated software (ClearRead CT, Riverain Technologies, Miamisburg, OH, USA), that allows subtracting vessels from lung parenchyma. Semi-automated volumetric measurements of 65 solid nodules were compared between SCT and VSCT. The measurements were repeated by two readers. For each solid nodule, volume measured on SCT by Reader 1 and Reader 2 was averaged and the average volume between readers acted as standard of reference value. Concordance between measurements was assessed using Lin's Concordance Correlation Coefficient (CCC). Limits of agreement (LoA) between readers and CT datasets were evaluated.

RESULTS

Standard of reference nodule volume ranged from 13 to 366 mm³. The mean overestimation between readers was 3 mm³ and 2.9 mm³ on SCT and VSCT, respectively. Semi-automated volumetric measurements on VSCT showed substantial agreement with the standard of reference (Lin's CCC = 0.990 for Reader 1; 0.985 for Reader 2). The upper and lower LoA between readers' measurements were (16.3, -22.4 mm³) and (15.5, -21.4 mm³) for SCT and VSCT, respectively.

CONCLUSIONS

VSCT datasets are feasible for the measurements of solid nodules, showing an almost perfect concordance between readers and with measurements on SCT.

Inter- and intrascanner variability of pulmonary nodule volumetry on low-dose 64-row CT: an anthropomorphic phantom study

OBJECTIVE

To assess inter- and intrascanner variability in volumetry of solid pulmonary nodules in an anthropomorphic thoracic phantom using low-dose CT.

METHODS

Five spherical solid artificial nodules [diameters 3, 5, 8, 10 and 12 mm; CT density +100 Hounsfield units (HU)] were randomly placed inside an anthropomorphic thoracic phantom in different combinations. The phantom was examined on two 64-row multidetector CT (64-MDCT) systems (CT-A and CT-B) from different vendors with a low-dose protocol. Each CT examination was performed three times. The CT examinations were evaluated twice by independent blinded observers. Nodule volume was semi-automatically measured by dedicated software. Interscanner variability was evaluated by Bland-Altman analysis and expressed as 95% confidence interval (CI) of relative differences. Intrascanner variability was expressed as 95% CI of relative variation from the mean.

RESULTS

No significant difference in CT-derived volume was found between CT-A and CT-B, except for the 3-mm nodules (p<0.05). The 95% CI of interscanner variability was within ±41.6%, ±18.2% and ±4.9% for 3, 5 and ≥8 mm nodules, respectively. The 95% CI of intrascanner variability was within ±28.6%, ±13.4% and ±2.6% for 3, 5 and ≥8 mm nodules, respectively.

CONCLUSION

Different 64-MDCT scanners in low-dose settings yield good agreement in volumetry of artificial pulmonary nodules between 5 mm and 12 mm in diameter. Inter- and intrascanner variability decreases at a larger nodule size to a maximum of 4.9% for ≥8 mm nodules.

ADVANCES IN KNOWLEDGE

The commonly accepted cut-off of 25% to determine nodule growth has the potential to be reduced for ≥8 mm nodules. This offers the possibility of reducing the interval for repeated CT scans in lung cancer screenings.

Automated registration, segmentation, and measurement of metastatic melanoma tumors in serial CT scans

OBJECTIVES

Our goal was to evaluate a new software capability that integrates registration, segmentation and tumor measurement across serial exams within a picture archiving communication system (PACS) to expedite tumor measurement.

MATERIALS AND METHODS

Patients treated under institutional review board-approved protocols for metastatic melanoma were retrospectively reviewed. Of the 19 included patients, five were male, the median age was 43.2, and all received treatment using an adoptive cell therapy. Seventy-one lung, liver, and subcutaneous tumors were manually measured using RECIST (Response Evaluation Criteria In Solid Tumors) criteria before therapy (baseline computed tomography [CT]) and within 3 months after therapy (follow-up CT). We performed semiautomated registration, segmentation, and RECIST measurements at both time points within PACS (Carestream Health, Rochester, NY). We compared manual and software-generated RECIST measurements using Bland-Altman plots.

RESULTS

The median manually measured RECIST diameter for all baseline tumors was 2.1 (1.0-6.2) cm. The refined registration function identified 70/71 (98.6%) tumors on the follow-up CT. On the baseline CT, all 21 liver, 27/32 (84%) lung, and 10/18 (55%) subcutaneous tumors completed segmentation. On the follow-up CT, 19/21 (90%) liver, 21/27 (78%) lung, and 8/10 (80%) subcutaneous tumors completed segmentation. The Bland-Altman plot demonstrated a 95% confidence interval of ±0.7 cm when comparing the software-generated and manual RECIST measurements.

CONCLUSIONS

The PACS software performed semiautomated baseline tumor measurements and fully automated follow-up tumor measurements in a majority of lung, liver, and subcutaneous tumors. In our patients, semiautomated metastatic tumor measurement did not obviate the need for physician oversight due to disease and treatment-related factors.

Advances and perspectives in lung cancer imaging using multidetector row computed tomography

The introduction of multidetector row computed tomography (CT) into clinical practice has revolutionized many aspects of the clinical work-up. Lung cancer imaging has benefited from various breakthroughs in computing technology, with advances in the field of lung cancer detection, tissue characterization, lung cancer staging and response to therapy. Our paper discusses the problems of radiation, image visualization and CT examination comparison. It also reviews the most significant advances in lung cancer imaging and highlights the emerging clinical applications that use state of the art CT technology in the field of lung cancer diagnosis and follow-up.

Evaluation of an improved method of simulating lung nodules in chest tomosynthesis

BACKGROUND

Simulated pathology is a valuable complement to clinical images in studies aiming at evaluating an imaging technique. In order for a study using simulated pathology to be valid, it is important that the simulated pathology in a realistic way reflect the characteristics of real pathology.

PURPOSE

To perform a thorough evaluation of a nodule simulation method for chest tomosynthesis, comparing the detection rate and appearance of the artificial nodules with those of real nodules in an observer performance experiment.

MATERIAL AND METHODS

A cohort consisting of 64 patients, 38 patients with a total of 129 identified pulmonary nodules and 26 patients without identified pulmonary nodules, was used in the study. Simulated nodules, matching the real clinically found pulmonary nodules by size, attenuation, and location, were created and randomly inserted into the tomosynthesis section images of the patients. Three thoracic radiologists and one radiology resident reviewed the images in an observer performance study divided into two parts. The first part included nodule detection and the second part included rating of the visual appearance of the nodules. The results were evaluated using a modified receiver-operating characteristic (ROC) analysis.

RESULTS

The sensitivities for real and simulated nodules were comparable, as the area under the modified ROC curve (AUC) was close to 0.5 for all observers (range, 0.43-0.55). Even though the ratings of visual appearance for real and simulated nodules overlapped considerably, the statistical analysis revealed that the observers to were able to separate simulated nodules from real nodules (AUC values range 0.70-0.74).

CONCLUSION

The simulation method can be used to create artificial lung nodules that have similar detectability as real nodules in chest tomosynthesis, although experienced thoracic radiologists may be able to distinguish them from real nodules.

Reduction in growth threshold for pulmonary metastases: an opportunity for volumetry and its impact on treatment decisions

OBJECTIVES

This study compares tumour response assessment by automated CT volumetry and standard manual measurements regarding the impact on treatment decisions and patient outcome.

METHODS

58 consecutive patients with 203 pulmonary metastases undergoing baseline and follow-up multirow detector CT (MDCT) under chemotherapy were assessed for response to chemotherapy. Tumour burden of pulmonary target lesions was quantified in three ways: (1) following response evaluation criteria in solid tumours (RECIST); (2) following the volume equivalents of RECIST (i.e. with a threshold of -65/+73%); and (3) using calculated limits for stable disease (SD). For volumetry, calculated limits had been set at ±38% prior to the study by repeated quantification of nodules scanned twice. Results were compared using non-weighted κ-values and were evaluated for their impact on treatment decisions and patient outcome.

RESULTS

In 15 (17%) of the 58 patients, the results of response assessment were inconsistent with 1 of the 3 methods, which would have had an impact on treatment decisions in 8 (13%). Patient outcome regarding therapy response could be verified in 5 (33%) of the 15 patients with inconsistent measurement results and was consistent with both RECIST and volumetry in 1, with calculated limits in 3 and with none in 1. Diagnosis as to the overall response was consistent with RECIST in six patients, with volumetry in six and with calculated limits in eight cases. There is an impact of different methods for therapy response assessment on treatment decisions.

CONCLUSION

A reduction of threshold for SD to ±30-40% of volume change seems reasonable when using volumetry.

The incidental pancreatic cyst

The discovery of a pancreatic cyst in an asymptomatic patient presents an immediate challenge to the interpreting radiologist, the clinician who manages the patient, and patients themselves. When a cyst is discovered on imaging in a patient without symptoms directly referable to the pancreas, the following questions are immediately raised: can the lesion be accurately diagnosed or is the appropriate management clear from the examination, is the best management approach to suggest watchful waiting with follow-up imaging, what is the best method for imaging follow-up, and what is the optimal frequency of follow-up? This article recommends an approach to analyzing patients with incidental pancreatic cysts.

Lung nodule volumetry: segmentation algorithms within the same software package cannot be used interchangeably

Objective

We examined the reproducibility of lung nodule volumetry software that offers three different volumetry algorithms.

Methods

In a lung cancer screening trial, 188 baseline nodules >5 mm were identified. Including follow-ups, these nodules formed a study-set of 545 nodules. Nodules were independently double read by two readers using commercially available volumetry software. The software offers readers three different analysing algorithms. We compared the inter-observer variability of nodule volumetry when the readers used the same and different algorithms.

Results

Both readers were able to correctly segment and measure 72% of nodules. In 80% of these cases, the readers chose the same algorithm. When readers used the same algorithm, exactly the same volume was measured in 50% of readings and a difference of >25% was observed in 4%. When the readers used different algorithms, 83% of measurements showed a difference of >25%.

Conclusion

Modern volumetric software failed to correctly segment a high number of screen detected nodules. While choosing a different algorithm can yield better segmentation of a lung nodule, reproducibility of volumetric measurements deteriorates substantially when different algorithms were used. It is crucial even in the same software package to choose identical parameters for follow-up.

In vivo repeatability of automated volume calculations of small pulmonary nodules with CT

OBJECTIVE

The objectives of our study were to evaluate the in vivo reproducibility of automated volume calculations of small lung nodules with both low-dose and standard-dose CT and to assess whether repeatability within each technique varies according to the diameter, site, or morphology of the nodule or to percentage of emphysema.

SUBJECTS AND METHODS

Sixty-six subjects with 83 solid pulmonary nodules between 5 and 10 mm in diameter were enrolled in this prospective study. Four consecutive MDCT data sets, two low dose and two standard dose, were obtained for each nodule on separate breath-holds during the same session. The volume of each nodule was calculated by automated software. Repeatability was evaluated by Bland-Altman's approach and the coefficient of repeatability. Associations of the percentage of volume variation between two measurements with nodule diameter, emphysema percentage, nodule site, and nodule morphology were assessed by Spearman's correlation coefficient and the Kruskal-Wallis test. A p value of < 0.05 was considered statistically significant.

RESULTS

The range of variation of the volumes of pulmonary nodules between two subsequent measurements was -38% +/- 60% for low-dose CT and -27% +/- 40% for standard-dose CT. No significant statistical association was found between variation in volume measurements and nodule site, nodule diameter, nodule morphology, or emphysema percentage by semiautomated calculation of lung density.

CONCLUSION

Automated volume calculations of small pulmonary nodules can significantly differ between two subsequent breath-holds with both low-dose and standard-dose CT techniques; in clinical practice we recommend that a volume variation of greater than 30% for nodules between 5 and 10 mm should be confirmed by follow-up CT to be sure that a nodule is actually growing.