Technical Note: Deriving ventilation imaging from 4DCT by deep convolutional neural network

Incorporation of Functional Lung Imaging Into Radiation Therapy Planning in Patients With Lung Cancer: A Systematic Review and Meta-Analysis

Our purpose was to provide an understanding of current functional lung imaging (FLI) techniques and their potential to improve dosimetry and outcomes for patients with lung cancer receiving radiation therapy (RT). Excerpta Medica dataBASE (EMBASE), PubMed, and Cochrane Library were searched from 1990 until April 2023. Articles were included if they reported on FLI in one of: techniques, incorporation into RT planning for lung cancer, or quantification of RT-related outcomes for patients with lung cancer. Studies involving all RT modalities, including stereotactic body RT and particle therapy, were included. Meta-analyses were conducted to investigate differences in dose-function parameters between anatomic and functional RT planning techniques, as well as to investigate correlations of dose-function parameters with grade 2+ radiation pneumonitis (RP). One hundred seventy-eight studies were included in the narrative synthesis. We report on FLI modalities, dose-response quantification, functional lung (FL) definitions, FL avoidance techniques, and correlations between FL irradiation and toxicity. Meta-analysis results show that FL avoidance planning gives statistically significant absolute reductions of 3.22% to the fraction of well-ventilated lung receiving 20 Gy or more, 3.52% to the fraction of well-perfused lung receiving 20 Gy or more, 1.3 Gy to the mean dose to the well-ventilated lung, and 2.41 Gy to the mean dose to the well-perfused lung. Increases in the threshold value for defining FL are associated with decreases in functional parameters. For intensity modulated RT and volumetric modulated arc therapy, avoidance planning results in a 13% rate of grade 2+ RP, which is reduced compared with results from conventional planning cohorts. A trend of increased predictive ability for grade 2+ RP was seen in models using FL information but was not statistically significant. FLI shows promise as a method to spare FL during thoracic RT, but interventional trials related to FL avoidance planning are sparse. Such trials are critical to understanding the effect of FL avoidance planning on toxicity reduction and patient outcomes.

Deep learning-based combination of [18F]-FDG PET and CT images for producing pulmonary perfusion image

BACKGROUND

The main application of [18F] FDG-PET (18 FDG-PET) and CT images in oncology is tumor identification and quantification. Combining PET and CT images to mine pulmonary perfusion information for functional lung avoidance radiation therapy (FLART) is desirable but remains challenging.

PURPOSE

To develop a deep-learning-based (DL) method to combine 18 FDG-PET and CT images for producing pulmonary perfusion images (PPI).

METHODS

Pulmonary technetium-99 m-labeled macroaggregated albumin SPECT (PPISPECT ), 18 FDG-PET, and CT images obtained from 53 patients were enrolled. CT and PPISPECT images were rigidly registered, and registration displacement was subsequently used to align 18 FDG-PET and PPISPECT images. The left/right lung was separated and rigidly registered again to improve the registration accuracy. A DL model based on 3D Unet architecture was constructed to directly combine multi-modality 18 FDG-PET and CT images for producing PPI (PPIDLM ). 3D Unet architecture was used as the basic architecture, and the input was expanded from a single-channel to a dual-channel to combine multi-modality images. For comparative evaluation, 18 FDG-PET images were also used alone to generate PPIDLPET . Sixty-seven samples were randomly selected for training and cross-validation, and 36 were used for testing. The Spearman correlation coefficient (rs ) and multi-scale structural similarity index measure (MS-SSIM) between PPIDLM /PPIDLPET and PPISPECT were computed to assess the statistical and perceptual image similarities. The Dice similarity coefficient (DSC) was calculated to determine the similarity between high-/low- functional lung (HFL/LFL) volumes.

RESULTS

The voxel-wise rs and MS-SSIM of PPIDLM /PPIDLPET were 0.78 ± 0.04/0.57 ± 0.03, 0.93 ± 0.01/0.89 ± 0.01 for cross-validation and 0.78 ± 0.11/0.55 ± 0.18, 0.93 ± 0.03/0.90 ± 0.04 for testing. PPIDLM /PPIDLPET achieved averaged DSC values of 0.78 ± 0.03/0.64 ± 0.02 for HFL and 0.83 ± 0.01/0.72 ± 0.03 for LFL in the training dataset and 0.77 ± 0.11/0.64 ± 0.12, 0.82 ± 0.05/0.72 ± 0.06 in the testing dataset. PPIDLM yielded a stronger correlation and higher MS-SSIM with PPISPECT than PPIDLPET (p < 0.001).

CONCLUSIONS

The DL-based method integrates lung metabolic and anatomy information for producing PPI and significantly improved the accuracy over methods based on metabolic information alone. The generated PPIDLM can be applied for pulmonary perfusion volume segmentation, which is potentially beneficial for FLART treatment plan optimization.

Respiratory Invariant Textures From Static Computed Tomography Scans for Explainable Lung Function Characterization

PURPOSE

The inherent characteristics of lung tissue independent of breathing maneuvers may provide fundamental information for function assessment. This paper attempted to correlate textural signatures from computed tomography (CT) with pulmonary function measurements.

MATERIALS AND METHODS

Twenty-one lung cancer patients with thoracic 4-dimensional CT, DTPA-single-photon emission CT ventilation ( VNM ) scans, and available spirometry measurements (forced expiratory volume in 1 s, FEV 1 ; forced vital capacity, FVC; and FEV 1 /FVC) were collected. In subregional feature discovery, function-correlated candidates were identified from 79 radiomic features based on the statistical strength to differentiate defected/nondefected lung regions. Feature maps (FMs) of selected candidates were generated on 4-dimensional CT phases for a voxel-wise feature distribution study. Quantitative metrics were applied for validations, including the Spearman correlation coefficient (SCC) and the Dice similarity coefficient for FM- VNM spatial agreement assessments, intraclass correlation coefficient for FM interphase robustness evaluations, and FM-spirometry comparisons.

RESULTS

At the subregion level, 8 function-correlated features were identified (effect size>0.330). The FMs of candidates yielded moderate-to-strong voxel-wise correlations with the reference VNM . The FMs of gray level dependence matrix dependence nonuniformity showed the highest robust (intraclass correlation coefficient=0.96 and P <0.0001) spatial correlation, with median SCCs ranging from 0.54 to 0.59 throughout the 10 breathing phases. Its phase-averaged FM achieved a median SCC of 0.60, a median Dice similarity coefficient of 0.60 (0.65) for high (low) functional lung volumes, and a correlation of 0.565 (0.646) between the spatially averaged feature values and FEV 1 (FEV 1 /FVC).

CONCLUSIONS

The results provide further insight into the underlying association of specific pulmonary textures with both local ( VNM ) and global (FEV 1 /FVC, FEV 1 ) functions. Further validations of the FM generalizability and the standardization of implementation protocols are warranted before clinically relevant investigations.

A hybrid model- and deep learning-based framework for functional lung image synthesis from multi-inflation CT and hyperpolarized gas MRI

BACKGROUND

Hyperpolarized gas MRI is a functional lung imaging modality capable of visualizing regional lung ventilation with exceptional detail within a single breath. However, this modality requires specialized equipment and exogenous contrast, which limits widespread clinical adoption. CT ventilation imaging employs various metrics to model regional ventilation from non-contrast CT scans acquired at multiple inflation levels and has demonstrated moderate spatial correlation with hyperpolarized gas MRI. Recently, deep learning (DL)-based methods, utilizing convolutional neural networks (CNNs), have been leveraged for image synthesis applications. Hybrid approaches integrating computational modeling and data-driven methods have been utilized in cases where datasets are limited with the added benefit of maintaining physiological plausibility.

PURPOSE

To develop and evaluate a multi-channel DL-based method that combines modeling and data-driven approaches to synthesize hyperpolarized gas MRI lung ventilation scans from multi-inflation, non-contrast CT and quantitatively compare these synthetic ventilation scans to conventional CT ventilation modeling.

METHODS

In this study, we propose a hybrid DL configuration that integrates model- and data-driven methods to synthesize hyperpolarized gas MRI lung ventilation scans from a combination of non-contrast, multi-inflation CT and CT ventilation modeling. We used a diverse dataset comprising paired inspiratory and expiratory CT and helium-3 hyperpolarized gas MRI for 47 participants with a range of pulmonary pathologies. We performed six-fold cross-validation on the dataset and evaluated the spatial correlation between the synthetic ventilation and real hyperpolarized gas MRI scans; the proposed hybrid framework was compared to conventional CT ventilation modeling and other non-hybrid DL configurations. Synthetic ventilation scans were evaluated using voxel-wise evaluation metrics such as Spearman's correlation and mean square error (MSE), in addition to clinical biomarkers of lung function such as the ventilated lung percentage (VLP). Furthermore, regional localization of ventilated and defect lung regions was assessed via the Dice similarity coefficient (DSC).

RESULTS

We showed that the proposed hybrid framework is capable of accurately replicating ventilation defects seen in the real hyperpolarized gas MRI scans, achieving a voxel-wise Spearman's correlation of 0.57 ± 0.17 and an MSE of 0.017 ± 0.01. The hybrid framework significantly outperformed CT ventilation modeling alone and all other DL configurations using Spearman's correlation. The proposed framework was capable of generating clinically relevant metrics such as the VLP without manual intervention, resulting in a Bland-Altman bias of 3.04%, significantly outperforming CT ventilation modeling. Relative to CT ventilation modeling, the hybrid framework yielded significantly more accurate delineations of ventilated and defect lung regions, achieving a DSC of 0.95 and 0.48 for ventilated and defect regions, respectively.

CONCLUSION

The ability to generate realistic synthetic ventilation scans from CT has implications for several clinical applications, including functional lung avoidance radiotherapy and treatment response mapping. CT is an integral part of almost every clinical lung imaging workflow and hence is readily available for most patients; therefore, synthetic ventilation from non-contrast CT can provide patients with wider access to ventilation imaging worldwide.

PhysVENeT: a physiologically-informed deep learning-based framework for the synthesis of 3D hyperpolarized gas MRI ventilation

Functional lung imaging modalities such as hyperpolarized gas MRI ventilation enable visualization and quantification of regional lung ventilation; however, these techniques require specialized equipment and exogenous contrast, limiting clinical adoption. Physiologically-informed techniques to map proton (¹H)-MRI ventilation have been proposed. These approaches have demonstrated moderate correlation with hyperpolarized gas MRI. Recently, deep learning (DL) has been used for image synthesis applications, including functional lung image synthesis. Here, we propose a 3D multi-channel convolutional neural network that employs physiologically-informed ventilation mapping and multi-inflation structural ¹H-MRI to synthesize 3D ventilation surrogates (PhysVENeT). The dataset comprised paired inspiratory and expiratory ¹H-MRI scans and corresponding hyperpolarized gas MRI scans from 170 participants with various pulmonary pathologies. We performed fivefold cross-validation on 150 of these participants and used 20 participants with a previously unseen pathology (post COVID-19) for external validation. Synthetic ventilation surrogates were evaluated using voxel-wise correlation and structural similarity metrics; the proposed PhysVENeT framework significantly outperformed conventional ¹H-MRI ventilation mapping and other DL approaches which did not utilize structural imaging and ventilation mapping. PhysVENeT can accurately reflect ventilation defects and exhibits minimal overfitting on external validation data compared to DL approaches that do not integrate physiologically-informed mapping.

Predicting pulmonary ventilation damage after radiation therapy for nonsmall cell lung cancer using a ResNet generative adversarial network

BACKGROUND

Functional lung avoidance radiation therapy (RT) is a technique being investigated to preferentially avoid specific regions of the lung that are predicted to be more susceptible to radiation-induced damage. Reducing the dose delivered to high functioning regions may reduce the occurrence radiation-induced lung injuries (RILIs) and toxicities. However, in order to develop effective lung function-sparing plans, accurate predictions of post-RT ventilation change are needed to determine which regions of the lung should be spared.

PURPOSE

To predict pulmonary ventilation change following RT for nonsmall cell lung cancer using machine learning.

METHODS

A conditional generative adversarial network (cGAN) was developed with data from 82 human subjects enrolled in a randomized clinical trial approved by the institution's IRB to predict post-RT pulmonary ventilation change. The inputs to the network were the pre-RT pulmonary ventilation map and radiation dose distribution. The loss function was a combination of the binary cross-entropy loss and an asymmetrical structural similarity index measure (aSSIM) function designed to increase penalization of under-prediction of ventilation damage. Network performance was evaluated against a previously developed polynomial regression model using a paired sample t-test for comparison. Evaluation was performed using eight-fold cross-validation.

RESULTS

From the eight-fold cross-validation, we found that relative to the polynomial model, the cGAN model significantly improved predicting regions of ventilation damage following radiotherapy based on true positive rate (TPR), 0.14±0.15 to 0.72±0.21, and Dice similarity coefficient (DSC), 0.19±0.16 to 0.46±0.14, but significantly declined in true negative rate, 0.97±0.05 to 0.62±0.21, and accuracy, 0.79±0.08 to 0.65±0.14. Additionally, the average true positive volume increased from 104±119 cc in the POLY model to 565±332 cc in the cGAN model, and the average false negative volume decreased from 654±361 cc in the POLY model to 193±163 cc in the cGAN model.

CONCLUSIONS

The proposed cGAN model demonstrated significant improvement in TPR and DSC. The higher sensitivity of the cGAN model can improve the clinical utility of functional lung avoidance RT by identifying larger volumes of functional lung that can be spared and thus decrease the probability of the patient developing RILIs.

A super-voxel-based method for generating surrogate lung ventilation images from CT

Purpose: This study aimed to develop and evaluate CTVISVD , a super-voxel-based method for surrogate computed tomography ventilation imaging (CTVI). Methods and Materials: The study used four-dimensional CT (4DCT) and single-photon emission computed tomography (SPECT) images and corresponding lung masks from 21 patients with lung cancer obtained from the Ventilation And Medical Pulmonary Image Registration Evaluation dataset. The lung volume of the exhale CT for each patient was segmented into hundreds of super-voxels using the Simple Linear Iterative Clustering (SLIC) method. These super-voxel segments were applied to the CT and SPECT images to calculate the mean density values (D _mean) and mean ventilation values (Vent _mean), respectively. The final CT-derived ventilation images were generated by interpolation from the D _mean values to yield CTVISVD. For the performance evaluation, the voxel- and region-wise differences between CTVISVD and SPECT were compared using Spearman's correlation and the Dice similarity coefficient index. Additionally, images were generated using two deformable image registration (DIR)-based methods, CTVIHU and CTVIJac, and compared with the SPECT images. Results: The correlation between the D _mean and Vent _mean of the super-voxel was 0.59 ± 0.09, representing a moderate-to-high correlation at the super-voxel level. In the voxel-wise evaluation, the CTVISVD method achieved a stronger average correlation (0.62 ± 0.10) with SPECT, which was significantly better than the correlations achieved with the CTVIHU (0.33 ± 0.14, p < 0.05) and CTVIJac (0.23 ± 0.11, p < 0.05) methods. For the region-wise evaluation, the Dice similarity coefficient of the high functional region for CTVISVD (0.63 ± 0.07) was significantly higher than the corresponding values for the CTVIHU (0.43 ± 0.08, p < 0.05) and CTVIJac (0.42 ± 0.05, p < 0.05) methods. Conclusion: The strong correlation between CTVISVD and SPECT demonstrates the potential usefulness of this novel method of ventilation estimation for surrogate ventilation imaging.

Volumetric multiphase ventilation imaging based on four-dimensional computed tomography for functional lung avoidance radiotherapy

PURPOSE

Current computed tomography (CT)-based lung ventilation imaging (CTVI) techniques derive a static ventilation image without temporal information. This research aims to develop a four-dimensional CT (4DCT)-based multiphase dynamic ventilation imaging framework capable of recovering the entire ventilation process throughout the breathing cycle for functional lung avoidance radiotherapy (FLART).

METHODS

A total of 15 free-breathing thoracic 4DCT scans of lung or esophageal cancer patients were collected from the public datasets. The lung region of each phase image was first delineated, and then the mask-free isotropic total variation image registration algorithm was used to derive the deformation vector fields between the end-expiration (EE) phase and other phases. As a surrogate of ventilation, the voxel-wise local expansion ratio of each phase relative to the EE phase was estimated using the parameterized Integrated Jacobian Formulation method in the EE phase coordinate. Lastly, the dynamic ventilation images were generated by warping these phase-specific local expansion distributions with a same geometry into their respective breathing phases. Quantitative analysis, including interphase Spearman correlation coefficients, voxel-wise, and regional-wise expansion/contraction tracking, were performed to indirectly validate the proposed method.

RESULTS

The proposed method maintains the physiological meaning of ventilation on each phase and enables to recover the dynamic lung ventilation process. The mean interphase Spearman correlations ranged between 0.23 ± 0.20 and 0.93 ± 0.04 and decreased near the EE phase. Only 26.2% (2.59E + 6 out of 9.89E + 6) of lung voxels exhibited the same expansion/contraction pattern as the global lung. Qualitative and quantitative evaluations of the interphase ventilation distribution difference show that ventilation spatiotemporal heterogeneities generally exist during respiration.

CONCLUSIONS

In contrast to conventional CTVI metrics, our method enables to extract additional phase-resolved respiration-correlated information and reflects the generally existed ventilation spatiotemporal heterogeneities. Subsequent studies with quantitative phase-by-phase cross-modality evaluations will further explore its potential to deepen our understanding of lung function and respiration mechanics and also to facilitate more accurate implementation of FLART.

Functional lung imaging in thoracic tumor radiotherapy: Application and progress

Radiotherapy plays an irreplaceable and unique role in treating thoracic tumors, but the occurrence of radiation-induced lung injury has limited the increase in tumor target doses and has influenced patients’ quality of life. However, the introduction of functional lung imaging has been incorporating functional lungs into radiotherapy planning. The design of the functional lung protection plan, while meeting the target dose requirements and dose limitations of the organs at risk (OARs), minimizes the radiation dose to the functional lung, thus reducing the occurrence of radiation-induced lung injury. In this manuscript, we mainly reviewed the lung ventilation or/and perfusion functional imaging modalities, application, and progress, as well as the results based on the functional lung protection planning in thoracic tumors. In addition, we also discussed the problems that should be explored and further studied in the practical application based on functional lung radiotherapy planning.

A deep learning method for translating 3D-CT to SPECT ventilation imaging: First comparison with 81m Kr-gas SPECT ventilation imaging

PURPOSE

This study aimed to evaluate the accuracy of deep learning (DL)-based computed tomography (CT) ventilation imaging (CTVI).

METHODS

A total of 71 cases who underwent single-photon emission CT ^81m Kr-gas ventilation (SPECT V) and CT imaging were included. Sixty cases were assigned to the training and validation sets and the remaining 11 cases were assigned to the test set. To directly transform 3DCT (free-breathing CT) images to SPECT V images, a DL-based model was implemented based on the U-Net architecture. The input and output data were 3DCT- and SPECT V-masked, respectively, except for whole-lung volumes. These data were rearranged in voxel size, registered rigidly, cropped, and normalized in pre-processing. In addition to a standard estimation method (i.e., without dropout during the estimation process), a Monte-Carlo Dropout (MCD) method (i.e., with dropout during the estimation process) was used to calculate prediction uncertainty. To evaluate the two models' (CTVI_{MCD U-Net} , CTVI_U-Net ) performance, we used five-fold cross-validation for the training and validation sets. To test the final model performances for both approaches, we applied the test set to each trained model and averaged the test prediction results from the five trained models to acquire the mean test result (bagging) for each approach. For the MCD method, the models were predicted repeatedly (sample size = 200), and the average and standard deviation maps were calculated in each voxel from the predicted results: the average maps were defined as test prediction results in each fold. As an evaluation index, the voxel-wise Spearman rank correlation coefficient (Spearman r_s ) and dice similarity coefficient (DSC) were calculated. The DSC was calculated for three functional regions (high, moderate, and low) separated by an almost equal volume. The coefficient of variation was defined as prediction uncertainty, and these average values were calculated within three functional regions. The Wilcoxon signed-rank test was used to test for a significant difference between the two DL-based approaches RESULTS: The average indexes with one standard deviation (1SD) between CTVI_{MCD U-Net} and SPECT V were 0.76 ± 0.06, 0.69 ± 0.07, 0.51 ± 0.06, and 0.75 ± 0.04 for Spearman r_s , DSC_high , DSC_moderate , and DSC_low , respectively. The average indexes with 1SD between CTVI_U-Net and SPECT V were 0.72 ± 0.05, 0.66 ± 0.04, 0.48 ± 0.04, and 0.74 ± 0.06 for Spearman r_s , DSC_high , DSC_moderate , and DSC_low , respectively. These indexes between CTVI_{MCD U-Net} and CTVI_U-Net showed no significance difference (Spearman r_s , p = 0.175; DSC_high , p = 0.123; DSC_moderate , p = 0.278; DSC_low , p = 0.520). The average coefficient of variations with 1SD were 0.27 ± 0.00, 0.27 ± 0.01, and 0.36 ± 0.03 for the high-, moderate-, and low-functional regions, respectively, and the low-functional region showed a tendency to exhibit larger uncertainties than the others.

CONCLUSION

We evaluated DL-based framework for estimating lung-functional ventilation images only from CT images. The results indicated that the DL-based approach could potentially be used for lung-ventilation estimation. This article is protected by copyright. All rights reserved.

Investigating the use of machine learning to generate ventilation images from CT scans

Background

Radiotherapy treatment planning incorporating ventilation imaging can reduce the incidence of radiation‐induced lung injury. The gold‐standard of ventilation imaging, using nuclear medicine, has limitations with respect to availability and cost.

Purpose

An alternative type of ventilation imaging to nuclear medicine uses 4DCT (or breath‐hold CT [BHCT] pair) with deformable image registration (DIR) and a ventilation metric to produce a CT ventilation image (CTVI). The purpose of this study is to investigate the application of machine learning as an alternative to DIR‐based methods when producing CTVIs.

Methods

A patient dataset of 15 inhale and exhale BHCTs and Galligas PET ventilation images were used to train and test a 2D U‐Net style convolutional neural network. The neural network established relationships between axial input BHCT image pairs and axial labeled Galligas PET images and was evaluated using eightfold cross‐validation. Once trained, the neural network could produce a CTVI from an input BHCT image pair. The CTVIs produced by the neural network were qualitatively assessed visually and quantitatively compared to a Galligas PET ventilation image using a Spearman correlation and Dice similarity coefficient (DSC). The DSC measured the spatial overlap between three segmented equal lung volumes by ventilation (high, medium, and low functioning lung [LFL]).

Results

The mean Spearman correlation between the CTVIs and the Galligas PET ventilation images was 0.58 ± 0.14. The mean DSC over high, medium, and LFL between the CTVIs and Galligas PET ventilation images was 0.55 ± 0.06. Visually, a systematic overprediction of ventilation within the lung was observed in the CTVIs with respect to the Galligas PET ventilation images, with jagged regions of ventilation in the sagittal and coronal planes.

Conclusions

A convolutional neural network was developed that could produce a CTVI from a BHCT image pair, which was then compared with a Galligas PET ventilation image. The performance of this machine learning method was comparable to previous benchmark studies investigating a DIR‐based CTVI, warranting future development, and investigation of applying machine learning to a CTVI.

Artificial intelligence in functional imaging of the lung

Artificial intelligence (AI) is transforming the way we perform advanced imaging. From high-resolution image reconstruction to predicting functional response from clinically acquired data, AI is promising to revolutionize clinical evaluation of lung performance, pushing the boundary in pulmonary functional imaging for patients suffering from respiratory conditions. In this review, we overview the current developments and expound on some of the encouraging new frontiers. We focus on the recent advances in machine learning and deep learning that enable reconstructing images, quantitating, and predicting functional responses of the lung. Finally, we shed light on the potential opportunities and challenges ahead in adopting AI for functional lung imaging in clinical settings.

Deep learning in structural and functional lung image analysis

The recent resurgence of deep learning (DL) has dramatically influenced the medical imaging field. Medical image analysis applications have been at the forefront of DL research efforts applied to multiple diseases and organs, including those of the lungs. The aims of this review are twofold: (i) to briefly overview DL theory as it relates to lung image analysis; (ii) to systematically review the DL research literature relating to the lung image analysis applications of segmentation, reconstruction, registration and synthesis. The review was conducted following the Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. 479 studies were initially identified from the literature search with 82 studies meeting the eligibility criteria. Segmentation was the most common lung image analysis DL application (65.9% of papers reviewed). DL has shown impressive results when applied to segmentation of the whole lung and other pulmonary structures. DL has also shown great potential for applications in image registration, reconstruction and synthesis. However, the majority of published studies have been limited to structural lung imaging with only 12.9% of reviewed studies employing functional lung imaging modalities, thus highlighting significant opportunities for further research in this field. Although the field of DL in lung image analysis is rapidly expanding, concerns over inconsistent validation and evaluation strategies, intersite generalisability, transparency of methodological detail and interpretability need to be addressed before widespread adoption in clinical lung imaging workflow.

Synthetic pulmonary perfusion images from 4DCT for functional avoidance using deep learning

Purpose.To develop and evaluate the performance of a deep learning model to generate synthetic pulmonary perfusion images from clinical 4DCT images for patients undergoing radiotherapy for lung cancer.Methods. A clinical data set of 58 pre- and post-radiotherapy^99mTc-labeled MAA-SPECT perfusion studies (32 patients) each with contemporaneous 4DCT studies was collected. Using the inhale and exhale phases of the 4DCT, a 3D-residual network was trained to create synthetic perfusion images utilizing the MAA-SPECT as ground truth. The training process was repeated for a 50-imaging study, five-fold validation with twenty model instances trained per fold. The highest performing model instance from each fold was selected for inference upon the eight-study test set. A manual lung segmentation was used to compute correlation metrics constrained to the voxels within the lungs. From the pre-treatment test cases (N = 5), 50th percentile contours of well-perfused lung were generated from both the clinical and synthetic perfusion images and the agreement was quantified.Results. Across the hold-out test set, our deep learning model predicted perfusion with a Spearman correlation coefficient of 0.70 (IQR: 0.61-0.76) and a Pearson correlation coefficient of 0.66 (IQR: 0.49-0.73). The agreement of the functional avoidance contour pairs was Dice of 0.803 (IQR: 0.750-0.810) and average surface distance of 5.92 mm (IQR: 5.68-7.55).Conclusion. We demonstrate that from 4DCT alone, a deep learning model can generate synthetic perfusion images with potential application in functional avoidance treatment planning.

Investigation of a Novel Deep Learning-Based Computed Tomography Perfusion Mapping Framework for Functional Lung Avoidance Radiotherapy

Functional lung avoidance radiation therapy aims to minimize dose delivery to the normal lung tissue while favoring dose deposition in the defective lung tissue based on the regional function information. However, the clinical acquisition of pulmonary functional images is resource-demanding, inconvenient, and technically challenging. This study aims to investigate the deep learning-based lung functional image synthesis from the CT domain. Forty-two pulmonary macro-aggregated albumin SPECT/CT perfusion scans were retrospectively collected from the hospital. A deep learning-based framework (including image preparation, image processing, and proposed convolutional neural network) was adopted to extract features from 3D CT images and synthesize perfusion as estimations of regional lung function. Ablation experiments were performed to assess the effects of each framework component by removing each element of the framework and analyzing the testing performances. Major results showed that the removal of the CT contrast enhancement component in the image processing resulted in the largest drop in framework performance, compared to the optimal performance (~12%). In the CNN part, all the three components (residual module, ROI attention, and skip attention) were approximately equally important to the framework performance; removing one of them resulted in a 3–5% decline in performance. The proposed CNN improved ~4% overall performance and ~350% computational efficiency, compared to the U-Net model. The deep convolutional neural network, in conjunction with image processing for feature enhancement, is capable of feature extraction from CT images for pulmonary perfusion synthesis. In the proposed framework, image processing, especially CT contrast enhancement, plays a crucial role in the perfusion synthesis. This CTPM framework provides insights for relevant research studies in the future and enables other researchers to leverage for the development of optimized CNN models for functional lung avoidance radiation therapy.

Technical Note: On the spatial correlation between robust CT-ventilation methods and SPECT ventilation

Purpose

The computed tomography (CT)‐derived ventilation imaging methodology employs deformable image registration (DIR) to recover respiratory motion‐induced volume changes from an inhale/exhale CT image pair, as a surrogate for ventilation. The Integrated Jacobian Formulation (IJF) and Mass Conserving Volume Change (MCVC) numerical methods for volume change estimation represent two classes of ventilation methods, namely transformation based and intensity (Hounsfield Unit) based, respectively. Both the IJF and MCVC methods utilize subregional volume change measurements that satisfy a specified uncertainty tolerance. In previous publications, the ventilation images resulting from this numerical strategy demonstrated robustness to DIR variations. However, the reduced measurement uncertainty comes at the expense of measurement resolution. The purpose of this study was to examine the spatial correlation between robust CT‐ventilation images and single photon emission CT‐ventilation (SPECT‐V).

Methods

Previously described implementations of IJF and MCVC require the solution of a large scale, constrained linear least squares problem defined by a series of robust subregional volume change measurements. We introduce a simpler parameterized implementation that reduces the number of unknowns while increasing the number of data points in the resulting least squares problem. A parameter sweep of the measurement uncertainty tolerance, τ, was conducted using the 4DCT and SPECT‐V images acquired for 15 non‐small cell lung cancer patients prior to radiotherapy. For each test case, MCVC and IJF CT‐ventilation images were created for 30 different uncertainty parameter values, uniformly sampled from the range 0.01,0.25. Voxel‐wise Spearman correlation between the SPECT‐V and the resulting CT‐ventilation images was computed.

Results

The median correlations between MCVC and SPECT‐V ranged from 0.20 to 0.48 across the parameter sweep, while the median correlations for IJF and SPECT‐V ranged between 0.79 and 0.82. For the optimal IJF tolerance τ=0.07, the IJF and SPECT‐V correlations across all 15 test cases ranged between 0.12 and 0.90. For the optimal MCVC tolerance τ=0.03, the MCVC and SPECT‐V correlations across all 15 test cases ranged between −0.06 and 0.84.

Conclusion

The reported correlations indicate that robust methods generate ventilation images that are spatially consistent with SPECT‐V, with the transformation‐based IJF method yielding higher correlations than those previously reported in the literature. For both methods, overall correlations were found to marginally vary for τ∈[0.03,0.15], indicating that the clinical utility of both methods is robust to both uncertainty tolerance and DIR solution.

A deep learning method for producing ventilation images from 4DCT: First comparison with technegas SPECT ventilation

PURPOSE

The purpose of this study is to develop a deep learning (DL) method for producing four-dimensional computed tomography (4DCT) ventilation imaging and to evaluate the accuracy of the DL-based ventilation imaging against single-photon emission-computed tomography (SPECT) ventilation imaging (SPECT-VI). The performance of the DL-based method is assessed by comparing with density change- and Jacobian-based (HU and JAC) methods.

MATERIALS AND METHODS

Fifty patients with esophagus or lung cancer who underwent thoracic radiotherapy were enrolled in this study. For each patient, 4DCT scans paired with 99mTc-Technegas SPECT/CT were acquired before the first radiotherapy treatment. 4DCT and SPECT/CT were first rigidly registered using MIMvista and converted to data matrix using MATLAB, and then transferred to a DL model based on U-net for correlating 4DCT features and SPECT-VI. Two forms of 4DCT dataset [(a) ten phases and (b) two phases of peak-exhalation and peak-inhalation] as input are studied. Tenfold cross-validation procedure was used to evaluate the performance of the DL model. For comparative evaluation, HU and JAC methodologies are used to calculate specific ventilation imaging based on 4DCT (CTVI) for each patient. The voxel-wise Spearman's correlation was evaluated over the whole lung between each of CTVI and corresponding SPECT-VI. The SPECT-VI and produced CTVIs were segmented into high, median, and low functional lung (HFL, MFL, and LFL) regions. The spatial overlap of corresponding HFL, MFL, and LFL for each CTVI against SPECT-VI was also evaluated using the dice similarity coefficient (DSC). The averaged DSC of functional lung regions was calculated and statistically analyzed with a one-factor ANONA model among different methods.

RESULTS

The voxel-wise Spearman r_s values were (0.22 ± 0.31), (-0.09 ± 0.18), and (0.73 ± 0.16)/(0.71 ± 0.17) for the CTVI_HU , CTVI_JAC , and CTVI_DL(1) /CTVI_DL(2) . These results showed the DL method yielded the strongest correlation with SPECT-VI. Using the DSC as the spatial overlap metric, we found that the CTVI_HU , CTVI_JAC , and CTVI_DL(1) /CTVI_DL(2) methods achieved averaged DSC values for all patients to be (0.45 ± 0.08), (0.33 ± 0.04), and (0.73 ± 0.09)/(0.71 ± 0.09), respectively. The results demonstrated that the DL method yielded the highest similarity with SPECT-VI with the prominently significant difference (P < 10^-7 ).

CONCLUSIONS

This study developed a DL method for producing CTVI and performed a validation against SPECT-VI. The results demonstrated that DL method can derive CTVI with greatly improved accuracy in comparison to HU and JAC methods. The produced ventilation images can be more accurate and useful for lung functional avoidance radiotherapy and treatment response modeling.

CT-based ventilation imaging in radiation oncology

A form of lung function imaging is emerging that uses phase-resolved four-dimensional CT (4DCT or breath-hold CT) images along with image processing techniques to generate lung function maps that provide a surrogate of lung ventilation. CT-based ventilation (referred to as CT-ventilation) research has gained momentum in Radiation Oncology because many lung cancer patients undergo four-dimensional CT simulation as part of the standard treatment planning process. Therefore, generating CT-ventilation images provides functional information without burdening the patient with an extra imaging procedure. CT-ventilation has progressed from an image processing calculation methodology, to validation efforts, to retrospective demonstration of clinical utility in Radiation Oncology. In particular, CT-ventilation has been proposed for two main clinical applications: functional avoidance radiation therapy and thoracic dose-response assessment. The idea of functional avoidance radiation therapy is to preferentially spare functional portions of the lung (as measured by CT-ventilation) during radiation therapy with the hypothesis that reducing dose to functional portions of the lung will lead to reduced rates of radiation-related thoracic toxicity. The idea of imaging-based dose-response assessment is to evaluate pre- to post-treatment CT-ventilation-based imaging changes. The hypothesis is that early, imaging-change-based response can be an early predictor of subsequent thoracic toxicity. Based on the retrospective evidence, the clinical applications of CT-ventilation have progressed from the retrospective setting to on-going prospective clinical trials. This review will cover basic CT-ventilation calculation methodologies, validation efforts, presentation of clinical applications, summarize on-going clinical trials, review potential uncertainties and shortcomings of CT-ventilation, and discuss future directions of CT-ventilation research.