Deriving Lung Perfusion Directly from CT Image Using Deep Convolutional Neural Network: A Preliminary Study

Volumetric multiphase ventilation imaging based on four-dimensional computed tomography for functional lung avoidance radiotherapy

PURPOSE

Current computed tomography (CT)-based lung ventilation imaging (CTVI) techniques derive a static ventilation image without temporal information. This research aims to develop a four-dimensional CT (4DCT)-based multiphase dynamic ventilation imaging framework capable of recovering the entire ventilation process throughout the breathing cycle for functional lung avoidance radiotherapy (FLART).

METHODS

A total of 15 free-breathing thoracic 4DCT scans of lung or esophageal cancer patients were collected from the public datasets. The lung region of each phase image was first delineated, and then the mask-free isotropic total variation image registration algorithm was used to derive the deformation vector fields between the end-expiration (EE) phase and other phases. As a surrogate of ventilation, the voxel-wise local expansion ratio of each phase relative to the EE phase was estimated using the parameterized Integrated Jacobian Formulation method in the EE phase coordinate. Lastly, the dynamic ventilation images were generated by warping these phase-specific local expansion distributions with a same geometry into their respective breathing phases. Quantitative analysis, including interphase Spearman correlation coefficients, voxel-wise, and regional-wise expansion/contraction tracking, were performed to indirectly validate the proposed method.

RESULTS

The proposed method maintains the physiological meaning of ventilation on each phase and enables to recover the dynamic lung ventilation process. The mean interphase Spearman correlations ranged between 0.23 ± 0.20 and 0.93 ± 0.04 and decreased near the EE phase. Only 26.2% (2.59E + 6 out of 9.89E + 6) of lung voxels exhibited the same expansion/contraction pattern as the global lung. Qualitative and quantitative evaluations of the interphase ventilation distribution difference show that ventilation spatiotemporal heterogeneities generally exist during respiration.

CONCLUSIONS

In contrast to conventional CTVI metrics, our method enables to extract additional phase-resolved respiration-correlated information and reflects the generally existed ventilation spatiotemporal heterogeneities. Subsequent studies with quantitative phase-by-phase cross-modality evaluations will further explore its potential to deepen our understanding of lung function and respiration mechanics and also to facilitate more accurate implementation of FLART.

A Transfer Learning Framework for Deep Learning-Based CT-to-Perfusion Mapping on Lung Cancer Patients

Purpose

Deep learning model has shown the feasibility of providing spatial lung perfusion information based on CT images. However, the performance of this method on lung cancer patients is yet to be investigated. This study aims to develop a transfer learning framework to evaluate the deep learning based CT-to-perfusion mapping method specifically on lung cancer patients.

Methods

SPECT/CT perfusion scans of 33 lung cancer patients and 137 non-cancer patients were retrospectively collected from two hospitals. To adapt the deep learning model on lung cancer patients, a transfer learning framework was developed to utilize the features learned from the non-cancer patients. These images were processed to extract features from three-dimensional CT images and synthesize the corresponding CT-based perfusion images. A pre-trained model was first developed using a dataset of patients with lung diseases other than lung cancer, and subsequently fine-tuned specifically on lung cancer patients under three-fold cross-validation. A multi-level evaluation was performed between the CT-based perfusion images and ground-truth SPECT perfusion images in aspects of voxel-wise correlation using Spearman’s correlation coefficient (R), function-wise similarity using Dice Similarity Coefficient (DSC), and lobe-wise agreement using mean perfusion value for each lobe of the lungs.

Results

The fine-tuned model yielded a high voxel-wise correlation (0.8142 ± 0.0669) and outperformed the pre-trained model by approximately 8%. Evaluation of function-wise similarity indicated an average DSC value of 0.8112 ± 0.0484 (range: 0.6460-0.8984) for high-functional lungs and 0.8137 ± 0.0414 (range: 0.6743-0.8902) for low-functional lungs. Among the 33 lung cancer patients, high DSC values of greater than 0.7 were achieved for high functional volumes in 32 patients and low functional volumes in all patients. The correlations of the mean perfusion value on the left upper lobe, left lower lobe, right upper lobe, right middle lobe, and right lower lobe were 0.7314, 0.7134, 0.5108, 0.4765, and 0.7618, respectively.

Conclusion

For lung cancer patients, the CT-based perfusion images synthesized by the transfer learning framework indicated a strong voxel-wise correlation and function-wise similarity with the SPECT perfusion images. This suggests the great potential of the deep learning method in providing regional-based functional information for functional lung avoidance radiation therapy.

Synthetic pulmonary perfusion images from 4DCT for functional avoidance using deep learning

Purpose.To develop and evaluate the performance of a deep learning model to generate synthetic pulmonary perfusion images from clinical 4DCT images for patients undergoing radiotherapy for lung cancer.Methods. A clinical data set of 58 pre- and post-radiotherapy^99mTc-labeled MAA-SPECT perfusion studies (32 patients) each with contemporaneous 4DCT studies was collected. Using the inhale and exhale phases of the 4DCT, a 3D-residual network was trained to create synthetic perfusion images utilizing the MAA-SPECT as ground truth. The training process was repeated for a 50-imaging study, five-fold validation with twenty model instances trained per fold. The highest performing model instance from each fold was selected for inference upon the eight-study test set. A manual lung segmentation was used to compute correlation metrics constrained to the voxels within the lungs. From the pre-treatment test cases (N = 5), 50th percentile contours of well-perfused lung were generated from both the clinical and synthetic perfusion images and the agreement was quantified.Results. Across the hold-out test set, our deep learning model predicted perfusion with a Spearman correlation coefficient of 0.70 (IQR: 0.61-0.76) and a Pearson correlation coefficient of 0.66 (IQR: 0.49-0.73). The agreement of the functional avoidance contour pairs was Dice of 0.803 (IQR: 0.750-0.810) and average surface distance of 5.92 mm (IQR: 5.68-7.55).Conclusion. We demonstrate that from 4DCT alone, a deep learning model can generate synthetic perfusion images with potential application in functional avoidance treatment planning.

Investigation of a Novel Deep Learning-Based Computed Tomography Perfusion Mapping Framework for Functional Lung Avoidance Radiotherapy

Functional lung avoidance radiation therapy aims to minimize dose delivery to the normal lung tissue while favoring dose deposition in the defective lung tissue based on the regional function information. However, the clinical acquisition of pulmonary functional images is resource-demanding, inconvenient, and technically challenging. This study aims to investigate the deep learning-based lung functional image synthesis from the CT domain. Forty-two pulmonary macro-aggregated albumin SPECT/CT perfusion scans were retrospectively collected from the hospital. A deep learning-based framework (including image preparation, image processing, and proposed convolutional neural network) was adopted to extract features from 3D CT images and synthesize perfusion as estimations of regional lung function. Ablation experiments were performed to assess the effects of each framework component by removing each element of the framework and analyzing the testing performances. Major results showed that the removal of the CT contrast enhancement component in the image processing resulted in the largest drop in framework performance, compared to the optimal performance (~12%). In the CNN part, all the three components (residual module, ROI attention, and skip attention) were approximately equally important to the framework performance; removing one of them resulted in a 3–5% decline in performance. The proposed CNN improved ~4% overall performance and ~350% computational efficiency, compared to the U-Net model. The deep convolutional neural network, in conjunction with image processing for feature enhancement, is capable of feature extraction from CT images for pulmonary perfusion synthesis. In the proposed framework, image processing, especially CT contrast enhancement, plays a crucial role in the perfusion synthesis. This CTPM framework provides insights for relevant research studies in the future and enables other researchers to leverage for the development of optimized CNN models for functional lung avoidance radiation therapy.