1
|
Stavropoulou A, Szmul A, Chandy E, Veiga C, Landau D, McClelland JR. A multichannel feature-based approach for longitudinal lung CT registration in the presence of radiation induced lung damage. Phys Med Biol 2021; 66:175020. [PMID: 34352743 PMCID: PMC8395598 DOI: 10.1088/1361-6560/ac1b1d] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2021] [Revised: 08/02/2021] [Accepted: 08/05/2021] [Indexed: 11/17/2022]
Abstract
Quantifying parenchymal tissue changes in the lungs is imperative in furthering the study of radiation induced lung damage (RILD). Registering lung images from different time-points is a key step of this process. Traditional intensity-based registration approaches fail this task due to the considerable anatomical changes that occur between timepoints. This work proposes a novel method to successfully register longitudinal pre- and post-radiotherapy (RT) lung computed tomography (CT) scans that exhibit large changes due to RILD, by extracting consistent anatomical features from CT (lung boundaries, main airways, vessels) and using these features to optimise the registrations. Pre-RT and 12 month post-RT CT pairs from fifteen lung cancer patients were used for this study, all with varying degrees of RILD, ranging from mild parenchymal change to extensive consolidation and collapse. For each CT, signed distance transforms from segmentations of the lungs and main airways were generated, and the Frangi vesselness map was calculated. These were concatenated into multi-channel images and diffeomorphic multichannel registration was performed for each image pair using NiftyReg. Traditional intensity-based registrations were also performed for comparison purposes. For the evaluation, the pre- and post-registration landmark distance was calculated for all patients, using an average of 44 manually identified landmark pairs per patient. The mean (standard deviation) distance for all datasets decreased from 15.95 (8.09) mm pre-registration to 4.56 (5.70) mm post-registration, compared to 7.90 (8.97) mm for the intensity-based registrations. Qualitative improvements in image alignment were observed for all patient datasets. For four representative subjects, registrations were performed for three additional follow-up timepoints up to 48 months post-RT and similar accuracy was achieved. We have demonstrated that our novel multichannel registration method can successfully align longitudinal scans from RILD patients in the presence of large anatomical changes such as consolidation and atelectasis, outperforming the traditional registration approach both quantitatively and through thorough visual inspection.
Collapse
Affiliation(s)
- A Stavropoulou
- Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, United Kingdom
| | - A Szmul
- Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, United Kingdom
| | - E Chandy
- Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, United Kingdom
- University College Hospital London, United Kingdom
| | - C Veiga
- Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, United Kingdom
| | - D Landau
- University College Hospital London, United Kingdom
| | - J R McClelland
- Centre for Medical Image Computing, Department of Medical Physics and Biomedical Engineering, University College London, United Kingdom
| |
Collapse
|
2
|
Weinheimer O, Hoff BA, Fortuna AB, Fernández-Baldera A, Konietzke P, Wielpütz MO, Robinson TE, Galbán CJ. Influence of Inspiratory/Expiratory CT Registration on Quantitative Air Trapping. Acad Radiol 2019; 26:1202-1214. [PMID: 30545681 DOI: 10.1016/j.acra.2018.11.001] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2018] [Revised: 10/25/2018] [Accepted: 11/03/2018] [Indexed: 12/21/2022]
Abstract
RATIONALE AND OBJECTIVES The aim of this study was to assess variability in quantitative air trapping (QAT) measurements derived from spatially aligned expiration CT scans. MATERIALS AND METHODS Sixty-four paired CT examinations, from 16 school-age cystic fibrosis subjects examined at four separate time intervals, were used in this study. For each pair, visually inspected lobe segmentation maps were generated and expiration CT data were registered to the inspiration CT frame. Measurements of QAT, the percentage of voxels on the expiration CT scan below a set threshold were calculated for each lobe and whole-lung from the registered expiration CT and compared to the true values from the unregistered data. RESULTS A mathematical model, which simulates the effect of variable regions of lung deformation on QAT values calculated from aligned to those from unaligned data, showed the potential for large bias. Assessment of experimental QAT measurements using Bland-Altman plots corroborated the model simulations, demonstrating biases greater than 5% when QAT was approximately 40% of lung volume. These biases were removed when calculating QAT from aligned expiration CT data using the determinant of the Jacobian matrix. We found, by Dice coefficient analysis, good agreement between aligned expiration and inspiration segmentation maps for the whole-lung and all but one lobe (Dice coefficient > 0.9), with only the lingula generating a value below 0.9 (mean and standard deviation of 0.85 ± 0.06). CONCLUSION The subtle and predictable variability in corrected QAT observed in this study suggests that image registration is reliable in preserving the accuracy of the quantitative metrics.
Collapse
Affiliation(s)
- Oliver Weinheimer
- Department of Diagnostic and Interventional Radiology, University Hospital of Heidelberg, 69120 Heidelberg, Germany; Translational Lung Research Center, Heidelberg (TLRC), German Lung Research Center (DZL), 69120 Heidelberg, Germany
| | - Benjamin A Hoff
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109
| | - Aleksa B Fortuna
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109
| | | | - Philip Konietzke
- Department of Diagnostic and Interventional Radiology, University Hospital of Heidelberg, 69120 Heidelberg, Germany; Translational Lung Research Center, Heidelberg (TLRC), German Lung Research Center (DZL), 69120 Heidelberg, Germany
| | - Mark O Wielpütz
- Department of Diagnostic and Interventional Radiology, University Hospital of Heidelberg, 69120 Heidelberg, Germany; Translational Lung Research Center, Heidelberg (TLRC), German Lung Research Center (DZL), 69120 Heidelberg, Germany
| | - Terry E Robinson
- Center of Excellence in Pulmonary Biology, Department of Pediatrics, Stanford University School of Medicine, Stanford, CA 94304
| | - Craig J Galbán
- Department of Radiology, University of Michigan, Ann Arbor, MI 48109.
| |
Collapse
|
3
|
King M, Sensakovic WF, Maxim P, Diehn M, Loo BW, Xing L. Line-Enhanced Deformable Registration of Pulmonary Computed Tomography Images Before and After Radiation Therapy With Radiation-Induced Fibrosis. Technol Cancer Res Treat 2019; 17:1533034617749419. [PMID: 29343206 PMCID: PMC5784562 DOI: 10.1177/1533034617749419] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Purpose: The deformable registration of pulmonary computed tomography images before and after radiation therapy is challenging due to anatomic changes from radiation fibrosis. We hypothesize that a line-enhanced registration algorithm can reduce landmark error over the entire lung, including the irradiated regions, when compared to an intensity-based deformable registration algorithm. Materials: Two intensity-based B-spline deformable registration algorithms of pre-radiation therapy and post-radiation therapy images were compared. The first was a control intensity–based algorithm that utilized computed tomography images without modification. The second was a line enhancement algorithm that incorporated a Hessian-based line enhancement filter prior to deformable image registration. Registrations were evaluated based on the landmark error between user-identified landmark pairs and the overlap ratio. Results: Twenty-one patients with pre-radiation therapy and post-radiation therapy scans were included. The median time interval between scans was 1.2 years (range: 0.3-3.3 years). Median landmark errors for the line enhancement algorithm were significantly lower than those for the control algorithm over the entire lung (1.67 vs 1.83 mm; P < .01), as well as within the 0 to 5 Gy (1.40 vs 1.57; P < .01) and >5 Gy (2.25 vs 3.31; P < .01) dose intervals. The median lung mask overlap ratio for the line enhancement algorithm (96.2%) was greater than that for the control algorithm (95.8%; P < .01). Landmark error within the >5 Gy dose interval demonstrated a significant inverse relationship with post-radiation therapy fibrosis enhancement after line enhancement filtration (Pearson correlation coefficient = −0.48; P = .03). Conclusion: The line enhancement registration algorithm is a promising method for registering images before and after radiation therapy.
Collapse
Affiliation(s)
- Martin King
- 1 Department of Radiation Oncology, Stanford University School of Medicine, Stanford, CA, USA
| | | | - Peter Maxim
- 1 Department of Radiation Oncology, Stanford University School of Medicine, Stanford, CA, USA
| | - Maximilian Diehn
- 1 Department of Radiation Oncology, Stanford University School of Medicine, Stanford, CA, USA
| | - Billy W Loo
- 1 Department of Radiation Oncology, Stanford University School of Medicine, Stanford, CA, USA
| | - Lei Xing
- 1 Department of Radiation Oncology, Stanford University School of Medicine, Stanford, CA, USA
| |
Collapse
|
4
|
Sarrut D, Baudier T, Ayadi M, Tanguy R, Rit S. Deformable image registration applied to lung SBRT: Usefulness and limitations. Phys Med 2017; 44:108-112. [PMID: 28947188 DOI: 10.1016/j.ejmp.2017.09.121] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/10/2016] [Revised: 08/21/2017] [Accepted: 09/09/2017] [Indexed: 11/30/2022] Open
Abstract
Radiation therapy (RT) of the lung requires deformation analysis. Deformable image registration (DIR) is the fundamental method to quantify deformations for various applications: motion compensation, contour propagation, dose accumulation, etc. DIR is therefore unavoidable in lung RT. DIR algorithms have been studied for decades and are now available both within commercial and academic packages. However, they are complex and have limitations that every user must be aware of before clinical implementation. In this paper, the main applications of DIR for lung RT with their associated uncertainties and their limitations are reviewed.
Collapse
Affiliation(s)
- David Sarrut
- Univ Lyon, INSA-Lyon, Université Lyon 1, CNRS, Inserm, Centre Léon Bérard, CREATIS UMR 5220, U1206, F-69373 Lyon, France; Univ Lyon, Centre Léon Bérard, F-69373 Lyon, France.
| | - Thomas Baudier
- Univ Lyon, INSA-Lyon, Université Lyon 1, CNRS, Inserm, Centre Léon Bérard, CREATIS UMR 5220, U1206, F-69373 Lyon, France; Univ Lyon, Centre Léon Bérard, F-69373 Lyon, France
| | - Myriam Ayadi
- Univ Lyon, Centre Léon Bérard, F-69373 Lyon, France
| | - Ronan Tanguy
- Univ Lyon, Centre Léon Bérard, F-69373 Lyon, France
| | - Simon Rit
- Univ Lyon, INSA-Lyon, Université Lyon 1, CNRS, Inserm, Centre Léon Bérard, CREATIS UMR 5220, U1206, F-69373 Lyon, France
| |
Collapse
|
5
|
Belharbi S, Chatelain C, Hérault R, Adam S, Thureau S, Chastan M, Modzelewski R. Spotting L3 slice in CT scans using deep convolutional network and transfer learning. Comput Biol Med 2017; 87:95-103. [PMID: 28558319 DOI: 10.1016/j.compbiomed.2017.05.018] [Citation(s) in RCA: 30] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2017] [Revised: 05/15/2017] [Accepted: 05/17/2017] [Indexed: 11/16/2022]
Abstract
In this article, we present a complete automated system for spotting a particular slice in a complete 3D Computed Tomography exam (CT scan). Our approach does not require any assumptions on which part of the patient's body is covered by the scan. It relies on an original machine learning regression approach. Our models are learned using the transfer learning trick by exploiting deep architectures that have been pre-trained on imageNet database, and therefore it requires very little annotation for its training. The whole pipeline consists of three steps: i) conversion of the CT scans into Maximum Intensity Projection (MIP) images, ii) prediction from a Convolutional Neural Network (CNN) applied in a sliding window fashion over the MIP image, and iii) robust analysis of the prediction sequence to predict the height of the desired slice within the whole CT scan. Our approach is applied to the detection of the third lumbar vertebra (L3) slice that has been found to be representative to the whole body composition. Our system is evaluated on a database collected in our clinical center, containing 642 CT scans from different patients. We obtained an average localization error of 1.91±2.69 slices (less than 5 mm) in an average time of less than 2.5 s/CT scan, allowing integration of the proposed system into daily clinical routines.
Collapse
Affiliation(s)
- Soufiane Belharbi
- Normandie Univ, UNIROUEN, UNIHAVRE, INSA Rouen, LITIS, 76000, Rouen, France
| | - Clément Chatelain
- Normandie Univ, UNIROUEN, UNIHAVRE, INSA Rouen, LITIS, 76000, Rouen, France
| | - Romain Hérault
- Normandie Univ, UNIROUEN, UNIHAVRE, INSA Rouen, LITIS, 76000, Rouen, France
| | - Sébastien Adam
- Normandie Univ, UNIROUEN, UNIHAVRE, INSA Rouen, LITIS, 76000, Rouen, France.
| | - Sébastien Thureau
- Henri Becquerel Center, Department of Radiotherapy, 76000, Rouen, France; Normandie Univ, UNIROUEN, UNIHAVRE, INSA Rouen, LITIS, 76000, Rouen, France
| | - Mathieu Chastan
- Henri Becquerel Center, Department of Nuclear Medicine, 76000, Rouen, France
| | - Romain Modzelewski
- Normandie Univ, UNIROUEN, UNIHAVRE, INSA Rouen, LITIS, 76000, Rouen, France; Henri Becquerel Center, Department of Nuclear Medicine, 76000, Rouen, France
| |
Collapse
|
6
|
König L, Derksen A, Papenberg N, Haas B. Deformable image registration for adaptive radiotherapy with guaranteed local rigidity constraints. Radiat Oncol 2016; 11:122. [PMID: 27647456 PMCID: PMC5029058 DOI: 10.1186/s13014-016-0697-4] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/13/2016] [Accepted: 09/09/2016] [Indexed: 11/29/2022] Open
Abstract
Background Deformable image registration (DIR) is a key component in many radiotherapy applications. However, often resulting deformations are not satisfying, since varying deformation properties of different anatomical regions are not considered. To improve the plausibility of DIR in adaptive radiotherapy in the male pelvic area, this work integrates a local rigidity deformation model into a DIR algorithm. Methods A DIR framework is extended by constraints, enforcing locally rigid deformation behavior for arbitrary delineated structures. The approach restricts those structures to rigid deformations, while surrounding tissue is still allowed to deform elastically. The algorithm is tested on ten CT/CBCT male pelvis datasets with active rigidity constraints on bones and prostate and compared to the Varian SmartAdapt deformable registration (VSA) on delineations of bladder, prostate and bones. Results The approach with no rigid structures (REG0) obtains an average dice similarity coefficient (DSC) of 0.87 ± 0.06 and a Hausdorff-Distance (HD) of 8.74 ± 5.95 mm. The new approach with rigid bones (REG1) yields a DSC of 0.87 ± 0.07, HD 8.91 ± 5.89 mm. Rigid deformation of bones and prostate (REG2) obtains 0.87 ± 0.06, HD 8.73 ± 6.01 mm, while VSA yields a DSC of 0.86 ± 0.07, HD 10.22 ± 6.62 mm. No deformation grid foldings are observed for REG0 and REG1 in 7 of 10 cases; for REG2 in 8 of 10 cases, with no grid foldings in prostate, an average of 0.08 % in bladder (REG2: no foldings) and 0.01 % inside the body contour. VSA exhibits grid foldings in each case, with an average percentage of 1.81 % for prostate, 1.74 % for bladder and 0.12 % for the body contour. While REG1 and REG2 keep bones rigid, elastic bone deformations are observed with REG0 and VSA. An average runtime of 26.2 s was achieved with REG1; 31.1 s with REG2, compared to 10.5 s with REG0 and 10.7 s with VMS. Conclusions With accuracy in the range of VSA, the new approach with constraints delivers physically more plausible deformations in the pelvic area with guaranteed rigidity of arbitrary structures. Although the algorithm uses an advanced deformation model, clinically feasible runtimes are achieved. Electronic supplementary material The online version of this article (doi:10.1186/s13014-016-0697-4) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Lars König
- Fraunhofer MEVIS, Maria-Goeppert-Str. 3, Lübeck, 23562, Germany.
| | | | - Nils Papenberg
- Fraunhofer MEVIS, Maria-Goeppert-Str. 3, Lübeck, 23562, Germany
| | - Benjamin Haas
- Varian Medical Systems, Imaging Laboratory GmbH, Täfernstr. 7, Baden, 5405, Switzerland
| |
Collapse
|
7
|
Cunliffe AR, Armato SG, Straus C, Malik R, Al-Hallaq HA. Lung texture in serial thoracic CT scans: correlation with radiologist-defined severity of acute changes following radiation therapy. Phys Med Biol 2014; 59:5387-98. [PMID: 25157625 DOI: 10.1088/0031-9155/59/18/5387] [Citation(s) in RCA: 21] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/25/2022]
Abstract
This study examines the correlation between the radiologist-defined severity of normal tissue damage following radiation therapy (RT) for lung cancer treatment and a set of mathematical descriptors of computed tomography (CT) scan texture ('texture features'). A pre-therapy CT scan and a post-therapy CT scan were retrospectively collected under IRB approval for each of the 25 patients who underwent definitive RT (median dose: 66 Gy). Sixty regions of interest (ROIs) were automatically identified in the non-cancerous lung tissue of each post-therapy scan. A radiologist compared post-therapy scan ROIs with pre-therapy scans and categorized each as containing no abnormality, mild abnormality, moderate abnormality, or severe abnormality. Twenty texture features that characterize gray-level intensity, region morphology, and gray-level distribution were calculated in post-therapy scan ROIs and compared with anatomically matched ROIs in the pre-therapy scan. Linear regression and receiver operating characteristic (ROC) analysis were used to compare the percent feature value change (ΔFV) between ROIs at each category of visible radiation damage. Most ROIs contained no (65%) or mild abnormality (30%). ROIs with moderate (3%) or severe (2%) abnormalities were observed in 9 patients. For 19 of 20 features, ΔFV was significantly different among severity levels. For 12 features, significant differences were observed at every level. Compared with regions with no abnormalities, ΔFV for these 12 features increased, on average, by 1.5%, 12%, and 30%, respectively, for mild, moderate, and severe abnormalitites. Area under the ROC curve was largest when comparing ΔFV in the highest severity level with the remaining three categories (mean AUC across features: 0.84). In conclusion, 19 features that characterized the severity of radiologic changes from pre-therapy scans were identified. These features may be used in future studies to quantify acute normal lung tissue damage following RT.
Collapse
Affiliation(s)
- Alexandra R Cunliffe
- Department of Radiology, The University of Chicago, 5841 S. Maryland Ave., MC2026, Chicago, IL 60637
| | | | | | | | | |
Collapse
|