1
|
Shao HC, Mengke T, Pan T, Zhang Y. Dynamic CBCT imaging using prior model-free spatiotemporal implicit neural representation (PMF-STINR). Phys Med Biol 2024; 69:115030. [PMID: 38697195 PMCID: PMC11133878 DOI: 10.1088/1361-6560/ad46dc] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/01/2023] [Revised: 04/12/2024] [Accepted: 05/01/2024] [Indexed: 05/04/2024]
Abstract
Objective. Dynamic cone-beam computed tomography (CBCT) can capture high-spatial-resolution, time-varying images for motion monitoring, patient setup, and adaptive planning of radiotherapy. However, dynamic CBCT reconstruction is an extremely ill-posed spatiotemporal inverse problem, as each CBCT volume in the dynamic sequence is only captured by one or a few x-ray projections, due to the slow gantry rotation speed and the fast anatomical motion (e.g. breathing).Approach. We developed a machine learning-based technique, prior-model-free spatiotemporal implicit neural representation (PMF-STINR), to reconstruct dynamic CBCTs from sequentially acquired x-ray projections. PMF-STINR employs a joint image reconstruction and registration approach to address the under-sampling challenge, enabling dynamic CBCT reconstruction from singular x-ray projections. Specifically, PMF-STINR uses spatial implicit neural representations to reconstruct a reference CBCT volume, and it applies temporal INR to represent the intra-scan dynamic motion of the reference CBCT to yield dynamic CBCTs. PMF-STINR couples the temporal INR with a learning-based B-spline motion model to capture time-varying deformable motion during the reconstruction. Compared with the previous methods, the spatial INR, the temporal INR, and the B-spline model of PMF-STINR are all learned on the fly during reconstruction in a one-shot fashion, without using any patient-specific prior knowledge or motion sorting/binning.Main results. PMF-STINR was evaluated via digital phantom simulations, physical phantom measurements, and a multi-institutional patient dataset featuring various imaging protocols (half-fan/full-fan, full sampling/sparse sampling, different energy and mAs settings, etc). The results showed that the one-shot learning-based PMF-STINR can accurately and robustly reconstruct dynamic CBCTs and capture highly irregular motion with high temporal (∼ 0.1 s) resolution and sub-millimeter accuracy.Significance. PMF-STINR can reconstruct dynamic CBCTs and solve the intra-scan motion from conventional 3D CBCT scans without using any prior anatomical/motion model or motion sorting/binning. It can be a promising tool for motion management by offering richer motion information than traditional 4D-CBCTs.
Collapse
Affiliation(s)
- Hua-Chieh Shao
- The Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX 75390, United States of America
| | - Tielige Mengke
- The Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX 75390, United States of America
| | - Tinsu Pan
- Department of Imaging Physics, University of Texas MD Anderson Cancer Center, Houston, TX, 77030, United States of America
| | - You Zhang
- The Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, University of Texas Southwestern Medical Center, Dallas, TX 75390, United States of America
| |
Collapse
|
2
|
Lauria M, Miller C, Singhrao K, Lewis J, Lin W, O'Connell D, Naumann L, Stiehl B, Santhanam A, Boyle P, Raldow AC, Goldin J, Barjaktarevic I, Low DA. Motion compensated cone-beam CT reconstruction using an a priorimotion model from CT simulation: a pilot study. Phys Med Biol 2024; 69:075022. [PMID: 38452385 DOI: 10.1088/1361-6560/ad311b] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Accepted: 03/07/2024] [Indexed: 03/09/2024]
Abstract
Objective. To combat the motion artifacts present in traditional 4D-CBCT reconstruction, an iterative technique known as the motion-compensated simultaneous algebraic reconstruction technique (MC-SART) was previously developed. MC-SART employs a 4D-CBCT reconstruction to obtain an initial model, which suffers from a lack of sufficient projections in each bin. The purpose of this study is to demonstrate the feasibility of introducing a motion model acquired during CT simulation to MC-SART, coined model-based CBCT (MB-CBCT).Approach. For each of 5 patients, we acquired 5DCTs during simulation and pre-treatment CBCTs with a simultaneous breathing surrogate. We cross-calibrated the 5DCT and CBCT breathing waveforms by matching the diaphragms and employed the 5DCT motion model parameters for MC-SART. We introduced the Amplitude Reassignment Motion Modeling technique, which measures the ability of the model to control diaphragm sharpness by reassigning projection amplitudes with varying resolution. We evaluated the sharpness of tumors and compared them between MB-CBCT and 4D-CBCT. We quantified sharpness by fitting an error function across anatomical boundaries. Furthermore, we compared our MB-CBCT approach to the traditional MC-SART approach. We evaluated MB-CBCT's robustness over time by reconstructing multiple fractions for each patient and measuring consistency in tumor centroid locations between 4D-CBCT and MB-CBCT.Main results. We found that the diaphragm sharpness rose consistently with increasing amplitude resolution for 4/5 patients. We observed consistently high image quality across multiple fractions, and observed stable tumor centroids with an average 0.74 ± 0.31 mm difference between the 4D-CBCT and MB-CBCT. Overall, vast improvements over 3D-CBCT and 4D-CBCT were demonstrated by our MB-CBCT technique in terms of both diaphragm sharpness and overall image quality.Significance. This work is an important extension of the MC-SART technique. We demonstrated the ability ofa priori5DCT models to provide motion compensation for CBCT reconstruction. We showed improvements in image quality over both 4D-CBCT and the traditional MC-SART approach.
Collapse
Affiliation(s)
- Michael Lauria
- UCLA, Department of Radiation Oncology, Los Angeles, CA, United States of America
| | - Claudia Miller
- UCLA, Department of Radiation Oncology, Los Angeles, CA, United States of America
| | - Kamal Singhrao
- Brigham and Women's Hospital, Dana Farber Cancer Institute and Harvard Medical School, Department of Radiation Oncology, Boston, MA, United States of America
| | - John Lewis
- Cedars-Sinai Medical Center, Department of Radiation Oncology, Los Angeles, CA, United States of America
| | - Weicheng Lin
- UCLA, Department of Radiation Oncology, Los Angeles, CA, United States of America
| | - Dylan O'Connell
- UCLA, Department of Radiation Oncology, Los Angeles, CA, United States of America
| | - Louise Naumann
- UCLA, Department of Radiation Oncology, Los Angeles, CA, United States of America
| | - Bradley Stiehl
- Cedars-Sinai Medical Center, Department of Radiation Oncology, Los Angeles, CA, United States of America
| | - Anand Santhanam
- UCLA, Department of Radiation Oncology, Los Angeles, CA, United States of America
| | - Peter Boyle
- UCLA, Department of Radiation Oncology, Los Angeles, CA, United States of America
| | - Ann C Raldow
- UCLA, Department of Radiation Oncology, Los Angeles, CA, United States of America
| | - Jonathan Goldin
- UCLA, Department of Radiological Sciences, Los Angeles, CA, United States of America
| | - Igor Barjaktarevic
- UCLA, Department of Pulmonary and Critical Care Medicine, Los Angeles, CA, United States of America
| | - Daniel A Low
- UCLA, Department of Radiation Oncology, Los Angeles, CA, United States of America
| |
Collapse
|
3
|
Huang Y, Thielemans K, Price G, McClelland JR. Surrogate-driven respiratory motion model for projection-resolved motion estimation and motion compensated cone-beam CT reconstruction from unsorted projection data. Phys Med Biol 2024; 69:025020. [PMID: 38091611 PMCID: PMC10791594 DOI: 10.1088/1361-6560/ad1546] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/07/2023] [Revised: 11/23/2023] [Accepted: 12/13/2023] [Indexed: 01/18/2024]
Abstract
Objective.As the most common solution to motion artefact for cone-beam CT (CBCT) in radiotherapy, 4DCBCT suffers from long acquisition time and phase sorting error. This issue could be addressed if the motion at each projection could be known, which is a severely ill-posed problem. This study aims to obtain the motion at each time point and motion-free image simultaneously from unsorted projection data of a standard 3DCBCT scan.Approach.Respiration surrogate signals were extracted by the Intensity Analysis method. A general framework was then deployed to fit a surrogate-driven motion model that characterized the relation between the motion and surrogate signals at each time point. Motion model fitting and motion compensated reconstruction were alternatively and iteratively performed. Stochastic subset gradient based method was used to significantly reduce the computation time. The performance of our method was comprehensively evaluated through digital phantom simulation and also validated on clinical scans from six patients.Results.For digital phantom experiments, motion models fitted with ground-truth or extracted surrogate signals both achieved a much lower motion estimation error and higher image quality, compared with non motion-compensated results.For the public SPARE Challenge datasets, more clear lung tissues and less blurry diaphragm could be seen in the motion compensated reconstruction, comparable to the benchmark 4DCBCT images but with a higher temporal resolution. Similar results were observed for two real clinical 3DCBCT scans.Significance.The motion compensated reconstructions and motion models produced by our method will have direct clinical benefit by providing more accurate estimates of the delivered dose and ultimately facilitating more accurate radiotherapy treatments for lung cancer patients.
Collapse
Affiliation(s)
- Yuliang Huang
- Centre for Medical Image Computing, University College London, London, United Kingdom
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, United Kingdom
| | - Kris Thielemans
- Centre for Medical Image Computing, University College London, London, United Kingdom
- Institute of Nuclear Medicine, University College London, London, United Kingdom
| | - Gareth Price
- Christie NHS Foundation Trust, Manchester, United Kingdom
| | - Jamie R McClelland
- Centre for Medical Image Computing, University College London, London, United Kingdom
- Wellcome/EPSRC Centre for Interventional and Surgical Sciences, University College London, London, United Kingdom
| |
Collapse
|
4
|
Ge T, Liao R, Medrano M, Politte DG, Whiting BR, Williamson JF, O’Sullivan JA. Motion-compensated scheme for sequential scanned statistical iterative dual-energy CT reconstruction. Phys Med Biol 2023; 68:145002. [PMID: 37327796 PMCID: PMC10482127 DOI: 10.1088/1361-6560/acdf38] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Revised: 06/07/2023] [Accepted: 06/16/2023] [Indexed: 06/18/2023]
Abstract
Objective.Dual-energy computed tomography (DECT) has been widely used to reconstruct numerous types of images due its ability to better discriminate tissue properties. Sequential scanning is a popular dual-energy data acquisition method as it requires no specialized hardware. However, patient motion between two sequential scans may lead to severe motion artifacts in DECT statistical iterative reconstructions (SIR) images. The objective is to reduce the motion artifacts in such reconstructions.Approach.We propose a motion-compensation scheme that incorporates a deformation vector field into any DECT SIR. The deformation vector field is estimated via the multi-modality symmetric deformable registration method. The precalculated registration mapping and its inverse or adjoint are then embedded into each iteration of the iterative DECT algorithm.Main results.Results from a simulated and clinical case show that the proposed framework is capable of reducing motion artifacts in DECT SIRs. Percentage mean square errors in regions of interest in the simulated and clinical cases were reduced from 4.6% to 0.5% and 6.8% to 0.8%, respectively. A perturbation analysis was then performed to determine errors in approximating the continuous deformation by using the deformation field and interpolation. Our findings show that errors in our method are mostly propagated through the target image and amplified by the inverse matrix of the combination of the Fisher information and Hessian of the penalty term.Significance.We have proposed a novel motion-compensation scheme to incorporate a 3D registration method into the joint statistical iterative DECT algorithm in order to reduce motion artifacts caused by inter-scan motion, and successfully demonstrate that interscan motion corrections can be integrated into the DECT SIR process, enabling accurate imaging of radiological quantities on conventional SECT scanners, without significant loss of either computational efficiency or accuracy.
Collapse
Affiliation(s)
- Tao Ge
- Washington University in St. Louis,
Saint Louis, MO, 63130, United States of America
| | - Rui Liao
- Washington University in St. Louis,
Saint Louis, MO, 63130, United States of America
| | - Maria Medrano
- Washington University in St. Louis,
Saint Louis, MO, 63130, United States of America
| | - David G Politte
- Washington University in St. Louis,
Saint Louis, MO, 63130, United States of America
| | - Bruce R Whiting
- University of Pittsburgh, Pittsburgh,
PA, 15260, United States of America
| | - Jeffrey F Williamson
- Washington University in St. Louis,
Saint Louis, MO, 63130, United States of America
| | - Joseph A O’Sullivan
- Washington University in St. Louis,
Saint Louis, MO, 63130, United States of America
| |
Collapse
|
5
|
Zhang Y, Shao HC, Pan T, Mengke T. Dynamic cone-beam CT reconstruction using spatial and temporal implicit neural representation learning (STINR). Phys Med Biol 2023; 68:045005. [PMID: 36638543 PMCID: PMC10087494 DOI: 10.1088/1361-6560/acb30d] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Revised: 12/27/2022] [Accepted: 01/13/2023] [Indexed: 01/15/2023]
Abstract
Objective. Dynamic cone-beam CT (CBCT) imaging is highly desired in image-guided radiation therapy to provide volumetric images with high spatial and temporal resolutions to enable applications including tumor motion tracking/prediction and intra-delivery dose calculation/accumulation. However, dynamic CBCT reconstruction is a substantially challenging spatiotemporal inverse problem, due to the extremely limited projection sample available for each CBCT reconstruction (one projection for one CBCT volume).Approach. We developed a simultaneous spatial and temporal implicit neural representation (STINR) method for dynamic CBCT reconstruction. STINR mapped the unknown image and the evolution of its motion into spatial and temporal multi-layer perceptrons (MLPs), and iteratively optimized the neuron weightings of the MLPs via acquired projections to represent the dynamic CBCT series. In addition to the MLPs, we also introduced prior knowledge, in the form of principal component analysis (PCA)-based patient-specific motion models, to reduce the complexity of the temporal mapping to address the ill-conditioned dynamic CBCT reconstruction problem. We used the extended-cardiac-torso (XCAT) phantom and a patient 4D-CBCT dataset to simulate different lung motion scenarios to evaluate STINR. The scenarios contain motion variations including motion baseline shifts, motion amplitude/frequency variations, and motion non-periodicity. The XCAT scenarios also contain inter-scan anatomical variations including tumor shrinkage and tumor position change.Main results. STINR shows consistently higher image reconstruction and motion tracking accuracy than a traditional PCA-based method and a polynomial-fitting-based neural representation method. STINR tracks the lung target to an average center-of-mass error of 1-2 mm, with corresponding relative errors of reconstructed dynamic CBCTs around 10%.Significance. STINR offers a general framework allowing accurate dynamic CBCT reconstruction for image-guided radiotherapy. It is a one-shot learning method that does not rely on pre-training and is not susceptible to generalizability issues. It also allows natural super-resolution. It can be readily applied to other imaging modalities as well.
Collapse
Affiliation(s)
- You Zhang
- Advanced Imaging and Informatics in Radiation Therapy (AIRT) Laboratory, Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX, 75235, United States of America
| | - Hua-Chieh Shao
- Advanced Imaging and Informatics in Radiation Therapy (AIRT) Laboratory, Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX, 75235, United States of America
| | - Tinsu Pan
- Department of Imaging Physics, University of Texas MD Anderson Cancer Center, Houston, TX, 77030, United States of America
| | - Tielige Mengke
- Advanced Imaging and Informatics in Radiation Therapy (AIRT) Laboratory, Medical Artificial Intelligence and Automation (MAIA) Laboratory, Department of Radiation Oncology, UT Southwestern Medical Center, Dallas, TX, 75235, United States of America
| |
Collapse
|