Respiratory motion models: A review

Chest Wall Reconstruction Using 3-Dimensional Printing: Functional and Mechanical Results

BACKGROUND

Tumors involving the chest wall may require extensive resection and reconstruction. This study aims to evaluate functional, cosmetic results, and quality of life (QoL) in patients who had a reconstruction based on patient-specific 3-dimensional (3D) printing.

METHODS

The patient-specific chest wall prosthesis was created for 10 patients. The anatomical models were 3D printed and used to produce a silicone mold that was filled with methyl methacrylate to create the customized prosthesis. Evaluation of the reconstruction was completed with a QoL assessment and postoperative tracking of patients' chest motion, using infrared markers. The distance between plot points representing markers on the operated and contralateral sides was measured to assess symmetrical motion.

RESULTS

Twenty-three consecutive patients were enrolled, with the median age of 64 years. Thirteen patients underwent a nonrigid reconstruction, and 10 had a patient-specific rigid reconstruction with methyl methacrylate. The median number of ribs resected was 3. No postoperative complications or morbidity related to the prostheses were reported. The median hospital stay in the nonrigid reconstruction group was 8.5 days compared with 7.5 days (p = .167) in the rigid reconstruction group. Postoperatively, most patients had low levels of symptoms, with 82% experiencing chest pain and 53% experiencing dyspnea. Rigid reconstruction patients demonstrated more symmetrical breathing motion compared with nonrigid reconstruction patients. The mean distances were 2.32 ± 2.18 and 7.28 ± 5.87 (P < .00001), respectively.

CONCLUSIONS

This study shows that a 3D patient-specific prosthesis is feasible and safe, suggesting a possible trend toward improved breathing mechanics, QoL, and cosmetic results.

Synergistic motion compensation strategies for positron emission tomography when acquired simultaneously with magnetic resonance imaging

Subject motion in positron emission tomography (PET) is a key factor that degrades image resolution and quality, limiting its potential capabilities. Correcting for it is complicated due to the lack of sufficient measured PET data from each position. This poses a significant barrier in calculating the amount of motion occurring during a scan. Motion correction can be implemented at different stages of data processing either during or after image reconstruction, and once applied accurately can substantially improve image quality and information accuracy. With the development of integrated PET-MRI (magnetic resonance imaging) scanners, internal organ motion can be measured concurrently with both PET and MRI. In this review paper, we explore the synergistic use of PET and MRI data to correct for any motion that affects the PET images. Different types of motion that can occur during PET-MRI acquisitions are presented and the associated motion detection, estimation and correction methods are reviewed. Finally, some highlights from recent literature in selected human and animal imaging applications are presented and the importance of motion correction for accurate kinetic modelling in dynamic PET-MRI is emphasized. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 2'.

Motion estimation and correction for simultaneous PET/MR using SIRF and CIL

SIRF is a powerful PET/MR image reconstruction research tool for processing data and developing new algorithms. In this research, new developments to SIRF are presented, with focus on motion estimation and correction. SIRF's recent inclusion of the adjoint of the resampling operator allows gradient propagation through resampling, enabling the MCIR technique. Another enhancement enabled registering and resampling of complex images, suitable for MRI. Furthermore, SIRF's integration with the optimization library CIL enables the use of novel algorithms. Finally, SPM is now supported, in addition to NiftyReg, for registration. Results of MR and PET MCIR reconstructions are presented, using FISTA and PDHG, respectively. These demonstrate the advantages of incorporating motion correction and variational and structural priors. This article is part of the theme issue 'Synergistic tomographic image reconstruction: part 2'.

Diffeomorphic respiratory motion estimation of thoracoabdominal organs for image-guided interventions

PURPOSE

Percutaneous image-guided interventions are commonly used for the diagnosis and treatment of cancer. In practice, physiological breathing-induced motion increases the difficulty of accurately inserting needles into tumors without impairing the surrounding vital structures. In this work, we propose a data-driven patient-specific hierarchical respiratory motion estimation framework to accurately estimate the position of a tumor and surrounding vital tissues in real time.

METHODS

The motion of optical markers attached to the chest or abdomen skin is used as a surrogate signal to estimate tumor motion based on ɛ-support vector regression (ɛ-SVR). With the estimated tumor motion as the input, a novel respiratory motion model is developed to estimate the diffeomorphic deformation field of the whole organ (liver or lung) without intraoperative, iterative optimization computations. The respiratory motion model of the whole organ is established in Lie algebra space based on the kriging algorithm to ensure that the estimated deformation field is diffeomorphic, optimal, and unbiased. Preoperative prior knowledge for modeling the motion of whole organs is obtained by deformation registration between four-dimensional computed tomography (4D CT) images using a hybrid diffeomorphic registration method.

RESULTS AND CONCLUSIONS

Experimental results on an in vivo beagle dog show that the minimum value of the determinant of the Jacobian of the estimated deformation field is greater than zero, so the estimated deformation field of the whole liver with our method is diffeomorphic. The mean position error of the tumor is 1.2 mm corresponding to a mean accuracy improvement of 76.5%, and the mean position error of the whole liver is 2.1 mm, corresponding to a mean accuracy improvement of 37.9%. The experimental results based on public human subject data show that the mean position error of the tumor is 1.1 mm, corresponding to a mean accuracy improvement of 83.1%, and the mean position error of the whole lung is 2.1 mm, corresponding to a mean accuracy improvement of 41.4%. The positioning errors for the tumor and whole organ are hierarchical and consistent with clinical demand.

Evaluation of four surface surrogates for modeling lung tumor positions over several fractions in radiotherapy

Patient breathing during lung cancer radiotherapy reduces the ability to keep a sharp dose gradient between tumor and normal tissues. To mitigate detrimental effects, accurate information about the tumor position is required. In this work, we evaluate the errors in modeled tumor positions over several fractions of a simple tumor motion model driven by a surface surrogate measure and its time derivative. The model is tested with respect to four different surface surrogates and a varying number of surrogate and image acquisitions used for model training. Fourteen patients were imaged 100 times with cine CT, at three sessions mimicking a planning session followed by two treatment fractions. Patient body contours were concurrently detected by a body surface laser scanning system BSLS from which four surface surrogates were extracted; thoracic point TP, abdominal point AP, the radial distance mean RDM, and a surface derived volume SDV. The motion model was trained on session 1 and evaluated on sessions 2 and 3 by comparing modeled tumor positions with measured positions from the cine images. The number of concurrent surrogate and image acquisitions used in the training set was varied, and its impact on the final result was evaluated. The use of AP as a surface surrogate yielded the smallest error in modeled tumor positions. The mean deviation between modeled and measured tumor positions was 1.9 mm. The corresponding deviations for using the other surrogates were 2.0 mm (RDM), 2.8 mm (SDV), and 3.0 mm (TP). To produce a motion model that accurately models the tumor position over several fractions requires at least 10 simultaneous surrogate and image acquisitions over 1–2 minutes.

Pitfalls on PET/CT Due to Artifacts and Instrumentation

PET/CT has become a preferred imaging modality over PET-only scanners in clinical practice. However, along with the significant improvement in diagnostic accuracy and patient throughput, pitfalls on PET/CT are reported as well. This review provides a general overview on the potential influence of the limitations with respect to PET/CT instrumentation and artifacts associated with the modality integration on the image appearance and quantitative accuracy of PET. Approaches proposed in literature to address the limitations or minimize the artifacts are discussed as well as their current challenges for clinical applications. Although the CT component can play an important role in assisting clinical diagnosis, we concentrate on the imaging scenarios where CT is used to provide auxiliary information for attenuation compensation and scatter correction in PET.

Motion management with variable cycle-based respiratory guidance method for carbon-ion pencil beam scanning treatment

PURPOSE

A novel variable cycle-based respiratory guidance method was proposed to synchronize the patterns between patients' breathing and the magnetic excitation of synchrotron under the mode of full-energy depth scanning beam delivery, in order to improve the treatment precision and efficiency for carbon ion therapy.

METHODS

Audio-visual biofeedback system with variable cycle-based respiratory guidance method was developed. We enrolled 6 healthy volunteers and a simulation study of the fixed cycle-based and variable cycle-based respiratory guidance with three treatment fractions was performed. A total of 72 breathing curves were collected for 4D dose calculations with three 4DCT datasets of lung tumor cases. Target dose coverage (D95: the percent dose covering 95% of the target), dose homogeneity (D5-D95), and treatment time were analyzed. The Wilcoxon signed-rank test was used for statistical difference analysis, and p < 0.05 was considered significant.

RESULTS

With the variable cycle-based respiratory guidance method, the breath hold phase of breathing curve could be synchronized with the synchrotron flat-top phase over time. The dose homogeneity was improved by factors of 1.94-2.92 compared to the fixed cycle-based respiratory guidance maneuvers alone or in combination with gating technique. Moreover, the treatment efficiency increased by 11-23%, depending on the duty cycle settings of the gating window.

CONCLUSIONS

The proposed variable cycle-based respiratory guidance method could improve both the treatment efficiency and precision under the mode of the full-energy depth scanning beam delivery for synchrotron-based carbon ion therapy.

Lung Respiratory Motion Estimation Based on Fast Kalman Filtering and 4D CT Image Registration

Respiratory motion estimation is an important part in image-guided radiation therapy and clinical diagnosis. However, most of the respiratory motion estimation methods rely on indirect measurements of external breathing indicators, which will not only introduce great estimation errors, but also bring invasive injury for patients. In this paper, we propose a method of lung respiratory motion estimation based on fast Kalman filtering and 4D CT image registration (LRME-4DCT). In order to perform dynamic motion estimation for continuous phases, a motion estimation model is constructed by combining two kinds of GPU-accelerated 4D CT image registration methods with fast Kalman filtering method. To address the high computational requirements of 4D CT image sequences, a multi-level processing strategy is adopted in the 4D CT image registration methods, and respiratory motion states are predicted from three independent directions. In the DIR-lab dataset and POPI dataset with 4D CT images, the average target registration error (TRE) of the LRME-4DCT method can reach 0.91 mm and 0.85 mm respectively. Compared with traditional estimation methods based on pair-wise image registration, the proposed LRME-4DCT method can estimate the physiological respiratory motion more accurately and quickly. Our proposed LRME-4DCT method fully meets the practical clinical requirements for rapid dynamic estimation of lung respiratory motion.

Respiratory motion correction for enhanced quantification of hepatic lesions in simultaneous PET and DCE-MR imaging

Simultaneous positron-emission tomography (PET)-magnetic resonance (MR) imaging is a hybrid technique in oncological hepatic imaging combining soft-tissue and functional contrast of dynamic contrast enhanced MR (DCE-MR) with metabolic information from PET. In this context, respiratory motion represents a major challenge by introducing blurring, artifacts and misregistration in the liver. In this work, we propose a free-breathing 3D non-rigid respiratory motion correction framework for simultaneously acquired DCE-MR and PET data, which makes use of higher spatial resolution MR data to derive motion information used directly during image reconstruction to minimize image blurring and motion artifacts. The main aim was to increase contrast of hepatic metastases to improve their detection and characterization. DCE-MR data were acquired at 3T through a golden radial phase encoding scheme, enabling derivation of motion fields. These were used in the motion compensated image reconstruction of DCE-MR time-series (48 time-points, 6 s temporal resolution, 1.5 mm isotropic spatial resolution) and 3D PET activity map, which was subsequently interpolated to the DCE-MR resolution. The extended Tofts model was fitted to DCE-MR data, obtaining functional parametric maps related to perfusion such as the endothelial permeability (Kt). Fifty-seven hepatic metastases were identified and analyzed. Quantitative evaluations of motion correction in PET images demonstrated average percentage increases of 16% ± 5% (mean ± SD) in Contrast (C), 18% ± 6% in SUV_meanand 14% ± 2% in SUV_max, while DCE-MR andKtscored contrast-to-noise-ratio increases of 64% ± 3% and 90% ± 6%, respectively. Motion-corrected data visually showed improved image contrast of hepatic metastases and effectively reduced blurring and motion artefacts. Scatter plots of SUV_meanversusKtsuggested that the proposed framework improved differentiation ofKtmeasurements. The presented motion correction framework for simultaneously acquired PET-DCE-MR data provides accurately aligned images with increased contrast of hepatic lesions allowing for improved detection and characterization.

HARP-I: A Harmonic Phase Interpolation Method for the Estimation of Motion From Tagged MR Images

We proposed a novel method called HARP-I, which enhances the estimation of motion from tagged Magnetic Resonance Imaging (MRI). The harmonic phase of the images is unwrapped and treated as noisy measurements of reference coordinates on a deformed domain, obtaining motion with high accuracy using Radial Basis Functions interpolations. Results were compared against Shortest Path HARP Refinement (SP-HR) and Sine-wave Modeling (SinMod), two harmonic image-based techniques for motion estimation from tagged images. HARP-I showed a favorable similarity with both methods under noise-free conditions, whereas a more robust performance was found in the presence of noise. Cardiac strain was better estimated using HARP-I at almost any motion level, giving strain maps with less artifacts. Additionally, HARP-I showed better temporal consistency as a new method was developed to fix phase jumps between frames. In conclusion, HARP-I showed to be a robust method for the estimation of motion and strain under ideal and non-ideal conditions.

An MRI framework for respiratory motion modelling validation

Introduction

Respiratory motion models establish a correspondence between respiratory‐correlated (RC) 4‐dimensional (4D) imaging and respiratory surrogates, to estimate time‐resolved (TR) 3D breathing motion. To evaluate the performance of motion models on real patient data, a validation framework based on magnetic resonance imaging (MRI) is proposed, entailing the use of RC 4DMRI to build the model, and on both (i) TR 2D cine‐MRI and (ii) additional 4DMRI data for testing intra‐/inter‐fraction breathing motion variability.

Methods

Repeated MRI data were acquired in 7 patients with abdominal lesions. The considered model relied on deformable image registration (DIR) for building the model and compensating for inter‐fraction baseline variations. Both 2D and 3D validation were performed, by comparing model estimations with the ground truth 2D cine‐MRI and 4DMRI respiratory phases, respectively.

Results

The median DIR error was comparable to the voxel size (1.33 × 1.33 × 5 mm³), with higher values in the presence of large inter‐fraction motion (median value: 2.97 mm). In the 2D validation, the median estimation error on anatomical landmarks’ position resulted below 4 mm in every scenario, whereas in the 3D validation it was 1.33 mm and 4.21 mm when testing intra‐ and inter‐fraction motion, respectively. The range of motion described in the cine‐MRI was comparable to the motion of the building 4DMRI, being always above the estimation error. Overall, the model performance was dependent on DIR error, presenting reduced accuracy when inter‐fraction baseline variations occurred.

Conclusions

Results suggest the potential of the proposed framework in evaluating global motion models for organ motion management in MRI‐guided radiotherapy.

Technical Note: Investigating internal-external motion correlation using fast helical CT

PURPOSE

To quantify the use of anterior torso skin surface position measurement as a breathing surrogate.

METHODS

Fourteen patients were scanned 25 times in alternating directions using a free-breathing low-mA fast helical CT protocol. Simultaneously, an abdominal pneumatic bellows was used as a real-time breathing surrogate. The imaged diaphragm dome position was used as a gold standard surrogate, characterized by localizing the most superior points of the diaphragm dome in each lung. These positions were correlated against the bellows signal acquired at the corresponding scan times. The bellows system has been shown to have a slow linear drift, and the bellows-to-CT synchronization process had a small uncertainty, so the drift and time offset were determined by maximizing the correlation coefficient between the craniocaudal diaphragm position and the drift-corrected bellows signal. The corresponding fit was used to model the real-time diaphragm position. To estimate the effectiveness of skin surface positions as surrogates, the anterior torso surface position was measured from the CT scans and correlated against the diaphragm position model. The residual error was defined as the root-mean-square correlation residual with the breathing amplitude normalized to the 5^th to 95^th breathing amplitude percentiles. The fit residual errors were analyzed over the surface for the fourteen studied patients and reported as percentages of the 5^th to 95^th percentile ranges.

RESULTS

A strong correlation was measured between the diaphragm motion and the abdominal bellows signal with an average residual error of 9.21% and standard deviation of 3.77%. In contrast, the correlations between the diaphragm position model and patient surface positions varied throughout the torso and from patient to patient. However, a consistently high correlation was found near the abdomen for each patient, and the average minimum residual error relating the skin surface to the diaphragm was 11.8% with a standard deviation of 4.61%.

CONCLUSIONS

The thoracic patient surface was found to be an accurate surrogate, but the accuracy varied across the surface sufficiently that care would need to be taken to use the surface as an accurate and reliable surrogate. Future studies will use surface imaging to determine surface patch algorithms that utilize the entire chest as well as thoracic and abdominal breathing relationships.

Retrospective Camera-Based Respiratory Gating in Clinical Whole-Heart 4D Flow MRI

Background

Respiratory gating is generally recommended in 4D flow MRI of the heart to avoid blurring and motion artifacts. Recently, a novel automated contact‐less camera‐based respiratory motion sensor has been introduced.

Purpose

To compare camera‐based respiratory gating (CAM) with liver‐lung‐navigator‐based gating (NAV) and no gating (NO) for whole‐heart 4D flow MRI.

Study Type

Retrospective.

Subjects

Thirty two patients with a spectrum of cardiovascular diseases.

Field Strength/Sequence

A 3T, 3D‐cine spoiled‐gradient‐echo‐T1‐weighted‐sequence with flow‐encoding in three spatial directions.

Assessment

Respiratory phases were derived and compared against each other by cross‐correlation. Three radiologists/cardiologist scored images reconstructed with camera‐based, navigator‐based, and no respiratory gating with a 4‐point Likert scale (qualitative analysis). Quantitative image quality analysis, in form of signal‐to‐noise ratio (SNR) and liver‐lung‐edge (LLE) for sharpness and quantitative flow analysis of the valves were performed semi‐automatically.

Statistical Tests

One‐way repeated measured analysis of variance (ANOVA) with Wilks's lambda testing and follow‐up pairwise comparisons. Significance level of P ≤ 0.05. Krippendorff's‐alpha‐test for inter‐rater reliability.

Results

The respiratory signal analysis revealed that CAM and NAV phases were highly correlated (C = 0.93 ± 0.09, P < 0.01). Image scoring showed poor inter‐rater reliability and no significant differences were observed (P ≥ 0.16). The image quality comparison showed that NAV and CAM were superior to NO with higher SNR (P = 0.02) and smaller LLE (P < 0.01). The quantitative flow analysis showed significant differences between the three respiratory‐gated reconstructions in the tricuspid and pulmonary valves (P ≤ 0.05), but not in the mitral and aortic valves (P > 0.05). Pairwise comparisons showed that reconstructions without respiratory gating were different in flow measurements to either CAM or NAV or both, but no differences were found between CAM and NAV reconstructions.

Data Conclusion

Camera‐based respiratory gating performed as well as conventional liver‐lung‐navigator‐based respiratory gating. Quantitative image quality analysis showed that both techniques were equivalent and superior to no‐gating‐reconstructions. Quantitative flow analysis revealed local flow differences (tricuspid/pulmonary valves) in images of no‐gating‐reconstructions, but no differences were found between images reconstructed with camera‐based and navigator‐based respiratory gating.

Level of Evidence

3

Technical Efficacy

Stage 2

Interventional respiratory motion compensation by simultaneous fluoroscopic and nuclear imaging: a phantom study

PURPOSE

A compact and mobile hybrid c-arm scanner, capable of simultaneously acquiring nuclear and fluoroscopic projections and SPECT/CBCT, was developed to aid fluoroscopy-guided interventional procedures involving the administration of radionuclides (e.g. hepatic radioembolization). However, as in conventional SPECT/CT, the acquired nuclear images may be deteriorated by patient respiratory motion. We propose to perform compensation for respiratory motion by extracting the motion signal from fluoroscopic projections so that the nuclear counts can be gated into motion bins. The purpose of this study is to quantify the performance of this motion compensation technique with phantom experiments.

METHODS

Anthropomorphic phantom configurations that are representative of distributions obtained during the pre-treatment procedure of hepatic radioembolization were placed on a stage that translated with three different motion patterns. Fluoroscopic projections and nuclear counts were simultaneously acquired under planar and SPECT/CBCT imaging. The planar projections were visually assessed. The SPECT reconstructions were visually assessed and quantitatively assessed by calculating the activity recovery of the spherical inserts in the phantom.

RESULTS

The planar nuclear projections of the translating anthropomorphic phantom were blurry when no motion compensation was applied. With motion compensation, the nuclear projections became representative of the stationary phantom nuclear projection. Similar behavior was observed for the visual quality of SPECT reconstructions. The mean error of the activity recovery in the uncompensated SPECT reconstructions was 15.8% ± 0.9% for stable motion, 11.9% ± 0.9% for small variations, and 11.0% ± 0.9% for large variations. When applying motion compensation, the mean error decreased to 1.8% ± 1.6% for stable motion, 2.2% ± 1.5% for small variations, and 5.2% ± 2.5% for large variations.

CONCLUSION

A compact and mobile hybrid c-arm scanner, capable of simultaneously acquiring nuclear and fluoroscopic projections, can perform compensation for respiratory motion. Such motion compensation results in sharper planar nuclear projections and increases the quantitative accuracy of the SPECT reconstructions.

Validation of a CT-based motion model with in-situ fluoroscopy for lung surface deformation estimation

Many surrogate-based motion models (SMMs), proposed to guide motion management in radiotherapy, are constructed by correlating motion of an external surrogate and internal anatomy during CT-simulation. Changes in this correlation define model break down. We validate a methodology that incorporates fluoroscopic images (FL) acquired during treatment for SMM construction and update. Under a prospective IRB, 4DCT scans, VisionRT surfaces, and orthogonal FLs were collected from five lung cancer patients. VisionRT surfaces and two FL time-series were acquired pre- and post-treatment. A simulated annealing optimization scheme was used to estimate optimal lung deformations by maximizing the mutual information between digitally reconstructed radiographs (DRRs) of the SMM-estimated 3D images and FLs. Our SMM used partial-least-regression and was trained using the optimal deformations and VisionRT surfaces from the first breathing-cycle. SMM performance was evaluated using the mutual information score between reference FLs and the corresponding SMM or phase-assigned 4DCT DRRs. The Hausdorff distance for contoured landmarks was used to evaluate target position estimation error. For four out of five patients, two principal components approximated lung surface deformations with submillimeter accuracy. Analysis of the mutual information score between more than 4,000 pairs of FL and DRR demonstrated that our model led to more similarity between the FL and DRR images compared to 4DCT and DRR images from a model based on an a priori correlation model. Our SMM consistently displayed lower mean and 95^th percentile Hausdorff distances. For one patient, 95^th percentile Hausdorff distance was reduced by 11mm. Patient-averaged reductions in mean and 95^th percentile Hausdorff distances were 3.6mm and 7mm for right-lung, and 3.1mm and 4mm for left-lung targets. FL data were used to evaluate model performance and investigate the feasibility of model update. Despite variability in breathing, use of post-treatment FL preserved model fidelity and consistently outperformed 4DCT for position estimation.

Porcine lung phantom-based validation of estimated 4D-MRI using orthogonal cine imaging for low-field MR-Linacs

Real-time motion monitoring of lung tumors with low-field magnetic resonance imaging-guided linear accelerators (MR-Linacs) is currently limited to sagittal 2D cine magnetic resonance imaging (MRI). To provide input data for improved intrafractional and interfractional adaptive radiotherapy, the 4D anatomy has to be inferred from data with lower dimensionality. The purpose of this study was to experimentally validate a previously proposed propagation method that provides continuous time-resolved estimated 4D-MRI based on orthogonal cine MRI for a low-field MR-Linac. Ex vivo porcine lungs were injected with artificial nodules and mounted in a dedicated phantom that allows for the simulation of periodic and reproducible breathing motion. The phantom was scanned with a research version of a commercial 0.35 T MR-Linac. Respiratory-correlated 4D-MRI were reconstructed and served as ground truth images. Series of interleaved orthogonal slices in sagittal and coronal orientation, intersecting the injected targets, were acquired at 7.3 Hz. Estimated 4D-MRI at 3.65 Hz were created in post-processing using the propagation method and compared to the ground truth 4D-MRI. Eight datasets at different breathing frequencies and motion amplitudes were acquired for three porcine lungs. The overall median (95[Formula: see text] percentile) deviation between ground truth and estimated deformation vector fields was 2.3 mm (5.7 mm), corresponding to 0.7 (1.6) times the in-plane imaging resolution (3.5 × 3.5 mm²). Median (95[Formula: see text] percentile) estimated nodule position errors were 1.5 mm (3.8 mm) for nodules intersected by orthogonal slices and 2.1 mm (7.1 mm) for nodules located more than 2 cm away from either of the orthogonal slices. The estimation error depended on the breathing phase, the motion amplitude and the location of the estimated position with respect to the orthogonal slices. By using the propagation method, the 4D motion within the porcine lung phantom could be accurately and robustly estimated. The method could provide valuable information for treatment planning, real-time motion monitoring, treatment adaptation, and post-treatment evaluation of MR-guided radiotherapy treatments.

A hierarchical model of abdominal configuration changes extracted from golden angle radial magnetic resonance imaging

Abdominal organs are subject to a variety of physiological forces that superimpose their effects to influence local motion and configuration. These forces not only include breathing, but can also arise from cyclic antral contractions and a range of slow configuration changes. To elucidate each individual motion pattern as well as their combined effects, a hierarchical motion model was built for characterization of these 3 motion modes (characterized as deformation maps between states) using golden angle radial MR signals. Breathing motions are characterized first. Antral contraction states are then reconstructed after breathing motion-induced deformation are corrected; slow configuration change states are further extracted from breathing motion-corrected image reconstructions. The hierarchical model is established based on these multimodal states, which can be either individually shown or combined to demonstrate any arbitrary composited motion patterns. The model was evaluated using 20 MR scans acquired from 9 subjects. Poor reproducibility of breathing motions both within as well as between scan sessions was observed, with an average intra-subject difference of 1.6 cycles min-1 for average breathing frequencies of 12.0 cycles min-1. Antral contraction frequency distributions were more stable than breathing, but also presented poor reproducibility between scans with an average difference of 0.3 cycles min-1 for average frequencies of 3.2 cycles min-1. The magnitudes of motions beyond breathing were found to be significant, with 14.4 and 33.8 mm maximal motions measured from antral contraction and slow configuration changes, respectively. Hierarchical motion models have potential in multiple applications in radiotherapy, including improving the accuracy of dose delivery estimation, providing guidance for margin creation, and supporting advanced decisions and strategies for immobilization, treatment monitoring and gating.

Adaptive Weighting Landmark-Based Group-Wise Registration on Lung DCE-MRI Images

Image registration of lung dynamic contrast enhanced magnetic resonance imaging (DCE-MRI) is challenging because the rapid changes in intensity lead to non-realistic deformations of intensity-based registration methods. To address this problem, we propose a novel landmark-based registration framework by incorporating landmark information into a group-wise registration. Robust principal component analysis is used to separate motion from intensity changes caused by a contrast agent. Landmark pairs are detected on the resulting motion components and then incorporated into an intensity-based registration through a constraint term. To reduce the negative effect of inaccurate landmark pairs on registration, an adaptive weighting landmark constraint is proposed. The method for calculating landmark weights is based on an assumption that the displacement of a good matched landmark is consistent with those of its neighbors. The proposed method was tested on 20 clinical lung DCE-MRI image series. Both visual inspection and quantitative assessment are used for the evaluation. Experimental results show that the proposed method effectively reduces the non-realistic deformations in registration and improves the registration performance compared with several state-of-the-art registration methods.

Clinical practice vs. state-of-the-art research and future visions: Report on the 4D treatment planning workshop for particle therapy - Edition 2018 and 2019

The 4D Treatment Planning Workshop for Particle Therapy, a workshop dedicated to the treatment of moving targets with scanned particle beams, started in 2009 and since then has been organized annually. The mission of the workshop is to create an informal ground for clinical medical physicists, medical physics researchers and medical doctors interested in the development of the 4D technology, protocols and their translation into clinical practice. The 10th and 11th editions of the workshop took place in Sapporo, Japan in 2018 and Krakow, Poland in 2019, respectively. This review report from the Sapporo and Krakow workshops is structured in two parts, according to the workshop programs. The first part comprises clinicians and physicists review of the status of 4D clinical implementations. Corresponding talks were given by speakers from five centers around the world: Maastro Clinic (The Netherlands), University Medical Center Groningen (The Netherlands), MD Anderson Cancer Center (United States), University of Pennsylvania (United States) and The Proton Beam Therapy Center of Hokkaido University Hospital (Japan). The second part is dedicated to novelties in 4D research, i.e. motion modelling, artificial intelligence and new technologies which are currently being investigated in the radiotherapy field.

A hybrid, image-based and biomechanics-based registration approach to markerless intraoperative nodule localization during video-assisted thoracoscopic surgery

The resection of small, low-dense or deep lung nodules during video-assisted thoracoscopic surgery (VATS) is surgically challenging. Nodule localization methods in clinical practice typically rely on the preoperative placement of markers, which may lead to clinical complications. We propose a markerless lung nodule localization framework for VATS based on a hybrid method combining intraoperative cone-beam CT (CBCT) imaging, free-form deformation image registration, and a poroelastic lung model with allowance for air evacuation. The difficult problem of estimating intraoperative lung deformations is decomposed into two more tractable sub-problems: (i) estimating the deformation due the change of patient pose from preoperative CT (supine) to intraoperative CBCT (lateral decubitus); and (ii) estimating the pneumothorax deformation, i.e. a collapse of the lung within the thoracic cage. We were able to demonstrate the feasibility of our localization framework with a retrospective validation study on 5 VATS clinical cases. Average initial errors in the range of 22 to 38 mm were reduced to the range of 4 to 14 mm, corresponding to an error correction in the range of 63 to 85%. To our knowledge, this is the first markerless lung deformation compensation method dedicated to VATS and validated on actual clinical data.

Liver-ultrasound-guided lung tumour tracking for scanned proton therapy: a feasibility study

Pencil beam scanned (PBS) proton therapy of lung tumours is hampered by respiratory motion and the motion-induced density changes along the beam path. In this simulation study, we aim to investigate the effectiveness of proton beam tracking for lung tumours both under ideal conditions and in conjunction with a respiratory motion model guided by real-time ultrasound imaging of the liver. Multiple-breathing-cycle 4DMRIs of the thorax and abdominal 2D ultrasound images were acquired simultaneously for five volunteers. Deformation vector fields extracted from the 4DMRI, referred to as ground truth motion, were used to generate 4DCT(MRI) data sets of two lung cancer patients, resulting in 10 data sets with variable motion patterns. Given the 4DCT(MRI) and the corresponding ultrasound images as surrogate data, a patient-specific motion model was built. The model consists of an autoregressive model and Gaussian process regression for the temporal and spatial prediction, respectively. Two-field PBS plans were optimised on the reference CTs, and 4D dose calculations (4DDC) were used to simulate dose delivery for (a) unmitigated motion, (b) ideal 2D and 3D tracking (both beam adaption and 4DDC based on ground truth motion), and (c) realistic 2D and 3D tracking (beam adaption based on motion predictions, 4DDC on ground truth motion). Model-guided tracking retrieved clinically acceptable target dose homogeneity, as seen in a substantial reduction of the D5%-D95% compared to the non-mitigated simulation. Tracking in 2D and 3D resulted in a similar improvement of the dose homogeneity, as did ideal and realistic tracking simulations. In some cases, however, the tracked deliveries resulted in a shift towards higher or lower dose levels, leading to unacceptable target over- or under-coverage. The presented motion modelling framework was shown to be an accurate motion prediction tool for the use in proton beam tracking. Tracking alone, however, may not always effectively mitigate motion effects, making it necessary to combine it with other techniques such as rescanning.

Imaging coronary plaques using 3D motion-compensated [18F]NaF PET/MR

Background

Cardiac PET has recently found novel applications in coronary atherosclerosis imaging using [¹⁸F]NaF as a radiotracer, highlighting vulnerable plaques. However, the resulting uptakes are relatively small, and cardiac motion and respiration-induced movement of the heart can impair the reconstructed images due to motion blurring and attenuation correction mismatches. This study aimed to apply an MR-based motion compensation framework to [¹⁸F]NaF data yielding high-resolution motion-compensated PET and MR images.

Methods

Free-breathing 3-dimensional Dixon MR data were acquired, retrospectively binned into multiple respiratory and cardiac motion states, and split into fat and water fraction using a model-based reconstruction framework. From the dynamic MR reconstructions, both a non-rigid cardiorespiratory motion model and a motion-resolved attenuation map were generated and applied to the PET data to improve image quality. The approach was tested in 10 patients and focal tracer hotspots were evaluated concerning their target-to-background ratio, contrast-to-background ratio, and their diameter.

Results

MR-based motion models were successfully applied to compensate for physiological motion in both PET and MR. Target-to-background ratios of identified plaques improved by 7 ± 7%, contrast-to-background ratios by 26 ± 38%, and the plaque diameter decreased by −22 ± 18%. MR-based dynamic attenuation correction strongly reduced attenuation correction artefacts and was not affected by stent-related signal voids in the underlying MR reconstructions.

Conclusions

The MR-based motion correction framework presented here can improve the target-to-background, contrast-to-background, and width of focal tracer hotspots in the coronary system. The dynamic attenuation correction could effectively mitigate the risk of attenuation correction artefacts in the coronaries at the lung-soft tissue boundary. In combination, this could enable a more reproducible and reliable plaque localisation.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00259-020-05180-4.

Real-time liver tracking algorithm based on LSTM and SVR networks for use in surface-guided radiation therapy

Background

Surface-guided radiation therapy can be used to continuously monitor a patient’s surface motions during radiotherapy by a non-irradiating, noninvasive optical surface imaging technique. In this study, machine learning methods were applied to predict external respiratory motion signals and predict internal liver motion in this therapeutic context.

Methods

Seven groups of interrelated external/internal respiratory liver motion samples lasting from 5 to 6 min collected simultaneously were used as a dataset, D_v. Long short-term memory (LSTM) and support vector regression (SVR) networks were then used to establish external respiratory signal prediction models (LSTMpred/SVRpred) and external/internal respiratory motion correlation models (LSTMcorr/SVRcorr). These external prediction and external/internal correlation models were then combined into an integrated model. Finally, the LSTMcorr model was used to perform five groups of model updating experiments to confirm the necessity of continuously updating the external/internal correlation model. The root-mean-square error (RMSE), mean absolute error (MAE), and maximum absolute error (MAX_AE) were used to evaluate the performance of each model.

Results

The models established using the LSTM neural network performed better than those established using the SVR network in the tasks of predicting external respiratory signals for latency-compensation (RMSE < 0.5 mm at a latency of 450 ms) and predicting internal liver motion using external signals (RMSE < 0.6 mm). The prediction errors of the integrated model (RMSE ≤ 1.0 mm) were slightly higher than those of the external prediction and external/internal correlation models. The RMSE/MAE of the fifth model update was approximately ten times smaller than that of the first model update.

Conclusions

The LSTM networks outperform SVR networks at predicting external respiratory signals and internal liver motion because of LSTM’s strong ability to deal with time-dependencies. The LSTM-based integrated model performs well at predicting liver motion from external respiratory signals with system latencies of up to 450 ms. It is necessary to update the external/internal correlation model continuously.

Non-Rigid Respiratory Motion Estimation of Whole-Heart Coronary MR Images Using Unsupervised Deep Learning

Non-rigid motion-corrected reconstruction has been proposed to account for the complex motion of the heart in free-breathing 3D coronary magnetic resonance angiography (CMRA). This reconstruction framework requires efficient and accurate estimation of non-rigid motion fields from undersampled images at different respiratory positions (or bins). However, state-of-the-art registration methods can be time-consuming. This article presents a novel unsupervised deep learning-based strategy for fast estimation of inter-bin 3D non-rigid respiratory motion fields for motion-corrected free-breathing CMRA. The proposed 3D respiratory motion estimation network (RespME-net) is trained as a deep encoder-decoder network, taking pairs of 3D image patches extracted from CMRA volumes as input and outputting the motion field between image patches. Using image warping by the estimated motion field, a loss function that imposes image similarity and motion smoothness is adopted to enable training without ground truth motion field. RespME-net is trained patch-wise to circumvent the challenges of training a 3D network volume-wise which requires large amounts of GPU memory and 3D datasets. We perform 5-fold cross-validation with 45 CMRA datasets and demonstrate that RespME-net can predict 3D non-rigid motion fields with subpixel accuracy (0.44 ± 0.38 mm) within ~10 seconds, being ~20 times faster than a GPU-implemented state-of-the-art non-rigid registration method. Moreover, we perform non-rigid motion-compensated CMRA reconstruction for 9 additional patients. The proposed RespME-net has achieved similar motion-corrected CMRA image quality to the conventional registration method regarding coronary artery length and sharpness.

Deep correction of breathing-related artifacts in real-time MR-thermometry

Real-time MR-imaging has been clinically adapted for monitoring thermal therapies since it can provide on-the-fly temperature maps simultaneously with anatomical information. However, proton resonance frequency based thermometry of moving targets remains challenging since temperature artifacts are induced by the respiratory as well as physiological motion. If left uncorrected, these artifacts lead to severe errors in temperature estimates and impair therapy guidance. In this study, we evaluated deep learning for on-line correction of motion related errors in abdominal MR-thermometry. For this, a convolutional neural network (CNN) was designed to learn the apparent temperature perturbation from images acquired during a preparative learning stage prior to hyperthermia. The input of the designed CNN is the most recent magnitude image and no surrogate of motion is needed. During the subsequent hyperthermia procedure, the recent magnitude image is used as an input for the CNN-model in order to generate an on-line correction for the current temperature map. The method's artifact suppression performance was evaluated on 12 free breathing volunteers and was found robust and artifact-free in all examined cases. Furthermore, thermometric precision and accuracy was assessed for in vivo ablation using high intensity focused ultrasound. All calculations involved at the different stages of the proposed workflow were designed to be compatible with the clinical time constraints of a therapeutic procedure.

Advancements in Methods and Camera-Based Sensors for the Quantification of Respiration

Assessment of respiratory function allows early detection of potential disorders in the respiratory system and provides useful information for medical management. There is a wide range of applications for breathing assessment, from measurement systems in a clinical environment to applications involving athletes. Many studies on pulmonary function testing systems and breath monitoring have been conducted over the past few decades, and their results have the potential to broadly impact clinical practice. However, most of these works require physical contact with the patient to produce accurate and reliable measures of the respiratory function. There is still a significant shortcoming of non-contact measuring systems in their ability to fit into the clinical environment. The purpose of this paper is to provide a review of the current advances and systems in respiratory function assessment, particularly camera-based systems. A classification of the applicable research works is presented according to their techniques and recorded/quantified respiration parameters. In addition, the current solutions are discussed with regards to their direct applicability in different settings, such as clinical or home settings, highlighting their specific strengths and limitations in the different environments.

Pilot tone-based motion correction for prospective respiratory compensated cardiac cine MRI

PURPOSE

To evaluate prospective motion correction using the pilot tone (PT) as a quantitative respiratory motion signal with high temporal resolution for cardiac cine images during free breathing.

METHODS

Before cine data acquisition, a short prescan was performed, calibrating the PT to the respiratory-induced heart motion using respiratory-resolved real-time images. The calibrated PT was then applied for nearly real-time prospective motion correction of cine MRI through slice tracking (ie, updating the slice position before every readout). Additionally, in-plane motion correction was performed retrospectively also based on the calibrated PT data. The proposed method was evaluated in a moving phantom and 10 healthy volunteers.

RESULTS

The PT showed very good correlation to the phantom motion. In volunteer studies using a long-term scan over 7.96 ± 1.40 min, the mean absolute error between registered and predicted motion from the PT was 1.44 ± 0.46 mm in head-feet and 0.46 ± 0.07 mm in anterior-posterior direction. Irregular breathing could also be corrected well with the PT. The PT motion correction leads to a significant improvement of contrast-to-noise ratio by 68% (P ≤ .01) between blood pool and myocardium and sharpness of endocardium by 24% (P = .04) in comparison to uncorrected data. The image score, which refers to the cine image quality, has improved with the utilization of the proposed PT motion correction.

CONCLUSION

The proposed approach provides respiratory motion-corrected cine images of the heart with improved image quality and a high scan efficiency using the PT. The PT is independent of the MR acquisition, making this a very flexible motion-correction approach.

Nonrigid 3D motion estimation at high temporal resolution from prospectively undersampled k-space data using low-rank MR-MOTUS

Purpose

With the recent introduction of the MR‐LINAC, an MR‐scanner combined with a radiotherapy LINAC, MR‐based motion estimation has become of increasing interest to (retrospectively) characterize tumor and organs‐at‐risk motion during radiotherapy. To this extent, we introduce low‐rank MR‐MOTUS, a framework to retrospectively reconstruct time‐resolved nonrigid 3D+t motion fields from a single low‐resolution reference image and prospectively undersampled k‐space data acquired during motion.

Theory

Low‐rank MR‐MOTUS exploits spatiotemporal correlations in internal body motion with a low‐rank motion model, and inverts a signal model that relates motion fields directly to a reference image and k‐space data. The low‐rank model reduces the degrees‐of‐freedom, memory consumption, and reconstruction times by assuming a factorization of space‐time motion fields in spatial and temporal components.

Methods

Low‐rank MR‐MOTUS was employed to estimate motion in 2D/3D abdominothoracic scans and 3D head scans. Data were acquired using golden‐ratio radial readouts. Reconstructed 2D and 3D respiratory motion fields were, respectively, validated against time‐resolved and respiratory‐resolved image reconstructions, and the head motion against static image reconstructions from fully sampled data acquired right before and right after the motion.

Results

Results show that 2D+t respiratory motion can be estimated retrospectively at 40.8 motion fields per second, 3D+t respiratory motion at 7.6 motion fields per second and 3D+t head‐neck motion at 9.3 motion fields per second. The validations show good consistency with image reconstructions.

Conclusions

The proposed framework can estimate time‐resolved nonrigid 3D motion fields, which allows to characterize drifts and intra and inter‐cycle patterns in breathing motion during radiotherapy, and could form the basis for real‐time MR‐guided radiotherapy.

The Importance of Respiratory Rate Monitoring: From Healthcare to Sport and Exercise

Respiratory rate is a fundamental vital sign that is sensitive to different pathological conditions (e.g., adverse cardiac events, pneumonia, and clinical deterioration) and stressors, including emotional stress, cognitive load, heat, cold, physical effort, and exercise-induced fatigue. The sensitivity of respiratory rate to these conditions is superior compared to that of most of the other vital signs, and the abundance of suitable technological solutions measuring respiratory rate has important implications for healthcare, occupational settings, and sport. However, respiratory rate is still too often not routinely monitored in these fields of use. This review presents a multidisciplinary approach to respiratory monitoring, with the aim to improve the development and efficacy of respiratory monitoring services. We have identified thirteen monitoring goals where the use of the respiratory rate is invaluable, and for each of them we have described suitable sensors and techniques to monitor respiratory rate in specific measurement scenarios. We have also provided a physiological rationale corroborating the importance of respiratory rate monitoring and an original multidisciplinary framework for the development of respiratory monitoring services. This review is expected to advance the field of respiratory monitoring and favor synergies between different disciplines to accomplish this goal.

Image-guided Radiotherapy to Manage Respiratory Motion: Lung and Liver

Organ motion as a result of respiratory and cardiac motion poses significant challenges for the accurate delivery of radiotherapy to both the thorax and the upper abdomen. Modern imaging techniques during radiotherapy simulation and delivery now permit better quantification of organ motion, which in turn reduces tumour and organ at risk position uncertainty. These imaging advances, coupled with respiratory correlated radiotherapy delivery techniques, have led to the development of a range of approaches to manage respiratory motion. This review summarises the key strategies of image-guided respiratory motion management with a focus on lung and liver radiotherapy.

Consistent and invertible deformation vector fields for a breathing anthropomorphic phantom: a post-processing framework for the XCAT phantom

Breathing motion is challenging for radiotherapy planning and delivery. This requires advanced four-dimensional (4D) imaging and motion mitigation strategies and associated validation tools with known deformations. Numerical phantoms such as the XCAT provide reproducible and realistic data for simulation-based validation. However, the XCAT generates partially inconsistent and non-invertible deformations where tumours remain rigid and structures can move through each other. We address these limitations by post-processing the XCAT deformation vector fields (DVF) to generate a breathing phantom with realistic motion and quantifiable deformation. An open-source post-processing framework was developed that corrects and inverts the XCAT-DVFs while preserving sliding motion between organs. Those post-processed DVFs are used to warp the first XCAT-generated image to consecutive time points providing a 4D phantom with a tumour that moves consistently with the anatomy, the ability to scale lung density as well as consistent and invertible DVFs. For a regularly breathing case, the inverse consistency of the DVFs was verified and the tumour motion was compared to the original XCAT. The generated phantom and DVFs were used to validate a motion-including dose reconstruction (MIDR) method using isocenter shifts to emulate rigid motion. Differences between the reconstructed doses with and without lung density scaling were evaluated. The post-processing framework produced DVFs with a maximum [Formula: see text]-percentile inverse-consistency error of 0.02 mm. The generated phantom preserved the dominant sliding motion between the chest wall and inner organs. The tumour of the original XCAT phantom preserved its trajectory while deforming consistently with the underlying tissue. The MIDR was compared to the ground truth dose reconstruction illustrating its limitations. MIDR with and without lung density scaling resulted in small dose differences up to 1 Gy (prescription 54 Gy). The proposed open-source post-processing framework overcomes important limitations of the original XCAT phantom and makes it applicable to a wider range of validation applications within radiotherapy.

A modern review of the uncertainties in volumetric imaging of respiratory-induced target motion in lung radiotherapy

Radiotherapy has become a critical component for the treatment of all stages and types of lung cancer, often times being the primary gateway to a cure. However, given that radiation can cause harmful side effects depending on how much surrounding healthy tissue is exposed, treatment of the lung can be particularly challenging due to the presence of moving targets. Careful implementation of every step in the radiotherapy process is absolutely integral for attaining optimal clinical outcomes. With the advent and now widespread use of stereotactic body radiation therapy (SBRT), where extremely large doses are delivered, accurate, and precise dose targeting is especially vital to achieve an optimal risk to benefit ratio. This has largely become possible due to the rapid development of image-guided technology. Although imaging is critical to the success of radiotherapy, it can often be plagued with uncertainties due to respiratory-induced target motion. There has and continues to be an immense research effort aimed at acknowledging and addressing these uncertainties to further our abilities to more precisely target radiation treatment. Thus, the goal of this article is to provide a detailed review of the prevailing uncertainties that remain to be investigated across the different imaging modalities, as well as to highlight the more modern solutions to imaging motion and their role in addressing the current challenges.

Continuous real time 3D motion reproduction using dynamic MRI and precomputed 4DCT deformation fields

Radiotherapy of mobile tumors requires specific imaging tools and models to reduce the impact of motion on the treatment. Online continuous nonionizing imaging has become possible with the recent development of magnetic resonance imaging devices combined with linear accelerators. This opens the way to new guided treatment methods based on the real-time tracking of anatomical motion. In such devices, 2D fast MR-images are well-suited to capture and predict the real-time motion of the tumor. To be used effectively in an adaptive radiotherapy, these MR images have to be combined with X-ray images such as CT, which are necessary to compute the irradiation dose deposition. We therefore developed a method combining both image modalities to track the motion on MR images and reproduce the tracked motion on a sequence of 3DCT images in real-time. It uses manually placed navigators to track organ interfaces in the image, making it possible to select anatomical object borders that are visible on both MRI and CT modalities and giving the operator precise control of the motion tracking quality. Precomputed deformation fields extracted from the 4DCT acquired in the planning phase are then used to deform existing 3DCT images to match the tracked object position, creating a new set of 3DCT images encompassing irregularities in the breathing pattern for the complete duration of the MRI acquisition. The final continuous reconstructed 4DCT image sequence reproduces the motion captured by the MRI sequence with high precision (difference below 2 mm).

Flexible numerical simulation framework for dynamic PET-MR data

This paper presents a simulation framework for dynamic PET-MR. The main focus of this framework is to provide motion-resolved MR and PET data and ground truth motion information. This can be used in the optimisation and quantitative evaluation of image registration and in assessing the error propagation due to inaccuracies in motion estimation in complex motion-compensated reconstruction algorithms. Contrast and tracer kinetics can also be simulated and are available as ground truth information. To closely emulate medical examination, input and output of the simulation are files in standardised open-source raw data formats. This enables the use of existing raw data as a template input and ensures seamless integration of the output into existing reconstruction pipelines. The proposed framework was validated in PET-MR and image registration applications. It was used to simulate a FDG-PET-MR scan with cardiac and respiratory motion. Ground truth motion information could be utilised to optimise parameters for PET and synergistic PET-MR image registration. In addition, a free-breathing dynamic contrast enhancement (DCE) abdominal scan of a patient with hepatic lesions was simulated. In order to correct for breathing motion, a motion-corrected image reconstruction scheme was used and a Toft's model was fit to the DCE data to obtain quantitative DCE-MRI parameters. Utilising the ground truth motion information, the dependency of quantitative DCE-MR images on the accuracy of the motion estimation was evaluated. We demonstrated that respiratory motion had to be available with an average accuracy of at least the spatial resolution of the DCE-MR images in order to ensure an improvement in lesions visualisation and quantification compared to no motion correction. The proposed framework provides a valuable tool with a wide range of scientific PET and MR applications and will be available as part of the open-source project Synergistic Image Reconstruction Framework (SIRF).

Evaluation of MRI-derived surrogate signals to model respiratory motion

An MR-Linac can provide motion information of tumour and organs-at-risk before, during, and after beam delivery. However, MR imaging cannot provide real-time high-quality volumetric images which capture breath-to-breath variability of respiratory motion. Surrogate-driven motion models relate the motion of the internal anatomy to surrogate signals, thus can estimate the 3D internal motion from these signals. Internal surrogate signals based on patient anatomy can be extracted from 2D cine-MR images, which can be acquired on an MR-Linac during treatment, to build and drive motion models. In this paper we investigate different MRI-derived surrogate signals, including signals generated by applying principal component analysis to the image intensities, or control point displacements derived from deformable registration of the 2D cine-MR images. We assessed the suitability of the signals to build models that can estimate the motion of the internal anatomy, including sliding motion and breath-to-breath variability. We quantitatively evaluated the models by estimating the 2D motion in sagittal and coronal slices of 8 lung cancer patients, and comparing them to motion measurements obtained from image registration. For sagittal slices, using the first and second principal components on the control point displacements as surrogate signals resulted in the highest model accuracy, with a mean error over patients around 0.80 mm which was lower than the in-plane resolution. For coronal slices, all investigated signals except the skin signal produced mean errors over patients around 1 mm. These results demonstrate that surrogate signals derived from 2D cine-MR images, including those generated by applying principal component analysis to the image intensities or control point displacements, can accurately model the motion of the internal anatomy within a single sagittal or coronal slice. This implies the signals should also be suitable for modelling the 3D respiratory motion of the internal anatomy.

The noise navigator for MRI-guided radiotherapy: an independent method to detect physiological motion

Motion is problematic during radiotherapy as it could lead to potential underdosage of the tumor, and/or overdosage in organs-at-risk. A solution is adaptive radiotherapy guided by magnetic resonance imaging (MRI). MRI allows for imaging of target volumes and organs-at-risk before and during treatment delivery with superb soft tissue contrast in any desired orientation, enabling motion management by means of (real-time) adaptive radiotherapy. The noise navigator, which is independent of the MR signal, could serve as a secondary motion detection method in synergy with MR imaging. The feasibility of respiratory motion detection by means of the noise navigator was demonstrated previously. Furthermore, from electromagnetic simulations we know that the noise navigator is sensitive to tissue displacement and thus could in principle be used for the detection of various types of motion. In this study we demonstrate the detection of various types of motion for three anatomical use cases of MRI-guided radiotherapy, i.e. torso (bulk movement and variable breathing), head-and-neck (swallowing) and cardiac. Furthermore, it is shown that the noise navigator can detect bulk movement, variable breathing and swallowing on a hybrid 1.5 T MRI-linac system. Cardiac activity detection through the noise navigator seems feasible in an MRI-guided radiotherapy setting, but needs further optimization. The noise navigator is a versatile and fast (millisecond temporal resolution) motion detection method independent of MR signal that could serve as an independent verification method to detect the occurrence of motion in synergy with real-time MRI-guided radiotherapy.

Impact of respiratory motion correction on lesion visibility and quantification in thoracic PET/MR imaging

The impact of a method for MR-based respiratory motion correction of PET data on lesion visibility and quantification in patients with oncologic findings in the lung was evaluated. Twenty patients with one or more lesions in the lung were included. Hybrid imaging was performed on an integrated PET/MR system using 18F-FDG as radiotracer. The standard thoracic imaging protocol was extended by a free-breathing self-gated acquisition of MR data for motion modelling. PET data was acquired simultaneously in list-mode for 5-10 mins. One experienced radiologist and one experienced nuclear medicine specialist evaluated and compared the post-processed data in consensus regarding lesion visibility (scores 1-4, 4 being best), image noise levels (scores 1-3, 3 being lowest noise), SUVmean and SUVmax. Motion-corrected (MoCo) images were additionally compared with gated images. Non-motion-corrected free-breathing data served as standard of reference in this study. Motion correction generally improved lesion visibility (3.19 ± 0.63) and noise ratings (2.95 ± 0.22) compared to uncorrected (2.81 ± 0.66 and 2.95 ± 0.22, respectively) or gated PET data (2.47 ± 0.93 and 1.30 ± 0.47, respectively). Furthermore, SUVs (mean and max) were compared for all methods to estimate their respective impact on the quantification. Deviations of SUVmax were smallest between the uncorrected and the MoCo lesion data (average increase of 9.1% of MoCo SUVs), while SUVmean agreed best for gated and MoCo reconstructions (MoCo SUVs increased by 1.2%). The studied method for MR-based respiratory motion correction of PET data combines increased lesion sharpness and improved lesion activity quantification with high signal-to-noise ratio in a clinical setting. In particular, the detection of small lesions in moving organs such as the lung and liver may thus be facilitated. These advantages justify the extension of the PET/MR imaging protocol by 5-10 minutes for motion correction.

Medical physics challenges in clinical MR-guided radiotherapy

The integration of magnetic resonance imaging (MRI) for guidance in external beam radiotherapy has faced significant research and development efforts in recent years. The current availability of linear accelerators with an embedded MRI unit, providing volumetric imaging at excellent soft tissue contrast, is expected to provide novel possibilities in the implementation of image-guided adaptive radiotherapy (IGART) protocols. This study reviews open medical physics issues in MR-guided radiotherapy (MRgRT) implementation, with a focus on current approaches and on the potential for innovation in IGART.Daily imaging in MRgRT provides the ability to visualize the static anatomy, to capture internal tumor motion and to extract quantitative image features for treatment verification and monitoring. Those capabilities enable the use of treatment adaptation, with potential benefits in terms of personalized medicine. The use of online MRI requires dedicated efforts to perform accurate dose measurements and calculations, due to the presence of magnetic fields. Likewise, MRgRT requires dedicated quality assurance (QA) protocols for safe clinical implementation.Reaction to anatomical changes in MRgRT, as visualized on daily images, demands for treatment adaptation concepts, with stringent requirements in terms of fast and accurate validation before the treatment fraction can be delivered. This entails specific challenges in terms of treatment workflow optimization, QA, and verification of the expected delivered dose while the patient is in treatment position. Those challenges require specialized medical physics developments towards the aim of fully exploiting MRI capabilities. Conversely, the use of MRgRT allows for higher confidence in tumor targeting and organs-at-risk (OAR) sparing.The systematic use of MRgRT brings the possibility of leveraging IGART methods for the optimization of tumor targeting and quantitative treatment verification. Although several challenges exist, the intrinsic benefits of MRgRT will provide a deeper understanding of dose delivery effects on an individual basis, with the potential for further treatment personalization.

Respiratory Motion Prediction Using Deep Convolutional Long Short-Term Memory Network

Background

Pulmonary movements during radiation therapy can cause damage to healthy tissues. It is necessary to adapt treatment planning based on tumor motion to avoid damage to healthy tissues. A range of approaches has been proposed to monitor the issue. A treatment planning based on fourdimensional computed tomography (4D CT) images can be addressed as one of the most achievable options. Although several methods proposed to predict pulmonary movements based on mathematical algorithms, the use of deep artificial neural networks has recently been considered.

Methods

In the current study, convolutional long shortterm memory networks are applied to predict and generate images throughout the breathing cycle. A total of 3295 CT images of six patients in three different views was considered as reference images. The proposed method was evaluated in six experiments based on a leaveonepatientout method similar to crossvalidation.

Results

The weighted average results of the experiments in terms of the rootmeansquared error and structural similarity index measure are 9 × 10^-3 and 0.943, respectively.

Conclusion

Utilizing the proposed method, because of its generative nature, which results in the generation of CT images during the breathing cycle, improves the radiotherapy treatment planning in the lack of access to 4D CT images.

Automatic reconstruction of the delivered dose of the day using MR-linac treatment log files and online MR imaging

BACKGROUND AND PURPOSE

Anatomical changes during external beam radiotherapy prevent the accurate delivery of the intended dose distribution. Resolving the delivered dose, which is currently unknown, is crucial to link radiotherapy doses to clinical outcomes and ultimately improve the standard of care.

MATERIAL AND METHODS

In this study, we present a dose reconstruction workflow based on data routinely acquired during MR-guided radiotherapy. It employs 3D MR images, 2D cine MR images and treatment machine log files to calculate the delivered dose taking intrafractional motion into account. The developed pipeline was used to measure anatomical changes and assess their dosimetric impact in 89 prostate radiotherapy fractions delivered with a 1.5 T MR-linac at our institute.

RESULTS

Over the course of radiation delivery, the CTV shifted 0.6 mm ± 2.1 mm posteriorly and 1.3 mm ± 1.5 mm inferiorly. When extrapolating the dose changes in each case to 20 fractions, the mean clinical target volume D98% and clinical target volume D50% dose-volume metrics decreased by 1.1 Gy ± 1.6 Gy and 0.1 Gy ± 0.2 Gy, respectively. Bladder D3% did not change (0.0 Gy ± 1.2 Gy), while rectum D3% decreased by 1.0 Gy ± 2.0 Gy. Although anatomical changes and their dosimetric impact were small in the majority of cases, large intrafractional motion caused the delivered dose to substantially deviate from the intended plan in some fractions.

CONCLUSIONS

The presented end-to-end workflow is able to reliably, non-invasively and automatically reconstruct the delivered prostate radiotherapy dose by processing MR-linac treatment log files and online MR images. In the future, we envision this workflow to be adapted to other cancer sites and ultimately to enter widespread clinical use.

Modeling RBE-weighted dose variations in irregularly moving abdominal targets treated with carbon ion beams

PURPOSE

To model four-dimensional (4D) relative biological effectiveness (RBE)-weighted dose variations in abdominal lesions treated with scanned carbon ion beam in case of irregular breathing motion.

METHODS

The proposed method, referred to as bioWED method, combines the simulation of tumor motion in a patient- and beam-specific water equivalent depth (WED)-space with RBE modeling, aiming at the estimation of RBE-weighted dose changes due to respiratory motion. The method was validated on a phantom, simulating gated and free breathing dose delivery, and on a patient case, for which free breathing irradiation was assumed and both amplitude and baseline breathing irregularities were simulated through a respiratory motion model. We quantified (a) the effect of motion on the equivalent uniform dose (EUD) and the RBE-weighted dose-volume histograms (DVH), by comparing the planned dose distribution with "ground truth" 4D RBE-weighted doses computed using 4D computed tomography data, and (ii) the estimation error, by comparing the doses estimated with the bioWED method to "ground truth" 4D RBE-weighted doses.

RESULTS

In the phantom validation, the estimation error on the EUD was limited with respect to the motion effect and the median estimation error on relevant RBE-weighted DVH metrics remained within 5%. In the patient study, the estimation error as computed on the EUD was smaller than the corresponding motion effect, exhibiting the largest values in the baseline irregularity simulation. However, the median estimation error over all simulations was below 3.2% considering relevant DVH metrics.

CONCLUSIONS

In the evaluated cases, the bioWED method showed proper accuracy when compared to deformable image registration-based 4D dose calculation. Therefore, it can be seen as a tool to test treatment plan robustness against irregular breathing motion, although its accuracy decreases as a function of increasing soft tissue deformation and should be evaluated on a larger patient dataset.

Large-scale Quality Control of Cardiac Imaging in Population Studies: Application to UK Biobank

In large population studies such as the UK Biobank (UKBB), quality control of the acquired images by visual assessment is unfeasible. In this paper, we apply a recently developed fully-automated quality control pipeline for cardiac MR (CMR) images to the first 19,265 short-axis (SA) cine stacks from the UKBB. We present the results for the three estimated quality metrics (heart coverage, inter-slice motion and image contrast in the cardiac region) as well as their potential associations with factors including acquisition details and subject-related phenotypes. Up to 14.2% of the analysed SA stacks had sub-optimal coverage (i.e. missing basal and/or apical slices), however most of them were limited to the first year of acquisition. Up to 16% of the stacks were affected by noticeable inter-slice motion (i.e. average inter-slice misalignment greater than 3.4 mm). Inter-slice motion was positively correlated with weight and body surface area. Only 2.1% of the stacks had an average end-diastolic cardiac image contrast below 30% of the dynamic range. These findings will be highly valuable for both the scientists involved in UKBB CMR acquisition and for the ones who use the dataset for research purposes.

Virtual 4DCT from 4DMRI for the management of respiratory motion in carbon ion therapy of abdominal tumors

PURPOSE

To evaluate a method for generating virtual four-dimensional computed tomography (4DCT) from four-dimensional magnetic resonance imaging (4DMRI) data in carbon ion radiotherapy with pencil beam scanning for abdominal tumors.

METHODS

Deformable image registration is used to: (a) register each respiratory phase of the 4DMRI to the end-exhale MRI; (b) register the reference end-exhale CT to the end-exhale MRI volume; (c) generate the virtual 4DCT by warping the registered CT according to the obtained deformation fields. A respiratory-gated carbon ion treatment plan is optimized on the planning 4DCT and the corresponding dose distribution is recalculated on the virtual 4DCT. The method was validated on a digital anthropomorphic phantom and tested on eight patients (18 acquisitions). For the phantom, a ground truth dataset was available to assess the method performances from the geometrical and dosimetric standpoints. For the patients, the virtual 4DCT was compared with the planning 4DCT.

RESULTS

In the phantom, the method exhibits a geometrical accuracy within the voxel size and Dose Volume Histograms deviations up to 3.3% for target V_95% (mean dose difference ≤ 0.2% of the prescription dose, gamma pass rate > 98%). For patients, the virtual and the planning 4DCTs show good agreement at end-exhale (3% median D_95% difference), whereas other respiratory phases exhibit moderate motion variability with consequent dose discrepancies, confirming the need for motion mitigation strategies during treatment.

CONCLUSIONS

The virtual 4DCT approach is feasible to evaluate treatment plan robustness against intra- and interfraction motion in carbon ion therapy delivered at the abdominal site.