Enhanced super-resolution reconstruction of T1w time-resolved 4DMRI in low-contrast tissue using 2-step hybrid deformable image registration

Deep learning based registration of serial whole-slide histopathology images in different stains

For routine pathology diagnosis and imaging-based biomedical research, Whole-slide image (WSI) analyses have been largely limited to a 2D tissue image space. For a more definitive tissue representation to support fine-resolution spatial and integrative analyses, it is critical to extend such tissue-based investigations to a 3D tissue space with spatially aligned serial tissue WSIs in different stains, such as Hematoxylin and Eosin (H&E) and Immunohistochemistry (IHC) biomarkers. However, such WSI registration is technically challenged by the overwhelming image scale, the complex histology structure change, and the significant difference in tissue appearances in different stains. The goal of this study is to register serial sections from multi-stain histopathology whole-slide image blocks. We propose a novel translation-based deep learning registration network CGNReg that spatially aligns serial WSIs stained in H&E and by IHC biomarkers without prior deformation information for the model training. First, synthetic IHC images are produced from H&E slides through a robust image synthesis algorithm. Next, the synthetic and the real IHC images are registered through a Fully Convolutional Network with multi-scaled deformable vector fields and a joint loss optimization. We perform the registration at the full image resolution, retaining the tissue details in the results. Evaluated with a dataset of 76 breast cancer patients with 1 H&E and 2 IHC serial WSIs for each patient, CGNReg presents promising performance as compared with multiple state-of-the-art systems in our evaluation. Our results suggest that CGNReg can produce promising registration results with serial WSIs in different stains, enabling integrative 3D tissue-based biomedical investigations.

A Simulation Study of Tolerance of Breathing Amplitude Variations in Radiotherapy of Lung Cancer Using 4DCT and Time-Resolved 4DMRI

As patient breathing irregularities can introduce a large uncertainty in targeting the internal tumor volume (ITV) of lung cancer patients, and thereby affect treatment quality, this study evaluates dose tolerance of tumor motion amplitude variations in ITV-based volumetric modulated arc therapy (VMAT). A motion-incorporated planning technique was employed to simulate treatment delivery of 10 lung cancer patients' clinical VMAT plans using original and three scaling-up (by 0.5, 1.0, and 2.0 cm) motion waveforms from single-breath four-dimensional computed tomography (4DCT) and multi-breath time-resolved 4D magnetic resonance imaging (TR-4DMRI). The planning tumor volume (PTV = ITV + 5 mm margin) dose coverage (PTV D95%) was evaluated. The repeated waveforms were used to move the isocenter in sync with the clinical leaf motion and gantry rotation. The continuous VMAT arcs were broken down into many static beam fields at the control points (2°-interval) and the composite plan represented the motion-incorporated VMAT plan. Eight motion-incorporated plans per patient were simulated and the plan with the native 4DCT waveform was used as a control. The first (D95% ≤ 95%) and second (D95% ≤ 90%) plan breaching points due to motion amplitude increase were identified and analyzed. The PTV D95% in the motion-incorporated plans was 99.4 ± 1.0% using 4DCT, closely agreeing with the corresponding ITV-based VMAT plan (PTV D95% = 100%). Tumor motion irregularities were observed in TR-4DMRI and triggered D95% ≤ 95% in one case. For small tumors, 4 mm extra motion triggered D95% ≤ 95%, and 6-8 mm triggered D95% ≤ 90%. For large tumors, 14 mm and 21 mm extra motions triggered the first and second breaching points, respectively. This study has demonstrated that PTV D95% breaching points may occur for small tumors during treatment delivery. Clinically, it is important to monitor and avoid systematic motion increase, including baseline drift, and large random motion spikes through threshold-based beam gating.

Real-Time 2D MR Cine From Beam Eye's View With Tumor-Volume Projection to Ensure Beam-to-Tumor Conformality for MR-Guided Radiotherapy of Lung Cancer

Purpose

To minimize computation latency using a predictive strategy to retrieve and project tumor volume onto 2D MR beam eye’s view (BEV) cine from time-resolved four-dimensional magnetic resonance imaging (TR-4DMRI) libraries (inhalation/exhalation) for personalized MR-guided intensity-modulated radiotherapy (IMRT) or volumetric-modulated arc therapy (VMAT).

Methods

Two time-series forecasting algorithms, autoregressive (AR) modeling and deep-learning-based long short-term memory (LSTM), were applied to predict the diaphragm position in the next 2D BEV cine to identify a motion-matched and hysteresis-accounted image to retrieve the tumor volume from the inhalation/exhalation TR-4DMRI libraries. Three 40-s TR-4DMRI (2 Hz, 3 × 80 images) per patient of eight lung cancer patients were used to create patient-specific inhalation/exhalation 4DMRI libraries, extract diaphragmatic waveforms, and interpolate them to f = 4 and 8 Hz to match 2D cine frame rates. Along a (40•f)-timepoint waveform, 30•f training timepoints were moved forward to produce 3×(10•f-1) predictions. The accuracy of position prediction was assessed against the waveform ground truth. The accuracy of tumor volume projections was evaluated using the center-of-mass difference (∆COM) and Dice similarity index against the TR-4DMRI ground truth for both IMRT (six beam angles, 30° interval) and VMAT (240/480 beam angles, 1.5°/0.75° interval, at 4/8 Hz, respectively).

Results

The accuracy of the first-timepoint prediction is 0.36 ± 0.10 mm (AR) and 0.62 ± 0.21 mm (LSTM) at 4 Hz and 0.06 ± 0.02 mm (AR) and 0.18 ± 0.06 mm (LSTM) at 8 Hz. A 10%–20% random error in prediction-library matching increases the overall uncertainty slightly. For both IMRT and VMAT, the accuracy of projected tumor volume contours on 2D BEV cine is ∆COM = 0.39 ± 0.13 mm and DICE = 0.97 ± 0.02 at 4 Hz and ∆COM = 0.10 ± 0.04 mm and DICE = 1.00 ± 0.00 at 8Hz.

Conclusion

This study demonstrates the feasibility of accurately predicting respiratory motion during 2D BEV cine imaging, identifying a motion-matched and hysteresis-accounted tumor volume, and projecting tumor volume contour on 2D BEV cine for real-time assessment of beam-to-tumor conformality, promising for optimal personalized MR-guided radiotherapy.

Stability and Reliability of Enhanced External-Internal Motion Correlation via Dynamic Phase-Shift Corrections Over 30-min Timeframe for Respiratory-Gated Radiotherapy

To assess the stability of patient-specific phase shifts between external- and internal-respiratory motion waveforms, the reliability of enhanced external–internal correlation with phase-shift correction, and the feasibility of guiding respiratory-gated radiotherapy (RGRT) over 30 min. In this clinical feasibility investigation, external bellows and internal-navigator waveforms were simultaneously and prospectively acquired along with two four-dimensional magnetic resonance imaging (4DMRI) scans (6–15 m each) with 15–20 m intervals in 10 volunteers. A bellows was placed 5 cm inferior to the xiphoid to monitor abdominal motion, and an MR navigator was used to track the diaphragmatic motion. The mean phase-domain (MPD) method was applied, which combines three individual phase-calculating methods: phase-space oval fitting, principal component analysis, and analytic signal analysis, weighted by the reciprocal of their residual errors (RE) excluding outliers (RE >2σ). The time-domain cross-correlation (TCC) analysis was applied for comparison. Dynamic phase-shift correction was performed based on the phase shift detected on the fly within two 10 s moving datasets. Simulating bellows-triggered gating, the median and 95% confidence interval for the navigator's position at beam-on/beam-off and %harm (percentage of beam-on time outside the safety margin) were calculated. Averaged across all subjects, the mean phase shifts are found indistinguishable (p > .05) between scan 1 (55˚ ± 9˚) and scan 2 (59˚ ± 11˚). Using the MPD method the averaged correlation increases from 0.56 ± 0.22 to 0.85 ± 0.11 for scan 1 and from 0.47 ± 0.30 to 0.84 ± 0.08 for scan 2. The TCC correction results in similar results. After phase-shift correction, the number of cases that were suitable for amplitude gating (with <10%harm) increased from 2 to 17 out of 20 cases. A patient-specific, stable phase-shift between the external and internal motions was observed and corrected using the MPD and TCC methods, producing long-lasting enhanced motion correlation over 30m. Phase-shift correction offers a feasible strategy for improving the accuracy of tumor-motion prediction during RGRT.

Feasibility of MR-guided radiotherapy using beam-eye-view 2D-cine with tumor-volume projection

PURPOSE

Current magnetic resonance imaging (MRI) guided radiotherapy (MRgRT) applies sagittal/coronal 2D-cine to monitor major tumor motions, however, the beam eye's view (BEV) with volumetric tumor projection would be the best measure for radiation beam conformality, independent of tumor through-plane motion. The goal is to assess the feasibility, accuracy, and performance of the BEV approach.

METHODS

Beam-specific BEV 2D-cine with volume-projected tumor contours were simulated to establish a 2D/3D tumor match against a tumor-motion library based on multi-breath time-resolved (TR) 4DMRI images. Two BEV-library-matching methods were developed: (1) fast screening with tumor center-of-mass (∆COM), in-plane area ratio, and DICE similarity, and finalizing with the highest DICE score and (2) DICE screening for top-3 candidates and finalizing with rigid registration. A 4D-XCAT digital phantom and 8 lung-cancer patients were used for assessment. For each patient, 3 sets of 40 s TR-4DMRI were acquired at 2 Hz and 6 representative BEV were created with the isocenter set at tumor COM in mid-respiration. One TR-4DMRI set (40 × 2 = 80-images) was used to simulate BEV 2D-cine and the other two (160-images) were used to create a library. The matching result was validated against the ground truth within the test set. Using a leave-one-out strategy, the success rate, accuracy, and speed of tumor matching were assessed for volume-projected tumors over 11520 time-points (=8patients•3sets•80images•6BEVs).

RESULTS

Volume-projected tumor contour area on the 6 BEVs varies by 60% ± 8% and [Formula: see text] (in-plane/volume-projected) varies by 82% ± 9%. The [Formula: see text] changes with tumor shape, orientation, and through-plane motion. Method-1 produces 96% matching success (ΔCOM = 0.7 ± 0.2 mm, [Formula: see text]=1.01 ± 0.02, Dice=0.92 ± 0.02) with the computational time of 15 ± 1 ms/match, while method-2 produces 94% ± 1% success (ΔCOM = 0.2 ± 0.1 mm, [Formula: see text]=1.00 ± 0.01, Dice = 0.94 ± 0.02) with 223 ± 13 ms/match.

CONCLUSION

This study has demonstrated the feasibility, accuracy, and benefits of BEV 2D-cine imaging with tumor-volume projection, allowing real-time tumor motion monitoring and beam conformality checking. Further clinical evaluation is necessary before MRgRT applications.