A method to reconstruct intra-fractional liver motion in rotational radiotherapy using linear fiducial markers

Real-time liver tumor localization via a single x-ray projection using deep graph neural network-assisted biomechanical modeling

Objective. Real-time imaging is highly desirable in image-guided radiotherapy, as it provides instantaneous knowledge of patients’ anatomy and motion during treatments and enables online treatment adaptation to achieve the highest tumor targeting accuracy. Due to extremely limited acquisition time, only one or few x-ray projections can be acquired for real-time imaging, which poses a substantial challenge to localize the tumor from the scarce projections. For liver radiotherapy, such a challenge is further exacerbated by the diminished contrast between the tumor and the surrounding normal liver tissues. Here, we propose a framework combining graph neural network-based deep learning and biomechanical modeling to track liver tumor in real-time from a single onboard x-ray projection. Approach. Liver tumor tracking is achieved in two steps. First, a deep learning network is developed to predict the liver surface deformation using image features learned from the x-ray projection. Second, the intra-liver deformation is estimated through biomechanical modeling, using the liver surface deformation as the boundary condition to solve tumor motion by finite element analysis. The accuracy of the proposed framework was evaluated using a dataset of 10 patients with liver cancer. Main results. The results show accurate liver surface registration from the graph neural network-based deep learning model, which translates into accurate, fiducial-less liver tumor localization after biomechanical modeling (<1.2 (±1.2) mm average localization error). Significance. The method demonstrates its potentiality towards intra-treatment and real-time 3D liver tumor monitoring and localization. It could be applied to facilitate 4D dose accumulation, multi-leaf collimator tracking and real-time plan adaptation. The method can be adapted to other anatomical sites as well.

Deep learning-based motion tracking using ultrasound images

PURPOSE

Ultrasound (US) imaging is an established imaging modality capable of offering video-rate volumetric images without ionizing radiation. It has the potential for intra-fraction motion tracking in radiation therapy. In this study, a deep learning-based method has been developed to tackle the challenges in motion tracking using US imaging.

METHODS

We present a Markov-like network, which is implemented via generative adversarial networks, to extract features from sequential US frames (one tracked frame followed by untracked frames) and thereby estimate a set of deformation vector fields (DVFs) through the registration of the tracked frame and the untracked frames. The positions of the landmarks in the untracked frames are finally determined by shifting landmarks in the tracked frame according to the estimated DVFs. The performance of the proposed method was evaluated on the testing dataset by calculating the tracking error (TE) between the predicted and ground truth landmarks on each frame.

RESULTS

The proposed method was evaluated using the MICCAI CLUST 2015 dataset which was collected using seven US scanners with eight types of transducers and the Cardiac Acquisitions for Multi-structure Ultrasound Segmentation (CAMUS) dataset which was acquired using GE Vivid E95 ultrasound scanners. The CLUST dataset contains 63 2D and 22 3D US image sequences respectively from 42 and 18 subjects, and the CAMUS dataset includes 2D US images from 450 patients. On CLUST dataset, our proposed method achieved a mean tracking error of 0.70 ± 0.38 mm for the 2D sequences and 1.71 ± 0.84 mm for the 3D sequences for those public available annotations. And on CAMUS dataset, a mean tracking error of 0.54 ± 1.24 mm for the landmarks in the left atrium was achieved.

CONCLUSIONS

A novel motion tracking algorithm using US images based on modern deep learning techniques has been demonstrated in this study. The proposed method can offer millimeter-level tumor motion prediction in real time, which has the potential to be adopted into routine tumor motion management in radiation therapy.

Experimental and numerical studies on kV scattered x-ray imaging for real-time image guidance in radiation therapy

Motion management is a critical component of image guided radiotherapy for lung cancer. We previously proposed a scheme using kV scattered x-ray photons for marker-less real-time image guidance in lung cancer radiotherapy. This study reports our recent progress using the photon counting detection technique to demonstrate potential feasibility of this method and using Monte Carlo (MC) simulations and ray-tracing calculations to characterize the performance. In our scheme, a thin slice of x-ray beam was directed to the target and we measured the outgoing scattered photons using a photon counting detector with a parallel-hole collimator to establish the correspondence between detector pixels and scatter positions. Image corrections of geometry, beam attenuation and scattering angle were performed to convert the raw image to the actual image of Compton attenuation coefficient. We set up a MC simulation system using an in-house developed GPU-based MC package modeling the image formation process. We also performed ray-tracing calculations to investigate the impacts of imaging system geometry on resulting image resolution. The experiment demonstrated feasibility of using a photon counting detector to measure scattered x-ray photons and generate the proposed scattered x-ray image. After correction, x-ray scattering image intensity and Compton scattering attenuation coefficient were linearly related, with R ² greater than 0.9. Contrast to noise ratios of different objects were improved and the values in experimental results and MC simulation results agreed with each other. Ray-tracing calculations revealed the dependence of image resolution on imaging geometry. The image resolution increases with reduced source to object distance and increased collimator height. The study demonstrated potential feasibility of using scattered x-ray imaging as a real-time image guidance method in radiation therapy.

Quantification of Intrafraction and Interfraction Tumor Motion Amplitude and Prediction Error for Different Liver Tumor Trajectories in Cyberknife Synchrony Tracking

PURPOSE

To research the fiducial-based, real-time tracking intrafraction (during the fraction [intra-]) and interfraction (between fractions [inter-]) tumor respiration amplitude, motion trajectory, and prediction error and quantify their relationships for different types of motion trajectories during Cyberknife-based stereotactic ablation radiotherapy.

METHODS AND MATERIALS

Twelve patients with liver tumors were treated using a Cyberknife system, and 58 fractions were involved in this study. Real-time target motion tracking data were extracted and transformed from the robot coordinate system into the patient coordinate system by the rotation matrix. Only the time sessions of the beam on were studied according to the data information generated from the Cyberknife motion tracking system. The motion correlation model between the external marker signal and internal fiducial position was built to present the type of motion trajectory.

RESULTS

Using the correlation model as a function of external marker signal and internal fiducial position, we knew 4 motion trajectories mainly existed for liver cancer patients as follows: perfect linearity (group I), simple linearity (group II), hysteresis (group III), and area respiratory (group IV) patterns. More than half of the patients had a linear breathing trajectory. Analyzing all patients together, the intra-amplitudes were slightly less than those of the inter-amplitudes. The amplitude from large to small was in the superior-inferior, left-right and anterior-posterior directions, regardless of inter- and intra-amplitudes. Then, patients with a larger peak-to-peak have a larger standard deviation of amplitude and a larger amplitude in all fractions/sessions. The prediction errors of the linear motion trajectory were generally less than 1 mm. The prediction errors of the regular hysteresis breathing model were smaller than those of the irregular hysteresis model. Scattered breathing would result in a larger tracking error, such as the area respiratory trajectory. It was logical that prediction errors were larger for patients who showed much variation in their breathing amplitude.

CONCLUSIONS

This paper showed that the liver motion trajectory model included perfect linearity, sample linearity, hysteresis, and area. The linear motion trajectory presented the minimum tracking error and the best stability, and the hysteresis and area trajectory were the worst. Therefore, breathing management, including respiration training, control, and evaluation of motion trajectory in all directions, was significantly necessary during liver SABR treatment.