Real-time automatic fiducial marker tracking in low contrast cine-MV images

A review of artificial intelligence applications for motion tracking in radiotherapy

During radiotherapy, the organs and tumour move as a result of the dynamic nature of the body; this is known as intrafraction motion. Intrafraction motion can result in tumour underdose and healthy tissue overdose, thereby reducing the effectiveness of the treatment while increasing toxicity to the patients. There is a growing appreciation of intrafraction target motion management by the radiation oncology community. Real-time image-guided radiation therapy (IGRT) can track the target and account for the motion, improving the radiation dose to the tumour and reducing the dose to healthy tissue. Recently, artificial intelligence (AI)-based approaches have been applied to motion management and have shown great potential. In this review, four main categories of motion management using AI are summarised: marker-based tracking, markerless tracking, full anatomy monitoring and motion prediction. Marker-based and markerless tracking approaches focus on tracking the individual target throughout the treatment. Full anatomy algorithms monitor for intrafraction changes in the full anatomy within the field of view. Motion prediction algorithms can be used to account for the latencies due to the time for the system to localise, process and act.

Couch and multileaf collimator tracking: A clinical feasibility study for pancreas and liver treatment

PURPOSE

Real-time tumor tracking through active correction by the multileaf collimator or treatment couch offers a promising strategy to mitigate delivery uncertainty due to intrafractional tumor motion. This study evaluated the performance of MLC and couch tracking using the prototype iTools Tracking system in TrueBeam Developer Mode and the application for abdominal cancer treatments.

METHODS

Experiments were carried out using a phantom with embedded Calypso transponders and a motion simulation platform. Geometric evaluations were performed using a circular conformal field with sinusoidal traces and pancreatic tumor motion traces. Geometric tracking accuracy was retrospectively calculated by comparing the compensational MLC or couch motion extracted from machine log files to the target motion reconstructed from real-time MV and kV images. Dosimetric tracking accuracy was measured with radiochromic films using clinical abdominal VMAT plans and pancreatic tumor traces.

RESULTS

Geometrically, the root-mean-square errors for MLC tracking were 0.5 and 1.8 mm parallel and perpendicular to leaf travel direction, respectively. Couch tracking, in contrast, showed an average of 0.8 mm or less geometric error in all directions. Dosimetrically, both MLC and couch tracking reduced motion-induced local dose errors compared to no tracking. Evaluated with five pancreatic tumor motion traces, the average 2%/2 mm global gamma pass rate of eight clinical abdominal VMAT plans was 67.4% (range: 26.4%-92.7%) without tracking, which was improved to 86.0% (range: 67.9%-95.6%) with MLC tracking, and 98.1% (range: 94.9%-100.0%) with couch tracking. In 16 out of 40 deliveries with different plans and motion traces, MLC tracking did not achieve clinically acceptable dosimetric accuracy with 3%/3mm gamma pass rate below 95%.

CONCLUSIONS

This study demonstrated the capability of MLC and couch tracking to reduce motion-induced dose errors in abdominal cases using a prototype tracking system. Clinically significant dose errors were observed with MLC tracking for certain plans which could be attributed to the inferior MLC tracking accuracy in the direction perpendicular to leaf travel, as well as the interplay between motion tracking and plan delivery for highly modulated plans. Couch tracking outperformed MLC tracking with consistently high dosimetric accuracy in all plans evaluated, indicating its clinical potential in the treatment of abdominal cancers.

Real-time intrafraction motion monitoring in external beam radiotherapy

Radiotherapy (RT) aims to deliver a spatially conformal dose of radiation to tumours while maximizing the dose sparing to healthy tissues. However, the internal patient anatomy is constantly moving due to respiratory, cardiac, gastrointestinal and urinary activity. The long term goal of the RT community to 'see what we treat, as we treat' and to act on this information instantaneously has resulted in rapid technological innovation. Specialized treatment machines, such as robotic or gimbal-steered linear accelerators (linac) with in-room imaging suites, have been developed specifically for real-time treatment adaptation. Additional equipment, such as stereoscopic kilovoltage (kV) imaging, ultrasound transducers and electromagnetic transponders, has been developed for intrafraction motion monitoring on conventional linacs. Magnetic resonance imaging (MRI) has been integrated with cobalt treatment units and more recently with linacs. In addition to hardware innovation, software development has played a substantial role in the development of motion monitoring methods based on respiratory motion surrogates and planar kV or Megavoltage (MV) imaging that is available on standard equipped linacs. In this paper, we review and compare the different intrafraction motion monitoring methods proposed in the literature and demonstrated in real-time on clinical data as well as their possible future developments. We then discuss general considerations on validation and quality assurance for clinical implementation. Besides photon RT, particle therapy is increasingly used to treat moving targets. However, transferring motion monitoring technologies from linacs to particle beam lines presents substantial challenges. Lessons learned from the implementation of real-time intrafraction monitoring for photon RT will be used as a basis to discuss the implementation of these methods for particle RT.

Adaptive Imaging Versus Periodic Surveillance for Intrafraction Motion Management During Prostate Cancer Radiotherapy

Objective:

To evaluate the benefits of adaptive imaging with automatic correction compared to periodic surveillance strategies with either manual or automatic correction.

Methods:

Using Calypso trajectories from 54 patients with prostate cancer at 2 institutions, we simulated 5-field intensity-modulated radiation therapy and dual-arc volumetric-modulated arc therapy with periodic imaging at various frequencies and with continuous adaptive imaging, respectively. With manual/automatic correction, we assumed there was a 30/1 second delay after imaging to determine and apply couch shift. For adaptive imaging, real-time “dose-free” cine-MV images during beam delivery are used in conjunction with online-updated motion pattern information to estimate 3D displacement. Simultaneous MV-kV imaging is only used to confirm the estimated overthreshold motion and calculate couch shift, hence very low additional patient dose from kV imaging.

Results:

Without intrafraction intervention, the prostates could on average have moved out of a 3-mm margin for ∼20% of the beam-on time after setup imaging in current clinical situation. If the time interval from the setup imaging to beam-on can be reduced to only 30 seconds, the mean over-3 mm percentage can be reduced to ∼7%. For intensity-modulated radiation therapy simulation, with manual correction, 110 and 70 seconds imaging periods both reduced the mean over-3 mm time to ∼4%. Automatic correction could give another 1% to 2% improvement. However, with either manual or automatic correction, the maximum patient-specific over-3 mm time was still relatively high (from 6.4% to 12.6%) and those patients are actually clinically most important. In contrast, adaptive imaging with automatic intervention significantly reduced the mean percentage to 0.6% and the maximum to 2.7% and averagely only ∼1 kV image and ∼1 couch shift were needed per fraction. The results of volumetric-modulated arc therapy simulation show a similar trend to that of intensity-modulated radiation therapy.

Conclusions:

Adaptive continuous monitoring with automatic motion compensation is more beneficial than periodic imaging surveillance at similar or even less imaging dose.

Design and validation of a MV/kV imaging-based markerless tracking system for assessing real-time lung tumor motion

PURPOSE

Localizing lung tumors during treatment delivery is critical for managing respiratory motion, ensuring tumor coverage, and reducing toxicities. The purpose of this project is to develop a real-time system that performs markerless tracking of lung tumors using simultaneously acquired MV and kV images during radiotherapy of lung cancer with volumetric modulated arc therapy.

METHOD

Continuous MV/kV images were simultaneously acquired during dose delivery. In the subsequent analysis, a gantry angle-specific region of interest was defined according to the treatment aperture. After removing imaging artifacts, processed MV/kV images were directly registered to the corresponding daily setup cone-beam CT (CBCT) projections that served as reference images. The registration objective function consisted of a sum of normalized cross-correlation, weighted by the contrast-to-noise ratio of each MV and kV image. The calculated 3D shifts of the tumor were corrected by the displacements between the CBCT projections and the planning respiratory correlated CT (RCCT) to generate motion traces referred to a specific respiratory phase. The accuracy of the algorithm was evaluated on both anthropomorphic phantom and patient studies. The phantom consisted of localizing a 3D printed tumor, embedded in a thorax phantom, in an arc delivery. In an IRB-approved study, data were obtained from VMAT treatments of two lung cancer patients with three electromagnetic (Calypso) beacon transponders implanted in airways near the lung tumor.

RESULT

In the phantom study, the root mean square error (RMSE) between the registered and actual (programmed couch movement) target position was 1.2 mm measured by the MV/kV imaging system, which was smaller compared to the MV or kV alone, of 4.1 and 1.3 mm, respectively. In the patient study, the mean and standard deviation discrepancy between electromagnetic-based tumor position and the MV/KV-markerless approach was -0.2 ± 0.6 mm, 0.2 ± 1.0 mm, and -1.2 ± 1.5 mm along the superior-inferior, anterior-posterior, and left-right directions, respectively; resulting in a 3D displacement discrepancy of 2.0 ± 1.1 mm. Poor contrast around the tumor was the main contribution to registration uncertainties.

CONCLUSION

The combined MV/kV imaging system can provide real-time 3D localization of lung tumor, with comparable accuracy to the electromagnetic-based system when features of tumors are detectable. Careful design of a registration algorithm and a VMAT plan that maximizes the tumor visibility are key elements for a successful MV/KV localization strategy.

Recommendation of fiducial marker implantation for better target tracking using MV imager in prostate radiotherapy

Purpose

The aim of this study was to develop a model that optimizes the fiducial marker locations in the prostate to increase detectability of the markers in the projected EPID images during VMAT treatments.

Methods and Materials

The fiducial marker tracking capability for each arc was evaluated through a proposed formula. The output of the formula, a detectability score, was calculated with the in‐house developed software written in MATLAB (The Mathworks, Inc., Natick, MA, USA). Three unique weighting factors were added to penalize the detectability score. The detectability scores of four different patterns containing 40 combinations of simulated fiducial marker locations were evaluated with 101 previously treated prostate treatment plans (containing 202 individual arcs). The results were analyzed for each pattern group and each marker separation distance on the transverse plane.

Results

The maximum detectability of the markers occurred when they were placed between 10 and 15 mm from the center of the prostate in the transverse plane and 6–13 mm in the superior–inferior direction. The detectability decreased when the markers were placed beyond 20 mm in both directions.

Conclusions

The fiducial marker‐based detectability score can be used to predict the real‐time tracking capability. Suggestions for optimal insertion locations were given to improve prostate motion management using MV imaging.

Comparison of 2D and 3D modeled tumor motion estimation/prediction for dynamic tumor tracking during arc radiotherapy

Many real-time imaging techniques have been developed to localize a target in 3D space or in a 2D beam's eye view (BEV) plane for intrafraction motion tracking in radiation therapy. With tracking system latency, the 3D-modeled method is expected to be more accurate even in terms of 2D BEV tracking error. No quantitative analysis, however, has been reported. In this study, we simulated co-planar arc deliveries using respiratory motion data acquired from 42 patients to quantitatively compare the accuracy between 2D BEV and 3D-modeled tracking in arc therapy and to determine whether 3D information is needed for motion tracking. We used our previously developed low kV dose adaptive MV-kV imaging and motion compensation framework as a representative of 3D-modeled methods. It optimizes the balance between additional kV imaging dose and 3D tracking accuracy and solves the MLC blockage issue. With simulated Gaussian marker detection errors (zero mean and 0.39 mm standard deviation) and ~155/310/460 ms tracking system latencies, the mean percentage of time that the target moved  >2 mm from the predicted 2D BEV position are 1.1%/4.0%/7.8% and 1.3%/5.8%/11.6% for the 3D-modeled and 2D-only tracking, respectively. The corresponding average BEV RMS errors are 0.67/0.90/1.13 mm and 0.79/1.10/1.37 mm. Compared to the 2D method, the 3D method reduced the average RMS unresolved motion along the beam direction from ~3 mm to ~1 mm, resulting in on average only  <1% dosimetric advantage in the depth direction. Only for a small fraction of the patients, when tracking latency is long, the 3D-modeled method showed significant improvement of BEV tracking accuracy, indicating potential dosimetric advantage. However, if the tracking latency is short (~150 ms or less), those improvements are limited. Therefore, 2D BEV tracking has sufficient targeting accuracy for most clinical cases. The 3D technique is, however, still important in solving the MLC blockage problem during 2D BEV tracking.

Optimizing fiducial visibility on periodically acquired megavoltage and kilovoltage image pairs during prostate volumetric modulated arc therapy

PURPOSE

Robust detection of implanted fiducials is essential for monitoring intrafractional motion during hypofractionated treatment. The authors developed a plan optimization strategy to ensure clear visibility of implanted fiducials and facilitate 3D localization during volumetric modulated arc therapy (VMAT).

METHODS

Periodic kilovoltage (kV) images were acquired at 20° gantry intervals and paired with simultaneously acquired 4.4° short arc megavoltage digital tomosynthesis (MV-DTS) to localize three fiducials during VMAT delivery for hypofractionated prostate cancer treatment. Beginning with the original optimized plan, control point segments where fiducials were consistently blocked by multileaf collimator (MLC) within each 4.4° MV-DTS interval were first identified. For each segment, MLC apertures were edited to expose the fiducial that led to the least increase in the cost function. Subsequently, MLC apertures of all control points not involved with fiducial visualization were reoptimized to compensate for plan quality losses and match the original dose-volume histogram. MV dose for each MV-DTS was also kept above 0.4 MU to ensure acceptable image quality. Different imaging (gantry) intervals and visibility margins around fiducials were also evaluated.

RESULTS

Fiducials were consistently blocked by the MLC for, on average, 36% of the imaging control points for five hypofractionated prostate VMAT plans but properly exposed after reoptimization. Reoptimization resulted in negligible dosimetric differences compared with original plans and outperformed simple aperture editing: on average, PTV D98 recovered from 87% to 94% of prescription, and PTV dose homogeneity improved from 9% to 7%. Without violating plan objectives and compromising delivery efficiency, the highest imaging frequency and largest margin that can be achieved are a 10° gantry interval, and 15 mm, respectively.

CONCLUSIONS

VMAT plans can be made to accommodate MV-kV imaging of fiducials. Fiducial visualization rate and workflow efficiency are significantly improved with an automatic modification and reoptimization approach.

Simultaneous MV-kV imaging for intrafractional motion management during volumetric-modulated arc therapy delivery

The purpose of this study was to evaluate the accuracy and clinical feasibility of a motion monitoring method employing simultaneously acquired MV and kV images during volumetric-modulated arc therapy (VMAT). Short-arc digital tomosynthesis (SA-DTS) is used to improve the quality of the MV images that are then combined with orthogonally acquired kV images to assess 3D motion. An anthropomorphic phantom with implanted gold seeds was used to assess accuracy of the method under static, typical prostatic, and respiratory motion scenarios. Automatic registra-tion of kV images and single MV frames or MV SA-DTS reconstructed with arc lengths from 2° to 7° with the appropriate reference fiducial template images was performed using special purpose-built software. Clinical feasibility was evaluated by retrospectively analyzing images acquired over four or five sessions for each of three patients undergoing hypofractionated prostate radiotherapy. The standard deviation of the registration error in phantom using MV SA-DTS was similar to single MV images for the static and prostate motion scenarios (σ = 0.25 mm). Under respiratory motion conditions, the standard deviation of the registration error increased to 0.7mm and 1.7 mm for single MV and MV SA-DTS, respectively. Registration failures were observed with the respiratory scenario only and were due to motion-induced fiducial blurring. For the three patients studied, the mean and standard deviation of the difference between automatic registration using 4° MV SA-DTS and manual registration using single MV images results was 0.07±0.52mm. The MV SA-DTS results in patients were, on average, superior to single-frame MV by nearly 1 mm - significantly more than what was observed in phantom. The best MV SA-DTS results were observed with arc lengths of 3° to 4°. Registration failures in patients using MV SA-DTS were primarily due to blockage of the gold seeds by the MLC. The failure rate varied from 2% to 16%. Combined MV SA-DTS and kV imaging is feasible for intratreatment motion monitoring during VMAT of anatomic sites where limited motion is expected, and improves registration accuracy compared to single MV/kV frames. To create a clinically robust technique, further improvements to ensure visualization of fiducials at the desired control points without degradation of the treatment plan are needed.

Intrafractional 3D localization using kilovoltage digital tomosynthesis for sliding-window intensity modulated radiation therapy

To implement novel imaging sequences integrated into intensity modulated radiation therapy (IMRT) and determine 3D positions for intrafractional patient motion monitoring and management.In one method, we converted a static gantry IMRT beam into a series of arcs in which dose index and multileaf collimator positions for all control points were unchanged, but gantry angles were modified to oscillate ± 3° around the original angle. Kilovoltage (kV) projections were acquired continuously throughout delivery and reconstructed to provide a series of 6° arc digital tomosynthesis (DTS) images which served to evaluate the in-plane positions of embedded-fiducials/vertebral-body. To obtain out-of-plane positions via triangulation, a 20° gantry rotation with beam hold-off was inserted during delivery to produce a pair of 6° DTS images separated by 14°. In a second method, the gantry remained stationary, but both kV source and detector moved over a 15° longitudinal arc using pitch and translational adjustment of the robotic arms. Evaluation of localization accuracy in an anthropomorphic Rando phantom during simulated intrafractional motion used programmed couch translations from customized scripts. Purpose-built software was used to reconstruct DTS images, register them to reference template images and calculate 3D fiducial positions.No significant dose difference (<0.5%) was found between the original and converted IMRT beams. For a typical hypofractionated spine treatment, 200 single DTS (6° arc) and 10 paired DTS (20° arc) images were acquired for each IMRT beam, providing in-plane and out-of-plane monitoring every 1.6 and 34.5 s, respectively. Mean ± standard deviation error in predicted position was -0.3 ± 0.2 mm, -0.1 ± 0.1 mm in-plane, and 0.2 ± 0.4 mm out-of-plane with rotational gantry, 0.8 ± 0.1 mm, -0.7 ± 0.3 mm in-plane and 1.1 ± 0.1 mm out-of-plane with translational source/detector.Acquiring 3D fiducial positions from kV-DTS during fixed gantry IMRT is technically feasible, and is capable of providing reliable guidance for intrafractional patient motion management.

Intelligent neonatal monitoring based on a virtual thermal sensor

BACKGROUND

Temperature measurement is a vital part of daily neonatal care. Accurate measurements are important for detecting deviations from normal values for both optimal incubator and radiant warmer functioning. The purpose of monitoring the temperature is to maintain the infant in a thermoneutral environmental zone. This physiological zone is defined as the narrow range of environmental temperatures in which the infant maintains a normal body temperature without increasing his or her metabolic rate and thus oxygen consumption. Although the temperature measurement gold standard is the skin electrode, infrared thermography (IRT) should be considered as an effortless and reliable tool for measuring and mapping human skin temperature distribution and assist in assessing thermoregulatory reflexes.

METHODS

Body surface temperature was recorded under several clinical conditions using an infrared thermography imaging technique. Temperature distributions were recorded as real-time video, which was analyzed to evaluate mean skin temperatures. Emissivity variations were considered for optimal neonatal IRT correction for which the compensation vector was overlaid on the tracking algorithm to improve the temperature reading. Finally, a tracking algorithm was designed for active follow-up of the defined region of interest over a neonate's geometry.

RESULTS

The outcomes obtained from the thermal virtual sensor demonstrate its ability to accurately track different geometric profiles and shapes over the external anatomy of a neonate. Only a small percentage of the motion detection attempts failed to fit tracking scenarios due to the lack of a properly matching matrix for the ROI profile over neonate's body surface.

CONCLUSIONS

This paper presents the design and implementation of a virtual temperature sensing application that can assist neonatologists in interpreting a neonate's skin temperature patterns. Regarding the surface temperature, the influence of different environmental conditions inside the incubator has been confirming.