Accuracy of finite element model-based multi-organ deformable image registration

Fully automated deep learning based auto-contouring of liver segments and spleen on contrast-enhanced CT images

Manual delineation of liver segments on computed tomography (CT) images for primary/secondary liver cancer (LC) patients is time-intensive and prone to inter/intra-observer variability. Therefore, we developed a deep-learning-based model to auto-contour liver segments and spleen on contrast-enhanced CT (CECT) images. We trained two models using 3d patch-based attention U-Net ([Formula: see text] and 3d full resolution of nnU-Net ([Formula: see text] to determine the best architecture ([Formula: see text]. BA was used with vessels ([Formula: see text] and spleen ([Formula: see text] to assess the impact on segment contouring. Models were trained, validated, and tested on 160 ([Formula: see text]), 40 ([Formula: see text]), 33 ([Formula: see text]), 25 (CCH) and 20 (CPVE) CECT of LC patients. [Formula: see text] outperformed [Formula: see text] across all segments with median differences in Dice similarity coefficients (DSC) ranging 0.03-0.05 (p < 0.05). [Formula: see text], and [Formula: see text] were not statistically different (p > 0.05), however, both were slightly better than [Formula: see text] by DSC up to 0.02. The final model, [Formula: see text], showed a mean DSC of 0.89, 0.82, 0.88, 0.87, 0.96, and 0.95 for segments 1, 2, 3, 4, 5-8, and spleen, respectively on entire test sets. Qualitatively, more than 85% of cases showed a Likert score [Formula: see text] 3 on test sets. Our final model provides clinically acceptable contours of liver segments and spleen which are usable in treatment planning.

Ablative margin quantification using deformable versus rigid image registration in colorectal liver metastasis thermal ablation: a retrospective single-center study

PURPOSE

To investigate the correlation of minimal ablative margin (MAM) quantification using biomechanical deformable (DIR) versus intensity-based rigid image registration (RIR) with local outcomes following colorectal liver metastasis (CLM) thermal ablation.

METHODS

This retrospective single-institution study included consecutive patients undergoing thermal ablation between May 2016 and October 2021. Patients who did not have intraprocedural pre- and post-ablation contrast-enhanced CT images for MAM quantification or follow-up period less than 1 year without residual tumor or local tumor progression (LTP) were excluded. DIR and RIR methods were used to quantify the MAM. The registration accuracy was compared using Dice similarity coefficient (DSC). Area under the receiver operating characteristic curve (AUC) was used to test MAM in predicting local tumor outcomes.

RESULTS

A total of 72 patients (mean age 57; 44 men) with 139 tumors (mean diameter 1.5 cm ± 0.8 (SD)) were included. During a median follow-up of 29.4 months, there was one residual unablated tumor and the LTP rate was 17% (24/138). The ranges of DSC were 0.96-0.98 and 0.67-0.98 for DIR and RIR, respectively (p < 0.001). When using DIR, 27 (19%) tumors were partially or totally registered outside the liver, compared to 46 (33%) with RIR. Using DIR versus RIR, the corresponding median MAM was 4.7 mm versus 4.0 mm, respectively (p = 0.5). The AUC in predicting residual tumor and 1-year LTP for DIR versus RIR was 0.89 versus 0.72, respectively (p < 0.001).

CONCLUSION

Ablative margin quantified on intra-procedural CT imaging using DIR method outperformed RIR for predicting local outcomes of CLM thermal ablation.

CLINICAL RELEVANCE STATEMENT

The study supports the role of biomechanical deformable image registration as the preferred image registration method over rigid image registration for quantifying minimal ablative margins using intraprocedural contrast-enhanced CT images.

KEY POINTS

• Accurate and reproducible image registration is a prerequisite for clinical application of image-based ablation confirmation methods. • When compared to intensity-based rigid image registration, biomechanical deformable image registration for minimal ablative margin quantification was more accurate for liver registration using intraprocedural contrast-enhanced CT images. • Biomechanical deformable image registration outperformed intensity-based rigid image registration for predicting local tumor outcomes following colorectal liver metastasis thermal ablation.

Exteriorization of the uterus reduces fetoscopic cannula-induced stress and strain: A finite element model analysis

OBJECTIVE

To estimate stresses and strains in the uterine wall and fetal membranes with single/multi-port fetoscopy, simulating either a percutaneous access or via exteriorized uterus.

STUDY DESIGN

Finite element models based on anatomical dimensions, material properties and boundary conditions were created to simulate stresses, strains and displacements on the uterine wall and fetal membranes during simulated fetal surgery either via exteriorized uterus or percutaneous approach, and with one or three cannulas. Clinically, we measured the anatomical layer thickness and cannula entry point displacement in patients undergoing single port percutaneous fetoscopy.

RESULTS

Simulations demonstrate that single port percutaneous fetoscopy increases stress on the fetal membranes (+105%, 128 to 262 kPa) and uterine wall (+115%, 0.89 to 1.9 kPa) compared to exteriorized uterine access. Using three ports increases stress by 110% (148 to 312 kPa) on membranes and 113% (1.08 to 2.3 kPa) on uterine wall. Finite Element Method showed 0.75 cm uterine entry point displacement from the cutaneous entry, while clinical measurements demonstrated displacement of more than double (1.69 ± 0.58 cm), suggesting modeled measurements may be underestimations.

CONCLUSION

The stresses and strains on the fetal membranes and uterus are double as high when entering percutaneously than via an exteriorized uterus. Based on what can be clinically measured, this may be an underestimation.

Deep learning based uncertainty prediction of deformable image registration for contour propagation and dose accumulation in online adaptive radiotherapy

Objective.Online adaptive radiotherapy aims to fully leverage the advantages of highly conformal therapy by reducing anatomical and set-up uncertainty, thereby alleviating the need for robust treatments. This requires extensive automation, among which is the use of deformable image registration (DIR) for contour propagation and dose accumulation. However, inconsistencies in DIR solutions between different algorithms have caused distrust, hampering its direct clinical use. This work aims to enable the clinical use of DIR by developing deep learning methods to predict DIR uncertainty and propagating it into clinically usable metrics.Approach.Supervised and unsupervised neural networks were trained to predict the Gaussian uncertainty of a given deformable vector field (DVF). Since both methods rely on different assumptions, their predictions differ and were further merged into a combined model. The resulting normally distributed DVFs can be directly sampled to propagate the uncertainty into contour and accumulated dose uncertainty.Main results.The unsupervised and combined models can accurately predict the uncertainty in the manually annotated landmarks on the DIRLAB dataset. Furthermore, for 5 patients with lung cancer, the propagation of the predicted DVF uncertainty into contour uncertainty yielded for both methods anexpected calibration errorof less than 3%. Additionally, theprobabilisticly accumulated dose volume histograms(DVH) encompass well the accumulated proton therapy doses using 5 different DIR algorithms. It was additionally shown that the unsupervised model can be used for different DIR algorithms without the need for retraining.Significance.Our work presents first-of-a-kind deep learning methods to predict the uncertainty of the DIR process. The methods are fast, yield high-quality uncertainty estimates and are useable for different algorithms and applications. This allows clinics to use DIR uncertainty in their workflows without the need to change their DIR implementation.

Prediction of the biomechanical behaviour of the lumbar spine under multi-axis whole-body vibration using a whole-body finite element model

Low back pain has been reported to have a high prevalence among occupational drivers. Whole-body vibration during the driving environment has been found to be a possible factor leading to low back pain. Vibration loads might lead to degeneration and herniation of the intervertebral disc, which would increase incidence of low back problems among drivers. Some previous studies have reported the effects of whole-body vibration on the human body, but studies on the internal dynamic responses of the lumbar spine under multi-axis vibration are limited. In this study, the internal biomechanical response of the intervertebral disc was extracted to investigate the biomechanical behaviour of the lumbar spine under a multi-axial vibration in a whole-body environment. A whole-body finite element model, including skin, soft tissues, the bone skeleton, internal organs and a detailed ligamentous lumbar spine, was used to provide a whole-body condition for analyses. The results showed that both vibrations close to vertical and fore-and-aft resonance frequencies would increase the transmission of vibrations in the intervertebral disc, and vertical vibration might have a greater effect on the lumbar spine than fore-and-aft vibration. The larger deformation of the posterior region of the intervertebral disc in a multi-axis vibration environment might contribute to the higher susceptibility of the posterior region of the intervertebral disc to injury. The findings of this study revealed the dynamic behaviours of the lumbar spine in multi-axis vehicle vibration conditions, and suggested that both vertical and fore-and-aft vibration should be considered for protecting the lumbar health of occupational drivers.

Development and CT image-domain validation of a computational lung lesion model for use in virtual imaging trials

PURPOSE

Computational abnormalities (e.g., lesion models) for use in medical imaging simulation studies are frequently generated using data collected from clinical images. Although this approach allows for highly-customizable lesion detectability studies on clinical computed tomography (CT) data, the ground-truth lesion models produced with this method do not provide a sufficiently realistic lesion morphology for use with current anthropomorphic simulation studies. This work is intended to demonstrate that the new anatomically-informed lesion model presented here is not inferior to the previous lesion model under CT imaging, and can therefore provide a more biologically-informed model for use with simulated CT imaging studies.

METHODS

The lesion model was simulated initially from a seed cell with 10 μm diameter placed in an anatomical location within segmented lung CT and was allowed to reproduce locally within the available solid angle in discrete time-intervals (corresponding to synchronous cell cycles) up to a size of ∼200 μm in diameter. Daughter cells of generation G were allowed also to reproduce on the next available time-step given sufficient space. At lesion sizes beyond 200 μm in diameter, the health of subregions of cells were tracked with a Markov chain technique, indicating which regions were likely to continue growing, which were likely stable, and which were likely to develop necrosis given their proximity to anatomical features and other lesion cells. For lesion sizes beyond 500 μm, the lesion was represented with three nested, triangulated surfaces (corresponding to proliferating, dormant, and necrotic regions), indicating how discrete volumes of the lesion were behaving at a particular time. Lesions were then assigned smoothly-varying material properties based on their cellular level health in each region, resulting in a multi-material lesion model. The lesions produced with this model were then voxelized and placed into lung CT images for comparison with both prior work and clinical data. This model was subject to an observer study in which cardiothoracic imaging radiologists assessed the realism of both clinical and synthetic lesions in CT images.

RESULTS

The useable outputs of this work were voxel- or surface-based, validated, computational lesions, at a scale clearly visible on clinical CT (3-4 cm). Analysis of the observer study results indicated that the computationally-generated lesions were indistinguishable from clinical lesions (AUC = 0.49, 95% CI = [0.36, 0.61]) and non-inferior to an earlier image-based lesion model-indicating the advantage of the model for use in both hybrid CT images and in simulated CT imaging of the lungs.

CONCLUSIONS

Results indicated the non-inferiority of this model as compared to previous methods, indicating the utility of the model for use in both hybrid CT images and in simulated CT imaging.

Ablative Margins of Colorectal Liver Metastases Using Deformable CT Image Registration and Autosegmentation

Background Confirming ablation completeness with sufficient ablative margin is critical for local tumor control following colorectal liver metastasis (CLM) ablation. An image-based confirmation method considering patient- and ablation-related biomechanical deformation is an unmet need. Purpose To evaluate a biomechanical deformable image registration (DIR) method for three-dimensional (3D) minimal ablative margin (MAM) quantification and the association with local disease progression following CT-guided CLM ablation. Materials and Methods This single-institution retrospective study included patients with CLM treated with CT-guided microwave or radiofrequency ablation from October 2015 to March 2020. A biomechanical DIR method with AI-based autosegmentation of liver, tumors, and ablation zones on CT images was applied for MAM quantification retrospectively. The per-tumor incidence of local disease progression was defined as residual tumor or local tumor progression. Factors associated with local disease progression were evaluated using the multivariable Fine-Gray subdistribution hazard model. Local disease progression sites were spatially localized with the tissue at risk for tumor progression (<5 mm) using a 3D ray-tracing method. Results Overall, 213 ablated CLMs (mean diameter, 1.4 cm) in 124 consecutive patients (mean age, 57 years ± 12 [SD]; 69 women) were evaluated, with a median follow-up interval of 25.8 months. In ablated CLMs, an MAM of 0 mm was depicted in 14.6% (31 of 213), from greater than 0 to less than 5 mm in 40.4% (86 of 213), and greater than or equal to 5 mm in 45.1% (96 of 213). The 2-year cumulative incidence of local disease progression was 72% for 0 mm and 12% for greater than 0 to less than 5 mm. No local disease progression was observed for an MAM greater than or equal to 5 mm. Among 117 tumors with an MAM less than 5 mm, 36 had local disease progression and 30 were spatially localized within the tissue at risk for tumor progression. On multivariable analysis, an MAM of 0 mm (subdistribution hazard ratio, 23.3; 95% CI: 10.8, 50.5; P < .001) was independently associated with local disease progression. Conclusion Biomechanical deformable image registration and autosegmentation on CT images enabled identification and spatial localization of colorectal liver metastases at risk for local disease progression following ablation, with a minimal ablative margin greater than or equal to 5 mm as the optimal end point. © RSNA, 2023 Supplemental material is available for this article. See also the editorial by Sofocleous in this issue.

Dose accumulation for MR-guided adaptive radiotherapy: From practical considerations to state-of-the-art clinical implementation

MRI-linear accelerator (MR-linac) devices have been introduced into clinical practice in recent years and have enabled MR-guided adaptive radiation therapy (MRgART). However, by accounting for anatomical changes throughout radiation therapy (RT) and delivering different treatment plans at each fraction, adaptive radiation therapy (ART) highlights several challenges in terms of calculating the total delivered dose. Dose accumulation strategies-which typically involve deformable image registration between planning images, deformable dose mapping, and voxel-wise dose summation-can be employed for ART to estimate the delivered dose. In MRgART, plan adaptation on MRI instead of CT necessitates additional considerations in the dose accumulation process because MRI pixel values do not contain the quantitative information used for dose calculation. In this review, we discuss considerations for dose accumulation specific to MRgART and in relation to current MR-linac clinical workflows. We present a general dose accumulation framework for MRgART and discuss relevant quality assurance criteria. Finally, we highlight the clinical importance of dose accumulation in the ART era as well as the possible ways in which dose accumulation can transform clinical practice and improve our ability to deliver personalized RT.

Optimization of mesh generation for geometric accuracy, robustness, and efficiency of biomechanical-model-based deformable image registration

BACKGROUND

Successful generation of biomechanical-model-based deformable image registration (BM-DIR) relies on user-defined parameters that dictate surface mesh quality. The trial-and-error process to determine the optimal parameters can be labor-intensive and hinder DIR efficiency and clinical workflow.

PURPOSE

To identify optimal parameters in surface mesh generation as boundary conditions for a BM-DIR in longitudinal liver and lung CT images to facilitate streamlined image registration processes.

METHODS

Contrast-enhanced CT images of 29 colorectal liver cancer patients and end-exhale four-dimensional CT images of 26 locally advanced non-small cell lung cancer patients were collected. Different combinations of parameters that determine the triangle mesh quality (voxel side length and triangle edge length) were investigated. The quality of DIRs generated using these parameters was evaluated with metrics for geometric accuracy, robustness, and efficiency. Metrics for geometric accuracy included target registration error (TRE) of internal vessel bifurcations, dice similar coefficient (DSC), mean distance to agreement (MDA), Hausdorff distance (HD) for organ contours, and number of vertices in the triangle mesh. American Association of Physicists in Medicine Task Group 132 was used to ensure parameters met TRE, DSC, MDA recommendations before the comparison among the parameters. Robustness was evaluated as the success rate of DIR generation, and efficiency was evaluated as the total time to generate boundary conditions and compute finite element analysis.

RESULTS

Voxel side length of 0.2 cm and triangle edge length of 3 were found to be the optimal parameters for both liver and lung, with success rate of 1.00 and 0.98 and average DIR computation time of 100 and 143 s, respectively. For this combination, the average TRE, DSC, MDA, and HD were 0.38-0.40, 0.96-0.97, 0.09-0.12, and 0.87-1.17 mm, respectively.

CONCLUSION

The optimal parameters were found for the analyzed patients. The decision-making process described in this study serves as a recommendation for BM-DIR algorithms to be used for liver and lung. These parameters can facilitate consistence in the evaluation of published studies and more widespread utilization of BM-DIR in clinical practice.

Phantom-based Quality Assurance of a Clinical Dose Accumulation Technique Used in an Online Adaptive Radiation Therapy Platform

Purpose

This study aimed to develop a routine quality assurance method for a dose accumulation technique provided by a radiation therapy platform for online treatment adaptation.

Methods and Materials

Two commonly used phantoms were selected for the dose accumulation QA: Electron density and anthropomorphic pelvis. On a computed tomography (CT) scan of the electron density phantom, 1 target (gross tumor volume [GTV]; insert at 6 o'clock), a subvolume within this target, and 7 organs at risk (OARs; other inserts) were contoured in the treatment planning system (TPS). Two adaptation sessions were performed in which the GTV was recontoured, first at 7 o'clock and then at 5 o'clock. The accumulated dose was exported from the TPS after delivery. Deformable vector fields were also exported to manually accumulate doses for comparison. For the pelvis phantom, synthetic Gaussian deformations were applied to the planning CT image to simulate organ changes. Two single-fraction adaptive plans were created based on the deformed planning CT and cone beam CT images acquired onboard the radiation therapy platform. A manual dose accumulation was performed after delivery using the exported deformable vector fields for comparison with the system-generated result.

Results

All plans were successfully delivered, and the accumulated dose was both manually calculated and derived from the TPS. For the electron density phantom, the average mean dose differences in the GTV, boost volume, and OARs 1 to 7 were 0.0%, -0.2%, 92.0%, 78.4%, 1.8%, 1.9%, 0.0%, 0.0%, and 2.3%, respectively, between the manually summed and platform-accumulated doses. The gamma passing rates for the 3-dimensional dose comparison between the manually generated and TPS-provided dose accumulations were >99% for both phantoms.

Conclusions

This study demonstrated agreement between manually obtained and TPS-generated accumulated doses in terms of both mean structure doses and local 3-dimensional dose distributions. Large disagreements were observed for OAR1 and OAR2 defined on the electron density phantom due to OARs having lower deformation priority over the target in addition to artificially large changes in position induced for these structures fraction-by-fraction. The tests applied in this study to a commercial platform provide a straightforward approach toward the development of routine quality assurance of dose accumulation in online adaptation.

Computational Analysis of Cardiac Contractile Function

PURPOSE OF REVIEW

Heart failure results in the high incidence and mortality all over the world. Mechanical properties of myocardium are critical determinants of cardiac function, with regional variations in myocardial contractility demonstrated within infarcted ventricles. Quantitative assessment of cardiac contractile function is therefore critical to identify myocardial infarction for the early diagnosis and therapeutic intervention.

RECENT FINDINGS

Current advancement of cardiac functional assessments is in pace with the development of imaging techniques. The methods tailored to advanced imaging have been widely used in cardiac magnetic resonance, echocardiography, and optical microscopy. In this review, we introduce fundamental concepts and applications of representative methods for each imaging modality used in both fundamental research and clinical investigations. All these methods have been designed or developed to quantify time-dependent 2-dimensional (2D) or 3D cardiac mechanics, holding great potential to unravel global or regional myocardial deformation and contractile function from end-systole to end-diastole. Computational methods to assess cardiac contractile function provide a quantitative insight into the analysis of myocardial mechanics during cardiac development, injury, and remodeling.

Effect of whole-body vibration at different frequencies on the lumbar spine: A finite element study based on a whole human body model

Many previous studies have found that occupational drivers commonly suffered from low back pain, and low back pain and degeneration of the intervertebral disc might be associated with vibration conditions. However, the biomechanical mechanisms of whole-body vibration that caused pain and injury were not clear. In this study, a validated whole human body finite element model was used, and vibration loads at frequencies of 3, 5, 7 and 9 Hz were loaded to evaluate the frequency effects on the spine. The results showed that the responses of the spine were strong at the 5 Hz vibration load. Vibration loads would produce alternating stresses and bulges in the annulus fibrosus and change the direction of the pressure in the nucleus pulposus. The posterior region of the intervertebral disc showed greater stress fluctuations than the anterior region. The Risk Factors showed that long-term exposure to whole-body vibrations at 5 and 7 Hz might have greater adverse effects on the spine. The findings of this study confirmed that vibrations near the resonance frequency of the human body would cause more injuries to the spine than other frequencies. Alternating stress and bulge might cause fatigue and the degeneration of the intervertebral disc, which might be the mechanisms of spinal injury caused by whole-body vibration, and the posterior regions of the intervertebral disc were more susceptible to degeneration. Some appropriate measures should be taken to reduce the adverse effects of whole-body vibration on spinal health.

Leveraging deep learning-based segmentation and contours-driven deformable registration for dose accumulation in abdominal structures

PURPOSE

Discrepancies between planned and delivered dose to GI structures during radiation therapy (RT) of liver cancer may hamper the prediction of treatment outcomes. The purpose of this study is to develop a streamlined workflow for dose accumulation in a treatment planning system (TPS) during liver image-guided RT and to assess its accuracy when using different deformable image registration (DIR) algorithms.

MATERIALS AND METHODS

Fifty-six patients with primary and metastatic liver cancer treated with external beam radiotherapy guided by daily CT-on-rails (CTOR) were retrospectively analyzed. The liver, stomach and duodenum contours were auto-segmented on all planning CTs and daily CTORs using deep-learning methods. Dose accumulation was performed for each patient using scripting functionalities of the TPS and considering three available DIR algorithms based on: (i) image intensities only; (ii) intensities + contours; (iii) a biomechanical model (contours only). Planned and accumulated doses were converted to equivalent dose in 2Gy (EQD2) and normal tissue complication probabilities (NTCP) were calculated for the stomach and duodenum. Dosimetric indexes for the normal liver, GTV, stomach and duodenum and the NTCP values were exported from the TPS for analysis of the discrepancies between planned and the different accumulated doses.

RESULTS

Deep learning segmentation of the stomach and duodenum enabled considerable acceleration of the dose accumulation process for the 56 patients. Differences between accumulated and planned doses were analyzed considering the 3 DIR methods. For the normal liver, stomach and duodenum, the distribution of the 56 differences in maximum doses (D2%) presented a significantly higher variance when a contour-driven DIR method was used instead of the intensity only-based method. Comparing the two contour-driven DIR methods, differences in accumulated minimum doses (D98%) in the GTV were >2Gy for 15 (27%) of the patients. Considering accumulated dose instead of planned dose in standard NTCP models of the duodenum demonstrated a high sensitivity of the duodenum toxicity risk to these dose discrepancies, whereas smaller variations were observed for the stomach.

CONCLUSION

This study demonstrated a successful implementation of an automatic workflow for dose accumulation during liver cancer RT in a commercial TPS. The use of contour-driven DIR methods led to larger discrepancies between planned and accumulated doses in comparison to using an intensity only based DIR method, suggesting a better capability of these approaches in estimating complex deformations of the GI organs.

A newly developed image fusion algorithm between CECT image and CT image: A feasibility study

Cancer cases have been on the rise over the world. Cancer treatment can benefit from an early accurate diagnosis. Percutaneous needle biopsy under the guidance of CT images is the most common method to obtain tumor samples for accurate diagnosis. However, due to the lack of vascular information in the CT images, the biopsy procedure is at great risk, especially for the tumor surrounded by vessels. In this study, a biomechanical model and surface elastic registration-based fusion algorithm were developed to map the vessels from contrast-enhanced CT images of the liver and lung to the corresponded CT image. Radiologists could observe vessels in the CT images during the biopsy procedure so that the risk can be decreased. The developed algorithm was tested through 20 groups of lung data and 16 groups of liver data. The results show that the fusion errors (mean ± standard deviation) were 2.35 ± 0.85, 2.08 ± 0.41, 2.31 ± 0.49, and 2.37 ± 0.62 mm for portal vein, hepatic vein, pulmonary artery, and pulmonary vein, respectively. The accuracy of this method was satisfied in clinical application

Modeling of Respiratory Motion to Support the Minimally Invasive Destruction of Liver Tumors

OBJECTIVE

Respiratory movements are a significant factor that may hinder the use of image navigation systems during minimally invasive procedures used to destroy focal lesions in the liver. This article aims to present a method of estimating the displacement of the target point due to respiratory movements during the procedure, working in real time.

METHOD

The real-time method using skin markers and non-rigid registration algorithms has been implemented and tested for various classes of transformation. The method was validated using clinical data from 21 patients diagnosed with liver tumors. For each patient, each marker was treated as a target and the remaining markers as target position predictors, resulting in 162 configurations and 1095 respiratory cycles analyzed. In addition, the possibility of estimating the respiratory phase signal directly from intraoperative US images and the possibility of synchronization with the 4D CT respiratory sequence are also presented, based on ten patients.

RESULTS

The median value of the target registration error (TRE) was 3.47 for the non-rigid registration method using the combination of rigid transformation and elastic body spline curves, and an adaptation of the assessing quality using image registration circuits (AQUIRC) method. The average maximum distance was 3.4 (minimum: 1.6, maximum 6.8) mm.

CONCLUSIONS

The proposed method obtained promising real-time TRE values. It also allowed for the estimation of the TRE at a given geometric margin level to determine the estimated target position. Directions for further quantitative research and the practical possibility of combining both methods are also presented.

Development of a quantitative analysis method for assessing patient body surface deformation using an optical surface tracking system

This study aimed to develop a new method to quantitatively analyze body shape changes in patients during radiotherapy without additional radiation exposure using an optical surface tracking system. This method's accuracy was evaluated using a cubic phantom with a known shift. Surface images of three-dimensionally printed phantoms, which simulated the head and neck shapes of real patients before and after treatment, were used to create a deformation surface area histogram. The near-maximum deformation value covering an area of 2 cm² in the surface image (Def-2cm²) was calculated. A volumetric modulated arc therapy (VMAT) plan was also created on the pre-treatment phantom, and the dose distribution was recalculated on the post-treatment phantom to compare the dose indices. Surface images of four patients were analyzed to evaluate Def-2cm² and examine whether this method can be used in clinical cases. Experiments with the cubic phantom resulted in a mean deformation error of 0.08 mm. With head and neck phantoms, the Def-2cm² value was 17.5 mm, and the dose that covered 95% of the planning target volume in the VMAT plan decreased by 11.7%, indicating that deformation of the body surface may affect the dose distribution. Although analysis of the clinical data showed no clinically relevant deformation in any of the cases, slight skin sagging and respiratory changes in the body surface were observed. The proposed method can quantitatively and accurately evaluate the deformation of a body surface. This method is expected to be used to make decisions regarding modifications to treatment plans.

Accuracy and consistency of intensity-based deformable image registration in 4DCT for tumor motion estimation in liver radiotherapy planning

We investigate the accuracy of intensity-based deformable image registration (DIR) for tumor localization in liver stereotactic body radiotherapy (SBRT). We included 4DCT scans to capture the breathing motion of eight patients receiving SBRT for liver metastases within a retrospective clinical study. Each patient had three fiducial markers implanted. The liver and the tumor were delineated in the mid-ventilation phase, and their positions in the other phases were estimated with deformable image registration. We tested referenced and sequential registrations strategies. The fiducial markers were the gold standard to evaluate registration accuracy. The registration errors related to measured versus estimated fiducial markers showed a mean value less than 1.6mm. The positions of some fiducial markers appeared not stable on the 4DCT throughout the respiratory phases. Markers’ center of mass tends to be a more reliable measurement. Distance errors of tumor location based on registration versus markers center of mass were less than 2mm. There were no statistically significant differences between the reference and the sequential registration, i.e., consistency and errors were comparable to resolution errors. We demonstrated that intensity-based DIR is accurate up to resolution level for locating the tumor in the liver during breathing motion.

Development and Validation of a Whole Human Body Finite Element Model with Detailed Lumbar Spine

OBJECTIVE

Investigations showed that low back pain of occupational drivers might be closely related to the whole-body vibration. Restricted by ethical concerns, the finite element method had become a viable alternative to invasive human experiments. Many mechanical behaviors of the human spine inside of the human body were unclear; therefore, a human whole-body finite element model might be required to better understand the lumbar behavior under whole-body vibration.

METHODS

In this study, a human whole-body finite element model with a detailed lumbar spine segment was developed. Several validations were performed to ensure the correctness of this model.

RESULTS

The results of anthropometry and geometry validation, static validation, and dynamic validation were presented in this study. The validation results showed that the whole human body model was reasonable and valid by comparing with published data.

CONCLUSIONS

The model developed in this study could reflect the biomechanical response of the human lumbar spine under vibration and could be used in further vibration analysis and offer proposals for protecting human body under whole-body vibration environment.

Deformable 3D-2D image registration and analysis of global spinal alignment in long-length intraoperative spine imaging

BACKGROUND

Spinal deformation during surgical intervention (caused by patient positioning and/or correction of malalignment) confounds conventional navigation due to assumptions of rigid transformation. Moreover, the ability to accurately quantify spinal alignment in the operating room would provide assessment of the surgical product via metrics that correlate with clinical outcome.

PURPOSE

A method for deformable 3D-2D registration of preoperative CT to intraoperative long-length tomosynthesis images is reported for accurate 3D evaluation of device placement in the presence of spinal deformation and automated evaluation of global spinal alignment (GSA).

METHODS

Long-length tomosynthesis ("Long Film", LF) images were acquired using an O-arm™ imaging system (Medtronic, Minneapolis USA). A deformable 3D-2D patient registration was developed using multi-scale masking (proceeding from the full-length image to local subvolumes about each vertebra) to transform vertebral labels and planning information from preoperative CT to the LF images. Automatic measurement of GSA [Main Thoracic Kyphosis (MThK) and Lumbar Lordosis (LL)] was obtained using a spline fit to registered labels. The "Known-Component Registration" (KC-Reg) method for device registration was adapted to the multi-scale process for 3D device localization from orthogonal LF images. The multi-scale framework was evaluated using a deformable spine phantom in which pedicle screws were inserted, and deformations were induced over a range in LL ∼25-80°. Further validation was carried out in a cadaver study with implanted pedicle screws and a similar range of spinal deformation. The accuracy of patient and device registration was evaluated in terms of 3D translational error and target registration error (TRE), respectively, and the accuracy of automatic GSA measurements were compared to manual annotation.

RESULTS

Phantom studies demonstrated accurate registration via the multi-scale framework for all vertebral levels in both the neutral and deformed spine: median (interquartile range, IQR) patient registration error was 1.1 mm (0.7-1.9 mm IQR). Automatic measures of MThK and LL agreed with manual delineation within -1.1° ± 2.2° and 0.7° ± 2.0° (mean and standard deviation), respectively. Device registration error was 0.7 mm (0.4-1.0 mm IQR) at the screw tip and 0.9° (1.0°-1.5°) about the screw trajectory. Deformable 3D-2D registration significantly outperformed conventional rigid registration (p < 0.05), which exhibited device registration error of 2.1 mm (0.8-4.1 mm) and 4.1° (1.2°-9.5°). Cadaver studies verified performance under realistic conditions, demonstrating patient registration error of 1.6 mm (0.9-2.1 mm); MThK within -4.2° ± 6.8° and LL within 1.7° ± 3.5°; and device registration error of 0.8 mm (0.5-1.9 mm) and 0.7° (0.4°-1.2°) for the multi-scale deformable method, compared to 2.5 mm (1.0-7.9 mm) and 2.3° (1.6°-8.1°) for rigid registration (p < 0.05).

CONCLUSION

The deformable 3D-2D registration framework leverages long-length intraoperative imaging to achieve accurate patient and device registration over extended lengths of the spine (up to 64 cm) even with strong anatomical deformation. The method offers a new means for quantitative validation of spinal correction (intraoperative GSA measurement) and 3D verification of device placement in comparison to preoperative images and planning data. This article is protected by copyright. All rights reserved.

Verification of morphological and physical properties for the development of a lung substitute phantom using microspheres

This paper proposes a new concept of phantom development, along with the utilization of new materials that can reproduce lung morphology and density. A lung substitute phantom using microspheres was fabricated; then, its dosimetric utility in radiotherapy was investigated, during which the density was adjusted to closely resemble the morphology of the actual human lung. Microspheres were used to reproduce alveoli, which are the main components of the lung. By changing the ratio of urethane, which is commonly used in soft tissue phantoms, to microspheres, we reproduced the density change of the lungs due to respiration. Here, we fabricated two slab-like lung substitutes to emulate commercially used phantoms. Although there is room for improvement in terms of practicality, the substitutes were easy to fabricate. Microscopic observation of the cut surface of the phantoms showed that the morphology of the phantoms mimicked the alveoli more faithfully than commercial phantoms. Furthermore, to compensate for the energy-independent mass attenuation and mass collision inhibition ability required by the tissue substitute phantom, we examined the physical properties of the phantom and confirmed that there was negligible energy dependence.

Coupled experimental and computational approach to stomach biomechanics: Towards a validated characterization of gastric tissues mechanical properties

Gastric diseases are one of the most relevant healthcare problems worldwide. Interventions and therapies definition/design mainly derive from biomedical and clinical expertise. Computational biomechanics, with particular regard to the finite element method, provides hard-to-measure quantities during in-vivo tests, such as strain and stress distribution, leading to a more comprehensive and promising approach to improve the effectiveness of many different clinical activities. However, reliable finite element models of biological organs require appropriate constitutive formulations of building tissues, whose parameters identification needs an experimental campaign consisting in different tests on human tissues and organs. The aim of the reported here research activities was the identification of mechanical properties of human gastric tissues. Human gastric specimens were tested at tissue, sub-structural and structural levels, by tensile, membrane indentation and inflation tests, respectively. On the other hand, animal experimentations on tissue layers from literature pointed out the mechanical response at sub-tissue level during tensile loading conditions. In detail, the analysis of experimental results at sub-tissue and tissue levels led to a fibre-reinforced visco-hyperelastic constitutive formulation and to the identification of gastric layers mechanical behaviour. Results from experimentations on human samples were coupled with data derived from animal models. Data from sub-structural and structural experimentations were exploited to upgrade and validate the constitutive formulations and parameters. The developed investigations led to a reliable constitutive framework of human gastric tissues that both describe stomach mechanical functionality and allow computational investigations. Indeed, the comparisons among average computational data and experimental medians provided the following RMSEs (Root Mean Square Errors): 0.89 N, 0.15 N for corpus and fundus during membrane indentation test, respectively, and 0.44 kPa during inflation test. Accounting for the magnitude of experimental and computational data, the RMSEs can be considered low and acceptable because they concerned biological samples. In fact, biological tissues and structures are affected by a high inherent inter-samples' variability, which is detectable in both the geometrical configuration and the mechanical behaviour. The specific values of the here reported RMSEs ensured the reliability of the achieved parameters and the quality of the overall developed procedure. Reliable computational models of the gastric district could become efficient clinical tools to find out the main crucial aspects of bariatric procedures, such as the mechanical stimulation of gastric mechano-receptors. Moreover, the methods of computational biomechanics will permit to run the preliminary tests of new and innovative bariatric procedures, on one hand, predicting the successful rate and the effectiveness, and, on other hand, reducing the use of animal testing.

Application of Magnetic Resonance Imaging in Liver Biomechanics: A Systematic Review

MRI-based biomechanical studies can provide a deep understanding of the mechanisms governing liver function, its mechanical performance but also liver diseases. In addition, comprehensive modeling of the liver can help improve liver disease treatment. Furthermore, such studies demonstrate the beginning of an engineering-level approach to how the liver disease affects material properties and liver function. Aimed at researchers in the field of MRI-based liver simulation, research articles pertinent to MRI-based liver modeling were identified, reviewed, and summarized systematically. Various MRI applications for liver biomechanics are highlighted, and the limitations of different viscoelastic models used in magnetic resonance elastography are addressed. The clinical application of the simulations and the diseases studied are also discussed. Based on the developed questionnaire, the papers' quality was assessed, and of the 46 reviewed papers, 32 papers were determined to be of high-quality. Due to the lack of the suitable material models for different liver diseases studied by magnetic resonance elastography, researchers may consider the effect of liver diseases on constitutive models. In the future, research groups may incorporate various aspects of machine learning (ML) into constitutive models and MRI data extraction to further refine the study methodology. Moreover, researchers should strive for further reproducibility and rigorous model validation and verification.

A novel use of biomechanical model-based deformable image registration (DIR) for assessing colorectal liver metastases ablation outcomes

Purpose:

Colorectal cancer is the third most common form of cancer in the United States, and up to 60% of these patients develop liver metastasis. While hepatic resection is the curative treatment of choice, only 20% of patients are candidates at the time of diagnosis. While percutaneous thermal ablation (PTA) has demonstrated 24%–51% overall 5-year survival rates, assurance of sufficient ablation margin delivery (5 mm) can be challenging, with current methods of 2D distance measurement not ensuring 3D minimum margin. We hypothesized that biomechanical model-based deformable image registration (DIR) can reduce spatial uncertainties and differentiate local tumor progression (LTP) patients from LTP-free patients.

Methods:

We retrospectively acquired 30 patients (16 LTP and 14 LTP-free) at our institution who had undergone PTA and had a contrast-enhanced pre-treatment and post-ablation CT scan. Liver, disease, and ablation zone were manually segmented. Biomechanical model-based DIR between the pre-treatment and post-ablation CT mapped the gross tumor volume onto the ablation zone and measured 3D minimum delivered margin (MDM). An in-house cone-tracing algorithm determined if progression qualitatively collocated with insufficient 5 mm margin achieved.

Results:

Mann–Whitney U test showed a significant difference (p < 0.01) in MDM from the LTP and LTP-free groups. A total of 93% (13/14) of patients with LTP had a correlation between progression and missing 5 mm of margin volume.

Conclusions:

Biomechanical DIR is able to reduce spatial uncertainty and allow measurement of delivered 3D MDM. This minimum margin can help ensure sufficient ablation delivery, and our workflow can provide valuable information in a clinically useful timeframe.

FEMOSSA: Patient-specific finite element simulation of the prostate-rectum spacer placement, a predictive model for prostate cancer radiotherapy

PURPOSE

Major advances in delivery systems in recent years have turned radiotherapy (RT) into a more effective way to manage prostate cancer. Still, adjacency of organs at risk (OARs) can severely limit RT benefits. Rectal spacer implant in recto-prostatic space provides sufficient separation between prostate and rectum, and therefore, the opportunity for potential dose escalation to the target and reduction of OAR dose. Pretreatment simulation of spacer placement can potentially provide decision support to reduce the risks and increase the efficacy of the spacer placement procedure.

METHODS

A novel finite element method-oriented spacer simulation algorithm, FEMOSSA, was developed in this study. We used the finite element (FE) method to model and predict the deformation of rectum and prostate wall, stemming from hydrogel injection. Ten cases of prostate cancer, which undergone hydrogel placement before the RT treatment, were included in this study. We used the pre-injection organ contours to create the FE model and post-injection spacer location to estimate the distribution of the virtual spacer. Material properties and boundary conditions specific to each patient's anatomy were assigned. The FE analysis was then performed to determine the displacement vectors of regions of interest (ROIs), and the results were validated by comparing the virtually simulated contours with the real post-injection contours. To evaluate the different aspects of our method's performance, we used three different figures of merit: dice similarity coefficient (DSC), nearest neighbor distance (NND), and overlapped volume histogram (OVH). Finally, to demonstrate a potential dosimetric application of FEMOSSA, the predicted rectal dose after virtual spacer placement was compared against the predicted post-injection rectal dose.

RESULTS

Our simulation showed a realistic deformation of ROIs. The post-simulation (virtual spacer) created the same separation between prostate and rectal wall, as post-injection spacer. The average DSCs for prostate and rectum were 0.87 and 0.74, respectively. Moreover, there was a statistically significant increase in rectal contour similarity coefficient (P < 0.01). Histogram of NNDs showed the same overall shape and a noticeable shift from lower to higher values for both post-simulation and post-injection, indicative of the increase in distance between prostate and rectum. There was less than 2.2- and 2.1-mm averaged difference between the mean and fifth percentile NNDs. The difference between the OVH distances and the corresponding predicted rectal dose was, on average, less than 1 mm and 1.5 Gy, respectively.

CONCLUSIONS

FEMOSSA provides a realistic simulation of the hydrogel injection process that can facilitate spacer placement planning and reduce the associated uncertainties. Consequently, it increases the robustness and success rate of spacer placement procedure that in turn improves prostate cancer RT quality.

Strain Energy Decay Predicts Elastic Registration Accuracy From Intraoperative Data Constraints

Image-guided intervention for soft tissue organs depends on the accuracy of deformable registration methods to achieve effective results. While registration techniques based on elastic theory are prevalent, no methods yet exist that can prospectively estimate registration uncertainty to regulate sources and mitigate consequences of localization error in deforming organs. This paper introduces registration uncertainty metrics based on dispersion of strain energy from boundary constraints to predict the proportion of target registration error (TRE) remaining after nonrigid elastic registration. These uncertainty metrics depend on the spatial distribution of intraoperative constraints provided to registration with relation to patient-specific organ geometry. Predictive linear and bivariate gamma models are fit and cross-validated using an existing dataset of 6291 simulated registration examples, plus 699 novel simulated registrations withheld for independent validation. Average uncertainty and average proportion of TRE remaining after elastic registration are strongly correlated ( r = 0.78 ), with mean absolute difference in predicted TRE equivalent to 0.9 ± 0.6 mm (cross-validation) and 0.9 ± 0.5 mm (independent validation). Spatial uncertainty maps also permit localized TRE estimates accurate to an equivalent of 3.0 ± 3.1 mm (cross-validation) and 1.6 ± 1.2 mm (independent validation). Additional clinical evaluation of vascular features yields localized TRE estimates accurate to 3.4 ± 3.2 mm. This work formalizes a lower bound for the inherent uncertainty of nonrigid elastic registrations given coverage of intraoperative data constraints, and demonstrates a relation to TRE that can be predictively leveraged to inform data collection and provide a measure of registration confidence for elastic methods.

Simulated daily plan adaptation for magnetic resonance-guided liver stereotactic body radiotherapy

INTRODUCTION

Liver cancers are challenging to treat using image-guided radiotherapy (IGRT) due to motion and deformation of target volumes and organs at risk (OARs), as well as difficulties in visualising liver tumours using cone-beam computed tomography (CBCT) based IGRT. Liver cancer patients may thus benefit from magnetic resonance (MR)-guided daily adaptive re-planning. We evaluated the dosimetric impact of a daily plan adaptation strategy based on daily MR imaging versus CBCT-based IGRT.

METHODS

Ten patients were studied who were treated with CBCT-guided five-fraction stereotactic body radiotherapy (SBRT) and underwent MR imaging before each fraction. Simulated reference plans were created on computer tomography (CT) images and adapted plans were created on the daily MR images. Two plan adaptation strategies were retrospectively simulated: (1) translational couch shifts to match liver, mimicking standard CBCT guidance and (2) daily plan adaptation based on reference plan clinical goals and daily target and OAR contours. Dose statistics were calculated for both strategies and compared.

RESULTS

Couch shifts resulted in an average reduction in GTV D99% relative to reference plan values of 5.2 Gy (-12.5% of reference values). Daily plan adaptation reduced this to 0.8 Gy (-2.0%). For six patients who were OAR dose-limited on reference plans, couch shifts resulted in OAR dose violations in 28 out of 28 simulated fractions, respectively; no violations occurred using daily plan adaptation. No OAR dose violations occurred using either strategy for the four cases not OAR dose-limited at reference planning.

CONCLUSIONS

MR-guided daily plan adaptation ensured OAR dose constraints were met at all simulated treatment fractions while CBCT-based IGRT resulted in a systematic over-dosing of OARs in patients whose doses were limited by OAR dose at the time of reference planning.

In-vivo lung biomechanical modeling for effective tumor motion tracking in external beam radiation therapy

Lung cancer is the most common cause of cancer-related death in both men and women. Radiation therapy is widely used for lung cancer treatment; however, respiratory motion presents challenges that can compromise the accuracy and/or effectiveness of radiation treatment. Respiratory motion compensation using biomechanical modeling is a common approach used to address this challenge. This study focuses on the development and validation of a lung biomechanical model that can accurately estimate the motion and deformation of lung tumor. Towards this goal, treatment planning 4D-CT images of lung cancer patients were processed to develop patient-specific finite element (FE) models of the lung to predict the patients' tumor motion/deformation. The tumor motion/deformation was modeled for a full respiration cycle, as captured by the 4D-CT scans. Parameters driving the lung and tumor deformation model were found through an inverse problem formulation. The CT datasets pertaining to the inhalation phases of respiration were used for validating the model's accuracy. The volumetric Dice similarity coefficient between the actual and simulated gross tumor volumes (GTVs) of the patients calculated across respiration phases was found to range between 0.80 ± 0.03 and 0.92 ± 0.01. The average error in estimating tumor's center of mass calculated across respiration phases ranged between 0.50 ± 0.10 (mm) and 1.04 ± 0.57 (mm), indicating a reasonably good accuracy of the proposed model. The proposed model demonstrates favorable accuracy for estimating the lung tumor motion/deformation, and therefore can potentially be used in radiation therapy applications for respiratory motion compensation.

A preliminary investigation of re-evaluating the irradiation dose in hepatocellular carcinoma radiotherapy applying 4D CT and deformable registration

Purpose

To investigate the effect of breathing motion on dose distribution for hepatocellular carcinoma (HCC) patients using four‐dimensional (4D) CT and deformable registration.

Methods

Fifty HCC patients who were going to receive radiotherapy were enrolled in this study. All patients had been treated with transarterial chemoembolization beforehand. Three‐dimensional (3D) and 4D CT scans in free breathing were acquired sequentially. Volumetric modulated arc therapy (VMAT) was planned on the 3D CT images and maximum intensity projection (MIP) images. Thus, the 3D dose (Dose‐_3D) and MIP dose (Dose‐_MIP) were obtained, respectively. Then, the Dose‐_3D and Dose‐_MIP were recalculated on 10 phases of 4D CT images, respectively, in which the end‐inhale and end‐exhale phase doses were defined as Dose‐_3D‐EI, Dose‐_3D‐EE, Dose‐_MIP‐EI, and Dose‐_MIP‐EE. The 4D dose (Dose‐_4D‐3D and Dose‐_4D‐MIP) were obtained by deforming 10 phase doses to the end‐exhale CT to accumulate. The dosimetric difference in Dose‐_3D, Dose‐_EI3D, Dose‐_EE3D, Dose‐_4D‐3D, Dose‐_MIP, Dose‐_EIMIP, Dose‐_EEMIP, and Dose‐_4D‐MIP were compared to evaluate the motion effect on dose delivery to the planning target volume (PTV) and normal liver.

Results

Compared with Dose‐_3D, PTV D99 in Dose‐_EI3D, Dose‐_EE3D and Dose‐_4D‐3D decreased by an average of 6.02%, 1.32%, 2.43%, respectively (P < 0.05); while PTV D95 decreased by an average of 3.34%, 1.51%, 1.93%, respectively (P < 0.05). However, CI and HI of the PTV in Dose‐_3D was superior to the other three distributions (P < 0.05). There was no significant differences for the PTV between Dose‐_EI and Dose‐_EE, and between the two extreme phase doses and Dose‐_4D (P> 0.05). Negligible difference was observed for normal liver in all dose distributions (P> 0.05).

Conclusions

Four‐dimensional dose calculations potentially ensure target volume coverage when breathing motion may affect the dose distribution. Dose escalation can be considered to improve the local control of HCC on the basis of accurately predicting the probability of radiation‐induced liver disease.

Accuracy of registrations between cone-beam computed tomography and conventional computed tomography images and dose mapping methods in RaySearch software for the bladder during brachytherapy of cervical cancer patients

Purpose

The aim of the study was to assess selected methods of image registration available in the RaySearch software and their impact on the accuracy of mapping of doses deposited in the bladder during brachytherapy (BRT) of cervical cancer in images used during external beam radiotherapy (EBRT).

Material and methods

The study was based on data from ten patients. Cone-beam computed tomography (CBCT) images (BRT) were aligned with CT images (EBRT) using four registration methods: Reg_1 (rigid), Reg_2a, Reg_2b (hybrid), and Reg_3 (biomechanical). Image mapping accuracy was evaluated based on bladder’s anatomy. Sørensen-Dice coefficient (DSC) values were analyzed for all the registrations. Discrepancies between triangular mesh points set on the basis of bladder contours were analyzed. Dose distributions from BRT were transformed according to registration results and mapped on CT images. Original BRT doses deposited in 2 cm³ volume of the bladder were compared to those transformed and associated with bladder’s volume determined on CT images.

Results

Mean DSC values amounted to 0.36 (Reg_1), 0.87 and 0.88 (Reg_2a and Reg_2b), and 0.97 (Reg_3). Significant differences were found between DSC for the following comparisons: Reg_3/Reg_1 (p = 0.001), Reg_2a/Reg_1 (p = 0.011), and Reg_2b/Reg_1 (p = 0.014). The lowest discrepancies between triangular mesh points were for Reg_3 (p < 0.001, Reg_3 vs. Reg_1, and p = 0.039, Reg_3 vs. Reg_2b). Finally, the lowest discrepancies between the original and transformed doses were found for Reg_3. Nevertheless, only 5 out of 10 observations for Reg_3 yielded error of less than 5%.

Conclusions

Biomechanical registration (Reg_3) enabled the most accurate alignment between CBCT and CT images. Satisfactory registration results of anatomical structures do not guarantee a correct mapping of primary BRT doses on the bladder delineated on CT images during EBRT. The results of dose transformation based on biomechanical registration had an error of less than 5% for only 50% of the observations.

Automated Contouring of Contrast and Noncontrast Computed Tomography Liver Images With Fully Convolutional Networks

PURPOSE

The deformable nature of the liver can make focal treatment challenging and is not adequately addressed with simple rigid registration techniques. More advanced registration techniques can take deformations into account (eg, biomechanical modeling) but require segmentations of the whole liver for each scan, which is a time-intensive process. We hypothesize that fully convolutional networks can be used to rapidly and accurately autosegment the liver, removing the temporal bottleneck for biomechanical modeling.

METHODS AND MATERIALS

Manual liver segmentations on computed tomography scans from 183 patients treated at our institution and 30 scans from the Medical Image Computing & Computer Assisted Intervention challenges were collected for this study. Three architectures were investigated for rapid automated segmentation of the liver (VGG-16, DeepLabv3 +, and a 3-dimensional UNet). Fifty-six cases were set aside as a final test set for quantitative model evaluation. Accuracy of the autosegmentations was assessed using Dice similarity coefficient and mean surface distance. Qualitative evaluation was also performed by 3 radiation oncologists on 50 independent cases with previously clinically treated liver contours.

RESULTS

The mean (minimum-maximum) mean surface distance for the test groups with the final model, DeepLabv3 +, were as follows: μContrast(N = 17): 0.99 mm (0.47-2.2), μNon_Contrast(N = 19)l: 1.12 mm (0.41-2.87), and μMiccai(N = 30)t: 1.48 mm (0.82-3.96). The qualitative evaluation showed that 30 of 50 autosegmentations (60%) were preferred to manual contours (majority voting) in a blinded comparison, and 48 of 50 autosegmentations (96%) were deemed clinically acceptable by at least 1 reviewing physician.

CONCLUSIONS

The autosegmentations were preferred compared with manually defined contours in the majority of cases. The ability to rapidly segment the liver with high accuracy achieved in this investigation has the potential to enable the efficient integration of biomechanical model-based registration into a clinical workflow.

Deep learning in medical image registration: a review

This paper presents a review of deep learning (DL)-based medical image registration methods. We summarized the latest developments and applications of DL-based registration methods in the medical field. These methods were classified into seven categories according to their methods, functions and popularity. A detailed review of each category was presented, highlighting important contributions and identifying specific challenges. A short assessment was presented following the detailed review of each category to summarize its achievements and future potential. We provided a comprehensive comparison among DL-based methods for lung and brain registration using benchmark datasets. Lastly, we analyzed the statistics of all the cited works from various aspects, revealing the popularity and future trend of DL-based medical image registration.

Biomechanical modeling of radiation dose-induced volumetric changes of the parotid glands for deformable image registration

PURPOSE

Early animal studies suggest that parotid gland (PG) toxicity prediction could be improved by an accurate estimation of the radiation dose to sub-regions of the PG. Translation to clinical investigation requires voxel-level dose accumulation in this organ that responds volumetrically throughout treatment. To date, deformable image registration (DIR) has been evaluated for the PG using only surface alignment. We sought to develop and evaluate an advanced DIR technique capable of modeling these complex PG volume changes over the course of radiation therapy.

MATERIALS AND METHODS

Planning and mid-treatment magnetic resonance images from 19 patients and computed tomography images from nine patients who underwent radiation therapy for head and neck cancer were retrospectively evaluated. A finite element model (FEM)-based DIR algorithm was applied between the corresponding pairs of images, based on boundary conditions on the PG surfaces only (Morfeus-spatial). To investigate an anticipated improvement in accuracy, we added a population model-based thermal expansion coefficient to simulate the dose distribution effect on the volume change inside the glands (Morfeus-spatialDose). The model accuracy was quantified using target registration error for magnetic resonance images, where corresponding anatomical landmarks could be identified. The potential clinical impact was evaluated using differences in mean dose, median dose, D98, and D50 of the PGs.

RESULTS

In the magnetic resonance images, the mean (±standard deviation) target registration error significantly reduced by 0.25 ± 0.38 mm (p = 0.01) when using Morfeus-spatialDose instead of Morfeus-spatial. In the computed tomography images, differences in the mean dose, median dose, D98, and D50 of the PGs reached 2.9 ± 0.8, 3.8, 4.1, and 3.8 Gy, respectively, between Morfeus-spatial and Morfeus-spatialDose.

CONCLUSION

Differences between Morfeus-spatial and Morfeus-spatialDose may be impactful when considering high-dose gradients of radiation in the PGs. The proposed DIR model can allow more accurate PG alignment than the standard model and improve dose estimation and toxicity prediction modeling.

Deformation Microscopy for Dynamic Intracellular and Intranuclear Mapping of Mechanics with High Spatiotemporal Resolution

Structural heterogeneity is a hallmark of living cells that drives local mechanical properties and dynamic cellular responses. However, the robust quantification of intracellular mechanics is lacking from conventional methods. Here, we describe the development of deformation microscopy, which leverages conventional imaging and an automated hyperelastic warping algorithm to investigate strain history, deformation dynamics, and changes in structural heterogeneity within the interior of cells and cell nuclei. Using deformation microscopy, we found that partial or complete disruption of LINC complexes in cardiomyocytes in vitro and lamin A/C deficiency in myocytes in vivo abrogate dominant tensile loading in the nuclear interior. We also found that cells cultured on stiff substrates or in hyperosmotic conditions displayed abnormal strain burden and asymmetries at interchromatin regions, which are associated with active transcription. Deformation microscopy represents a foundational approach toward intracellular elastography, with the potential utility to provide mechanistic and quantitative insights in diverse mechanobiological applications.

Ghosh et al. show that deformation microscopy, a technique based on image analysis and mechanics, reveals deformation dynamics and structural heterogeneity changes for several applications and at multiple scales, including tissues, cells, and nuclei. They reveal how the disruption of nuclear proteins and pathological conditions abrogate mechanical strain in the nuclear interior.

Associations between voxel-level accumulated dose and rectal toxicity in prostate radiotherapy

Background and Purpose

Associations between dose and rectal toxicity in prostate radiotherapy are generally poorly understood. Evaluating spatial dose distributions to the rectal wall (RW) may lead to improvements in dose-toxicity modelling by incorporating geometric information, masked by dose-volume histograms. Furthermore, predictive power may be strengthened by incorporating the effects of interfraction motion into delivered dose calculations.Here we interrogate 3D dose distributions for patients with and without toxicity to identify rectal subregions at risk (SRR), and compare the discriminatory ability of planned and delivered dose.

Material and Methods

Daily delivered dose to the rectum was calculated using image guidance scans, and accumulated at the voxel level using biomechanical finite element modelling. SRRs were statistically determined for rectal bleeding, proctitis, faecal incontinence and stool frequency from a training set (n = 139), and tested on a validation set (n = 47).

Results

SRR patterns differed per endpoint. Analysing dose to SRRs improved discriminative ability with respect to the full RW for three of four endpoints. Training set AUC and OR analysis produced stronger toxicity associations from accumulated dose than planned dose. For rectal bleeding in particular, accumulated dose to the SRR (AUC 0.76) improved upon dose-toxicity associations derived from planned dose to the RW (AUC 0.63). However, validation results could not be considered significant.

Conclusions

Voxel-level analysis of dose to the RW revealed SRRs associated with rectal toxicity, suggesting non-homogeneous intra-organ radiosensitivity. Incorporating spatial features of accumulated delivered dose improved dose-toxicity associations. This may be an important tool for adaptive radiotherapy in the future.

Vasculature-Driven Biomechanical Deformable Image Registration of Longitudinal Liver Cholangiocarcinoma Computed Tomographic Scans

PURPOSE

Deformable image registration (DIR) of longitudinal liver cancer computed tomographic (CT) images can be challenging owing to anatomic changes caused by radiation therapy (RT) or disease progression. We propose a workflow for the DIR of longitudinal contrast-enhanced CT scans of liver cancer based on a biomechanical model of the liver driven by boundary conditions on the liver surface and centerline of an autosegmentation of the vasculature.

METHODS AND MATERIALS

Pre- and post-RT CT scans acquired with a median gap of 112 (32-217) days for 28 patients who underwent RT for intrahepatic cholangiocarcinoma were retrospectively analyzed. For each patient, 5 corresponding anatomic landmarks in pre- and post-RT scans were identified in the liver by a clinical expert for evaluation of the accuracy of different DIR strategies. The first strategy corresponded to the use of a biomechanical model-based DIR method with boundary conditions specified on the liver surface (BM_DIR). The second strategy corresponded to the use of an expansion of BM_DIR consisting of the auto-segmentation of the liver vasculature to determine additional boundary conditions in the biomechanical model (BM_DIR_VBC). The 2 strategies were also compared with an intensity-based DIR strategy using a Demons algorithms.

RESULTS

The group mean target registration errors were 12.4 ± 7.5, 7.7 ± 3.7 and 4.4 ± 2.5 mm, for the Demons, BM_DIR and BM_DIR_VBC, respectively.

CONCLUSIONS

In regard to the large and complex deformation observed in this study and the achieved accuracy of 4.4 mm, the proposed BM_DIR_VBC method might reveal itself as a valuable tool in future studies on the relationship between delivered dose and treatment outcome.

Deformable Mapping Method to Relate Lesions in Dedicated Breast CT Images to Those in Automated Breast Ultrasound and Digital Breast Tomosynthesis Images

This work demonstrates the potential for using a deformable mapping method to register lesions between dedicated breast computed tomography (bCT) and both automated breast ultrasound (ABUS) and digital breast tomosynthesis (DBT) images (craniocaudal [CC] and mediolateral oblique [MLO] views). Two multi-modality breast phantoms with external fiducial markers attached were imaged by the three modalities. The DBT MLO view was excluded for the second phantom. The automated deformable mapping algorithm uses biomechanical modeling to determine corresponding lesions based on distances between their centers of mass (d_COM) in the deformed bCT model and the reference model (DBT or ABUS). For bCT to ABUS, the mean d_COM was 5.2 ± 2.6 mm. For bCT to DBT (CC), the mean d_COM was 5.1 ± 2.4 mm. For bCT to DBT (MLO), the mean d_COM was 4.7 ± 2.5 mm. This application could help improve a radiologist's efficiency and accuracy in breast lesion characterization, using multiple imaging modalities.

Accuracy of deformable image registration techniques for alignment of longitudinal cholangiocarcinoma CT images

PURPOSE

Response assessment of radiotherapy for the treatment of intrahepatic cholangiocarcinoma (IHCC) across longitudinal images is challenging due to anatomical changes. Advanced deformable image registration (DIR) techniques are required to correlate corresponding tissues across time. In this study, the accuracy of five commercially available DIR algorithms in four treatment planning systems (TPS) was investigated for the registration of planning images with posttreatment follow-up images for response assessment or re-treatment purposes.

METHODS

Twenty-nine IHCC patients treated with hypofractionated radiotherapy and with pretreatment and posttreatment contrast-enhanced computed tomography (CT) images were analyzed. Liver segmentations were semiautomatically generated on all CTs and the posttreatment CT was then registered to the pretreatment CT using five commercially available algorithms (Demons, B-splines, salient feature-based, anatomically constrained and finite element-based) in four TPSs. This was followed by an in-depth analysis of 10 DIR strategies (plus global and liver-focused rigid registration) in one of the TPSs. Eight of the strategies were variants of the anatomically constrained DIR while the two were based on a finite element-based biomechanical registration. The anatomically constrained techniques were combinations of: (a) initializations with the two rigid registrations; (b) two similarity metrics - correlation coefficient (CC) and mutual information (MI); and (c) with and without a controlling region of interest (ROI) - the liver. The finite element-based techniques were initialized by the two rigid registrations. The accuracy of each registration was evaluated using target registration error (TRE) based on identified vessel bifurcations. The results were statistically analyzed with a one-way analysis of variance (ANOVA) and pairwise comparison tests. Stratified analysis was conducted on the inter-TPS data (plus the liver-focused rigid registration) using treatment volume changes, slice thickness, time between scans, and abnormal lab values as stratifying factors.

RESULTS

The complex deformation observed following treatment resulted in average TRE exceeding the image voxel size for all techniques. For the inter-TPS comparison, the Demons algorithm had the lowest TRE, which was significantly superior to all the other algorithms. The respective mean (standard deviation) TRE (in mm) for the Demons, B-splines, salient feature-based, anatomically constrained, and finite element-based algorithms were 4.6 (2.0), 7.4 (2.7), 7.2 (2.6), 6.3 (2.3), and 7.5 (4.0). In the follow-up comparison of the anatomically constrained DIR, the strategy with liver-focused rigid registration initialization, CC as similarity metric and liver as a controlling ROI had the lowest mean TRE - 6.0 (2.0). The maximum TRE for all techniques exceeded 10 mm. Selection of DIR strategy was found to be a statistically significant factor for registration accuracy. Tumor volume change had a significant effect on TRE for finite element-based registration and B-splines DIR. Time between scans had a substantial effect on TRE for all registrations but was only significant for liver-focused rigid, finite element-based and salient feature-based DIRs.

CONCLUSIONS

This study demonstrates the limitations of commercially available DIR techniques in TPSs for alignment of longitudinal images of liver cancer presenting complex anatomical changes including local hypertrophy and fibrosis/necrosis. DIR in this setting should be used with caution and careful evaluation.

Evaluation of the effect of user-guided deformable image registration of thoracic images on registration accuracy among users

User-guided deformable image registration (DIR) has allowed users to actively participate in the DIR process and is expected to improve DIR accuracy. The purpose of this study was to evaluate the time required for and effect of user-guided DIR on registration accuracy for thoracic images among users. In this study, 4-dimensional computed tomographic images of 10 thoracic cancer patients were used. The dataset for these patients was provided by DIR-Lab (www.dir-lab.com) and included a coordinate list of anatomical landmarks (300 bronchial bifurcations). Four medical physicists from different institutions performed DIR between peak-inhale and peak-exhale images with/without the user-guided DIR tool, Reg Refine, implemented in MIM Maestro (MIM software, Cleveland, OH). DIR accuracy was quantified by using target registration errors (TREs) for 300 anatomical landmarks in each patient. The average TREs with user-guided DIR in the 10 images by the 4 medical physicists were 1.48, 1.80, 3.46, and 3.55 mm, respectively, whereas the TREs without user-guided DIR were 3.28, 3.45, 3.56, and 3.28 mm, respectively. The average times taken by the 4 physicists to use the user-guided DIR were 10.0, 6.7, 7.1, and 8.0 min, respectively. This study demonstrated that user-guided DIR can improve DIR accuracy and requires only a moderate amount of time (<10 min). However, 2 of the 4 users did not show much improvement in DIR accuracy, which indicated the necessity of training prior to use of user-guided DIR.

Advanced 4-dimensional cone-beam computed tomography reconstruction by combining motion estimation, motion-compensated reconstruction, biomechanical modeling and deep learning

4-Dimensional cone-beam computed tomography (4D-CBCT) offers several key advantages over conventional 3D-CBCT in moving target localization/delineation, structure de-blurring, target motion tracking, treatment dose accumulation and adaptive radiation therapy. However, the use of the 4D-CBCT in current radiation therapy practices has been limited, mostly due to its sub-optimal image quality from limited angular sampling of cone-beam projections. In this study, we summarized the recent developments of 4D-CBCT reconstruction techniques for image quality improvement, and introduced our developments of a new 4D-CBCT reconstruction technique which features simultaneous motion estimation and image reconstruction (SMEIR). Based on the original SMEIR scheme, biomechanical modeling-guided SMEIR (SMEIR-Bio) was introduced to further improve the reconstruction accuracy of fine details in lung 4D-CBCTs. To improve the efficiency of reconstruction, we recently developed a U-net-based deformation-vector-field (DVF) optimization technique to leverage a population-based deep learning scheme to improve the accuracy of intra-lung DVFs (SMEIR-Unet), without explicit biomechanical modeling. Details of each of the SMEIR, SMEIR-Bio and SMEIR-Unet techniques were included in this study, along with the corresponding results comparing the reconstruction accuracy in terms of CBCT images and the DVFs. We also discussed the application prospects of the SMEIR-type techniques in image-guided radiation therapy and adaptive radiation therapy, and presented potential schemes on future developments to achieve faster and more accurate 4D-CBCT imaging.

Computed Tomography to Cone Beam Computed Tomography Deformable Image Registration for Contour Propagation Using Head and Neck, Patient-Based Computational Phantoms: A Multicenter Study

PURPOSE

To investigate the performance of various algorithms for deformable image registration (DIR) for propagating regions of interest (ROIs) using multiple commercial platforms, from computed tomography to cone beam computed tomography (CBCT) and megavoltage computed tomography.

METHODS AND MATERIALS

Fourteen institutions participated in the study using 5 commercial platforms: RayStation (RaySearch Laboratories, Stockholm, Sweden), MIM (Cleveland, OH), VelocityAI and SmartAdapt (Varian Medical Systems, Palo Alto, CA), and ABAS (Elekta AB, Stockholm, Sweden). Algorithms were tested on synthetic images generated with the ImSimQA (Oncology Systems Limited, Shrewsbury, UK) package by applying 2 specific deformation vector fields (DVF) to real head and neck patient datasets. On-board images from 3 systems were used: megavoltage computed tomography from Tomotherapy and 2 kinds of CBCT from a clinical linear accelerator. Image quality of the system was evaluated. The algorithms' accuracy was assessed by comparing the DIR-mapped ROIs returned by each center with those of the reference, using the Dice similarity coefficient and mean distance to conformity metrics. Statistical inference on the validation results was carried out to identify the prognostic factors of DIR performance.

RESULTS

Analyzing 840 DIR-mapped ROIs returned by the centers, it was demonstrated that DVF intensity and image quality were significant prognostic factors of DIR performance. The accuracy of the propagated contours was generally high, and acceptable DIR performance can be obtained with lower-dose CBCT image protocols.

CONCLUSIONS

The performance of the systems proved to be image quality specific, depending on the DVF type and only partially on the platforms. All systems proved to be robust against image artifacts and noise, except the demon-based software.

Biomechanical modeling of neck flexion for deformable alignment of the salivary glands in head and neck cancer images

During head and neck (HN) cancer radiation therapy, analysis of the dose-response relationship for the parotid glands (PG) relies on the ability to accurately align soft tissue organs between longitudinal images. In order to isolate the response of the salivary glands to delivered dose, from deformation due to patient position, it is important to resolve the patient postural changes, mainly due to neck flexion. In this study we evaluate the use of a biomechanical model-based deformable image registration (DIR) algorithm to estimate the displacements and deformations of the salivary glands due to postural changes. A total of 82 pairs of CT images of HN cancer patients with varying angles of neck flexion were retrospectively obtained. The pairs of CTs of each patient were aligned using bone-based rigid registration. The images were then deformed using biomechanical model-based DIR method that focused on the mandible, C1 vertebrae, C3 vertebrae, and external contour. For comparison, an intensity-based DIR was also performed. The accuracy of the biomechanical model-based DIR was assessed using Dice similarity coefficient (DSC) for all images and for the subset of images where the PGs had a volume change within 20%. The accuracy was compared to the intensity-based DIR. The PG mean  ±  STD DSC were 0.63  ±  0.18, 0.80  ±  0.08, and 0.82  ±  0.15 for the rigid registration, biomechanical model-based DIR, and intensity based DIR, respectively, for patients with a PG volume change up to 20%. For the entire cohort of patients, where the PG volume change was up to 57%, the PG mean  ±  STD DSC were 0.60  ±  0.18, 0.78  ±  0.09, and 0.81  ±  0.14 for the rigid registration, biomechanical model-based DIR, and intensity based DIR, respectively. The difference in DSC of the intensity and biomechanical model-based DIR methods was not statistically significant when the volume change was less than 20% (two-sided paired t-test, p   =  0.12). When all volume changes were considered, there was a significant difference between the two registration approaches, although the magnitude was small. These results demonstrate that the proposed biomechanical model with boundary conditions on the bony anatomy can serve to describe the varying angles of neck flexion appearing in images during radiation treatment and to align the salivary glands for proper analysis of dose-response relationships. It also motivates the need for dose response modeling following neck flexion for cases where parotid gland response is noted.