Combination of intensity-based image registration with 3D simulation in radiation therapy

A hybrid, image-based and biomechanics-based registration approach to markerless intraoperative nodule localization during video-assisted thoracoscopic surgery

The resection of small, low-dense or deep lung nodules during video-assisted thoracoscopic surgery (VATS) is surgically challenging. Nodule localization methods in clinical practice typically rely on the preoperative placement of markers, which may lead to clinical complications. We propose a markerless lung nodule localization framework for VATS based on a hybrid method combining intraoperative cone-beam CT (CBCT) imaging, free-form deformation image registration, and a poroelastic lung model with allowance for air evacuation. The difficult problem of estimating intraoperative lung deformations is decomposed into two more tractable sub-problems: (i) estimating the deformation due the change of patient pose from preoperative CT (supine) to intraoperative CBCT (lateral decubitus); and (ii) estimating the pneumothorax deformation, i.e. a collapse of the lung within the thoracic cage. We were able to demonstrate the feasibility of our localization framework with a retrospective validation study on 5 VATS clinical cases. Average initial errors in the range of 22 to 38 mm were reduced to the range of 4 to 14 mm, corresponding to an error correction in the range of 63 to 85%. To our knowledge, this is the first markerless lung deformation compensation method dedicated to VATS and validated on actual clinical data.

A hybrid patient-specific biomechanical model based image registration method for the motion estimation of lungs

This paper presents a new hybrid biomechanical model-based non-rigid image registration method for lung motion estimation. In the proposed method, a patient-specific biomechanical modelling process captures major physically realistic deformations with explicit physical modelling of sliding motion, whilst a subsequent non-rigid image registration process compensates for small residuals. The proposed algorithm was evaluated with 10 4D CT datasets of lung cancer patients. The target registration error (TRE), defined as the Euclidean distance of landmark pairs, was significantly lower with the proposed method (TRE = 1.37 mm) than with biomechanical modelling (TRE = 3.81 mm) and intensity-based image registration without specific considerations for sliding motion (TRE = 4.57 mm). The proposed method achieved a comparable accuracy as several recently developed intensity-based registration algorithms with sliding handling on the same datasets. A detailed comparison on the distributions of TREs with three non-rigid intensity-based algorithms showed that the proposed method performed especially well on estimating the displacement field of lung surface regions (mean TRE = 1.33 mm, maximum TRE = 5.3 mm). The effects of biomechanical model parameters (such as Poisson's ratio, friction and tissue heterogeneity) on displacement estimation were investigated. The potential of the algorithm in optimising biomechanical models of lungs through analysing the pattern of displacement compensation from the image registration process has also been demonstrated.

A finite element head and neck model as a supportive tool for deformable image registration

PURPOSE

A finite element (FE) head and neck model was developed as a tool to aid investigations and development of deformable image registration and patient modeling in radiation oncology. Useful aspects of a FE model for these purposes include ability to produce realistic deformations (similar to those seen in patients over the course of treatment) and a rational means of generating new configurations, e.g., via the application of force and/or displacement boundary conditions.

METHODS

The model was constructed based on a cone-beam computed tomography image of a head and neck cancer patient. The three-node triangular surface meshes created for the bony elements (skull, mandible, and cervical spine) and joint elements were integrated into a skeletal system and combined with the exterior surface. Nodes were additionally created inside the surface structures which were composed of the three-node triangular surface meshes, so that four-node tetrahedral FE elements were created over the whole region of the model. The bony elements were modeled as a homogeneous linear elastic material connected by intervertebral disks. The surrounding tissues were modeled as a homogeneous linear elastic material. Under force or displacement boundary conditions, FE analysis on the model calculates approximate solutions of the displacement vector field.

RESULTS

A FE head and neck model was constructed that skull, mandible, and cervical vertebrae were mechanically connected by disks. The developed FE model is capable of generating realistic deformations that are strain-free for the bony elements and of creating new configurations of the skeletal system with the surrounding tissues reasonably deformed.

CONCLUSIONS

The FE model can generate realistic deformations for skeletal elements. In addition, the model provides a way of evaluating the accuracy of image alignment methods by producing a ground truth deformation and correspondingly simulated images. The ability to combine force and displacement conditions provides flexibility for simulating realistic anatomic configurations.

Modeling lung deformation: a combined deformable image registration method with spatially varying Young's modulus estimates

PURPOSE

Respiratory motion introduces uncertainties in tumor location and lung deformation, which often results in difficulties calculating dose distributions in thoracic radiation therapy. Deformable image registration (DIR) has ability to describe respiratory-induced lung deformation, with which the radiotherapy techniques can deliver high dose to tumors while reducing radiation in surrounding normal tissue. The authors' goal is to propose a DIR method to overcome two main challenges of the previous biomechanical model for lung deformation, i.e., the requirement of precise boundary conditions and the lack of elasticity distribution.

METHODS

As opposed to typical methods in biomechanical modeling, the authors' method assumes that lung tissue is inhomogeneous. The authors thus propose a DIR method combining a varying intensity flow (VF) block-matching algorithm with the finite element method (FEM) for lung deformation from end-expiratory phase to end-inspiratory phase. Specifically, the lung deformation is formulated as a stress-strain problem, for which the boundary conditions are obtained from the VF block-matching algorithm and the element specific Young's modulus distribution is estimated by solving an optimization problem with a quasi-Newton method. The authors measure the spatial accuracy of their nonuniform model as well as a standard uniform model by applying both methods to four-dimensional computed tomography images of six patients. The spatial errors produced by the registrations are computed using large numbers (>1000) of expert-determined landmark point pairs.

RESULTS

In right-left, anterior-posterior, and superior-inferior directions, the mean errors (standard deviation) produced by the standard uniform FEM model are 1.42(1.42), 1.06(1.05), and 1.98(2.10) mm whereas the authors' proposed nonuniform model reduces these errors to 0.59(0.61), 0.52(0.51), and 0.78(0.89) mm. The overall 3D mean errors are 3.05(2.36) and 1.30(0.97) mm for the uniform and nonuniform models, respectively.

CONCLUSIONS

The results indicate that the proposed nonuniform model can simulate patient-specific and position-specific lung deformation via spatially varying Young's modulus estimates, which improves registration accuracy compared to the uniform model and is therefore a more suitable description of lung deformation.

Evaluation of image registration spatial accuracy using a Bayesian hierarchical model

To evaluate the utility of automated deformable image registration (DIR) algorithms, it is necessary to evaluate both the registration accuracy of the DIR algorithm itself, as well as the registration accuracy of the human readers from whom the "gold standard" is obtained. We propose a Bayesian hierarchical model to evaluate the spatial accuracy of human readers and automatic DIR methods based on multiple image registration data generated by human readers and automatic DIR methods. To fully account for the locations of landmarks in all images, we treat the true locations of landmarks as latent variables and impose a hierarchical structure on the magnitude of registration errors observed across image pairs. DIR registration errors are modeled using Gaussian processes with reference prior densities on prior parameters that determine the associated covariance matrices. We develop a Gibbs sampling algorithm to efficiently fit our models to high-dimensional data, and apply the proposed method to analyze an image dataset obtained from a 4D thoracic CT study.

A reference dataset for deformable image registration spatial accuracy evaluation using the COPDgene study archive

Landmark point-pairs provide a strategy to assess deformable image registration (DIR) accuracy in terms of the spatial registration of the underlying anatomy depicted in medical images. In this study, we propose to augment a publicly available database (www.dir-lab.com) of medical images with large sets of manually identified anatomic feature pairs between breath-hold computed tomography (BH-CT) images for DIR spatial accuracy evaluation. Ten BH-CT image pairs were randomly selected from the COPDgene study cases. Each patient had received CT imaging of the entire thorax in the supine position at one-fourth dose normal expiration and maximum effort full dose inspiration. Using dedicated in-house software, an imaging expert manually identified large sets of anatomic feature pairs between images. Estimates of inter- and intra-observer spatial variation in feature localization were determined by repeat measurements of multiple observers over subsets of randomly selected features. 7298 anatomic landmark features were manually paired between the 10 sets of images. Quantity of feature pairs per case ranged from 447 to 1172. Average 3D Euclidean landmark displacements varied substantially among cases, ranging from 12.29 (SD: 6.39) to 30.90 (SD: 14.05) mm. Repeat registration of uniformly sampled subsets of 150 landmarks for each case yielded estimates of observer localization error, which ranged in average from 0.58 (SD: 0.87) to 1.06 (SD: 2.38) mm for each case. The additions to the online web database (www.dir-lab.com) described in this work will broaden the applicability of the reference data, providing a freely available common dataset for targeted critical evaluation of DIR spatial accuracy performance in multiple clinical settings. Estimates of observer variance in feature localization suggest consistent spatial accuracy for all observers across both four-dimensional CT and COPDgene patient cohorts.

Pulmonary kinematics from image data: a review

The effects of certain lung pathologies include alterations in lung physiology negatively affecting pulmonary compliance. Current approaches to diagnosis and treatment assessment of lung disease commonly rely on pulmonary function testing. Such testing is limited to global measures of lung function, neglecting regional measurements, which are critical for early diagnosis and localization of disease. Increased accessibility to medical image acquisition strategies with high spatiotemporal resolution coupled with the development of sophisticated intensity-based and geometric registration techniques has resulted in the recent exploration of modeling pulmonary motion for calculating local measures of deformation. In this review, the authors provide a broad overview of such research efforts for the estimation of pulmonary deformation. This includes discussion of various techniques, current trends in validation approaches, and the public availability of software and data resources.

Deformable image registration of heterogeneous human lung incorporating the bronchial tree

PURPOSE

To investigate the effect of the bronchial tree on the accuracy of biomechanical-based deformable image registration of human lungs.

METHODS

Three dimensional finite element models have been developed using four dimensional computed tomography image data of ten lung cancer patients. Each model is built of a body, left and right lungs, tumor, and bronchial trees. Triangular shell elements are used for the bronchial trees while tetrahedral elements are used for other components. Hyperelastic material properties based on experimental investigation on human lungs are used for the lung parenchyma. Different material properties are assigned for the bronchial tree using five values for the modulus of elasticity of 0.01, 0.12, 0.5, 10, and 18 MPa. Lungs are modeled to slide inside chest cavities by applying frictionless contact surfaces between each lung and corresponding chest cavity. The accuracy of the models is examined using an average of 40 bronchial bifurcation points identified on inhale and exhale images. Relative accuracy is evaluated by comparing the displacement of all nodes within the lungs as well as the dosimetric difference at the exhale position predicted by the model.

RESULTS

There is no significant effect of bronchial tree on the model accuracy based on the bifurcation points analysis. However, on the local level, using an average of 38 000 nodes, there is a maximum difference of 8.5 mm in the deformation of the bronchial trees, as the modulus of elasticity of the bronchial trees increases from 0.01 to 18 MPa; however, more than 96% of nodes are within a 2.5 mm difference in each direction. The average dose difference at the predicted exhale position is less than 35 cGy between the models.

CONCLUSIONS

The bronchial tree has little effect on the global deformation and the accuracy of deformable image registration of lungs. Hence, the homogenous model is a reasonable assumption. Since there are some local deformation differences between nodes as the material properties of the bronchial tree change that may affect the accuracy of dosimetric results, heterogeneity may be required for a smaller scale modeling of lungs.

Four-dimensional deformable image registration using trajectory modeling

A four-dimensional deformable image registration (4D DIR) algorithm, referred to as 4D local trajectory modeling (4DLTM), is presented and applied to thoracic 4D computed tomography (4DCT) image sets. The theoretical framework on which this algorithm is built exploits the incremental continuity present in 4DCT component images to calculate a dense set of parameterized voxel trajectories through space as functions of time. The spatial accuracy of the 4DLTM algorithm is compared with an alternative registration approach in which component phase to phase (CPP) DIR is utilized to determine the full displacement between maximum inhale and exhale images. A publically available DIR reference database (http://www.dir-lab.com) is utilized for the spatial accuracy assessment. The database consists of ten 4DCT image sets and corresponding manually identified landmark points between the maximum phases. A subset of points are propagated through the expiratory 4DCT component images. Cubic polynomials were found to provide sufficient flexibility and spatial accuracy for describing the point trajectories through the expiratory phases. The resulting average spatial error between the maximum phases was 1.25 mm for the 4DLTM and 1.44 mm for the CPP. The 4DLTM method captures the long-range motion between 4DCT extremes with high spatial accuracy.

Mass preserving nonrigid registration of CT lung images using cubic B-spline

The authors propose a nonrigid image registration approach to align two computed-tomography (CT)-derived lung datasets acquired during breath-holds at two inspiratory levels when the image distortion between the two volumes is large. The goal is to derive a three-dimensional warping function that can be used in association with computational fluid dynamics studies. In contrast to the sum of squared intensity difference (SSD), a new similarity criterion, the sum of squared tissue volume difference (SSTVD), is introduced to take into account changes in reconstructed Hounsfield units (scaled attenuation coefficient, HU) with inflation. This new criterion aims to minimize the local tissue volume difference within the lungs between matched regions, thus preserving the tissue mass of the lungs if the tissue density is assumed to be relatively constant. The local tissue volume difference is contributed by two factors: Change in the regional volume due to the deformation and change in the fractional tissue content in a region due to inflation. The change in the regional volume is calculated from the Jacobian value derived from the warping function and the change in the fractional tissue content is estimated from reconstructed HU based on quantitative CT measures. A composite of multilevel B-spline is adopted to deform images and a sufficient condition is imposed to ensure a one-to-one mapping even for a registration pair with large volume difference. Parameters of the transformation model are optimized by a limited-memory quasi-Newton minimization approach in a multiresolution framework. To evaluate the effectiveness of the new similarity measure, the authors performed registrations for six lung volume pairs. Over 100 annotated landmarks located at vessel bifurcations were generated using a semiautomatic system. The results show that the SSTVD method yields smaller average landmark errors than the SSD method across all six registration pairs.

A framework for evaluation of deformable image registration spatial accuracy using large landmark point sets

Expert landmark correspondences are widely reported for evaluating deformable image registration (DIR) spatial accuracy. In this report, we present a framework for objective evaluation of DIR spatial accuracy using large sets of expert-determined landmark point pairs. Large samples (>1100) of pulmonary landmark point pairs were manually generated for five cases. Estimates of inter- and intra-observer variation were determined from repeated registration. Comparative evaluation of DIR spatial accuracy was performed for two algorithms, a gradient-based optical flow algorithm and a landmark-based moving least-squares algorithm. The uncertainty of spatial error estimates was found to be inversely proportional to the square root of the number of landmark point pairs and directly proportional to the standard deviation of the spatial errors. Using the statistical properties of this data, we performed sample size calculations to estimate the average spatial accuracy of each algorithm with 95% confidence intervals within a 0.5 mm range. For the optical flow and moving least-squares algorithms, the required sample sizes were 1050 and 36, respectively. Comparative evaluation based on fewer than the required validation landmarks results in misrepresentation of the relative spatial accuracy. This study demonstrates that landmark pairs can be used to assess DIR spatial accuracy within a narrow uncertainty range.