Surgeon-robot interface development framework

The progress of robotic medicine leads to the emergence of an increasing number of highly specialized automated systems based on specialized software. In any such system, there is the task of translating the surgeon's requests into the process of automated procedure execution. The hardware and software system that provides the translation is the interface between the surgeon and the robot. This paper proposes a generalized framework architecture for the development of such software - the surgeon-robot interface. Existing implementations of such an interface are considered, solutions for the internal structure design of the framework are proposed. Experiments were performed using a prototype of the proposed framework. Such a development framework will allow one to effectively implement the surgeon-robot interfaces at all stages of the robotization of medical procedures, from prototype to final use in the operating room.

In Vivo Investigation of the Effectiveness of a Hyper-viscoelastic Model in Simulating Brain Retraction

Intraoperative brain retraction leads to a misalignment between the intraoperative positions of the brain structures and their previous positions, as determined from preoperative images. In vitro swine brain sample uniaxial tests showed that the mechanical response of brain tissue to compression and extension could be described by the hyper-viscoelasticity theory. The brain retraction caused by the mechanical process is a combination of brain tissue compression and extension. In this paper, we first constructed a hyper-viscoelastic framework based on the extended finite element method (XFEM) to simulate intraoperative brain retraction. To explore its effectiveness, we then applied this framework to an in vivo brain retraction simulation. The simulation strictly followed the clinical scenario, in which seven swine were subjected to brain retraction. Our experimental results showed that the hyper-viscoelastic XFEM framework is capable of simulating intraoperative brain retraction and improving the navigation accuracy of an image-guided neurosurgery system (IGNS).

A nonrigid registration method for correcting brain deformation induced by tumor resection

PURPOSE

This paper presents a nonrigid registration method to align preoperative MRI with intraoperative MRI to compensate for brain deformation during tumor resection. This method extends traditional point-based nonrigid registration in two aspects: (1) allow the input data to be incomplete and (2) simulate the underlying deformation with a heterogeneous biomechanical model.

METHODS

The method formulates the registration as a three-variable (point correspondence, deformation field, and resection region) functional minimization problem, in which point correspondence is represented by a fuzzy assign matrix; Deformation field is represented by a piecewise linear function regularized by the strain energy of a heterogeneous biomechanical model; and resection region is represented by a maximal simply connected tetrahedral mesh. A nested expectation and maximization framework is developed to simultaneously resolve these three variables.

RESULTS

To evaluate this method, the authors conducted experiments on both synthetic data and clinical MRI data. The synthetic experiment confirmed their hypothesis that the removal of additional elements from the biomechanical model can improve the accuracy of the registration. The clinical MRI experiments on 25 patients showed that the proposed method outperforms the ITK implementation of a physics-based nonrigid registration method. The proposed method improves the accuracy by 2.88 mm on average when the error is measured by a robust Hausdorff distance metric on Canny edge points, and improves the accuracy by 1.56 mm on average when the error is measured by six anatomical points.

CONCLUSIONS

The proposed method can effectively correct brain deformation induced by tumor resection.

A framework for correcting brain retraction based on an eXtended Finite Element Method using a laser range scanner

BACKGROUND

Brain retraction causes great distortion that limits the accuracy of an image-guided neurosurgery system that uses preoperative images. Therefore, brain retraction correction is an important intraoperative clinical application.

METHODS

We used a linear elastic biomechanical model, which deforms based on the eXtended Finite Element Method (XFEM) within a framework for brain retraction correction. In particular, a laser range scanner was introduced to obtain a surface point cloud of the exposed surgical field including retractors inserted into the brain. A brain retraction surface tracking algorithm converted these point clouds into boundary conditions applied to XFEM modeling that drive brain deformation. To test the framework, we performed a brain phantom experiment involving the retraction of tissue. Pairs of the modified Hausdorff distance between Canny edges extracted from model-updated images, pre-retraction, and post-retraction CT images were compared to evaluate the morphological alignment of our framework. Furthermore, the measured displacements of beads embedded in the brain phantom and the predicted ones were compared to evaluate numerical performance.

RESULTS

The modified Hausdorff distance of 19 pairs of images decreased from 1.10 to 0.76 mm. The forecast error of 23 stainless steel beads in the phantom was between 0 and 1.73 mm (mean 1.19 mm). The correction accuracy varied between 52.8 and 100 % (mean 81.4 %).

CONCLUSIONS

The results demonstrate that the brain retraction compensation can be incorporated intraoperatively into the model-updating process in image-guided neurosurgery systems.

Classification and Analysis of the Errors in Neuronavigation

There are many different types of errors in neuronavigation, and the reasons and results of these errors are complex. For a neurosurgeon using the neuronavigation system, it is important to have a clear understanding of when an error may occur, what the magnitude of it is, and how to avoid it or reduce its influence on the final application accuracy. In this article, we classify all the errors into 2 groups according to the working principle of neuronavigation systems. The first group contains the errors caused by the differences between the anatomic structures in the images and that of the real patient, and the second group contains the errors occurring in transforming the position of surgical tools from the patient space to the image space. Each group is further divided into 2 subgroups. We discuss 16 types of errors and classify each of them into one of the subgroups. The classification and analysis of these errors should help neurosurgeons understand the power and limits of neuronavigation systems and use them more properly.

A sparse intraoperative data-driven biomechanical model to compensate for brain shift during neuronavigation

BACKGROUND AND PURPOSE

Intraoperative brain deformation is an important factor compromising the accuracy of image-guided neurosurgery. The purpose of this study was to elucidate the role of a model-updated image in the compensation of intraoperative brain shift.

MATERIALS AND METHODS

An FE linear elastic model was built and evaluated in 11 patients with craniotomies. To build this model, we provided a novel model-guided segmentation algorithm. After craniotomy, the sparse intraoperative data (the deformed cortical surface) were tracked by a 3D LRS. The surface deformation, calculated by an extended RPM algorithm, was applied on the FE model as a boundary condition to estimate the entire brain shift. The compensation accuracy of this model was validated by the real-time image data of brain deformation acquired by intraoperative MR imaging.

RESULTS

The prediction error of this model ranged from 1.29 to 1.91 mm (mean, 1.62 ± 0.22 mm), and the compensation accuracy ranged from 62.8% to 81.4% (mean, 69.2 ± 5.3%). The compensation accuracy on the displacement of subcortical structures was higher than that of deep structures (71.3 ± 6.1%:66.8 ± 5.0%, P < .01). In addition, the compensation accuracy in the group with a horizontal bone window was higher than that in the group with a nonhorizontal bone window (72.0 ± 5.3%:65.7 ± 2.9%, P < .05).

CONCLUSIONS

Combined with our novel model-guided segmentation and extended RPM algorithms, this sparse data-driven biomechanical model is expected to be a reliable, efficient, and convenient approach for compensation of intraoperative brain shift in image-guided surgery.

A brain-deformation framework based on a linear elastic model and evaluation using clinical data

In image-guided neurosurgery, brain tissue displacement and deformation during neurosurgical procedures are a major source of error. In this paper, we implement and evaluate a linear-elastic-model-based framework for correction of brain shift using clinical data from five brain tumor patients. The framework uses a linear elastic model to simulate brain-shift behavior. The model is driven by cortical surface deformations, which are tracked using a surface-tracking algorithm combined with a laser-range scanner. The framework performance was evaluated using displacements of anatomical landmarks, tumor contours and self-defined evaluation parameters. The results show that tumor deformations predicted by the present framework agreed well with the ones observed intraoperatively, especially in the parts of the larger deformations. On average, a brain shift of 3.9 mm and a tumor margin shift of 4.2 mm were corrected to 1.2 and 1.3 mm, respectively. The entire correction process was performed in less than 5 min. The data from this study suggest that the technique is a suitable candidate for intraoperative brain-deformation correction.