An articulated neurosurgical navigation system using MRI and CT images

Computerized surgical navigation resection of pelvic region simulated bone tumors using skin fiducial marker registration: an in vitro cadaveric study

INTRODUCTION

Computerized surgical navigation system guidance can improve bone tumor surgical resection accuracy. This study compared the 10-mm planned resection margin agreement between simulated pelvic-region bone tumors (SPBT) resected using either skin fiducial markers or Kirschner (K)-wires inserted directly into osseous landmarks with navigational system registration under direct observation. We hypothesized that skin fiducial markers would display similar resection margin accuracy.

METHODS

Six cadaveric pelvises had one SPBT implanted into each supra-acetabular region. At the left hemi-pelvis, the skin fiducial marker group had guidance from markers placed over the pubic tubercle, the anterior superior iliac spine, the central and more posterior iliac crest, and the greater trochanter (5 markers). At the right hemi-pelvis, the K-wire group had guidance from 1.4-mm-diameter wires inserted into the pubic tubercle, and 3 inserted along the iliac crest (4 K-wires). The senior author, a fellowship-trained surgeon performed "en bloc" SPBT resections. The primary investigator, blinded to group assignment, measured actual resection margins.

RESULTS

Twenty of 22 resection margins (91%) in the skin fiducial marker group were within the Bland-Altman plot 95% confidence interval for actual-planned margin mean difference (mean = -0.23 mm; 95% confidence intervals = 2.8 mm, - 3.3 mm). Twenty-one of 22 resection margins (95%) in the K-wire group were within the 95% confidence interval of actual-planned margin mean difference (mean = 0.26 mm; 95% confidence intervals = 1.7 mm, - 1.1 mm).

CONCLUSION

Pelvic bone tumor resection with navigational guidance from skin fiducial markers placed over osseous landmarks provided similar accuracy to K-wires inserted into osseous landmarks. Further in vitro studies with different SPBT dimensions/locations and clinical studies will better delineate use efficacy.

Development of an inside-out augmented reality technique for neurosurgical navigation

OBJECTIVE

With the advancement of 3D modeling techniques and visualization devices, augmented reality (AR)-based navigation (AR navigation) is being developed actively. The authors developed a pilot model of their newly developed inside-out tracking AR navigation system.

METHODS

The inside-out AR navigation technique was developed based on the visual inertial odometry (VIO) algorithm. The Quick Response (QR) marker was created and used for the image feature-detection algorithm. Inside-out AR navigation works through the steps of visualization device recognition, marker recognition, AR implementation, and registration within the running environment. A virtual 3D patient model for AR rendering and a 3D-printed patient model for validating registration accuracy were created. Inside-out tracking was used for the registration. The registration accuracy was validated by using intuitive, visualization, and quantitative methods for identifying coordinates by matching errors. Fine-tuning and opacity-adjustment functions were developed.

RESULTS

ARKit-based inside-out AR navigation was developed. The fiducial marker of the AR model and those of the 3D-printed patient model were correctly overlapped at all locations without errors. The tumor and anatomical structures of AR navigation and the tumors and structures placed in the intracranial space of the 3D-printed patient model precisely overlapped. The registration accuracy was quantified using coordinates, and the average moving errors of the x-axis and y-axis were 0.52 ± 0.35 and 0.05 ± 0.16 mm, respectively. The gradients from the x-axis and y-axis were 0.35° and 1.02°, respectively. Application of the fine-tuning and opacity-adjustment functions was proven by the videos.

CONCLUSIONS

The authors developed a novel inside-out tracking-based AR navigation system and validated its registration accuracy. This technical system could be applied in the novel navigation system for patient-specific neurosurgery.

Positional effect of preoperative neuronavigational magnetic resonance image on accuracy of posterior fossa lesion localization

OBJECTIVE

The aim of this study was to analyze the positional effect of MRI on the accuracy of neuronavigational localization for posterior fossa (PF) lesions when the operation is performed with the patient in the prone position.

METHODS

Ten patients with PF tumors requiring surgery in the prone position were prospectively enrolled in the study. All patients underwent preoperative navigational MRI in both the supine and prone positions in a single session. Using simultaneous intraoperative registration of the supine and prone navigational MR images, the authors investigated the images' accuracy, spatial deformity, and source of errors for PF lesions. Accuracy was determined in terms of differences in the ability of the supine and prone MR images to localize 64 test points in the PF by using a neuronavigation system. Spatial deformities were analyzed and visualized by in-house-developed software with a 3D reconstruction function and spatial calculation of the MRI data. To identify the source of differences, the authors investigated the accuracy of fiducial point localization in the supine and prone MR images after taking the surface anatomy and age factors into consideration.

RESULTS

Neuronavigational localization performed using prone MRI was more accurate for PF lesions than routine supine MRI prior to prone position surgery. Prone MRI more accurately localized 93.8% of the tested PF areas than supine MRI. The spatial deformities in the neuronavigation system calculated using the supine MRI tended to move in the posterior-superior direction from the actual anatomical landmarks. The average distance of the spatial differences between the prone and supine MR images was 6.3 mm. The spatial difference had a tendency to increase close to the midline. An older age (> 60 years) and fiducial markers adjacent to the cervical muscles were considered to contribute significantly to the source of differences in the positional effect of neuronavigation (p < 0.001 and p = 0.01, respectively).

CONCLUSIONS

This study demonstrated the superior accuracy of neuronavigational localization with prone-position MRI during prone-position surgery for PF lesions. The authors recommend that the scan position of the neuronavigational MRI be matched with the surgical position for more precise localization.

Frontiers of Medical Robotics: From Concept to Systems to Clinical Translation

Medical robotics is poised to transform all aspects of medicine—from surgical intervention to targeted therapy, rehabilitation, and hospital automation. A key area is the development of robots for minimally invasive interventions. This review provides a detailed analysis of the evolution of interventional robots and discusses how the integration of imaging, sensing, and robotics can influence the patient care pathway toward precision intervention and patient-specific treatment. It outlines how closer coupling of perception, decision, and action can lead to enhanced dexterity, greater precision, and reduced invasiveness. It provides a critical analysis of some of the key interventional robot platforms developed over the years and their relative merit and intrinsic limitations. The review also presents a future outlook for robotic interventions and emerging trends in making them easier to use, lightweight, ergonomic, and intelligent, and thus smarter, safer, and more accessible for clinical use.

Navigation in Musculoskeletal Oncology: An Overview

Navigation in surgery has increasingly become more commonplace. The use of this technological advancement has enabled ever more complex and detailed surgery to be performed to the benefit of surgeons and patients alike. This is particularly so when applying the use of navigation within the field of orthopedic oncology. The developments in computer processing power coupled with the improvements in scanning technologies have permitted the incorporation of navigational procedures into day-to-day practice. A comprehensive search of PubMed using the search terms "navigation", "orthopaedic" and "oncology" yielded 97 results. After filtering for English language papers, excluding spinal surgery and review articles, this resulted in 38 clinical studies and case reports. These were analyzed in detail by the authors (GM and JS) and the most relevant papers reviewed. We have sought to provide an overview of the main types of navigation systems currently available within orthopedic oncology and to assess some of the evidence behind its use.

Evidence-based clinical management and utilization of new technology in European neurosurgery

BACKGROUND

Evidence-based medicine (EBM) has become one of the pillars of modern patient care. However, neurosurgery has always been an experience-based and technology-driven discipline, and it remains unknown to which extent European neurosurgeons follow high-level evidence-based recommendations.

METHODS

We conducted a Web-based survey with a 15-item questionnaire about evidence-based clinical management and utilization of new technology among European neurosurgeons. Two different sum scores were calculated from the questions concerning clinical practice; evidence-based treatment score and new technology score. A high evidence-based treatment score means that more clinical conditions (i.e., study questions) were managed in compliance with the available highest levels of evidence from published clinical trials. A high new technology score reflects the use of a high number of modern tools in neurosurgical practice.

RESULTS

A total of 239 neurosurgeons from 30 different European countries answered the questionnaire. There were large variations among European neurosurgeons in providing evidence-based care and in utilization of various modern tools. There were significant regional differences in evidence-based treatment scores and modern technology scores with higher scores in northern and western Europe. High-volume institutions were not associated with better evidence-based treatment scores, but had significantly higher new technology scores. There were significantly higher new technology scores at university hospitals and a trend towards higher evidence-based treatment scores compared to other hospitals.

CONCLUSIONS

Clinical management in neurosurgery does not always comply with the best available evidence and there are large regional differences in clinical management and in utilization of various modern tools. The position of evidence-based medicine in European neurosurgery seems weak and this may be a threat to the quality of care.

Vision-based navigation in image-guided interventions

The trend toward minimally invasive surgical interventions has created new challenges for visualization during surgical procedures. However, at the same time, the introduction of high-definition digital endoscopy offers the opportunity to apply methods from computer vision to provide visualization enhancements such as anatomic reconstruction, surface registration, motion tracking, and augmented reality. This review provides a perspective on this rapidly evolving field. It first introduces the clinical and technical background necessary for developing vision-based algorithms for interventional applications. It then discusses several examples of clinical interventions where computer vision can be applied, including bronchoscopy, rhinoscopy, transnasal skull-base neurosurgery, upper airway interventions, laparoscopy, robotic-assisted surgery, and Natural Orifice Transluminal Endoscopic Surgery (NOTES). It concludes that the currently reported work is only the beginning. As the demand for minimally invasive procedures rises, computer vision in surgery will continue to advance through close interdisciplinary work between interventionists and engineers.

Image-guided system with miniature robot for precise positioning and targeting in keyhole neurosurgery

This paper describes a novel image-guided system for precise automatic targeting in minimally invasive keyhole neurosurgery. The system consists of the MARS miniature robot fitted with a mechanical guide for needle, probe or catheter insertion. Intraoperatively, the robot is directly affixed to a head clamp or to the patient's skull. It automatically positions itself with respect to predefined targets in a preoperative CT/MRI image following an anatomical registration with an intraoperative 3D surface scan of the patient's facial features and registration jig. We present the system architecture, surgical protocol, custom hardware (targeting and registration jig), and software modules (preoperative planning, intraoperative execution, 3D surface scan processing, and three-way registration). We also describe a prototype implementation of the system and in vitro registration experiments. Our results indicate a system-wide target registration error of 1.7 mm (standard deviation = 0.7 mm), which is close to the required 1.0-1.5 mm clinical accuracy in many keyhole neurosurgical procedures.

Computer- und Robotertechnik für die bildgeführte Orthopädische Chirurgie (Computer and Robot Technology for Image guided Orthopaedic Surgery)

Seit einigen Jahren hält die Computer- und auch Robotertechnologie in der Orthopädischen Chirurgie Einzug, wird jedoch teilweise sehr kontrovers diskutiert. Wo liegen Vorteile und Probleme der Automatisierungstechnik für den chirurgischen Einsatz? In diesem Beitrag sollen Möglichkeiten und Techniken im Überblick dargestellt werden. Entwicklungspotentiale insbesondere im Hinblick auf robotische Unterstützungssysteme sollen am Beispiel des CRIGOS-Parallelrobotersystems aufgezeigt werden.

2D/3D registration of endoscopic ultrasound to CT volume data

This paper describes a computer-aided navigation system using image fusion to support endoscopic interventions such as the accurate collection of biopsy specimens. An endoscope provides the physician with real-time ultrasound (US) and a video image. An image slice that corresponds to the corresponding image from the US scan head is derived from a preoperative computed tomography (CT) or magnetic resonance image volume data set using oblique reformatting and displayed side by side with the US image. The position of the image acquired by the US scan head is determined by a miniaturized electromagnetic tracking system (EMTS) after calibrating the endoscope's scan head. The transformation between the patient coordinate system and the preoperative data set is calculated using a 2D/3D registration. This is achieved by calibrating an intraoperative interventional CT slice with an optical tracking system (OTS) using the same algorithm as for the US calibration. The slice is then used for 2D/3D registration with the coordinate system of the preoperative volume. The fiducial registration error (FRE) for the US calibration was 2.0 mm +/- 0.4 mm; the interventional CT FRE was 0.36 +/- 0.12 mm; and the 2D/3D registration target registration error (TRE) was 1.8 +/- 0.3 mm. The point-to-point registration between the OTS and the EMTS had an FRE of 0.9 +/- 0.4 mm. Finally, we found an overall TRE for the complete system to be 3.9 +/- 0.6 mm.

Robust Motion Estimation and Structure Recovery from Endoscopic Image Sequences With an Adaptive Scale Kernel Consensus Estimator

To correctly estimate the camera motion parameters and reconstruct the structure of the surrounding tissues from endoscopic image sequences, we need not only to deal with outliers (e.g., mismatches), which may involve more than 50% of the data, but also to accurately distinguish inliers (correct matches) from outliers. In this paper, we propose a new robust estimator, Adaptive Scale Kernel Consensus (ASKC), which can tolerate more than 50 percent outliers while automatically estimating the scale of inliers. With ASKC, we develop a reliable feature tracking algorithm. This, in turn, allows us to develop a complete system for estimating endoscopic camera motion and reconstructing anatomical structures from endoscopic image sequences. Preliminary experiments on endoscopic sinus imagery have achieved promising results.

[Evaluation of a DC pulsed magnetic tracking system in neurosurgical navigation: technique, accuracies, and influencing factors]

Navigation systems are useful instruments in cranial neurosurgery. For specification of position, so-called sensor-based navigation techniques use: (a) a signal emitter that generates a defined electromagnetic field in the area of the operation site; and (b) small sensors that detect the position of various operating instruments in the electromagnetic field. For a long time, owing to a lack of clinical data and long-term studies, electromagnetic systems have been regarded as error-prone and imprecise. With the development of a pulsed direct current (DC) technique, precision levels can now be reached that are comparable with those of established optical and mechanical measuring procedures. However, it must be noted that the influence on the measuring accuracy within the operating field increases with increasing susceptibility of the various metals used in the operating theatre (titanium<aluminium<high-alloy steels<low-alloy steels). The technique, accuracy, and influencing factors of a DC pulsed magnetic tracking system were investigated in more than 200 cases.

Image-to-patient registration techniques in head surgery

Frame-based stereotaxy was developed in neurosurgery at the beginning of the last century, evolving from atlas-based stereotaxy to stereotaxy based on the individual patient's image data. This established method is still in use in neurosurgery and radiotherapy. There have since been two main developments based on this concept: frameless stereotaxy and markerless registration. Frameless stereotactic systems ('navigation systems') replaced the cumbersome stereotactic frame by mechanically and later also optically or magnetically tracked instruments. Stereotaxy based on the individual patient's image data introduced the problem of patient-to-image data registration. The development of navigation systems based on frameless stereotaxy has dramatically increased its use in surgical disciplines other than neurosurgery, but image-guided surgery based on fiducial marker registration needs dedicated imaging for registration purposes, in addition to the diagnostic imaging that might have been performed. Markerless registration techniques can overcome the resulting additional cost and effort, and result in more widespread use of image-guided surgery techniques. In this review paper, the developments that led to today's navigation systems are outlined, and the applications and possibilities of these methods in the field of maxillofacial surgery are presented.

Image-guided minimally invasive surgical access to the temporomandibular joint: A preliminary report

PURPOSE

To establish a protocol for image-guided minimally invasive surgical access to the temporomandibular joint (TMJ).

MATERIALS AND METHODS

This study involved 2 patients with TMJ pain and mandibular motion dysfunction. Axial magnetic resonance imaging (MRI) of the TMJ was obtained and loaded into an intra-operative navigation system to guide joint space injection. With a navigated syringe, 1 mL synvisc Hylan G-F 20 was directly injected into the superior and inferior joint spaces under navigation guidance.

RESULTS

With the assistance of an intraoperative navigational system, the TMJ MRI images were visualized in 3 dimensions and enabled guiding a needle into the superior and inferior joint spaces for therapeutic injection. The treatment outcome for both patients was satisfactory with improvement in pain score and mandibular motion.

CONCLUSIONS

A protocol for image-guided minimally invasive surgical access to the TMJ was established. This could provide the technical basis for evaluation of accurate joint space intervention as a form of treatment of appropriate TMJ disorders.

Robot-assisted image-guided targeting for minimally invasive neurosurgery: planning, registration, and in-vitro experiment

This paper present a novel image-guided system for precise automatic targeting in keyhole minimally invasive neurosurgery. The system consists of a miniature robot fitted with a mechanical guide for needle/probe insertion. Intraoperatively, the robot is directly affixed to a head clamp or to the patient skull. It automatically positions itself with respect to predefined targets in a preoperative CT/MRI image following an anatomical registration with a intraoperative 3D surface scan of the patient facial features. We describe the preoperative planning and registration modules, and an in-vitro registration experiment of the entire system which yields a target registration error of 1.7 mm (std = 0.7 mm).

Scale-invariant registration of monocular endoscopic images to CT-scans for sinus surgery

In this paper, we present a novel method for intra-operative registration directly from monocular endoscopic images. This technique has the potential to provide a more accurate surface registration at the surgical site than existing methods. It can operate autonomously from as few as two images and can be particularly useful in revision cases where surgical landmarks may be absent. A by-product of video registration is an estimate of the local surface structure of the anatomy, thus providing the opportunity to dynamically update anatomical models as the surgery progresses. Our approach is based on a previously presented method [Burschka, D., Hager, G.D., 2004. V-GPS (SLAM):--Vision-based inertial system for mobile robots. In: Proceedings of ICRA, 409-415] for reconstruction of a scaled 3D model of the environment from unknown camera motion. We use this scaled reconstruction as input to a PCA-based algorithm that registers the reconstructed data to the CT data and recovers the scale and pose parameters of the camera in the coordinate frame of the CT scan. The result is used in an ICP registration step to refine the registration estimates. The details of our approach and the experimental results with a phantom of a human skull and a head of a pig cadaver are presented in this paper.

Robots in the operating theatre—chances and challenges

The use of surgical robots and manipulators is still being frequently discussed in the mass media as well as in the scientific community. Although it was already noted in 1985 that the first patient was treated by a joint team of robot and surgeon, today such systems are not routinely used. This can be explained by the high complexity of such systems and the often limited usability, but also, that it is difficult for surgeons to accept "automatic" machines. In this paper the possibilities and chances of robots and manipulators will be explained and it will be shown that robots will never work alone in the operating theatre as it is common in industry today. On the other hand, also limitations and challenges will be outlined. Therefore first a review on today's systems is given in different disciplines including oral- and cranio-maxillofacial surgery, then advantages and disadvantages are shown.

Computer-aided navigation in neurosurgery

The article comprises three main parts: a historical review on navigation, the mathematical basics for calculation and the clinical applications of navigation devices. Main historical steps are described from the first idea till the realisation of the frame-based and frameless navigation devices including robots. In particular the idea of robots can be traced back to the Iliad of Homer, the first testimony of European literature over 2500 years ago. In the second part the mathematical calculation of the mapping between the navigation and the image space is demonstrated, including different registration modalities and error estimations. The error of the navigation has to be divided into the technical error of the device calculating its own position in space, the registration error due to inaccuracies in the calculation of the transformation matrix between the navigation and the image space, and the application error caused additionally by anatomical shift of the brain structures during operation. In the third part the main clinical fields of application in modern neurosurgery are demonstrated, such as localisation of small intracranial lesions, skull-base surgery, intracerebral biopsies, intracranial endoscopy, functional neurosurgery and spinal navigation. At the end of the article some possible objections to navigation-aided surgery are discussed.

Research progress in the last quarter of the 20th century at the University of Tokyo and Tokyo Women's Medical University

Professor Keiji Sano described the history of neurosurgery in Japan until 1975. After World War II, not only neurosurgery but all fields of medicine were devastated in Japan. Professor Sano contributed greatly to the reform and modernization of neurosurgery during that very difficult era in Japan. He performed much research by himself and also as a leader of research groups on stereotactic and functional neurosurgery, cerebrovascular diseases, head injuries, and brain tumors. He organized the Fifth International Congress of Neurological Surgery in Tokyo in 1973. I succeeded in the chairmanship of the Department of Neurosurgery of the University of Tokyo in 1981. We have performed research on the treatment of brain tumors and cerebrovascular diseases. To obtain the best results for brain tumor treatment, we have introduced several new radiotherapeutic methods, such as the gamma knife, heavy-particle irradiation, and the photon radiosurgery system. To improve surgical treatment, we have energetically engaged in medical engineering research on computer-assisted surgical systems (intraoperative monitoring and navigation systems). We have also performed much research on chemotherapy and immunotherapy. In the field of cerebrovascular diseases, the main research projects have been focused on the mechanism and treatment of vasospasm and brain edema after subarachnoid hemorrhage. I summarize the results of our research performed in the Department of Neurosurgery of the University of Tokyo until 1992 and at Tokyo Women's Medical University after 1992, in the last quarter of the 20th century.

Design and implementation of a PC-based image-guided surgical system

In interactive, image-guided surgery, current physical space position in the operating room is displayed on various sets of medical images used for surgical navigation. We have developed a PC-based surgical guidance system (ORION) which synchronously displays surgical position on up to four image sets and updates them in real time. There are three essential components which must be developed for this system: (1) accurately tracked instruments; (2) accurate registration techniques to map physical space to image space; and (3) methods to display and update the image sets on a computer monitor. For each of these components, we have developed a set of dynamic link libraries in MS Visual C++ 6.0 supporting various hardware tools and software techniques. Surgical instruments are tracked in physical space using an active optical tracking system. Several of the different registration algorithms were developed with a library of robust math kernel functions, and the accuracy of all registration techniques was thoroughly investigated. Our display was developed using the Win32 API for windows management and tomographic visualization, a frame grabber for live video capture, and OpenGL for visualization of surface renderings. We have begun to use this current implementation of our system for several surgical procedures, including open and minimally invasive liver surgery.

The use of stereotactic navigation guidance in minimally invasive transnasal nasopharyngectomy: a comparison with the conventional open transfacial approach

The purpose of this paper is to study the efficacy of applying stereotactic navigation guidance to nasopharyngectomy via a minimally invasive transnasal approach as compared with the conventional open transfacial approaches. The nasopharynx is the centre of the anterior skull base, which is remote from the surface of the facial skeleton. It is well known that there are several surgical approaches for access to resect tumours from the nasopharynx. However, the open techniques have been associated with much morbidity and only provide access to, and identification of, the ipsilateral internal carotid artery that forms the lateral boundary and resection limit of the nasopharynx. The coupling of stereotactic navigation guidance and a minimally invasive transnasal approach for nasopharyngectomy allows the surgeon to identify and protect the internal carotid artery bilaterally at the nasopharynx. This technique reduces operating time and morbidity to a minimum and yet is oncologically sound for resecting nasopharyngeal lesions. We compare 15 patients who underwent the stereotactic navigation guidance approach with 20 patients who received a conventional open transfacial approach.

The process and development of image-guided procedures

Medical imaging has been used primarily for diagnosis. In the past 15 years there has been an emergence of the use of images for the guidance of therapy. This process requires three-dimensional localization devices, the ability to register medical images to physical space, and the ability to display position and trajectory on those images. This paper examines the development and state of the art in those processes.

Computer assisted oral and maxillofacial surgery--a review and an assessment of technology

Advances in the basic scientific research within the field of computer assisted oral and maxillofacial surgery have enabled us to introduce features of these techniques into routine clinical practice. In order to simulate complex surgery with the aid of a computer, the diagnostic image data and especially various imaging modalities including computer tomography (CT), magnetic resonance imaging (MRI) and Ultrasound (US) must be arranged in relation to each other, thus enabling a rapid switching between the various modalities as well as the viewing of superimposed images. Segmenting techniques for the reconstruction of three-dimensional representations of soft and hard tissues are required. We must develop ergonomic and user friendly interactive methods for the surgeon, thus allowing for a precise and fast entry of the planned surgical procedure in the planning and simulation phase. During the surgical phase, instrument navigation tools offer the surgeon interactive support through operation guidance and control of potential dangers. This feature is already available today and within this article we present a review of the development of this rapidly evolving technique. Future intraoperative assistance takes the form of such passive tools for the support of intraoperative orientation as well as so-called 'tracking systems' (semi-active systems) which accompany and support the surgeons' work. The final form are robots which execute specific steps completely autonomously. The techniques of virtual reality and computer assisted surgery are increasingly important in their medical applications. Many applications are still being developed or are still in the form of a prototype. It is already clear, however, that developments in this area will have a considerable effect on a surgeon's routine work.

An overview of computer-integrated surgery and therapy

Computer-integrated surgery and therapy (CIST): Methods and systems to help the surgeon or the physician use multimodality data (mainly medical images) in a rational and quantitative way, in order to plan but also to perform medical interventions through the use of passive, semi-active, or active guiding systems.

A passive-marker-based optical system for computer-aided surgery in otorhinolaryngology: development and first clinical experiences

OBJECTIVES

To develop a new type of optical computer-aided surgery (CAS) device that overcomes some of the restrictions of common systems and to examine its accuracy and usability under laboratory and intraoperative conditions.

STUDY DESIGN

Prospective study using laboratory experiments and intraoperative data collection.

METHODS

An optical CAS system applying passive optical markers for coordinate determination was developed. Laboratory accuracy measurements were obtained on a Plexiglas model with known coordinates of fiducial markers, before and after predefined table movements. Intraoperative accuracy measurements were recorded from 24 patients undergoing endonasal surgery of the paranasal sinuses with two different referencing techniques (fiducial markers and mouthpiece).

RESULTS

The system demonstrated laboratory accuracy to within 0.86 mm (SD = 0.94 mm). After table movements, the accuracy decreased to 1.12 mm (SD = 0.99 mm), 1.05 mm (SD = 0.96 mm), 1.15 mm (SD = 1.04 mm), and 1.54 mm (SD = 1.25 mm), respectively, in four different positions. Intraoperative accuracy was within 1.14 mm (SD = 0.57 mm) (fiducial markers) and 2.66 mm (SD = 1.89 mm) (mouthpiece) (P < .05). One of the main advantages of the new technology was the possibility of using any common instrument or endoscope by adapting a marker array.

CONCLUSIONS

Passive-marker technology has been demonstrated to be useful for optical position determination in computer-aided surgery.

Measurement of intraoperative brain surface deformation under a craniotomy

OBJECTIVE

Several causes of spatial inaccuracies in image-guided surgery have been carefully studied and documented for several systems. These include error in identifying the external features used for registration, geometrical distortion in the preoperative images, and error in tracking the surgical instruments. Another potentially important source of error is brain deformation between the time of imaging and the time of surgery or during surgery. In this study, we measured the deformation of the dura and brain surfaces between the time of imaging and the start of surgical resection for 21 patients.

METHODS

All patients underwent intraoperative functional mapping, allowing us to measure brain surface motion at two times that were separated by nearly an hour after opening the dura but before performing resection. The positions of the dura and brain surfaces were recorded and transformed to the coordinate space of a preoperative magnetic resonance image, using the Acustar surgical navigation system (manufactured by Johnson & Johnson Professional, Inc., Randolph, MA) (the Acustar trademark and associated intellectual property rights are now owned by Picker International, Highland Heights, OH). This system performs image registration with bone-implanted markers and tracks a surgical probe by optical triangulation.

RESULTS

The mean displacements of the dura and the first and second brain surfaces were 1.2, 4.4, and 5.6 mm, respectively, with corresponding mean volume reductions under the craniotomy of 6, 22, and 29 cc. The maximum displacement was greater than 10 mm in approximately one-third of the patients for the first brain surface measurement and one-half of the patients for the second. In all cases, the direction of brain shift corresponded to a "sinking" of the brain intraoperatively, compared with its preoperative position. Analysis of the measurement error revealed that its magnitude was approximately 1 to 2 mm. We observed two different patterns of the brain surface deformation field, depending on the inclination of the craniotomy with respect to gravity. Separate measurements of brain deformation within the closed cranium caused by changes in patient head orientation with respect to gravity suggested that less than 1 mm of the brain shift recorded intraoperatively could have resulted from the change in patient orientation between the time of imaging and the time of surgery.

CONCLUSION

These results suggest that intraoperative brain deformation is an important source of error that needs to be considered when using surgical navigation systems.

An ultrasonic approach to localization of fiducial markers for interactive, image-guided neurosurgery--Part I: Principles

Fiducial markers are reference points used in the registration of image space(s) with physical (patient) space. As applied to interactive, image-guided surgery, the registration of image space with physical space allows the current location of a surgical tool to be indicated on a computer display of patient-specific preoperative images. This intrasurgical guidance information is particularly valuable in surgery within the brain, where visual feedback is limited. The accuracy of the mapping between physical and image space depends upon the accuracy with which the fiducial markers were located in each coordinate system. To effect accurate space registration for interactive, image-guided neurosurgery, the use of permanent fiducial markers implanted into the surface of the skull is proposed in this paper. These small cylindrical markers are composed of materials that make them visible in the image sets. The challenge lies in locating the subcutaneous markers in physical space. This paper presents an ultrasonic technique for transcutaneously detecting the location of these markers. The technique incorporates an algorithm based on detection of characteristic properties of the reflected A-mode ultrasonic waveform. The results demonstrate that ultrasound is an appropriate technique for accurate transcutaneous marker localization. The companion paper to this article describes an automatic, enhanced implementation of the marker-localization theory described in this article.

An ultrasonic approach to localization of fiducial markers for interactive, image-guided neurosurgery--Part II: Implementation and automation

Registration of image space and physical space lies at the heart of any interactive, image-guided neurosurgery system. This paper, in conjunction with the previous companion paper [1], describes a localization technique that enables bone-implanted fiducial markers to be used for the registration of these spaces. The nature of these subcutaneous markers allows for their long-term use for registration which is desirable for surgical follow-up, monitoring of therapy efficacy, and performing fractionated stereotactic radiosurgery. The major challenge to using implanted markers is determining the location of the markers in physical space after implantation. The A-mode ultrasonic technique described here is capable of determining the three-dimensional (3-D) location of small implanted cylindrical markers. Accuracy tests were conducted on a phantom representing a human head. The accuracy of the system was characterized by comparing the location of a marker analogue as determined with an optically tracked pointer and the location as determined with the ultrasonic localization. Analyzing the phantom in several orientations revealed a mean system accuracy of 0.5 mm with a +/- 0.1-mm 95% confidence interval. These tests indicate that transcutaneous localization of implanted fiducial markers is possible with a high degree of accuracy.

Registration of head volume images using implantable fiducial markers

In this paper, we describe an extrinsic-point-based, interactive image-guided neurosurgical system designed at Vanderbilt University, Nashville, TN, as part of a collaborative effort among the Departments of Neurological Surgery, Computer Science, and Biomedical Engineering. Multimodal image-to-image (II) and image-to-physical (IP) registration is accomplished using implantable markers. Physical space tracking is accomplished with optical triangulation. We investigate the theoretical accuracy of point-based registration using numerical simulations, the experimental accuracy of our system using data obtained with a phantom, and the clinical accuracy of our system using data acquired in a prospective clinical trial by six neurosurgeons at four medical centers from 158 patients undergoing craniotomies to resect cerebral lesions. We can determine the position of our markers with an error of approximately 0.4 mm in X-ray computed tomography (CT) and magnetic resonance (MR) images and 0.3 mm in physical space. The theoretical registration error using four such markers distributed around the head in a configuration that is clinically practical is approximately 0.5-0.6 mm. The mean CT-physical registration error for the phantom experiments is 0.5 mm and for the clinical data obtained with rigid head fixation during scanning is 0.7 mm. The mean CT-MR registration error for the clinical data obtained without rigid head fixation during scanning is 1.4 mm, which is the highest mean error that we observed. These theoretical and experimental findings indicate that this system is an accurate navigational aid that can provide real-time feedback to the surgeon about anatomical structures encountered in the surgical field.

Computed intraoperative navigation guidance--a preliminary report on a new technique

OBJECTIVE

To assess the value of a computer-assisted three-dimensional guidance system (Virtual Patient System) in maxillofacial operations.

DESIGN

Laboratory and open clinical study.

SETTING

Teaching Hospital, Austria.

SUBJECTS

6 patients undergoing various procedures including removal of foreign body (n=3) and biopsy, maxillary advancement, and insertion of implants (n=1 each).

INTERVENTIONS

Storage of computed tomographic (CT) pictures on an optical disc, and imposition of intraoperative video images on to these. The resulting display is shown to the surgeon on a micromonitor in his head-up display for guidance during the operations.

MAIN OUTCOME MEASURES

To improve orientation during complex or minimally invasive maxillofacial procedures and to make such operations easier and less traumatic.

RESULTS

Successful transferral of computed navigation technology into an operation room environment and positive evaluation of the method by the surgeons involved.

CONCLUSIONS

Computer-assisted three-dimensional guidance systems have the potential for making complex or minimally invasive procedures easier to do, thereby reducing postoperative morbidity.

Effect of geometrical distortion correction in MR on image registration accuracy

In this article we investigate the effect of geometrical distortion correction in MR images on the accuracy of the registration of X-ray CT and MR head images for both a fiducial marker (extrinsic point) method and a surface-matching technique. We use CT and T2-weighted MR image volumes acquired from seven patients who underwent craniotomies in a stereotactic neurosurgical clinical trial. Each patient had four external markers attached to transcutaneous posts screwed into the outer table of the skull. The MR images are corrected for static field inhomogeneity by using an image rectification technique and corrected for scale distortion (gradient magnitude uncertainty) by using an attached stereotactic frame as an object of known shape and size. We define target registration error (TRE) as the distance between corresponding marker positions after registration and transformation. The accuracy of the fiducial marker method is determined by using each combination of three markers to estimate the transformation and the remaining marker to calculate registration error. Surface-based registration is accomplished by fitting MR contours corresponding to the CSF-dura interface to CT contours derived from the inner surface of the skull. The mean point-based TRE using three noncollinear fiducials improved 34%-from 1.15 to 0.76 mm-after correcting for both static field inhomogeneity and scale distortion. The mean surface-based TRE improved 46%-from 2.20 to 1.19 mm. Correction of geometrical distortion in MR images can significantly improve the accuracy of point-based and surface-based registration of CT and MR head images. Distortion correction can be important in clinical situations such as stereotactic and functional neurosurgery where 1 to 2 mm accuracy is required.

An automatic technique for finding and localizing externally attached markers in CT and MR volume images of the head

An image processing technique is presented for finding and localizing the centroids of cylindrical markers externally attached to the human head in computed tomography (CT) and magnetic resonance (MR) image volumes. The centroids can be used as control points for image registration. The technique, which is fast, automatic, and knowledge-based, has two major steps. First, it searches the entire image volume to find one voxel inside each marker-like object. We call this voxel a "candidate" voxel, and we call the object a candidate marker. Second, it classifies the voxels in a region surrounding the candidate voxel as marker or nonmarker voxels using knowledge-based rules and calculates an intensity-weighted centroid for each true marker. We call this final centroid the "fiducial" point of the marker. The technique was developed on 42 scans of six patients-one CT and six MR scans per patient. There are four markers attached to each patient for a total of 168 marker images. For the CT images the false marker rate was zero. For MR the false marker rate was 1.4% (Two out of 144 markers). To evaluate the accuracy of the fiducial points, CT-MR registration was performed after correcting the MR images for geometrical distortion. The fiducial registration accuracy averaged 0.4 mm and was better than 0.6 mm for each of the eighteen image pairs.

Computer-assisted image-guided surgery in pediatric skull-base procedures

Skull-base surgery is characterized by the variety of important neural and vascular structures within a narrow operating field. Although preoperative imaging by computed tomography (CT) and magnetic resonance imaging (MRI) and the use of microsurgical techniques have improved intraoperative orientation, a large number of complications still are caused by localization problems. Especially in pediatric skull-base surgery, maximum localization accuracy during surgery is required. The authors developed a localizing system based on tomographic imaging (such as CT or MRI) to achieve safer surgery by providing highly accurate location information. The preliminary successful experience in the use of the Aachen computer-assisted surgery device for pediatric skull-base surgery (14 cases) is presented. Indication include juvenile angiofibroma of the nasopharynx, infectious and tumorous diseases of the paranasal sinuses, orbital tumors, foreign bodies, and intracranial abscess formation.

Building a hybrid patient's model for augmented reality in surgery: a registration problem

In the field of Augmented Reality in Surgery, building a hybrid patient's model, i.e. merging all the data and systems available for a given application, is a difficult but crucial technical problem. The purpose is to merge all the data that constitute the patient model with the reality of the surgery, i.e. the surgical tools and feedback devices. In this paper, we first develop this concept, we show that this construction comes to a problem of registration between various sensor data, and we detail a general framework of registration. The state of the art in this domain is presented. Finally, we show results that we have obtained using a method which is based on the use of anatomical reference surfaces. We show that in many clinical cases, registration is only possible through the use of internal patient structures.

A newly designed attachment device of multipurpose frame for neuronavigator. Technical note

A newly designed attachment device of the multipurpose head frame (Sugita) for Neuronavigator (Watanabe) is presented with an illustrative case of glioblastoma in an eloquent area. This has extended the usefulness of the neuronavigator for those who prefer and use the multipurpose head frame, while the requirements for keeping a stereotactic combination and the original concept of the multipurpose head frame, as well as that of the neuronavigator have been kept undisturbed.