An MRI-guided stereotactic neurosurgical robotic system for semi-enclosed head coils

Magnetic resonance imaging (MRI) offers high-quality soft tissue imaging without radiation exposure, which allows stereotactic techniques to significantly improve outcomes in cranial surgeries, particularly in deep brain stimulation (DBS) procedures. However, conventional stereotactic neurosurgeries often rely on mechanical stereotactic head frames and preoperative imaging, leading to suboptimal results due to the invisibility and the contact with patient's head, which may cause additional harm. This paper presents a frameless, MRI-guided stereotactic neurosurgical robotic system. The robot features a seven-degree-of-freedom (7-DOF) remote center of motion, with five DOFs for preoperative trajectory alignment to the target lesion and two DOFs for defining the depth and twisting motion of the needle during insertion, thus to minimize tissue damage. The system employs interactive MRI guidance for real-time visualization of the puncture process, showing great potential in reducing surgery time, enhancing targeting accuracy, and improving safety. Experiments were conducted on the proposed system to evaluate signal-to-noise ratio (SNR) and geometric distortion. During the simultaneous operation and imaging, the system demonstrated less than 10.02% SNR attenuation and less than 0.1% geometric distortion, ensuring image usability. The free-space positioning accuracy of the system was evaluated using a laser tracker, revealing a tip position repeatability error within 0.3 ± 0.1 mm.

Interactive Multi-Stage Robotic Positioner for Intra-Operative MRI-Guided Stereotactic Neurosurgery

Magnetic resonance imaging (MRI) demonstrates clear advantages over other imaging modalities in neurosurgery with its ability to delineate critical neurovascular structures and cancerous tissue in high-resolution 3D anatomical roadmaps. However, its application has been limited to interventions performed based on static pre/post-operative imaging, where errors accrue from stereotactic frame setup, image registration, and brain shift. To leverage the powerful intra-operative functions of MRI, e.g., instrument tracking, monitoring of physiological changes and tissue temperature in MRI-guided bilateral stereotactic neurosurgery, a multi-stage robotic positioner is proposed. The system positions cannula/needle instruments using a lightweight (203 g) and compact (Ø97 × 81 mm) skull-mounted structure that fits within most standard imaging head coils. With optimized design in soft robotics, the system operates in two stages: i) manual coarse adjustment performed interactively by the surgeon (workspace of ±30°), ii) automatic fine adjustment with precise (<0.2° orientation error), responsive (1.4 Hz bandwidth), and high-resolution (0.058°) soft robotic positioning. Orientation locking provides sufficient transmission stiffness (4.07 N/mm) for instrument advancement. The system's clinical workflow and accuracy is validated with lab-based (<0.8 mm) and MRI-based testing on skull phantoms (<1.7 mm) and a cadaver subject (<2.2 mm). Custom-made wireless omni-directional tracking markers facilitated robot registration under MRI.

Omnidirectional Monolithic Marker for Intra-Operative MR-Based Positional Sensing in Closed MRI

We present a design of an inductively coupled radio frequency (ICRF) marker for magnetic resonance (MR)-based positional tracking, enabling the robust increase of tracking signal at all scanning orientations in quadrature-excited closed MR imaging (MRI). The marker employs three curved resonant circuits fully covering a cylindrical surface that encloses the signal source. Each resonant circuit is a planar spiral inductor with parallel plate capacitors fabricated monolithically on flexible printed circuit board (FPC) and bent to achieve the curved structure. Size of the constructed marker is Ø3-mm ×5 -mm with quality factor > 22, and its tracking performance was validated with 1.5 T MRI scanner. As result, the marker remains as a high positive contrast spot under 360° rotations in 3 axes. The marker can be accurately localized with a maximum error of 0.56 mm under a displacement of 56 mm from the isocenter, along with an inherent standard deviation of 0.1-mm. Accrediting to the high image contrast, the presented marker enables automatic and real-time tracking in 3D without dependency on its orientation with respect to the MRI scanner receive coil. In combination with its small form-factor, the presented marker would facilitate robust and wireless MR-based tracking for intervention and clinical diagnosis. This method targets applications that can involve rotational changes in all axes (X-Y-Z).

A deep unrolled neural network for real-time MRI-guided brain intervention

Accurate navigation and targeting are critical for neurological interventions including biopsy and deep brain stimulation. Real-time image guidance further improves surgical planning and MRI is ideally suited for both pre- and intra-operative imaging. However, balancing spatial and temporal resolution is a major challenge for real-time interventional MRI (i-MRI). Here, we proposed a deep unrolled neural network, dubbed as LSFP-Net, for real-time i-MRI reconstruction. By integrating LSFP-Net and a custom-designed, MR-compatible interventional device into a 3 T MRI scanner, a real-time MRI-guided brain intervention system is proposed. The performance of the system was evaluated using phantom and cadaver studies. 2D/3D real-time i-MRI was achieved with temporal resolutions of 80/732.8 ms, latencies of 0.4/3.66 s including data communication, processing and reconstruction time, and in-plane spatial resolution of 1 × 1 mm2. The results demonstrated that the proposed method enables real-time monitoring of the remote-controlled brain intervention, and showed the potential to be readily integrated into diagnostic scanners for image-guided neurosurgery.

FRSR: Framework for real-time scene reconstruction in robot-assisted minimally invasive surgery

3D reconstruction of the intra-operative scenes provides precise position information which is the foundation of various safety related applications in robot-assisted surgery, such as augmented reality. Herein, a framework integrated into a known surgical system is proposed to enhance the safety of robotic surgery. In this paper, we present a scene reconstruction framework to restore the 3D information of the surgical site in real time. In particular, a lightweight encoder-decoder network is designed to perform disparity estimation, which is the key component of the scene reconstruction framework. The stereo endoscope of da Vinci Research Kit (dVRK) is adopted to explore the feasibility of the proposed approach, and it provides the possibility for the migration to other Robot Operating System (ROS) based robot platforms due to the strong independence on hardware. The framework is evaluated using three different scenarios, including a public dataset (3018 pairs of endoscopic images), the scene from the dVRK endoscope in our lab as well as a self-made clinical dataset captured from an oncology hospital. Experimental results show that the proposed framework can reconstruct 3D surgical scenes in real time (25 FPS), and achieve high accuracy (2.69 ± 1.48 mm in MAE, 5.47 ± 1.34 mm in RMSE and 0.41 ± 0.23 in SRE, respectively). It demonstrates that our framework can reconstruct intra-operative scenes with high reliability of both accuracy and speed, and the validation of clinical data also shows its potential in surgery. This work enhances the state of art in 3D intra-operative scene reconstruction based on medical robot platforms. The clinical dataset has been released to promote the development of scene reconstruction in the medical image community.

Robotic Instruments Inside the MRI Bore: Key Concepts and Evolving Paradigms in Imaging-enhanced Cranial Neurosurgery

Intraoperative MRI has been increasingly used to robotically deliver electrodes and catheters into the human brain using a linear trajectory with great clinical success. Current cranial MR guided robotics do not allow for continuous real-time imaging during the procedure because most surgical instruments are not MR-conditional. MRI guided robotic cranial surgery can achieve its full potential if all the traditional advantages of robotics (such as tremor-filtering, precision motion scaling, etc.) can be incorporated with the neurosurgeon physically present in the MRI bore or working remotely through controlled robotic arms. The technological limitations of design optimization, choice of sensing, kinematic modeling, physical constraints, and real-time control had hampered early developments in this emerging field, but continued research and development in these areas over time has granted neurosurgeons far greater confidence in using cranial robotic techniques. This article elucidates the role of MR-guided robotic procedures using clinical devices like NeuroBlate and Clearpoint that have several thousands of cases operated in a "linear cranial trajectory" and planned clinical trials, such as LAANTERN for MR guided robotics in cranial neurosurgery using LITT and MR-guided putaminal delivery of AAV2 GDNF in Parkinson's disease. The next logical improvisation would be a steerable curvilinear trajectory in cranial robotics with added DOFs and distal tip dexterity to the neurosurgical tools. Similarly, the novel concept of robotic actuators that are powered, imaged, and controlled by the MRI itself is discussed in this article, with its potential for seamless cranial neurosurgery.

Flexible Needle Bending Model for Spinal Injection Procedures

An in situ needle manipulation technique used by physicians when performing spinal injections is modeled to study its effect on needle shape and needle tip position. A mechanics-based model is proposed and solved using finite element method. A test setup is presented to mimic the needle manipulation motion. Tissue phantoms made from plastisol as well as porcine skeletal muscle samples are used to evaluate the model accuracy against medical images. The effect of different compression models as well as model parameters on model accuracy is studied, and the effect of needle-tissue interaction on the needle remote center of motion is examined. With the correct combination of compression model and model parameters, the model simulation is able to predict needle tip position within submillimeter accuracy.

Design of a Patient-Specific Respiratory-Motion-Simulating Platform for In Vitro 4D Flow MRI

Four-dimensional (4D) flow magnetic resonance imaging (MRI) is a leading-edge imaging technique and has numerous medicinal applications. In vitro 4D flow MRI can offer some advantages over in vivo ones, especially in accurately controlling flow rate (gold standard), removing patient and user-specific variations, and minimizing animal testing. Here, a complete testing method and a respiratory-motion-simulating platform are proposed for in vitro validation of 4D flow MRI. A silicon phantom based on the hepatic arteries of a living pig is made. Under the free-breathing, a human volunteer's liver motion (inferior-superior direction) is tracked using a pencil-beam MRI navigator and is extracted and converted into velocity-distance pairs to program the respiratory-motion-simulating platform. With the magnitude displacement of about 1.3 cm, the difference between the motions obtained from the volunteer and our platform is ≤ 1 mm which is within the positioning error of the MRI navigator. The influence of the platform on the MRI signal-to-noise ratio can be eliminated even if the actuator is placed in the MRI room. The 4D flow measurement errors are respectively 0.4% (stationary phantom), 9.4% (gating window = 3 mm), 27.3% (gating window = 4 mm) and 33.1% (gating window = 7 mm). The vessel resolutions decreased with the increase of the gating window. The low-cost simulation system, assembled from commercially available components, is easy to be duplicated.

State of the Art and Future Opportunities in MRI-Guided Robot-Assisted Surgery and Interventions

Magnetic resonance imaging (MRI) can provide high-quality 3-D visualization of target anatomy, surrounding tissue, and instrumentation, but there are significant challenges in harnessing it for effectively guiding interventional procedures. Challenges include the strong static magnetic field, rapidly switching magnetic field gradients, high-power radio frequency pulses, sensitivity to electrical noise, and constrained space to operate within the bore of the scanner. MRI has a number of advantages over other medical imaging modalities, including no ionizing radiation, excellent soft-tissue contrast that allows for visualization of tumors and other features that are not readily visible by other modalities, true 3-D imaging capabilities, including the ability to image arbitrary scan plane geometry or perform volumetric imaging, and capability for multimodality sensing, including diffusion, dynamic contrast, blood flow, blood oxygenation, temperature, and tracking of biomarkers. The use of robotic assistants within the MRI bore, alongside the patient during imaging, enables intraoperative MR imaging (iMRI) to guide a surgical intervention in a closed-loop fashion that can include tracking of tissue deformation and target motion, localization of instrumentation, and monitoring of therapy delivery. With the ever-expanding clinical use of MRI, MRI-compatible robotic systems have been heralded as a new approach to assist interventional procedures to allow physicians to treat patients more accurately and effectively. Deploying robotic systems inside the bore synergizes the visual capability of MRI and the manipulation capability of robotic assistance, resulting in a closed-loop surgery architecture. This article details the challenges and history of robotic systems intended to operate in an MRI environment and outlines promising clinical applications and associated state-of-the-art MRI-compatible robotic systems and technology for making this possible.

A Smarter Health through the Internet of Surgical Things

(1) Background: In the last few years, technological developments in the surgical field have been rapid and are continuously evolving. One of the most revolutionizing breakthroughs was the introduction of the IoT concept within surgical practice. Our systematic review aims to summarize the most important studies evaluating the IoT concept within surgical practice, focusing on Telesurgery and surgical Telementoring. (2) Methods: We conducted a systematic review of the current literature, focusing on the Internet of Surgical Things in Telesurgery and Telementoring. Forty-eight (48) studies were included in this review. As secondary research questions, we also included brief overviews of the use of IoT in image-guided surgery, and patient Telemonitoring, by systematically analyzing fourteen (14) and nineteen (19) studies, respectively. (3) Results: Data from 219 patients and 757 healthcare professionals were quantitively analyzed. Study designs were primarily observational or based on model development. Palpable advantages from the IoT incorporation mainly include less surgical hours, accessibility to high quality treatment, and safer and more effective surgical education. Despite the described technological advances, and proposed benefits of the systems presented, there are still identifiable gaps in the literature that need to be further explored in a systematic manner. (4) Conclusions: The use of the IoT concept within the surgery domain is a widely incorporated but less investigated concept. Advantages have become palpable over the past decade, yet further research is warranted.

Heat-Mitigated Design and Lorentz Force-Based Steering of an MRI-Driven Microcatheter toward Minimally Invasive Surgery

Catheters integrated with microcoils for electromagnetic steering under the high, uniform magnetic field within magnetic resonance (MR) scanners (3-7 Tesla) have enabled an alternative approach for active catheter operations. Achieving larger ranges of tip motion for Lorentz force-based steering have previously been dependent on using high power coupled with active cooling, bulkier catheter designs, or introducing additional microcoil sets along the catheter. This work proposes an alternative approach using a heat-mitigated design and actuation strategy for a magnetic resonance imaging (MRI)-driven microcatheter. A quad-configuration microcoil (QCM) design is introduced, allowing miniaturization of existing MRI-driven, Lorentz force-based catheters down to 1-mm diameters with minimal power consumption (0.44 W). Heating concerns are experimentally validated using noninvasive MRI thermometry. The Cosserat model is implemented within an MR scanner and results demonstrate a desired tip range up to 110° with 4° error. The QCM is used to validate the proposed model and power-optimized steering algorithm using an MRI-compatible neurovascular phantom and ex vivo kidney tissue. The power-optimized tip orientation controller conserves as much as 25% power regardless of the catheter's initial orientation. These results demonstrate the implementation of an MRI-driven, electromagnetic catheter steering platform for minimally invasive surgical applications without the need for camera feedback or manual advancement via guidewires. The incorporation of such system in clinics using the proposed design and actuation strategy can further improve the safety and reliability of future MRI-driven active catheter operations.

A Brief Insight on Magnetic Resonance Conditional Neurosurgery Robots

The brain is a delicate organ in the human body that requires extreme care. Brain-related diseases are unavoidable. Perse, neurosurgery is a complicated procedure that demands high precision and accuracy. Developing a surgical robot is a complex task. To date, there are only a handful of neurosurgery robots in the market that distinctly undergo clinical procedures. These robots have exorbitant cost that hinders the utmost care progress in the area as they are unaffordable. This paper looked at the historical perspective and presented insight literature of the magnetic resonance conditional stereotactic neurosurgery robots that find their ways in clinics, abandoning research projects and promising research yet to undergo clinical use. In addition, the study also gives a thorough insight into the advantage of magnetic resonance imaging modalities and magnetic resonance conditional robots and the future challenges in automation use. Image compatibility test data and accuracy results are also examined because they guarantee that these systems work correctly in particular imaging settings. The primary differences between these systems include actuation and control technologies, construction materials, and the degree of freedom. Thus, one system has an advantage over the other.

Future Directions in Robotic Neurosurgery

In this paper, we highlight promising technologies in each phase of a robotic neurosurgery operation, and identify key factors affecting how quickly these technologies will mature into products in the operating room. We focus on specific technology trends in image-guided cranial and spinal procedures, including advances in imaging, machine learning, robotics, and novel interfaces. For each technology, we discuss the required effort to overcome safety or implementation challenges, as well as identifying example regulatory approved products in related fields for comparison. The goal is to provide a roadmap for clinicians as to which robotic and automation technologies are in the developmental pipeline, and which ones are likely to impact their practice sooner, rather than later.

Soft robotic manipulator for intraoperative MRI-guided transoral laser microsurgery

Magnetic resonance (MR) imaging (MRI) provides compelling features for the guidance of interventional procedures, including high-contrast soft tissue imaging, detailed visualization of physiological changes, and thermometry. Laser-based tumor ablation stands to benefit greatly from MRI guidance because 3D resection margins alongside thermal distributions can be evaluated in real time to protect critical structures while ensuring adequate resection margins. However, few studies have investigated the use of projection-based lasers like those for transoral laser microsurgery, potentially because dexterous laser steering is required at the ablation site, raising substantial challenges in the confined MRI bore and its strong magnetic field. Here, we propose an MR-safe soft robotic system for MRI-guided transoral laser microsurgery. Owing to its miniature size (Ø12 × 100 mm), inherent compliance, and five degrees of freedom, the soft robot ensures zero electromagnetic interference with MRI and enables safe and dexterous operation within the confined oral and pharyngeal cavities. The laser manipulator is rapidly fabricated with hybrid soft and hard structures and is powered by microvolume (<0.004 milliter) fluid flow to enable laser steering with enhanced stiffness and lowered hysteresis. A learning-based controller accommodates the inherent nonlinear robot actuation, which was validated with laser path-following tests. Submillimeter laser steering accuracy was demonstrated with a mean error < 0.20 mm. MRI compatibility testing demonstrated zero observable image artifacts during robot operation. Ex vivo tissue ablation and a cadaveric head-and-neck trial were carried out under MRI, where we employed MR thermometry to monitor the tissue ablation margin and thermal diffusion intraoperatively.

Preliminary Evaluation of Hydraulic Needle Delivery System for Magnetic Resonance Imaging-Guided Prostate Biopsy Procedures

In clinical routine, the prostate biopsy procedure is performed with the guidance of transrectal ultrasound (TRUS) imaging to diagnose prostate cancer. However, the TRUS-guided prostate biopsy brings reliability concerns due to the lack of contrast difference between prostate tissue and lesions. In this study, a novel hydraulic needle delivery system that is designed for performing magnetic resonance imaging (MRI)-guided prostate biopsy procedure with transperineal approach is introduced. The feasibility of the overall system was evaluated through in vitro phantom experiments under an MRI guidance. The in vitro experiments performed using a certified prostate phantom (incorporating MRI visible lesions). MRI experiments showed that overall hydraulic biopsy needle delivery system has excellent MRI compatibility (signal to noise ratio (SNR) loss &lt; 3%), provides acceptable targeting accuracy (average 2.05±0.46 mm) and procedure time (average 40 min).

MR-Conditional Actuations: A Review

Magnetic resonance imaging (MRI) is one of the most prevailing technologies to enable noninvasive and radiation-free soft tissue imaging. Operating a robotic device under MRI guidance is an active research area that has the potential to provide efficient and precise surgical therapies. MR-conditional actuators that can safely drive these robotic devices without causing safety hazards or adversely affecting the image quality are crucial for the development of MR-guided robotic devices. This paper aims to summarize recent advances in actuation methods for MR-guided robots and each MR-conditional actuator was reviewed based on its working principles, construction materials, the noteworthy features, and corresponding robotic application systems, if any. Primary characteristics, such as torque, force, accuracy, and signal-to-noise ratio (SNR) variation due to the variance of the actuator, are also covered. This paper concludes with a perspective on the current development and future of MR-conditional actuators.

Shoulder-mounted Robot for MRI-Guided Arthrography: Clinically Optimized System

This paper introduces our compact and lightweight patient-mounted MRI-compatible 4 degree-of-freedom (DOF) robot with an improved transmission system for MRI-guided arthrography procedures. This robot could make the traditional two-stage arthrography procedure (fluoroscopy-guided needle insertion followed by a diagnostic MRI scan) simpler by converting it to a one-stage procedure but more accurate with an optimized system. The new transmission system is proposed, using different mechanical components, to result in higher accuracy of needle insertion. The results of a recent accuracy study are reported. Experimental results show that the new system has an error of 1.7 mm in positioning the needle tip at a depth of 50 mm, which indicates high accuracy.

Remotely Actuated Needle Driving Device for MRI-Guided Percutaneous Interventions: Force and Accuracy Evaluation

This paper presents a 2 degrees-of-freedom (DOF) remotely actuated needle driving device for Magnetic Resonance Imaging (MRI) guided pain injections. The device is evaluated in phantom studies under real-time MRI guidance. The force and torque asserted by the device on the 4-DOF base robot are measured. The needle driving device consists of a needle driver, a 1.2-meter long beaded chain transmission, an actuation box, a robot controller and a Graphical User Interface (GUI). The needle driver can fit within a typical MRI scanner bore and is remotely actuated at the end of the MRI table through a novel beaded chain transmission. The remote actuation mechanism significantly reduces the weight and size of the needle driver at the patient end as well as the artifacts introduced by the motors. The clinician can manually steer the needle by rotating the knobs on the actuation box or remotely through a software interface in the MRI console room. The force and torque resulting from the needle driver in various configurations both in static and dynamic status were measured and reported. An accuracy experiment in the MRI environment under real-time image feedback demonstrates a small mean targeting error (<; 1.5 mm) in a phantom study.

Remotely Actuated Needle Driving Device for MRI-Guided Percutaneous Interventions

In this paper we introduce a remotely actuated MRI-compatible needle driving device for pain injections in the lower back. This device is able to manipulate the needle inside the closed-bore MRI scanner under the control of the interventional radiologist inside both the scanner room and the console room. The device consists of a 2 degrees of freedom (DOF) needle driver and an actuation box. The 2-DOF needle driver is placed inside the scanner bore and driven by the actuation box settled at the end of the table through a beaded chain transmission. This novel remote actuation design could reduce the weight and profile of the needle driver that is mounted on the patient, as well as minimize the potential imaging noise introduced by the actuation electronics. The actuation box is designed to perform needle intervention in both manual and motorized fashion by utilizing a mode switch mechanism. A mechanical hard stop is also incorporated to improve the device's safety. The bench-top accuracy evaluation of the device demonstrated a small mean needle placement error (< 1 mm) in a phantom study.

Towards Patient-Specific 3D-Printed Robotic Systems for Surgical Interventions

Surgical robots have been extensively researched for a wide range of surgical procedures due to the advantages of improved precision, sensing capabilities, motion scaling, and tremor reduction, to name a few. Though the underlying disease condition or pathology may be the same across patients, the intervention approach to treat the condition can vary significantly across patients. This is especially true for endovascular interventions, where each case brings forth its own challenges. Hence it is critical to develop patient-specific surgical robotic systems to maximize the benefits of robot-assisted surgery. Manufacturing patient-specific robots can be challenging for complex procedures and furthermore the time required to build them can be a challenge. To overcome this challenge, additive manufacturing, namely 3D-printing, is a promising solution. 3D-printing enables fabrication of complex parts precisely and efficiently. Although 3D-printing techniques have been researched for general medical applications, patient-specific surgical robots are currently in their infancy. After reviewing the state-of-the-art in 3D-printed surgical robots, this paper discusses 3D-printing techniques that could potentially satisfy the stringent requirements for surgical interventions. We also present the accomplishments in our group in developing 3D-printed surgical robots for neurosurgical and cardiovascular interventions. Finally, we discuss the challenges in developing 3D-printed surgical robots and provide our perspectives on future research directions.