Laparoscopic Photoacoustic Imaging System Based on Side-Illumination Diffusing Fibers

OBJECTIVE

To develop a flexible miniaturized photoacoustic (PA) imaging probe for detecting anatomical structures during laparoscopic surgery. The proposed probe aimed to facilitate intraoperative detection of blood vessels and nerve bundles embedded in tissue not directly visible to the operating physician to preserve these delicate and vital structures.

METHODS

We modified a commercially available ultrasound laparoscopic probe by incorporating custom-fabricated side-illumination diffusing fibers that illuminate the probe's field of view. The probe geometry, including the position and orientation of the fibers and the emission angle, was determined using computational models of light propagation in the simulation and subsequently validated through experimental studies.

RESULTS

In wire phantom studies within an optical scattering medium, the probe achieved an imaging resolution of 0.43 ±0.09 mm and a signal-to-noise ratio of 31.2±1.84 dB. We also conducted an ex vivo study using a rat model, demonstrating the successful detection of blood vessels and nerves.

CONCLUSION

Our results indicate the viability of a side-illumination diffusing fiber PA imaging system for guidance during laparoscopic surgery.

SIGNIFICANCE

The potential clinical translation of this technology could enhance the preservation of critical vascular structures and nerves, thereby minimizing post-operative complications.

Intraoperative laparoscopic photoacoustic image guidance system in the da Vinci surgical system

This paper describes a framework allowing intraoperative photoacoustic (PA) imaging integrated into minimally invasive surgical systems. PA is an emerging imaging modality that combines the high penetration of ultrasound (US) imaging with high optical contrast. With PA imaging, a surgical robot can provide intraoperative neurovascular guidance to the operating physician, alerting them of the presence of vital substrate anatomy invisible to the naked eye, preventing complications such as hemorrhage and paralysis. Our proposed framework is designed to work with the da Vinci surgical system: real-time PA images produced by the framework are superimposed on the endoscopic video feed with an augmented reality overlay, thus enabling intuitive three-dimensional localization of critical anatomy. To evaluate the accuracy of the proposed framework, we first conducted experimental studies in a phantom with known geometry, which revealed a volumetric reconstruction error of 1.20 ± 0.71 mm. We also conducted an ex vivo study by embedding blood-filled tubes into chicken breast, demonstrating the successful real-time PA-augmented vessel visualization onto the endoscopic view. These results suggest that the proposed framework could provide anatomical and functional feedback to surgeons and it has the potential to be incorporated into robot-assisted minimally invasive surgical procedures.

Individuals with moderate to severe hand impairments may struggle to use EMG control for assistive devices

Neurological trauma, such as stroke, traumatic brain injury (TBI), spinal cord injury, and cerebral palsy can cause mild to severe upper limb impairments. Hand impairment makes it difficult for individuals to complete activities of daily living, especially bimanual tasks. A robotic hand orthosis or hand exoskeleton can be used to restore partial function of an intact but impaired hand. It is common for upper extremity prostheses and orthoses to use electromyography (EMG) sensing as a method for the user to control their device. However some individuals with an intact but impaired hand may struggle to use a myoelectrically controlled device due to potentially confounding muscle activity. This study was conducted to evaluate the application of conventional EMG control techniques as a robotic orthosis/exoskeleton user input method for individuals with mild to severe hand impairments. Nine impaired subjects and ten healthy subjects were asked to perform repeated contractions of muscles in their forearm and then onset analysis and feature classification were used to determine the accuracy of the employed EMG techniques. The average accuracy for contraction identification across employed EMG techniques was 95.4% ± 4.9 for the healthy subjects and 73.9% ± 13.1 for the impaired subjects with a range of 47.0% ± 19.1 - 91.6% ± 8.5. These preliminary results suggest that the conventional EMG control technologies employed in this paper may be difficult for some impaired individuals to use due to their unreliable muscle control.

State of the Art and Future Opportunities in MRI-Guided Robot-Assisted Surgery and Interventions

Magnetic resonance imaging (MRI) can provide high-quality 3-D visualization of target anatomy, surrounding tissue, and instrumentation, but there are significant challenges in harnessing it for effectively guiding interventional procedures. Challenges include the strong static magnetic field, rapidly switching magnetic field gradients, high-power radio frequency pulses, sensitivity to electrical noise, and constrained space to operate within the bore of the scanner. MRI has a number of advantages over other medical imaging modalities, including no ionizing radiation, excellent soft-tissue contrast that allows for visualization of tumors and other features that are not readily visible by other modalities, true 3-D imaging capabilities, including the ability to image arbitrary scan plane geometry or perform volumetric imaging, and capability for multimodality sensing, including diffusion, dynamic contrast, blood flow, blood oxygenation, temperature, and tracking of biomarkers. The use of robotic assistants within the MRI bore, alongside the patient during imaging, enables intraoperative MR imaging (iMRI) to guide a surgical intervention in a closed-loop fashion that can include tracking of tissue deformation and target motion, localization of instrumentation, and monitoring of therapy delivery. With the ever-expanding clinical use of MRI, MRI-compatible robotic systems have been heralded as a new approach to assist interventional procedures to allow physicians to treat patients more accurately and effectively. Deploying robotic systems inside the bore synergizes the visual capability of MRI and the manipulation capability of robotic assistance, resulting in a closed-loop surgery architecture. This article details the challenges and history of robotic systems intended to operate in an MRI environment and outlines promising clinical applications and associated state-of-the-art MRI-compatible robotic systems and technology for making this possible.

A sEMG Proportional Control for the Gripper of Patient Side Manipulator in da Vinci Surgical System

There is a large community of people with hand disabilities, and these disabilities can be a barrier to those looking to retain or pursue surgical careers. With the development of surgical robotics technologies, it may be possible to develop user interfaces to accommodate these individuals. This paper proposes a hand-free control method for the gripper of a patient side manipulator (PSM) in the da Vinci surgical system. Using electromyography (EMG) signals, a proportional control method was tested on its ability to grasp a pressure sensor. These preliminary results demonstrate that the user can reliably control the grasping motion of the da Vinci PSM using this system. There is a strong correlation between grasping force and normalized EMG signal (r= 0.874). Moreover, the gripper can generate a step grasping force output when feeding in a generated step signal. The results in this paper demonstrate the system integration of a research EMG system with the da Vinci surgical system and are a step towards developing accessible teleoperation systems for surgeons with disabilities. Hand-free control for remaining degrees of freedom in the PSM is under development using additional input from the motion capture system.

Control of a lower limb exoskeleton using Learning from Demonstration and an iterative Linear Quadratic Regulator Controller: A simulation study

Lower limb exoskeletons have complex dynamics that mimic human motion. They need to be able to replicate lower limb motion such as walking. The trajectory of the exoskeleton joints and the control signal generated are essential to the system's operation. Current learning from demonstration methods has only been combined with linear quadratic regulators; this limits the applicability of processes since most robotic systems have non-linear dynamics. The Asynchronous Multi-Body Framework simulates the dynamics and allows for real-time control. Eleven gait cycle demonstrations were recorded from volunteers using motion capture and encoded using Task Parameterized Gaussian mixture models. An iterative linear quadratic regulator is used to find an optimal control signal to drive the exoskeleton joints through the desired trajectories. A PD controller is added as a feed-forward control component for unmodeled dynamics and optimized using the Bayesian Information Criterion. We show how the trajectory is learned, and the control signal is optimized by reducing the required bins for learning. The framework presented produces optimal control signals to allow the exoskeleton's legs to follow human motion demonstrations.

Open source Vicon Toolkit for motion capture and Gait Analysis

BACKGROUND AND OBJECTIVE

The Vicon motion capture system is a popular tool for biomechanics, gait analysis, and robotics. The ASCII files produced are large and complex, making them difficult to read and analyze.

METHODS

This paper presents two packages, the Vicon Toolkit Package and the Gait Analysis Toolkit Package. They use an open-source framework for ingesting, parsing, and analyzing Vicon mocap data and performing gait analysis. The package that handles the Vicon analysis is separated from the Gait Analysis package to allow for abstraction and expansion, and is not specific only to the Vicon system.

RESULTS

Our Vicon Toolkit provides tools to work directly with the marker data and other Vicon Nexus system outputs. The Gait Toolkit provides tools for performing gait analysis, EMG filtering, and learning trajectories. The packages are built upon a core library, GaitCore, that provides unified objects to perform operations and store data.

CONCLUSION

This paper will show how to use the packages' tools and the expected outputs. All the tools are open-source and written in Python3.x for ease of use and access to other powerful libraries.

Modeling of Interstitial Ultrasound Ablation for Continuous Applicator Rotation With MR Validation

The primary objective of cancer intervention is the selective removal of malignant cells while conserving surrounding healthy tissues. However, the accessibility, size and shape of the cancer can make achieving appropriate margins a challenge. One minimally invasive treatment option for these clinical cases is interstitial needle based therapeutic ultrasound (NBTU). In this work, we develop a finite element model (FEM) capable of simulating continuous rotation of a directional NBTU applicator. The developed model was used to simulate the thermal deposition for different rotation trajectories. The actual thermal deposition patterns for the simulated trajectories were then evaluated using magnetic resonance thermal imaging (MRTI) in a porcine skin gelatin phantom. An MRI-compatible robot was used to control the rotation motion profile of the physical NBTU applicator to match the simulated trajectory. The model showed agreement when compared to experimental measurements with Pearson correlation coefficients greater than 0.839 when comparing temperature fields within an area of 12.6 mm radius from the ultrasound applicator. The average temperature error along a 6.3 mm radius profile from the applicator was 1.27 °C. The model was able to compute 1 s of thermal deposition by the applicator in 0.2 s on average with a 0.1 mm spatial resolution and 0.5 s time steps. The developed simulation demonstrates performance suitable for real-time control which may enable robotically-actuated closed-loop conformal tumor ablation.

An Integrated Robotic System for MRI-Guided Neuroablation: Preclinical Evaluation

OBJECTIVE

Treatment of brain tumors requires high precision in order to ensure sufficient treatment while minimizing damage to surrounding healthy tissue. Ablation of such tumors using needle-based therapeutic ultrasound (NBTU) under real-time magnetic resonance imaging (MRI) can fulfill this need. However, the constrained space and strong magnetic field in the MRI bore restricts patient access limiting precise placement of the NBTU ablation tool. A surgical robot compatible with use inside the bore of an MRI scanner can alleviate these challenges.

METHODS

We present preclinical trials of a robotic system for NBTU ablation of brain tumors under real-time MRI guidance. The system comprises of an updated robotic manipulator and corresponding control electronics, the NBTU ablation system and applications for planning, navigation and monitoring of the system.

RESULTS

The robotic system had a mean translational and rotational accuracy of 1.39  ± 0.64 mm and 1.27 [Formula: see text] in gelatin phantoms and 3.13  ± 1.41 mm and 5.58 [Formula: see text] in 10 porcine trials while causing a maximum reduction in signal to noise ratio (SNR) of 10.3%.

CONCLUSION

The integrated robotic system can place NBTU ablator at a desired target location in porcine brain and monitor the ablation in realtime via magnetic resonance thermal imaging (MRTI).

SIGNIFICANCE

Further optimization of this system could result in a clinically viable system for use in human trials for various diagnostic or therapeutic neurosurgical interventions.

A Fully Actuated Robotic Assistant for MRI-Guided Precision Conformal Ablation of Brain Tumors

This paper reports the development of a fully actuated robotic assistant for magnetic resonance imaging (MRI)-guided precision conformal ablation of brain tumors using an interstitial high intensity needle-based therapeutic ultrasound (NBTU) ablator probe. The robot is designed with an eight degree-of-freedom (DOF) remote center of motion (RCM) manipulator driven by piezoelectric actuators, five for aligning the ultrasound thermal ablator to the target lesions and three for inserting and orienting the ablator and its cannula to generate a desired ablation profile. The 8-DOF fully actuated robot can be operated in the scanner bore during imaging; thus, alleviating the need of moving the patient in or out of the scanner during the procedure, and therefore potentially reducing the procedure time and streamlining the workflow. The free space positioning accuracy of the system is evaluated with the OptiTrack motion capture system, demonstrating the root mean square (RMS) error of the tip position to be 1.11±0.43mm. The system targeting accuracy in MRI is assessed with phantom studies, indicating the RMS errors of the tip position to be 1.45±0.66mm and orientation to be 1.53±0.69°. The feasibility of the system to perform thermal ablation is validated through a preliminary ex-vivo tissue study with position error less than 4.3mm and orientation error less than 4.3°.

Demonstration and Experimental Validation of Plastic-Encased Resonant Ultrasonic Piezoelectric Actuator for Magnetic Resonance Imaging-Guided Surgical Robots

Intra-operative medical imaging based on magnetic resonance imaging (MRI) coupled with robotic manipulation of surgical instruments enables precise feedback-driven procedures. Electrically powered nonferromagnetic motors based on piezoelectric elements have shown to be well suited for MRI robots. However, even avoiding ferrous materials, the high metal content on commercially available motors still cause distortions to the magnetic fields. We construct semicustom piezoelectric actuators wherein the quantity of conductive material is minimized and demonstrate that the distortion issues can be partly addressed through substituting several of these components for plastic equivalents, while maintaining motor functionality. Distortion was measured by assessing the root-mean-squared (RMS) change in position of 49 centroid points in a 12.5 mm square grid of a gelatin-filled phantom. The metal motor caused a distortion of up to 4.91 mm versus 0.55 mm for the plastic motor. An additional signal-to-noise-ratio (SNR) drop between motor off and motor spinning of approximately 20% was not statistically different for metal versus plastic (p = 0.36).

A minimally invasive catheter-based ultrasound technology for therapeutic interventions in brain: initial preclinical studies

OBJECTIVE Minimally invasive procedures may allow surgeons to avoid conventional open surgical procedures for certain neurological disorders. This paper describes the iterative process for development of a catheter-based ultrasound thermal therapy applicator. METHODS Using an ultrasound applicator with an array of longitudinally stacked and angularly sectored tubular transducers within a catheter, the authors conducted experimental studies in porcine liver, in vivo and ex vivo, in order to characterize the device performance and lesion patterns. In addition, they applied the technique in a rodent model of Parkinson's disease to investigate the feasibility of its application in brain. RESULTS Thermal lesions with multiple shapes and sizes were readily achieved in porcine liver. The feasibility of catheter-based focused ultrasound in the treatment of brain conditions was demonstrated in a rodent model of Parkinson's disease. CONCLUSIONS The authors show proof of principle of a catheter-based ultrasound system that can create lesions with concurrent thermode-based measurements.

A Method for High-Throughput Robotic Assembly of Three-Dimensional Vascular Tissue

IMPACT STATEMENT

Self-assembled tissues have potential to serve both as implantable grafts and as tools for disease modeling and drug screening. For these applications, tissue production must ultimately be scaled-up and automated. Limited technologies exist for precisely manipulating self-assembled tissues, which are fragile early in culture. Here, we presented a method for automatically stacking self-assembled smooth muscle cell rings onto mandrels, using a custom-designed well plate and robotic punch system. Rings then fuse into tissue-engineered blood vessels (TEBVs). This is a critical step toward automating TEBV production that may be applied to other tubular tissues as well.

DEMONSTRATION AND EXPERIMENTAL VALIDATION OF PLASTIC-ENCASED RESONANT ULTRASONIC PIEZOELECTRIC ACTUATOR FOR MRI-GUIDED SURGICAL ROBOTS

Intra-operative medical imaging based on magnetic resonance imaging (MRI) coupled with robotic manipulation of surgical instruments enables precise feedback-driven procedures. Electrically powered non-ferromagnetic motors based on piezoelectric elements have shown to be well suited for MRI robots. However, even avoiding ferrous materials, the high metal content on commercially available motors still cause distortions to the magnetic fields. We construct semi-custom piezoelectric actuators wherein the quantity of conductive material is minimized and demonstrate that the distortion issues can be partly addressed through substituting several of these components for plastic equivalents, while maintaining motor functionality. Distortion was measured by assessing the RMS change in position of 49 centroid points in a 12.5mm square grid of a gelatin-filled phantom. The metal motor caused a distortion of up to 4.91mm versus 0.55mm for the plastic motor. An additional SNR drop between motor off and motor spinning of approximately 20% was not statistically different for metal versus plastic (p=0.36).

System Integration and Preliminary Clinical Evaluation of a Robotic System for MRI-Guided Transperineal Prostate Biopsy

This paper presents the development, preclinical evaluation, and preliminary clinical study of a robotic system for targeted transperineal prostate biopsy under direct interventional magnetic resonance imaging (MRI) guidance. The clinically integrated robotic system is developed based on a modular design approach, comprised of surgical navigation application, robot control software, MRI robot controller hardware, and robotic needle placement manipulator. The system provides enabling technologies for MRI-guided procedures. It can be easily transported and setup for supporting the clinical workflow of interventional procedures, and the system is readily extensible and reconfigurable to other clinical applications. Preclinical evaluation of the system is performed with phantom studies in a 3 Tesla MRI scanner, rehearsing the proposed clinical workflow, and demonstrating an in-plane targeting error of 1.5mm. The robotic system has been approved by the institutional review board (IRB) for clinical trials. A preliminary clinical study is conducted with the patient consent, demonstrating the targeting errors at two biopsy target sites to be 4.0mm and 3.7mm, which is sufficient to target a clinically significant tumor foci. First-in-human trials to evaluate the system's effectiveness and accuracy for MR image-guide prostate biopsy are underway.

Evaluation of robot-assisted MRI-guided prostate biopsy: needle path analysis during clinical trials

While the interaction between a needle and the surrounding tissue is known to cause a significant targeting error in prostate biopsy leading to false-negative results, few studies have demonstrated how it impacts in the actual procedure. We performed a pilot study on robot-assisted MRI-guided prostate biopsy with an emphasis on the in-depth analysis of the needle-tissue interaction in vivo. The data were acquired during in-bore transperineal prostate biopsies in patients using a 4 degrees-of-freedom (DoF) MRI-compatible robot. The anatomical structures in the pelvic area and the needle path were reconstructed from MR images, and quantitatively analyzed. We analyzed each structure individually and also proposed a mathematical model to investigate the influence of those structures in the targeting error using the mixed-model regression. The median targeting error in 188 insertions (27 patients) was 6.3 mm. Both the individual anatomical structure analysis and the mixed-model analysis showed that the deviation resulted from the contact between the needle and the skin as the main source of error. On contrary, needle bending inside the tissue (expressed as needle curvature) did not vary among insertions with targeting errors above and below the average. The analysis indicated that insertions crossing the bulbospongiosus presented a targeting error lower than the average. The mixed-model analysis demonstrated that the distance between the needle guide and the patient skin, the deviation at the entry point, and the path length inside the pelvic diaphragm had a statistically significant contribution to the targeting error (p  <  0.05). Our results indicate that the errors associated with the elastic contact between the needle and the skin were more prominent than the needle bending along the insertion. Our findings will help to improve the preoperative planning of transperineal prostate biopsies.

Closed-Loop Active Compensation for Needle Deflection and Target Shift During Cooperatively Controlled Robotic Needle Insertion

Intra-operative imaging is sometimes available to assist needle biopsy, but typical open-loop insertion does not account for unmodeled needle deflection or target shift. Closed-loop image-guided compensation for deviation from an initial straight-line trajectory through rotational control of an asymmetric tip can reduce targeting error. Incorporating robotic closed-loop control often reduces physician interaction with the patient, but by pairing closed-loop trajectory compensation with hands-on cooperatively controlled insertion, a physician's control of the procedure can be maintained while incorporating benefits of robotic accuracy. A series of needle insertions were performed with a typical 18G needle using closed-loop active compensation under both fully autonomous and user-directed cooperative control. We demonstrated equivalent improvement in accuracy while maintaining physician-in-the-loop control with no statistically significant difference (p > 0.05) in the targeting accuracy between any pair of autonomous or individual cooperative sets, with average targeting accuracy of 3.56 mm_rms. With cooperatively controlled insertions and target shift between 1 and 10 mm introduced upon needle contact, the system was able to effectively compensate up to the point where error approached a maximum curvature governed by bending mechanics. These results show closed-loop active compensation can enhance targeting accuracy, and that the improvement can be maintained under user directed cooperative insertion.

Mechanical Validation of an MRI Compatible Stereotactic Neurosurgery Robot in Preparation for Pre-Clinical Trials

The use of magnetic resonance imaging (MRI) for guiding robotic surgical devices has shown great potential for performing precisely targeted and controlled interventions. To fully realize these benefits, devices must work safely within the tight confines of the MRI bore without negatively impacting image quality. Here we expand on previous work exploring MRI guided robots for neural interventions by presenting the mechanical design and assessment of a device for positioning, orienting, and inserting an interstitial ultrasound-based ablation probe. From our previous work we have added a 2 degree of freedom (DOF) needle driver for use with the aforementioned probe, revised the mechanical design to improve strength and function, and performed an evaluation of the mechanism's accuracy and effect on MR image quality. The result of this work is a 7-DOF MRI robot capable of positioning a needle tip and orienting it's axis with accuracy of 1.37 ± 0.06mm and 0.79° ± 0.41°, inserting it along it's axis with an accuracy of 0.06 ± 0.07mm, and rotating it about it's axis to an accuracy of 0.77° ± 1.31°. This was accomplished with no significant reduction in SNR caused by the robot's presence in the MRI bore, ≤ 10.3% reduction in SNR from running the robot's motors during a scan, and no visible paramagnetic artifacts.

An MRI-Guided Telesurgery System Using a Fabry-Perot Interferometry Force Sensor and a Pneumatic Haptic Device

This paper presents a surgical master-slave teleoperation system for percutaneous interventional procedures under continuous magnetic resonance imaging (MRI) guidance. The slave robot consists of a piezoelectrically actuated 6-degree-of-freedom (DOF) robot for needle placement with an integrated fiber optic force sensor (1-DOF axial force measurement) using the Fabry-Perot interferometry (FPI) sensing principle; it is configured to operate inside the bore of the MRI scanner during imaging. By leveraging the advantages of pneumatic and piezoelectric actuation in force and position control respectively, we have designed a pneumatically actuated master robot (haptic device) with strain gauge based force sensing that is configured to operate the slave from within the scanner room during imaging. The slave robot follows the insertion motion of the haptic device while the haptic device displays the needle insertion force as measured by the FPI sensor. Image interference evaluation demonstrates that the telesurgery system presents a signal to noise ratio reduction of less than 17% and less than 1% geometric distortion during simultaneous robot motion and imaging. Teleoperated needle insertion and rotation experiments were performed to reach 10 targets in a soft tissue-mimicking phantom with 0.70 ± 0.35 mm Cartesian space error.

Closed-loop asymmetric-tip needle steering under continuous intraoperative MRI guidance

Magnetic resonance imaging (MRI) provides excellent image contrast for various types of tissues, making it a suitable choice over other imaging modalities for various image-guided needle interventions. Furthermore, robot-assistance is maturing for surgical procedures such as percutaneous prostate and brain interventions. Although MRI-guided, robot-assisted needle interventions are approaching clinical usage, they are still typically open-loop in nature due to the lack of continuous intraoperative needle tracking. Closed-loop needle-based procedures can improve the accuracy of needle tip placement by correcting the needle trajectory during insertion. This paper proposes a system for robot-assisted, flexible asymmetric-tipped needle interventions under continuous intraoperative MRI guidance. A flexible needle's insertion depth and rotation angle are manipulated by an MRI-compatible robot in the bore of the MRI scanner during continuous multi-planar image acquisition to reach a desired target location. Experiments are performed on gelatin phantoms to assess the accuracy of needle placement into the target location. The system was able to successfully utilize live MR imaging to guide the path of the needle, and results show an average total targeting error of 2.5±0.47mm, with an average in-plane error of 2.09±0.33mm.

Fiber Optic Force Sensors for MRI-Guided Interventions and Rehabilitation: A Review

Magnetic Resonance Imaging (MRI) provides both anatomical imaging with excellent soft tissue contrast and functional MRI imaging (fMRI) of physiological parameters. The last two decades have witnessed the manifestation of increased interest in MRI-guided minimally invasive intervention procedures and fMRI for rehabilitation and neuroscience research. Accompanying the aspiration to utilize MRI to provide imaging feedback during interventions and brain activity for neuroscience study, there is an accumulated effort to utilize force sensors compatible with the MRI environment to meet the growing demand of these procedures, with the goal of enhanced interventional safety and accuracy, improved efficacy and rehabilitation outcome. This paper summarizes the fundamental principles, the state of the art development and challenges of fiber optic force sensors for MRI-guided interventions and rehabilitation. It provides an overview of MRI-compatible fiber optic force sensors based on different sensing principles, including light intensity modulation, wavelength modulation, and phase modulation. Extensive design prototypes are reviewed to illustrate the detailed implementation of these principles. Advantages and disadvantages of the sensor designs are compared and analyzed. A perspective on the future development of fiber optic sensors is also presented which may have additional broad clinical applications. Future surgical interventions or rehabilitation will rely on intelligent force sensors to provide situational awareness to augment or complement human perception in these procedures.

Towards synergistic control of hands-on needle insertion with automated needle steering for MRI-guided prostate interventions

A significant hurdle of accurate needle tip placement in percutaneous needle-based prostate interventions is unmodeled needle deflection and tissue deformation during insertion. This paper introduces a robotic platform for developing synergistic, cooperatively controlled needle insertion algorithms decoupled from closed-loop image-guided needle steering. Shared control of the surgical workspace through human-robot synergy creates a balance between the accuracy of robotic autonomy while still providing ultimate control of the procedure to the physician. Validation tests were performed using camera-based image-guided feedback control of needle steering with cooperative hands-on needle insertion. Locations were targeted inside a transparent gelatin phantom with an average total error of 2.68 ± 0.34mm and in-plane error of 2.59 ± 0.30mm.

A Concentric Tube Continuum Robot with Piezoelectric Actuation for MRI-Guided Closed-Loop Targeting

This paper presents the design, modeling and experimental evaluation of a magnetic resonance imaging (MRI)-compatible concentric tube continuum robotic system. This system enables MRI-guided deployment of a precurved and steerable concentric tube continuum mechanism, and is suitable for clinical applications where a curved trajectory is needed. This compact 6 degree-of-freedom (DOF) robotic system is piezoelectrically-actuated, and allows simultaneous robot motion and imaging with no visually observable image artifact. The targeting accuracy is evaluated with optical tracking system and gelatin phantom under live MRI-guidance with Root Mean Square (RMS) errors of 1.94 and 2.17 mm respectively. Furthermore, we demonstrate that the robot has kinematic redundancy to reach the same target through different paths. This was evaluated in both free space and MRI-guided gelatin phantom trails, with RMS errors of 0.48 and 0.59 mm respectively. As the first of its kind, MRI-guided targeted concentric tube needle placements with ex vivo porcine liver are demonstrated with 4.64 mm RMS error through closed-loop control of the piezoelectrically-actuated robot.

Modeling and design of a tendon actuated soft robotic exoskeleton for hemiparetic upper limb rehabilitation

Robotic technology has recently been explored as a means to rehabilitate and assist individuals suffering from hemiparesis of their upper limbs. Robotic approaches allow for targeted rehabilitation routines which are more personalized and adaptable while providing quantitative measurements of patient outcomes. Development of these technologies into inherently safe and portable devices has the potential to extend the therapy outside of the clinical setting and into the patient's home with benefits to the cost and accessibility of care. To this end, a soft, cable actuated robotic glove and sleeve was designed, modeled, and constructed to provide assistance of finger and elbow movements in a way that mimics the biological function of the tendons. The resulting design increases safety through greater compliance as well as greater tolerance for misalignment with the user's skeletal frame over traditional rigid exoskeletons. Overall this design provides a platform to expand and study the concepts around soft robotic rehabilitation.

Robotic system for MRI-guided stereotactic neurosurgery

Stereotaxy is a neurosurgical technique that can take several hours to reach a specific target, typically utilizing a mechanical frame and guided by preoperative imaging. An error in any one of the numerous steps or deviations of the target anatomy from the preoperative plan such as brain shift (up to mm), may affect the targeting accuracy and thus the treatment effectiveness. Moreover, because the procedure is typically performed through a small burr hole opening in the skull that prevents tissue visualization, the intervention is basically “blind” for the operator with limited means of intraoperative confirmation that may result in reduced accuracy and safety. The presented system is intended to address the clinical needs for enhanced efficiency, accuracy, and safety of image-guided stereotactic neurosurgery for deep brain stimulation lead placement. The study describes a magnetic resonance imaging (MRI)-guided, robotically actuated stereotactic neural intervention system for deep brain stimulation procedure, which offers the potential of reducing procedure duration while improving targeting accuracy and enhancing safety. This is achieved through simultaneous robotic manipulation of the instrument and interactively updated in situ MRI guidance that enables visualization of the anatomy and interventional instrument. During simultaneous actuation and imaging, the system has demonstrated less than 15% signal-to-noise ratio variation and less than 0.20 geometric distortion artifact without affecting the imaging usability to visualize and guide the procedure. Optical tracking and MRI phantom experiments streamline the clinical workflow of the prototype system, corroborating targeting accuracy with three-ax- s root mean square error 1.38 ± 0.45 mm in tip position and 2.03 ± 0.58° in insertion angle.

Tissue Changes During Operational Load Bearing in UH-60 Aircrew Using Magnetic Resonance Imaging

INTRODUCTION

Warfighters involved in mounted operations often experience prolonged periods of tissue loading, leading to injury. Determining how anatomical structures are affected during loading aids in the prevention and treatment of injury. The purpose of this study was to develop a magnetic resonance imaging (MRI) compatible seat system that simulates a UH-60 Blackhawk in-flight sitting posture.

METHODS

Eight men were scanned with a 3.0 Tesla MRI. Scans were collected with and without 6.38 psi of pressure applied to the buttocks via two air bladders and an MRI-compatible robot controller system.

RESULTS

Scans revealed that 6.38 psi of pressure applied to the buttocks significantly decreases total soft-tissue thickness beneath the left and right ischial tuberosities by 3.6 and 3.8 mm, respectively.

DISCUSSION

At operational load bearing pressures seen in the UH-60, the soft tissue structures of the buttocks are compressed. These findings aid in our understanding of the etiology of repetitive trauma disorders in aircrew due to prolonged sitting. This study serves as the foundation for future work examining the anatomical changes associated with prolonged restricted sitting and other operational activities. A better understanding of the anatomical characteristics associated with mounted operations is invaluable to the prevention and treatment of injuries reported by warfighters and civilian populations.

Piezoelectrically Actuated Robotic System for MRI-Guided Prostate Percutaneous Therapy

This paper presents a fully-actuated robotic system for percutaneous prostate therapy under continuously acquired live magnetic resonance imaging (MRI) guidance. The system is composed of modular hardware and software to support the surgical workflow of intra-operative MRI-guided surgical procedures. We present the development of a 6-degree-of-freedom (DOF) needle placement robot for transperineal prostate interventions. The robot consists of a 3-DOF needle driver module and a 3-DOF Cartesian motion module. The needle driver provides needle cannula translation and rotation (2-DOF) and stylet translation (1-DOF). A custom robot controller consisting of multiple piezoelectric motor drivers provides precision closed-loop control of piezoelectric motors and enables simultaneous robot motion and MR imaging. The developed modular robot control interface software performs image-based registration, kinematics calculation, and exchanges robot commands and coordinates between the navigation software and the robot controller with a new implementation of the open network communication protocol OpenIGTLink. Comprehensive compatibility of the robot is evaluated inside a 3-Tesla MRI scanner using standard imaging sequences and the signal-to-noise ratio (SNR) loss is limited to 15%. The image deterioration due to the present and motion of robot demonstrates unobservable image interference. Twenty-five targeted needle placements inside gelatin phantoms utilizing an 18-gauge ceramic needle demonstrated 0.87 mm root mean square (RMS) error in 3D Euclidean distance based on MRI volume segmentation of the image-guided robotic needle placement procedure.

In-bore prostate transperineal interventions with an MRI-guided parallel manipulator: system development and preliminary evaluation

BACKGROUND

Robot-assisted minimally-invasive surgery is well recognized as a feasible solution for diagnosis and treatment of prostate cancer in humans.

METHODS

This paper discusses the kinematics of a parallel 4 Degrees-of-Freedom (DOF) surgical manipulator designed for minimally invasive in-bore prostate percutaneous interventions through the patient's perineum. The proposed manipulator takes advantage of four sliders actuated by MRI-compatible piezoelectric motors and incremental rotary encoders. Errors, mostly originating from the design and manufacturing process, need to be identified and reduced before the robot is deployed in clinical trials.

RESULTS

The manipulator has undergone several experiments to evaluate the repeatability and accuracy (about 1 mm in air (in x or y direction) at the needle's reference point) of needle placement, which is an essential concern in percutaneous prostate interventions.

CONCLUSION

The acquired results endorse the sustainability, precision and reliability of the manipulator. Copyright © 2015 John Wiley & Sons, Ltd.

A soft robotic exomusculature glove with integrated sEMG sensing for hand rehabilitation

Stroke affects 750,000 people annually, and 80% of stroke survivors are left with weakened limbs and hands. Repetitive hand movement is often used as a rehabilitation technique in order to regain hand movement and strength. In order to facilitate this rehabilitation, a robotic glove was designed to aid in the movement and coordination of gripping exercises. This glove utilizes a cable system to open and close a patients hand. The cables are actuated by servomotors, mounted in a backpack weighing 13.2 lbs including battery power sources. The glove can be controlled in terms of finger position and grip force through switch interface, software program, or surface myoelectric (sEMG) signal. The primary control modes of the system provide: active assistance, active resistance and a preprogrammed mode. This project developed a working prototype of the rehabilitative robotic glove which actuates the fingers over a full range of motion across one degree-of-freedom, and is capable of generating a maximum 15N grip force.

Combining psychological and engineering approaches to utilizing social robots with children with autism

It is estimated that Autism Spectrum Disorder (ASD) affects 1 in 68 children. Early identification of an ASD is exceedingly important to the introduction of an intervention. We are developing a robot-assisted approach that will serve as an improved diagnostic and early intervention tool for children with autism. The robot, named PABI® (Penguin for Autism Behavioral Interventions), is a compact humanoid robot taking on an expressive cartoon-like embodiment. The robot is affordable, durable, and portable so that it can be used in various settings including schools, clinics, and the home. Thus enabling significantly enhanced and more readily available diagnosis and continuation of care. Through facial expressions, body motion, verbal cues, stereo vision-based tracking, and a tablet computer, the robot is capable of interacting meaningfully with an autistic child. Initial implementations of the robot, as part of a comprehensive treatment model (CTM), include Applied Behavioral Analysis (ABA) therapy where the child interacts with a tablet computer wirelessly interfaced with the robot. At the same time, the robot makes meaningful expressions and utterances and uses stereo cameras in eyes to track the child, maintain eye contact, and collect data such as affect and gaze direction for charting of progress. In this paper we present the clinical justification, anticipated usage with corresponding requirements, prototype development of the robotic system, and demonstration of a sample application for robot-assisted ABA therapy.

A Fabry-Perot Interferometry Based MRI-Compatible Miniature Uniaxial Force Sensor for Percutaneous Needle Placement

Robot-assisted surgical procedures, taking advantage of the high soft tissue contrast and real-time imaging of magnetic resonance imaging (MRI), are developing rapidly. However, it is crucial to maintain tactile force feedback in MRI-guided needle-based procedures. This paper presents a Fabry-Perot interference (FPI) based system of an MRI-compatible fiber optic sensor which has been integrated into a piezoelectrically actuated robot for prostate cancer biopsy and brachytherapy in 3T MRI scanner. The opto-electronic sensing system design was minimized to fit inside an MRI-compatible robot controller enclosure. A flexure mechanism was designed that integrates the FPI sensor fiber for measuring needle insertion force, and finite element analysis was performed for optimizing the correct force-deformation relationship. The compact, low-cost FPI sensing system was integrated into the robot and calibration was conducted. The root mean square (RMS) error of the calibration among the range of 0-10 Newton was 0.318 Newton comparing to the theoretical model which has been proven sufficient for robot control and teleoperation.

Teleoperation System with Hybrid Pneumatic-Piezoelectric Actuation for MRI-Guided Needle Insertion with Haptic Feedback

This paper presents a surgical master-slave tele-operation system for percutaneous interventional procedures under continuous magnetic resonance imaging (MRI) guidance. This system consists of a piezoelectrically actuated slave robot for needle placement with integrated fiber optic force sensor utilizing Fabry-Perot interferometry (FPI) sensing principle. The sensor flexure is optimized and embedded to the slave robot for measuring needle insertion force. A novel, compact opto-mechanical FPI sensor interface is integrated into an MRI robot control system. By leveraging the complementary features of pneumatic and piezoelectric actuation, a pneumatically actuated haptic master robot is also developed to render force associated with needle placement interventions to the clinician. An aluminum load cell is implemented and calibrated to close the impedance control loop of the master robot. A force-position control algorithm is developed to control the hybrid actuated system. Teleoperated needle insertion is demonstrated under live MR imaging, where the slave robot resides in the scanner bore and the user manipulates the master beside the patient outside the bore. Force and position tracking results of the master-slave robot are demonstrated to validate the tracking performance of the integrated system. It has a position tracking error of 0.318mm and sine wave force tracking error of 2.227N.

Towards Clinically Optimized MRI-guided Surgical Manipulator for Minimally Invasive Prostate Percutaneous Interventions: Constructive Design

This paper undertakes the modular design and development of a minimally invasive surgical manipulator for MRI-guided transperineal prostate interventions. Severe constraints for the MRI-compatibility to hold the minimum artifact on the image quality and dimensions restraint of the bore scanner shadow the design procedure. Regarding the constructive design, the manipulator kinematics has been optimized and the effective analytical needle workspace is developed and followed by proposing the workflow for the manual needle insertion. A study of the finite element analysis is established and utilized to improve the mechanism weaknesses under some inevitable external forces to ensure the minimum structure deformation. The procedure for attaching a sterile plastic drape on the robot manipulator is discussed. The introduced robotic manipulator herein is aimed for the clinically prostate biopsy and brachytherapy applications.

A Fully Actuated Robotic Assistant for MRI-Guided Prostate Biopsy and Brachytherapy

Intra-operative medical imaging enables incorporation of human experience and intelligence in a controlled, closed-loop fashion. Magnetic resonance imaging (MRI) is an ideal modality for surgical guidance of diagnostic and therapeutic procedures, with its ability to perform high resolution, real-time, high soft tissue contrast imaging without ionizing radiation. However, for most current image-guided approaches only static pre-operative images are accessible for guidance, which are unable to provide updated information during a surgical procedure. The high magnetic field, electrical interference, and limited access of closed-bore MRI render great challenges to developing robotic systems that can perform inside a diagnostic high-field MRI while obtaining interactively updated MR images. To overcome these limitations, we are developing a piezoelectrically actuated robotic assistant for actuated percutaneous prostate interventions under real-time MRI guidance. Utilizing a modular design, the system enables coherent and straight forward workflow for various percutaneous interventions, including prostate biopsy sampling and brachytherapy seed placement, using various needle driver configurations. The unified workflow compromises: 1) system hardware and software initialization, 2) fiducial frame registration, 3) target selection and motion planning, 4) moving to the target and performing the intervention (e.g. taking a biopsy sample) under live imaging, and 5) visualization and verification. Phantom experiments of prostate biopsy and brachytherapy were executed under MRI-guidance to evaluate the feasibility of the workflow. The robot successfully performed fully actuated biopsy sampling and delivery of simulated brachytherapy seeds under live MR imaging, as well as precise delivery of a prostate brachytherapy seed distribution with an RMS accuracy of 0.98mm.

An affordable compact humanoid robot for Autism Spectrum Disorder interventions in children

Autism Spectrum Disorder impacts an ever-increasing number of children. The disorder is marked by social functioning that is characterized by impairment in the use of nonverbal behaviors, failure to develop appropriate peer relationships and lack of social and emotional exchanges. Providing early intervention through the modality of play therapy has been effective in improving behavioral and social outcomes for children with autism. Interacting with humanoid robots that provide simple emotional response and interaction has been shown to improve the communication skills of autistic children. In particular, early intervention and continuous care provide significantly better outcomes. Currently, there are no robots capable of meeting these requirements that are both low-cost and available to families of autistic children for in-home use. This paper proposes the piloting the use of robotics as an improved diagnostic and early intervention tool for autistic children that is affordable, non-threatening, durable, and capable of interacting with an autistic child. This robot has the ability to track the child with its 3 degree of freedom (DOF) eyes and 3-DOF head, open and close its 1-DOF beak and 1-DOF each eyelids, raise its 1-DOF each wings, play sound, and record sound. These attributes will give it the ability to be used for the diagnosis and treatment of autism. As part of this project, the robot and the electronic and control software have been developed, and integrating semi-autonomous interaction, teleoperation from a remote healthcare provider and initiating trials with children in a local clinic are in progress.

Development of a StandAlone Surgical Haptic Arm

When performing telesurgery with current commercially available Minimally Invasive Robotic Surgery (MIRS) systems, a surgeon cannot feel the tool interactions that are inherent in traditional laparoscopy. It is proposed that haptic feedback in the control of MIRS systems could improve the speed, safety and learning curve of robotic surgery. To test this hypothesis, a standalone surgical haptic arm (SASHA) capable of manipulating da Vinci tools has been designed and fabricated with the additional ability of providing information for haptic feedback. This arm was developed as a research platform for developing and evaluating approaches to telesurgery, including various haptic mappings between master and slave and evaluating the effects of latency.

Reconfigurable MRI-guided robotic surgical manipulator: prostate brachytherapy and neurosurgery applications

This paper describes a modular design approach for robotic surgical manipulator under magnetic resonance imaging (MRI) guidance. The proposed manipulator provides 2 degree of freedom (DOF) Cartesian motion and 2-DOF pitch and yaw motion. Primarily built up with dielectric materials, it utilizes parallel mechanism and is compact in size to fit into the limited space of close-bore MRI scanner. It is ideal for needle based surgical procedures which usually require positioning and orientation control for accurate imaging plane alignment. Specifically, this mechanism is easily reconfigurable to over constrained manipulator structure which provides 2-DOF Cartesian motion by simple structure modification. This modular manipulator integrated with different end-effector modules is investigated for prostate brachytherapy and neurosurgery applications as preliminary evaluation.

Preclinical evaluation of an MRI-compatible pneumatic robot for angulated needle placement in transperineal prostate interventions

PURPOSE

To evaluate the targeting accuracy of a small profile MRI-compatible pneumatic robot for needle placement that can angulate a needle insertion path into a large accessible target volume.

METHODS

We extended our MRI-compatible pneumatic robot for needle placement to utilize its four degrees-of-freedom (4-DOF) mechanism with two parallel triangular structures and support transperineal prostate biopsies in a closed-bore magnetic resonance imaging (MRI) scanner. The robot is designed to guide a needle toward a lesion so that a radiologist can manually insert it in the bore. The robot is integrated with navigation software that allows an operator to plan angulated needle insertion by selecting a target and an entry point. The targeting error was evaluated while the angle between the needle insertion path and the static magnetic field was between -5.7° and 5.7° horizontally and between -5.7° and 4.3° vertically in the MRI scanner after sterilizing and draping the device.

RESULTS

The robot positioned the needle for angulated insertion as specified on the navigation software with overall targeting error of 0.8 ± 0.5mm along the horizontal axis and 0.8 ± 0.8mm along the vertical axis. The two-dimensional root-mean-square targeting error on the axial slices as containing the targets was 1.4mm.

CONCLUSIONS

Our preclinical evaluation demonstrated that the MRI-compatible pneumatic robot for needle placement with the capability to angulate the needle insertion path provides targeting accuracy feasible for clinical MRI-guided prostate interventions. The clinical feasibility has to be established in a clinical study.

CHIC: cylindrical helix imaging coordinate registration fiducial for MRI-guided interventions

Accurate placement of tubular shaped surgical tools is necessary for a large variety of image-guided medical interventions. In this process, localization of the instrument, or a robotic assistant manipulating the instrument, is crucial for successful registration of physical space to medical image space. Various fiducial frames and registration methods have been proposed and discussed in literature. However, these frames are typically bulky in size or otherwise not appropriate for use with MR imaging. In particular, it is impossible or awkward to integrate them with the surgical tools. This paper presents the design a compact Cylindrical Helix Imaging Coordinate Registration Fiducial (CHIC) and algorithm to precisely and robustly localize the frame in 6 degree of freedom (DOF). The mathematical model of the frame is developed and evaluated with simulation. This cylindrical shaped frame is particularly suitable for mounting to the distal end of tubular shape surgical tools, which provides a direct imaging visualization of frame, tool and possibly the surgical sites. The paper uses MRI-guided surgical procedure as a focusing application, although the broader aim is development of a versatile registration frame that is usable for a variety of image-guided procedures ranging from ultrasound to fluoroscopy and computerized tomography (CT). Accuracy and performance were evaluated in three cases: simulated images with artificial noise, arbitrarily re-sliced 3D MRI volume, and real 3T MRI images.

A Unified and Integrated Approach to Teaching a Two-Course Sequence in Robotics Engineering

This paper presents the details of the curricular content developed for a two-course robotics sequence within the undergraduate Robotics Engineering program at Worcester Polytechnic Institute. The approach focuses on teaching a unified robotics curriculum, incorporating the foundational concepts from computer science, electrical engineering and mechanical engineering, in an integrative manner by emphasizing the whole systemdesign. Outcomes include high student satisfaction, enhanced student learning and a broad engineering education to meet the needs of the growing robotics industry.

Approaches to creating and controlling motion in MRI

Magnetic Resonance Imaging (MRI) can provide three dimensional (3D) imaging with excellent resolution and sensitivity making it ideal for guiding and monitoring interventions. The development of MRI-compatible interventional devices is complicated by factors including: the high magnetic field strength, the requirement that such devices should not degrade image quality, and the confined physical space of the scanner bore. Numerous MRI guided actuated devices have been developed or are currently being developed utilizing piezoelectric actuators as their primary means of mechanical energy generation to enable better interventional procedure performance. While piezoelectric actuators are highly desirable for MRI guided actuation for their precision, high holding force, and non-magnetic operation they are often found to cause image degradation on a large enough to scale to render live imaging unusable. This paper describes a newly developed piezoelectric actuator driver and control system designed to drive a variety of both harmonic and non-harmonic motors that has been demonstrated to be capable of operating both harmonic and non-harmonic piezoelectric actuators with less than 5% SNR loss under closed loop control. The proposed system device allows for a single controller to control any supported actuator and feedback sensor without any physical hardware changes.

High-field MRI-compatible needle placement robot for prostate interventions

This paper presents the design of a magnetic resonance imaging (MRI) compatible needle placement system actuated by piezoelectric actuators for prostate brachytherapy and biopsy. An MRI-compatible modular 3 degree-of-freedom (DOF) needle driver module coupled with a 3-DOF x-y-z stage is proposed as a slave robot to precisely deliver radioactive brachytherapy seeds under interactive MRI guidance. The needle driver module provides for needle cannula rotation, needle insertion and cannula retraction to enable the brachytherapy procedure with the preloaded needles. The device mimics the manual physician gesture by two point grasping (hub and base) and provides direct force measurement of needle insertion force by fiber optic force sensors. The fabricated prototype is presented and an experiment with phantom trials in 3T MRI is analyzed to demonstrate the system compatibility.