Hybrid Tendon and Ball Chain Continuum Robots for Enhanced Dexterity in Medical Interventions

A hybrid continuum robot design is introduced that combines a proximal tendon-actuated section with a distal telescoping section comprised of permanent-magnet spheres actuated using an external magnet. While, individually, each section can approach a point in its workspace from one or at most several orientations, the two-section combination possesses a dexterous workspace. The paper describes kinematic modeling of the hybrid design and provides a description of the dexterous workspace. We present experimental validation which shows that a simplified kinematic model produces tip position mean and maximum errors of 3% and 7% of total robot length, respectively.

Using robotics to move a neurosurgeon's hands to the tip of their endoscope

A major advantage of surgical robots is that they can reduce the invasiveness of a procedure by enabling the clinician to manipulate tools as they would in open surgery but through small incisions in the body. Neurosurgery has yet to benefit from this advantage. Although clinical robots are available for the least invasive neurosurgical procedures, such as guiding electrode insertion, the most invasive brain surgeries, such as tumor resection, are still performed as open manual procedures. To investigate whether robotics could reduce the invasiveness of major brain surgeries while still providing the manipulation capabilities of open surgery, we created a two-armed joystick-controlled endoscopic robot. To evaluate the efficacy of this robot, we developed a set of neurosurgical skill tasks patterned after the steps of brain tumor resection. We also created a patient-derived brain model for pineal tumors, which are located in the center of the brain and are normally removed by open surgery. In comparison, testing with existing manual endoscopic instrumentation, we found that the robot provided access to a much larger working volume at the trocar tip and enabled bimanual tasks without compression of brain tissue adjacent to the trocar. Furthermore, many tasks could be completed faster with the robot. These results suggest that robotics has the potential to substantially reduce the invasiveness of brain surgery by enabling certain procedures currently performed as open surgery to be converted to endoscopic interventions.

A novel ex vivo tracheobronchomalacia model for airway stent testing and in vivo model refinement

OBJECTIVES

We sought to develop an ex vivo trachea model capable of producing mild, moderate, and severe tracheobronchomalacia for optimizing airway stent design. We also aimed to determine the amount of cartilage resection required for achieving different tracheobronchomalacia grades that can be used in animal models.

METHODS

We developed an ex vivo trachea test system that enabled video-based measurement of internal cross-sectional area as intratracheal pressure was cyclically varied for peak negative pressures of 20 to 80 cm H2O. Fresh ovine tracheas were induced with tracheobronchomalacia by single mid-anterior incision (n = 4), mid-anterior circumferential cartilage resection of 25% (n = 4), and 50% per cartilage ring (n = 4) along an approximately 3-cm length. Intact tracheas (n = 4) were used as control. All experimental tracheas were mounted and experimentally evaluated. In addition, helical stents of 2 different pitches (6 mm and 12 mm) and wire diameters (0.52 mm and 0.6 mm) were tested in tracheas with 25% (n = 3) and 50% (n = 3) circumferentially resected cartilage rings. The percentage collapse in tracheal cross-sectional area was calculated from the recorded video contours for each experiment.

RESULTS

Ex vivo tracheas compromised by single incision and 25% and 50% circumferential cartilage resection produce tracheal collapse corresponding to clinical grades of mild, moderate, and severe tracheobronchomalacia, respectively. A single anterior cartilage incision produces saber-sheath type tracheobronchomalacia, whereas 25% and 50% circumferential cartilage resection produce circumferential tracheobronchomalacia. Stent testing enabled the selection of stent design parameters such that airway collapse associated with moderate and severe tracheobronchomalacia could be reduced to conform to, but not exceed, that of intact tracheas (12-mm pitch, 0.6-mm wire diameter).

CONCLUSIONS

The ex vivo trachea model is a robust platform that enables systematic study and treatment of different grades and morphologies of airway collapse and tracheobronchomalacia. It is a novel tool for optimization of stent design before advancing to in vivo animal models.

Robotic Instruments Inside the MRI Bore: Key Concepts and Evolving Paradigms in Imaging-enhanced Cranial Neurosurgery

Intraoperative MRI has been increasingly used to robotically deliver electrodes and catheters into the human brain using a linear trajectory with great clinical success. Current cranial MR guided robotics do not allow for continuous real-time imaging during the procedure because most surgical instruments are not MR-conditional. MRI guided robotic cranial surgery can achieve its full potential if all the traditional advantages of robotics (such as tremor-filtering, precision motion scaling, etc.) can be incorporated with the neurosurgeon physically present in the MRI bore or working remotely through controlled robotic arms. The technological limitations of design optimization, choice of sensing, kinematic modeling, physical constraints, and real-time control had hampered early developments in this emerging field, but continued research and development in these areas over time has granted neurosurgeons far greater confidence in using cranial robotic techniques. This article elucidates the role of MR-guided robotic procedures using clinical devices like NeuroBlate and Clearpoint that have several thousands of cases operated in a "linear cranial trajectory" and planned clinical trials, such as LAANTERN for MR guided robotics in cranial neurosurgery using LITT and MR-guided putaminal delivery of AAV2 GDNF in Parkinson's disease. The next logical improvisation would be a steerable curvilinear trajectory in cranial robotics with added DOFs and distal tip dexterity to the neurosurgical tools. Similarly, the novel concept of robotic actuators that are powered, imaged, and controlled by the MRI itself is discussed in this article, with its potential for seamless cranial neurosurgery.

Workspace Characterization for Hybrid Tendon and Ball Chain Continuum Robots

Continuum robots have attracted considerable attention for applications in minimally invasive diagnostics and therapeutics over the past decade [1]. The primary reason is their ability to navigate narrow and tortuous anatomical passageways, while guaranteeing safe inter- action with the anatomy. In designing such robots, an important goal is create a robot with a workspace appropriate for the clinical task. A significant limitation of many continuum designs re- lates to the minimum radius of curvature that a particular design can achieve. While multiple bending sections can be concatenated to provide more degrees of freedom, the orientations by which a point in the workspace can be approached are often limited. To overcome this limitation, this paper investigates a hybrid design that combines the advantages of tendon- actuated [2] and magnetic ball chain robots [3] as shown in Fig. 1. In this hybrid design, a proximal tendon- actuated section positions the robot with respect to the goal tip location while a distal ball chain section orients the robot tip with respect to the goal location. This abstract describes how the hybrid kinematics can be modeled and illustrates how the hybrid design possesses a dextrous workspace of finite extent.

Magnetic Ball Chain Robots for Endoluminal Interventions

This paper introduces a novel class of hyperredundant robots comprised of chains of permanently magnetized spheres enclosed in a cylindrical polymer skin. With their shape controlled using an externally-applied magnetic field, the spherical joints of these robots enable them to bend to very small radii of curvature. These robots can be used as steerable tips for endoluminal instruments. A kinematic model is derived based on minimizing magnetic and elastic potential energy. Simulation is used to demonstrate the enhanced steerability of these robots in comparison to magnetic soft continuum robots designed using either distributed or lumped magnetic material. Experiments are included to validate the model and to demonstrate the steering capability of ball chain robots in bifurcating channels.

Closed-form Kinematic Model and Workspace Characterization for Magnetic Ball Chain Robots

Magnetic ball chains are well suited to serve as the steerable tips of endoluminal robots. While it has been demonstrated that these robots produce a larger reachable workspace than magnetic soft continuum robots designed using either distributed or lumped magnetic material, here we investigate the orientational capabilities of these robots. To increase the range of orientations that can be produced at each point in the workspace, we introduce a comparatively-stiff outer sheath from which the steerable ball chain is extended. We present an energy-based kinematic model and also derive an approximate expression for the range of achievable orientations at each point in the workspace. Experiments are used to validate these results.

Modeling Tendon-actuated Concentric Tube Robots

Mechanics-based models have been developed to describe the shape of tendon-actuated continuum robots. Models have also been developed to describe the shape of concentric tube robots, i.e., nested combinations of precurved superelastic tubes. While an important class of continuum robots used in endoscopic and intracardiac medical applications combines these two designs, existing models do not cover this combination. Tendon-actuated models are limited to a single tube while concentric tube models do not include tendon-produced forces and moments. This paper derives a mechanics-based model for this hybrid design and assesses it using numerical and physical experiments involving a pair of tendon-actuated tubes. It is demonstrated that, similar to concentric tube robots, relative twisting between the tendon-actuated tubes is an important factor in determining overall robot shape.

A Soft Robotic Balloon Endoscope for Airway Procedures

Soft robots can provide advantages for medical interventions given their low cost and their ability to change shape and safely apply forces to tissue. This article explores the potential for their use for endoscopically-guided balloon dilation procedures in the airways. A scalable robot design based on balloon catheter technology is proposed, which is composed of five balloons together with a tip-mounted camera and LED. Its design parameters are optimized with respect to the clinical requirements associated with balloon dilation procedures in the trachea and bronchi. Possessing a lumen to allow for respiration and powered by the pressure and vacuum sources found in a clinical procedure room, the robot is teleoperated through the airways using a game controller and real-time video from the tip-mounted camera. The robot design includes proximal and distal bracing balloons that expand radially to produce traction forces. The distal bracing balloon is also used to perform balloon dilation. Three actuation balloons, located between the bracing balloons, produce elongation and bending of the robot body to enable locomotion and turning. An analysis of the actuation balloons, which incorporate helical coils to prevent radial collapse, provides design formulas by relating geometric parameters to such performance criteria as maximum change in actuator length and maximum robot bending angle. Experimental evaluation of a prototype robot inside rigid plastic tubes and ex vivo porcine airways is used to demonstrate the potential of the approach.

Continuum Robots for Medical Interventions

Continuum robots are not constructed with discrete joints but, instead, change shape and position their tip by flexing along their entire length. Their narrow curvilinear shape makes them well suited to passing through body lumens, natural orifices, or small surgical incisions to perform minimally invasive procedures. Modeling and controlling these robots are, however, substantially more complex than traditional robots comprised of rigid links connected by discrete joints. Furthermore, there are many approaches to achieving robot flexure. Each presents its own design and modeling challenges, and to date, each has been pursued largely independently of the others. This article attempts to provide a unified summary of the state of the art of continuum robot architectures with respect to design for specific clinical applications. It also describes a unifying framework for modeling and controlling these systems while additionally explaining the elements unique to each architecture. The major research accomplishments are described for each topic and directions for the future progress needed to achieve widespread clinical use are identified.

Eccentric Tube Robots as Multiarmed Steerable Sheaths

This paper presents a novel continuum robot sheath for use in single-port minimally invasive procedures such as neuroendoscopy in which the sheath is designed to deliver multiple robotic arms. Actuation of the sheath is achieved by using precurved superelastic tubes lining the working channels used for arm delivery. These tubes perform a similar role to push/pull tendons, but can accomplish shape change of the sheath via rotation. A kinematic model using Cosserat rod theory is derived which is based on modeling the system as a set of eccentrically aligned precurved tubes constrained along their length by an elastic backbone. The specific case of a two-arm sheath is considered in detail. Simulation and experiments are used to investigate the validate the concept and model.

A decade retrospective of medical robotics research from 2010 to 2020

[Figure: see text].

In Vivo Molding of Airway Stents

Like ready-to-wear clothing, medical devices come in a fixed set of sizes. While this may accommodate a large fraction of the patient population, others must either experience suboptimal results due to poor sizing or must do without the device. Although techniques have been proposed to fabricate patient-specific devices in advance of a procedure, this process is expensive and time consuming. An alternative solution that provides every patient with a tailored fit is to create devices that can be customized to the patient's anatomy as they are delivered. This paper reports an in vivo molding process in which a soft flexible photocurable stent is delivered into the trachea or bronchi over a UV-transparent balloon. The balloon is expanded such that the stent conforms to the varying cross-sectional shape of the airways. UV light is then delivered through the balloon curing the stent into its expanded conformal shape. The potential of this method is demonstrated using phantom, ex vivo and in vivo experiments. This approach can produce stents providing equivalent airway support to those made from standard materials while providing a customized fit.

The grand challenges of Science Robotics

One of the ambitions of Science Robotics is to deeply root robotics research in science while developing novel robotic platforms that will enable new scientific discoveries. Of our 10 grand challenges, the first 7 represent underpinning technologies that have a wider impact on all application areas of robotics. For the next two challenges, we have included social robotics and medical robotics as application-specific areas of development to highlight the substantial societal and health impacts that they will bring. Finally, the last challenge is related to responsible innovation and how ethics and security should be carefully considered as we develop the technology further.

Minimally Invasive Bilateral Anterior Cingulotomy via Open Minicraniotomy Using a Novel Multiport Cisternoscope: A Cadaveric Demonstration

BACKGROUND

Bilateral anterior cingulotomy has been used to treat chronic pain, obsessive compulsive disorder, and addictions. Lesioning of the target area is typically performed using bilateral stereotactic electrode placement and target ablation, which involves transparenchymal access through both hemispheres.

OBJECTIVE

To evaluate an endoscopic direct-vision lesioning using a unilateral parasagittal minicraniotomy for minimally invasive bilateral anterior cingulotomy using a novel multiport endoscope through the anterior interhemispheric fissure.

METHODS

A novel multiport magnetic resonance imaging (MRI)-compatible neuroendoscope prototype is used to demonstrate cadaveric cingulate lesioning through a lateral imaging port while simultaneously viewing the pericallosal arteries as landmarks through a tip imaging port. The lateral port enables extended lesioning of the gyrus while rotation of the endoscope about its axis provides access to homologous areas of both hemispheres.

RESULTS

Cadaver testing confirmed the capability to navigate the multiport neuroendoscope between the hemispheres using concurrent imaging from the tip and lateral ports. The lateral port enabled exploration of the gyrus, visualization of lesioning, and subsequent inspection of lesions. Tip-port imaging provided navigational cues and allowed the operator to ensure that the endoscope tip did not contact tissue. The multiport design required instrument rotation in the coronal plane of only 20° to lesion both gyri, while a standard endoscope necessitated a rotation of 54°.

CONCLUSION

Multiport MRI-compatible endoscopy can be effectively used in cisternal endoscopy, whereby a unilateral parasagittal minicraniotomy can be used for endoscopic interhemispheric bilateral anterior cingulotomy.

Preclinical evaluation of a pediatric airway stent for tracheobronchomalacia

OBJECTIVES

We sought to demonstrate in an animal model that helical stents made from a nickel titanium alloy called nitinol (NiTi) and designed for malacic airways could be delivered and removed without significant trauma while minimally impeding mucus clearance during the period of implantation.

METHODS

Stents were delivered and removed from the tracheas of healthy 20 kg swine (n = 5) using tools designed to minimize trauma. In 4-week experiments, the stents were implanted on day 0, removed after 3 weeks, and swine were put to death after 4 weeks. Weekly bronchoscopies, radiographs, and mucus clearance examinations were performed in vivo. Hematoxylin and eosin staining and scanning electron microscopy imaging were used to evaluate foreign body response, tracheal tissue reaction, and damage and to measure unciliated regions.

RESULTS

In all in vivo experiments, the stent was implanted and removed atraumatically. Mucus clearance was maintained throughout the experiment period. Hematoxylin and eosin-stained slides showed that foreign body response and tracheal tissue damage were localized to the stented subsections. Tracheal tissue reaction and damage was further restricted to the epithelium and submucosal layers. Scanning electron microscopy imaging revealed that the cilia were absent only over the contact area between the trachea and the wire forming the helical stent.

CONCLUSIONS

Helical nitinol stents designed to provide radial support for malacic airways were well tolerated in a porcine model, providing for mucus clearance while also enabling atraumatic removal.

Steering a Multi-armed Robotic Sheath Using Eccentric Precurved Tubes

This paper presents a novel continuum robot sheath for use in single-port minimally invasive procedures such as neuroendoscopy in which the sheath is designed to deliver multiple robotic arms. Articulation of the sheath is achieved by using precurved superelastic tubes lining the working channels used for arm delivery. These tubes perform a similar role to push/pull tendons, but can accomplish shape change of the sheath via rotation as well as translation. A kinematic model using Cosserat rod theory is derived which is based on modeling the system as a set of eccentrically aligned precurved tubes constrained along their length by an elastic backbone. The specific case of a two-arm sheath is considered in detail and its relationship to a concentric tube balanced pair is described. Simulation and experiment are used to investigate the concept, map its workspace and to evaluate the kinematic model.

Autonomous Robotic Intracardiac Catheter Navigation Using Haptic Vision

While all minimally invasive procedures involve navigating from a small incision in the skin to the site of the intervention, it has not been previously demonstrated how this can be done autonomously. To show that autonomous navigation is possible, we investigated it in the hardest place to do it - inside the beating heart. We created a robotic catheter that can navigate through the blood-filled heart using wall-following algorithms inspired by positively thigmotactic animals. The catheter employs haptic vision, a hybrid sense using imaging for both touch-based surface identification and force sensing, to accomplish wall following inside the blood-filled heart. Through in vivo animal experiments, we demonstrate that the performance of an autonomously-controlled robotic catheter rivals that of an experienced clinician. Autonomous navigation is a fundamental capability on which more sophisticated levels of autonomy can be built, e.g., to perform a procedure. Similar to the role of automation in fighter aircraft, such capabilities can free the clinician to focus on the most critical aspects of the procedure while providing precise and repeatable tool motions independent of operator experience and fatigue.

Optically-guided instrument for transapical beating-heart delivery of artificial mitral chordae tendineae

OBJECTIVE

We sought to develop an instrument that would enable the delivery of artificial chordae tendineae (ACT) using optical visualization of the leaflet inside the beating heart.

METHODS

A delivery instrument was developed together with an ACT anchor system. The instrument incorporates an optically clear silicone grasping surface in which are embedded a camera and LED for direct leaflet visualization during localization, grasping, and chordal delivery. ACTs, comprised of T-shaped anchors and an expanded polytetrafluoroethylene chordae, were fabricated to enable testing in a porcine model. Ex vivo experiments were used to measure the anchor tear-out force from the mitral leaflets. In vivo experiments were performed in which the mitral leaflets were accessed transapically using only optical guidance and ACTs were deployed in the posterior and anterior leaflets (P2 and A2 segments).

RESULTS

In 5 porcine ex vivo experiments, the mean force required to tear the anchors from the leaflets was 3.8 ± 1.2 N. In 5 porcine in vivo nonsurvival procedures, 14 ACTs were successfully placed in the leaflets (9 in P2 and 5 in A2). ACT implantation took an average of 3.22 ± 0.83 minutes from entry to exit through the apex.

CONCLUSIONS

Optical visualization of the mitral leaflet during chordal placement is feasible and provides direct feedback to the operator throughout the deployment sequence. This enables visual confirmation of the targeted leaflet location, distance from the free edge, and successful deployment of the chordal anchor. Further studies are needed to refine and assess the device for clinical use.

Pediatric Airway Stent Designed to Facilitate Mucus Transport and Atraumatic Removal

OBJECTIVE

The goal was to develop a pediatric airway stent for treating tracheobronchomalacia that could be used as an alternative to positive pressure ventilation. The design goals were for the stent to allow mucus flow and to resist migration inside the airways, while also enabling easy insertion and removal.

METHODS

A helical stent design, together with insertion and removal tools, is presented. A mechanics model of stent compression is derived to assist in selecting stent design parameters (pitch and wire diameter) that provide the desired amount of tracheal support, while introducing the minimal amount of foreign material into the airway. Worst-case airway area reduction with stent support is investigated experimentally using a pressurized tracheal phantom matched to porcine tracheal tissue properties. The stent design is then evaluated in a porcine in vivo experiment.

RESULTS

Phantom testing validated the mechanics model of stent compression. In vivo testing demonstrated that the stent was well tolerated by the animal. Since the helical design covers only a small portion of the epithelium, mucus transport through the stented region was minimally impeded. Furthermore, the screw-like stent resisted migration, while also providing for atraumatic removal through the use of an unscrewing motion during removal.

CONCLUSION

The proposed stent design and tools represent a promising approach to prevent airway collapse in children with tracheobronchomalacia.

SIGNIFICANCE

The proposed technology overcomes the limitations of existing airway stents and may provide an alternative to maintaining children on a ventilator.

Modeling Tube Clearance and Bounding the Effect of Friction in Concentric Tube Robot Kinematics

The shape of a concentric tube robot depends not only on the relative rotations and translations of its constituent tubes, but also on the history of relative tube displacements. Existing mechanics-based models neglect all history-dependent phenomena with the result that when calibrated on experimental data collected over a robot's workspace, the maximum tip position error can exceed 8 mm for a 200-mm-long robot. In this paper, we develop a model that computes the bounding kinematic solutions in which Coulomb friction is acting either to maximize or minimize the relative twisting between each pair of contacting tubes. The path histories associated with these limiting cases correspond to first performing all tube translations and then performing relative tube rotations of sufficient angle so that the maximum Coulomb friction force is obtained along the interface of each contacting tube pair. The robot tip configurations produced by these path histories are shown experimentally to bound position error with respect to the estimated frictionless model compared to path histories comprised of translation or mixed translation and rotation. Intertube friction forces and torques are computed as proportional to the intertube contact forces. To compute these contact forces, the standard zero-clearance assumption that constrains the concentrically combined tubes to possess the same centerline is relaxed. The effects of clearance and friction are explored through numerical and physical experiments and it is shown that friction can explain much of the prediction error observed in existing models. This model is not intended for real-time control, but rather for path planning-to provide error bounds and to inform how the ordering of tube rotations and translations can be used to reduce the effect of friction.

Varying ultrasound power level to distinguish surgical instruments and tissue

We investigate a new framework of surgical instrument detection based on power-varying ultrasound images with simple and efficient pixel-wise intensity processing. Without using complicated feature extraction methods, we identified the instrument with an estimated optimal power level and by comparing pixel values of varying transducer power level images. The proposed framework exploits the physics of ultrasound imaging system by varying the transducer power level to effectively distinguish metallic surgical instruments from tissue. This power-varying image-guidance is motivated from our observations that ultrasound imaging at different power levels exhibit different contrast enhancement capabilities between tissue and instruments in ultrasound-guided robotic beating-heart surgery. Using lower transducer power levels (ranging from 40 to 75% of the rated lowest ultrasound power levels of the two tested ultrasound scanners) can effectively suppress the strong imaging artifacts from metallic instruments and thus, can be utilized together with the images from normal transducer power levels to enhance the separability between instrument and tissue, improving intraoperative instrument tracking accuracy from the acquired noisy ultrasound volumetric images. We performed experiments in phantoms and ex vivo hearts in water tank environments. The proposed multi-level power-varying ultrasound imaging approach can identify robotic instruments of high acoustic impedance from low-signal-to-noise-ratio ultrasound images by power adjustments.

A low-cost bioprosthetic semilunar valve for research, disease modelling and surgical training applications

OBJECTIVES

This paper provides detailed instructions for constructing low-cost bioprosthetic semilunar valves for animal research and clinical training. This work fills an important gap between existing simulator training valves and clinical valves by providing fully functioning designs that can be employed in ex vivo and in vivo experiments and can also be modified to model valvular disease.

METHODS

Valves are constructed in 4 steps consisting of creating a metal frame, covering it with fabric and attaching a suture ring and leaflets. Computer-aided design files are provided for making the frame from wire or by metal 3D printing. The covering fabric and suturing ring are made from materials readily available in a surgical lab, while the leaflets are made from pericardium. The entire fabrication process is described in figures and in a video. To demonstrate disease modelling, design modifications are described for producing paravalvular leaks, and these valves were evaluated in porcine ex vivo (n = 3) and in vivo (n = 6) experiments.

RESULTS

Porcine ex vivo and acute in vivo experiments demonstrate that the valves can replicate the performance of clinical valves for research and training purposes. Surgical implantation is similar, and echocardiograms are comparable to clinical valves. Furthermore, valve leaflet function was satisfactory during acute in vivo tests with little central regurgitation, while the paravalvular leak modifications consistently produced leaks in the desired locations.

CONCLUSIONS

The detailed design procedure presented here, which includes a tutorial video and computer-aided design files, should be of substantial benefit to researchers developing valve disease models and to clinicians developing realistic valve training systems.

Designing Stable Concentric Tube Robots Using Piecewise Straight Tubes

Concentric tube robots experience elastic instability when the potential energy stored in torsional twisting of the tubes is suddenly released. To date, ensuring stability for all possible rotational configurations has involved constraining the precurvatures and/or precurved lengths of the tubes comprising the robot, which results in limitations on robot curvature and workspace. This paper presents a design approach that eliminates the constraints on tube precurvature and length for stable rotation. The idea is to compose designs in which, at every point along the length of a robot, a single tube is precurved and the others are straight. The resulting designs do not experience any precurvature-induced torsional tube twisting and so are stable regardless of precurvature and length. This design concept can be usefully employed at the tip of a robot to provide a large stable range of tip orientation angles. A stability analysis is provided for designs composed of an arbitrary number of tubes and design rules are provided for tube pairs that can produce tip angles varying from zero to a desired maximum value. The method is validated experimentally for a tube pair comprised of three sections.

Cardioscopically Guided Beating Heart Surgery: Paravalvular Leak Repair

PURPOSE

There remains a paucity of direct visualization techniques for beating-heart intracardiac procedures. To address this need, we evaluated a novel cardioscope in the context of aortic paravalvular leaks (PVLs) localization and closure.

DESCRIPTION

A porcine aortic PVL model was created using a custom-made bioprosthetic valve, and PVL presence was verified by epicardial echocardiography. Transapical delivery of occlusion devices guided solely by cardioscopy was attempted 13 times in a total of three pigs. Device retrieval after release was attempted six times. Echocardiography, morphologic evaluation, and delivery time were used to assess results.

EVALUATION

Cardioscopic imaging enabled localization of PVLs via visualization of regurgitant jet flow in a paravalvular channel at the base of the prosthetic aortic valve. Occluders were successfully placed in 11 of 13 attempts (84.6%), taking on average 3:03 ± 1:34 min. Devices were cardioscopically removed successfully in three of six attempts (50%), taking 3:41 ± 1:46 min. No damage to the ventricle or annulus was observed at necropsy.

CONCLUSIONS

Cardioscopy can facilitate intracardiac interventions by providing direct visualization of anatomic structures inside the blood-filled, beating-heart model.

Toward On-line Parameter Estimation of Concentric Tube Robots Using a Mechanics-based Kinematic Model

Although existing mechanics-based models of concentric tube robots have been experimentally demonstrated to approximate the actual kinematics, determining accurate estimates of model parameters remains difficult due to the complex relationship between the parameters and available measurements. Further, because the mechanics-based models neglect some phenomena like friction, nonlinear elasticity, and cross section deformation, it is also not clear if model error is due to model simplification or to parameter estimation errors. The parameters of the superelastic materials used in these robots can be slowly time-varying, necessitating periodic re-estimation. This paper proposes a method for estimating the mechanics-based model parameters using an extended Kalman filter as a step toward on-line parameter estimation. Our methodology is validated through both simulation and experiments.

A multiport MR-compatible neuroendoscope: spanning the gap between rigid and flexible scopes

OBJECTIVE Rigid endoscopes enable minimally invasive access to the ventricular system; however, the operative field is limited to the instrument tip, necessitating rotation of the entire instrument and causing consequent tissue compression while reaching around corners. Although flexible endoscopes offer tip steerability to address this limitation, they are more difficult to control and provide fewer and smaller working channels. A middle ground between these instruments-a rigid endoscope that possesses multiple instrument ports (for example, one at the tip and one on the side)-is proposed in this article, and a prototype device is evaluated in the context of a third ventricular colloid cyst resection combined with septostomy. METHODS A prototype neuroendoscope was designed and fabricated to include 2 optical ports, one located at the instrument tip and one located laterally. Each optical port includes its own complementary metal-oxide semiconductor (CMOS) chip camera, light-emitting diode (LED) illumination, and working channels. The tip port incorporates a clear silicone optical window that provides 2 additional features. First, for enhanced safety during tool insertion, instruments can be initially seen inside the window before they extend from the scope tip. Second, the compliant tip can be pressed against tissue to enable visualization even in a blood-filled field. These capabilities were tested in fresh porcine brains. The image quality of the multiport endoscope was evaluated using test targets positioned at clinically relevant distances from each imaging port, comparing it with those of clinical rigid and flexible neuroendoscopes. Human cadaver testing was used to demonstrate third ventricular colloid cyst phantom resection through the tip port and a septostomy performed through the lateral port. To extend its utility in the treatment of periventricular tumors using MR-guided laser therapy, the device was designed to be MR compatible. Its functionality and compatibility inside a 3-T clinical scanner were also tested in a brain from a freshly euthanized female pig. RESULTS Testing in porcine brains confirmed the multiport endoscope's ability to visualize tissue in a blood-filled field and to operate inside a 3-T MRI scanner. Cadaver testing confirmed the device's utility in operating through both of its ports and performing combined third ventricular colloid cyst resection and septostomy with an endoscope rotation of less than 5°. CONCLUSIONS The proposed design provides freedom in selecting both the number and orientation of imaging and instrument ports, which can be customized for each ventricular pathological entity. The lightweight, easily manipulated device can provide added steerability while reducing the potential for the serious brain distortion that happens with rigid endoscope navigation. This capability would be particularly valuable in treating hydrocephalus, both primary and secondary (due to tumors, cysts, and so forth). Magnetic resonance compatibility can aid in endoscope-assisted ventricular aqueductal plasty and stenting, the management of multiloculated complex hydrocephalus, and postinflammatory hydrocephalus in which scarring obscures the ventricular anatomy.

Optimizing Tube Precurvature to Enhance Elastic Stability of Concentric Tube Robots

Robotic instruments based on concentric tube technology are well suited to minimally invasive surgery since they are slender, can navigate inside small cavities and can reach around sensitive tissues by taking on shapes of varying curvature. Elastic instabilities can arise, however, when rotating one precurved tube inside another. In contrast to prior work that considered only tubes of piecewise constant precurvature, we allow precurvature to vary along the tube's arc length. Stability conditions for a planar tube pair are derived and used to formulate an optimal design problem. An analytic formulation of the optimal precurvature function is derived that achieves a desired tip orientation range while maximizing stability and respecting bending strain limits. This formulation also includes straight transmission segments at the proximal ends of the tubes. The result, confirmed by both numerical and physical experiment, enables designs with enhanced stability in comparison to designs of constant precurvature.

Adaptive Nonparametric Kinematic Modeling of Concentric Tube Robots

Concentric tube robots comprise telescopic precurved elastic tubes. The robot's tip and shape are controlled via relative tube motions, i.e. tube rotations and translations. Non-linear interactions between the tubes, e.g. friction and torsion, as well as uncertainty in the physical properties of the tubes themselves, e.g. the Young's modulus, curvature, or stiffness, hinder accurate kinematic modelling. In this paper, we present a machine-learning-based methodology for kinematic modelling of concentric tube robots and in situ model adaptation. Our approach is based on Locally Weighted Projection Regression (LWPR). The model comprises an ensemble of linear models, each of which locally approximates the original complex kinematic relation. LWPR can accommodate for model deviations by adjusting the respective local models at run-time, resulting in an adaptive kinematics framework. We evaluated our approach on data gathered from a three-tube robot, and report high accuracy across the robot's configuration space.

Simultaneous steering and imaging of magnetic particles using MRI toward delivery of therapeutics

Magnetic resonance navigation (MRN) offers the potential for real-time steering of drug particles and cells to targets throughout the body. In this technique, the magnetic gradients of an MRI scanner perform image-based steering of magnetically-labelled therapeutics through the vasculature and into tumours. A major challenge of current techniques for MRN is that they alternate between pulse sequences for particle imaging and propulsion. Since no propulsion occurs while imaging the particles, this results in a significant reduction in imaging frequency and propulsive force. We report a new approach in which an imaging sequence is designed to simultaneously image and propel particles. This sequence provides a tradeoff between maximum propulsive force and imaging frequency. In our reported example, the sequence can image at 27 Hz while still generating 95% of the force produced by a purely propulsive pulse sequence. We implemented our pulse sequence on a standard clinical scanner using millimetre-scale particles and demonstrated high-speed (74 mm/s) navigation of a multi-branched vascular network phantom. Our study suggests that the magnetic gradient magnitudes previously demonstrated to be sufficient for pure propulsion of micron-scale therapeutics in magnetic resonance targeting (MRT) could also be sufficient for real-time steering of these particles.

The Effect of Friction on the Forward Dynamics Problem

This article discusses the numerical solution of the forward dynamic equations of an n-degree-of-freedom manipulator with friction. Also discussed are the modeling and experimen tal identification of friction. It is shown that the inclusion of Coulomb-type friction in the dynamic equations introduces two difficulties in the forward dynamic solution. The differential equations are shown to be discontinuous in the highest-order derivative terms. In addition, the load dependency of this type of friction typically causes the equations to be implicit in the joint accelerations. For the important case of load-dependent transmission friction, the equations can be explicit. Techniques for the forward solution are described through the example of a roller screw transmission. Experimental and simulation results are used to show the importance of load-dependent friction in a particular robot.

Contact State Estimation Using Multiple Model Estimation and Hidden Markov Models

In this paper we present an approach to estimating the contact state between a robot and its environment during task execution. Contact states are modeled by constraint equations parametrized by timedependent sensor data and time-independent object properties. At each sampling time, multiple model estimation is used to assess the most likely contact state. The assessment is performed by a hidden Markov model, which combines a measure of how well each set of constraint equations fits the sensor data with the probability of specific contact state transitions. The latter is embodied in a task-based contact state network. The approach is illustrated for a three-dimensional peg-in-hole insertion using a tabletop manipulator robot. Using only position sensing, the contact state sequence is successfully estimated without knowledge of nominal property values. Property estimates are obtained for the peg dimensions as well as the hole position and orientation.

Biocompatible Pressure Sensing Skins for Minimally Invasive Surgical Instruments

This paper presents 800-μm thick, biocompatible sensing skins composed of arrays of pressure sensors. The arrays can be configured to conform to the surface of medical instruments so as to act as disposable sensing skins. In particular, the fabrication of cylindrical geometries is considered here for use on endoscopes. The sensing technology is based on polydimethylsiloxane synthetic silicone encapsulated microchannels filled with a biocompatible salt-saturated glycerol solution, functioning as the conductive medium. A multi-layer manufacturing approach is introduced that enables stacking sensing microchannels, mechanical stress concentration features, and electrical routing via flexcircuits in a thickness of less than 1 mm. The proposed approach is inexpensive and does not require clean room tools or techniques. The mechanical stress concentration features are implemented using a patterned copper layer that serves to improve sensing range and sensitivity. Sensor performance is demonstrated experimentally using a sensing skin mounted on a neuroendoscope insertion cannula and is shown to outperform previously developed non-biocompatible sensors.

Cardioscopic Tool-delivery Instrument for Beating-heart Surgery

This paper describes an instrument that provides solutions to two open challenges in beating-heart intracardiac surgery - providing high-fidelity imaging of tool-tissue contact and controlling tool penetration into tissue over the cardiac cycle. Tool delivery is illustrated in the context of tissue removal for which these challenges equate to visualization of the tissue as it is being removed and to control of cutting depth. Cardioscopic imaging is provided by a camera and illumination system encased in an optical window. When the optical window is pressed against tissue, it displaces the blood between the camera and tissue allowing clear visualization. Control of cutting depth is achieved via precise extension of the cutting tool from a port in the optical window. Successful tool use is demonstrated in ex vivo and in vivo experiments.

Elastic Stability of Concentric Tube Robots Subject to External Loads

Concentric tube robots, which are comprised of precurved elastic tubes that are concentrically arranged, are being developed for many medical interventions. The shape of the robot is determined by the rotation and translation of the tubes relative to each other, and also by any external forces applied by the environment. As the tubes rotate and translate relative to each other, elastic potential energy caused by tube bending and twisting can accumulate; if a configuration is not locally elastically stable, then a dangerous snapping motion may occur as energy is suddenly released. External loads on the robot also influence elastic stability. In this paper, we provide a second-order sufficient condition, and also a separate necessary condition, for elastic stability. Using methods of optimal control theory, we show that these conditions apply to general concentric tube robot designs subject to arbitrary conservative external loads. They can be used to assess the stability of candidate robot configurations. Our results are validated via comparison with other known stability criteria, and their utility is demonstrated by an application to stable path planning.

Real-time Adaptive Kinematic Model Estimation of Concentric Tube Robots

Kinematic models of concentric tube robots have matured from considering only tube bending to considering tube twisting as well as external loading. While these models have been demonstrated to approximate actual behavior, modeling error can be significant for medical applications that often call for positioning accuracy of 1-2mm. As an alternative to moving to more complex models, this paper proposes using sensing to adaptively update model parameters during robot operation. Advantages of this method are that the model is constantly tuning itself to provide high accuracy in the region of the workspace where it is currently operating. It also adapts automatically to changes in robot shape and compliance associated with the insertion and removal of tools through its lumen. As an initial exploration of this approach, a recursive on-line estimator is proposed and evaluated experimentally.

Concentric Tube Robot Design and Optimization Based on Task and Anatomical Constraints

Concentric tube robots are catheter-sized continuum robots that are well suited for minimally invasive surgery inside confined body cavities. These robots are constructed from sets of pre-curved superelastic tubes and are capable of assuming complex 3D curves. The family of 3D curves that the robot can assume depends on the number, curvatures, lengths and stiffnesses of the tubes in its tube set. The robot design problem involves solving for a tube set that will produce the family of curves necessary to perform a surgical procedure. At a minimum, these curves must enable the robot to smoothly extend into the body and to manipulate tools over the desired surgical workspace while respecting anatomical constraints. This paper introduces an optimization framework that utilizes procedureor patient-specific image-based anatomical models along with surgical workspace requirements to generate robot tube set designs. The algorithm searches for designs that minimize robot length and curvature and for which all paths required for the procedure consist of stable robot configurations. Two mechanics-based kinematic models are used. Initial designs are sought using a model assuming torsional rigidity. These designs are then refined using a torsionally-compliant model. The approach is illustrated with clinically relevant examples from neurosurgery and intracardiac surgery.

Novel pressure-sensing skin for detecting impending tissue damage during neuroendoscopy

OBJECT

Endoscopy plays an increasingly important role in minimally invasive neurosurgery. Visual feedback from the endoscope tip helps the surgeon prevent unwanted tissue contact. However, critical feedback regarding tissue deformation and trauma from proximal endoscope components is currently unavailable. A system for force feedback along the endoscope length could provide significant clinical benefit by warning of impending damage. The authors manufactured and tested a novel pressure-sensing polymer skin for use in pressure feedback during intracranial endoscopy.

METHODS

A photolithography process on a silicon wafer was used to produce a pattern of 80-μm-tall extrusions to serve as a positive mold for the sensor array. A thin layer of polydimethylsiloxane polymer was molded onto these features. Demolding the polymer from the wafer and sealing with another polymer layer resulted in microchannels. These microchannels were filled with a conductive liquid metal and connected to recording hardware. Spiral channel patterns were designed to create a 3 × 3 array of pressure-sensor pads, which were wrapped around a standard neuroendoscope operating sheath. Pressure readings from the compressed sensor array were translated into a color-coded graphic user interface. Calibration experiments were conducted, and the sensor was evaluated through cortical compression tests on explanted ovine brain.

RESULTS

The sensing endoscope operating sheath was successfully calibrated to detect and display pressures within a range consistent with normal and tissue-threatening compressions.

CONCLUSIONS

Force-feedback mechanisms for the neuroendoscopist are critically lacking with contemporary endoscopes. The authors designed a pressure-sensing skin technology for improved pressure feedback during endoscopy as a means for minimizing collateral tissue damage during endoscopy.

An MRI-powered and controlled actuator technology for tetherless robotic interventions

This paper presents a novel actuation technology for robotically assisted MRI-guided interventional procedures. In the proposed approach, the MRI scanner is used to deliver power, estimate actuator state and perform closed-loop control. The actuators themselves are compact, inexpensive and wireless. Using needle driving as an example application, actuation principles and force production capabilities are examined. Actuator stability and performance are analyzed for the two cases of state estimation at the input versus the output of the actuator transmission. Closed-loop needle position control is achieved by interleaving imaging pulse sequences to estimate needle position (transmission output estimation) and propulsion pulse sequences to drive the actuator. A prototype needle driving robot is used to validate the proposed approach in a clinical MRI scanner.

Percutaneous steerable robotic tool delivery platform and metal microelectromechanical systems device for tissue manipulation and approximation: closure of patent foramen ovale in an animal model

BACKGROUND

Beating-heart image-guided intracardiac interventions have been evolving rapidly. To extend the domain of catheter-based and transcardiac interventions into reconstructive surgery, a new robotic tool delivery platform and a tissue approximation device have been developed. Initial results using these tools to perform patent foramen ovale closure are described.

METHODS AND RESULTS

A robotic tool delivery platform comprising superelastic metal tubes provides the capability of delivering and manipulating tools and devices inside the beating heart. A new device technology is also presented that uses a metal-based microelectromechanical systems-manufacturing process to produce fully assembled and fully functional millimeter-scale tools. As a demonstration of both technologies, patent foramen ovale creation and closure was performed in a swine model. In the first group of animals (n=10), a preliminary study was performed. The procedural technique was validated with a transcardiac hand-held delivery platform and epicardial echocardiography, video-assisted cardioscopy, and fluoroscopy. In the second group (n=9), the procedure was performed percutaneously using the robotic tool delivery platform under epicardial echocardiography and fluoroscopy imaging. All patent foramen ovales were completely closed in the first group. In the second group, the patent foramen ovale was not successfully created in 1 animal, and the defects were completely closed in 6 of the 8 remaining animals.

CONCLUSIONS

In contrast to existing robotic catheter technologies, the robotic tool delivery platform uses a combination of stiffness and active steerability along its length to provide the positioning accuracy and force-application capability necessary for tissue manipulation. In combination with a microelectromechanical systems tool technology, it can enable reconstructive procedures inside the beating heart.

Simultaneous Soft Sensing of Tissue Contact Angle and Force for Millimeter-scale Medical Robots

A novel robotic sensor is proposed to measure both the contact angle and the force acting between the tip of a surgical robot and soft tissue. The sensor is manufactured using a planar lithography process that generates microchannels that are subsequently filled with a conductive liquid. The planar geometry is then molded onto a hemispherical plastic scaffolding in a geometric configuration enabling estimation of the contact angle (angle between robot tip tangent and tissue surface normal) by the rotation of the sensor around its roll axis. Contact force can also be estimated by monitoring the changes in resistance in each microchannel. Bench top experimental results indicate that, on average, the sensor can estimate the angle of contact to within ±2° and the contact force to within ±5.3 g.

Tubular structure enhancement for surgical instrument detection in 3D ultrasound

Three-dimensional ultrasound has been an effective imaging modality for diagnostics and is now an emerging modality for image-guided minimally-invasive interventions since it enables visualization of both instruments and tissue. Challenges to ultrasound-guided interventions arise, however, due to the low signal-to-noise ratio and the imaging artifacts created by the interventional instruments. Metallic instruments, in particular, are strong scatters and so produce a variety of artifacts. For many interventions, the manual or robotic instrument is comprised of a long curved tubular structure with specialized tooling at its tip. Toward the goal of developing a surgical navigation system, this paper proposes an image processing algorithm for enhancing the tubular structure of imaged instruments while also reducing imaging artifacts. Experiments are presented to evaluate the effectiveness of the approach in the context of robotic instruments whose shape comprises a smooth curve along their length.

Percutaneous intracardiac beating-heart surgery using metal MEMS tissue approximation tools

Achieving superior outcomes through the use of robots in medical applications requires an integrated approach to the design of the robot, tooling and the procedure itself. In this paper, this approach is applied to develop a robotic technique for closing abnormal communication between the atria of the heart. The goal is to achieve the efficacy of surgical closure as performed on a stopped, open heart with the reduced risk and trauma of a beating-heart catheter-based procedure. In the proposed approach, a concentric tube robot is used to percutaneously access the right atrium and deploy a tissue approximation device. The device is constructed using a metal microelectromechanical system (MEMS) fabrication process and is designed to both fit the manipulation capabilities of the robot as well as to reproduce the beneficial features of surgical closure by suture. The effectiveness of the approach is demonstrated through ex vivo and in vivo experiments.

Robotics and imaging in congenital heart surgery

The initial success seen in adult cardiac surgery with the application of available robotic systems has not been realized as broadly in pediatric cardiac surgery. The main obstacles include extended set-up time and complexity of the procedures, as well as the large size of the instruments with respect to the size of the child. Moreover, while the main advantage of robotic systems is the ability to minimize incision size, for intracardiac repairs, cardiopulmonary bypass is still required. Catheter-based interventions, on the other hand, have expanded rapidly in both application as well as the complexity of procedures and lesions being treated. However, despite the development of sophisticated devices, robotic systems to aid catheter procedures have not been commonly applied in children. In this article, we describe new catheter-like robotic delivery platforms, which facilitate safe navigation and enable complex repairs, such as tissue approximation and fixation, and tissue removal, inside the beating heart. Additional features including the tracking of rapidly moving tissue targets and novel imaging approaches are described, along with a discussion of future prospects for steerable robotic systems.