A multifunctional soft robot for cardiac interventions

In minimally invasive endovascular procedures, surgeons rely on catheters with low dexterity and high aspect ratios to reach an anatomical target. However, the environment inside the beating heart presents a combination of challenges unique to few anatomic locations, making it difficult for interventional tools to maneuver dexterously and apply substantial forces on an intracardiac target. We demonstrate a millimeter-scale soft robotic platform that can deploy and self-stabilize at the entrance to the heart, and guide existing interventional tools toward a target site. In two exemplar intracardiac procedures within the right atrium, the robotic platform provides enough dexterity to reach multiple anatomical targets, enough stability to maintain constant contact on motile targets, and enough mechanical leverage to generate newton-level forces. Because the device addresses ongoing challenges in minimally invasive intracardiac intervention, it may enable the further development of catheter-based interventions.

Continuum Robots for Medical Interventions

Continuum robots are not constructed with discrete joints but, instead, change shape and position their tip by flexing along their entire length. Their narrow curvilinear shape makes them well suited to passing through body lumens, natural orifices, or small surgical incisions to perform minimally invasive procedures. Modeling and controlling these robots are, however, substantially more complex than traditional robots comprised of rigid links connected by discrete joints. Furthermore, there are many approaches to achieving robot flexure. Each presents its own design and modeling challenges, and to date, each has been pursued largely independently of the others. This article attempts to provide a unified summary of the state of the art of continuum robot architectures with respect to design for specific clinical applications. It also describes a unifying framework for modeling and controlling these systems while additionally explaining the elements unique to each architecture. The major research accomplishments are described for each topic and directions for the future progress needed to achieve widespread clinical use are identified.

Combining Differential Kinematics and Optical Flow for Automatic Labeling of Continuum Robots in Minimally Invasive Surgery

The segmentation of continuum robots in medical images can be of interest for analyzing surgical procedures or for controlling them. However, the automatic segmentation of continuous and flexible shapes is not an easy task. On one hand conventional approaches are not adapted to the specificities of these instruments, such as imprecise kinematic models, and on the other hand techniques based on deep-learning showed interesting capabilities but need many manually labeled images. In this article we propose a novel approach for segmenting continuum robots on endoscopic images, which requires no prior on the instrument visual appearance and no manual annotation of images. The method relies on the use of the combination of kinematic models and differential kinematic models of the robot and the analysis of optical flow in the images. A cost function aggregating information from the acquired image, from optical flow and from robot encoders is optimized using particle swarm optimization and provides estimated parameters of the pose of the continuum instrument and a mask defining the instrument in the image. In addition a temporal consistency is assessed in order to improve stochastic optimization and reject outliers. The proposed approach has been tested for the robotic instruments of a flexible endoscopy platform both for benchtop acquisitions and an in vivo video. The results show the ability of the technique to correctly segment the instruments without a prior, and in challenging conditions. The obtained segmentation can be used for several applications, for instance for providing automatic labels for machine learning techniques.

Modeling Tube Clearance and Bounding the Effect of Friction in Concentric Tube Robot Kinematics

The shape of a concentric tube robot depends not only on the relative rotations and translations of its constituent tubes, but also on the history of relative tube displacements. Existing mechanics-based models neglect all history-dependent phenomena with the result that when calibrated on experimental data collected over a robot's workspace, the maximum tip position error can exceed 8 mm for a 200-mm-long robot. In this paper, we develop a model that computes the bounding kinematic solutions in which Coulomb friction is acting either to maximize or minimize the relative twisting between each pair of contacting tubes. The path histories associated with these limiting cases correspond to first performing all tube translations and then performing relative tube rotations of sufficient angle so that the maximum Coulomb friction force is obtained along the interface of each contacting tube pair. The robot tip configurations produced by these path histories are shown experimentally to bound position error with respect to the estimated frictionless model compared to path histories comprised of translation or mixed translation and rotation. Intertube friction forces and torques are computed as proportional to the intertube contact forces. To compute these contact forces, the standard zero-clearance assumption that constrains the concentrically combined tubes to possess the same centerline is relaxed. The effects of clearance and friction are explored through numerical and physical experiments and it is shown that friction can explain much of the prediction error observed in existing models. This model is not intended for real-time control, but rather for path planning-to provide error bounds and to inform how the ordering of tube rotations and translations can be used to reduce the effect of friction.

Designing Stable Concentric Tube Robots Using Piecewise Straight Tubes

Concentric tube robots experience elastic instability when the potential energy stored in torsional twisting of the tubes is suddenly released. To date, ensuring stability for all possible rotational configurations has involved constraining the precurvatures and/or precurved lengths of the tubes comprising the robot, which results in limitations on robot curvature and workspace. This paper presents a design approach that eliminates the constraints on tube precurvature and length for stable rotation. The idea is to compose designs in which, at every point along the length of a robot, a single tube is precurved and the others are straight. The resulting designs do not experience any precurvature-induced torsional tube twisting and so are stable regardless of precurvature and length. This design concept can be usefully employed at the tip of a robot to provide a large stable range of tip orientation angles. A stability analysis is provided for designs composed of an arbitrary number of tubes and design rules are provided for tube pairs that can produce tip angles varying from zero to a desired maximum value. The method is validated experimentally for a tube pair comprised of three sections.

Optimizing Tube Precurvature to Enhance Elastic Stability of Concentric Tube Robots

Robotic instruments based on concentric tube technology are well suited to minimally invasive surgery since they are slender, can navigate inside small cavities and can reach around sensitive tissues by taking on shapes of varying curvature. Elastic instabilities can arise, however, when rotating one precurved tube inside another. In contrast to prior work that considered only tubes of piecewise constant precurvature, we allow precurvature to vary along the tube's arc length. Stability conditions for a planar tube pair are derived and used to formulate an optimal design problem. An analytic formulation of the optimal precurvature function is derived that achieves a desired tip orientation range while maximizing stability and respecting bending strain limits. This formulation also includes straight transmission segments at the proximal ends of the tubes. The result, confirmed by both numerical and physical experiment, enables designs with enhanced stability in comparison to designs of constant precurvature.

Cardioscopic Tool-delivery Instrument for Beating-heart Surgery

This paper describes an instrument that provides solutions to two open challenges in beating-heart intracardiac surgery - providing high-fidelity imaging of tool-tissue contact and controlling tool penetration into tissue over the cardiac cycle. Tool delivery is illustrated in the context of tissue removal for which these challenges equate to visualization of the tissue as it is being removed and to control of cutting depth. Cardioscopic imaging is provided by a camera and illumination system encased in an optical window. When the optical window is pressed against tissue, it displaces the blood between the camera and tissue allowing clear visualization. Control of cutting depth is achieved via precise extension of the cutting tool from a port in the optical window. Successful tool use is demonstrated in ex vivo and in vivo experiments.

Elastic Stability of Concentric Tube Robots: A Stability Measure and Design Test

Concentric tube robots are needle-sized manipulators which have been investigated for use in minimally invasive surgeries. It was noted early in the development of these devices that elastic energy storage can lead to rapid snapping motion for designs with moderate to high tube curvatures. Substantial progress has recently been made in the concentric tube robot community in designing snap-free robots, planning stable paths, and characterizing conditions that result in snapping for specific classes of concentric tube robots. However, a general measure for how stable a given robot configuration is has yet to be proposed. In this paper, we use bifurcation and elastic stability theory to provide such a measure, as well as to produce a test for determining whether a given design is snap-free (i.e. whether snapping can occur anywhere in the unloaded robot's workspace). These results are useful in designing, planning motions for, and controlling concentric tube robots with high curvatures.

Elastic Stability of Concentric Tube Robots Subject to External Loads

Concentric tube robots, which are comprised of precurved elastic tubes that are concentrically arranged, are being developed for many medical interventions. The shape of the robot is determined by the rotation and translation of the tubes relative to each other, and also by any external forces applied by the environment. As the tubes rotate and translate relative to each other, elastic potential energy caused by tube bending and twisting can accumulate; if a configuration is not locally elastically stable, then a dangerous snapping motion may occur as energy is suddenly released. External loads on the robot also influence elastic stability. In this paper, we provide a second-order sufficient condition, and also a separate necessary condition, for elastic stability. Using methods of optimal control theory, we show that these conditions apply to general concentric tube robot designs subject to arbitrary conservative external loads. They can be used to assess the stability of candidate robot configurations. Our results are validated via comparison with other known stability criteria, and their utility is demonstrated by an application to stable path planning.

Real-time Adaptive Kinematic Model Estimation of Concentric Tube Robots

Kinematic models of concentric tube robots have matured from considering only tube bending to considering tube twisting as well as external loading. While these models have been demonstrated to approximate actual behavior, modeling error can be significant for medical applications that often call for positioning accuracy of 1-2mm. As an alternative to moving to more complex models, this paper proposes using sensing to adaptively update model parameters during robot operation. Advantages of this method are that the model is constantly tuning itself to provide high accuracy in the region of the workspace where it is currently operating. It also adapts automatically to changes in robot shape and compliance associated with the insertion and removal of tools through its lumen. As an initial exploration of this approach, a recursive on-line estimator is proposed and evaluated experimentally.