A Concentric Tube Robot System for Rigid Bronchoscopy: A Feasibility Study on Central Airway Obstruction Removal

Neural Network-Based Shape Analysis and Control of Continuum Objects

Soft robots are gaining increasing attention in current robotics research due to their continuum structure. However, accurately recognizing and reproducing the shape of such continuum robots remains a challenge. In this paper, we propose a novel approach that combines contour extraction with camera reconstruction to obtain shape features. Neural networks are employed to model the relationship between motor inputs and the resulting shape output. A simulation environment is established to verify the shape estimation and shape control of the flexible continuum. The outcomes demonstrate that this approach effectively predicts and reproduces the shape of flexible continuum robots, providing a promising solution for continuum shape control.

Closed-Loop Control of a Tendon-Driven Active Needle for Tip Tracking at Desired Bending Angle for High-Dose-Rate Prostate Brachytherapy

Prostate cancer is the second most common malignancy in American men. High-dose-rate brachytherapy is a popular treatment technique in which a large, localized radiation dose is used to kill cancer. Utilization of curvilinear catheter implantation inside the prostate gland to provide access channels to host the radiation source has shown superiority in terms of improved dosimetric constraints compared to straight needles. To this aim, we have introduced an active needle to curve inside the prostate conformal to the patient's specific anatomical relationship for improved dose distribution to the prostate and reduced toxicity to the organs at risk (OARs). This work presents closed-loop control of our tendon-driven active needle in water medium and air using the position feedback of the tip obtained in real time from an ultrasound (US) or an electromagnetic (EM) tracking sensor, respectively. The active needle consists of a compliant flexure section to realize bending in two directions via actuation of two internal tendons. Tracking errors using US and EM tracker are estimated and compared. Results show that the bending angle of the active needle could be controlled using position feedback of the US or the EM tracking system with a bending angle error of less than 1.00 degree, when delay is disregarded. It is concluded that the actuation system and controller, presented in this work, are able to realize a desired bending angle at the active needle tip with reasonable accuracy paving the path for tip tracking and manipulation control evaluations in a prostate brachytherapy.

A Model to Predict Deflection of an Active Tendon-Driven Notched Needle Inside Soft Tissue

The last decade has witnessed major progress in the field of minimally invasive and robotic-assisted surgeries. Needle insertion, a minimally invasive technique, has proven its efficacy in procedures such as brachytherapy, ablation, drug delivery, and biopsy. Manual needle steering inside tissue is a challenging task due to complex needle-tissue interactions, needle and tissue movement, lack of actuation and control, as well as poor sensing and visualization. Recently, active tendon-driven notched needles, and robotic manipulation systems have been proposed to assist surgeons to guide the needles in desired trajectories toward target positions. This work introduces a new deflection model for the active tendon-driven notched needle steering inside soft tissue for intention to use in model-based robotic control. The model is developed to predict needle deflection in a single-layer tissue. To validate the proposed deflection model, five sets of needle insertion experiments with a bevel-tipped active needle into single-layer phantom tissues were performed. A real-time robot-assisted ultrasound tracking method was used to track the needle tip during needle insertion. It was shown that the model predicts needle deflection with an average error of 0.58 ± 0.14 mm for the bevel-tipped active needle insertion into a single-layer phantom tissue.

Coupling Analysis of Compound Continuum Robots for Surgery: Another Line of Thought

The compound continuum robot employs both concentric tube components and cable-driven continuum components to achieve its complex motions. Nevertheless, the interaction between these components causes coupling, which inevitably leads to reduced accuracy. Consequently, researchers have been striving to mitigate and compensate for this coupling-induced error in order to enhance the overall performance of the robot. This paper leverages the coupling between the components of the compound continuum robot to accomplish specific surgical procedures. Specifically, the internal concentric tube component is utilized to induce motion in the cable-driven external component, which generates coupled motion under the constraints of the cable. This approach enables the realization of high-precision surgical operations. Specifically, a kinematic model for the proposed robot is established, and an inverse kinematic algorithm is developed. In this inverse kinematic algorithm, the solution of a highly nonlinear system of equations is simplified into the solution of a single nonlinear equation. To demonstrate the effectiveness of the proposed approach, simulations are conducted to evaluate the efficiency of the algorithm. The simulations conducted in this study indicate that the proposed inverse kinematic (IK) algorithm improves computational speed by a significant margin. Specifically, it achieves a speedup of 2.8 × 10³ over the Levenberg-Marquardt (LM) method. In addition, experimental results demonstrate that the coupled-motion system achieves high levels of accuracy. Specifically, the repetitive positioning accuracy is measured to be 0.9 mm, and the tracking accuracy is 1.5 mm. This paper is significant for dealing with the coupling of the compound continuum robot.

Innovation in rigid bronchoscopy-past, present, and future

German laryngologist Gustav Killian performed the first "Direkte Bronchoskopie" using a rigid bronchoscope to extract a foreign airway body from the right main bronchus over a hundred years ago, transforming the practice of respiratory medicine. The procedure instantaneously became popular throughout the world. Chevalier Jackson Sr from the United States further advanced the instrument, technique, safety, and application. In the 1960s, Professors Harold H. Hopkins and N.S. Kapany introduced optical rods as well as fiberoptics that led Karl Storz to develop the cold light system improving endoluminal illumination, achievements that ushered in the modern era of flexible endoscopy. Several diagnostic and therapeutic procedures became possible such as transbronchial needle biopsy, transbronchial lung biopsy, airway electrosurgery, or cryotherapy. Dr. Jean-François Dumon from France advanced the use of Nd-YAG laser in the endobronchial tree and created the dedicated Dumon silicone stent introducing the whole new field of interventional pulmonology (IP). This major milestone revitalized interest in rigid bronchoscopy (RB). Now, advancements are being made in stenting, instrumentation, and education. RB robotic technology advancements are currently anticipated and can potentially revolutionize the practice of pulmonary medicine. In this review, we describe some of the most substantial advances related to RB from its beginning to the modern era.

A Millimeter-Scale Soft Robot for Tissue Biopsy Procedures

While interest in soft robotics as surgical tools has grown due to their inherently safe interactions with the body, their feasibility is limited in the amount of force that can be transmitted during procedures. This is especially apparent in minimally invasive procedures where millimeter-scale devices are necessary for reaching the desired surgical site, such as in interventional bronchoscopy. To leverage the benefits of soft robotics in minimally invasive surgery, a soft robot with integrated tip steering, stabilization, and needle deployment capabilities is proposed for lung tissue biopsy procedures. Design, fabrication, and modeling of the force transmission of this soft robotic platform allows for integration into a system with a diameter of 3.5 mm. Characterizations of the soft robot are performed to analyze bending angle, force transmission, and expansion during needle deployment. In-vitro experiments of both the needle deployment mechanism and fully integrated soft robot validate the proposed workflow and capabilities in a simulated surgical setting.

Flexible Needle Steering with Tethered and Untethered Actuation: Current States, Targeting Errors, Challenges and Opportunities

Accurate needle targeting is critical for many clinical procedures, such as transcutaneous biopsy or radiofrequency ablation of tumors. However, targeting errors may arise, limiting the widespread adoption of these procedures. Advances in flexible needle (FN) steering are emerging to mitigate these errors. This review summarizes the state-of-the-art developments of FNs and addresses possible targeting errors that can be overcome with steering actuation techniques. FN steering techniques can be classified as passive and active. Passive steering directly results from the needle-tissue interaction forces, whereas active steering requires additional forces to be applied at the needle tip, which enhances needle steerability. Therefore, the corresponding targeting errors of most passive FNs and active FNs are between 1 and 2 mm, and less than 1 mm, respectively. However, the diameters of active FNs range from 1.42 to 12 mm, which is larger than the passive steering needle varying from 0.5 to 1.4 mm. Therefore, the development of active FNs is an area of active research. These active FNs can be steered using tethered internal direct actuation or untethered external actuation. Examples of tethered internal direct actuation include tendon-driven, longitudinal segment transmission and concentric tube transmission. Tendon-driven FNs have various structures, and longitudinal segment transmission needles could be adapted to reduce tissue damage. Additionally, concentric tube needles have immediate advantages and clinical applications in natural orifice surgery. Magnetic actuation enables active FN steering with untethered external actuation and facilitates miniaturization. The challenges faced in the fabrication, sensing, and actuation methods of FN are analyzed. Finally, bio-inspired FNs may offer solutions to address the challenges faced in FN active steering mechanisms.

Compliant and Flexible Robotic System with Parallel Continuum Mechanism for Transoral Surgery: A Pilot Cadaveric Study

As one of the minimally invasive surgeries (MIS), transoral robotic surgery (TORS) contributes to excellent oncological and functional outcomes. This paper introduces a compliant and flexible robotic system for transoral surgery, consisting of an execution part with flexible parallel mechanisms and a positioning part with a continuum structure. A pilot cadaveric study that mimics the procedure of the TORS using an intact cadaveric human head was conducted to evaluate the feasibility and efficiency of this robotic system. Both the initial setup time and the time cost by the robot to safely access the deep surgical area in the upper aerodigestive tract are shortened due to the enlarged workspace, compact structure, and increased flexibility. The proposed surgical robotic system is preliminarily demonstrated to be feasible for TORS, especially for the in-depth surgical sites in the upper aerodigestive tract.

Modular robotic platform for precision neurosurgery with a bio-inspired needle: System overview and first in-vivo deployment

Over the past 10 years, minimally invasive surgery (MIS) has shown significant benefits compared to conventional surgical techniques, with reduced trauma, shorter hospital stays, and shorter patient recovery times. In neurosurgical MIS procedures, inserting a straight tool (e.g. catheter) is common practice in applications ranging from biopsy and laser ablation, to drug delivery and fluid evacuation. How to handle tissue deformation, target migration and access to deep-seated anatomical structures remain an open challenge, affecting both the preoperative planning phase and eventual surgical intervention. Here, we present the first neurosurgical platform in the literature, able to deliver an implantable steerable needle for a range of diagnostic and therapeutic applications, with a short-term focus on localised drug delivery. This work presents the system's architecture and first in vivo deployment with an optimised surgical workflow designed for pre-clinical trials with the ovine model, which demonstrate appropriate function and safe implantation.

Shape Reconstruction Processes for Interventional Application Devices: State of the Art, Progress, and Future Directions

Soft and continuum robots are transforming medical interventions thanks to their flexibility, miniaturization, and multidirectional movement abilities. Although flexibility enables reaching targets in unstructured and dynamic environments, it also creates challenges for control, especially due to interactions with the anatomy. Thus, in recent years lots of efforts have been devoted for the development of shape reconstruction methods, with the advancement of different kinematic models, sensors, and imaging techniques. These methods can increase the performance of the control action as well as provide the tip position of robotic manipulators relative to the anatomy. Each method, however, has its advantages and disadvantages and can be worthwhile in different situations. For example, electromagnetic (EM) and Fiber Bragg Grating (FBG) sensor-based shape reconstruction methods can be used in small-scale robots due to their advantages thanks to miniaturization, fast response, and high sensitivity. Yet, the problem of electromagnetic interference in the case of EM sensors, and poor response to high strains in the case of FBG sensors need to be considered. To help the reader make a suitable choice, this paper presents a review of recent progress on shape reconstruction methods, based on a systematic literature search, excluding pure kinematic models. Methods are classified into two categories. First, sensor-based techniques are presented that discuss the use of various sensors such as FBG, EM, and passive stretchable sensors for reconstructing the shape of the robots. Second, imaging-based methods are discussed that utilize images from different imaging systems such as fluoroscopy, endoscopy cameras, and ultrasound for the shape reconstruction process. The applicability, benefits, and limitations of each method are discussed. Finally, the paper draws some future promising directions for the enhancement of the shape reconstruction methods by discussing open questions and alternative methods.

A Soft Robot for Peripheral Lung Cancer Diagnosis and Therapy

Lung cancer is one of the deadliest forms of cancers and is often diagnosed by performing biopsies with the use of a bronchoscope. However, this diagnostic procedure is limited in ability to explore deep into the periphery of the lung where cancer can remain undetected. In this study, we present design, modeling, fabrication, and testing of a one degree of freedom soft robot with integrated diagnostic and interventional capabilities as well as vision sensing. The robot can be deployed through the working channel of commercial bronchoscopes or used as a stand-alone system as it integrates a micro camera to provide vision sensing and controls to the periphery of the lung. The small diameter (2.4 mm) of the device allows navigation in branches deeper in the lung, where current devices have limited reachability. We have performed mechanical characterizations of the robotic platform, including blocked force, maximum bending angle, maximum angular velocity, and workspace, and assessed its performance in in vitro and ex vivo experiments. We have developed a computer vision algorithm, and validated it in in vitro conditions, to autonomously align the robot to a selected branch of the lung and aid the clinician (by means of a graphical user interface) during navigation tasks and to perform robot-assisted stabilization in front of a lesion, with automated tracking and alignment.

Tip estimation approach for concentric tube robots using 2D ultrasound images and kinematic model

Concentric tube robot (CTR) is an efficient approach for minimally invasive surgery (MIS) and diagnosis due to its small size and high dexterity. To manipulate the robot accurately and safely inside the human body, tip position and shape information need to be well measured. In this paper, we propose a tip estimation method based on 2D ultrasound images with the help of the forward kinematic model of CTR. The forward kinematic model can help to provide a fast ultrasound scanning path and narrow the region of interest in ultrasound images. For each tube, only three scan positions are needed by combining the kinematic model prediction as prior knowledge. After that, the curve fitting method is used for its shape reconstruction, while its tip position can be estimated based on the constraints of its structure and length.7 This method provides the advantage that only three scan positions are needed for estimating the tip of each telescoping section. Moreover, no structure modification is needed on the robot, which makes it an appropriate approach for existing flexible surgical robots. Experimental results verified the feasibility of the proposed method and the tip estimation error is 0.59 mm. Graphical abstract In this paper, we propose a tip estimation method based on 2D Ultrasound images with the help of the forward kinematic model of CTR. The forward kinematic model can help to provide a fast Ultrasound scanning path and narrow the region of interest in Ultrasound images. For each tube, only three scan positions are needed by combining the kinematic model prediction as prior knowledge. After that, the curve fitting method is used for its shape reconstruction, while its tip position can be estimated based on the constraints of its structure and length.

Beyond Constant Curvature: A New Mechanics Model for Unidirectional Notched-Tube Continuum Wrists

This paper presents a new mechanics model for unidirectional notched-tube continuum wrists, a class of mechanisms frequently used to implement distal steering in needle-sized surgical robotic instruments. Existing kinematic models available for these devices are based on the simplifying assumption that, during actuation, all the notches undergo the same amount of deflection, so that the shape of a wrist can be approximated by an arc of constant curvature. This approach is analytically attractive, but, as we show in this paper, it can sometimes fail to provide good tracking accuracy. In this article, we provide a new model that relaxes the assumption above, and we report experimental evidence showing its superior accuracy. We model wrist deflection using Castigliano's second theorem, with the addition of a capstan friction term that accounts for frictional losses on the actuation tendon. Because notched-tube wrists are typically made of Nickel-Titanium (Nitinol), which has nonlinear stress-strain characteristics, we use a technique to obtain a local linearized approximation of the material modulus, suitable for use in the deflection model. The result of our modeling is a system of nonlinear equations that can be solved numerically to predict the wrist configuration based on the applied actuation force. Experimental results on physical specimens show that this improved model provides a more accurate estimate of wrist kinematics than prior models assuming constant curvature bending.

Transurethral Anastomosis after Transurethral Radical Prostatectomy: A Phantom Study on Intraluminal Suturing With Concentric Tube Robots

Current surgical approaches to radical prostatectomy are associated with high rates of erectile dysfunction and incontinence. These complications occur secondary to the disruption of surrounding healthy tissue, which is required to expose the prostate. The urethra offers the least invasive access to the prostate, and feasibility has been demonstrated of enucleating the prostate with an endoscope using Holmium laser, which can itself be aimed by concentric tube robots. However, the transurethral approach to radical prostatectomy has thus far been limited by the lack of a suitable means to perform an anastomosis of the urethra to the bladder after prostate removal. Only a few intraluminal anastomotic devices currently exist, and none are small enough to pass through the urethra. In this paper we describe a new way to perform an anastomosis in the small luminal space of the urethra, harnessing the dexterity and customizability of concentric tube manipulators. We demonstrate a successful initial proof-of-concept anastomosis in an anthropomorphic phantom of the urethra and bladder.