1
|
Rogatinsky J, Recco D, Feichtmeier J, Kang Y, Kneier N, Hammer P, O’Leary E, Mah D, Hoganson D, Vasilyev NV, Ranzani T. A multifunctional soft robot for cardiac interventions. SCIENCE ADVANCES 2023; 9:eadi5559. [PMID: 37878705 PMCID: PMC10599628 DOI: 10.1126/sciadv.adi5559] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 09/26/2023] [Indexed: 10/27/2023]
Abstract
In minimally invasive endovascular procedures, surgeons rely on catheters with low dexterity and high aspect ratios to reach an anatomical target. However, the environment inside the beating heart presents a combination of challenges unique to few anatomic locations, making it difficult for interventional tools to maneuver dexterously and apply substantial forces on an intracardiac target. We demonstrate a millimeter-scale soft robotic platform that can deploy and self-stabilize at the entrance to the heart, and guide existing interventional tools toward a target site. In two exemplar intracardiac procedures within the right atrium, the robotic platform provides enough dexterity to reach multiple anatomical targets, enough stability to maintain constant contact on motile targets, and enough mechanical leverage to generate newton-level forces. Because the device addresses ongoing challenges in minimally invasive intracardiac intervention, it may enable the further development of catheter-based interventions.
Collapse
Affiliation(s)
- Jacob Rogatinsky
- Department of Mechanical Engineering, Boston University, Boston, MA 02215, USA
| | - Dominic Recco
- Department of Cardiac Surgery, Boston Children’s Hospital, Boston, MA 02115, USA
| | | | - Yuchen Kang
- Department of Mechanical Engineering, Boston University, Boston, MA 02215, USA
| | - Nicholas Kneier
- Department of Cardiac Surgery, Boston Children’s Hospital, Boston, MA 02115, USA
| | - Peter Hammer
- Department of Cardiac Surgery, Boston Children’s Hospital, Boston, MA 02115, USA
| | - Edward O’Leary
- Department of Cardiology, Boston Children’s Hospital, Boston, MA 02115, USA
| | - Douglas Mah
- Department of Cardiology, Boston Children’s Hospital, Boston, MA 02115, USA
| | - David Hoganson
- Department of Cardiac Surgery, Boston Children’s Hospital, Boston, MA 02115, USA
| | - Nikolay V. Vasilyev
- Department of Cardiac Surgery, Boston Children’s Hospital, Boston, MA 02115, USA
| | - Tommaso Ranzani
- Department of Mechanical Engineering, Boston University, Boston, MA 02215, USA
| |
Collapse
|
2
|
Liang K, Tang Y, Jiang X, Wang S, Li J, Wang Y, Pan M. Time-varying modeling and intelligent compensation control of singletendon-sheath structure of surgical robot. Proc Inst Mech Eng H 2023; 237:451-466. [PMID: 36882972 DOI: 10.1177/09544119231158237] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/09/2023]
Abstract
The inaccurate force and position control of tendon sheath system (TSS) due to nonlinear friction during surgery seriously hinders its development in the field of precision surgical robots. To this end, this paper proposes a time-varying bending angle estimation method under the state of sensorless offline identification combined with robot kinematics by analyzing the friction of the TSS and the deformation of the robot during the movement, and establishes a force and position transfer model with time-varying path trajectory (SJM model). The model uses B-spline curve to fit tendon-sheath trajectory. In order to further improve the control accuracy of force and position, a new intelligent feedforward control strategy that integrates the SJM model and a neural network algorithm is proposed. In order to gain an in-depth understanding of the transmission process of force and position and to demonstrate the validity of the SJM model, an experimental platform for the TSS was built. A feedforward control system under the MATLAB environment was built with the aim of verifying the accuracy of the intelligent feedforward control strategy. The system innovatively combines the SJM model with BP and RBF neural networks, respectively. The experimental results showed that the correlation coefficients (R2) of force and position transfer are above 99.10% and 99.48%, respectively. Ultimately, we compared the intelligent feedforward and intelligent control strategy under a single neural network, and observed that the intelligent feedforward control strategy has a better effect.
Collapse
Affiliation(s)
- Ke Liang
- School of Mechanical Engineering, Guangxi University, Nanning, China
| | - Yu Tang
- School of Mechanical Engineering, Guangxi University, Nanning, China
| | - Xianbao Jiang
- School of Mechanical Engineering, Guangxi University, Nanning, China
| | - Shuo Wang
- School of Mechanical Engineering, Guangxi University, Nanning, China
| | - Jing Li
- School of Mechanical Engineering, Guangxi University, Nanning, China
| | - Yupeng Wang
- School of Mechanical Engineering, Guangxi University, Nanning, China
| | - Mingzhang Pan
- School of Mechanical Engineering, Guangxi University, Nanning, China
| |
Collapse
|
3
|
Nazari AA, Zareinia K, Janabi-Sharifi F. Visual servoing of continuum robots: Methods, challenges, and prospects. Int J Med Robot 2022; 18:e2384. [PMID: 35199451 DOI: 10.1002/rcs.2384] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2021] [Revised: 02/16/2022] [Accepted: 02/19/2022] [Indexed: 01/05/2023]
Abstract
BACKGROUND Recent advancements in continuum robotics have accentuated developing efficient and stable controllers to handle shape deformation and compliance. The control of continuum robots (CRs) using physical sensors attached to the robot, particularly in confined spaces, is difficult due to their limited accuracy in three-dimensional deflections and challenging localisation. Therefore, using non-contact imaging sensors finds noticeable importance, particularly in medical scenarios. Accordingly, given the need for direct control of the robot tip and notable uncertainties in the kinematics and dynamics of CRs, many papers have focussed on the visual servoing (VS) of CRs in recent years. METHODS The significance of this research towards safe human-robot interaction has fuelled our survey on the previous methods, current challenges, and future opportunities. RESULTS Beginning with actuation modalities and modelling approaches, the paper investigates VS methods in medical and non-medical scenarios. CONCLUSIONS Finally, challenges and prospects of VS for CRs are discussed, followed by concluding remarks.
Collapse
Affiliation(s)
- Ali A Nazari
- Department of Mechanical and Industrial Engineering, Ryerson University, Toronto, Ontario, Canada
| | - Kourosh Zareinia
- Department of Mechanical and Industrial Engineering, Ryerson University, Toronto, Ontario, Canada
| | - Farrokh Janabi-Sharifi
- Department of Mechanical and Industrial Engineering, Ryerson University, Toronto, Ontario, Canada
| |
Collapse
|
4
|
Wang Z, Yang C, Ding Z, Yang T, Guo H, Jiang F, Tian B. Study on the Control Method of Knee Joint Human-Exoskeleton Interactive System. SENSORS 2022; 22:s22031040. [PMID: 35161792 PMCID: PMC8839318 DOI: 10.3390/s22031040] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/27/2021] [Revised: 01/25/2022] [Accepted: 01/27/2022] [Indexed: 02/04/2023]
Abstract
The advantages of exoskeletons based on the Bowden cable include being lightweight and flexible, thus being convenient in assisting humans. However, the performance of an exoskeleton is limited by the structure and human–exoskeleton interaction, which is analyzed from the established mathematical model of the human–exoskeleton system. In order to improve the auxiliary accuracy, corresponding control methods are proposed. The disturbance observer is designed to compensate for disturbances and parameter perturbations in the inner loop. The human–exoskeleton interaction feedforward model is integrated into the admittance control, which overcomes the limitation of the force loading caused by the friction of the Bowden cable and the change in stiffness of the human–exoskeleton interaction. Furthermore, an angle prediction method using the encoder as the signal source is designed to reduce the disturbance of the force loading caused by human motion. Finally, the effectiveness of the design method proposed in this paper is verified through experiments.
Collapse
Affiliation(s)
- Zhipeng Wang
- School of Mechatronics Engineering, Harbin Institute of Technology, Harbin 150001, China; (Z.W.); (C.Y.); (Z.D.); (T.Y.)
| | - Chifu Yang
- School of Mechatronics Engineering, Harbin Institute of Technology, Harbin 150001, China; (Z.W.); (C.Y.); (Z.D.); (T.Y.)
| | - Zhen Ding
- School of Mechatronics Engineering, Harbin Institute of Technology, Harbin 150001, China; (Z.W.); (C.Y.); (Z.D.); (T.Y.)
| | - Tao Yang
- School of Mechatronics Engineering, Harbin Institute of Technology, Harbin 150001, China; (Z.W.); (C.Y.); (Z.D.); (T.Y.)
| | - Hao Guo
- School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China;
| | - Feng Jiang
- School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China;
- Correspondence:
| | - Bowen Tian
- School of Business Administration, Zhongnan University of Economics and Law, Wuhan 430000, China;
| |
Collapse
|
5
|
Multilevel Operation Strategy of a Vascular Interventional Robot System for Surgical Safety in Teleoperation. IEEE T ROBOT 2022. [DOI: 10.1109/tro.2022.3140887] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
6
|
Hao R, Erdem Tuna E, Çavuşoğlu MC. Contact Stability and Contact Safety of a Magnetic Resonance Imaging-Guided Robotic Catheter Under Heart Surface Motion. JOURNAL OF DYNAMIC SYSTEMS, MEASUREMENT, AND CONTROL 2021; 143:071010. [PMID: 33994580 PMCID: PMC8086176 DOI: 10.1115/1.4049837] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/20/2020] [Revised: 12/28/2020] [Indexed: 06/12/2023]
Abstract
Contact force quality is one of the most critical factors for safe and effective lesion formation during catheter based atrial fibrillation ablation procedures. In this paper, the contact stability and contact safety of a novel magnetic resonance imaging (MRI)-actuated robotic cardiac ablation catheter subject to surface motion disturbances are studied. First, a quasi-static contact force optimization algorithm, which calculates the actuation needed to achieve a desired contact force at an instantaneous tissue surface configuration is introduced. This algorithm is then generalized using a least-squares formulation to optimize the contact stability and safety over a prediction horizon for a given estimated heart motion trajectory. Four contact force control schemes are proposed based on these algorithms. The first proposed force control scheme employs instantaneous heart position feedback. The second control scheme applies a constant actuation level using a quasi-periodic heart motion prediction. The third and the last contact force control schemes employ a generalized adaptive filter-based heart motion prediction, where the former uses the predicted instantaneous position feedback, and the latter is a receding horizon controller. The performance of the proposed control schemes is compared and evaluated in a simulation environment.
Collapse
Affiliation(s)
- Ran Hao
- Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, Cleveland, OH 44106
| | - E. Erdem Tuna
- Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, Cleveland, OH 44106
| | - M. Cenk Çavuşoğlu
- Department of Electrical, Computer, and Systems Engineering, Case Western Reserve University, Cleveland, OH 44106
| |
Collapse
|
7
|
Active Loading Control Design for a Wearable Exoskeleton with a Bowden Cable for Transmission. ACTUATORS 2021. [DOI: 10.3390/act10060108] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Exoskeletons with a Bowden cable for power transmission have the advantages of a concentrated mass and flexible movement. However, their integrated motor is disturbed by the Bowden cable’s friction, which limits the performance of the force loading response. In this paper, we solve this problem by designing an outer-loop feedforward-feedback proportion-differentiation controller based on an inner loop disturbance observer. Firstly, the inner loop’s dynamic performance is equivalent to the designed nominal model using the proposed disturbance observer, which effectively compensates for the parameter perturbation and friction disturbance. Secondly, based on an analysis of the stability of the inner loop controller, we obtain the stability condition and discuss the influence of modeling errors on the inner loop’s dynamic performance. Thirdly, to avoid excessive noise from the force sensors being introduced into the designed disturbance observer, we propose the feedforward-feedback proportion-differentiation controller based on the nominal model and pole configuration, which improves the outer loop’s force loading performance. Experiments are conducted, which verify the effectiveness of the proposed methods.
Collapse
|
8
|
Tariverdi A, Venkiteswaran VK, Richter M, Elle OJ, Tørresen J, Mathiassen K, Misra S, Martinsen ØG. A Recurrent Neural-Network-Based Real-Time Dynamic Model for Soft Continuum Manipulators. Front Robot AI 2021; 8:631303. [PMID: 33869294 PMCID: PMC8044932 DOI: 10.3389/frobt.2021.631303] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2020] [Accepted: 02/05/2021] [Indexed: 11/25/2022] Open
Abstract
This paper introduces and validates a real-time dynamic predictive model based on a neural network approach for soft continuum manipulators. The presented model provides a real-time prediction framework using neural-network-based strategies and continuum mechanics principles. A time-space integration scheme is employed to discretize the continuous dynamics and decouple the dynamic equations for translation and rotation for each node of a soft continuum manipulator. Then the resulting architecture is used to develop distributed prediction algorithms using recurrent neural networks. The proposed RNN-based parallel predictive scheme does not rely on computationally intensive algorithms; therefore, it is useful in real-time applications. Furthermore, simulations are shown to illustrate the approach performance on soft continuum elastica, and the approach is also validated through an experiment on a magnetically-actuated soft continuum manipulator. The results demonstrate that the presented model can outperform classical modeling approaches such as the Cosserat rod model while also shows possibilities for being used in practice.
Collapse
Affiliation(s)
| | | | - Michiel Richter
- Department of Biomechanical Engineering, University of Twente, Enschede, Netherlands
| | - Ole J Elle
- The Intervention Centre, Oslo University Hospital, Oslo, Norway.,Department of Informatics, University of Oslo, Oslo, Norway
| | - Jim Tørresen
- Department of Informatics, University of Oslo, Oslo, Norway
| | - Kim Mathiassen
- Department of Technology Systems, University of Oslo, Oslo, Norway
| | - Sarthak Misra
- Department of Biomechanical Engineering, University of Twente, Enschede, Netherlands.,Department of Biomedical Engineering, University of Groningen and University Medical Centre Groningen, Groningen, Netherlands
| | - Ørjan G Martinsen
- Department of Physics, University of Oslo, Oslo, Norway.,Department of Clinical and Biomedical Engineering, Oslo University Hospital, Oslo, Norway
| |
Collapse
|
9
|
Lim A, Schonewille A, Forbrigger C, Looi T, Drake J, Diller E. Design and Comparison of Magnetically-Actuated Dexterous Forceps Instruments for Neuroendoscopy. IEEE Trans Biomed Eng 2021; 68:846-856. [PMID: 32746054 DOI: 10.1109/tbme.2020.3007581] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
Abstract
Robot-assisted minimally invasive surgical (MIS) techniques offer improved instrument precision and dexterity, reduced patient trauma and risk, and promise to lessen the skill gap among surgeons. These approaches are common in general surgery, urology, and gynecology. However, MIS techniques remain largely absent for surgical applications within narrow, confined workspaces, such as neuroendoscopy. The limitation stems from a lack of small yet dexterous robotic tools. In this work, we present the first instance of a surgical robot with a direct magnetically-driven end effector capable of being deployed through a standard neuroendoscopic working channel (3.2 mm outer diameter) and operate at the neuroventricular scale. We propose a physical model for the gripping performance of three unique end-effector magnetization profiles and mechanical designs. Rates of blocking force per external magnetic flux density magnitude were 0.309 N/T, 0.880 N/T, and 0.351 N/T for the three designs which matched the physical model's prediction within 14.9% error. The rate of gripper closure per external magnetic flux density had a mean percent error of 11.2% compared to the model. The robot's performance was qualitatively evaluated during a pineal region tumor resection on a tumor analogue in a silicone brain phantom. These results suggest that wireless magnetic actuation may be feasible for dexterously manipulating tissue during minimally invasive neurosurgical procedures.
Collapse
|
10
|
Wang K, Liu J, Yan W, Lu Q, Nie S. Force feedback controls of multi-gripper robotic endovascular intervention: design, prototype, and experiments. Int J Comput Assist Radiol Surg 2020; 16:179-192. [PMID: 33089435 DOI: 10.1007/s11548-020-02278-w] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2020] [Accepted: 10/06/2020] [Indexed: 11/29/2022]
Abstract
PURPOSE Robotic endovascular intervention system (REIS) has the advantages of telemanipulation without radiation damage, precise location, and isolation of hand quiver. However, current REIS lacks a force feedback, which leads to high clinical risks. For the high operational safety of remote operations, this research proposes a force feedback control method for a novel manipulator with multi-grippers and develops a prototype to verify its expected telepresence. METHODS A high-resolution force sensor is used to acquire and transmit the intervention resistance force to the control handle. When the handle is translated or rotated, a loading mechanism composed of a servomotor, a screw pair, a spring, and friction roller generates the resistance force transmitted to the doctor's hand through the handle. A force/displacement hybrid control and PID control algorithm are used for the smaller feedback force error and lower delay. RESULTS This manipulator and its control handle are tested in the simulated catheter and vascular cases. The experiments show that force feedback precision can reach 0.05 N and the delay is not more than 50 ms, and the bandwidth is 9 Hz@-3 dB. CONCLUSION The proposed force feedback method can recreate resistance force from the intervention devices. The control model is valid with higher precision and wide bands, which has laid foundations to the application of REIS in clinic.
Collapse
Affiliation(s)
- Kundong Wang
- Department of Instrument Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China.
| | - Jianyun Liu
- Department of Instrument Engineering, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Weiwu Yan
- Department of Automation, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Qingsheng Lu
- Department of Vascular Surgery, Changhai Hospital, Shanghai, 200433, China.
| | - Shengdong Nie
- School of Medical Instrument and Food Engineering, University of Shanghai for Science and Technology, Shanghai, 200093, China
| |
Collapse
|
11
|
Ertop TE, Emerson M, Rox M, Granna J, Maldonado F, Gillaspie E, Lester M, Kuntz A, Rucker C, Fu M, Hoelscher J, Fried I, Alterovitz R, Webster R. STEERABLE NEEDLE TRAJECTORY FOLLOWING IN THE LUNG: TORSIONAL DEADBAND COMPENSATION AND FULL POSE ESTIMATION WITH 5DOF FEEDBACK FOR NEEDLES PASSING THROUGH FLEXIBLE ENDOSCOPES. PROCEEDINGS OF THE ASME DYNAMIC SYSTEMS AND CONTROL CONFERENCE. ASME DYNAMIC SYSTEMS AND CONTROL CONFERENCE 2020; 2020:V001T05A003. [PMID: 35284151 PMCID: PMC8916686 DOI: 10.1115/dscc2020-3163] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Bronchoscopic diagnosis and intervention in the lung is a new frontier for steerable needles, where they have the potential to enable minimally invasive, accurate access to small nodules that cannot be reliably accessed today. However, the curved, flexible bronchoscope requires a much longer needle than prior work has considered, with complex interactions between the needle and bronchoscope channel, introducing new challenges in steerable needle control. In particular, friction between the working channel and needle causes torsional windup along the bronchoscope, the effects of which cannot be directly measured at the tip of thin needles embedded with 5 degree-of-freedom magnetic tracking coils. To compensate for these effects, we propose a new torsional deadband-aware Extended Kalman Filter to estimate the full needle tip pose including the axial angle, which defines its steering direction. We use the Kalman Filter estimates with an established sliding mode controller to steer along desired trajectories in lung tissue. We demonstrate that this simple torsional deadband model is sufficient to account for the complex interactions between the needle and endoscope channel for control purposes. We measure mean final targeting error of 1.36 mm in phantom tissue and 1.84 mm in ex-vivo porcine lung, with mean trajectory following error of 1.28 mm and 1.10 mm, respectively.
Collapse
Affiliation(s)
| | - Maxwell Emerson
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37212
| | - Margaret Rox
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37212
| | - Josephine Granna
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37212
| | | | - Erin Gillaspie
- Vanderbilt University Medical Center, Nashville, TN 37212
| | - Michael Lester
- Vanderbilt University Medical Center, Nashville, TN 37212
| | - Alan Kuntz
- Robotics Center and School of Computing, University of Utah, Salt Lake City, UT 84112
| | - Caleb Rucker
- The Department of Mechanical, Aerospace, and Biomedical Engineering, University of Tennessee, Knoxville, TN 37996
| | - Mengyu Fu
- Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599
| | - Janine Hoelscher
- Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599
| | - Inbar Fried
- Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599
| | - Ron Alterovitz
- Department of Computer Science, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599
| | - Robert Webster
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37212
| |
Collapse
|
12
|
Tariverdi A, Venkiteswaran VK, Martinsen ØG, Elle OJ, Tørresen J, Misra S. Dynamic modeling of soft continuum manipulators using lie group variational integration. PLoS One 2020; 15:e0236121. [PMID: 32697813 PMCID: PMC7375556 DOI: 10.1371/journal.pone.0236121] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2020] [Accepted: 06/29/2020] [Indexed: 11/18/2022] Open
Abstract
This paper presents the derivation and experimental validation of algorithms for modeling and estimation of soft continuum manipulators using Lie group variational integration. Existing approaches are generally limited to static and quasi-static analyses, and are not sufficiently validated for dynamic motion. However, in several applications, models need to consider the dynamical behavior of the continuum manipulators. The proposed modeling and estimation formulation is obtained from a discrete variational principle, and therefore grants outstanding conservation properties to the continuum mechanical model. The main contribution of this article is the experimental validation of the dynamic model of soft continuum manipulators, including external torques and forces (e.g., generated by magnetic fields, friction, and the gravity), by carrying out different experiments with metal rods and polymer-based soft rods. To consider dissipative forces in the validation process, distributed estimation filters are proposed. The experimental and numerical tests also illustrate the algorithm's performance on a magnetically-actuated soft continuum manipulator. The model demonstrates good agreement with dynamic experiments in estimating the tip position of a Polydimethylsiloxane (PDMS) rod. The experimental results show an average absolute error and maximum error in tip position estimation of 0.13 mm and 0.58 mm, respectively, for a manipulator length of 60.55 mm.
Collapse
Affiliation(s)
| | | | - Ørjan Grøttem Martinsen
- Department of Physics, University of Oslo, Oslo, Norway
- Department of Clinical and Biomedical Engineering, Oslo University Hospital, Oslo, Norway
| | - Ole Jacob Elle
- The Intervention Centre, Oslo University Hospital, Oslo, Norway
- Department of Informatics, University of Oslo, Oslo, Norway
| | - Jim Tørresen
- Department of Informatics, University of Oslo, Oslo, Norway
| | - Sarthak Misra
- Department of Biomechanical Engineering, University of Twente, Enschede, The Netherlands
- Department of Biomedical Engineering, University of Groningen and University Medical Centre Groningen, Groningen, The Netherlands
| |
Collapse
|
13
|
Wu H, Yin M, Xu Z, Zhao Z, Han W. Transmission Characteristics Analysis and Compensation Control of Double Tendon-sheath Driven Manipulator. SENSORS (BASEL, SWITZERLAND) 2020; 20:E1301. [PMID: 32121020 PMCID: PMC7085673 DOI: 10.3390/s20051301] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 01/13/2020] [Revised: 02/19/2020] [Accepted: 02/26/2020] [Indexed: 02/02/2023]
Abstract
The double tendon-sheath drive system is widely used in the design of surgical robots and search and rescue robots because of its simplicity, dexterity, and long-distance transmission. We are attempting to apply it to manipulators, wherenon-linear characteristics such as gaps, hysteresis, etc., due to friction between the contact surfaces of the tendon sheath and the flexibility of the rope, are the main difficulties in controlling such manipulators. Most of the existing compensation control methods applicable to double tendon-sheath actuators are offline compensation methods that do not require output feedback, but when the system's motion and configuration changes, it cannot adapt to the drastic changes in the transmission characteristics. Depending on the transmission system, the robotic arm, changes at any time during the working process, and the force sensors and torque sensors that cannot be applied to the joints of the robot, so a real-time position compensation control method based on flexible cable deformation is proposed. A double tendon-sheath transmission model is established, a double tendon-sheath torque transmission model under any load condition is derived, and a semi-physical simulation experimental platform composed of a motor, a double tendon-sheath transmission system and a single articulated arm is established to verify the transfer model. Through the signal feedback of the end encoder, a real-time closed-loop feedback system was established, thus that the system can still achieve the output to follow the desired torque trajectory under the external interference.
Collapse
Affiliation(s)
- Haoting Wu
- Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; (Z.X.); (Z.Z.); (W.H.)
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
- School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110169, China
| | - Meng Yin
- Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; (Z.X.); (Z.Z.); (W.H.)
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Zhigang Xu
- Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; (Z.X.); (Z.Z.); (W.H.)
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
| | - Zhiliang Zhao
- Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; (Z.X.); (Z.Z.); (W.H.)
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
- School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110169, China
| | - Wei Han
- Shenyang Institute of Automation, Chinese Academy of Sciences, Shenyang 110016, China; (Z.X.); (Z.Z.); (W.H.)
- Institutes for Robotics and Intelligent Manufacturing, Chinese Academy of Sciences, Shenyang 110169, China
- School of Mechanical Engineering and Automation, Northeastern University, Shenyang 110169, China
| |
Collapse
|
14
|
Kim H, Hwang M, Kim J, You JM, Lim CS, Kwon DS. Effect of backlash hysteresis of surgical tool bending joints on task performance in teleoperated flexible endoscopic robot. Int J Med Robot 2019; 16:e2047. [PMID: 31675461 DOI: 10.1002/rcs.2047] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/30/2019] [Revised: 10/03/2019] [Accepted: 10/04/2019] [Indexed: 12/13/2022]
Abstract
BACKGROUND The tendon-sheath mechanism provides flexibility but degrades the task performance of the flexible endoscopic robot because of the inherent backlash hysteresis problem. Previous studies have only focused on reducing backlash hysteresis. The goal of this study is to identify the backlash hysteresis criteria of surgical tool bending joints to maintain efficient surgical performance. METHODS A test platform for a surgical tool has been developed that has initial backlash hysteresis under 5° and can adjust the backlash hysteresis intentionally. Performance variation has been investigated in three bench-top endoscopic tasks in which various backlash hysteresis conditions were intentionally adjusted. RESULTS A clear drop-off in task performance has been observed when the backlash hysteresis of the bending joints was greater than 10° regardless of the type of task and link length. CONCLUSIONS The backlash hysteresis of surgical tool bending joints should be reduced to at least 10° to maintain efficient performance in robotic endoscopic surgery.
Collapse
Affiliation(s)
- Hansoul Kim
- Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
| | - Minho Hwang
- Department of Electrical Engineering and Computer Sciences, University of California Berkeley, Berkeley, California
| | - Joonhwan Kim
- Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
| | - Jae Min You
- Robotics Program, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
| | - Chan-Soon Lim
- Robotics Program, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
| | - Dong-Soo Kwon
- Department of Mechanical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea
| |
Collapse
|
15
|
Hu X, Chen A, Luo Y, Zhang C, Zhang E. Steerable catheters for minimally invasive surgery: a review and future directions. Comput Assist Surg (Abingdon) 2019; 23:21-41. [PMID: 30497292 DOI: 10.1080/24699322.2018.1526972] [Citation(s) in RCA: 32] [Impact Index Per Article: 6.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023] Open
Abstract
The steerable catheter refers to the catheter that is manipulated by a mechanism which may be driven by operators or by actuators. The steerable catheter for minimally invasive surgery has rapidly become a rich and diverse area of research. Many important achievements in design, application and analysis of the steerable catheter have been made in the past decade. This paper aims to provide an overview of the state of arts of steerable catheters. Steerable catheters are classified into four main groups based on the actuation principle: (1) tendon driven catheters, (2) magnetic navigation catheters, (3) soft material driven catheters (shape memory effect catheters, steerable needles, concentric tubes, conducting polymer driven catheters and hydraulic pressure driven catheters), and (4) hybrid actuation catheters. The advantages and limitations of each of them are commented and discussed in this paper. The future directions of research are summarized.
Collapse
Affiliation(s)
- Xiaohua Hu
- a School of Mechatronic Engineering and Automation , Shanghai University , Shanghai , P.R. China.,b Division of Biomedical Engineering , University of Saskatchewan , Saskatoon , SK , Canada
| | - Ang Chen
- b Division of Biomedical Engineering , University of Saskatchewan , Saskatoon , SK , Canada
| | - Yigang Luo
- b Division of Biomedical Engineering , University of Saskatchewan , Saskatoon , SK , Canada.,c Department of Surgery , University of Saskatchewan , Saskatoon , SK , Canada
| | - Chris Zhang
- a School of Mechatronic Engineering and Automation , Shanghai University , Shanghai , P.R. China.,b Division of Biomedical Engineering , University of Saskatchewan , Saskatoon , SK , Canada
| | - Edwin Zhang
- d Department of Medical Imaging , University of Toronto , Toronto , Canada
| |
Collapse
|
16
|
Antico M, Sasazawa F, Wu L, Jaiprakash A, Roberts J, Crawford R, Pandey AK, Fontanarosa D. Ultrasound guidance in minimally invasive robotic procedures. Med Image Anal 2019; 54:149-167. [DOI: 10.1016/j.media.2019.01.002] [Citation(s) in RCA: 25] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/30/2017] [Revised: 01/01/2019] [Accepted: 01/09/2019] [Indexed: 12/20/2022]
|
17
|
Omisore OM, Han SP, Ren LX, Wang GS, Ou FL, Li H, Wang L. Towards Characterization and Adaptive Compensation of Backlash in a Novel Robotic Catheter System for Cardiovascular Interventions. IEEE TRANSACTIONS ON BIOMEDICAL CIRCUITS AND SYSTEMS 2018; 12:824-838. [PMID: 29994773 DOI: 10.1109/tbcas.2018.2825359] [Citation(s) in RCA: 20] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Despite the success and prospects of the robotic catheter system for the cardiovascular access, loss of vision, and haptics have limited its global adoption. A direct implication is the great difficulty posed when trying to eliminate the backlash in catheters during vascular cannulations. As a result, physicians and patients end up been exposed to high radiation for a long period of time. Existing control systems proposed for such interventional robots have not fully consider the hysteretic (backlash) behavior. In this study, a novel robotic catheter system is designed for accessing the human cardiac area through the radial vasculature, while single factor descriptive analysis is employed to characterize the backlash behavior during axial motions of the interventional robot. Based on the descriptive analysis, an adaptive system is proposed for the backlash compensation during the cardiovascular access. The adaptive system consists of a neuro-fuzzy module that predicts a backlash gap based on bounded motion signals, and contact force modulated from a modified error-based force control model. The proposed system is implemented in MATLAB and visual C++. Finally, an in vitro experiment with a human tubular model, shows that the proposed adaptive compensation system can minimize the backlash occurrence during cardiovascular access.
Collapse
|
18
|
Abstract
Remote and robotically actuated catheters are the stepping-stones toward autonomous catheters, where complex intravascular procedures may be performed with minimal intervention from a physician. This article proposes a concept for the positional, feedforward control of a robotically actuated cell injection catheter used for the injection of myogenic or undifferentiated stem cells into the myocardial infarct boundary zones of the left ventricle. The prototype for the catheter system was built upon a needle-based catheter with a single degree of deflection, a 3-D printed handle combined with actuators, and the Arduino microcontroller platform. A bench setup was used to mimic a left ventricle catheter procedure starting from the femoral artery. Using Matlab and the open-source video modeling tool Tracker, the planar coordinates (y, z) of the catheter position were analyzed, and a feedforward control system was developed based on empirical models. Using the Student’s t test with a sample size of 26, it was determined that for both the y- and z-axes, the mean discrepancy between the calibrated and theoretical coordinate values had no significant difference compared to the hypothetical value of µ = 0. The root mean square error of the calibrated coordinates also showed an 88% improvement in the z-axis and 31% improvement in the y-axis compared to the unmodified trial run. This proof of concept investigation leads to the possibility of further developing a feedfoward control system in vivo using catheters with omnidirectional deflection. Feedforward positional control allows for more flexibility in the design of an automated catheter system where problems such as systemic time delay may be a hindrance in instances requiring an immediate reaction.
Collapse
Affiliation(s)
- Weyland Cheng
- 1 Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, China.,2 Cell Therapy Institute, Wuhan, China
| | | |
Collapse
|
19
|
Cheng L, Sharifi M, Tavakoli M. Towards robot-assisted anchor deployment in beating-heart mitral valve surgery. Int J Med Robot 2018; 14:e1900. [DOI: 10.1002/rcs.1900] [Citation(s) in RCA: 14] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/10/2017] [Revised: 01/08/2018] [Accepted: 01/11/2018] [Indexed: 11/07/2022]
Affiliation(s)
- Lingbo Cheng
- Department of Electrical and Computer Engineering; University of Alberta; Edmonton Alberta Canada
| | - Mojtaba Sharifi
- Department of Mechanical Engineering; Shiraz University; Shiraz Iran
| | - Mahdi Tavakoli
- Department of Electrical and Computer Engineering; University of Alberta; Edmonton Alberta Canada
| |
Collapse
|
20
|
Shi C, Luo X, Qi P, Li T, Song S, Najdovski Z, Fukuda T, Ren H. Shape Sensing Techniques for Continuum Robots in Minimally Invasive Surgery: A Survey. IEEE Trans Biomed Eng 2017; 64:1665-1678. [DOI: 10.1109/tbme.2016.2622361] [Citation(s) in RCA: 161] [Impact Index Per Article: 23.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
21
|
Back J, Lindenroth L, Rhode K, Liu H. Model-Free Position Control for Cardiac Ablation Catheter Steering Using Electromagnetic Position Tracking and Tension Feedback. Front Robot AI 2017. [DOI: 10.3389/frobt.2017.00017] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
|
22
|
Cheng W, Law PK. Conceptual Design and Procedure for an Autonomous Intramyocardial Injection Catheter. Cell Transplant 2017; 26:735-751. [PMID: 27938487 PMCID: PMC5657718 DOI: 10.3727/096368916x694256] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2016] [Accepted: 02/09/2017] [Indexed: 11/24/2022] Open
Abstract
This article discusses existing catheter systems and proposes a conceptual design and procedure for an autonomous cell injection catheter for the purpose of transferring committed myogenic or undifferentiated stem cells into the infarct boundary zones of the left ventricle. Operation of existing catheters used for cell delivery is far from optimal. Commercial injection catheters available are handheld devices operated manually by means of tip deflection and torque capabilities. Interventionists require a hefty learning curve and often encounter difficulties in catheter stabilization and infarct detection, resulting in lengthy operation times and nonprecise injections. We examined current technologies and proposed a design incorporating robotic positional control, feedback signals, and an adaptable operational sequence to overcome these problems. The design provides the basis for robotic catheter construction that is able to autonomously assist the physician in transferring myogenic cells to the left ventricle infarct boundary zones.
Collapse
Affiliation(s)
- Weyland Cheng
- Department of Biomedical Engineering, Huazhong University of Science and Technology, Wuhan, P.R. China
- Cell Therapy Institute, Wuhan, P.R. China
| | | |
Collapse
|
23
|
Gelman D, Skanes AC, Tavallaei MA, Drangova M. Design and Evaluation of a Catheter Contact-Force Controller for Cardiac Ablation Therapy. IEEE Trans Biomed Eng 2016; 63:2301-2307. [DOI: 10.1109/tbme.2016.2525929] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
24
|
Mehndiratta A. Large-deflection statics analysis of active cardiac catheters through co-rotational modelling. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2016; 2016:2133-2136. [PMID: 28268753 DOI: 10.1109/embc.2016.7591150] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
This paper presents a co-rotational concept for large-deflection formulation of cardiac catheters. Using this approach, the catheter is first discretized with a number of equal length beam elements and nodes, and the rigid body motions of an individual beam element are separated from its deformations. Therefore, it is adequate for modelling arbitrarily large deflections of a catheter with linear elastic analysis at the local element level. A novel design of active cardiac catheter of 9 Fr in diameter at the beginning of the paper is proposed, which is based on the contra-rotating double helix patterns and is improved from the previous prototypes. The modelling section is followed by MATLAB simulations of various deflections when the catheter is exerted different types of loads. This proves the feasibility of the presented modelling approach. To the best knowledge of the authors, it is the first to utilize this methodology for large-deflection static analysis of the catheter, which will enable more accurate control of robot-assisted cardiac catheterization procedures. Future work would include further experimental validations.
Collapse
|
25
|
Moradi Dalvand M, Nahavandi S, Howe RD. Fast vision-based catheter 3D reconstruction. Phys Med Biol 2016; 61:5128-48. [DOI: 10.1088/0031-9155/61/14/5128] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
|
26
|
A Three-Dimensional Shape-Based Force and Stiffness-Sensing Platform for Tendon-Driven Catheters. SENSORS 2016; 16:s16070990. [PMID: 27367685 PMCID: PMC4970041 DOI: 10.3390/s16070990] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/22/2016] [Revised: 04/29/2016] [Accepted: 05/24/2016] [Indexed: 11/16/2022]
Abstract
This paper presents an efficient shape-based three-axial force and stiffness estimator for active catheters commonly implemented in cardiac ablation. The force-sensing capability provides important feedback for catheterization procedures including real-time control and catheter steering in autonomous navigation systems. The proposed platform is based on the introduced accurate and computationally efficient Cosserat rod model for tendon-driven catheters. The proposed nonlinear Kalman filter formulation for contact force estimation along with the developed catheter model provides a real-time force observer robust to nonlinearities and noise covariance uncertainties. Furthermore, the proposed platform enables stiffness estimation in addition to tip contact force sensing in different operational circumstances. The approach incorporates pose measurements which can be achieved using currently developed pose-sensing systems or imaging techniques. The method makes the approach compatible with the range of forces applied in clinical applications. The simulation and experimental results verify the viability of the introduced force and stiffness-sensing technique.
Collapse
|
27
|
Do TN, Seah TET, Phee SJ. Design and Control of a Mechatronic Tracheostomy Tube for Automated Tracheal Suctioning. IEEE Trans Biomed Eng 2016; 63:1229-1238. [PMID: 26485352 PMCID: PMC7186034 DOI: 10.1109/tbme.2015.2491327] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2015] [Revised: 08/22/2015] [Accepted: 10/13/2015] [Indexed: 11/10/2022]
Abstract
GOAL Mechanical ventilation is required to aid patients with breathing difficulty to breathe more comfortably. A tracheostomy tube inserted through an opening in the patient neck into the trachea is connected to a ventilator for suctioning. Currently, nurses spend millions of person-hours yearly to perform this task. To save significant person-hours, an automated mechatronic tracheostomy system is needed. This system allows for relieving nurses and other carers from the millions of person-hours spent yearly on tracheal suctioning. In addition, it will result in huge healthcare cost savings. METHODS We introduce a novel mechatronic tracheostomy system including the development of a long suction catheter, automatic suctioning mechanisms, and relevant control approaches to perform tracheal suctioning automatically. To stop the catheter at a desired position, two approaches are introduced: 1) Based on the known travel length of the catheter tip; 2) Based on a new sensing device integrated at the catheter tip. It is known that backlash nonlinearity between the suction catheter and its conduit as well as in the gear system of the actuator are unavoidable. They cause difficulties to control the exact position of the catheter tip. For the former case, we develop an approximate model of backlash and a direct inverse scheme to enhance the system performances. The scheme does not require any complex inversions of the backlash model and allows easy implementations. For the latter case, a new sensing device integrated into the suction catheter tip is developed and backlash compensation controls are avoided. RESULTS Automated suctioning validations are successfully carried out on the proposed experimental system. Comparisons and discussions are also introduced. SIGNIFICANCE The results demonstrate a significant contribution and potential benefits to the mechanical ventilation areas.
Collapse
Affiliation(s)
- Thanh Nho Do
- School of Mechanical and Aerospace
EngineeringNanyang Technological UniversitySingapore639798
| | | | - Soo Jay Phee
- School of Mechanical and Aerospace EngineeringNanyang Technological University
| |
Collapse
|
28
|
Xu W, Poon CCY, Yam Y, Chiu PWY. Motion compensated controller for a tendon-sheath-driven flexible endoscopic robot. Int J Med Robot 2016; 13. [PMID: 27045665 DOI: 10.1002/rcs.1747] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2015] [Revised: 12/09/2015] [Accepted: 02/23/2016] [Indexed: 11/09/2022]
Abstract
BACKGROUND A tendon-sheath system (TSS) has the advantages of being relatively compact in size, flexible and low cost, and therefore is favoured in building flexible endoscopic robots to pass through long and tortuous human lumen. TSS, however, is prone to nonlinear behaviors such as backlash, hysteresis and direction dependent properties. A compensation technique is required to improve its positioning performance. METHODS Tension and elongation models of TSS are analyzed. A feedforward motion compensation controller is designed to compensate the asymmetric backlash behavior of the TSS in real time. RESULTS Motion tracking experiments were conducted on a TSS driven two DOFs continuum manipulator. The results showed that using the proposed compensation methods, tracking error can be reduced by 74%. CONCLUSIONS The proposed compensation method is useful for controlling flexible continuum robots, which are anticipated to have emerging roles in assisting surgeons to perform the increasingly technically challenging endoscopic procedures. Copyright © 2016 John Wiley & Sons, Ltd.
Collapse
Affiliation(s)
- Wenjun Xu
- Department of Biomedical Engineering, National University of Singapore, Singapore.,Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong
| | - Carmen C Y Poon
- Department of Surgery, The Chinese University of Hong Kong, Hong Kong
| | - Y Yam
- Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong
| | - P W Y Chiu
- Department of Surgery, The Chinese University of Hong Kong, Hong Kong
| |
Collapse
|
29
|
Roesthuis RJ, Misra S. Steering of Multisegment Continuum Manipulators Using Rigid-Link Modeling and FBG-Based Shape Sensing. IEEE T ROBOT 2016. [DOI: 10.1109/tro.2016.2527047] [Citation(s) in RCA: 68] [Impact Index Per Article: 8.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
30
|
Feng ZQ, Bian GB, Xie XL, Hao JL, Gao ZJ, Hou ZG. Preliminary study for motion scaling based control in minimally invasive vascular interventional robot. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2016; 2015:4898-901. [PMID: 26737390 DOI: 10.1109/embc.2015.7319490] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Robot-assisted vascular interventions present promising trend for reducing the X-ray radiation to the surgeon during the operation. However, the control methods in the current vascular interventional robots only repeat the manipulation of the surgeon. While under certain circumstances, it is necessary to scale the manipulation of the surgeon to obtain a higher precision or a shorter manipulation time. A novel control method based on motion scaling for vascular interventional robot is proposed in this paper. The main idea of the method is to change the motion speed ratios between the master and the slave side. The motion scaling based control method is implemented in the vascular interventional robot we've developed before, so the operator can deliver the interventional devices under different motion scaling factors. Experiment studies verify the effectiveness of the motion scaling based control.
Collapse
|
31
|
Concentric Tube Robots: The State of the Art and Future Directions. SPRINGER TRACTS IN ADVANCED ROBOTICS 2016. [DOI: 10.1007/978-3-319-28872-7_15] [Citation(s) in RCA: 73] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/21/2022]
|
32
|
Smoljkic G, Borghesan G, Devreker A, Poorten EV, Rosa B, De Praetere H, De Schutter J, Reynaerts D, Sloten JV. Control of a hybrid robotic system for computer-assisted interventions in dynamic environments. Int J Comput Assist Radiol Surg 2015; 11:1371-83. [PMID: 26662203 DOI: 10.1007/s11548-015-1333-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/27/2015] [Accepted: 11/22/2015] [Indexed: 10/22/2022]
Abstract
PURPOSE Minimally invasive surgery is becoming the standard treatment of care for a variety of procedures. Surgeons need to display a high level of proficiency to overcome the challenges imposed by the minimal access. Especially when operating on a dynamic organ, it becomes very difficult to align instruments reliably and precisely. In this paper, a hybrid rigid/continuum robotic system and a dedicated robotic control approach are proposed to assist the surgeon performing complex surgical gestures in a dynamic environment. METHODS The proposed robotic system consists of a rigid robot arm on top of which a continuum robot is mounted in series. The continuum robot is locally actuated with McKibben muscles. A control scheme based on quadratic programming framework is adopted. It is shown that the framework allows enforcing a set of constraints on the pose of the tip, as well as of the instrument shaft, which is commanded to slide in and out through the entry point. RESULTS Through simulation and experiments, it is shown how the robot tool tip is able to follow sinusoidal trajectories of 0.37 and 2 Hz, while maintaining the instrument shaft pivoting along the entry point. The positioning and tracking accuracy of such system are shown to lie below 4.7 mm in position and [Formula: see text] in angle. CONCLUSION The results suggest a good potential for applying the proposed technology to assist the surgeon during complex robot-assisted interventions. It is also illustrated that even when using flexible hence relatively safe end-effectors, it is possible to reach acceptable tracking behaviour at relatively high frequencies.
Collapse
Affiliation(s)
- Gabrijel Smoljkic
- Department of Mechanical Engineering, KU Leuven, Celestijnenlaan 300C, 3001, Leuven, Belgium.
| | - Gianni Borghesan
- Department of Mechanical Engineering, KU Leuven, Celestijnenlaan 300C, 3001, Leuven, Belgium
| | - Alain Devreker
- Department of Mechanical Engineering, KU Leuven, Celestijnenlaan 300C, 3001, Leuven, Belgium
| | - Emmanuel Vander Poorten
- Department of Mechanical Engineering, KU Leuven, Celestijnenlaan 300C, 3001, Leuven, Belgium
| | - Benoit Rosa
- Department of Mechanical Engineering, KU Leuven, Celestijnenlaan 300C, 3001, Leuven, Belgium
| | | | - Joris De Schutter
- Department of Mechanical Engineering, KU Leuven, Celestijnenlaan 300C, 3001, Leuven, Belgium
| | - Dominiek Reynaerts
- Department of Mechanical Engineering, KU Leuven, Celestijnenlaan 300C, 3001, Leuven, Belgium
| | - Jos Vander Sloten
- Department of Mechanical Engineering, KU Leuven, Celestijnenlaan 300C, 3001, Leuven, Belgium
| |
Collapse
|
33
|
|
34
|
Abstract
The recent growth of surgical applications exploiting continuum robots demands for new control paradigms that ensure safety by controlling interaction forces of tele-operated end-effectors. In this paper, we present the modeling, sensing and control of multi-backbone continuum robots in a unified framework for hybrid motion/force control. Multi-backbone continuum robots allow to estimate forces and torques at the operational point by monitoring loads along their actuation lines without the need for a dedicated transducer at the operational point. This capability is indeed crucial in emerging fields such as robotic surgery where cost and strict sterilization guidelines prevent the adoption of a dedicated sensor to provide force feedback from the sterile field. To advance further the force sensing capabilities of multi-backbone continuum robots, we present a new framework for hybrid motion and force control of continuum robots with intrinsic force sensing capabilities. The framework is based on a kinetostatic modeling of the multi-backbone continuum robot with, a simplified model for online estimate of the manipulator’s compliance, and a new strategy for merging force and motion control laws in the configuration space of the manipulator. Experimental results show the ability to sense and regulate forces at the operational point and evaluate the framework for shape exploration and stiffness imaging in flexible environments.
Collapse
Affiliation(s)
- Andrea Bajo
- Advanced Robotics and Mechanism Applications (ARMA),
Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, USA
| | - Nabil Simaan
- Advanced Robotics and Mechanism Applications (ARMA),
Department of Mechanical Engineering, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
35
|
Sun Z, Wang Z, Phee SJ. Modeling and motion compensation of a bidirectional tendon-sheath actuated system for robotic endoscopic surgery. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2015; 119:77-87. [PMID: 25819033 DOI: 10.1016/j.cmpb.2015.03.001] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/30/2014] [Revised: 02/09/2015] [Accepted: 03/04/2015] [Indexed: 06/04/2023]
Abstract
Recent study shows that tendon-sheath system (TSS) has great potential in the development of surgical robots for endoscopic surgery. It is able to deliver adequate power in a light-weight and compact package. And the flexibility and compliance of the tendon-sheath system make it capable of adapting to the long and winding path in the flexible endoscope. However, the main difficulties in precise control of such system fall on the nonlinearities of the system behavior and absence of necessary sensory feedback at the surgical end-effectors. Since accurate position control of the tool is a prerequisite for efficacy, safety and intuitive user-experience in robotic surgery, in this paper we propose a system modeling approach for motion compensation. Based on a bidirectional actuated system using two separate tendon-sheaths, motion transmission is firstly characterized. Two types of positional errors due to system backlash and environment loading are defined and modeled. Then a model-based feedforward compensation method is proposed for open-loop control, giving the system abilities to adjust according to changes in the transmission route configuration without any information feedback from the distal end. A dedicated experimental platform emulating a bidirectional TSS robotic system for endoscopic surgery is built for testing. Proposed positional errors are identified and verified. The performance of the proposed motion compensation is evaluated by trajectory tracking under different environment loading conditions. And the results demonstrate that accurate position control can be achieved even if the transmission route configuration is updated.
Collapse
Affiliation(s)
- Zhenglong Sun
- SUTD-MIT International Design Center, Singapore University of Technology and Design, Singapore.
| | - Zheng Wang
- Department of Mechanical Engineering, The University of Hong Kong, Hong Kong, China
| | - Soo Jay Phee
- School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore
| |
Collapse
|
36
|
Abstract
A novel robotic tool is proposed to enable the surgical removal of tissue from inside the beating heart. The tool is manufactured using a unique metal MEMS process that provides the means to fabricate fully assembled devices that incorporate micron-scale features in a millimeter scale tool. The tool is integrated with a steerable curved concentric tube robot that can enter the heart percutaneously through peripheral vessels. Incorporating both irrigation and aspiration, the tissue removal system is capable of extracting substantial amounts of tissue under teleoperated control by first morselizing it and then transporting the debris out of the heart through the lumen of the robot. Tool design and robotic integration are described, and ex vivo and in vivo large animal experimental results are presented.
Collapse
|
37
|
|
38
|
Moradi Dalvand M, Shirinzadeh B, Nahavandi S, Smith J. Effects of realistic force feedback in a robotic assisted minimally invasive surgery system. MINIM INVASIV THER 2013; 23:127-35. [DOI: 10.3109/13645706.2013.867886] [Citation(s) in RCA: 24] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022]
|
39
|
Kim JH, Choi SH, Park IW, Zaheer SA. Intelligence Technology for Robots That Think [Application Notes]. IEEE COMPUT INTELL M 2013. [DOI: 10.1109/mci.2013.2264573] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/11/2022]
|