1
|
Tamadon I, Sadati SMH, Mamone V, Ferrari V, Bergeles C, Menciassi A. Semiautonomous Robotic Manipulator for Minimally Invasive Aortic Valve Replacement. IEEE T ROBOT 2023; 39:4500-4519. [PMID: 38249319 PMCID: PMC7615540 DOI: 10.1109/tro.2023.3315966] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/23/2024]
Abstract
Aortic valve surgery is the preferred procedure for replacing a damaged valve with an artificial one. The ValveTech robotic platform comprises a flexible articulated manipulator and surgical interface supporting the effective delivery of an artificial valve by teleoperation and endoscopic vision. This article presents our recent work on force-perceptive, safe, semiautonomous navigation of the ValveTech platform prior to valve implantation. First, we present a force observer that transfers forces from the manipulator body and tip to a haptic interface. Second, we demonstrate how hybrid forward/inverse mechanics, together with endoscopic visual servoing, lead to autonomous valve positioning. Benchtop experiments and an artificial phantom quantify the performance of the developed robot controller and navigator. Valves can be autonomously delivered with a 2.0±0.5 mm position error and a minimal misalignment of 3.4±0.9°. The hybrid force/shape observer (FSO) algorithm was able to predict distributed external forces on the articulated manipulator body with an average error of 0.09 N. FSO can also estimate loads on the tip with an average accuracy of 3.3%. The presented system can lead to better patient care, delivery outcome, and surgeon comfort during aortic valve surgery, without requiring sensorization of the robot tip, and therefore obviating miniaturization constraints.
Collapse
Affiliation(s)
- Izadyar Tamadon
- Faculty of Engineering Technology, University of Twente, 7522 NB Enschede, The Netherlands, and also with the BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pontedera, Italy
| | - S. M. Hadi Sadati
- Robotics and Vision Department in Medicine Lab, School of Biomedical Engineering & Imaging Sciences, King’s College London, SE17EU London, U.K
| | - Virginia Mamone
- Department of Computer Science and the EndoCAS Center for Computer-Assisted Surgery, University of Pisa, 56124 Pisa, Italy
| | - Vincenzo Ferrari
- Department of Computer Science and the EndoCAS Center for Computer-Assisted Surgery, University of Pisa, 56124 Pisa, Italy
| | - Christos Bergeles
- Robotics and Vision Department in Medicine Lab, School of Biomedical Engineering & Imaging Sciences, King’s College London, SE17EU London, U.K
| | - Arianna Menciassi
- BioRobotics Institute, Scuola Superiore Sant’Anna, 56025 Pontedera, Italy
| |
Collapse
|
2
|
Sahu SK, Sozer C, Rosa B, Tamadon I, Renaud P, Menciassi A. Shape Reconstruction Processes for Interventional Application Devices: State of the Art, Progress, and Future Directions. Front Robot AI 2021; 8:758411. [PMID: 34869615 PMCID: PMC8640970 DOI: 10.3389/frobt.2021.758411] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2021] [Accepted: 10/11/2021] [Indexed: 01/02/2023] Open
Abstract
Soft and continuum robots are transforming medical interventions thanks to their flexibility, miniaturization, and multidirectional movement abilities. Although flexibility enables reaching targets in unstructured and dynamic environments, it also creates challenges for control, especially due to interactions with the anatomy. Thus, in recent years lots of efforts have been devoted for the development of shape reconstruction methods, with the advancement of different kinematic models, sensors, and imaging techniques. These methods can increase the performance of the control action as well as provide the tip position of robotic manipulators relative to the anatomy. Each method, however, has its advantages and disadvantages and can be worthwhile in different situations. For example, electromagnetic (EM) and Fiber Bragg Grating (FBG) sensor-based shape reconstruction methods can be used in small-scale robots due to their advantages thanks to miniaturization, fast response, and high sensitivity. Yet, the problem of electromagnetic interference in the case of EM sensors, and poor response to high strains in the case of FBG sensors need to be considered. To help the reader make a suitable choice, this paper presents a review of recent progress on shape reconstruction methods, based on a systematic literature search, excluding pure kinematic models. Methods are classified into two categories. First, sensor-based techniques are presented that discuss the use of various sensors such as FBG, EM, and passive stretchable sensors for reconstructing the shape of the robots. Second, imaging-based methods are discussed that utilize images from different imaging systems such as fluoroscopy, endoscopy cameras, and ultrasound for the shape reconstruction process. The applicability, benefits, and limitations of each method are discussed. Finally, the paper draws some future promising directions for the enhancement of the shape reconstruction methods by discussing open questions and alternative methods.
Collapse
Affiliation(s)
- Sujit Kumar Sahu
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
- ICube, CNRS, INSA Strasbourg, University of Strasbourg, Strasbourg, France
| | - Canberk Sozer
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Benoit Rosa
- ICube, CNRS, INSA Strasbourg, University of Strasbourg, Strasbourg, France
| | - Izadyar Tamadon
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| | - Pierre Renaud
- ICube, CNRS, INSA Strasbourg, University of Strasbourg, Strasbourg, France
| | - Arianna Menciassi
- The BioRobotics Institute, Scuola Superiore Sant’Anna, Pisa, Italy
- Department of Excellence in Robotics & AI, Scuola Superiore Sant’Anna, Pisa, Italy
| |
Collapse
|
3
|
Dynamic Analysis of an Underwater Cable-Driven Manipulator with a Fluid-Power Buoyancy Regulation System. MICROMACHINES 2020; 11:mi11121042. [PMID: 33256229 PMCID: PMC7760609 DOI: 10.3390/mi11121042] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/08/2020] [Revised: 11/25/2020] [Accepted: 11/25/2020] [Indexed: 11/17/2022]
Abstract
This article presents an underwater cable-driven manipulator (UCDM) with a buoyancy regulation system (BRS), which is controlled by a fluid-power system. The manipulator consists of five sections, and each section is embedded with a buoyancy adjustment unit. By regulating buoyancy at each section, the static and dynamic states of the manipulator will be changed, promising a new operating mode of an underwater manipulator driven by buoyancy. In this article, a dynamic model of the manipulator is established by the Newton-Euler equation, considering cable tension, inter-joint force, buoyancy, water resistance and other variables. With a numerical method, the dynamic model is solved and the values of cable tension are obtained, which are used to evaluate the buoyancy-driven operating mode of underwater manipulator. This research will be useful for manipulator operating in fluid environments, such as underwater manipulator in the ocean, micro-manipulator in a blood vessel, and so on.
Collapse
|
4
|
Tamadon I, Mamone V, Huan Y, Condino S, Quaglia C, Ferrari V, Ferrari M, Menciassi A. ValveTech: A Novel Robotic Approach for Minimally Invasive Aortic Valve Replacement. IEEE Trans Biomed Eng 2020; 68:1238-1249. [PMID: 32931426 DOI: 10.1109/tbme.2020.3024184] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVE Aortic valve disease is the most common heart disease in the elderly calling for replacement with an artificial valve. The presented surgical robot aims to provide a highly controllable instrument for efficient delivery of an artificial valve by the help of integrated endoscopic vision. METHODS A robot (called ValveTech), intended for minimally invasive surgery (MIS) and consisting of a flexible cable driven manipulator, a passive arm, and a control unit has been designed and prototyped. The flexible manipulator has several features (e.g., stabilizing flaps, tiny cameras, dexterous introducer and custom cartridge) to help the proper valve placement. It provides 5 degrees of freedom for reaching the operative site via mini-thoracotomy; it adjusts the valve and expands it at the optimal position. The robot was evaluated by ten cardiac surgeons following a real surgical scenario in artificial chest simulator with an aortic mockup. Moreover, after each delivery, the expanded valve was evaluated objectively in comparison with the ideal position. RESULTS The robot performances were evaluated positively by surgeons. The trials resulted in faster delivery and an average misalignment distance of 3.8 mm along the aorta axis; 16.3 degrees rotational angle around aorta axis and 8.8 degrees misalignment of the valve commissure plane to the ideal plane were measured. CONCLUSION The trials successfully proved the proposed system for valve delivery under endoscopic vision. SIGNIFICANCE The ValveTech robot can be an alternative solution for minimally invasive aortic valve surgery and improve the quality of the operation both for surgeons and patients.
Collapse
|
5
|
Tamadon I, Huan Y, de Groot AG, Menciassi A, Sinibaldi E. Positioning and stiffening of an articulated/continuum manipulator for implant delivery in minimally invasive surgery. Int J Med Robot 2020; 16:e2072. [PMID: 31876096 DOI: 10.1002/rcs.2072] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2019] [Revised: 12/03/2019] [Accepted: 12/18/2019] [Indexed: 01/20/2023]
Abstract
BACKGROUND Hollow, bendable manipulators can advance implant delivery in minimally invasive surgery, by circumventing the drawbacks of straight-line delivery and fostering single-port approaches. Variable stiffness manipulators are sought to be safe and effective. METHODS We designed and experimentally assessed a cable-driven articulated/continuum manipulator, devised for cardiac valve delivery. Positioning and stiffening were teleoperated, based on cable shortening. Stiffening was parameterized by using the leading tension (LT, ie, tension of the cables driving bending). We assessed positioning (repeatability/reversibility along eight/two bending directions) and stiffening (eight bent configurations). RESULTS We achieved good repeatability and reversibility (mean errors <1% and 1.5%, respectively, of the workspace characteristic length). Stiffening was effective (up to 9-fold increase, depending on pose). Stiffening was linearly correlated (R2 = 0.92) with LT for all the considered configurations. CONCLUSION We accurately positioned and effectively stiffened the manipulator in several bent configurations. The proposed stiffness modulation strategy can be extended to other manipulators.
Collapse
Affiliation(s)
- Izadyar Tamadon
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pontedera, Italy
| | - Yu Huan
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pontedera, Italy.,Center for Micro-BioRobotics, Istituto Italiano di Tecnologia, Pontedera, Italy
| | | | - Arianna Menciassi
- The BioRobotics Institute, Scuola Superiore Sant'Anna, Pontedera, Italy
| | - Edoardo Sinibaldi
- Center for Micro-BioRobotics, Istituto Italiano di Tecnologia, Pontedera, Italy
| |
Collapse
|
6
|
Low-Computational Cost Stitching Method in a Three-Eyed Endoscope. JOURNAL OF HEALTHCARE ENGINEERING 2019; 2019:5613931. [PMID: 31316742 PMCID: PMC6604418 DOI: 10.1155/2019/5613931] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/30/2018] [Revised: 03/01/2019] [Accepted: 04/24/2019] [Indexed: 02/03/2023]
Abstract
Aortic valve replacement is the only definitive treatment for aortic stenosis, a highly prevalent condition in elderly population. Minimally invasive surgery brought numerous benefits to this intervention, and robotics recently provided additional improvements in terms of telemanipulation, motion scaling, and smaller incisions. Difficulties in obtaining a clear and wide field of vision is a major challenge in minimally invasive aortic valve surgery: surgeon orientates with difficulty because of lack of direct view and limited spaces. This work focuses on the development of a computer vision methodology, for a three-eyed endoscopic vision system, to ease minimally invasive instrument guidance during aortic valve surgery. Specifically, it presents an efficient image stitching method to improve spatial awareness and overcome the orientation problems which arise when cameras are decentralized with respect to the main axis of the aorta and are nonparallel oriented. The proposed approach was tested for the navigation of an innovative robotic system for minimally invasive valve surgery. Based on the specific geometry of the setup and the intrinsic parameters of the three cameras, we estimate the proper plane-induced homographic transformation that merges the views of the operatory site plane into a single stitched image. To evaluate the deviation from the image correct alignment, we performed quantitative tests by stitching a chessboard pattern. The tests showed a minimum error with respect to the image size of 0.46 ± 0.15% measured at the homography distance of 40 mm and a maximum error of 6.09 ± 0.23% at the maximum offset of 10 mm. Three experienced surgeons in aortic valve replacement by mini-sternotomy and mini-thoracotomy performed experimental tests based on the comparison of navigation and orientation capabilities in a silicone aorta with and without stitched image. The tests showed that the stitched image allows for good orientation and navigation within the aorta, and furthermore, it provides more safety while releasing the valve than driving from the three separate views. The average processing time for the stitching of three views into one image is 12.6 ms, proving that the method is not computationally expensive, thus leaving space for further real-time processing.
Collapse
|