1
|
Muzzammil HM, Zhang YD, Ejaz H, Yuan Q, Muddassir M. A review on tissue-needle interaction and path planning models for bevel tip type flexible needle minimal intervention. MATHEMATICAL BIOSCIENCES AND ENGINEERING : MBE 2024; 21:523-561. [PMID: 38303433 DOI: 10.3934/mbe.2024023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/03/2024]
Abstract
A flexible needle has emerged as a crucial clinical technique in contemporary medical practices, particularly for minimally invasive interventions. Its applicability spans diverse surgical domains such as brachytherapy, cardiovascular surgery, neurosurgery and others. Notably, flexible needles find utility in biopsies requiring deep skin penetration to access infected areas. Despite its minimally invasive advantages, the precise guidance of the needle to its intended target, while avoiding damage to bones, blood vessels, organs and tissues, remains a significant challenge for researchers. Consequently, extensive research has been dedicated to enhancing the steering and accuracy of flexible needles. Here, we aim to elucidate the recent advancements, trends and perspectives in flexible needle steering models and path planning over the last 15 years. The discussed models encompass various types, including symmetric-tip needles, curved-tip needles, tendon-actuated needles, programmable needles and the innovative fracture-directed waterjet needles. Moreover, the paper offers a comprehensive analysis, comparing the trajectories followed by these needle models to attain the desired target with minimal tissue damage. By delving into these aspects, the paper contributes to a deeper understanding of the current landscape of flexible needle technology and guides future research directions in this dynamic field.
Collapse
Affiliation(s)
- Hafiz Muhammad Muzzammil
- Key Laboratory of Advanced Manufacturing and Intelligent Technology, Harbin University of Science and Technology, Harbin 150080, China
- Department of Mechanical and Aerospace Engineering, Air University, E-9, Islamabad, Pakistan
| | - Yong-De Zhang
- Key Laboratory of Advanced Manufacturing and Intelligent Technology, Harbin University of Science and Technology, Harbin 150080, China
| | - Hassan Ejaz
- Department of Mechanical and Aerospace Engineering, Air University, E-9, Islamabad, Pakistan
| | - Qihang Yuan
- Key Laboratory of Advanced Manufacturing and Intelligent Technology, Harbin University of Science and Technology, Harbin 150080, China
| | - Muhammad Muddassir
- Department of Mechanical and Aerospace Engineering, Air University, E-9, Islamabad, Pakistan
| |
Collapse
|
2
|
Yao T, Wang C, Wang X, Li X, Jiang Z, Qi P. Enhancing percutaneous coronary intervention with heuristic path planning and deep-learning-based vascular segmentation. Comput Biol Med 2023; 166:107540. [PMID: 37806060 DOI: 10.1016/j.compbiomed.2023.107540] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/22/2023] [Revised: 09/21/2023] [Accepted: 09/28/2023] [Indexed: 10/10/2023]
Abstract
Percutaneous coronary intervention (PCI) is a minimally invasive technique for treating vascular diseases. PCI requires precise and real-time visualization and guidance to ensure surgical safety and efficiency. Existing mainstream guiding methods rely on hemodynamic parameters. However, these methods are less intuitive than images and pose some challenges to the decision-making of cardiologists. This paper proposes a novel PCI guiding assistance system by combining a novel vascular segmentation network and a heuristic intervention path planning algorithm, providing cardiologists with clear and visualized information. A dataset of 1077 DSA images from 288 patients is also collected in clinical practice. A Likert Scale is also designed to evaluate system performance in user experiments. Results of user experiments demonstrate that the system can generate satisfactory and reasonable paths for PCI. Our proposed method outperformed the state-of-the-art baselines based on three metrics (Jaccard: 0.4091, F1: 0.5626, Accuracy: 0.9583). The proposed system can effectively assist cardiologists in PCI by providing a clear segmentation of vascular structures and optimal real-time intervention paths, thus demonstrating great potential for robotic PCI autonomy.
Collapse
Affiliation(s)
- Tianliang Yao
- College of Electronics and Information Engineering, Tongji University, Shanghai, 200092, China.
| | - Chengjia Wang
- School of Mathematical and Computer Sciences, Heriot-Watt University, Edinburgh, EH14 4AP, United Kingdom; BHF Centre for Cardiovascular Science,University of Edinburgh, Edinburgh, EH16 4TJ, United Kingdom.
| | - Xinyi Wang
- School of Medicine, Tongji University, Shanghai, 200092, China.
| | - Xiang Li
- Departments of Cardiology and Nursing, Shanghai Tenth People's Hospital, School of Medicine, Tongji University, Shanghai, 200072, China.
| | - Zhaolei Jiang
- Department of Cardiothoracic Surgery, Xinhua Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, Shanghai, 200092, China.
| | - Peng Qi
- College of Electronics and Information Engineering, Tongji University, Shanghai, 200092, China.
| |
Collapse
|
3
|
Li Z, Manzionna E, Monizzi G, Mastrangelo A, Mancini ME, Andreini D, Dankelman J, De Momi E. Position-based dynamics simulator of vessel deformations for path planning in robotic endovascular catheterization. Med Eng Phys 2022; 110:103920. [PMID: 36564143 DOI: 10.1016/j.medengphy.2022.103920] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2022] [Revised: 09/14/2022] [Accepted: 11/03/2022] [Indexed: 11/08/2022]
Abstract
A major challenge during autonomous navigation in endovascular interventions is the complexity of operating in a deformable but constrained workspace with an instrument. Simulation of deformations for it can provide a cost-effective training platform for path planning. Aim of this study is to develop a realistic, auto-adaptive, and visually plausible simulator to predict vessels' global deformation induced by the robotic catheter's contact and cyclic heartbeat motion. Based on a Position-based Dynamics (PBD) approach for vessel modeling, Particle Swarm Optimization (PSO) algorithm is employed for an auto-adaptive calibration of PBD deformation parameters and of the vessels movement due to a heartbeat. In-vitro experiments were conducted and compared with in-silico results. The end-user evaluation results were reported through quantitative performance metrics and a 5-Point Likert Scale questionnaire. Compared with literature, this simulator has an error of 0.23±0.13% for deformation and 0.30±0.85mm for the aortic root displacement. In-vitro experiments show an error of 1.35±1.38mm for deformation prediction. The end-user evaluation results show that novices are more accustomed to using joystick controllers, and cardiologists are more satisfied with the visual authenticity. The real-time and accurate performance of the simulator make this framework suitable for creating a dynamic environment for autonomous navigation of robotic catheters.
Collapse
Affiliation(s)
- Zhen Li
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Piazza Leonardo da Vinci 32, Milan 20133, Italy; Department of Biomechanical Engineering, Delft University of Technology, Mekelweg 2, CD Delft 2628, Netherlands.
| | - Enrico Manzionna
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Piazza Leonardo da Vinci 32, Milan 20133, Italy
| | | | | | | | - Daniele Andreini
- Centro Cardiologico Monzino, IRCCS, Milan, Italy; Department of Clinical Sciences and Community Health, University of Milan, Milan, Italy
| | - Jenny Dankelman
- Department of Biomechanical Engineering, Delft University of Technology, Mekelweg 2, CD Delft 2628, Netherlands
| | - Elena De Momi
- Department of Electronics, Information and Bioengineering, Politecnico di Milano, Piazza Leonardo da Vinci 32, Milan 20133, Italy
| |
Collapse
|
4
|
Autonomous Obstacle Avoidance Path Planning for Grasping Manipulator Based on Elite Smoothing Ant Colony Algorithm. Symmetry (Basel) 2022. [DOI: 10.3390/sym14091843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022] Open
Abstract
Assembly robots have become the core equipment of high-precision flexible automatic assembly systems with a small working range. Among different fields of robot technology, path planning is one of the most important branches. In the present study, an elite smoothing ant colony algorithm (ESACO) is proposed for spatial obstacle avoidance path planning of the grasping manipulator. In this regard, the state transition probability and pheromone update strategies are improved to enhance the search capability of path planning symmetry and the convergence of the algorithm. Then a segmented B-spline curve is presented to eliminate path folding points and generate a smooth path. Finally, a manipulator control system based on the Arduino Uno microcontroller is designed to drive the manipulator according to the planned trajectory. The experimental results show that the performance of the ESACO algorithm in different scenarios has symmetry advantages, and the manipulator can efficiently complete the simulation trajectory with high accuracy. The proposed algorithm provides a feasible scheme for the efficient planning of manipulators in equipment manufacturing workshops.
Collapse
|
5
|
Ghoreishi SF, Sochol RD, Gandhi D, Krieger A, Fuge M. Physics-Informed Modeling and Control of Multi-Actuator Soft Catheter Robots. Front Robot AI 2022; 8:772628. [PMID: 35096981 PMCID: PMC8795879 DOI: 10.3389/frobt.2021.772628] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2021] [Accepted: 11/09/2021] [Indexed: 11/13/2022] Open
Abstract
Catheter-based endovascular interventional procedures have become increasingly popular in recent years as they are less invasive and patients spend less time in the hospital with less recovery time and less pain. These advantages have led to a significant growth in the number of procedures that are performed annually. However, it is still challenging to position a catheter in a target vessel branch within the highly complicated and delicate vascular structure. In fact, vessel tortuosity and angulation, which cause difficulties in catheterization and reaching the target site, have been reported as the main causes of failure in endovascular procedures. Maneuverability of a catheter for intravascular navigation is a key to reaching the target area; ability of a catheter to move within the target vessel during trajectory tracking thus affects to a great extent the length and success of the procedure. To address this issue, this paper models soft catheter robots with multiple actuators and provides a time-dependent model for characterizing the dynamics of multi-actuator soft catheter robots. Built on this model, an efficient and scalable optimization-based framework is developed for guiding the catheter to pass through arteries and reach the target where an aneurysm is located. The proposed framework models the deflection of the multi-actuator soft catheter robot and develops a control strategy for movement of catheter along a desired trajectory. This provides a simulation-based framework for selection of catheters prior to endovascular catheterization procedures, assuring that given a fixed design, the catheter is able to reach the target location. The results demonstrate the benefits that can be achieved by design and control of catheters with multiple number of actuators for navigation into small vessels.
Collapse
Affiliation(s)
- Seyede Fatemeh Ghoreishi
- Department of Civil and Environmental Engineering and Khoury College of Computer Sciences, Northeastern University, Boston, MA, United States
| | - Ryan D. Sochol
- Department of Mechanical Engineering, University of Maryland, College Park, MD, United States
| | - Dheeraj Gandhi
- Department of Diagnostic Radiology and Nuclear Medicine, School of Medicine, University of Maryland, Baltimore, MD, United States
| | - Axel Krieger
- Department of Mechanical Engineering, Johns Hopkins University, Baltimore, MD, United States
| | - Mark Fuge
- Department of Mechanical Engineering, University of Maryland, College Park, MD, United States
| |
Collapse
|
6
|
Gumbs AA, Frigerio I, Spolverato G, Croner R, Illanes A, Chouillard E, Elyan E. Artificial Intelligence Surgery: How Do We Get to Autonomous Actions in Surgery? SENSORS (BASEL, SWITZERLAND) 2021; 21:5526. [PMID: 34450976 PMCID: PMC8400539 DOI: 10.3390/s21165526] [Citation(s) in RCA: 32] [Impact Index Per Article: 10.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 07/06/2021] [Revised: 08/03/2021] [Accepted: 08/11/2021] [Indexed: 12/30/2022]
Abstract
Most surgeons are skeptical as to the feasibility of autonomous actions in surgery. Interestingly, many examples of autonomous actions already exist and have been around for years. Since the beginning of this millennium, the field of artificial intelligence (AI) has grown exponentially with the development of machine learning (ML), deep learning (DL), computer vision (CV) and natural language processing (NLP). All of these facets of AI will be fundamental to the development of more autonomous actions in surgery, unfortunately, only a limited number of surgeons have or seek expertise in this rapidly evolving field. As opposed to AI in medicine, AI surgery (AIS) involves autonomous movements. Fortuitously, as the field of robotics in surgery has improved, more surgeons are becoming interested in technology and the potential of autonomous actions in procedures such as interventional radiology, endoscopy and surgery. The lack of haptics, or the sensation of touch, has hindered the wider adoption of robotics by many surgeons; however, now that the true potential of robotics can be comprehended, the embracing of AI by the surgical community is more important than ever before. Although current complete surgical systems are mainly only examples of tele-manipulation, for surgeons to get to more autonomously functioning robots, haptics is perhaps not the most important aspect. If the goal is for robots to ultimately become more and more independent, perhaps research should not focus on the concept of haptics as it is perceived by humans, and the focus should be on haptics as it is perceived by robots/computers. This article will discuss aspects of ML, DL, CV and NLP as they pertain to the modern practice of surgery, with a focus on current AI issues and advances that will enable us to get to more autonomous actions in surgery. Ultimately, there may be a paradigm shift that needs to occur in the surgical community as more surgeons with expertise in AI may be needed to fully unlock the potential of AIS in a safe, efficacious and timely manner.
Collapse
Affiliation(s)
- Andrew A. Gumbs
- Centre Hospitalier Intercommunal de POISSY/SAINT-GERMAIN-EN-LAYE 10, Rue Champ de Gaillard, 78300 Poissy, France;
| | - Isabella Frigerio
- Department of Hepato-Pancreato-Biliary Surgery, Pederzoli Hospital, 37019 Peschiera del Garda, Italy;
| | - Gaya Spolverato
- Department of Surgical, Oncological and Gastroenterological Sciences, University of Padova, 35122 Padova, Italy;
| | - Roland Croner
- Department of General-, Visceral-, Vascular- and Transplantation Surgery, University of Magdeburg, Haus 60a, Leipziger Str. 44, 39120 Magdeburg, Germany;
| | - Alfredo Illanes
- INKA–Innovation Laboratory for Image Guided Therapy, Medical Faculty, Otto-von-Guericke University Magdeburg, 39120 Magdeburg, Germany;
| | - Elie Chouillard
- Centre Hospitalier Intercommunal de POISSY/SAINT-GERMAIN-EN-LAYE 10, Rue Champ de Gaillard, 78300 Poissy, France;
| | - Eyad Elyan
- School of Computing, Robert Gordon University, Aberdeen AB10 7JG, UK;
| |
Collapse
|