1
|
Straathof R, Meijaard JP, van Vliet-Pérez SM, Kolkman-Deurloo IKK, Nout RA, Heijmen BJM, Wauben LSGL, Dankelman J, van de Berg NJ. Multibody dynamic modeling of the behavior of flexible instruments used in cervical cancer brachytherapy. Med Phys 2024; 51:3698-3710. [PMID: 38226798 DOI: 10.1002/mp.16934] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2022] [Revised: 10/24/2023] [Accepted: 12/09/2023] [Indexed: 01/17/2024] Open
Abstract
BACKGROUND The steep radiation dose gradients in cervical cancer brachytherapy (BT) necessitate a thorough understanding of the behavior of afterloader source cables or needles in the curved channels of (patient-tailored) applicators. PURPOSE The purpose of this study is to develop and validate computer models to simulate: (1) BT source positions, and (2) insertion forces of needles in curved applicator channels. The methodology presented can be used to improve the knowledge of instrument behavior in current applicators and aid the development of novel (3D-printed) BT applicators. METHODS For the computer models, BT instruments were discretized in finite elements. Simulations were performed in SPACAR by formulating nodal contact force and motion input models and specifying the instruments' kinematic and dynamic properties. To evaluate the source cable model, simulated source paths in ring applicators were compared with manufacturer-measured source paths. The impact of discrepancies on the dosimetry was estimated for standard plans. To validate needle models, simulated needle insertion forces in curved channels with varying curvature, torsion, and clearance, were compared with force measurements in dedicated 3D-printed templates. RESULTS Comparison of simulated with manufacturer-measured source positions showed 0.5-1.2 mm median and <2.0 mm maximum differences, in all but one applicator geometry. The resulting maximum relative dose differences at the lateral surface and at 5 mm depth were 5.5% and 4.7%, respectively. Simulated insertion forces for BT needles in curved channels accurately resembled the forces experimentally obtained by including experimental uncertainties in the simulation. CONCLUSION The models developed can accurately predict source positions and insertion forces in BT applicators. Insights from these models can aid novel applicator design with improved motion and force transmission of BT instruments, and contribute to the estimation of overall treatment precision. The methodology presented can be extended to study other applicator geometries, flexible instruments, and afterloading systems.
Collapse
Affiliation(s)
- Robin Straathof
- Department of BioMechanical Engineering, Delft University of Technology, Delft, the Netherlands
- Department of Radiotherapy, Erasmus MC Cancer Institute, University Medical Center Rotterdam, Rotterdam, the Netherlands
| | - Jaap P Meijaard
- Department of Precision and Microsystems Engineering, Delft University of Technology, Delft, the Netherlands
| | - Sharline M van Vliet-Pérez
- Department of BioMechanical Engineering, Delft University of Technology, Delft, the Netherlands
- Department of Radiotherapy, Erasmus MC Cancer Institute, University Medical Center Rotterdam, Rotterdam, the Netherlands
| | - Inger-Karine K Kolkman-Deurloo
- Department of Radiotherapy, Erasmus MC Cancer Institute, University Medical Center Rotterdam, Rotterdam, the Netherlands
| | - Remi A Nout
- Department of Radiotherapy, Erasmus MC Cancer Institute, University Medical Center Rotterdam, Rotterdam, the Netherlands
| | - Ben J M Heijmen
- Department of Radiotherapy, Erasmus MC Cancer Institute, University Medical Center Rotterdam, Rotterdam, the Netherlands
| | - Linda S G L Wauben
- Department of BioMechanical Engineering, Delft University of Technology, Delft, the Netherlands
| | - Jenny Dankelman
- Department of BioMechanical Engineering, Delft University of Technology, Delft, the Netherlands
| | - Nick J van de Berg
- Department of BioMechanical Engineering, Delft University of Technology, Delft, the Netherlands
- Department of Gynecological Oncology, Erasmus MC Cancer Institute, University Medical Center Rotterdam, Rotterdam, the Netherlands
| |
Collapse
|
2
|
Zhang Z, Shen J, Ha J, Chen Y. Toward Extending Concentric Tube Robot Kinematics for Large Clearance and Impulse Curvature. IEEE Robot Autom Lett 2024; 9:2407-2414. [PMID: 38912312 PMCID: PMC11189652 DOI: 10.1109/lra.2024.3351000] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/25/2024]
Abstract
Concentric Tube Robots (CTRs) have been proposed to operate within the unstructured environment for minimally invasive surgeries. In this letter, we consider the operation scenario where the tubes travel inside the channels with a large clearance or large curvature, such as aortas or industrial pipes. Accurate kinematic modeling of CTRs is required for the development of motion planning and control within these operation scenarios. To this end, we extended the conventional CTR kinematics model to a more general case with large tube-to-tube clearance and large centerline curvature. Numerical simulations and experimental validations are conducted to compare our model with respect to the conventional CTR kinematic model. In the physical experiments, our proposed model achieved a tip position error of 1.53 mm in the 2D planer case and 3.86 mm in 3D case, outperforming the state-of-the-art model by 71% and 61%, respectively.
Collapse
Affiliation(s)
- Zhouyu Zhang
- Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta 30332 USA
| | - Jia Shen
- Institute for Robotics and Intelligent Machines, Georgia Institute of Technology, Atlanta 30332 USA
| | - Junhyoung Ha
- Center for Healthcare Robotics, Artificial Intelligence and Robotics Institute, Korea Institute of Science and Technology, Seoul 02792, South Korea
| | - Yue Chen
- Institute for Robotics and Intelligent Machines and the Wallace H. Coulter Department of Biomedical Engineering, Georgia Institute of Technology/Emory University, Atlanta 30332 USA
| |
Collapse
|
3
|
Liu T, Zhang G, Zhang P, Cheng T, Luo Z, Wang S, Du F. Modeling of and Experimenting with Concentric Tube Robots: Considering Clearance, Friction and Torsion. SENSORS (BASEL, SWITZERLAND) 2023; 23:3709. [PMID: 37050768 PMCID: PMC10099042 DOI: 10.3390/s23073709] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 03/06/2023] [Revised: 03/29/2023] [Accepted: 03/31/2023] [Indexed: 06/19/2023]
Abstract
Concentric tube robots (CTRs) are a promising prospect for minimally invasive surgery due to their inherent compliance and ability to navigate in constrained environments. Existing mechanics-based kinematic models typically neglect friction, clearance, and torsion between each pair of contacting tubes, leading to large positioning errors in medical applications. In this paper, an improved kinematic modeling method is developed. The effect of clearance on tip position during concentric tube assembly is compensated by the database method. The new kinematic model is mechanic-based, and the impact of friction moment and torsion on tubes is considered. Integrating the infinitesimal torsion of the concentric tube robots eliminates the errors caused by the interaction force between the tubes. A prototype is built, and several experiments with kinematic models are designed. The results indicate that the error of tube rotations is less than 2 mm. The maximum error of the feeding experiment does not exceed 0.4 mm. The error of the new modeling method is lower than that of the previous kinematic model. This paper has substantial implications for the high-precision and real-time control of concentric tube robots.
Collapse
Affiliation(s)
- Tianxiang Liu
- School of Mechanical Engineering, Shandong University, Jinan 250061, China
- Key Laboratory of High-Efficiency and Clean Mechanical Manufacture of MOE, Shandong University, Jinan 250061, China
- Engineering Research Center of Intelligent Unmanned System, Ministry of Education, Jinan 250061, China
| | - Gang Zhang
- School of Mechanical Engineering, Shandong University, Jinan 250061, China
- Key Laboratory of High-Efficiency and Clean Mechanical Manufacture of MOE, Shandong University, Jinan 250061, China
- Engineering Research Center of Intelligent Unmanned System, Ministry of Education, Jinan 250061, China
| | - Peng Zhang
- School of Mechanical Engineering, Shandong University, Jinan 250061, China
- Key Laboratory of High-Efficiency and Clean Mechanical Manufacture of MOE, Shandong University, Jinan 250061, China
- Engineering Research Center of Intelligent Unmanned System, Ministry of Education, Jinan 250061, China
| | - Tianyu Cheng
- School of Mechanical Engineering, Shandong University, Jinan 250061, China
- Key Laboratory of High-Efficiency and Clean Mechanical Manufacture of MOE, Shandong University, Jinan 250061, China
- Engineering Research Center of Intelligent Unmanned System, Ministry of Education, Jinan 250061, China
| | - Zijie Luo
- School of Mechanical Engineering, Shandong University, Jinan 250061, China
- Key Laboratory of High-Efficiency and Clean Mechanical Manufacture of MOE, Shandong University, Jinan 250061, China
- Engineering Research Center of Intelligent Unmanned System, Ministry of Education, Jinan 250061, China
| | - Shengsong Wang
- Shandong Center for Food and Drug Evaluation & Inspection, Jinan 250014, China
| | - Fuxin Du
- School of Mechanical Engineering, Shandong University, Jinan 250061, China
- Key Laboratory of High-Efficiency and Clean Mechanical Manufacture of MOE, Shandong University, Jinan 250061, China
- Engineering Research Center of Intelligent Unmanned System, Ministry of Education, Jinan 250061, China
| |
Collapse
|
4
|
Robotic needle steering: state-of-the-art and research challenges. INTEL SERV ROBOT 2022. [DOI: 10.1007/s11370-022-00446-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
5
|
Learning Non-Parametric Models in Real Time via Online Generalized Product of Experts. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3190809] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
6
|
Dupont PE, Simaan N, Choset H, Rucker C. Continuum Robots for Medical Interventions. PROCEEDINGS OF THE IEEE. INSTITUTE OF ELECTRICAL AND ELECTRONICS ENGINEERS 2022; 110:847-870. [PMID: 35756186 PMCID: PMC9231641 DOI: 10.1109/jproc.2022.3141338] [Citation(s) in RCA: 26] [Impact Index Per Article: 8.7] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/01/2023]
Abstract
Continuum robots are not constructed with discrete joints but, instead, change shape and position their tip by flexing along their entire length. Their narrow curvilinear shape makes them well suited to passing through body lumens, natural orifices, or small surgical incisions to perform minimally invasive procedures. Modeling and controlling these robots are, however, substantially more complex than traditional robots comprised of rigid links connected by discrete joints. Furthermore, there are many approaches to achieving robot flexure. Each presents its own design and modeling challenges, and to date, each has been pursued largely independently of the others. This article attempts to provide a unified summary of the state of the art of continuum robot architectures with respect to design for specific clinical applications. It also describes a unifying framework for modeling and controlling these systems while additionally explaining the elements unique to each architecture. The major research accomplishments are described for each topic and directions for the future progress needed to achieve widespread clinical use are identified.
Collapse
Affiliation(s)
- Pierre E Dupont
- Department of Cardiovascular Surgery, Boston Children's Hospital, Harvard Medical School, Boston, MA 02115 USA
| | - Nabil Simaan
- Department of Mechanical Engineering, the Department of Computer Science, and the Department of Otolaryngology, Vanderbilt University, Nashville, TN 37235 USA
| | - Howie Choset
- Mechanical Engineering Department, the Biomedical Engineering Department, and the Robotics Institute, Carnegie Mellon, Pittsburgh, PA 15213 USA
| | - Caleb Rucker
- Department of Mechanical, Aerospace, and Biomedical Engineering, The University of Tennessee, Knoxville, TN 37996 USA
| |
Collapse
|
7
|
Yang H, Yang Z, Jin D, Su L, Chan KF, Chong KKL, Pang CP, Zhang L. Magnetic Micro-Driller System for Nasolacrimal Duct Recanalization. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3182105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Affiliation(s)
- Haojin Yang
- Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong
| | - Zhengxin Yang
- Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong
| | - Dongdong Jin
- Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong
| | - Lin Su
- Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong
| | - Kai-Fung Chan
- Chow Yuk Ho Technology Centre for Innovative Medicine, The Chinese University of Hong Kong, Hong Kong
| | - Kelvin Kam-Lung Chong
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong
| | - Chi Pui Pang
- Department of Ophthalmology and Visual Sciences, The Chinese University of Hong Kong, Hong Kong
| | - Li Zhang
- Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong(CUHK), Hong Kong
| |
Collapse
|
8
|
Han D, Zhang S, Zhang H. Artificial Intelligence Technologies and Their Application for Reform and Development of Table Tennis Training in Complex Environments. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:3442610. [PMID: 35747715 PMCID: PMC9213137 DOI: 10.1155/2022/3442610] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/07/2022] [Revised: 03/25/2022] [Accepted: 04/04/2022] [Indexed: 11/17/2022]
Abstract
The development of information technology has been deployed in almost all sectors and is making life easier. In this development, the sports sector has seen tremendous expansion. In traditional table tennis training, the coach and the players have to meet daily to take appropriate training for the game. This process is time-consuming in a complex environment, and it will have a significant impact on the reformation and development of table tennis training. The utilization of improved technologies can overcome this challenge by performing training of the game online with an intelligent wireless system with advanced training mechanisms. Carrying the traditional and heavier intelligent wireless devices will be difficult for the players. In this research, the fine-grained evaluation (FGE) system is incorporated into the deep learning model to analyze the player's body postures during the training and event sessions and make them develop after each session through online training in any circumstance. The proposed FGE was compared with the traditional statistical model, and it was observed that the proposed FGE had obtained higher precision and recall values of 70% and 98.9% than the statistical model.
Collapse
Affiliation(s)
- Dong Han
- Sports Teaching and Research Department, Jilin Business and Technology College, Changchun 130507, Jilin, China
| | - Shengtao Zhang
- Aeronautical Sports Department, Air Force Aviation University, Changchun 130000, Jilin, China
| | - Huanyu Zhang
- Aeronautical Sports Department, Air Force Aviation University, Changchun 130000, Jilin, China
| |
Collapse
|
9
|
Sadati SMH, Mitros Z, Henry R, Zeng L, Cruz LD, Bergeles C. Real-Time Dynamics of Concentric Tube Robots With Reduced-Order Kinematics Based on Shape Interpolation. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3151399] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/05/2022]
|
10
|
Rucker C, Childs J, Molaei P, Gilbert HB. Transverse Anisotropy Stabilizes Concentric Tube Robots. IEEE Robot Autom Lett 2022. [DOI: 10.1109/lra.2022.3140441] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
|
11
|
Abstract
This paper presents a novel continuum robot sheath for use in single-port minimally invasive procedures such as neuroendoscopy in which the sheath is designed to deliver multiple robotic arms. Actuation of the sheath is achieved by using precurved superelastic tubes lining the working channels used for arm delivery. These tubes perform a similar role to push/pull tendons, but can accomplish shape change of the sheath via rotation. A kinematic model using Cosserat rod theory is derived which is based on modeling the system as a set of eccentrically aligned precurved tubes constrained along their length by an elastic backbone. The specific case of a two-arm sheath is considered in detail. Simulation and experiments are used to investigate the validate the concept and model.
Collapse
Affiliation(s)
- Jiaole Wang
- School of Mechanical Engineering and Automation, Harbin Institute of Technology, Shenzhen 518055, China.,Department of Cardiovascular Surgery, Boston Children’s Hospital, Harvard Medical School, Boston, MA 02115, USA
| | - Joseph Peine
- Department of Cardiovascular Surgery, Boston Children’s Hospital, Harvard Medical School, Boston, MA 02115, USA
| | - Pierre E. Dupont
- Department of Cardiovascular Surgery, Boston Children’s Hospital, Harvard Medical School, Boston, MA 02115, USA
| |
Collapse
|
12
|
Girerd C, Morimoto TK. Design and Control of a Hand-Held Concentric Tube Robot for Minimally Invasive Surgery. IEEE T ROBOT 2021. [DOI: 10.1109/tro.2020.3043668] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
13
|
Target Tracking Algorithm for Table Tennis Using Machine Vision. JOURNAL OF HEALTHCARE ENGINEERING 2021; 2021:9961978. [PMID: 34094043 PMCID: PMC8137303 DOI: 10.1155/2021/9961978] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/28/2021] [Revised: 04/22/2021] [Accepted: 04/25/2021] [Indexed: 11/23/2022]
Abstract
The current table tennis robot system has two common problems. One is the table tennis ball speed, which moves fast, and it is difficult for the robot to react in a short time. The second is that the robot cannot recognize the type of the ball's movement, i.e., rotation, top rotation, no rotation, wait, etc. It is impossible to judge whether the ball is rotating and the direction of rotation, resulting in a single return strategy of the robot with poor adaptability. In this paper, these problems are solved by proposing a target trajectory tracking algorithm for table tennis using machine vision combined with Scaled Conjugate Gradient (SCG). Real human-machine game's data are obtained in the proposed algorithm by extracting ten continuous position information and speed information frames for feature selection. These features are used as input data for the deep neural network and then are normalized to create a deep neural network algorithm model. The model is trained by the position information of the successive 20 frames. During the initial sets of experiments, we found the shortcomings of the original SCG algorithm. By setting the accuracy threshold and offline learning of historical data and saving the hidden layer weight matrix, the SCG algorithm was improved. Finally, experiments verify the improved algorithm's feasibility and applicability and show that the proposed algorithm is more suitable for table tennis robots.
Collapse
|
14
|
Renda F, Messer C, Rucker C, Boyer F. A Sliding-Rod Variable-Strain Model for Concentric Tube Robots. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3063704] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
15
|
Till J, Aloi V, Riojas KE, Anderson PL, Webster RJ, Rucker C. A Dynamic Model for Concentric Tube Robots. IEEE T ROBOT 2021; 36:1704-1718. [PMID: 33603591 DOI: 10.1109/tro.2020.3000290] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
Existing static and kinematic models of concentric tube robots are based on the ordinary differential equations of a static Cosserat rod. In this paper, we provide the first dynamic model for concentric tube continuum robots by adapting the partial differential equations of a dynamic Cosserat rod to describe the coupled inertial dynamics of precurved concentric tubes. This generates an initial-boundary-value problem that can capture robot vibrations over time. We solve this model numerically at high time resolutions using implicit finite differences in time and arc length. This approach is capable of resolving the high-frequency torsional dynamics that occur during unstable "snapping" motions and provides a simulation tool that can track the true robot configuration through such transitions. Further, it can track slower oscillations associated with bending and torsion as a robot interacts with tissue at real-time speeds. Experimental verification of the model shows that this wide range of effects is captured efficiently and accurately.
Collapse
Affiliation(s)
- John Till
- Department of Mechanical, Aerospace, and Biomedical Engineering, The University of Tennessee, Knoxville, TN
| | - Vincent Aloi
- Department of Mechanical, Aerospace, and Biomedical Engineering, The University of Tennessee, Knoxville, TN
| | - Katherine E Riojas
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37235 USA
| | - Patrick L Anderson
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37235 USA
| | - Robert J Webster
- Department of Mechanical Engineering, Vanderbilt University, Nashville, TN 37235 USA
| | - Caleb Rucker
- Department of Mechanical, Aerospace, and Biomedical Engineering, The University of Tennessee, Knoxville, TN
| |
Collapse
|
16
|
Alfalahi H, Renda F, Stefanini C. Concentric Tube Robots for Minimally Invasive Surgery: Current Applications and Future Opportunities. ACTA ACUST UNITED AC 2020. [DOI: 10.1109/tmrb.2020.3000899] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
17
|
Childs JA, Rucker C. Concentric Precurved Bellows: New Bending Actuators for Soft Robots. IEEE Robot Autom Lett 2020. [DOI: 10.1109/lra.2020.2967323] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
|
18
|
Rosa B, Bordoux V, Nageotte F. Combining Differential Kinematics and Optical Flow for Automatic Labeling of Continuum Robots in Minimally Invasive Surgery. Front Robot AI 2019; 6:86. [PMID: 33501101 PMCID: PMC7805658 DOI: 10.3389/frobt.2019.00086] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2019] [Accepted: 08/26/2019] [Indexed: 11/13/2022] Open
Abstract
The segmentation of continuum robots in medical images can be of interest for analyzing surgical procedures or for controlling them. However, the automatic segmentation of continuous and flexible shapes is not an easy task. On one hand conventional approaches are not adapted to the specificities of these instruments, such as imprecise kinematic models, and on the other hand techniques based on deep-learning showed interesting capabilities but need many manually labeled images. In this article we propose a novel approach for segmenting continuum robots on endoscopic images, which requires no prior on the instrument visual appearance and no manual annotation of images. The method relies on the use of the combination of kinematic models and differential kinematic models of the robot and the analysis of optical flow in the images. A cost function aggregating information from the acquired image, from optical flow and from robot encoders is optimized using particle swarm optimization and provides estimated parameters of the pose of the continuum instrument and a mask defining the instrument in the image. In addition a temporal consistency is assessed in order to improve stochastic optimization and reject outliers. The proposed approach has been tested for the robotic instruments of a flexible endoscopy platform both for benchtop acquisitions and an in vivo video. The results show the ability of the technique to correctly segment the instruments without a prior, and in challenging conditions. The obtained segmentation can be used for several applications, for instance for providing automatic labels for machine learning techniques.
Collapse
Affiliation(s)
- Benoît Rosa
- ICube, CNRS, University of Strasbourg, INSA, Strasbourg, France
| | | | | |
Collapse
|