1
|
Yamasaki Y, Tokunaga M, Sakai Y, Kayasuga H, Nishihara T, Tadano K, Kawashima K, Haruki S, Kinugasa Y. Effects of a force feedback function in a surgical robot on the suturing procedure. Surg Endosc 2024; 38:1222-1229. [PMID: 38092971 DOI: 10.1007/s00464-023-10617-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/01/2023] [Accepted: 11/26/2023] [Indexed: 02/23/2024]
Abstract
BACKGROUND Currently, widely used robotic surgical systems do not provide force feedback. This study aimed to evaluate the impact and benefits of a force feedback function on the suturing procedure. METHODS Twenty surgeons were recruited and divided into young (Y-group, n = 11) and senior (S-group, n = 9) groups, based on their years of surgical experience. The effect of the force feedback function on suturing quality was evaluated using an objective assessment system (A-LAP mini, Kyoto Kagaku Co., Ltd., Kyoto, Japan). Each participant completed the suturing task on intestinal model sheets with the robotic contact force feedback on and off. The task accomplishment time (s), maximal force (Newton, N) applied to the robotic forceps, and quality of suturing (assessed by A-LAP mini) were recorded as performance parameters. RESULTS In total, the maximal force applied to the robotic forceps was significantly decreased with the robotic force feedback switched on (median [interquartile range]: 2.8 N (2.3-3.2)) as compared with when the feedback was switched off (3.4 N (2.7-4.0), P < 0.001). The contact force feedback function did not affect the objectively assessed suturing score (18 points (17.7-19.0) versus 18 points (17.0-19.0), P = 0.421). The contact force feedback function slightly shortened the task accomplishment time in the Y-group (552.5 s (466.5-832) versus 605.5 s (476.2-689.7), P = 0.851) but not in the S-group (566 s (440.2-703.5) versus 470.5 s (419.7-560.2), P = 0.164). CONCLUSIONS With the contact force feedback function, the suturing task was completed with a smaller maximal force, while maintaining the quality of suturing. Because the benefits are more apparent in young surgeons, robots with the contact force feedback function will facilitate the educational process in novice surgeons.
Collapse
Affiliation(s)
- Yoshimi Yamasaki
- Department of Gastrointestinal Surgery, Graduate School of Medicine, Tokyo Medical and Dental University, 1-5-45 Yushima, Bunkyo-ku, Tokyo, 113-8510, Japan
| | - Masanori Tokunaga
- Department of Gastrointestinal Surgery, Graduate School of Medicine, Tokyo Medical and Dental University, 1-5-45 Yushima, Bunkyo-ku, Tokyo, 113-8510, Japan.
| | - Yoshihiro Sakai
- Department of Gastrointestinal Surgery, Graduate School of Medicine, Tokyo Medical and Dental University, 1-5-45 Yushima, Bunkyo-ku, Tokyo, 113-8510, Japan
| | | | | | | | | | - Shigeo Haruki
- Department of Gastrointestinal Surgery, Graduate School of Medicine, Tokyo Medical and Dental University, 1-5-45 Yushima, Bunkyo-ku, Tokyo, 113-8510, Japan
| | - Yusuke Kinugasa
- Department of Gastrointestinal Surgery, Graduate School of Medicine, Tokyo Medical and Dental University, 1-5-45 Yushima, Bunkyo-ku, Tokyo, 113-8510, Japan
| |
Collapse
|
2
|
Bergholz M, Ferle M, Weber BM. The benefits of haptic feedback in robot assisted surgery and their moderators: a meta-analysis. Sci Rep 2023; 13:19215. [PMID: 37932393 PMCID: PMC10628231 DOI: 10.1038/s41598-023-46641-8] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2023] [Accepted: 11/03/2023] [Indexed: 11/08/2023] Open
Abstract
Robot assisted surgery (RAS) provides medical practitioners with valuable tools, decreasing strain during surgery and leading to better patient outcomes. While the loss of haptic sensation is a commonly cited disadvantage of RAS, new systems aim to address this problem by providing artificial haptic feedback. N = 56 papers that compared robotic surgery systems with and without haptic feedback were analyzed to quantify the performance benefits of restoring the haptic modality. Additionally, this study identifies factors moderating the effect of restoring haptic sensation. Overall results showed haptic feedback was effective in reducing average forces (Hedges' g = 0.83) and peak forces (Hedges' g = 0.69) applied during surgery, as well as reducing the completion time (Hedges' g = 0.83). Haptic feedback has also been found to lead to higher accuracy (Hedges' g = 1.50) and success rates (Hedges' g = 0.80) during surgical tasks. Effect sizes on several measures varied between tasks, the type of provided feedback, and the subjects' levels of surgical expertise, with higher levels of expertise generally associated with smaller effect sizes. No significant differences were found between virtual fixtures and rendering contact forces. Implications for future research are discussed.
Collapse
Affiliation(s)
- Max Bergholz
- Department of Ergonomics, Technical University of Munich, 85748, Garching, Germany
- Institute of Robotics and Mechatronics, German Aerospace Center, 82234, Wessling, Germany
| | - Manuel Ferle
- Department of Ergonomics, Technical University of Munich, 85748, Garching, Germany.
| | - Bernhard M Weber
- Institute of Robotics and Mechatronics, German Aerospace Center, 82234, Wessling, Germany
| |
Collapse
|
3
|
Oppici L, Grütters K, Bechtolsheim F, Speidel S. How does the modality of delivering force feedback influence the performance and learning of surgical suturing skills? We don’t know, but we better find out! A review. Surg Endosc 2022; 37:2439-2452. [PMID: 36303044 PMCID: PMC10082114 DOI: 10.1007/s00464-022-09740-7] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/09/2022] [Accepted: 10/14/2022] [Indexed: 11/26/2022]
Abstract
Abstract
Background
Force feedback is a critical element for performing and learning surgical suturing skill. Force feedback is impoverished or not present at all in non-open surgery (i.e., in simulation, laparoscopic, and robotic-assisted surgery), but it can be augmented using different modalities. This rapid, systematic review examines how the modality of delivering force feedback influences the performance and learning of surgical suturing skills.
Methods
An electronic search was performed on PubMed/MEDLINE, Web of Science, and Embase databases to identify relevant articles. The results were synthesized using vote counting based on direction of effect.
Results
A total of nine studies of medium-to-low quality were included. The synthesis of results suggests that the visual modality could be more beneficial than the tactile and auditory modalities in improving force control and that auditory and tactile modalities could be more beneficial than the visual modality in improving suturing performance. Results are mixed and unclear with regards to how modality affects the reduction of force magnitude and unclear when unimodal was compared to multimodal feedback. The studies have a general low level of evidence.
Conclusion
The low number of studies with low methodological quality and low level of evidence (most were proof of concept) prevents us from drawing any meaningful conclusion and as such it is currently unknown whether and how force feedback modality influences surgical suturing skill. Speculatively, the visual modality may be more beneficial for improving the control of exerted force, while auditory and tactile modalities may be more effective in improving the overall suturing performance. We consider the issue of feedback modality to be highly relevant in this field, and we encourage future research to conduct further investigation integrating principles from learning psychology and neuroscience: identify feedback goal, context, and skill level and then design and compare feedback modalities accordingly.
Collapse
Affiliation(s)
- Luca Oppici
- Psychology of Learning and Instruction, Department of Psychology, School of Science, Technische Universität Dresden, Zellescher Weg 17, 01069, Dresden, Germany.
- Centre for Tactile Internet with Human-in-the-Loop (CeTI), Technische Universität Dresden, Dresden, Germany.
- Norwegian School of Sport Sciences, Oslo, Norway.
| | - Kim Grütters
- Psychology of Learning and Instruction, Department of Psychology, School of Science, Technische Universität Dresden, Zellescher Weg 17, 01069, Dresden, Germany
| | - Felix Bechtolsheim
- Centre for Tactile Internet with Human-in-the-Loop (CeTI), Technische Universität Dresden, Dresden, Germany
- Department of Visceral, Thoracic- and Vascular Surgery, University Hospital Carl Gustav Carus, Technische Universität Dresden, Dresden, Germany
| | - Stefanie Speidel
- Centre for Tactile Internet with Human-in-the-Loop (CeTI), Technische Universität Dresden, Dresden, Germany
- Division of Translational Surgical Oncology, National Center for Tumor Diseases Dresden, Dresden, Germany
| |
Collapse
|
4
|
Ehrampoosh A, Shirinzadeh B, Pinskier J, Smith J, Moshinsky R, Zhong Y. A Force-Feedback Methodology for Teleoperated Suturing Task in Robotic-Assisted Minimally Invasive Surgery. SENSORS (BASEL, SWITZERLAND) 2022; 22:s22207829. [PMID: 36298180 PMCID: PMC9609411 DOI: 10.3390/s22207829] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/01/2022] [Revised: 09/30/2022] [Accepted: 10/11/2022] [Indexed: 06/12/2023]
Abstract
With robotic-assisted minimally invasive surgery (RAMIS), patients and surgeons benefit from a reduced incision size and dexterous instruments. However, current robotic surgery platforms lack haptic feedback, which is an essential element of safe operation. Moreover, teleportation control challenges make complex surgical tasks like suturing more time-consuming than those that use manual tools. This paper presents a new force-sensing instrument that semi-automates the suturing task and facilitates teleoperated robotic manipulation. In order to generate the ideal needle insertion trajectory and pass the needle through its curvature, the end-effector mechanism has a rotating degree of freedom. Impedance control was used to provide sensory information about needle-tissue interaction forces to the operator using an indirect force estimation approach based on data-based models. The operator's motion commands were then regulated using a hyperplanar virtual fixture (VF) designed to maintain the desired distance between the end-effector and tissue surface while avoiding unwanted contact. To construct the geometry of the VF, an optoelectronic sensor-based approach was developed. Based on the experimental investigation of the hyperplane VF methodology, improved needle-tissue interaction force, manipulation accuracy, and task completion times were demonstrated. Finally, experimental validation of the trained force estimation models and the perceived interaction forces by the user was conducted using online data, demonstrating the potential of the developed approach in improving task performance.
Collapse
Affiliation(s)
- Armin Ehrampoosh
- Robotics and Mechatronics Research Laboratory (RMRL), Department of Mechanical and Aerospace Engineering, Monash University, Melbourne, VIC 3800, Australia
| | - Bijan Shirinzadeh
- Robotics and Mechatronics Research Laboratory (RMRL), Department of Mechanical and Aerospace Engineering, Monash University, Melbourne, VIC 3800, Australia
| | | | - Julian Smith
- Department of Surgery, Monash University, Melbourne, VIC 3800, Australia
| | - Randall Moshinsky
- Department of Surgery, Monash University, Melbourne, VIC 3800, Australia
| | - Yongmin Zhong
- Department of Mechanical and Automotive Engineering, RMIT University, Melbourne, VIC 3083, Australia
| |
Collapse
|
5
|
Cabibihan JJ, Alhaddad AY, Gulrez T, Yoon WJ. Influence of Visual and Haptic Feedback on the Detection of Threshold Forces in a Surgical Grasping Task. IEEE Robot Autom Lett 2021. [DOI: 10.1109/lra.2021.3068934] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
6
|
Li S, Cao G, Zhou R, Zhang X, Zhou Y, Tang ST. Feasible techniques in robotic thoracoscopic repair of congenital esophageal atresia: case report and literature review. Surg Case Rep 2021; 7:142. [PMID: 34150469 PMCID: PMC8205192 DOI: 10.1186/s40792-021-01229-0] [Citation(s) in RCA: 6] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2021] [Accepted: 06/06/2021] [Indexed: 11/10/2022] Open
Abstract
Background Robotic repair for esophageal atresia (EA) using da Vinci system is challenging. Specific surgical techniques need to be explored to overcome the current hurdles. Case presentation Two cases with EA (type I and type III by Gross classification, respectively) were repaired using da Vinci robotic system. Step trocar insertion and asymmetric ports distribution techniques were used. The mean weight was 3.2 kg. Operative times were 95 min totally, with the anastomotic time of 27.5 min. Follow-up duration was 12 months. Esophageal fistula reoccurred in one case. None was confirmed anastomotic stricture. Conclusion Step trocar insertion procedure and asymmetric ports distribution technique are effective in robotic esophageal atresia.
Collapse
Affiliation(s)
- Shuai Li
- Department of Pediatric Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, 1277 Jie Fang Avenue, Wuhan, 430022 China
| | - Guoqing Cao
- Department of Pediatric Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, 1277 Jie Fang Avenue, Wuhan, 430022 China
| | - Rongchao Zhou
- Operation Room, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, Wuhan, 430022 China
| | - Xi Zhang
- Department of Pediatric Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, 1277 Jie Fang Avenue, Wuhan, 430022 China
| | - Ying Zhou
- Department of Pediatric Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, 1277 Jie Fang Avenue, Wuhan, 430022 China
| | - Shao-Tao Tang
- Department of Pediatric Surgery, Union Hospital, Tongji Medical College, Huazhong University of Science and Technology, 1277 Jie Fang Avenue, Wuhan, 430022 China
| |
Collapse
|
7
|
Feizi N, Tavakoli M, Patel RV, Atashzar SF. Robotics and AI for Teleoperation, Tele-Assessment, and Tele-Training for Surgery in the Era of COVID-19: Existing Challenges, and Future Vision. Front Robot AI 2021; 8:610677. [PMID: 33937347 PMCID: PMC8079974 DOI: 10.3389/frobt.2021.610677] [Citation(s) in RCA: 17] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/26/2020] [Accepted: 01/18/2021] [Indexed: 12/18/2022] Open
Abstract
The unprecedented shock caused by the COVID-19 pandemic has severely influenced the delivery of regular healthcare services. Most non-urgent medical activities, including elective surgeries, have been paused to mitigate the risk of infection and to dedicate medical resources to managing the pandemic. In this regard, not only surgeries are substantially influenced, but also pre- and post-operative assessment of patients and training for surgical procedures have been significantly impacted due to the pandemic. Many countries are planning a phased reopening, which includes the resumption of some surgical procedures. However, it is not clear how the reopening safe-practice guidelines will impact the quality of healthcare delivery. This perspective article evaluates the use of robotics and AI in 1) robotics-assisted surgery, 2) tele-examination of patients for pre- and post-surgery, and 3) tele-training for surgical procedures. Surgeons interact with a large number of staff and patients on a daily basis. Thus, the risk of infection transmission between them raises concerns. In addition, pre- and post-operative assessment also raises concerns about increasing the risk of disease transmission, in particular, since many patients may have other underlying conditions, which can increase their chances of mortality due to the virus. The pandemic has also limited the time and access that trainee surgeons have for training in the OR and/or in the presence of an expert. In this article, we describe existing challenges and possible solutions and suggest future research directions that may be relevant for robotics and AI in addressing the three tasks mentioned above.
Collapse
Affiliation(s)
- Navid Feizi
- Canadian Surgical Technologies and Advanced Robotics (CSTAR), London Health Sciences Centre, and School of Biomedical Engineering, University of Western Ontario, London, ON, Canada
| | - Mahdi Tavakoli
- Department of Electrical and Computer Engineering, University of Alberta, Edmonton, AB, Canada
| | - Rajni V. Patel
- Canadian Surgical Technologies and Advanced Robotics (CSTAR), London Health Sciences Centre, and School of Biomedical Engineering, University of Western Ontario, London, ON, Canada
- Department of Electrical and Computer Engineering, University of Western Ontario, London, ON, Canada
- Department of Surgery, University of Western Ontario, London, ON, Canada
| | - S. Farokh Atashzar
- Department of Electrical and Computer Engineering, New York University, New York, NY, United States
- Department of Mechanical and Aerospace Engineering, New York University, New York, NY, United States
| |
Collapse
|
8
|
Abdi E, Kulic D, Croft E. Haptics in Teleoperated Medical Interventions: Force Measurement, Haptic Interfaces and Their Influence on User's Performance. IEEE Trans Biomed Eng 2020; 67:3438-3451. [PMID: 32305890 DOI: 10.1109/tbme.2020.2987603] [Citation(s) in RCA: 14] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
OBJECTIVES Haptics in teleoperated medical interventions enables measurement and transfer of force information to the operator during robot-environment interaction. This paper provides an overview of the current research in this domain and guidelines for future investigations. METHODS We review current technologies in force measurement and haptic devices as well as their experimental evaluation and influence on user's performance. RESULTS Force sensing is moving away from the conventional proximal measurement methods to distal sensing and contact-less methods. Wearable devices that deliver haptic feedback on different body parts are increasingly playing an important role. Performance and accuracy improvement are the widely reported benefits of haptic feedback, while there is a debate on its effect on task completion time and exerted force. CONCLUSION With the surge of new ideas, there is a need for better and more systematic validation of the new sensing and feedback technology, through better user studies and novel methods like validated benchmarks and new taxonomies. SIGNIFICANCE This review investigates haptics from sensing to interfaces within the context of user's performance and the validation procedures to highlight salient advances. It provides guidelines to future developments and highlights the shortcomings in the field.
Collapse
|
9
|
Bahar L, Sharon Y, Nisky I. Surgeon-Centered Analysis of Robot-Assisted Needle Driving Under Different Force Feedback Conditions. Front Neurorobot 2020; 13:108. [PMID: 32038218 PMCID: PMC6993204 DOI: 10.3389/fnbot.2019.00108] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/30/2019] [Accepted: 12/06/2019] [Indexed: 11/24/2022] Open
Abstract
Robotic assisted minimally invasive surgery (RAMIS) systems present many advantages to the surgeon and patient over open and standard laparoscopic surgery. However, haptic feedback, which is crucial for the success of many surgical procedures, is still an open challenge in RAMIS. Understanding the way that haptic feedback affects performance and learning can be useful in the development of haptic feedback algorithms and teleoperation control systems. In this study, we examined the performance and learning of inexperienced participants under different haptic feedback conditions in a task of surgical needle driving via a soft homogeneous deformable object-an artificial tissue. We designed an experimental setup to characterize their movement trajectories and the forces that they applied on the artificial tissue. Participants first performed the task in an open condition, with a standard surgical needle holder, followed by teleoperation in one of three feedback conditions: (1) no haptic feedback, (2) haptic feedback based on position exchange, and (3) haptic feedback based on direct recording from a force sensor, and then again with the open needle holder. To quantify the effect of different force feedback conditions on the quality of needle driving, we developed novel metrics that assess the kinematics of needle driving and the tissue interaction forces, and we combined our novel metrics with classical metrics. We analyzed the final teleoperated performance in each condition, the improvement during teleoperation, and the aftereffect of teleoperation on the performance when using the open needle driver. We found that there is no significant difference in the final performance and in the aftereffect between the 3 conditions. Only the two conditions with force feedback presented statistically significant improvement during teleoperation in several of the metrics, but when we compared directly between the improvements in the three different feedback conditions none of the effects reached statistical significance. We discuss possible explanations for the relative similarity in performance. We conclude that we developed several new metrics for the quality of surgical needle driving, but even with these detailed metrics, the advantage of state of the art force feedback methods to tasks that require interaction with homogeneous soft tissue is questionable.
Collapse
Affiliation(s)
| | | | - Ilana Nisky
- Department of Biomedical Engineering, Zlotowski Center of Neuroscience, Ben-Gurion University of the Negev, Be'er Sheva, Israel
| |
Collapse
|
10
|
Yu YL, Lan CC. Design of a Miniature Series Elastic Actuator for Bilateral Teleoperations Requiring Accurate Torque Sensing and Control. IEEE Robot Autom Lett 2019. [DOI: 10.1109/lra.2019.2891287] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|