Evaluating tactile feedback in robotic surgery for potential clinical application using an animal model

Biosymbiotic haptic feedback - Sustained long term human machine interfaces

Haptic technology permeates diverse fields and is receiving renewed attention for VR and AR applications. Advances in flexible electronics, facilitate the integration of haptic technologies into soft wearable systems, however, because of small footprint requirements face challenges of operational time requiring either large batteries, wired connections or frequent recharge, restricting the utility of haptic devices to short-duration tasks or low duty cycles, prohibiting continuously assisting applications. Currently many chronic applications are not investigated because of this technological gap. Here, we address wireless power and operation challenges with a biosymbiotic approach enabling continuous operation without user intervention, facilitated by wireless power transfer, eliminating the need for large batteries, and offering long-term haptic feedback without adhesive attachment to the body. These capabilities enable haptic feedback for robotic surgery training and posture correction over weeks of use with neural net computation. The demonstrations showcase that this device class expands use beyond conventional brick and strap or epidermally attached devices enabling new fields of use for imperceptible therapeutic and assistive haptic technologies supporting care and disease management.

Robotic versus open and laparoscopic pelvic exenterations for pelvic cancer: a multicenter propensity-matched analysis in Japan

BACKGROUND

Pelvic exenteration (PE) is the last resort for achieving a complete cure for pelvic cancer; however, it is burdensome for patients. Minimally invasive surgeries, including robot-assisted surgery, have been widely used to treat malignant tumors and have also recently been used in PE. This study aimed to evaluate the safety and efficacy of robot-assisted PE (RPE) by comparing the outcomes of open PE (OPE) with those of conventional laparoscopic PE (LPE) for treating pelvic tumors.

METHODS

Following the ethics committee approval, a multicenter retrospective analysis of patients who underwent pelvic exenteration between January 2012 and October 2022 was conducted. Data on patient demographics, tumor characteristics, and perioperative outcomes were collected. A 1:1 propensity score-matched analysis was performed to minimize group selection bias.

RESULTS

In total, 261 patients met the study criteria, of whom 61 underwent RPE, 90 underwent OPE, and 110 underwent LPE. After propensity score matching, 50 pairs were created for RPE and OPE and 59 for RPE and LPE. RPE was associated with significantly less blood loss (RPE vs. OPE: 408 mL vs. 2385 ml, p < 0.001), lower transfusion rate (RPE vs. OPE: 32% vs. 82%, p < 0.001), and lower rate of complications over Clavien-Dindo grade II (RPE vs. OPE: 48% vs. 74%, p = 0.013; RPE vs. LPE: 48% vs. 76%, p = 0.002).

CONCLUSION

This multicenter study suggests that RPE reduces blood loss and transfusion compared with OPE and has a lower rate of complications compared with OPE and LPE in patients with locally advanced and recurrent pelvic tumors.

The development of tissue handling skills is sufficient and comparable after training in virtual reality or on a surgical robotic system: a prospective randomized trial

BACKGROUND

Virtual reality is a frequently chosen method for learning the basics of robotic surgery. However, it is unclear whether tissue handling is adequately trained in VR training compared to training on a real robotic system.

METHODS

In this randomized controlled trial, participants were split into two groups for "Fundamentals of Robotic Surgery (FRS)" training on either a DaVinci VR simulator (VR group) or a DaVinci robotic system (Robot group). All participants completed four tasks on the DaVinci robotic system before training (Baseline test), after proficiency in three FRS tasks (Midterm test), and after proficiency in all FRS tasks (Final test). Primary endpoints were forces applied across tests.

RESULTS

This trial included 87 robotic novices, of which 43 and 44 participants received FRS training in VR group and Robot group, respectively. The Baseline test showed no significant differences in force application between the groups indicating a sufficient randomization. In the Midterm and Final test, the force application was not different between groups. Both groups displayed sufficient learning curves with significant improvement of force application. However, the Robot group needed significantly less repetitions in the three FRS tasks Ring tower (Robot: 2.48 vs. VR: 5.45; p < 0.001), Knot Tying (Robot: 5.34 vs. VR: 8.13; p = 0.006), and Vessel Energy Dissection (Robot: 2 vs. VR: 2.38; p = 0.001) until reaching proficiency.

CONCLUSION

Robotic tissue handling skills improve significantly and comparably after both VR training and training on a real robotic system, but training on a VR simulator might be less efficient.

Vision-based estimation of manipulation forces by deep learning of laparoscopic surgical images obtained in a porcine excised kidney experiment

In robot-assisted surgery, in which haptics should be absent, surgeons experience haptics-like sensations as "pseudo-haptic feedback". As surgeons who routinely perform robot-assisted laparoscopic surgery, we wondered if we could make these "pseudo-haptics" explicit to surgeons. Therefore, we created a simulation model that estimates manipulation forces using only visual images in surgery. This study aimed to achieve vision-based estimations of the magnitude of forces during forceps manipulation of organs. We also attempted to detect over-force, exceeding the threshold of safe manipulation. We created a sensor forceps that can detect precise pressure at the tips with three vectors. Using an endoscopic system that is used in actual surgery, images of the manipulation of excised pig kidneys were recorded with synchronized force data. A force estimation model was then created using deep learning. Effective detection of over-force was achieved if the region of the visual images was restricted by the region of interest around the tips of the forceps. In this paper, we emphasize the importance of limiting the region of interest in vision-based force estimation tasks.

Robotic surgery for deep-infiltrating endometriosis: is it time to take a step forward?

Endometriosis is a chronic debilitating disease that affects nearly 10% of women of the reproductive age. Although the treatment modalities of endometriosis are numerous, surgical excision of the endometriotic implants and nodules remains the sole cytoreductive approach. Laparoscopic excision of endometriosis was proven to be beneficial in improving the postoperative pain and fertility. Moreover, it was also proved to be safe and efficient in treating the visceral localization of deep endometriosis, such as urinary and colorectal endometriosis. More recently, robotic-assisted surgery gained attention in the field of endometriosis surgery. Although the robotic technology provides a 3D vision of the surgical field and 7-degree of freedom motion, the safety, efficacy, and cost-effectiveness of this approach are yet to be determined. With this paper, we aim to review the available evidence regarding the role of robotic surgery in the management of endometriosis along with the current practices in the field.

Effects of a force feedback function in a surgical robot on the suturing procedure

BACKGROUND

Currently, widely used robotic surgical systems do not provide force feedback. This study aimed to evaluate the impact and benefits of a force feedback function on the suturing procedure.

METHODS

Twenty surgeons were recruited and divided into young (Y-group, n = 11) and senior (S-group, n = 9) groups, based on their years of surgical experience. The effect of the force feedback function on suturing quality was evaluated using an objective assessment system (A-LAP mini, Kyoto Kagaku Co., Ltd., Kyoto, Japan). Each participant completed the suturing task on intestinal model sheets with the robotic contact force feedback on and off. The task accomplishment time (s), maximal force (Newton, N) applied to the robotic forceps, and quality of suturing (assessed by A-LAP mini) were recorded as performance parameters.

RESULTS

In total, the maximal force applied to the robotic forceps was significantly decreased with the robotic force feedback switched on (median [interquartile range]: 2.8 N (2.3-3.2)) as compared with when the feedback was switched off (3.4 N (2.7-4.0), P < 0.001). The contact force feedback function did not affect the objectively assessed suturing score (18 points (17.7-19.0) versus 18 points (17.0-19.0), P = 0.421). The contact force feedback function slightly shortened the task accomplishment time in the Y-group (552.5 s (466.5-832) versus 605.5 s (476.2-689.7), P = 0.851) but not in the S-group (566 s (440.2-703.5) versus 470.5 s (419.7-560.2), P = 0.164).

CONCLUSIONS

With the contact force feedback function, the suturing task was completed with a smaller maximal force, while maintaining the quality of suturing. Because the benefits are more apparent in young surgeons, robots with the contact force feedback function will facilitate the educational process in novice surgeons.

Comparison of senhance and da vinci robotic radical prostatectomy: short-term outcomes, learning curve, and cost analysis

BACKGROUND

The Senhance® Robotic System is a new laparoscopy-based platform that has been increasingly used in radical prostatectomy (RP) procedures. The purpose of this study is to compare the outcome of Senhance RP (SRP) with da Vinci RP (DRP) cases.

METHODS

From August 2019 to April 2022, we prospectively recruited 63 cases of SRP. We compared the perioperative data, postoperative complication rates, short-term surgical outcomes (3-month postoperative undetectable prostate-specific antigen (PSA) and incontinence rates), learning curves, and cost analysis with data from 63 matched da Vinci Xi RP cases.

RESULTS

There was no difference in BL (180 versus 180 ml, p = 0.86) and postoperative surgical complication rate (Clavient -Dindo grade I-IV, 25.3 versus 22.2%, p = 0.21) between the SRP cases and the DRP. Regarding the oncologic and continence function, there was no difference between positive margin rate (36.5% versus 41.3%, p = 0.58), rate of undetectable PSA level at postoperative 3 months (68.3 versus 66.7%, p = 0.85), and incontinence rate (14.3 versus 15.9%, p = 1.0) at postoperative 3 months between the two cohorts. The learning curve showed a quick downward slope for laparoscopic experienced surgeons. The median pocket cost for SRP patients in our hospital was $4170, which was lower than $7675 for the DRP patients.

CONCLUSIONS

Safety and short-term outcomes are comparable between SRP and DRP. For experienced LRP surgeons, using the Senhance system to perform RP is straightforward. With a more affordable price as its biggest advantage, the Senhance system may serve as a safe and effective alternative for robotic RP.

An intelligent grasper to provide real-time force feedback to shorten the learning curve in laparoscopic training

BACKGROUND

A lack of force feedback in laparoscopic surgery often leads to a steep learning curve to the novices and traditional training system equipped with force feedback need a high educational cost. This study aimed to use a laparoscopic grasper providing force feedback in laparoscopic training which can assist in controlling of gripping forces and improve the learning processing of the novices.

METHODS

Firstly, we conducted a pre-experiment to verify the role of force feedback in gripping operations and establish the safe gripping force threshold for the tasks. Following this, we proceeded with a four-week training program. Unlike the novices without feedback (Group A2), the novices receiving feedback (Group B2) underwent training that included force feedback. Finally, we completed a follow-up period without providing force feedback to assess the training effect under different conditions. Real-time force parameters were recorded and compared.

RESULTS

In the pre-experiment, we set the gripping force threshold for the tasks based on the experienced surgeons' performance. This is reasonable as the experienced surgeons have obtained adequate skill of handling grasper. The thresholds for task 1, 2, and 3 were set as 0.731 N, 1.203 N and 0.938 N, respectively. With force feedback, the gripping force applied by the novices with feedback (Group B1) was lower than that of the novices without feedback (Group A1) (p < 0.005). During the training period, the Group B2 takes 6 trails to achieve gripping force of 0.635 N, which is lower than the threshold line, whereas the Group A2 needs 11 trails, meaning that the learning curve of Group B2 was significantly shorter than that of Group A2. Additionally, during the follow-up period, there was no significant decline in force learning, and Group B2 demonstrated better control of gripping operations. The training with force feedback received positive evaluations.

CONCLUSION

Our study shows that using a grasper providing force feedback in laparoscopic training can help to control the gripping force and shorten the learning curve. It is anticipated that the laparoscopic grasper equipped with FBG sensor is promising to provide force feedback during laparoscopic training, which ultimately shows great potential in laparoscopic surgery.

The influence of the da Vinci surgical robot on electromagnetic tracking in a clinical environment

Robot-assisted surgery is increasingly used in surgery for cancer. Reduced overview and loss of anatomical orientation are challenges that might be solved with image-guided surgical navigation using electromagnetic tracking (EMT). However, the robot's presence may distort the electromagnetic field, affecting EMT accuracy. The aim of this study was to evaluate the robot's influence on EMT accuracy. For this purpose, two different electromagnetic field generators were used inside a clinical surgical environment: a table top field generator (TTFG) and a planar field generator (PFG). The position and orientation of sensors within the electromagnetic field were measured using an accurate in-house developed 3D board. Baseline accuracy was measured without the robot, followed by stepwise introduction of potential distortion sources (robot and robotic instruments). The absolute accuracy was determined within the entire 3D board and in the clinical working volume. For the baseline setup, median errors in the entire tracking volume within the 3D board were 0.9 mm and 0.3° (TTFG), and 1.1 mm and 0.4° (PFG). Adding the robot and instruments did not affect the TTFG's position accuracy (p = 0.60), while the PFG's accuracies decreased to 1.5 mm and 0.7° (p < 0.001). For both field generators, when adding robot and instruments, accuracies inside the clinical working volume were higher compared to the entire tracking 3D board volume, 0.7 mm and 0.3° (TTFG), and 1.1 mm and 0.7° (PFG). Introduction of a surgical robot and robotic instruments shows limited distortion of the EMT field, allowing sufficient accuracy for surgical navigation in robotic procedures.

Impact of a pneumatic surgical robot with haptic feedback function on surgical manipulation

Although robotic-assisted surgery has the advantages of low patient burden and high precision without unsteady hand movements, the lack of tactile sensations may result in unexpected iatrogenic organ damage. The Saroa (Riverfield Inc., Tokyo, Japan) is a pneumatically driven robot that provides real-time haptic feedback to the surgeon. Using the Saroa robot, six examinees performed puffed rice transfer and four of them performed pig lung resection tasks with the feedback function turned on and off. The puffed rice transfer task consisted of transferring 20 grains of puffed rice from the left to the right compartment in the training box. The mean grasping forces during the puffed rice transfer task with the haptic feedback function turned off and on were 2.14 N and 0.63 N, respectively (P = 0.003). The mean grasping forces during the pig lung resection task were lower with the feedback turned on than turned off. The force that the forceps exerted on the grasping object was weaker in both tasks when the haptic feedback function was turned on, suggesting that the feedback function allows gentler handling of tissues, improving patient safety during robotic surgery.

World's first report of sigmoidectomy for sigmoid cancer using the Saroa surgical system with tactile feedback

Increasing evidence based on the safety and benefits of robot-assisted surgery indicates the disadvantage of the lack of tactile feedback. A lack of tactile feedback increases the risk of intraoperative complications, prolongs operative times, and delays the learning curve. A 40-year-old female patient presented to our hospital with a positive fecal occult blood test. A colonoscopy revealed type 2 advanced cancer of the sigmoid colon, and histological examination showed a well-differentiated adenocarcinoma. Furthermore, abdominal contrast-enhanced computed tomography revealed a tumor in the sigmoid colon and several swollen lymph nodes in the colonic mesentery without distant metastases. The patient was diagnosed with cStage IIIb (cT3N1bM0) sigmoid cancer and underwent sigmoidectomy using the Saroa Surgical System, which was developed by RIVERFIELD, a venture company at the Tokyo Medical and Dental University, and the Tokyo Institute of Technology. Based on adequate simulation, surgery was safely performed with appropriate port placement and arm base-angle adjustment. The operating time was 176 min, with a console time of 116 min and 0 ml blood loss. The patient was discharged 6 days postoperatively without complications. The pathological diagnosis was adenocarcinoma, tub1, tub2, pT2N1bM0, and pStage IIIa. Herein, we report the world's first surgery for sigmoid cancer using the Saroa Surgical System with tactile feedback in which a safe and appropriate oncological surgery was performed.

The benefits of haptic feedback in robot assisted surgery and their moderators: a meta-analysis

Robot assisted surgery (RAS) provides medical practitioners with valuable tools, decreasing strain during surgery and leading to better patient outcomes. While the loss of haptic sensation is a commonly cited disadvantage of RAS, new systems aim to address this problem by providing artificial haptic feedback. N = 56 papers that compared robotic surgery systems with and without haptic feedback were analyzed to quantify the performance benefits of restoring the haptic modality. Additionally, this study identifies factors moderating the effect of restoring haptic sensation. Overall results showed haptic feedback was effective in reducing average forces (Hedges' g = 0.83) and peak forces (Hedges' g = 0.69) applied during surgery, as well as reducing the completion time (Hedges' g = 0.83). Haptic feedback has also been found to lead to higher accuracy (Hedges' g = 1.50) and success rates (Hedges' g = 0.80) during surgical tasks. Effect sizes on several measures varied between tasks, the type of provided feedback, and the subjects' levels of surgical expertise, with higher levels of expertise generally associated with smaller effect sizes. No significant differences were found between virtual fixtures and rendering contact forces. Implications for future research are discussed.

Robot-assisted Partial Nephrectomy with the Newly Developed KangDuo Surgical Robot Versus the da Vinci Si Surgical System: A Double-center Prospective Randomized Controlled Noninferiority Trial

BACKGROUND

The KangDuo surgical robot (KD-SR) was recently developed in China.

OBJECTIVE

To compare the safety and efficacy of the KD-SR versus the da Vinci Si Surgical System (DV-SS-Si) for robot-assisted partial nephrectomy (RAPN).

DESIGN, SETTING, AND PARTICIPANTS

A double-center prospective randomized controlled noninferiority trial of patients aged 18-75 yr with a suspicion of T1a N0M0 renal cancer (RENAL nephrometry score ≤9) was conducted.

INTERVENTION

RAPN with the KD-SR versus the DV-SS-Si.

OUTCOME MEASUREMENTS AND STATISTICAL ANALYSIS

The primary endpoint was the success rate of operation. The operation was successful if (1) there was no open or laparoscopic conversion, (2) the warm ischemia time was <30 min for RENAL nephrometry scores of 4-6 or 40 min for RENAL nephrometry scores of 7-9, and (3) the pathological margin was negative. The secondary endpoint was the estimated glomerular filtration rate (eGFR). A threshold of 10% was set to demonstrate noninferiority.

RESULTS AND LIMITATIONS

From September 2020 to March 2021, 100 participants were enrolled, of whom 99 (49 in the KD-SR group and 50 in the DV-SS-Si group) were finally included in the full analysis set and 98 (49 in the KD-SR group and -49 in the DV-SS-Si group) in the per-protocol set. Baseline demographic and clinical characteristics were similar between the two groups. All surgeries were completed successfully. The eGFR at postoperative weeks 4-12 and adverse events were similar between the two groups. The docking time and suture time per stitch were longer in the KD-SR group. The main limitation was that a negative margin was considered as the primary outcome rather than survival.

CONCLUSIONS

The KD-SR achieved noninferior outcomes as compared with the DV-SS-Si regarding safety and efficacy for T1a tumors.

PATIENT SUMMARY

The first trial comparing the KangDuo surgical robot (KD-SR) versus the da Vinci Si Surgical System for robot-assisted partial nephrectomy showed that the KD-SR is a viable option for minimally invasive treatment of T1a renal tumors.

Smart laparoscopic grasper integrated with fiber Bragg grating based tactile sensor for real-time force feedback

Minimally invasive surgery, such as laparoscopic surgery, has developed rapidly due to its small wound, less bleeding and quick recovery. However, a lack of force feedback, which leads to tissue damage, is still unsolved. Many sensors have been used to offer force feedback but still limited by their large size, low security and high complexity. Based on the advantages of small size, high sensitivity and immunity to electromagnetic interferences, we propose a tactile sensor integrated with fiber Bragg gratings (FBGs) at the tip of laparoscopic grasper to offer real-time force feedback in the laparoscopic surgery. The tactile sensor shows a force sensitivity of 0.076 nm/N with a repeatable accuracy of 0.118 N. A bench test is conducted in a laparoscopic training box to verify its feasibility. Test results illustrate that gripping force exerted on the laparoscopic grasper in terms of peak and standard deviation values reduce significantly for the novice subjects with force feedback compared to those without force feedback. The proposed sensor integrated at the tip of the laparoscopic grasper demonstrates a better control of the gripping force among the novice surgeons and indicates that the smart grasper can help surgeons achieve precise gripping force to reduce unnecessary tissue trauma.

Smooth and safe tram journeys: tram driver perspectives and opportunities using a haptic master controller in a virtual reality environment

Tram drivers operate a master controller to control the acceleration and braking of the tram. Operation should ensure passenger comfort and safety through smooth tram motion and the avoidance of jerkiness that may cause passengers to fall in the carriage. This work investigates current driver practices and strategies for tram driving in normal operations through interviews and the capacity of a new haptic master controller to support drivers in achieving smooth and safe tram journeys. A haptic feedback algorithm based on viscosity was implemented on the master controller to provide drivers with feedback on the rate at which they were accelerating and braking the tram. This aspect was tested in a virtual tram within a simulated inner city virtual reality environment. Results indicate that the haptic master controller and coupled viscosity feedback algorithm did not increase smoothness of driving during the simulated experiences. Despite this, the drivers indicated a preference for the provision of further haptic information to support driving tasks and the overall journey safety and smoothness. Practitioner Summary: This research comprises two studies. The first investigates strategies currently used by drivers to operate a tram smoothly in order to elicit design requirements for a haptic tram master controller. The second study evaluates the impact of a novel haptic master controller on journey smoothness within a virtual environment.

The role of data-driven artificial intelligence on COVID-19 disease management in public sphere: a review

Coronavirus disease 2019 (COVID-19) is an infectious disease with acute intense respiratory syndrome which spread around the world for the very first time impacting the way of life with drastic uncertainty. It rapidly reached almost every nook and corner of the world and the World Health Organization (WHO) has announced COVID-19 as a pandemic. The health care institutions around the globe are looking for viable and real-time technological solutions to handle the virus for evading its spread and circumvent probable demises. Importantly, the artificial intelligence tools and techniques are playing a major role in fighting the effect of virus on the economic jolt by mimicking human intelligence by screening, analyzing, predicting and tracking the existing and likely future patients. Since the first reported case, all the government organizations in the world jumped into action to prevent it and many studies reported the role of AI in taking decisions analyzing big data available in public sphere. Thereby, this review focuses on identifying the significant implication of AI techniques used for the COVID-19 disease management in the public sphere by agglomerating the latest available information. It also discusses the pitfalls and future directions in handling sensitive big data required for advanced neural networks.

Reducing retraction forces with tactile feedback during robotic total mesorectal excision in a porcine model

Excessive tissue-instrument interaction forces during robotic surgery have the potential for causing iatrogenic tissue damages. The current in vivo study seeks to assess whether tactile feedback could reduce intraoperative tissue-instrument interaction forces during robotic-assisted total mesorectal excision. Five subjects, including three experts and two novices, used the da Vinci robot to perform total mesorectum excision in four pigs. The grip force in the left arm, used for retraction, and the pushing force in the right arm, used for blunt pelvic dissection around the rectum, were recorded. Tissue-instrument interaction forces were compared between trials done with and without tactile feedback. The mean force exerted on the tissue was consistently higher in the retracting arm than the dissecting arm (3.72 ± 1.19 vs 0.32 ± 0.36 N, p < 0.01). Tactile feedback brought about significant reductions in average retraction forces (3.69 ± 1.08 N vs 4.16 ± 1.12 N, p = 0.02), but dissection forces appeared unaffected (0.43 ± 0.42 vs 0.37 ± 0.28 N, p = 0.71). No significant differences were found between retraction and dissection forces exerted by novice and expert robotic surgeons. This in vivo animal study demonstrated the efficacy of tactile feedback in reducing retraction forces during total mesorectal excision. Further research is required to quantify the clinical impact of such force reduction.

Force sensing in robot-assisted keyhole endoscopy: A systematic survey

Instrument–tissue interaction forces in minimally invasive surgery (MIS) provide valuable information that can be used to provide haptic perception, monitor tissue trauma, develop training guidelines, and evaluate the skill level of novice and expert surgeons. Force and tactile sensing is lost in many robot-assisted surgery (RAS) systems. Therefore, many researchers have focused on recovering this information through sensing systems and estimation algorithms. This article provides a comprehensive systematic review of the current force sensing research aimed at RAS and, more generally, keyhole endoscopy, in which instruments enter the body through small incisions. Articles published between January 2011 and May 2020 are considered, following the Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA) guidelines. The literature search resulted in 110 papers on different force estimation algorithms and sensing technologies, sensor design specifications, and fabrication techniques.

Adaptive Surgical Robotic Training Using Real-Time Stylistic Behavior Feedback Through Haptic Cues

Surgical skill directly affects surgical procedure outcomes; thus, effective training is needed to ensure satisfactory results. Many objective assessment metrics have been developed that provide the trainee with descriptive feedback about their performance however, often lack feedback on how to improve performance. The most effective training method is one that is intuitive, easy to understand, personalized to the user,and provided in a timely manner. We propose a framework to enable user-adaptive training using near real-time detection of performance, based on intuitive styles of surgical movements, and design a haptic feedback framework to assist with correcting styles of movement. We evaluate the ability of three types of force feedback (spring, damping, and spring plus damping feedback), computed based on prior user positions, to improve different stylistic behaviors of the user during kinematically constrained reaching movement tasks. The results indicate that five out of six styles studied here were improved using at least one of the three types of force feedback. Task performance metrics were compared in the presence of the three types of feedback. Task time was statistically significantly lower when applying spring feedback, compared to the other two types of feedback. Path straightness and targeting error were statistically significantly improved when using spring-damping feedback compared to the other two types of feedback. This study presents a groundwork for adaptive training in robotic surgery based on near real-time human-centric models of surgical behavior.

Potential Contenders for the Leadership in Robotic Surgery

Purpose: To summarize the scientific published literature on new robotic surgical platforms with potential use in the urological field, reviewing their evolution from presentation until the present day. Our goal is to describe the current characteristics and possible prospects for these platforms. Materials and Methods: A nonsystematic search of the PubMed, Cochrane library's Central, EMBASE, MEDLINE, and Scopus databases was conducted to identify scientific literature about new robotic platforms other than the Da Vinci^® system, reviewing their evolution from inception until December 2020. Only English language publications were included. The following keywords were used: "new robotic platforms," "Revo-I robot," "Versius robot," and "Senhance robot." All relevant English-language original studies were analyzed by one author (R.F.) and summarized after discussion with an independent third party (E.M., S.Y., S.P., and M.A.). Results: Since 1995, Intuitive Surgical, Inc., with the Da Vinci surgical system, is the leading company in the robotic surgical market. However, Revo-I^®, Versius^®, and Senhance^® are the other three platforms that recently appeared on the market with available articles published in peer-reviewed journals. Among these three new surgical systems, the Senhance robot has the most substantial scientific proof of its capacity to perform minimally invasive urological surgery and as such, it might become a contender of the Da Vinci robot. Conclusions: The Da Vinci surgical platform has allowed the diffusion of robotic surgery worldwide and showed the different advantages of this type of technique. However, its use has some drawbacks, especially its price. New robotic platforms characterized by unique features are under development. Of note, they might be less expensive compared with the Da Vinci robotic system. We found that these new platforms are still at the beginning of their technical and scientific validation. However, the Senhance robot is in a more advanced stage, with clinical studies supporting its full implementation.

Position Control and Force Estimation Method for Surgical Forceps Using SMA Actuators and Sensors

Minimally invasive surgery is increasingly used in many medical operations because of the benefits for the patients. However, for the surgeons, accessing the situs through a small incision or natural orifice comes with a reduction of the degrees of freedom of the instrument. Due to friction of the mechanical coupling, the haptic feedback lacks sensitivity that could lead to damage of the tissue. The approach of this work to overcome these problems is to develop a control concept for position control and force estimation with shape memory alloys (SMA) which could offer haptic feedback in a novel handheld instrument. The concept aims to bridge the gap between manually actuated laparoscopic instruments and surgical robots. Nickel-titanium shape memory alloys are used for actuation because of their high specific energy density. The work includes the manufacturing of a functional model as a proof of concept comprising the development of a suitable forceps mechanism and electronic circuit for position control and gripping force measurement, as well as designing an ergonomic user interface with haptic force feedback.

Rethinking Autonomous Surgery: Focusing on Enhancement over Autonomy

CONTEXT

As robot-assisted surgery is increasingly used in surgical care, the engineering research effort towards surgical automation has also increased significantly. Automation promises to enhance surgical outcomes, offload mundane or repetitive tasks, and improve workflow. However, we must ask an important question: should autonomous surgery be our long-term goal?

OBJECTIVE

To provide an overview of the engineering requirements for automating control systems, summarize technical challenges in automated robotic surgery, and review sensing and modeling techniques to capture real-time human behaviors for integration into the robotic control loop for enhanced shared or collaborative control.

EVIDENCE ACQUISITION

We performed a nonsystematic search of the English language literature up to March 25, 2021. We included original studies related to automation in robot-assisted laparoscopic surgery and human-centered sensing and modeling.

EVIDENCE SYNTHESIS

We identified four comprehensive review papers that present techniques for automating portions of surgical tasks. Sixteen studies relate to human-centered sensing technologies and 23 to computer vision and/or advanced artificial intelligence or machine learning methods for skill assessment. Twenty-two studies evaluate or review the role of haptic or adaptive guidance during some learning task, with only a few applied to robotic surgery. Finally, only three studies discuss the role of some form of training in patient outcomes and none evaluated the effects of full or semi-autonomy on patient outcomes.

CONCLUSIONS

Rather than focusing on autonomy, which eliminates the surgeon from the loop, research centered on more fully understanding the surgeon's behaviors, goals, and limitations could facilitate a superior class of collaborative surgical robots that could be more effective and intelligent than automation alone.

PATIENT SUMMARY

We reviewed the literature for studies on automation in surgical robotics and on modeling of human behavior in human-machine interaction. The main application is to enhance the ability of surgical robotic systems to collaborate more effectively and intelligently with human surgeon operators.

Bio-inspired Haptic Feedback for Artificial Palpation in Robotic Surgery

Adding haptic feedback has been reported to improve the outcome of minimally invasive robotic surgery. In this study, we seek to determine whether an algorithm based on simulating responses of a cutaneous afferent population can be implemented to improve the performance of presenting haptic feedback for robot-assisted surgery. We propose a bio-inspired controlling model to present vibration and force feedback to help surgeons localize underlying structures in phantom tissue. A single pair of actuators was controlled by outputs of a model of a population of cutaneous afferents based on the pressure signal from a single sensor embedded in surgical forceps. We recruited 25 subjects including 10 expert surgeons to evaluate the performance of the bio-inspired controlling model in an artificial palpation task using the da Vinci surgical robot. Among the control methods tested, the bio-inspired system was unique in allowing both novices and experts to easily identify the locations of all classes of tumors and did so with reduced contact force and tumor contact time. This work demonstrates the utility of our bio-inspired multi-modal feedback system, which resulted in superior performance for both novice and professional users, in comparison to a traditional linear and the existing piecewise discrete algorithms of haptic feedback.

Robotic colorectal surgery and ergonomics

Improved ergonomics for the operating surgeon may be an advantage of robotic colorectal surgery. Perceived robotic ergonomic advantages in visualisation include better exposure, three-dimensional vision, surgeon camera control, and line of sight screen location. Postural advantages include seated position and freedom from the constraints of the sterile operating field. Manipulation benefits include articulated instruments with seven degrees of freedom movement, elimination of fulcrum effect, tremor filtration, and scaling of movement. Potential ergonomic detriments of robotic surgery include lack of haptic feedback, visual, and mental strain from increased operating time and interruptions to workflow from crowding.

Tool-tissue forces in surgery: A systematic review

Background

Excessive tool-tissue interaction forces often result in tissue damage and intraoperative complications, while insufficient forces prevent the completion of the task. This review sought to explore the tool-tissue interaction forces exerted by instruments during surgery across different specialities, tissues, manoeuvres and experience levels.

Materials & methods

A PRISMA-guided systematic review was carried out using Embase, Medline and Web of Science databases.

Results

Of 462 articles screened, 45 studies discussing surgical tool-tissue forces were included. The studies were categorized into 9 different specialities with the mean of average forces lowest for ophthalmology (0.04N) and highest for orthopaedic surgery (210N). Nervous tissue required the least amount of force to manipulate (mean of average: 0.4N), whilst connective tissue (including bone) required the most (mean of average: 45.8). For manoeuvres, drilling recorded the highest forces (mean of average: 14N), whilst sharp dissection recorded the lowest (mean of average: 0.03N). When comparing differences in the mean of average forces between groups, novices exerted 22.7% more force than experts, and presence of a feedback mechanism (e.g. audio) reduced exerted forces by 47.9%.

Conclusions

The measurement of tool-tissue forces is a novel but rapidly expanding field. The range of forces applied varies according to surgical speciality, tissue, manoeuvre, operator experience and feedback provided. Knowledge of the safe range of surgical forces will improve surgical safety whilst maintaining effectiveness. Measuring forces during surgery may provide an objective metric for training and assessment. Development of smart instruments, robotics and integrated feedback systems will facilitate this.

•

This review explores tool-tissue forces during surgery, a new and expanding field.

•

Forces were lowest in ophthalmology (0.04N) and highest in orthopaedics (210N).

•

Forces were lowest during sharp dissection (0.03N) and highest when drilling (14N).

•

Being an expert (vs. novice) and having feedback mechanisms (e.g. haptic) reduced exerted forces.

•

Development of force metrics will facilitate training, assessment & novel technology.

Robotic-assisted cholecystectomy is superior to laparoscopic cholecystectomy in the initial training for surgical novices in an ex vivo porcine model: a randomized crossover study

Background

Robotic-assisted surgery (RAS) potentially reduces workload and shortens the surgical learning curve compared to conventional laparoscopy (CL). The present study aimed to compare robotic-assisted cholecystectomy (RAC) to laparoscopic cholecystectomy (LC) in the initial learning phase for novices.

Methods

In a randomized crossover study, medical students (n = 40) in their clinical years performed both LC and RAC on a cadaveric porcine model. After standardized instructions and basic skill training, group 1 started with RAC and then performed LC, while group 2 started with LC and then performed RAC. The primary endpoint was surgical performance measured with Objective Structured Assessment of Technical Skills (OSATS) score, secondary endpoints included operating time, complications (liver damage, gallbladder perforations, vessel damage), force applied to tissue, and subjective workload assessment.

Results

Surgical performance was better for RAC than for LC for total OSATS (RAC = 77.4 ± 7.9 vs. LC = 73.8 ± 9.4; p = 0.025, global OSATS (RAC = 27.2 ± 1.0 vs. LC = 26.5 ± 1.6; p = 0.012, and task specific OSATS score (RAC = 50.5 ± 7.5 vs. LC = 47.1 ± 8.5; p = 0.037). There were less complications with RAC than with LC (10 (25.6%) vs. 26 (65.0%), p = 0.006) but no difference in operating times (RAC = 77.0 ± 15.3 vs. LC = 75.5 ± 15.3 min; p = 0.517). Force applied to tissue was similar. Students found RAC less physical demanding and less frustrating than LC.

Conclusions

Novices performed their first cholecystectomies with better performance and less complications with RAS than with CL, while operating time showed no differences. Students perceived less subjective workload for RAS than for CL. Unlike our expectations, the lack of haptic feedback on the robotic system did not lead to higher force application during RAC than LC and did not increase tissue damage. These results show potential advantages for RAS over CL for surgical novices while performing their first RAC and LC using an ex vivo cadaveric porcine model.

Registration number

researchregistry6029

Graphic abstract

Review of Advanced Medical Telerobots

The advent of telerobotic systems has revolutionized various aspects of the industry and human life. This technology is designed to augment human sensorimotor capabilities to extend them beyond natural competence. Classic examples are space and underwater applications when distance and access are the two major physical barriers to be combated with this technology. In modern examples, telerobotic systems have been used in several clinical applications, including teleoperated surgery and telerehabilitation. In this regard, there has been a significant amount of research and development due to the major benefits in terms of medical outcomes. Recently telerobotic systems are combined with advanced artificial intelligence modules to better share the agency with the operator and open new doors of medical automation. In this review paper, we have provided a comprehensive analysis of the literature considering various topologies of telerobotic systems in the medical domain while shedding light on different levels of autonomy for this technology, starting from direct control, going up to command-tracking autonomous telerobots. Existing challenges, including instrumentation, transparency, autonomy, stochastic communication delays, and stability, in addition to the current direction of research related to benefit in telemedicine and medical automation, and future vision of this technology, are discussed in this review paper.

Eye-Tracking Metrics Predict Perceived Workload in Robotic Surgical Skills Training

OBJECTIVE

The aim of this study is to assess the relationship between eye-tracking measures and perceived workload in robotic surgical tasks.

BACKGROUND

Robotic techniques provide improved dexterity, stereoscopic vision, and ergonomic control system over laparoscopic surgery, but the complexity of the interfaces and operations may pose new challenges to surgeons and compromise patient safety. Limited studies have objectively quantified workload and its impact on performance in robotic surgery. Although not yet implemented in robotic surgery, minimally intrusive and continuous eye-tracking metrics have been shown to be sensitive to changes in workload in other domains.

METHODS

Eight surgical trainees participated in 15 robotic skills simulation sessions. In each session, participants performed up to 12 simulated exercises. Correlation and mixed-effects analyses were conducted to explore the relationships between eye-tracking metrics and perceived workload. Machine learning classifiers were used to determine the sensitivity of differentiating between low and high workload with eye-tracking features.

RESULTS

Gaze entropy increased as perceived workload increased, with a correlation of .51. Pupil diameter and gaze entropy distinguished differences in workload between task difficulty levels, and both metrics increased as task level difficulty increased. The classification model using eye-tracking features achieved an accuracy of 84.7% in predicting workload levels.

CONCLUSION

Eye-tracking measures can detect perceived workload during robotic tasks. They can potentially be used to identify task contributors to high workload and provide measures for robotic surgery training.

APPLICATION

Workload assessment can be used for real-time monitoring of workload in robotic surgical training and provide assessments for performance and learning.

Robotic Retinal Surgery Impacts on Scleral Forces: In Vivo Study

Purpose

This study aims to map force interaction between instrument and sclera of in vivo rabbits during retinal procedures, and verify if a robotic active force control could prevent unwanted increase of forces on the sclera.

Methods

Experiments consisted in the performance of intraocular movements of a force sensing instrument, adjacent to the retinal surface, in radial directions, from the center to the periphery and back, and compared manual manipulations with robotic assistance and also robotic assistance with an active force control. This protocol was approved by the Animal Use and Ethical Committee and experiments were according to ARVO Statement of Animal Use.

Results

Mean forces using manual manipulations were 115 ± 51 mN. Using robotic assistance, mean forces were 118 ± 49 mN. Using an active force control method, overall mean forces reduced to 69 ± 15, with a statistical difference compared with other methods (P < 0.001). Comparing intraocular directions, superior sector required higher forces and the force control method reduced differences in forces between users and retained the same force pattern between them.

Conclusions

Results validate that the introduction of robotic assistance might increase the dynamic interactions between instrument and sclera, and the addition of an active force control method reduces the forces at levels lower than manual manipulations.

Translational Relevance

All marketing benefits from extreme accuracy and stability from robots, however, redundancy of safety mechanisms during intraocular manipulations, especially on force control and surgical awareness, would allow all utility of robotic assistance in ophthalmology.

Potential Value of Haptic Feedback in Minimally Invasive Surgery for Deep Endometriosis

Introduction. Laparoscopic treatment of deep endometriosis (DE) is associated with intra- and post-operative morbidity. New technological developments, such as haptic feedback in laparoscopic instruments, could reduce the rate of complications. The aim of this study was to assess the room for improvement and potential cost-effectiveness of haptic feedback instruments in laparoscopic surgery. Methods. To assess the potential value of haptic feedback, a decision analytical model was constructed. Complications that could be related to the absence of haptic feedback were included in the model. Costs of complications were based on the additional length of hospital stay, operating time, outpatient visits, reinterventions, and/or conversions to laparotomy. The target population consists of women who are treated for DE in the Netherlands. A headroom analysis was performed to estimate the maximum value of haptic feedback in case it would be able to prevent all selected intra- and post-operative complications. Results. A total of 9.7 intraoperative and 47.0 post-operative complications are expected in the cohort of 636 patients annually treated for DE in the Netherlands. Together, these complications cause an additional length of hospital stay of 432.1 days, 10.2 additional outpatient visits, 73.9 reinterventions, and 4.2 conversions. Most consequences are related to post-operative complications. The total additional annual costs due to complications were €436 623, amounting to €687 additional costs per patient. Discussion. This study demonstrated that the potential value for improvement in DE laparoscopic surgery by using haptic feedback instruments is considerable, mostly caused by the potential prevention of major post-operative complications.

Haptic Intracorporeal Palpation Using a Cable-Driven Parallel Robot: A User Study

OBJECTIVE

Intraoperative palpation is a surgical gesture jeopardized by the lack of haptic feedback which affects robotic minimally invasive surgery. Restoring the force reflection in teleoperated systems may improve both surgeons' performance and procedures' outcome.

METHODS

A force-based sensing approach was developed, based on a cable-driven parallel manipulator with anticipated seamless and low-cost integration capabilities in teleoperated robotic surgery. No force sensor on the end-effector is used, but tissue probing forces are estimated from measured cable tensions. A user study involving surgical trainees (n = 22) was conducted to experimentally evaluate the platform in two palpation-based test-cases on silicone phantoms. Two modalities were compared: visual feedback alone and both visual + haptic feedbacks available at the master site.

RESULTS

Surgical trainees' preference for the modality providing both visual and haptic feedback is corroborated by both quantitative and qualitative metrics. Hard nodules detection sensitivity improves (94.35 ± 9.1% vs 76.09 ± 19.15% for visual feedback alone), while also exerting smaller forces (4.13 ± 1.02 N vs 4.82 ± 0.81 N for visual feedback alone) on the phantom tissues. At the same time, the subjective perceived workload decreases.

CONCLUSION

Tissue-probe contact forces are estimated in a low cost and unique way, without the need of force sensors on the end-effector. Haptics demonstrated an improvement in the tumor detection rate, a reduction of the probing forces, and a decrease in the perceived workload for the trainees.

SIGNIFICANCE

Relevant benefits are demonstrated from the usage of combined cable-driven parallel manipulators and haptics during robotic minimally invasive procedures. The translation of robotic intraoperative palpation to clinical practice could improve the detection and dissection of cancer nodules.

Pneumatically driven surgical forceps displaying a magnified grasping torque

BACKGROUND

Sensing the grasping force and displaying the force for the operator are important for safe operation in robot-assisted surgery. Although robotic forceps that senses the force by force sensors or driving torque of electric motors is proposed, the force sensors and the motors have some problems such as increase in weight and difficulty of the sterilization.

METHOD

We developed a pneumatically driven robotic forceps that estimates the grasping torque and display the magnified torque for the operator. The robotic forceps has a master device and a slave robot, and they are integrated. In the slave side, the grasping torque is estimated by the pressure change in the pneumatic cylinder. A pneumatic bellows display the torque through a linkage.

RESULTS

We confirmed that the slave robot follows the motion of the master, and the grasping torque is estimated in the accuracy of 7 mNm and is magnified and displayed for the operator.

CONCLUSIONS

The pneumatically driven robotic forceps has the capability in the estimation of the grasping torque and display of the torque. Regarding future work, the usability and fatigues of the surgeons must be evaluated.

Electrically-Evoked Proximity Sensation Can Enhance Fine Finger Control in Telerobotic Pinch

For teleoperation tasks requiring high control accuracy, it is essential to provide teleoperators with information on the interaction between the end effector and the remote environment. Real-time imaging devices have been widely adopted, but it delivers limited information, especially when the end effectors approach the target following the line-of-sight. In such situations, teleoperators rely on the perspective at the screen and can apply high force unintentionally at the initial contact. This research proposes to deliver the distance information at teleoperation to the fingertips of teleoperators, i.e., proximity sensation. Transcutaneous electrical stimulation was applied onto the fingertips of teleoperators, with the pulsing frequency inversely proportional to the distance. The efficacy of the proximity sensation was evaluated by the initial contact force during telerobotic pinch in three sensory conditions: vision only, vision + visual assistance (distance on the screen), and vision + proximity sensation. The experiments were repeated at two viewing angles: 30–60° and line-of-sight, for eleven healthy human subjects. For both cases, the initial contact force could be significantly reduced by either visual assistance (20–30%) or the proximity sensation (60–70%), without additional processing time. The proximity sensation is two-to-three times more effective than visual assistance regarding the amount of force reduction.

The impact of artificial intelligence in medicine on the future role of the physician

The practice of medicine is changing with the development of new Artificial Intelligence (AI) methods of machine learning. Coupled with rapid improvements in computer processing, these AI-based systems are already improving the accuracy and efficiency of diagnosis and treatment across various specializations. The increasing focus of AI in radiology has led to some experts suggesting that someday AI may even replace radiologists. These suggestions raise the question of whether AI-based systems will eventually replace physicians in some specializations or will augment the role of physicians without actually replacing them. To assess the impact on physicians this research seeks to better understand this technology and how it is transforming medicine. To that end this paper researches the role of AI-based systems in performing medical work in specializations including radiology, pathology, ophthalmology, and cardiology. It concludes that AI-based systems will augment physicians and are unlikely to replace the traditional physician-patient relationship.

Performance of a Haptic Feedback Grasper in Laparoscopic Surgery: A Randomized Pilot Comparison With Conventional Graspers in a Porcine Model

Background. Compared with open surgery, minimally invasive surgery is limited by reduced sensation of tissue properties. A laparoscopic grasper with integrated haptic feedback technology that improves the ability to sense tissue properties might provide a solution. The force reflecting operation instrument (FROI) is a new laparoscopic grasper, designed to provide information about the interaction forces between the instrument and tissue through resistance in the handle. This pilot study aimed to assess the functionality of the FROI compared with a conventional grasper in an in vivo setting. Methods. In this randomized trial, we used a standard laparoscopic surgical setup to perform laparoscopic surgery in pigs. In all, 11 surgeons performed colorectal, gynecological, or urological procedures, once with the FROI and once with a conventional grasper. Participants were asked to complete the NASA Task Load Index Rating Scale and rate 5 specific features for both graspers. To capture opinions on the overall functionality of the FROI, participants were asked to answer 8 open questions. Results. The surgeons reported that the use of the FROI significantly improved tissue consistency perception, arterial pulse detection, and force control compared with the conventional grasper. No significant differences were found in surgeons' muscular strain or operative time. The most emphasized topics in the open questions were improved soft-tissue handling and importance for complex procedures. Conclusion. Through this first in vivo analysis of the functionality of the FROI, a multispecialty group of laparoscopic surgeons confirmed the added value of haptic feedback technology in a live surgical setting.

Haptic feedback in the da Vinci Research Kit (dVRK): A user study based on grasping, palpation, and incision tasks

BACKGROUND

It was suggested that the lack of haptic feedback, formerly considered a limitation for the da Vinci robotic system, does not affect robotic surgeons because of training and compensation based on visual feedback. However, conclusive studies are still missing, and the interest in force reflection is rising again.

METHODS

We integrated a seven-DoF master into the da Vinci Research Kit. We designed tissue grasping, palpation, and incision tasks with robotic surgeons, to be performed by three groups of users (expert surgeons, medical residents, and nonsurgeons, five users/group), either with or without haptic feedback. Task-specific quantitative metrics and a questionnaire were used for assessment.

RESULTS

Force reflection made a statistically significant difference for both palpation (improved inclusion detection rate) and incision (decreased tissue damage).

CONCLUSIONS

Haptic feedback can improve key surgical outcomes for tasks requiring a pronounced cognitive burden for the surgeon, to be possibly negotiated with longer completion times.

Multi-Modal Haptic Feedback for Grip Force Reduction in Robotic Surgery

Minimally invasive robotic surgery allows for many advantages over traditional surgical procedures, but the loss of force feedback combined with a potential for strong grasping forces can result in excessive tissue damage. Single modality haptic feedback systems have been designed and tested in an attempt to diminish grasping forces, but the results still fall short of natural performance. A multi-modal pneumatic feedback system was designed to allow for tactile, kinesthetic, and vibrotactile feedback, with the aims of more closely imitating natural touch and further improving the effectiveness of HFS in robotic surgical applications and tasks such as tissue grasping and manipulation. Testing of the multi-modal system yielded very promising results with an average force reduction of nearly 50% between the no feedback and hybrid (tactile and kinesthetic) trials (p < 1.0E-16). The multi-modal system demonstrated an increased reduction over single modality feedback solutions and indicated that the system can help users achieve average grip forces closer to those normally possible with the human hand.

Instrumental palpation in endoscopic renal surgery: case reports and analysis

Palpation is one of the classic examination methods in open surgeries. In minimally invasive surgery, intra-operational manual palpation is impossible to use for assessing tactile characteristics of tissues. In Russia, the only available instrument for intra-operational assessment and objective registration of tissue visco-elastic properties is the Medical Tactile Endosurgical Complex (MTEC). The aim of this work was to study the performance of MTEC in renal surgery. The study was performed during nine elective laparoscopic surgeries for clear cell renal carcinoma and simple renal cysts. We have found several differences in the use of MTEC in renal surgery, as compared to its use in gastrointestinal or lung surgeries. The key factor determining these differences was the inverse relations between tissue visco-elastic properties: the studied tumors were softer than the surrounding tissue. Detection of intraparenchymal tumors by tactile methods was impossible. For surface tumors, in one case out of nine it was possible to strictly locate the border of the tumor by tactile examination. We were able to quantitatively assess and determine the difference in hardness of tumors and intact tissue using MTEC. This allows studying the prognostic value of objectively registered tactile characteristics of renal tumors.

Evaluation of a pneumatic surgical robot with dynamic force feedback

Robot-assisted surgery is limited by the lack of haptic feedback and increased operating times. Force scaling adjusts feedback transmitted to the operator through the use of scaling factors. Herein, we investigate how force scaling affects forces exerted in robotic surgery during simple and complex tasks, using a pneumatic surgical robot, IBIS VI. Secondary objectives were to test the effects of force scaling on operating time, depth of needle insertion and user satisfaction. Two novice males performed simple (modified block transfer) and complex (needle insertion) tasks under four scaling factors: 0.0, 0.5, 1.0 and 2.0. Single-blind experiments were repeated five times, with alternating scaling factors in random order. Increasing the scaling factor from 0.0 to 2.0 reduces forces in block transfer (p = 0.04). All feedback conditions reduce forces in needle insertion compared to baseline (0.5: p < 0.001, 1.0: p = 0.001, 2.0: p = 0.001). Time to complete block transfer is shorter for scaling factor 0.5 (p = 0.02), but not for 1.0 (p = 0.05) or 2.0 (p = 0.48), compared to baseline. Depth of needle insertion decreases consistently with incremental scaling factors (p < 0.001). Further reductions are observed upon augmenting feedback (0.5-2.0: p = 0.02). User satisfaction in block transfer is highest for intermediate scaling factors (0.0-1.0: p = 0.01), but no change is observed in needle insertion (p = 0.99). Increments in scaling factor reduce forces exerted, particularly in tasks requiring precision. Depth of needle insertion follows a similar pattern, but operating time and user satisfaction are improved by intermediate scaling factors. In summary, dynamic adjustment of force feedback can improve operative outcomes and advance surgical automation.

Evaluation of Haptic Feedback on Bimanually Teleoperated Laparoscopy for Endometriosis Surgery

Robotic minimal invasive surgery is gaining acceptance in surgical care. In contrast with the appreciated three-dimensional vision and enhanced dexterity, haptic feedback is not offered. For this reason, robotics is not considered beneficial for delicate interventions such as the endometriosis. Overall, haptic feedback remains debatable and yet unproven except for some simple scenarios such as fundamentals of laparoscopic surgery exercises. Objective: This work investigates the benefits of haptic feedback on more complex surgical gestures, manipulating delicate tissue through coordination between multiple instruments. Methods: A new training exercise, “endometriosis surgery exercise” (ESE) has been devised approximating the setting for monocular robotic endometriosis treatment. A bimanual bilateral teleoperation setup was designed for laparoscopic laser surgery. Haptic guidance and haptic feedback are, respectively, offered to the operator. User experiments have been conducted to assess the validity of ESE and examine possible advantages of haptic technology during execution of bimanual surgery. Results: Content and face validity of ESE were established by participating surgeons. Surgeons suggested ESE also as a mean to train lasering skills, and interaction forces on endometriotic tissue were found to be significantly lower when a bilateral controller is used. Collisions between instruments and the environment were less frequent and so were situations marked as potentially dangerous. Conclusion: This study provides some promising results suggesting that haptics may offer a distinct advantage in complex robotic interventions were fragile tissue is manipulated. Significance: Patients need to know whether it should be incorporated. Improved understanding of the value of haptics is important as current commercial surgical robots are widely used but do not offer haptics.

Artificial palpation in robotic surgery using haptic feedback

BACKGROUND

The loss of tactile feedback in minimally invasive robotic surgery remains a major challenge to the expanding field. With visual cue compensation alone, tissue characterization via palpation proves to be immensely difficult. This work evaluates a bimodal vibrotactile system as a means of conveying applied forces to simulate haptic feedback in two sets of studies simulating an artificial palpation task using the da Vinci surgical robot.

METHODS

Subjects in the first study were tasked with localizing an embedded vessel in a soft tissue phantom using a single-sensor unit. In the second study, subjects localized tumor-like structures using a three-sensor array. In both sets of studies, subjects completed the task under three trial conditions: no feedback, normal force tactile feedback, and hybrid vibrotactile feedback. Recordings of correct localization, incorrect localization, and time-to-completion were used to evaluate performance outcomes.

RESULTS

With the addition of vibrotactile and pneumatic feedback, significant improvements in the percentage of correct localization attempts were detected (p = 0.0001 and p = 0.0459, respectively) during the first experiment with phantom vessels. Similarly, significant improvements in correct localization were found with the addition of vibrotactile (p = 2.57E-5) and pneumatic significance (p = 8.54E-5) were observed in the second experiment involving tumor phantoms.

CONCLUSIONS

This work demonstrates not only the superior benefits of a multi-modal feedback over traditional single-modality feedback, but also the effectiveness of vibration in providing haptic feedback to artificial palpation systems.

Utilization of a robotic mount to determine the force required to cut palatal tissue

Determination of the material properties of soft tissue is a growing area of interest that aids in the development of new surgical tools and surgical simulators. This study first aims to develop a robot-operated tissue testing system for determination of tissue cutting forces. Second, this system was used to ascertain the cutting properties of the hard and soft palate mucosa and soft palate musculature for the purpose of developing a robotic instrument for cleft palate surgery and a cleft-specific surgical simulator. The palate tissue was cut with a 15 blade mounted to the robot with varying angles (30°, 60°, 90°) and speeds (1.5, 2.5, 3.5 cm/s) of cutting to imitate typical operative tasks. The cutting force range for hard palate mucosa, soft palate mucosa and soft palate muscle were 0.98-3.30, 0.34-1.74 and 0.71-2.71 N, respectively. The break-in force of the cut (i.e. force required for the blade to penetrate the tissue) is significantly impacted by the angle of the blade relative to the tissue rather than the cutting speed. Furthermore, the total surface area of the tissue in contact with the blade during the cut has a significant impact on the total force expended on the tissue.

Haptic Feedback for Control and Active Constraints in Contactless Laser Surgery: Concept, Implementation, and Evaluation

Haptics has proven to be highly beneficial in surgical robotics, bringing enhanced safety and precision by complementing the surgeon's visual channel. However, most of the research body in this context is dedicated to applications involving traditional "cold steel" surgical instruments. This paper proposes to bring the benefits of haptics to contactless surgeries, and presents a novel method to achieve this. The specific case of robot-assisted laser microsurgery is investigated. Here, a fictitious force feedback is created through stereoscopic visualization and 3D reconstruction, allowing the surgeon to sense the surgical area haptically while controlling a non-contact surgical laser. This is shown to significantly improve system usability and the accuracy of laser incisions, especially in applications involving several passes of the laser over the same incision line. Validation of the system is performed through two series of experiments involving both naive users and expert surgeons. The obtained results demonstrate that haptics can indeed be introduced in contactless laser surgery, allowing the exploitation of active constraints and guidance techniques that significantly enhance laser control accuracy both in static and dynamic environments. Furthermore, the proposed haptic technology shows good acceptance and high usability, indicating it has great potential to positively impact real surgeries.

[Robotic Surgery - Who is The Boss?]

In the head and neck region, great potential is seen in robot-assisted surgery (RAS). Mainly in cancer surgery, the use of robotic systems seems to be of interest. Until today, two robotic systems (DaVinci® und FLEX®) have gained approval for clinical use in the head and neck region, and multiple other systems are currently in pre-clinical testing. Although, certain groups of patients may benefit from RAS, no unbiased randomized clinical studies are available. Until today, it was not possible to satisfactorily prove any advantage of RAS as compared to standard procedures. The limited clinical benefit and the additional financial burden seem to be the main reasons, why the comprehensive application of RAS has not been realized so far.This review article describes the large variety of clinical applications for RAS in the head and neck region. In addition, the financial and technical challenges, as well as ongoing developments of RAS are highlighted. Special focus is put on risks associated with RAS and current clinical studies. We believe, that RAS will find its way into clinical routine during the next years. Therefore, medical staff will have to increasingly face the technical, scientific and ethical features of RAS.

The effects of laparoscopic graspers with enhanced haptic feedback on applied forces: a randomized comparison with conventional graspers

Background

Haptic feedback, which enables surgeons to perceive information on interaction forces between instrument and tissue, is deficient in laparoscopic surgery. This information, however, is essential for accurate tissue manipulation and recognition of tissue consistencies. To this end, a laparoscopic grasper with enhanced haptic feedback has been developed: the force reflecting operation instrument (FROI). This study tested the effects of enhanced haptic feedback on force control, tissue consistency interpretation, and the associated surgeons’ level of confidence through a randomized controlled crossover experiment.

Methods

A randomized three-period crossover trial was conducted, in which seven surgical residents and 13 medical students participated. The setup involved a box trainer in which slices of porcine organs (lung, small intestine, or liver) were presented. Participants performed three series of blinded palpation tasks involving three different graspers: the conventional grasper, the FROI with enhanced haptic feedback activated, and the FROI with enhanced haptic feedback deactivated. In each series, nine pairs of organ tissues were palpated to compare consistencies. The orders of presenting both instruments and tissues were randomized.

Results

The force applied during tissue palpation significantly decreased, by a mean factor of 3.1 with enhanced haptic feedback. Tissue consistency interpretation was significantly improved with more correct assessments and participants answered with significantly more confidence when enhanced haptic feedback was available.

Conclusion

The availability of enhanced haptic feedback enabled participants to operate with significantly reduced interaction force between instrument and tissues. This observation is expected to have multiple important clinical implications, such as less tissue damage, fewer complications, shorter operation times, and improved ergonomics.

Instrumental tactile diagnostics in robot-assisted surgery

BACKGROUND

Robotic surgery has gained wide acceptance due to minimizing trauma in patients. However, the lack of tactile feedback is an essential limiting factor for the further expansion. In robotic surgery, feedback related to touch is currently kinesthetic, and it is mainly aimed at the minimization of force applied to tissues and organs. Design and implementation of diagnostic tactile feedback is still an open problem. We hypothesized that a sufficient tactile feedback in robot-assisted surgery can be provided by utilization of Medical Tactile Endosurgical Complex (MTEC), which is a novel specialized tool that is already commercially available in the Russian Federation. MTEC allows registration of tactile images by a mechanoreceptor, real-time visualization of these images, and reproduction of images via a tactile display.

MATERIALS AND METHODS

Nine elective surgeries were performed with da Vinci™ robotic system. An assistant performed tactile examination through an additional port under the guidance of a surgeon during revision of tissues. The operating surgeon sensed registered tactile data using a tactile display, and the assistant inspected the visualization of tactile data. First, surgeries where lesion boundaries were visually detectable were performed. The goal was to promote cooperation between the surgeon and the assistant and to train them in perception of the tactile feedback. Then, instrumental tactile diagnostics was utilized in case of visually undetectable boundaries.

RESULTS

In robot-assisted surgeries where lesion boundaries were not visually detectable, instrumental tactile diagnostics performed using MTEC provided valid identification and localization of lesions. The results of instrumental tactile diagnostics were concordant with the results of intraoperative ultrasound examination. However, in certain cases, for example, thoracoscopy, ultrasound examination is inapplicable, while MTEC-based tactile diagnostics can be efficiently utilized.

CONCLUSION

The study proved that MTEC can be efficiently used in robot-assisted surgery allowing correct localization of visually undetectable lesions and visually undetectable boundaries of pathological changes of tissues.