Reviewing the technological challenges associated with the development of a laparoscopic palpation device

Vibro-acoustic sensing of tissue-instrument-interactions allows a differentiation of biological tissue in computerised palpation

BACKGROUND

The shift towards minimally invasive surgery is associated with a significant reduction of tactile information available to the surgeon, with compensation strategies ranging from vision-based techniques to the integration of sensing concepts into surgical instruments. Tactile information is vital for palpation tasks such as the differentiation of tissues or the characterisation of surfaces. This work investigates a new sensing approach to derive palpation-related information from vibration signals originating from instrument-tissue-interactions.

METHODS

We conducted a feasibility study to differentiate three non-animal and three animal tissue specimens based on palpation of the surface. A sensor configuration was mounted at the proximal end of a standard instrument opposite the tissue-interaction point. Vibro-acoustic signals of 1680 palpation events were acquired, and the time-varying spectrum was computed using Continuous-Wavelet-Transformation. For validation, nine spectral energy-related features were calculated for a subsequent classification using linear Support Vector Machine and k-Nearest-Neighbor.

RESULTS

Indicators derived from the vibration signal are highly stable in a set of palpations belonging to the same tissue specimen, regardless of the palpating subject. Differences in the surface texture of the tissue specimens reflect in those indicators and can serve as a basis for differentiation. The classification following a supervised learning approach shows an accuracy of >93.8% for the three-tissue classification tasks and decreases to 78.8% for a combination of all six tissues.

CONCLUSIONS

Simple features derived from the vibro-acoustic signals facilitate the differentiation between biological tissues, showing the potential of the presented approach to provide information related to the interacting tissue. The results encourage further investigation of a yet little-exploited source of information in minimally invasive surgery.

Reaction Force Mapping by 3-Axis Tactile Sensing With Arbitrary Angles for Tissue Hard-Inclusion Localization

Although robot-assisted diagnosis and minimally invasive surgery (MIS) brings distinct benefits, deficient multi-dimensional force feedback remains a noteworthy limitation and challenge in MIS. Aiming for a comprehensive high-fidelity perception of tissue-instrument interactions, we present a Fiber Bragg Grating (FBG)-based 3-axis tactile sensing for surface reaction force mapping, identification and localization of tissue hard-inclusion. The tactile sensing probe consists of five optical fibers inscribed with FBGs and a force-sensitive 3D printed deformable body. All fibers are suspended inside the deformable body in a parallel manner, leading to the direct compression or tension of each FBG. Such configuration can effectively avoid the chirping failure of FBG compared with the pasting FBG-based sensors. A linearized difference model is proposed to calibrate the 3-axis force detection and enhance the resistance to nonlinear interferences. Hard-inclusion identification experiments with varied hard-inclusion sizes and depths have been implemented through discrete palpation and dragging palpation modes. Results indicate that the probe can effectively identify the presence and location of these small hard-inclusions from the force mapping. Furthermore, lengthy vessels embedded in the phantom can be accurately identified through dragging palpation with an arbitrary contact angle. Another novelty of the probe is the reconstruction of the surface profile of a non-planar tissue, which further allows hard-inclusion identification and 3D localization. Ex-vivo tissue palpation on a porcine kidney further validates the effectiveness and feasibility of the probe to map surface reaction forces and localize the hard-inclusions intraoperatively.

Evaluation of laparoscopic forceps jaw contact pressure and distribution using pressure sensitive film

In this study, the authors used the Fujifilm Prescale Pressure Measuring System to measure the contact pressure and distribution at the jaws of laparoscopic grasping forceps. This data was then correlated with measured pressures at the forceps handles to understand the relationship between the surgeon's actuating pressure and that on the organ being manipulated. The purpose of this study is to create a database of tactile information to provide guidelines in defining minimally invasive surgery (MIS). This is expected to be important as today's society continues to progress in the use of automation, IoT, AI and MIS. In order to achieve the above, the authors developed an experimental device consisting of an actuator, a load cell and an MCU to stably actuate and control the handle side of grasping forceps. Target organs were simulated using triangular prisms of various silicone rubber materials. The experimental method involved actuating the handle side with preset pressure values for fixed time periods and using sensitive film to measure the pressure at the forceps tip. The film data was then scanned, processed and analyzed.

Performance of a Haptic Feedback Grasper in Laparoscopic Surgery: A Randomized Pilot Comparison With Conventional Graspers in a Porcine Model

Background. Compared with open surgery, minimally invasive surgery is limited by reduced sensation of tissue properties. A laparoscopic grasper with integrated haptic feedback technology that improves the ability to sense tissue properties might provide a solution. The force reflecting operation instrument (FROI) is a new laparoscopic grasper, designed to provide information about the interaction forces between the instrument and tissue through resistance in the handle. This pilot study aimed to assess the functionality of the FROI compared with a conventional grasper in an in vivo setting. Methods. In this randomized trial, we used a standard laparoscopic surgical setup to perform laparoscopic surgery in pigs. In all, 11 surgeons performed colorectal, gynecological, or urological procedures, once with the FROI and once with a conventional grasper. Participants were asked to complete the NASA Task Load Index Rating Scale and rate 5 specific features for both graspers. To capture opinions on the overall functionality of the FROI, participants were asked to answer 8 open questions. Results. The surgeons reported that the use of the FROI significantly improved tissue consistency perception, arterial pulse detection, and force control compared with the conventional grasper. No significant differences were found in surgeons' muscular strain or operative time. The most emphasized topics in the open questions were improved soft-tissue handling and importance for complex procedures. Conclusion. Through this first in vivo analysis of the functionality of the FROI, a multispecialty group of laparoscopic surgeons confirmed the added value of haptic feedback technology in a live surgical setting.

A Pneumatic Tactile Ring for Instantaneous Sensory Feedback in Laparoscopic Tumor Localization

We aim to achieve intraoperative localization of an early-stage gastric tumor that cannot be visually detected during laparoscopic surgery. In this study, we developed and evaluated a pneumatic tactile ring, which is a clinically applicable tactile device to provide instantaneous feedback from a tactile sensor directly manipulated by a surgeon. It was designed to be worn on the finger of the manipulating hand and to present pressure to the finger pad. It is lightweight, cost-effective, disposable, and sterilizable. We also developed a compact pneumatic drive unit to control the pressure and investigated its fundamental performance. The bandwidth of the pressure control was at least 1.3 Hz with a controllable range of up to 79.7 kPa. Moreover, a psychophysical experiment was performed to obtain the Weber ratio of the pressure and evaluate the effectiveness of the instantaneous tactile feedback of the sensor output through the tactile ring. The Weber ratio was 0.40 at the reference pressure of 22.7 kPa. The provided tactile feedback significantly reduced the absolute localization error and increased participants' confidence in their answers. It was shown that the tactile feedback through the ring is effective in laparoscopic tumor localization.

DNN-Based Assistant in Laparoscopic Computer-Aided Palpation

Tactile sensory input of surgeons is severely limited in minimally invasive surgery, therefore manual palpation cannot be performed for intraoperative tumor detection. Computer-aided palpation, in which tactile information is acquired by devices and relayed to the surgeon, is one solution for overcoming this limitation. An important design factor is the method by which the acquired information is fed back to the surgeon. However, currently there is no systematic method for achieving this aim, and it is possible that a badly implemented feedback mechanism could adversely affect the performance of the surgeon. In this study, we propose an assistance algorithm for intraoperative tumor detection in laparoscopic surgery. Our scenario is that the surgeon manipulates a sensor probe, makes a decision based on the feedback provided from the sensor, while simultaneously, the algorithm analyzes the time series of the sensor output. Thus, the algorithm assists the surgeon in making decisions by providing independent detection results. A deep neural network model with three hidden layers was used to analyze the sensor output. We propose methods to input the time series of the sensor output to the model for real-time analysis, and to determine the criterion for detection by the model. This study aims to validate the feasibility of the algorithm by using data acquired in our previous psychophysical experiment. There, novice participants were asked to detect a phantom of an early-stage gastric tumor through visual feedback from the tactile sensor. In addition to the analysis of the accuracy, signal detection theory was employed to assess the potential detection performance of the model. The detection performance was compared with that of human participants. We conducted two types of validation, and found that the detection performance of the model was not significantly different from that of the human participants if the data from a known user was included in the model construction. The result supports the feasibility of the proposed algorithm for detection assistance in computer-aided palpation.

Intraoperative real-time tissue elastography during laparoscopic hepatectomy

BACKGROUND

Real-time tissue elastography during open hepatectomy facilitates the differential diagnosis of liver tumors by providing information on elasticity. This study investigated the utility of intraoperative real-time tissue elastography (IORTE) during laparoscopic hepatectomy (LH).

METHODS

Between 2012 and 2014, IORTE was performed during LH for 21 hepatocellular carcinomas (HCCs), 16 adenocarcinomas and 5 other tumors in 32 patients. The elasticity images were classified into six categories according to the modified criteria on the elasticity type of liver tumors, in which type 1 tumors show more strain than the surrounding liver and type 6 tumors no strain. The concordance of the IORTE findings with those of the pathological examination of the tumors was assessed (The registration no. 1418).

RESULTS

Among the 21 HCCs, 20 were classified as "HCC pattern" (type 3, 4, or 5), resulting in a sensitivity of 95.2%, a specificity of 66.7% and an accuracy of 81.0%. Ten out of the 16 adenocarcinomas were classified as "adenocarcinoma pattern" (type 6), resulting in a sensitivity of 62.5%, a specificity of 92.3% and an accuracy of 81.0%.

CONCLUSION

IORTE is feasible and provides useful information on the elasticity of liver tumors in LH, in which conventional tumor palpation is difficult.

Prevalence of haptic feedback in robot-mediated surgery: a systematic review of literature

With the successful uptake and inclusion of robotic systems in minimally invasive surgery and with the increasing application of robotic surgery (RS) in numerous surgical specialities worldwide, there is now a need to develop and enhance the technology further. One such improvement is the implementation and amalgamation of haptic feedback technology into RS which will permit the operating surgeon on the console to receive haptic information on the type of tissue being operated on. The main advantage of using this is to allow the operating surgeon to feel and control the amount of force applied to different tissues during surgery thus minimising the risk of tissue damage due to both the direct and indirect effects of excessive tissue force or tension being applied during RS. We performed a two-rater systematic review to identify the latest developments and potential avenues of improving technology in the application and implementation of haptic feedback technology to the operating surgeon on the console during RS. This review provides a summary of technological enhancements in RS, considering different stages of work, from proof of concept to cadaver tissue testing, surgery in animals, and finally real implementation in surgical practice. We identify that at the time of this review, while there is a unanimous agreement regarding need for haptic and tactile feedback, there are no solutions or products available that address this need. There is a scope and need for new developments in haptic augmentation for robot-mediated surgery with the aim of improving patient care and robotic surgical technology further.

Prostate Cancer Detection with a Tactile Resonance Sensor-Measurement Considerations and Clinical Setup

Tumors in the human prostate are usually stiffer compared to surrounding non-malignant glandular tissue, and tactile resonance sensors measuring stiffness can be used to detect prostate cancer. To explore this further, we used a tactile resonance sensor system combined with a rotatable sample holder where whole surgically removed prostates could be attached to detect tumors on, and beneath, the surface ex vivo. Model studies on tissue phantoms made of silicone and porcine tissue were performed. Finally, two resected human prostate glands were studied. Embedded stiff silicone inclusions placed 4 mm under the surface could be detected in both the silicone and biological tissue models, with a sensor indentation of 0.6 mm. Areas with different amounts of prostate cancer (PCa) could be distinguished from normal tissue (p < 0.05), when the tumor was located in the anterior part, whereas small tumors located in the dorsal aspect were undetected. The study indicates that PCa may be detected in a whole resected prostate with an uneven surface and through its capsule. This is promising for the development of a clinically useful instrument to detect prostate cancer during surgery.

Instrumental tactile diagnostics in robot-assisted surgery

BACKGROUND

Robotic surgery has gained wide acceptance due to minimizing trauma in patients. However, the lack of tactile feedback is an essential limiting factor for the further expansion. In robotic surgery, feedback related to touch is currently kinesthetic, and it is mainly aimed at the minimization of force applied to tissues and organs. Design and implementation of diagnostic tactile feedback is still an open problem. We hypothesized that a sufficient tactile feedback in robot-assisted surgery can be provided by utilization of Medical Tactile Endosurgical Complex (MTEC), which is a novel specialized tool that is already commercially available in the Russian Federation. MTEC allows registration of tactile images by a mechanoreceptor, real-time visualization of these images, and reproduction of images via a tactile display.

MATERIALS AND METHODS

Nine elective surgeries were performed with da Vinci™ robotic system. An assistant performed tactile examination through an additional port under the guidance of a surgeon during revision of tissues. The operating surgeon sensed registered tactile data using a tactile display, and the assistant inspected the visualization of tactile data. First, surgeries where lesion boundaries were visually detectable were performed. The goal was to promote cooperation between the surgeon and the assistant and to train them in perception of the tactile feedback. Then, instrumental tactile diagnostics was utilized in case of visually undetectable boundaries.

RESULTS

In robot-assisted surgeries where lesion boundaries were not visually detectable, instrumental tactile diagnostics performed using MTEC provided valid identification and localization of lesions. The results of instrumental tactile diagnostics were concordant with the results of intraoperative ultrasound examination. However, in certain cases, for example, thoracoscopy, ultrasound examination is inapplicable, while MTEC-based tactile diagnostics can be efficiently utilized.

CONCLUSION

The study proved that MTEC can be efficiently used in robot-assisted surgery allowing correct localization of visually undetectable lesions and visually undetectable boundaries of pathological changes of tissues.

Can virtual reality trainers improve the compliance discrimination abilities of trainee surgeons?

The assessment of tissue compliance using a handheld tool is an important skill in medical areas such as laparoscopic and dental surgery. The increasing prevalence of virtual reality devices raises the question of whether we can exploit these systems to accelerate the training of compliance discrimination in trainee surgeons. We used a haptic feedback device and stylus to assess the abilities of naïve participants to detect compliance differences with and without knowledge of results (KR) (groups 1 and 2), as well as the abilities of participants who had undergone repetitive training over several days (group 3). Kinematic analyses were carried out to objectively measure the probing action. Untrained participants had poor detection thresholds (mean just noticeable difference, JND = 33%), and we found no effect of KR (provided after each trial) on performance (mean JND = 35%). Intensive training dramatically improved group performance (mean JND = 12%). Probing action (in particular, slower movement execution) was associated with better detection thresholds, but training did not lead to systematic changes in probing behaviour. These findings set a benchmark for training systems that act to increase perceptual sensitivity and guide the learner toward optimal movement strategies to improve discrimination.

Tissue quality assessment using a novel direct elasticity assessment device (the E-finger): a cadaveric study of prostatectomy dissection

Introduction

Minimally invasive radical prostatectomy (RP) (robotic and laparoscopic), have brought improvements in the outcomes of RP due to improved views and increased degrees of freedom of surgical devices. Robotic and laparoscopic surgeries do not incorporate haptic feedback, which may result in complications secondary to inadequate tissue dissection (causing positive surgical margins, rhabdosphincter damage, etc). We developed a micro-engineered device (6 mm² sized) [E-finger]) capable of quantitative elasticity assessment, with amplitude ratio, mean ratio and phase lag representing this. The aim was to assess the utility of the device in differentiating peri-prostatic tissue types in order to guide prostate dissection.

Material and Methods

Two embalmed and 2 fresh frozen cadavers were used in the study. Baseline elasticity values were assessed in bladder, prostate and rhabdosphincter of pre-dissected embalmed cadavers using the micro-engineered device. A measurement grid was created to span from the bladder, across the prostate and onto the rhabdosphincter of fresh frozen cadavers to enable a systematic quantitative elasticity assessment of the entire area by 2 independent assessors. Tissue was sectioned along each row of elasticity measurement points, and stained with haematoxylin and eosin (H&E). Image analysis was performed with Image Pro Premier to determine the histology at each measurement point.

Results

Statistically significant differences in elasticity were identified between bladder, prostate and sphincter in both embalmed and fresh frozen cadavers (p = <0.001). Intra-class correlation (ICC) reliability tests showed good reliability (average ICC = 0.851). Sensitivity and specificity for tissue identification was 77% and 70% respectively to a resolution of 6 mm².

Conclusions

This cadaveric study has evaluated the ability of our elasticity assessment device to differentiate bladder, prostate and rhabdosphincter to a resolution of 6 mm². The results provide useful data for which to continue to examine the use of elasticity assessment devices for tissue quality assessment with the aim of giving haptic feedback to surgeons performing complex surgery.