Force controlled and teleoperated endoscopic grasper for minimally invasive surgery--experimental performance evaluation

Biomechanics of Hollow Organs: Experimental Testing and Computational Modeling

Hollow organs are visceral organs that are hollow tubes or pouches (such as the intestine or the stomach, respectively) or that include a cavity (such as the heart) and which subserve a vital function [...].

The Effect of Kinesthetic and Artificial Tactile Noise and Variability on Stiffness Perception

Robot-assisted minimally invasive surgeries (RAMIS) have many benefits. A disadvantage, however, is the lack of haptic feedback. Haptic feedback is comprised of kinesthetic and tactile information, and we use both to form stiffness perception. Applying both kinesthetic and tactile feedback can enable more precise feedback than kinesthetic feedback alone. However, during remote surgeries, haptic noises and variations can be present. Therefore, toward designing haptic feedback for RAMIS, it is important to understand the effect of haptic manipulations on stiffness perception. We assessed the effect of two manipulations using stiffness discrimination tasks in which participants received force feedback and artificial skin stretch. In Experiment 1, we added sinusoidal noise to the artificial tactile signal, and found that the noise did not affect participants' stiffness perception or uncertainty. In Experiment 2, we varied either the kinesthetic or the artificial tactile information between consecutive interactions with an object. We found that the both forms of variability did not affect stiffness perception, but kinesthetic variability increased participants' uncertainty. We show that haptic feedback, comprised of force feedback and artificial skin stretch, provides robust haptic information even in the presence of noise and variability, and hence can potentially be both beneficial and viable in RAMIS.

Tactile Sensing for Minimally Invasive Surgery: Conventional Methods and Potential Emerging Tactile Technologies

As opposed to open surgery procedures, minimally invasive surgery (MIS) utilizes small skin incisions to insert a camera and surgical instruments. MIS has numerous advantages such as reduced postoperative pain, shorter hospital stay, faster recovery time, and reduced learning curve for surgical trainees. MIS comprises surgical approaches, including laparoscopic surgery, endoscopic surgery, and robotic-assisted surgery. Despite the advantages that MIS provides to patients and surgeons, it remains limited by the lost sense of touch due to the indirect contact with tissues under operation, especially in robotic-assisted surgery. Surgeons, without haptic feedback, could unintentionally apply excessive forces that may cause tissue damage. Therefore, incorporating tactile sensation into MIS tools has become an interesting research topic. Designing, fabricating, and integrating force sensors onto different locations on the surgical tools are currently under development by several companies and research groups. In this context, electrical force sensing modality, including piezoelectric, resistive, and capacitive sensors, is the most conventionally considered approach to measure the grasping force, manipulation force, torque, and tissue compliance. For instance, piezoelectric sensors exhibit high sensitivity and accuracy, but the drawbacks of thermal sensitivity and the inability to detect static loads constrain their adoption in MIS tools. Optical-based tactile sensing is another conventional approach that facilitates electrically passive force sensing compatible with magnetic resonance imaging. Estimations of applied loadings are calculated from the induced changes in the intensity, wavelength, or phase of light transmitted through optical fibers. Nonetheless, new emerging technologies are also evoking a high potential of contributions to the field of smart surgical tools. The recent development of flexible, highly sensitive tactile microfluidic-based sensors has become an emerging field in tactile sensing, which contributed to wearable electronics and smart-skin applications. Another emerging technology is imaging-based tactile sensing that achieved superior multi-axial force measurements by implementing image sensors with high pixel densities and frame rates to track visual changes on a sensing surface. This article aims to review the literature on MIS tactile sensing technologies in terms of working principles, design requirements, and specifications. Moreover, this work highlights and discusses the promising potential of a few emerging technologies towards establishing low-cost, high-performance MIS force sensing.

An extended algorithm for autonomous grasping of soft tissues during robotic surgery

BACKGROUND

Autonomous grasping of soft tissues can facilitate the robotic surgery procedures. The previous attempts for implementing auto-grasping have been based on a simplistic representation of the actual surgery maneuvers.

METHOD

A generalized three-zone grasp model was introduced to consider the effect of the pull force angulation on the grasp mode, that is, damage, slip, or safe grasp. Also, an extended auto-grasping algorithm was proposed in which the trigger force is automatically controlled against the pull force magnitude and direction, to achieve a safe and secure grasp.

RESULTS

The autonomous grasping experiments against a varying pull force in a phantom study indicated a good agreement between the desired and actual pinch and trigger forces (root mean square errors lower than 0.168 N and 0.280 N, respectively) and no sign of tissue tear or slippage.

CONCLUSIONS

The proposed auto-grasping algorithm can help manipulating the soft tissues safely and effectively during robotic surgery procedures.

Haptics in Teleoperated Medical Interventions: Force Measurement, Haptic Interfaces and Their Influence on User's Performance

OBJECTIVES

Haptics in teleoperated medical interventions enables measurement and transfer of force information to the operator during robot-environment interaction. This paper provides an overview of the current research in this domain and guidelines for future investigations.

METHODS

We review current technologies in force measurement and haptic devices as well as their experimental evaluation and influence on user's performance.

RESULTS

Force sensing is moving away from the conventional proximal measurement methods to distal sensing and contact-less methods. Wearable devices that deliver haptic feedback on different body parts are increasingly playing an important role. Performance and accuracy improvement are the widely reported benefits of haptic feedback, while there is a debate on its effect on task completion time and exerted force.

CONCLUSION

With the surge of new ideas, there is a need for better and more systematic validation of the new sensing and feedback technology, through better user studies and novel methods like validated benchmarks and new taxonomies.

SIGNIFICANCE

This review investigates haptics from sensing to interfaces within the context of user's performance and the validation procedures to highlight salient advances. It provides guidelines to future developments and highlights the shortcomings in the field.

Real-Time Vision-Based Stiffness Mapping †

This paper presents new findings concerning a hand-held stiffness probe for the medical diagnosis of abnormalities during palpation of soft-tissue. Palpation is recognized by the medical community as an essential and low-cost method to detect and diagnose disease in soft-tissue. However, differences are often subtle and clinicians need to train for many years before they can conduct a reliable diagnosis. The probe presented here fills this gap providing a means to easily obtain stiffness values of soft tissue during a palpation procedure. Our stiffness sensor is equipped with a multi degree of freedom (DoF) Aurora magnetic tracker, allowing us to track and record the 3D position of the probe whilst examining a tissue area, and generate a 3D stiffness map in real-time. The stiffness probe was integrated in a robotic arm and tested in an artificial environment representing a good model of soft tissue organs; the results show that the sensor can accurately measure and map the stiffness of a silicon phantom embedded with areas of varying stiffness.

Disposable soft 3 axis force sensor for biomedical applications

This paper proposes a new disposable soft 3D force sensor that can be used to calculate either force or displacement and vibrations. It uses three Hall Effect sensors orthogonally placed around a cylindrical beam made of silicon rubber. A niobium permanent magnet is inside the silicon. When a force is applied to the end of the cylinder, it is compressed and bent to the opposite side of the force displacing the magnet. This displacement causes change in the magnetic flux around the ratiomatric linear sensors (Hall Effect sensors). By analysing these changes, we calculate the force or displacement in three directions using a lookup table. This sensor can be used in minimal invasive surgery and haptic feedback applications. The cheap construction, bio-compatibility and ease of miniaturization are few advantages of this sensor. The sensor design, and its characterization are presented in this work.

Three-dimensional nonlinear force-sensing method based on double microgrippers with E-type vertical elastomer for minimally invasive robotic surgery

This paper presents a new type of forceps that consist of two microgrippers with the capability of direct force sensing, which enables grasping and manipulating forces at the tip of surgical instrument for minimally invasive robotic surgery. For the prototype design of the forceps, a double E-type vertical elastomer with four strain beams is presented, whose force-sensing principle is expounded. Thus, the forceps with the elastomer can be considered a compliant component, which provides tiny displacements that allow large strain, and the overall diameter is 10 mm. The sizes of the elastomer and forceps are successively determined by analyzing the relationship of several parameters and strain. Then, the linearity analysis of strain beams determines the positions to apply gauges for sensing. The two-dimensional force decoupling models for a single microgripper are proposed based on piecewise analytical polynomials of the strain difference and employed to develop a new three-dimensional force nonlinear decoupling algorithm based on double microgrippers, which realizes single-axial grasping and three-axial pulling forces. Finally, the required force-sensing performance of the proposed method is successfully verified in theory using finite-element simulations.

Grasper integrated tri-axial force sensor system for robotic minimally invasive surgery

This paper describes the design, microfabrication, and characterization of a miniature force sensor for providing tactile feedback in robotic surgical systems. We demonstrate for the first time a microfabricated sensor that can provide triaxial sensing (normal, x-shear, y-shear) in a single sensor element that can be integrated with commercial robotic surgical graspers. Features of this capacitive force sensor include differential sensing in the shear directions as well as a design where all electrical connections are on one side, leaving the backside pristine as the sensing face. The sensor readout is performed by a custom-designed printed circuit board with 24-bit resolution. Experimental results of sensor performance show normal force resolution of 0.055 N, x-shear resolution of 0.25 N, and y-shear resolution of 1.45 N, all of which fall in a range of clinically relevant forces.

Influence of clamping stress and duration on the trauma of liver tissue during surgery operation

BACKGROUND

Tissue grasping damage often occurs in minimally invasive surgery, which would increase the postoperative recovery time and the risk of surgical complications. The purpose of this study was to evaluate the relationship between liver tissue trauma and compression stress magnitude and duration during tissue clamping operation.

METHODS

The clamping experiments of liver tissues in vivo were conducted by using a universal soft tissue mechanical testing machine under different clamping stress magnitudes and durations. The rabbit liver was used to simulate human liver. A minimally invasive surgery grasper was used in these tests to simulate the real tissue-surgical operation condition. A pathological grading system was created to quantitatively assess the trauma within the liver tissue. The hyperbolic regression models were utilized to predict the trauma degree of liver tissue.

FINDINGS

Obvious hyperemia, hemorrhage, hepatic capsule rupture and inflammatory cell infiltration appeared in the clamping sites of the liver. Assessment results indicated that the trauma degree increased nonlinearly with the increasing clamping stress and duration time. There exist safe thresholds, in which the severe trauma of the studied tissue can be avoided during grasping operation.

INTERPRETATION

The results could provide the safety margins and the trauma prediction models for surgeons during grasping and palpation tasks in minimally invasive surgery.

Development and testing of a grasper for NOTES powered by variable stiffness pneumatic actuation

BACKGROUND

In natural orifice transluminal endoscopic surgery (NOTES) the peritoneal cavity is reached through natural orifices (mouth, rectus and transvaginal duct), by means of little cuttings in the walls of hollow organs. Due to narrow spaces, NOTES needs robotic systems to assure operation/movement precision and patient safety. Variable stiffness actuation (VSA) assures both requirements.

METHODS

The authors developed a grasper for NOTES, provided with VSA, to use as an end-effector for snail robot devices. The present paper deals with basic concepts of VSA and describes the design and architecture of the grasper. Characterization and functional experiments were performed and results analysed.

RESULTS

A finite element model developed for the actuator design was validated, performance grasper characteristic curves were obtained, VSA was validated, and the gripping capability of several objects was assessed.

CONCLUSION

The grasper satisfies technical design specifications. On the basis of the results obtained, a control system can be developed to test grasper in a simulated surgery environment.

A modular force-controlled robotic instrument for minimally invasive surgery - efficacy for being used in autonomous grasping against a variable pull force

BACKGROUND

Many deficiencies of minimally invasive robotic surgery systems can be eliminated by using automated laparoscopic tools with force measurement and control capability.

METHOD

A fully modular, automated laparoscopic instrument with a proximal force sensory system was designed and fabricated. The efficacy of the instrument was evaluated experimentally when functioning in an autonomous force-controlled grasping scheme.

RESULTS

The designed instrument was shown to work easily with standard laparoscopic tools, with the whole distal part detachable for autoclave sterilization. The root mean squared error (RMSE) of the actual pinch force from the target ramp was 0.318 N; it was 0.402 N for a sinusoidal pull force, which dropped by 21% using a static friction compensation. A secure grasping condition was achieved, in spite of this error, by applying a sufficiently large margin from the slip boundary.

CONCLUSIONS

With a simple and practical design, the instrument enjoys affordability, versatility and autoclave sterilizability for clinical usage, with an acceptable performance for being used in an auto-grasping control scheme. Copyright © 2016 John Wiley & Sons, Ltd.

Methods for Multiloop Identification of Visual and Neuromuscular Pilot Responses

In this paper, identification methods are proposed to estimate the neuromuscular and visual responses of a multiloop pilot model. A conventional and widely used technique for simultaneous identification of the neuromuscular and visual systems makes use of cross-spectral density estimates. This paper shows that this technique requires a specific noninterference hypothesis, often implicitly assumed, that may be difficult to meet during actual experimental designs. A mathematical justification of the necessity of the noninterference hypothesis is given. Furthermore, two methods are proposed that do not have the same limitations. The first method is based on autoregressive models with exogenous inputs, whereas the second one combines cross-spectral estimators with interpolation in the frequency domain. The two identification methods are validated by offline simulations and contrasted to the classic method. The results reveal that the classic method fails when the noninterference hypothesis is not fulfilled; on the contrary, the two proposed techniques give reliable estimates. Finally, the three identification methods are applied to experimental data from a closed-loop control task with pilots. The two proposed techniques give comparable estimates, different from those obtained by the classic method. The differences match those found with the simulations. Thus, the two identification methods provide a good alternative to the classic method and make it possible to simultaneously estimate human's neuromuscular and visual responses in cases where the classic method fails.

Sensing elasticity from the phase difference of the stepper motor

We have developed a made-to-order surgical support manipulator with a function that senses the mechanical characteristics of internal organs, and which can be customized based on the maximum grasping force of the patient. The purpose of this study is to establish an elasticity-sensing model that uses the phase difference of the stepper motor based on material strength and to apply it to in vitro organs. In this study, we propose a measurement model and develop a prototype that is used in experiments on silicon rubber and in vitro organs in a dog. Young's modulus E and spring constant K are measured by the prototype and a material testing machine. The results of the prototype showed good agreement with those of the material testing machine, and that the proposed model will be a great help in the development of surgical support manipulators.

Simultaneous Estimation of Elasticity for Multiple Deformable Bodies

Material property has great importance in deformable body simulation and medical robotics. The elasticity parameters, such as Young's modulus of the deformable bodies, are important to make realistic animations. Further in medical applications the (recovered) elasticity parameters can assist surgeons to perform better pre-op surgical planning and enable medical robots to carry out personalized surgical procedures. Previous elasticity parameters estimation methods are limited to recover one elasticity parameter of one deformable body at a time. In this paper, we propose a novel elasticity parameter estimation algorithm that can recover the elasticity parameters of multiple deformable bodies or multiple regions of one deformable body simultaneously from (at least two sets of) images. We validate our algorithm with both synthetic test cases and real patient CT images.

Finite element analysis for evaluating liver tissue damage due to mechanical compression

The development of robotic-assisted minimally invasive surgery (RMIS) has resulted in increased research to improve surgeon training, proficiency and patient safety. Minimizing tissue damage is an essential consideration in RMIS. Various studies have reported the quantified tissue damage resulting from mechanical compression; however, most of them require bench work analysis, which limits their application in clinical conditions of RMIS. We present a new methodology based on nonlinear finite element (FE) analysis that can predict damage degree inside tissue. The effects of the boundary conditions and material property of the FE model on the simulated von Mises stress value and tissue damage were investigated. Four FE models were analyzed: two-dimensional (2D) plane strain model, 2D plane stress model, full three-dimensional (3D) model, and 3D thin membrane model. Nonlinear material properties of liver tissue used in the FEA were derived from previously reported in vivo and in vitro experiments. Our study showed that for integrated von Mises stress and tissue damage computations, the 3D thin membrane model yielded results closest to the full 3D analysis and required only 0.2% of the compute time. The results from 3D thin membrane and the full 3D models fell below plane-strain model and above the plane-stress model. Both stress and necrosis distributions were impacted by the material property of FE models. This study can guide engineers to design surgical instruments to improve patient safety. Additionally it is useful for improving the surgical simulator performance by reflecting more realistic tissue material property and displaying tissue damage severity.

Quantification of Forces During a Neurosurgical Procedure: A Pilot Study

OBJECTIVE

Knowledge of tool-tissue interaction is mostly taught and learned in a qualitative manner because a means to quantify the technical aspects of neurosurgery is currently lacking. Neurosurgeons typically require years of hands-on experience, together with multiple initial trial and error, to master the optimal force needed during the performance of neurosurgical tasks. The aim of this pilot study was to develop a novel force-sensing bipolar forceps for neurosurgery and obtain preliminary data on specific tasks performed on cadaveric brains.

METHODS

A novel force-sensing bipolar forceps capable of measuring coagulation and dissection forces was designed and developed by installing strain gauges along the length of the bipolar forceps prongs. The forceps was used in 3 cadaveric brain experiments and forces applied by an experienced neurosurgeon for 10 surgical tasks across the 3 experiments were quantified.

RESULTS

Maximal peak (effective) forces of 1.35 N and 1.16 N were observed for dissection (opening) and coagulation (closing) tasks, respectively. More than 70% of forces applied during the neurosurgical tasks were less than 0.3 N. Mean peak forces ranged between 0.10 N and 0.41 N for coagulation of scalp vessels and pia-arachnoid, respectively, and varied from 0.16 N for dissection of small cortical vessel to 0.65 N for dissection of the optic chiasm.

CONCLUSIONS

The force-sensing bipolar forceps were able to successfully measure and record real-time tool-tissue interaction throughout the 3 experiments. This pilot study serves as a first step toward quantification of tool-tissue interaction forces in neurosurgery for training and improvement of instrument handling skills.

Endoscopic add-on stiffness probe for real-time soft surface characterisation in MIS

This paper explores a novel stiffness sensor which is mounted on the tip of a laparoscopic camera. The proposed device is able to compute stiffness when interacting with soft surfaces. The sensor can be used in Minimally Invasive Surgery, for instance, to localise tumor tissue which commonly has a higher stiffness when compared to healthy tissue. The purely mechanical sensor structure utilizes the functionality of an endoscopic camera to the maximum by visually analyzing the behavior of trackers within the field of view. Two pairs of spheres (used as easily identifiable features in the camera images) are connected to two springs with known but different spring constants. Four individual indenters attached to the spheres are used to palpate the surface. During palpation, the spheres move linearly towards the objective lens (i.e. the distance between lens and spheres is changing) resulting in variations of their diameters in the camera images. Relating the measured diameters to the different spring constants, a developed mathematical model is able to determine the surface stiffness in real-time. Tests were performed using a surgical endoscope to palpate silicon phantoms presenting different stiffness. Results show that the accuracy of the sensing system developed increases with the softness of the examined tissue.

Control devices and steering strategies in pathway surgery

For pathway surgery, that is, minimally invasive procedures carried out transluminally or through instrument-created pathways, handheld maneuverable instruments are being developed. As the accompanying control interfaces of such instruments have not been optimized for intuitive manipulation, we investigated the effect of control mode (1DoF or 2DoF), and control device (joystick or handgrip) on human performance in a navigation task. The experiments were conducted using the Endo-PaC (Endoscopic-Path Controller), a simulator that emulates the shaft and handle of a maneuverable instrument, combined with custom-developed software animating pathway surgical scenarios. Participants were asked to guide a virtual instrument without collisions toward a target located at the end of a virtual curved tunnel. The performance was assessed in terms of task completion time, path length traveled by the virtual instrument, motion smoothness, collision metrics, subjective workload, and personal preference. The results indicate that 2DoF control leads to faster task completion and fewer collisions with the tunnel wall combined with a strong subjective preference compared with 1DoF control. Handgrip control appeared to be more intuitive to master than joystick control. However, the participants experienced greater physical demand and had longer path lengths with handgrip than joystick control.

A Novel Structure of a Less Invasive Forceps to Realize Linear Clamping for Endoscopic Surgery

Safety is always a commonly concerned issue during the development of minimally invasive surgery for more than 30 yr. For the absence of force feedback in conventional forceps, excessive pressure may be applied on tissues leading to unexpected injury. In this paper, a gear-rack endoscopic forceps structure embedded with a shape memory alloy (SMA) is proposed to solve this problem. The gear-rack jaws structure enables a linear relation between clamping pressure and handling force which makes the estimating clamping force easier for a surgeon. The SMA wire is embedded to control the clamping pressure at a certain value which is necessary and sufficient for tissue clamping. In this way, the forceps with these two features could make surgery much safer. A prototype is designed to demonstrate the concept.

DEVELOPMENT OF A SIX-DIMENSIONAL SENSOR FOR MINIMALLY INVASIVE ROBOTIC SURGERY

In minimally invasive robotic surgery (MIRS), the force/torque which occurred between instruments and organs cannot be accessed by surgeon. This paper presents development of a six-dimensional sensor based on double-hole parallel crossing beam, which can be integrated into instruments of MIRS. The size of sensor is 9.8 mm (diameter) × 6 mm (height). The structure of the sensor can acquire the force signals directly. The decoupling mechanism of the sensor was analyzed. The result of the finite element analysis (FEA) showed that the maximum coupling error was 3.8%. The machining error of the sensor was also investigated, and it was feasible for numerical control (NC) machine tools to manufacture the components of the sensor. The experimental calibration and soft tissue experiment indicated that the developed sensor can measure the force/torque loaded on the instrument and can be used to obtain the force feedback in the application of teleoperation surgical robot.

Nonlinear bilateral teleoperation using extended active observer for force estimation and disturbance suppression

A novel nonlinear teleoperation algorithm for simultaneous inertial parameters and force estimation at the master and slave sides of the teleoperation system is proposed. The scheme, called Extended Active Observer (EAOB), is an extension of the existing active observer. It provides effective force tracking at the master side with accurate position tracking at the slave side in the presence of inertial parameter variation and measurement noise. The proposed method only requires the measurement of robot position, and as a result significantly reduces the difficulty and cost of implementing bilateral teleoperation systems. The approach is described and its stability is analytically verified. The performance of the method is validated through computer simulation and compared with the Nicosia observer-based controller. According to the results, EAOB outperforms the Nicosia observer method and effectively rejects noise.

HAPTIC MODELING OF STOMACH FOR REAL-TIME PROPERTY AND FORCE ESTIMATION

Robotic devices are being employed in gastrointestinal endoscopy procedures for diagnostics and surgery. However, force measurement, a very important factor for control and haptic feedback, becomes very challenging due to the strict size limitation of such devices and the flexible nature of the endoscope. This paper focuses on the modeling of the interior stomach wall for tool–tissue interactions from two perspectives: (1) If the interaction force between the robotic tool and the tissue can be measured, we utilize the force information to estimate the mechanical property of the stomach wall in real-time; given the force and position information, we would derive mathematically the only system model that can guarantee identifiability under arbitrary manipulation; (2) in the worst case scenario where force measurement is not available, we propose a viscoelastic model to restore force information solely based on position and motion information available from the robot. Ex-vivo experiments were performed on porcine stomach specimens to demonstrate the performance of the proposed models. Based on these findings, generalization and implementations of the modeling in real-time applications were discussed.

Arthroscopic proficiency: methods in evaluating competency

BACKGROUND

The current paradigm of arthroscopic training lacks objective evaluation of technical ability and its adequacy is concerning given the accelerating complexity of the field. To combat insufficiencies, emphasis is shifting towards skill acquisition outside the operating room and sophisticated assessment tools. We reviewed (1) the validity of cadaver and surgical simulation in arthroscopic training, (2) the role of psychomotor analysis and arthroscopic technical ability, (3) what validated assessment tools are available to evaluate technical competency, and (4) the quantification of arthroscopic proficiency.

METHODS

The Medline and Embase databases were searched for published articles in the English literature pertaining to arthroscopic competence, arthroscopic assessment and evaluation and objective measures of arthroscopic technical skill. Abstracts were independently evaluated and exclusion criteria included articles outside the scope of knee and shoulder arthroscopy as well as original articles about specific therapies, outcomes and diagnoses leaving 52 articles cited in this review.

RESULTS

Simulated arthroscopic environments exhibit high levels of internal validity and consistency for simple arthroscopic tasks, however the ability to transfer complex skills to the operating room has not yet been established. Instrument and force trajectory data can discriminate between technical ability for basic arthroscopic parameters and may serve as useful adjuncts to more comprehensive techniques. There is a need for arthroscopic assessment tools for standardized evaluation and objective feedback of technical skills, yet few comprehensive instruments exist, especially for the shoulder. Opinion on the required arthroscopic experience to obtain proficiency remains guarded and few governing bodies specify absolute quantities.

CONCLUSIONS

Further validation is required to demonstrate the transfer of complex arthroscopic skills from simulated environments to the operating room and provide objective parameters to base evaluation. There is a deficiency of validated assessment tools for technical competencies and little consensus of what constitutes a sufficient case volume within the arthroscopy community.

Real time cancer prediction based on objective tissue compliance measurement in endoscopic surgery

OBJECTIVE

To investigate the feasibility of real time cancer tissue diagnosis intraoperatively based on in vivo tissue compliance measurements obtained by a recently developed laparoscopic smart device.

BACKGROUND

Cancer tissue is stiffer than its normal counterpart. Modern forms of remote surgery such as laparoscopic and robotic surgical techniques diminish direct assessment of this important tissue property. In vivo human tissue compliance of the normal and cancer gastrointestinal tissue is unknown. A Clinical Real Time Tissue Compliance Mapping System (CRTCMS) with a predictive power comparable to the human hand and useable in routine surgical practice has been recently developed.

METHODS

The CRTCMS is employed in the operating theater to collect data from 50 patients undergoing intra-abdominal surgical interventions [40 men, 10 women, aged between 32 and 89 (mean = 66.4, range = 57)]. This includes 10 esophageal and 27 gastric cancer patients. A total of 1212 compliance measurements of normal and cancerous in vivo gastrointestinal tissues were taken. The data were used to calibrate the CRTCMS to predict cancerous tissue in a further 12 patients (3 cancer esophagus and 9 cancer stomach) involving 175 measurements.

RESULTS

The system demonstrated a high prediction power to diagnose cancer tissue in real time during routine surgical procedures (sensitivity = 98.7%, specificity = 99%). An in vivo human tissue compliance data bank of the gastrointestinal tract was produced.

CONCLUSIONS

Real time cancer diagnosis based on in vivo tissue compliance measurements is feasible. The reported data open new avenues in cancer diagnostics, surgical robotics, and development of more realistic surgical simulators.

A triple-jaw actuated and sensorized instrument for grasping large organs during minimally invasive robotic surgery

BACKGROUND

Secure grasping and effective manipulation of delicate large organs during robotic surgery operations needs especially designed instruments that can enclose a large amount of tissue and feed back the pinch forces.

METHODS

A large organ triple-jaw grasper was instrumented using practical force sensory and actuating systems. A force tracking scheme was proposed to facilitate auto-grasping of large organs during robotic teleoperation surgery. An on-site force commanding/reflecting mechanism was also implemented to use the device as an independent hand-held robotic instrument. The efficacy of the robotic grasper was examined in phantom tests.

RESULTS

The instrument grasped large soft objects effectively and safely with accurately measured and controlled pinch forces. Furthermore, it could characterize the overall mechanical behavior of the grasping objects.

CONCLUSIONS

The instrument designed provides a potential solution for the safe and effective grasping and manipulation of large abdominal organs, either as a hand-held device, or in a teleoperation framework.

Reviewing the technological challenges associated with the development of a laparoscopic palpation device

Minimally invasive surgery (MIS) has heralded a revolution in surgical practice, with numerous advantages over open surgery. Nevertheless, it prevents the surgeon from directly touching and manipulating tissue and therefore severely restricts the use of valuable techniques such as palpation. Accordingly a key challenge in MIS is to restore haptic feedback to the surgeon. This paper reviews the state-of-the-art in laparoscopic palpation devices (LPDs) with particular focus on device mechanisms, sensors and data analysis. It concludes by examining the challenges that must be overcome to create effective LPD systems that measure and display haptic information to the surgeon for improved intraoperative assessment.

Perception and Action in Teleoperated Needle Insertion

We studied the effect of delay on perception and action in contact with a force field that emulates elastic soft tissue with a rigid nonlinear boundary. Such a field is similar to forces exerted on a needle during teleoperated needle insertion. We found that delay causes motor underestimation of the stiffness of this nonlinear soft tissue, without perceptual change. These experimental results are supported by simulation of a simplified mechanical model of the arm and neural controller, and a model for perception of stiffness, which is based on regression in the force-position space. In addition, we show that changing the gain of the teleoperation channel cancels the motor effect of delay without adding perceptual distortion. We conclude that it is possible to achieve perceptual and motor transparency in virtual one-dimensional remote needle insertion task.

Force feedback in a piezoelectric linear actuator for neurosurgery

BACKGROUND

Force feedback in robotic minimally invasive surgery allows the human operator to manipulate tissues as if his/her hands were in contact with the patient organs. A force sensor mounted on the probe raises problems with sterilization of the overall surgical tool. Also, the use of off-axis gauges introduces a moment that increases the friction force on the bearing, which can easily mask off the signal, given the small force to be measured.

METHODS

This work aims at designing and testing two methods for estimating the resistance to the advancement (force) experienced by a standard probe for brain biopsies within a brain-like material. The further goal is to provide a neurosurgeon using a master-slave tele-operated driver with direct feedback on the tissue mechanical characteristics. Two possible sensing methods, in-axis strain gauge force sensor and position-position error (control-based method), were implemented and tested, both aimed at device miniaturization. The analysis carried out was aimed at fulfilment of the psychophysics requirements for force detection and delay tolerance, also taking into account safety, which is directly related to the last two issues. Controller parameters definition is addressed and consideration is given to development of the device with integration of a haptic interface.

RESULTS

Results show better performance of the control-based method (RMSE < 0.1 N), which is also best for reliability, sterilizability, and material dimensions for the application addressed.

CONCLUSIONS

The control-based method developed for force estimation is compatible with the neurosurgical application and is also capable of measuring tissue resistance without any additional sensors. Force feedback in minimally invasive surgery allows the human operator to manipulate tissues as if his/her hands were in contact with the patient organs.

Learning kinematic mappings in laparoscopic surgery

We devised an interactive environment in which subjects could perform simulated laparoscopic maneuvers, using either unconstrained movements or standard mechanical contact typical of a box-trainer. During training the virtual tool responded to the absolute position in space (Position-Based) or the orientation (Orientation-Based) of a hand-held sensor. Volunteers were further assigned to different sequences of target distances (Near-Far-Near or Far-Near-Far). Orientation-Based control produced much lower error and task times during training, which suggests that the motor system more easily accommodates tool use with degrees of freedom that match joint angles. When evaluated in constrained (physical box-trainer) conditions, each group exhibited improved performance from training. However, Position-Based training enabled greater reductions in movement error relative to Orientation-Based (mean -13.7%, CI:-27.1, -0.4). Furthermore, the Near-Far-Near schedule allowed a greater decrease in task time relative to the Far-Near-Far sequence (mean -13.5%, CI:-19.5, -7.5). Training at shallow insertion in virtual laparoscopy might promote more efficient movement strategies by emphasizing the curvature of tool motion. In addition, our findings suggest that an understanding of absolute tool position is critical to coping with mechanical interactions between the tool and trochar.

Force Tracking with Feed-Forward Motion Estimation for Beating Heart Surgery

The manipulation of fast moving, delicate tissues in beating heart procedures presents a considerable challenge to the surgeon. A robotic force tracking system can assist the surgeon by applying precise contact forces to the beating heart during surgical manipulation. Standard force control approaches cannot safely attain the required bandwidth for this application due to vibratory modes within the robot structure. These vibrations are a limitation even for single degree of freedom systems driving long surgical instruments. These bandwidth limitations can be overcome by incorporating feed-forward motion terms in the control law. For intracardiac procedures, the required motion estimates can be derived from 3D ultrasound imaging. Dynamic analysis shows that a force controller with feed-forward motion terms can provide safe and accurate force tracking for contact with structures within the beating heart. In vivo validation confirms that this approach confers a 50% reduction in force fluctuations when compared to a standard force controller and a 75% reduction in fluctuations when compared to manual attempts to maintain the same force.

A remote palpation instrument for laparoscopic surgery: design and performance

This paper describes the design and performance of a prototype remote palpation instrument with tactile feedback for laparoscopic surgery. Psychophysical experiments aiming at comparing palpation with and without tactile feedback are also described. The remote palpation instrument is designed to provide the surgeon with information about size and contact force distribution. The instrument consists of a tactile sensor and a tactile display, both of which are small enough to fit onto a conventional laparoscopic grasper. Static tests showed that hardness, size and shape were successfully rendered by the tactile display. Dynamic testing showed that the bandwidth is suboptimal, but at low frequencies the output from the remote palpation instrument is useful. For the psychophysical testing, nine subjects were asked to discriminate hardness and size of objects with and without tactile feedback. The results indicated that the instrument with tactile feedback can be helpful for hardness discrimination, although the difference between the two instruments was not statistically significant for neither hardness nor size. Comparisons with earlier, similar experiments showed that the quality of the grasper and size of the forceps affected the results, indicating that there is a great potential for improving laparoscopic graspers in general.