Haptic interaction in robot-assisted endoscopic surgery: a sensorized end-effector

High-fidelity bilateral teleoperation systems and the effect of multimodal haptics

In master-slave teleoperation applications that deal with a delicate and sensitive environment, it is important to provide haptic feedback of slave/environment interactions to the user's hand as it improves task performance and teleoperation transparency (fidelity), which is the extent of telepresence of the remote environment available to the user through the master-slave system. For haptic teleoperation, in addition to a haptics-capable master interface, often one or more force sensors are also used, which warrant new bilateral control architectures while increasing the cost and the complexity of the teleoperation system. In this paper, we investigate the added benefits of using force sensors that measure hand/master and slave/environment interactions and of utilizing local feedback loops on the teleoperation transparency. We compare the two-channel and the four-channel bilateral control systems in terms of stability and transparency, and study the stability and performance robustness of the four-channel method against nonidealities that arise during bilateral control implementation, which include master-slave communication latency and changes in the environment dynamics. The next issue addressed in the paper deals with the case where the master interface is not haptics capable, but the slave is equipped with a force sensor. In the context of robotics-assisted soft-tissue surgical applications, we explore through human factors experiments whether slave/environment force measurements can be of any help with regard to improving task performance. The last problem we study is whether slave/environment force information, with and without haptic capability in the master interface, can help improve outcomes under degraded visual conditions.

Haptics in minimally invasive surgery--a review

This article gives an overview of research performed in the field of haptic information feedback during minimally invasive surgery (MIS). Literature has been consulted from 1985 to present. The studies show that currently, haptic information feedback is rare, but promising, in MIS. Surgeons benefit from additional feedback about force information. When it comes to grasping forces and perceiving slip, little is known about the advantages additional haptic information can give to prevent tissue trauma during manipulation. Improvement of haptic perception through augmented haptic information feedback in MIS might be promising.

Novel haptic tool and input device for real time bilateral biomanipulation addressing endoscopic surgery

In this paper a sensorised polymer microgripper is presented which can be used as a suitable end effector on an endoscopic microinstrument for robot-assisted and possibly teleoperated surgery to enable the operator to receive haptic feedback information on the forces generated during the procedure. A novel tweezers- like haptic input device is also described, which gives the operator the ability to remotely feel these forces generated by grasping operations with the microgripper. This feedback is used to control the amount of force applied in manipulation of tissues during the procedure. The mechanical and electronic design of the microgripper, microinstrument and haptic tweezers is also presented and preliminary results detailed.

Methods and mechanisms for contact feedback in a robot-assisted minimally invasive environment

Providing a surgeon with information regarding contacts made between instruments and tissue during robot-assisted interventions can improve task efficiency and reliability. In this report, different methods for feedback of such information to the surgeon are discussed. It is hypothesized that various methods of contact feedback have the potential to enhance performance in a robot-assisted minimally invasive environment. To verify the hypothesis, novel mechanisms needed for incorporating contact feedback were designed, including a surgeon-robot interface with full force feedback capabilities and a surgical end-effector with full force sensing capabilities, that are suitable for minimally invasive applications. These two mechanisms were used to form a robotic "master-slave" test bed for studying the effect of contact feedback on the system and user performance. Using the master-slave system, experiments for surgical tasks involving soft tissue palpation were conducted. The performance of the master-slave system was validated in terms of criteria that assess the accurate transmission of task-related information to the surgeon, which is critical in the context of soft tissue surgical applications. Moreover, using a set of experiments involving human subjects, the performance of several users in carrying out the task was compared among different methods of contact feedback.

Multi-sensory force/deformation cues for stiffness characterization in soft-tissue palpation

In the commercially available robot-assisted surgical systems, camera vision constitutes the only flow of data from the patient side to the surgeon side. This paper studies how various modalities for feedback of interaction between a surgical tool and soft tissue can improve the efficiency of a typical surgical task. Utilizing a haptics-enabled master-slave test-bed for minimally invasive surgery, user performance during a telemanipulated soft tissue stiffness discrimination task is compared under visual, haptic, graphical, and graphical plus haptic feedback modes in terms of task success rate and completion time and the amount of energy transfer and consequently trauma to tissue. While no significant difference is found in terms of the task completion times, graphical cueing and visual cueing are found to lead to the highest success rate and the highest risk of tissue damage (proportional to energy), respectively.