Development of a Novel Tool for Assessing Deformation and Hardness of Real Organs: Pressure Measuring Grasper (PMEG)

Vision-based estimation of manipulation forces by deep learning of laparoscopic surgical images obtained in a porcine excised kidney experiment

In robot-assisted surgery, in which haptics should be absent, surgeons experience haptics-like sensations as "pseudo-haptic feedback". As surgeons who routinely perform robot-assisted laparoscopic surgery, we wondered if we could make these "pseudo-haptics" explicit to surgeons. Therefore, we created a simulation model that estimates manipulation forces using only visual images in surgery. This study aimed to achieve vision-based estimations of the magnitude of forces during forceps manipulation of organs. We also attempted to detect over-force, exceeding the threshold of safe manipulation. We created a sensor forceps that can detect precise pressure at the tips with three vectors. Using an endoscopic system that is used in actual surgery, images of the manipulation of excised pig kidneys were recorded with synchronized force data. A force estimation model was then created using deep learning. Effective detection of over-force was achieved if the region of the visual images was restricted by the region of interest around the tips of the forceps. In this paper, we emphasize the importance of limiting the region of interest in vision-based force estimation tasks.

Evaluation of the bio-dynamic response of the hand-arm system and hand-tool designs - A brief review

Hand-operated tools transmit a high magnitude of vibration exposure to the hand-arm system that causes occupational diseases. The health effects caused in various countries for the past years due to usage of hand tools are necessary to identify the occupational disorders. Researchers have conducted various studies on biological effects, hand-transmitted vibration exposure and biodynamic responses throughout the years. This article goes over each of these studies in detail, as well as identifying areas where more research is needed. The majority of studies deal with the following topics: general guidelines for hand-transmitted vibrations; assessment techniques of vibration exposure; hand-tool evaluation methods; influence of hand-tool design to overcome the biomechanical effects; and finite element modelling for quantifying vibration exposure. In response to this, understanding the biodynamic behaviour of the hand-arm system is useful for better ergonomic intervention in hand tools to reduce fatigue and increase comfort.