Mikada T, Kanno T, Kawase T, Miyazaki T, Kawashima K. Three-dimensional posture estimation of robot forceps using endoscope with convolutional neural network.
Int J Med Robot 2020;
16:e2062. [PMID:
31913577 PMCID:
PMC7154714 DOI:
10.1002/rcs.2062]
[Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/16/2019] [Revised: 11/27/2019] [Accepted: 11/28/2019] [Indexed: 11/10/2022]
Abstract
BACKGROUND
In recent years, there has been significant developments in surgical robots. Image-based sensing of surgical instruments, without the use of electric sensors, are preferred for easily washable robots.
METHODS
We propose a method to estimate the three-dimensional posture of the tip of the forceps tip by using an endoscopic image. A convolutional neural network (CNN) receives the image of the tracked markers attached to the forceps as an input and outputs the posture of the forceps.
RESULTS
The posture estimation results showed that the posture estimated from the image followed the electrical sensor. The estimated results of the external force calculated based on the posture also followed the measured values.
CONCLUSION
The method which estimates the forceps posture from the image using CNN is effective. The mean absolute error of the estimated external force is smaller than the human detection limit.
Collapse