3
|
Tokuyasu T, Iwashita Y, Matsunobu Y, Kamiyama T, Ishikake M, Sakaguchi S, Ebe K, Tada K, Endo Y, Etoh T, Nakashima M, Inomata M. Development of an artificial intelligence system using deep learning to indicate anatomical landmarks during laparoscopic cholecystectomy. Surg Endosc 2020; 35:1651-1658. [PMID: 32306111 PMCID: PMC7940266 DOI: 10.1007/s00464-020-07548-x] [Citation(s) in RCA: 35] [Impact Index Per Article: 8.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2019] [Accepted: 04/04/2020] [Indexed: 12/14/2022]
Abstract
BACKGROUND The occurrence of bile duct injury (BDI) during laparoscopic cholecystectomy (LC) is an important medical issue. Expert surgeons prevent intraoperative BDI by identifying four landmarks. The present study aimed to develop a system that outlines these landmarks on endoscopic images in real time. METHODS An intraoperative landmark indication system was constructed using YOLOv3, which is an algorithm for object detection based on deep learning. The training datasets comprised approximately 2000 endoscopic images of the region of Calot's triangle in the gallbladder neck obtained from 76 videos of LC. The YOLOv3 learning model with the training datasets was applied to 23 videos of LC that were not used in training, to evaluate the estimation accuracy of the system to identify four landmarks: the cystic duct, common bile duct, lower edge of the left medial liver segment, and Rouviere's sulcus. Additionally, we constructed a prototype and used it in a verification experiment in an operation for a patient with cholelithiasis. RESULTS The YOLOv3 learning model was quantitatively and subjectively evaluated in this study. The average precision values for each landmark were as follows: common bile duct: 0.320, cystic duct: 0.074, lower edge of the left medial liver segment: 0.314, and Rouviere's sulcus: 0.101. The two expert surgeons involved in the annotation confirmed consensus regarding valid indications for each landmark in 22 of the 23 LC videos. In the verification experiment, the use of the intraoperative landmark indication system made the surgical team more aware of the landmarks. CONCLUSIONS Intraoperative landmark indication successfully identified four landmarks during LC, which may help to reduce the incidence of BDI, and thus, increase the safety of LC. The novel system proposed in the present study may prevent BDI during LC in clinical practice.
Collapse
Affiliation(s)
- Tatsushi Tokuyasu
- Faculty of Information Engineering, Department of Information and Systems Engineering, Fukuoka Institute of Technology, 3-30-1 Wajiro-higashi, Higashi-ku, Fukuoka-City, Fukuoka, 811-0295, Japan.
| | - Yukio Iwashita
- Faculty of Medicine, Department of Gastroenterological and Pediatric Surgery, Oita University, 1-1 Idaigaoka, Hasama-machi, Yufu-City, Oita, 879-5593, Japan
| | - Yusuke Matsunobu
- Faculty of Information Engineering, Department of Information and Systems Engineering, Fukuoka Institute of Technology, 3-30-1 Wajiro-higashi, Higashi-ku, Fukuoka-City, Fukuoka, 811-0295, Japan
| | - Toshiya Kamiyama
- Customer Solutions Development, Platform Technology, Olympus Technologies Asia, Olympus Corporation, 2-3 Kuboyama-cho, Hachioji-City, Tokyo, 192-8512, Japan
| | - Makoto Ishikake
- Customer Solutions Development, Platform Technology, Olympus Technologies Asia, Olympus Corporation, 2-3 Kuboyama-cho, Hachioji-City, Tokyo, 192-8512, Japan
| | - Seiichiro Sakaguchi
- Customer Solutions Development, Platform Technology, Olympus Technologies Asia, Olympus Corporation, 2-3 Kuboyama-cho, Hachioji-City, Tokyo, 192-8512, Japan
| | - Kohei Ebe
- Customer Solutions Development, Platform Technology, Olympus Technologies Asia, Olympus Corporation, 2-3 Kuboyama-cho, Hachioji-City, Tokyo, 192-8512, Japan
| | - Kazuhiro Tada
- Faculty of Medicine, Department of Gastroenterological and Pediatric Surgery, Oita University, 1-1 Idaigaoka, Hasama-machi, Yufu-City, Oita, 879-5593, Japan
| | - Yuichi Endo
- Faculty of Medicine, Department of Gastroenterological and Pediatric Surgery, Oita University, 1-1 Idaigaoka, Hasama-machi, Yufu-City, Oita, 879-5593, Japan
| | - Tsuyoshi Etoh
- Faculty of Medicine, Department of Gastroenterological and Pediatric Surgery, Oita University, 1-1 Idaigaoka, Hasama-machi, Yufu-City, Oita, 879-5593, Japan
| | - Makoto Nakashima
- Faculty of Science and Technology, Division of Computer Science and Intelligent Systems, Oita University, 700 Dannoharu, Oita-City, Oita, 870-1192, Japan
| | - Masafumi Inomata
- Faculty of Medicine, Department of Gastroenterological and Pediatric Surgery, Oita University, 1-1 Idaigaoka, Hasama-machi, Yufu-City, Oita, 879-5593, Japan
| |
Collapse
|
6
|
Iwashita Y, Hibi T, Ohyama T, Umezawa A, Takada T, Strasberg SM, Asbun HJ, Pitt HA, Han HS, Hwang TL, Suzuki K, Yoon YS, Choi IS, Yoon DS, Huang WSW, Yoshida M, Wakabayashi G, Miura F, Okamoto K, Endo I, de Santibañes E, Giménez ME, Windsor JA, Garden OJ, Gouma DJ, Cherqui D, Belli G, Dervenis C, Deziel DJ, Jonas E, Jagannath P, Supe AN, Singh H, Liau KH, Chen XP, Chan ACW, Lau WY, Fan ST, Chen MF, Kim MH, Honda G, Sugioka A, Asai K, Wada K, Mori Y, Higuchi R, Misawa T, Watanabe M, Matsumura N, Rikiyama T, Sata N, Kano N, Tokumura H, Kimura T, Kitano S, Inomata M, Hirata K, Sumiyama Y, Inui K, Yamamoto M. Delphi consensus on bile duct injuries during laparoscopic cholecystectomy: an evolutionary cul-de-sac or the birth pangs of a new technical framework? JOURNAL OF HEPATO-BILIARY-PANCREATIC SCIENCES 2017; 24:591-602. [PMID: 28884962 DOI: 10.1002/jhbp.503] [Citation(s) in RCA: 58] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/26/2022]
Abstract
Bile duct injury (BDI) during laparoscopic cholecystectomy remains a serious iatrogenic surgical complication. BDI most often occurs as a result of misidentification of the anatomy; however, clinical evidence on its precise mechanism and surgeons' perceptions is scarce. Surgeons from Japan, Korea, Taiwan, and the USA, etc. (n = 614) participated in a questionnaire regarding their BDI experience and near-misses; and perceptions on landmarks, intraoperative findings, and surgical techniques. Respondents voted for a Delphi process and graded each item on a five-point scale. The consensus was built when ≥80% of overall responses were 4 or 5. Response rates for the first- and second-round Delphi were 60.6% and 74.9%, respectively. Misidentification of local anatomy accounted for 76.2% of BDI. Final consensus was reached on: (1) Effective retraction of the gallbladder, (2) Always obtaining critical view of safety, and (3) Avoiding excessive use of electrocautery/clipping as vital procedures; and (4) Calot's triangle area and (5) Critical view of safety as important landmarks. For (6) Impacted gallstone and (7) Severe fibrosis/scarring in Calot's triangle, bail-out procedures may be indicated. A consensus was reached among expert surgeons on relevant landmarks and intraoperative findings and appropriate surgical techniques to avoid BDI.
Collapse
Affiliation(s)
- Yukio Iwashita
- Department of Gastroenterological and Pediatric Surgery, Oita University, Faculty of Medicine, Oita, Japan
| | - Taizo Hibi
- Department of Surgery, Keio University School of Medicine, Tokyo, Japan
| | | | - Akiko Umezawa
- Minimally Invasive Surgery Center, Yotsuya Medical Cube, Tokyo, Japan
| | - Tadahiro Takada
- Department of Surgery, Teikyo University School of Medicine, Tokyo, Japan
| | - Steven M Strasberg
- Section of HPB Surgery, Washington University in Saint Louis, St. Louis, MO, USA
| | - Horacio J Asbun
- Department of Surgery, Mayo Clinic College of Medicine, Jacksonville, FL, USA
| | - Henry A Pitt
- Lewis Katz School of Medicine at Temple University, Philadelphia, PA, USA
| | - Ho-Seong Han
- Department of Surgery, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seoul, Korea
| | - Tsann-Long Hwang
- Division of General Surgery, Lin-Kou Chang Gung Memorial Hospital, Tauyuan, Taiwan
| | - Kenji Suzuki
- Department of Surgery, Fujinomiya City General Hospital, Shizuoka, Japan
| | - Yoo-Seok Yoon
- Department of Surgery, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seoul, Korea
| | - In-Seok Choi
- Department of Surgery, Konyang University Hospital, Daejeon, Korea
| | - Dong-Sup Yoon
- Department of Surgery, Yonsei University Gangnam Severance Hospital, Seoul, Korea
| | | | - Masahiro Yoshida
- Department of Hemodialysis and Surgery, Chemotherapy Research Institute, International University of Health and Welfare, Chiba, Japan
| | - Go Wakabayashi
- Department of Surgery, Ageo Central General Hospital, Saitama, Japan
| | - Fumihiko Miura
- Department of Surgery, Teikyo University School of Medicine, Tokyo, Japan
| | - Kohji Okamoto
- Department of Surgery, Center for Gastroenterology and Liver Disease, Kitakyushu City Yahata Hospital, Fukuoka, Japan
| | - Itaru Endo
- Department of Gastroenterological Surgery, Yokohama City University Graduate School of Medicine, Kanagawa, Japan
| | - Eduardo de Santibañes
- Department of Surgery, Hospital Italianio, University of Buenos Aires, Buenos Aires, Argentina
| | - Mariano Eduardo Giménez
- Chair of General Surgery and Minimal Invasive Surgery "Taquini", University of Buenos Aires, Argentina DAICIM Foundation, Buenos Aires, Argentina
| | - John A Windsor
- Department of Surgery, The University of Auckland, Auckland, New Zealand
| | - O James Garden
- Clinical Surgery, The University of Edinburgh, Edinburgh, UK
| | - Dirk J Gouma
- Department of Surgery, Academic Medical Center, Amsterdam, The Netherlands
| | - Daniel Cherqui
- Hepatobiliary Center, Paul Brousse Hospital, Villejuif, France
| | - Giulio Belli
- Department of General and HPB Surgery, Loreto Nuovo Hospital, Naples, Italy
| | | | - Daniel J Deziel
- Department of Surgery, Rush University Medical Center, Chicago, IL, USA
| | - Eduard Jonas
- Surgical Gastroenterology/Hepatopancreatobiliary Unit, University of Cape Town and Groote Schuur Hospital, Cape Town, South Africa
| | - Palepu Jagannath
- Department of Surgical Oncology, Lilavati Hospital and Research Centre, Mumbai, India
| | - Avinash Nivritti Supe
- Department of Surgical Gastroenterology, Seth G S Medical College and K E M Hospital, Mumbai, India
| | - Harjit Singh
- Hepatic Surgery Centre, Department of Surgery, Tongji Hospital, Tongi Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Kui-Hin Liau
- Hepatic Surgery Centre, Department of Surgery, Tongji Hospital, Tongi Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Xiao-Ping Chen
- Hepatic Surgery Centre, Department of Surgery, Tongji Hospital, Tongi Medical College, Huazhong University of Science and Technology, Wuhan, China
| | - Angus C W Chan
- Surgery Centre, Department of Surgery, Hong Kong Sanatorium and Hospital, Hong Kong, Hong Kong
| | - Wan Yee Lau
- Faculty of Medicine, The Chinese University of Hong Kong, Shatin, Hong Kong
| | - Sheung Tat Fan
- Department of Surgery, The University of Hong Kong, Queen Mary Hospital, Hong Kong, Hong Kong
| | - Miin-Fu Chen
- Department of Surgery, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seoul, Korea
| | - Myung-Hwan Kim
- Department of Gastroenterology, University of Ulsan College of Medicine, Seoul, Korea
| | - Goro Honda
- Department of Surgery, Tokyo Metropolitan Komagome Hospital, Tokyo, Japan
| | - Atsushi Sugioka
- Department of Surgery, Fujita Health University School of Medicine, Aichi, Japan
| | - Koji Asai
- Department of Surgery, Toho University Ohashi Medical Center, Tokyo, Japan
| | - Keita Wada
- Department of Surgery, Teikyo University School of Medicine, Tokyo, Japan
| | - Yasuhisa Mori
- Department of Surgery I, Kyushu University, Faculty of Medicine, Fukuoka, Japan
| | - Ryota Higuchi
- Department of Surgery, Institute of Gastroenterology, Tokyo Women's Medical University, Tokyo, Japan
| | - Takeyuki Misawa
- Department of Surgery, The Jikei University Kashiwa Hospital, Chiba, Japan
| | - Manabu Watanabe
- Department of Surgery, Toho University Ohashi Medical Center, Tokyo, Japan
| | | | - Toshiki Rikiyama
- Department of Surgery, Saitama Medical Center, Jichi Medical University, Saitama, Japan
| | - Naohiro Sata
- Department of Surgery, Jichi Medical University, Tochigi, Japan
| | | | | | - Taizo Kimura
- Department of Surgery, Fujinomiya City General Hospital, Shizuoka, Japan
| | | | - Masafumi Inomata
- Department of Gastroenterological and Pediatric Surgery, Oita University, Faculty of Medicine, Oita, Japan
| | - Koichi Hirata
- Department of Surgery, JR Sapporo Hospital, Hokkaido, Japan
| | | | - Kazuo Inui
- Department of Gastroenterology, Second Teaching Hospital, Fujita Health University, Aichi, Japan
| | - Masakazu Yamamoto
- Department of Surgery, Institute of Gastroenterology, Tokyo Women's Medical University, Tokyo, Japan
| |
Collapse
|
7
|
Wysocki AP, Murphy S, Ware RS. Is cystic artery lymph node excision during laparoscopic cholecystectomy a marker of technique? ANZ J Surg 2017; 88:630-634. [PMID: 28667672 DOI: 10.1111/ans.14087] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2017] [Revised: 04/27/2017] [Accepted: 04/27/2017] [Indexed: 11/27/2022]
Abstract
BACKGROUND In order to minimize bile duct injury, experts suggest that dissection during laparoscopic cholecystectomy (LC) should be performed lateral to the lymph node (LN). This study aims to determine whether the frequency of excision of the LN is related to patient factors, disease severity or surgical difficulty. METHODS All LCs performed or supervised by one surgeon were identified from a prospective database. The presence of LN was retrospectively determined by reviewing the gallbladder histology report. RESULTS The LN was identified in 10.4% of 1332 cholecystectomies. The American Society of Anesthesiologists class 3 was associated with a lower rate of LN excision compared with class 1 (odds ratio: 0.36; P = 0.049) as was the presence of a senior surgical trainee (odds ratio: 0.18; P < 0.001). Rate of LN excision was independent of patient demographic and clinical characteristics, including indication for cholecystectomy, conversion to open, gallbladder perforation, cholangiography, bile duct exploration and overall surgical difficulty. CONCLUSIONS The frequency with which the LN is excised during LC by the one surgeon is independent of the majority of clinical and surgical factors and may represent a surrogate marker of surgical technique. Whether this is related to the rate of bile duct injury remains to be determined.
Collapse
Affiliation(s)
- Arkadiusz P Wysocki
- Department of Surgery, Logan Hospital, Logan City, Queensland, Australia.,Griffith University Medical School, Griffith Health Centre, Logan City, Queensland, Australia
| | - Skyle Murphy
- Department of Surgery, Logan Hospital, Logan City, Queensland, Australia.,Griffith University Medical School, Griffith Health Centre, Logan City, Queensland, Australia
| | - Robert S Ware
- Menzies Health Institute Queensland, Griffith University, Brisbane, Queensland, Australia
| |
Collapse
|