1
|
Chen M, Wang Y, Wang Q, Shi J, Wang H, Ye Z, Xue P, Qiao Y. Impact of human and artificial intelligence collaboration on workload reduction in medical image interpretation. NPJ Digit Med 2024; 7:349. [PMID: 39616244 PMCID: PMC11608314 DOI: 10.1038/s41746-024-01328-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/27/2024] [Accepted: 11/04/2024] [Indexed: 01/04/2025] Open
Abstract
Clinicians face increasing workloads in medical imaging interpretation, and artificial intelligence (AI) offers potential relief. This meta-analysis evaluates the impact of human-AI collaboration on image interpretation workload. Four databases were searched for studies comparing reading time or quantity for image-based disease detection before and after AI integration. The Quality Assessment of Studies of Diagnostic Accuracy was modified to assess risk of bias. Workload reduction and relative diagnostic performance were pooled using random-effects model. Thirty-six studies were included. AI concurrent assistance reduced reading time by 27.20% (95% confidence interval, 18.22%-36.18%). The reading quantity decreased by 44.47% (40.68%-48.26%) and 61.72% (47.92%-75.52%) when AI served as the second reader and pre-screening, respectively. Overall relative sensitivity and specificity are 1.12 (1.09, 1.14) and 1.00 (1.00, 1.01), respectively. Despite these promising results, caution is warranted due to significant heterogeneity and uneven study quality.
Collapse
Affiliation(s)
- Mingyang Chen
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Yuting Wang
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Qiankun Wang
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Jingyi Shi
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Huike Wang
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Zichen Ye
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China
| | - Peng Xue
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.
| | - Youlin Qiao
- School of Population Medicine and Public Health, Chinese Academy of Medical Sciences and Peking Union Medical College, Beijing, China.
| |
Collapse
|
2
|
Chen S, Ding P, Guo H, Meng L, Zhao Q, Li C. Applications of artificial intelligence in digital pathology for gastric cancer. Front Oncol 2024; 14:1437252. [PMID: 39529836 PMCID: PMC11551048 DOI: 10.3389/fonc.2024.1437252] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/23/2024] [Accepted: 10/07/2024] [Indexed: 11/16/2024] Open
Abstract
Gastric cancer is one of the most common cancers and is one of the leading causes of cancer-related deaths in worldwide. Early diagnosis and treatment are essential for a positive outcome. The integration of artificial intelligence in the pathology field is increasingly widespread, including histopathological images analysis. In recent years, the application of digital pathology technology emerged as a potential solution to enhance the understanding and management of gastric cancer. Through sophisticated image analysis algorithms, artificial intelligence technologies facilitate the accuracy and sensitivity of gastric cancer diagnosis and treatment and personalized therapeutic strategies. This review aims to evaluate the current landscape and future potential of artificial intelligence in transforming gastric cancer pathology, so as to provide ideas for future research.
Collapse
Affiliation(s)
- Sheng Chen
- School of Clinical Medicine, Hebei University, Affiliated Hospital of Hebei University, Baoding, China
| | - Ping’an Ding
- The Third Department of Surgery, the Fourth Hospital of Hebei Medical University, Shijiazhuang Hebei, China
- Hebei Key Laboratory of Precision Diagnosis and Comprehensive Treatment of Gastric Cancer, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei, China
- Big Data Analysis and Mining Application for Precise Diagnosis and Treatment of Gastric Cancer Hebei Provincial Engineering Research Center, Shijiazhuang, Hebei, China
| | - Honghai Guo
- The Third Department of Surgery, the Fourth Hospital of Hebei Medical University, Shijiazhuang Hebei, China
- Hebei Key Laboratory of Precision Diagnosis and Comprehensive Treatment of Gastric Cancer, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei, China
- Big Data Analysis and Mining Application for Precise Diagnosis and Treatment of Gastric Cancer Hebei Provincial Engineering Research Center, Shijiazhuang, Hebei, China
| | - Lingjiao Meng
- The Third Department of Surgery, the Fourth Hospital of Hebei Medical University, Shijiazhuang Hebei, China
- Hebei Key Laboratory of Precision Diagnosis and Comprehensive Treatment of Gastric Cancer, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei, China
- Big Data Analysis and Mining Application for Precise Diagnosis and Treatment of Gastric Cancer Hebei Provincial Engineering Research Center, Shijiazhuang, Hebei, China
| | - Qun Zhao
- The Third Department of Surgery, the Fourth Hospital of Hebei Medical University, Shijiazhuang Hebei, China
- Hebei Key Laboratory of Precision Diagnosis and Comprehensive Treatment of Gastric Cancer, The Fourth Hospital of Hebei Medical University, Shijiazhuang, Hebei, China
- Big Data Analysis and Mining Application for Precise Diagnosis and Treatment of Gastric Cancer Hebei Provincial Engineering Research Center, Shijiazhuang, Hebei, China
| | - Cong Li
- School of Clinical Medicine, Hebei University, Affiliated Hospital of Hebei University, Baoding, China
- Department of Hepatobiliary Surgery, Affiliated Hospital of Hebei University, Baoding, China
| |
Collapse
|
3
|
Mayer RS, Kinzler MN, Stoll AK, Gretser S, Ziegler PK, Saborowski A, Reis H, Vogel A, Wild PJ, Flinner N. [The model transferability of AI in digital pathology : Potential and reality]. PATHOLOGIE (HEIDELBERG, GERMANY) 2024; 45:124-132. [PMID: 38372762 PMCID: PMC10901943 DOI: 10.1007/s00292-024-01299-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 12/18/2023] [Indexed: 02/20/2024]
Abstract
OBJECTIVE Artificial intelligence (AI) holds the potential to make significant advancements in pathology. However, its actual implementation and certification for practical use are currently limited, often due to challenges related to model transferability. In this context, we investigate the factors influencing transferability and present methods aimed at enhancing the utilization of AI algorithms in pathology. MATERIALS AND METHODS Various convolutional neural networks (CNNs) and vision transformers (ViTs) were trained using datasets from two institutions, along with the publicly available TCGA-MIBC dataset. These networks conducted predictions in urothelial tissue and intrahepatic cholangiocarcinoma (iCCA). The objective was to illustrate the impact of stain normalization, the influence of various artifacts during both training and testing, as well as the effects of the NoisyEnsemble method. RESULTS We were able to demonstrate that stain normalization of slides from different institutions has a significant positive effect on the inter-institutional transferability of CNNs and ViTs (respectively +13% and +10%). In addition, ViTs usually achieve a higher accuracy in the external test (here +1.5%). Similarly, we showcased how artifacts in test data can negatively affect CNN predictions and how incorporating these artifacts during training leads to improvements. Lastly, NoisyEnsembles of CNNs (better than ViTs) were shown to enhance transferability across different tissues and research questions (+7% Bladder, +15% iCCA). DISCUSSION It is crucial to be aware of the transferability challenge: achieving good performance during development does not necessarily translate to good performance in real-world applications. The inclusion of existing methods to enhance transferability, such as stain normalization and NoisyEnsemble, and their ongoing refinement, is of importance.
Collapse
Affiliation(s)
- Robin S Mayer
- Universitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland
| | - Maximilian N Kinzler
- Universitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland
- Universitätsklinikum, Medizinische Klinik 1, Goethe-Universität Frankfurt, Frankfurt am Main, Deutschland
| | - Alexandra K Stoll
- Universitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland
- Frankfurt Institute for Advanced Studies (FIAS), Frankfurt am Main, Deutschland
| | - Steffen Gretser
- Universitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland
| | - Paul K Ziegler
- Universitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland
| | - Anna Saborowski
- Klinik für Gastroenterologie, Hepatologie, Infektiologie und Endokrinologie, Medizinische Hochschule Hannover, Hannover, Deutschland
| | - Henning Reis
- Universitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland
| | - Arndt Vogel
- Klinik für Gastroenterologie, Hepatologie, Infektiologie und Endokrinologie, Medizinische Hochschule Hannover, Hannover, Deutschland
| | - Peter J Wild
- Universitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland
- Frankfurt Institute for Advanced Studies (FIAS), Frankfurt am Main, Deutschland
- Wildlab, University Hospital Frankfurt MVZ GmbH, Frankfurt am Main, Deutschland
- Frankfurt Cancer Institute (FCI), Frankfurt am Main, Deutschland
- University Cancer Center (UCT) Frankfurt-Marburg, Frankfurt am Main, Deutschland
| | - Nadine Flinner
- Universitätsklinikum, Dr. Senckenbergisches Institut für Pathologie, Goethe-Universität Frankfurt, Theodor-Stern-Kai 7, 60596, Frankfurt am Main, Deutschland.
- Frankfurt Institute for Advanced Studies (FIAS), Frankfurt am Main, Deutschland.
- Frankfurt Cancer Institute (FCI), Frankfurt am Main, Deutschland.
- University Cancer Center (UCT) Frankfurt-Marburg, Frankfurt am Main, Deutschland.
| |
Collapse
|