1
|
Tafavvoghi M, Bongo LA, Shvetsov N, Busund LTR, Møllersen K. Publicly available datasets of breast histopathology H&E whole-slide images: A scoping review. J Pathol Inform 2024; 15:100363. [PMID: 38405160 PMCID: PMC10884505 DOI: 10.1016/j.jpi.2024.100363] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2023] [Revised: 11/24/2023] [Accepted: 01/23/2024] [Indexed: 02/27/2024] Open
Abstract
Advancements in digital pathology and computing resources have made a significant impact in the field of computational pathology for breast cancer diagnosis and treatment. However, access to high-quality labeled histopathological images of breast cancer is a big challenge that limits the development of accurate and robust deep learning models. In this scoping review, we identified the publicly available datasets of breast H&E-stained whole-slide images (WSIs) that can be used to develop deep learning algorithms. We systematically searched 9 scientific literature databases and 9 research data repositories and found 17 publicly available datasets containing 10 385 H&E WSIs of breast cancer. Moreover, we reported image metadata and characteristics for each dataset to assist researchers in selecting proper datasets for specific tasks in breast cancer computational pathology. In addition, we compiled 2 lists of breast H&E patches and private datasets as supplementary resources for researchers. Notably, only 28% of the included articles utilized multiple datasets, and only 14% used an external validation set, suggesting that the performance of other developed models may be susceptible to overestimation. The TCGA-BRCA was used in 52% of the selected studies. This dataset has a considerable selection bias that can impact the robustness and generalizability of the trained algorithms. There is also a lack of consistent metadata reporting of breast WSI datasets that can be an issue in developing accurate deep learning models, indicating the necessity of establishing explicit guidelines for documenting breast WSI dataset characteristics and metadata.
Collapse
Affiliation(s)
- Masoud Tafavvoghi
- Department of Community Medicine, Uit The Arctic University of Norway, Tromsø, Norway
| | - Lars Ailo Bongo
- Department of Computer Science, Uit The Arctic University of Norway, Tromsø, Norway
| | - Nikita Shvetsov
- Department of Computer Science, Uit The Arctic University of Norway, Tromsø, Norway
| | | | - Kajsa Møllersen
- Department of Community Medicine, Uit The Arctic University of Norway, Tromsø, Norway
| |
Collapse
|
2
|
Sung YN, Lee H, Kim E, Jung WY, Sohn JH, Lee YJ, Keum B, Ahn S, Lee SH. Interpretable deep learning model to predict lymph node metastasis in early gastric cancer using whole slide images. Am J Cancer Res 2024; 14:3513-3522. [PMID: 39113867 PMCID: PMC11301296 DOI: 10.62347/rjbh6076] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/24/2024] [Accepted: 06/24/2024] [Indexed: 08/10/2024] Open
Abstract
In early gastric cancer (EGC), the presence of lymph node metastasis (LNM) is a crucial factor for determining the treatment options. Endoscopic resection is used for treatment of EGC with minimal risk of LNM. However, owing to the lack of definitive criteria for identifying patients who require additional surgery, some patients undergo unnecessary additional surgery. Considering that histopathologic patterns are significant factor for predicting lymph node metastasis in gastric cancer, we aimed to develop a machine learning algorithm which can predict LNM status using hematoxylin and eosin (H&E)-stained images. The images were obtained from several institutions. Our pipeline comprised two sequential approaches including a feature extractor and a risk classifier. For the feature extractor, a segmentation network (DeepLabV3+) was trained on 243 WSIs across three datasets to differentiate each histological subtype. The risk classifier was trained with XGBoost using 70 morphological features inferred from the trained feature extractor. The trained segmentation network, the feature extractor, achieved high performance, with pixel accuracies of 0.9348 and 0.8939 for the internal and external datasets in patch level, respectively. The risk classifier achieved an overall AUC of 0.75 in predicting LNM status. Remarkably, one of the datasets also showed a promising result with an AUC of 0.92. This is the first multi-institution study to develop machine learning algorithm for predicting LNM status in patients with EGC using H&E-stained histopathology images. Our findings have the potential to improve the selection of patients who require surgery among those with EGC showing high-risk histological features.
Collapse
Affiliation(s)
- You-Na Sung
- Department of Pathology, Korea University Anam Hospital, College of Medicine, Korea UniversitySeoul, South Korea
| | - Hyeseong Lee
- Department of Hospital Pathology, Seoul St. Mary’s Hospital, College of Medicine, The Catholic UniversitySeoul, South Korea
| | - Eunsu Kim
- Department of Hospital Pathology, Seoul St. Mary’s Hospital, College of Medicine, The Catholic UniversitySeoul, South Korea
| | - Woon Yong Jung
- Department of Pathology, Hanyang University Guri Hospital, College of Medicine, Hanyang UniversityGuri, South Korea
| | - Jin-Hee Sohn
- Department of Pathology, Samkwang Medical LaboratoriesSeoul, South Korea
| | - Yoo Jin Lee
- Department of Pathology, Korea University Anam Hospital, College of Medicine, Korea UniversitySeoul, South Korea
| | - Bora Keum
- Division of Gastroenterology and Hepatology, Department of Internal Medicine, Korea University Anam Hospital, College of Medicine, Korea UniversitySeoul, South Korea
| | - Sangjeong Ahn
- Department of Pathology, Korea University Anam Hospital, College of Medicine, Korea UniversitySeoul, South Korea
- Artificial Intelligence Center, Korea University Anam Hospital, College of Medicine, Korea UniversitySeoul, South Korea
- Department of Medical Informatics, College of Medicine, Korea UniversitySeoul, South Korea
| | - Sung Hak Lee
- Department of Hospital Pathology, Seoul St. Mary’s Hospital, College of Medicine, The Catholic UniversitySeoul, South Korea
| |
Collapse
|
3
|
Overkamp F. [A look into the neighboring discipline: eHealth in oncology]. CHIRURGIE (HEIDELBERG, GERMANY) 2024; 95:451-458. [PMID: 38727743 DOI: 10.1007/s00104-024-02089-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 04/09/2024] [Indexed: 05/16/2024]
Abstract
Digitalization is dramatically changing the entire healthcare system. Keywords such as artificial intelligence, electronic patient files (ePA), electronic prescriptions (eRp), telemedicine, wearables, augmented reality and digital health applications (DiGA) represent the digital transformation that is already taking place. Digital becomes real! This article outlines the state of research and development, current plans and ongoing uses of digital tools in oncology in the first half of 2024. The possibilities for using artificial intelligence and the use of DiGAs in oncology are presented in more detail in this overview according to their stage of development as they already show a noticeable benefit in oncology.
Collapse
Affiliation(s)
- Friedrich Overkamp
- OncoConsult Overkamp GmbH, Europaplatz 2, 10557, Berlin, Deutschland.
- onkowissen.de GmbH, Würzburg, Deutschland.
| |
Collapse
|
4
|
Lee JH, Kang MK, Park J, Lee SJ, Kim JC, Park SH. Deep-Learning Model Prediction of Radiation Pneumonitis Using Pretreatment Chest Computed Tomography and Clinical Factors. Technol Cancer Res Treat 2024; 23:15330338241254060. [PMID: 38752262 PMCID: PMC11102700 DOI: 10.1177/15330338241254060] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2023] [Revised: 04/17/2024] [Accepted: 04/22/2024] [Indexed: 05/21/2024] Open
Abstract
Objectives: This study aimed to build a comprehensive deep-learning model for the prediction of radiation pneumonitis using chest computed tomography (CT), clinical, dosimetric, and laboratory data. Introduction: Radiation therapy is an effective tool for treating patients with lung cancer. Despite its effectiveness, the risk of radiation pneumonitis limits its application. Although several studies have demonstrated models to predict radiation pneumonitis, no reliable model has been developed yet. Herein, we developed prediction models using pretreatment chest CT and various clinical data to assess the likelihood of radiation pneumonitis in lung cancer patients. Methods: This retrospective study analyzed 3-dimensional (3D) lung volume data from chest CT scans and 27 features including dosimetric, clinical, and laboratory data from 548 patients who were treated at our institution between 2010 and 2021. We developed a neural network, named MergeNet, which processes lung 3D CT, clinical, dosimetric, and laboratory data. The MergeNet integrates a convolutional neural network with subsequent fully connected layers. A support vector machine (SVM) and light gradient boosting machine (LGBM) model were also implemented for comparison. For comparison, the convolution-only neural network was implemented as well. Three-dimensional Resnet-10 network and 4-fold cross-validation were used. Results: Classification performance was quantified by using the area under the receiver operative characteristic curve (AUC) metrics. MergeNet showed the AUC of 0.689. SVM, LGBM, and convolution-only networks showed AUCs of 0.525, 0.541, and 0.550, respectively. Application of DeLong test to pairs of receiver operating characteristic curves respectively yielded P values of .001 for the MergeNet-SVM pair and 0.001 for the MergeNet-LGBM pair. Conclusion: The MergeNet model, which incorporates chest CT, clinical, dosimetric, and laboratory data, demonstrated superior performance compared to other models. However, since its prediction performance has not yet reached an efficient level for clinical application, further research is required. Contribution: This study showed that MergeNet may be an effective means to predict radiation pneumonitis. Various predictive factors can be used together for the radiation pneumonitis prediction task via the MergeNet.
Collapse
Affiliation(s)
- Jang Hyung Lee
- Department of Radiation Oncology, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
- Cardiovascular Research Institute, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
| | - Min Kyu Kang
- Department of Radiation Oncology, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
| | - Jongmoo Park
- Department of Radiation Oncology, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
| | - Seoung-Jun Lee
- Department of Radiation Oncology, Kyungpook National University Hospital, Daegu, Republic of Korea
| | - Jae-Chul Kim
- Department of Radiation Oncology, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
| | - Shin-Hyung Park
- Department of Radiation Oncology, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
- Cardiovascular Research Institute, School of Medicine, Kyungpook National University, Daegu, Republic of Korea
| |
Collapse
|
5
|
Zhang C, Xu J, Tang R, Yang J, Wang W, Yu X, Shi S. Novel research and future prospects of artificial intelligence in cancer diagnosis and treatment. J Hematol Oncol 2023; 16:114. [PMID: 38012673 PMCID: PMC10680201 DOI: 10.1186/s13045-023-01514-5] [Citation(s) in RCA: 23] [Impact Index Per Article: 11.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/07/2023] [Accepted: 11/20/2023] [Indexed: 11/29/2023] Open
Abstract
Research into the potential benefits of artificial intelligence for comprehending the intricate biology of cancer has grown as a result of the widespread use of deep learning and machine learning in the healthcare sector and the availability of highly specialized cancer datasets. Here, we review new artificial intelligence approaches and how they are being used in oncology. We describe how artificial intelligence might be used in the detection, prognosis, and administration of cancer treatments and introduce the use of the latest large language models such as ChatGPT in oncology clinics. We highlight artificial intelligence applications for omics data types, and we offer perspectives on how the various data types might be combined to create decision-support tools. We also evaluate the present constraints and challenges to applying artificial intelligence in precision oncology. Finally, we discuss how current challenges may be surmounted to make artificial intelligence useful in clinical settings in the future.
Collapse
Affiliation(s)
- Chaoyi Zhang
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China
| | - Jin Xu
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China
| | - Rong Tang
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China
| | - Jianhui Yang
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China
| | - Wei Wang
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China
| | - Xianjun Yu
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China.
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China.
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China.
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China.
| | - Si Shi
- Department of Pancreatic Surgery, Fudan University Shanghai Cancer Center, No. 270 Dong'An Road, Shanghai, 200032, People's Republic of China.
- Department of Oncology, Shanghai Medical College, Fudan University, Shanghai, 200032, People's Republic of China.
- Shanghai Pancreatic Cancer Institute, No. 399 Lingling Road, Shanghai, 200032, People's Republic of China.
- Pancreatic Cancer Institute, Fudan University, Shanghai, 200032, People's Republic of China.
| |
Collapse
|