1
|
Shafi S, Parwani AV. Artificial intelligence in diagnostic pathology. Diagn Pathol 2023; 18:109. [PMID: 37784122 PMCID: PMC10546747 DOI: 10.1186/s13000-023-01375-z] [Citation(s) in RCA: 33] [Impact Index Per Article: 16.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2023] [Accepted: 07/21/2023] [Indexed: 10/04/2023] Open
Abstract
Digital pathology (DP) is being increasingly employed in cancer diagnostics, providing additional tools for faster, higher-quality, accurate diagnosis. The practice of diagnostic pathology has gone through a staggering transformation wherein new tools such as digital imaging, advanced artificial intelligence (AI) algorithms, and computer-aided diagnostic techniques are being used for assisting, augmenting and empowering the computational histopathology and AI-enabled diagnostics. This is paving the way for advancement in precision medicine in cancer. Automated whole slide imaging (WSI) scanners are now rendering diagnostic quality, high-resolution images of entire glass slides and combining these images with innovative digital pathology tools is making it possible to integrate imaging into all aspects of pathology reporting including anatomical, clinical, and molecular pathology. The recent approvals of WSI scanners for primary diagnosis by the FDA as well as the approval of prostate AI algorithm has paved the way for starting to incorporate this exciting technology for use in primary diagnosis. AI tools can provide a unique platform for innovations and advances in anatomical and clinical pathology workflows. In this review, we describe the milestones and landmark trials in the use of AI in clinical pathology with emphasis on future directions.
Collapse
Affiliation(s)
- Saba Shafi
- Department of Pathology, The Ohio State University Wexner Medical Center, E409 Doan Hall, 410 West 10th Ave, Columbus, OH, 43210, USA
| | - Anil V Parwani
- Department of Pathology, The Ohio State University Wexner Medical Center, E409 Doan Hall, 410 West 10th Ave, Columbus, OH, 43210, USA.
| |
Collapse
|
2
|
Kunonga TP, Kenny RPW, Astin M, Bryant A, Kontogiannis V, Coughlan D, Richmond C, Eastaugh CH, Beyer FR, Pearson F, Craig D, Lovat P, Vale L, Ellis R. Predictive accuracy of risk prediction models for recurrence, metastasis and survival for early-stage cutaneous melanoma: a systematic review. BMJ Open 2023; 13:e073306. [PMID: 37770261 PMCID: PMC10546114 DOI: 10.1136/bmjopen-2023-073306] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 03/02/2023] [Accepted: 09/03/2023] [Indexed: 09/30/2023] Open
Abstract
OBJECTIVES To identify prognostic models for melanoma survival, recurrence and metastasis among American Joint Committee on Cancer stage I and II patients postsurgery; and evaluate model performance, including overall survival (OS) prediction. DESIGN Systematic review and narrative synthesis. DATA SOURCES Searched MEDLINE, Embase, CINAHL, Cochrane Library, Science Citation Index and grey literature sources including cancer and guideline websites from 2000 to September 2021. ELIGIBILITY CRITERIA Included studies on risk prediction models for stage I and II melanoma in adults ≥18 years. Outcomes included OS, recurrence, metastases and model performance. No language or country of publication restrictions were applied. DATA EXTRACTION AND SYNTHESIS Two pairs of reviewers independently screened studies, extracted data and assessed the risk of bias using the CHecklist for critical Appraisal and data extraction for systematic Reviews of prediction Modelling Studies checklist and the Prediction study Risk of Bias Assessment Tool. Heterogeneous predictors prevented statistical synthesis. RESULTS From 28 967 records, 15 studies reporting 20 models were included; 8 (stage I), 2 (stage II), 7 (stages I-II) and 7 (stages not reported), but were clearly applicable to early stages. Clinicopathological predictors per model ranged from 3-10. The most common were: ulceration, Breslow thickness/depth, sociodemographic status and site. Where reported, discriminatory values were ≥0.7. Calibration measures showed good matches between predicted and observed rates. None of the studies assessed clinical usefulness of the models. Risk of bias was high in eight models, unclear in nine and low in three. Seven models were internally and externally cross-validated, six models were externally validated and eight models were internally validated. CONCLUSIONS All models are effective in their predictive performance, however the low quality of the evidence raises concern as to whether current follow-up recommendations following surgical treatment is adequate. Future models should incorporate biomarkers for improved accuracy. PROSPERO REGISTRATION NUMBER CRD42018086784.
Collapse
Affiliation(s)
- Tafadzwa Patience Kunonga
- Evidence Synthesis Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
- NIHR Innovation Observatory, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - R P W Kenny
- Evidence Synthesis Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
- NIHR Innovation Observatory, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Margaret Astin
- Evidence Synthesis Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Andrew Bryant
- Biostatistics Research Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Vasileios Kontogiannis
- Health Economics Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Diarmuid Coughlan
- Health Economics Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Catherine Richmond
- Evidence Synthesis Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
- NIHR Innovation Observatory, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Claire H Eastaugh
- Evidence Synthesis Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
- NIHR Innovation Observatory, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Fiona R Beyer
- Evidence Synthesis Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
- NIHR Innovation Observatory, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Fiona Pearson
- Evidence Synthesis Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
- NIHR Innovation Observatory, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Dawn Craig
- Evidence Synthesis Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
- NIHR Innovation Observatory, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
- Health Economics Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Penny Lovat
- Dermatological Sciences, Translation and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
- AMLo Bisciences, The Biosphere, Newcastle Helix, Newcastle upon Tyne, UK
| | - Luke Vale
- Health Economics Group, Population Health Sciences Institute, Newcastle University, Newcastle upon Tyne, UK
| | - Robert Ellis
- Dermatological Sciences, Translation and Clinical Research Institute, Newcastle University, Newcastle upon Tyne, UK
- AMLo Bisciences, The Biosphere, Newcastle Helix, Newcastle upon Tyne, UK
- Department of Dermatology, South Tees Hospitals NHS FT, Middlesbrough, UK
| |
Collapse
|
3
|
Meves A, Todd A, Johnson EF. Tumor width and calculated tumor area do not outperform Breslow thickness in predicting sentinel lymph node biopsy positivity. J Am Acad Dermatol 2023; 89:188-190. [PMID: 36948300 PMCID: PMC10330270 DOI: 10.1016/j.jaad.2023.03.012] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2022] [Revised: 02/09/2023] [Accepted: 03/09/2023] [Indexed: 03/24/2023]
Affiliation(s)
- Alexander Meves
- Department of Dermatology, Mayo Clinic, Rochester, Minnesota
| | - Austin Todd
- Department of Biostatistics, Mayo Clinic, Rochester, Minnesota
| | - Emma F Johnson
- Department of Dermatology, Mayo Clinic, Rochester, Minnesota; Department of Laboratory Medicine and Pathology, Mayo Clinic, Rochester, Minnesota.
| |
Collapse
|
4
|
Vale L, Kunonga P, Coughlan D, Kontogiannis V, Astin M, Beyer F, Richmond C, Wilson D, Bajwa D, Javanbakht M, Bryant A, Akor W, Craig D, Lovat P, Labus M, Nasr B, Cunliffe T, Hinde H, Shawgi M, Saleh D, Royle P, Steward P, Lucas R, Ellis R. Optimal surveillance strategies for patients with stage 1 cutaneous melanoma post primary tumour excision: three systematic reviews and an economic model. Health Technol Assess 2021; 25:1-178. [PMID: 34792018 DOI: 10.3310/hta25640] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/23/2022] Open
Abstract
BACKGROUND Malignant melanoma is the fifth most common cancer in the UK, with rates continuing to rise, resulting in considerable burden to patients and the NHS. OBJECTIVES The objectives were to evaluate the effectiveness and cost-effectiveness of current and alternative follow-up strategies for stage IA and IB melanoma. REVIEW METHODS Three systematic reviews were conducted. (1) The effectiveness of surveillance strategies. Outcomes were detection of new primaries, recurrences, metastases and survival. Risk of bias was assessed using the Cochrane Collaboration's Risk-of-Bias 2.0 tool. (2) Prediction models to stratify by risk of recurrence, metastases and survival. Model performance was assessed by study-reported measures of discrimination (e.g. D-statistic, Harrel's c-statistic), calibration (e.g. the Hosmer-Lemeshow 'goodness-of-fit' test) or overall performance (e.g. Brier score, R 2). Risk of bias was assessed using the Prediction model Risk Of Bias ASsessment Tool (PROBAST). (3) Diagnostic test accuracy of fine-needle biopsy and ultrasonography. Outcomes were detection of new primaries, recurrences, metastases and overall survival. Risk of bias was assessed using the Quality Assessment of Diagnostic Accuracy Studies-2 (QUADAS-2) tool. Review data and data from elsewhere were used to model the cost-effectiveness of alternative surveillance strategies and the value of further research. RESULTS (1) The surveillance review included one randomised controlled trial. There was no evidence of a difference in new primary or recurrence detected (risk ratio 0.75, 95% confidence interval 0.43 to 1.31). Risk of bias was considered to be of some concern. Certainty of the evidence was low. (2) Eleven risk prediction models were identified. Discrimination measures were reported for six models, with the area under the operating curve ranging from 0.59 to 0.88. Three models reported calibration measures, with coefficients of ≥ 0.88. Overall performance was reported by two models. In one, the Brier score was slightly better than the American Joint Committee on Cancer scheme score. The other reported an R 2 of 0.47 (95% confidence interval 0.45 to 0.49). All studies were judged to have a high risk of bias. (3) The diagnostic test accuracy review identified two studies. One study considered fine-needle biopsy and the other considered ultrasonography. The sensitivity and specificity for fine-needle biopsy were 0.94 (95% confidence interval 0.90 to 0.97) and 0.95 (95% confidence interval 0.90 to 0.97), respectively. For ultrasonography, sensitivity and specificity were 1.00 (95% confidence interval 0.03 to 1.00) and 0.99 (95% confidence interval 0.96 to 0.99), respectively. For the reference standards and flow and timing domains, the risk of bias was rated as being high for both studies. The cost-effectiveness results suggest that, over a lifetime, less intensive surveillance than recommended by the National Institute for Health and Care Excellence might be worthwhile. There was considerable uncertainty. Improving the diagnostic performance of cancer nurse specialists and introducing a risk prediction tool could be promising. Further research on transition probabilities between different stages of melanoma and on improving diagnostic accuracy would be of most value. LIMITATIONS Overall, few data of limited quality were available, and these related to earlier versions of the American Joint Committee on Cancer staging. Consequently, there was considerable uncertainty in the economic evaluation. CONCLUSIONS Despite adoption of rigorous methods, too few data are available to justify changes to the National Institute for Health and Care Excellence recommendations on surveillance. However, alternative strategies warrant further research, specifically on improving estimates of incidence, progression of recurrent disease; diagnostic accuracy and health-related quality of life; developing and evaluating risk stratification tools; and understanding patient preferences. STUDY REGISTRATION This study is registered as PROSPERO CRD42018086784. FUNDING This project was funded by the National Institute for Health Research Health Technology Assessment programme and will be published in full in Health Technology Assessment; Vol 25, No. 64. See the NIHR Journals Library website for further project information.
Collapse
Affiliation(s)
- Luke Vale
- Institute of Health & Society, Newcastle University, Newcastle upon Tyne, UK
| | - Patience Kunonga
- Institute of Health & Society, Newcastle University, Newcastle upon Tyne, UK
| | - Diarmuid Coughlan
- Institute of Health & Society, Newcastle University, Newcastle upon Tyne, UK
| | | | - Margaret Astin
- Institute of Health & Society, Newcastle University, Newcastle upon Tyne, UK
| | - Fiona Beyer
- Institute of Health & Society, Newcastle University, Newcastle upon Tyne, UK
| | - Catherine Richmond
- Institute of Health & Society, Newcastle University, Newcastle upon Tyne, UK
| | - Dor Wilson
- Institute of Health & Society, Newcastle University, Newcastle upon Tyne, UK
| | - Dalvir Bajwa
- Institute of Cellular Medicine, Newcastle University, Newcastle upon Tyne, UK
| | - Mehdi Javanbakht
- Institute of Health & Society, Newcastle University, Newcastle upon Tyne, UK
| | - Andrew Bryant
- Institute of Health & Society, Newcastle University, Newcastle upon Tyne, UK
| | - Wanwuri Akor
- Northumbria Healthcare NHS Foundation Trust, North Shields, UK
| | - Dawn Craig
- Institute of Health & Society, Newcastle University, Newcastle upon Tyne, UK
| | - Penny Lovat
- Institute of Translation and Clinical Studies, Newcastle University, Newcastle upon Tyne, UK
| | - Marie Labus
- Business Development and Enterprise, Newcastle University, Newcastle upon Tyne, UK
| | - Batoul Nasr
- Dermatological Sciences, Institute of Cellular Medicine, Newcastle University, Newcastle upon Tyne, UK
| | - Timothy Cunliffe
- Dermatology Department, James Cook University Hospital, Middlesbrough, UK
| | - Helena Hinde
- Dermatology Department, James Cook University Hospital, Middlesbrough, UK
| | - Mohamed Shawgi
- Radiology Department, James Cook University Hospital, Middlesbrough, UK
| | - Daniel Saleh
- Newcastle upon Tyne Hospitals NHS Foundation Trust, Newcastle upon Tyne, UK.,Princess Alexandra Hospital Southside Clinical Unit, Faculty of Medicine, University of Queensland, Brisbane, QLD, Australia
| | - Pam Royle
- Patient representative, ITV Tyne Tees, Gateshead, UK
| | - Paul Steward
- Patient representative, Dermatology Department, James Cook University Hospital, Middlesbrough, UK
| | - Rachel Lucas
- Patient representative, Dermatology Department, James Cook University Hospital, Middlesbrough, UK
| | - Robert Ellis
- Institute of Translation and Clinical Studies, Newcastle University, Newcastle upon Tyne, UK.,South Tees Hospitals NHS Foundation Trust, Middlesbrough, UK
| |
Collapse
|
5
|
廖 俊, 冯 小, 王 玉, 郭 凌. [Identifying Molecular Subtypes of Whole-Slide Image in Colorectal Cancer via Deep Learning]. SICHUAN DA XUE XUE BAO. YI XUE BAN = JOURNAL OF SICHUAN UNIVERSITY. MEDICAL SCIENCE EDITION 2021; 52:686-692. [PMID: 34323050 PMCID: PMC10409381 DOI: 10.12182/20210760501] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Indexed: 11/23/2022]
Abstract
OBJECTIVE To establish an artificial intelligence-assisted diagnosis system for molecular subtyping of colorectal cancer (CRC). METHODS 812 whole-slide images (WSIs) of 422 patients were selected from the database of The Cancer Genome Atlas (TCGA) and were put into the training set (75%) and the test set (25%). The slides were stored in the www.paiwsit.com database. We preprocessed and segmented the slides based on the labelling results of experienced pathologists to generate a training set of more than 4 million labeled samples. Finally, deep learning models were adopted for training. RESULTS After training with several convolutional neural network models, we tested the performance of the trained deep learning model on the test set of 203 WSIs from 110 patients, and our model achieved an accuracy of 53.04% at patch-level and 51.72% at slide-level, while the accuracy of CMS2 (one of a consensus of four subtypes for CRC) at slide-level was as high as 75.00%. CONCLUSION This study is of great significance to the promotion of colorectal cancer screening and precision treatment.
Collapse
Affiliation(s)
- 俊 廖
- 中国药科大学理学院 (南京 211198)School of Science, China Pharmaceutical University, Nanjing 211198, China
| | - 小兵 冯
- 中国药科大学理学院 (南京 211198)School of Science, China Pharmaceutical University, Nanjing 211198, China
| | - 玉红 王
- 中国药科大学理学院 (南京 211198)School of Science, China Pharmaceutical University, Nanjing 211198, China
| | - 凌川 郭
- 中国药科大学理学院 (南京 211198)School of Science, China Pharmaceutical University, Nanjing 211198, China
| |
Collapse
|
6
|
Reschke R, Gussek P, Ziemer M. Identifying High-Risk Tumors within AJCC Stage IB-III Melanomas Using a Seven-Marker Immunohistochemical Signature. Cancers (Basel) 2021; 13:cancers13122902. [PMID: 34200680 PMCID: PMC8229951 DOI: 10.3390/cancers13122902] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2021] [Revised: 06/05/2021] [Accepted: 06/07/2021] [Indexed: 11/17/2022] Open
Abstract
Simple Summary Immunotherapy and targeted therapy are widely accepted for stage III and IV melanoma patients. Clinical investigation of adjuvant therapy in stage II melanoma has already started. Therefore, methods for relapse prediction in lower stage melanoma patients apart from sentinel node biopsies are much needed to guide (neo)adjuvant therapies. Gene scores such as the “DecisionDx-Melanoma” and the “MelaGenix” score can help assist therapy decisions. However, a seven-marker immunohistochemical signature could add valuable feasibility to the biomarker toolbox. Abstract Background: We aim to validate a seven-marker immunohistochemical signature, consisting of Bax, Bcl-X, PTEN, COX-2, (loss of) ß-Catenin, (loss of) MTAP and (presence of) CD20, in an independent patient cohort and test clinical feasibility. Methods: We performed staining of the mentioned antibodies in tissue of 88 primary melanomas and calculated a risk score for each patient. Data were correlated with clinical parameters and outcome (recurrence-free, distant metastasis-free and melanoma-specific survival). Results: The seven-marker signature was able to identify high-risk patients within stages IB-III melanoma patients that have a significantly higher risk of disease recurrence, metastasis, and death. In particular, the high sensitivity of relapse prediction (>94%) in sentinel negative patients (stages IB–IIC) was striking (negative predictive value of 100% for melanoma-specific survival and distant metastasis-free survival, and 97.5% for relapse-free survival). For stage III patients (positive nodal status), the negative predictive value was 100% with the seven-marker signature. Conclusions: The seven-marker signature can help to further select high-risk patients in stages IIB-C but also in earlier stages IB–IIA and be a useful tool for therapy decisions in the adjuvant and future neo-adjuvant settings. Stage III patients with measurable lymph node disease classified as high-risk with the seven-marker signature are potential candidates for neoadjuvant immunotherapy.
Collapse
|
7
|
Zhang Y. Digital image processing and recognition technology for classification and recognition of hydrothorax cancer cells. JOURNAL OF INTELLIGENT & FUZZY SYSTEMS 2020. [DOI: 10.3233/jifs-179609] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/15/2022]
Affiliation(s)
- Yihong Zhang
- The Nursing Department of Anyang Tumor Hospital in Henan Province, Anyang, Henan, China
| |
Collapse
|
8
|
Bera K, Schalper KA, Rimm DL, Velcheti V, Madabhushi A. Artificial intelligence in digital pathology - new tools for diagnosis and precision oncology. Nat Rev Clin Oncol 2019; 16:703-715. [PMID: 31399699 PMCID: PMC6880861 DOI: 10.1038/s41571-019-0252-y] [Citation(s) in RCA: 737] [Impact Index Per Article: 122.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/04/2019] [Indexed: 02/06/2023]
Abstract
In the past decade, advances in precision oncology have resulted in an increased demand for predictive assays that enable the selection and stratification of patients for treatment. The enormous divergence of signalling and transcriptional networks mediating the crosstalk between cancer, stromal and immune cells complicates the development of functionally relevant biomarkers based on a single gene or protein. However, the result of these complex processes can be uniquely captured in the morphometric features of stained tissue specimens. The possibility of digitizing whole-slide images of tissue has led to the advent of artificial intelligence (AI) and machine learning tools in digital pathology, which enable mining of subvisual morphometric phenotypes and might, ultimately, improve patient management. In this Perspective, we critically evaluate various AI-based computational approaches for digital pathology, focusing on deep neural networks and 'hand-crafted' feature-based methodologies. We aim to provide a broad framework for incorporating AI and machine learning tools into clinical oncology, with an emphasis on biomarker development. We discuss some of the challenges relating to the use of AI, including the need for well-curated validation datasets, regulatory approval and fair reimbursement strategies. Finally, we present potential future opportunities for precision oncology.
Collapse
Affiliation(s)
- Kaustav Bera
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA
| | - Kurt A Schalper
- Department of Pathology, Yale University School of Medicine, New Haven, CT, USA
| | - David L Rimm
- Department of Pathology, Yale University School of Medicine, New Haven, CT, USA
| | - Vamsidhar Velcheti
- Thoracic Medical Oncology, Perlmutter Cancer Center, New York University, New York, NY, USA
| | - Anant Madabhushi
- Department of Biomedical Engineering, Case Western Reserve University, Cleveland, OH, USA.
- Louis Stokes Cleveland Veterans Administration Medical Center, Cleveland, OH, USA.
| |
Collapse
|