1
|
Carreras J. Celiac Disease Deep Learning Image Classification Using Convolutional Neural Networks. J Imaging 2024; 10:200. [PMID: 39194989 DOI: 10.3390/jimaging10080200] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/01/2024] [Revised: 08/09/2024] [Accepted: 08/10/2024] [Indexed: 08/29/2024] Open
Abstract
Celiac disease (CD) is a gluten-sensitive immune-mediated enteropathy. This proof-of-concept study used a convolutional neural network (CNN) to classify hematoxylin and eosin (H&E) CD histological images, normal small intestine control, and non-specified duodenal inflammation (7294, 11,642, and 5966 images, respectively). The trained network classified CD with high performance (accuracy 99.7%, precision 99.6%, recall 99.3%, F1-score 99.5%, and specificity 99.8%). Interestingly, when the same network (already trained for the 3 class images), analyzed duodenal adenocarcinoma (3723 images), the new images were classified as duodenal inflammation in 63.65%, small intestine control in 34.73%, and CD in 1.61% of the cases; and when the network was retrained using the 4 histological subtypes, the performance was above 99% for CD and 97% for adenocarcinoma. Finally, the model added 13,043 images of Crohn's disease to include other inflammatory bowel diseases; a comparison between different CNN architectures was performed, and the gradient-weighted class activation mapping (Grad-CAM) technique was used to understand why the deep learning network made its classification decisions. In conclusion, the CNN-based deep neural system classified 5 diagnoses with high performance. Narrow artificial intelligence (AI) is designed to perform tasks that typically require human intelligence, but it operates within limited constraints and is task-specific.
Collapse
Affiliation(s)
- Joaquim Carreras
- Department of Pathology, School of Medicine, Tokai University, 143 Shimokasuya, Isehara 259-1193, Japan
| |
Collapse
|
2
|
Denholm J, Schreiber BA, Jaeckle F, Wicks MN, Benbow EW, Bracey TS, Chan JYH, Farkas L, Fryer E, Gopalakrishnan K, Hughes CA, Kirkwood KJ, Langman G, Mahler-Araujo B, McMahon RFT, Myint KLW, Natu S, Robinson A, Sanduka A, Sheppard KA, Tsang YW, Arends MJ, Soilleux EJ. CD, or not CD, that is the question: a digital interobserver agreement study in coeliac disease. BMJ Open Gastroenterol 2024; 11:e001252. [PMID: 38302475 PMCID: PMC10870791 DOI: 10.1136/bmjgast-2023-001252] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/12/2023] [Accepted: 12/11/2023] [Indexed: 02/03/2024] Open
Abstract
OBJECTIVE Coeliac disease (CD) diagnosis generally depends on histological examination of duodenal biopsies. We present the first study analysing the concordance in examination of duodenal biopsies using digitised whole-slide images (WSIs). We further investigate whether the inclusion of immunoglobulin A tissue transglutaminase (IgA tTG) and haemoglobin (Hb) data improves the interobserver agreement of diagnosis. DESIGN We undertook a large study of the concordance in histological examination of duodenal biopsies using digitised WSIs in an entirely virtual reporting setting. Our study was organised in two phases: in phase 1, 13 pathologists independently classified 100 duodenal biopsies (40 normal; 40 CD; 20 indeterminate enteropathy) in the absence of any clinical or laboratory data. In phase 2, the same pathologists examined the (re-anonymised) WSIs with the inclusion of IgA tTG and Hb data. RESULTS We found the mean probability of two observers agreeing in the absence of additional data to be 0.73 (±0.08) with a corresponding Cohen's kappa of 0.59 (±0.11). We further showed that the inclusion of additional data increased the concordance to 0.80 (±0.06) with a Cohen's kappa coefficient of 0.67 (±0.09). CONCLUSION We showed that the addition of serological data significantly improves the quality of CD diagnosis. However, the limited interobserver agreement in CD diagnosis using digitised WSIs, even after the inclusion of IgA tTG and Hb data, indicates the importance of interpreting duodenal biopsy in the appropriate clinical context. It further highlights the unmet need for an objective means of reproducible duodenal biopsy diagnosis, such as the automated analysis of WSIs using artificial intelligence.
Collapse
Affiliation(s)
- James Denholm
- Department of Pathology, University of Cambridge, Cambridge, UK
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
- Lyzeum Ltd, Cambridge, UK
| | - Benjamin A Schreiber
- Department of Pathology, University of Cambridge, Cambridge, UK
- Department of Applied Mathematics and Theoretical Physics, University of Cambridge, Cambridge, UK
| | - Florian Jaeckle
- Department of Pathology, University of Cambridge, Cambridge, UK
- Lyzeum Ltd, Cambridge, UK
| | - Mike N Wicks
- Department of Pathology, The University of Edinburgh College of Medicine and Veterinary Medicine, Edinburgh, UK
| | - Emyr W Benbow
- Division of Medical Education, The University of Manchester, Manchester, UK
- Department of Histopathology, Manchester University NHS Foundation Trust, Manchester, UK
| | - Tim S Bracey
- Department of Diagnostic and Molecular Pathology, Royal Cornwall Hospitals NHS Trust, Truro, UK
- University Hospitals Plymouth NHS Trust, Plymouth, UK
| | - James Y H Chan
- Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - Lorant Farkas
- Department of Pathology, Akershus University Hospital, Nordbyhagen, Norway
- Institute of Clinical Medicine, University of Oslo, Nordbyhagen, Norway
| | - Eve Fryer
- Department of Cellular Pathology, Oxford University Hospitals NHS foundation Trust, Oxford, UK
| | - Kishore Gopalakrishnan
- Department of Histopathology, University Hospitals Coventry and Warwickshire NHS Trust, Coventry, UK
| | - Caroline A Hughes
- Department of Cellular Pathology, Oxford University Hospitals NHS foundation Trust, Oxford, UK
| | | | - Gerald Langman
- Department of Cellular Pathology, Heartlands Hospital, University Hospitals Birmingham NHS Foundation Trust, Birmingham, UK
| | - Betania Mahler-Araujo
- Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
- MRC Institute of Metabolic Science, Wellcome Trust, Cambridge, UK
| | - Raymond F T McMahon
- Division of Medical Education, The University of Manchester, Manchester, UK
- Department of Histopathology, Manchester University NHS Foundation Trust, Manchester, UK
| | - Khun La Win Myint
- Department of Pathology, Queen Elizabeth University Hospital, Glasgow, UK
| | - Sonali Natu
- University Hospital of North Tees, North Tees and Hartlepool NHS Foundation Trust, Stockton on Tees, UK
| | - Andrew Robinson
- Department of Histopathology, University Hospitals Coventry and Warwickshire NHS Trust, Coventry, UK
| | - Ashraf Sanduka
- Cambridge University Hospitals NHS Foundation Trust, Cambridge, UK
| | - Katharine A Sheppard
- Department of Cellular Pathology, Oxford University Hospitals NHS foundation Trust, Oxford, UK
| | - Yee Wah Tsang
- Department of Histopathology, University Hospitals Coventry and Warwickshire NHS Trust, Coventry, UK
| | - Mark J Arends
- Division of Pathology, University of Edinburgh, Edinburgh, UK
| | - Elizabeth J Soilleux
- Department of Pathology, University of Cambridge, Cambridge, UK
- Lyzeum Ltd, Cambridge, UK
| |
Collapse
|