1
|
Ateeq T, Faheem ZB, Ghoneimy M, Ali J, Li Y, Baz A. Naïve Bayes classifier assisted automated detection of cerebral microbleeds in susceptibility-weighted imaging brain images. Biochem Cell Biol 2023; 101:562-573. [PMID: 37639730 DOI: 10.1139/bcb-2023-0156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/31/2023] Open
Abstract
Cerebral microbleeds (CMBs) in the brain are the essential indicators of critical brain disorders such as dementia and ischemic stroke. Generally, CMBs are detected manually by experts, which is an exhaustive task with limited productivity. Since CMBs have complex morphological nature, manual detection is prone to errors. This paper presents a machine learning-based automated CMB detection technique in the brain susceptibility-weighted imaging (SWI) scans based on statistical feature extraction and classification. The proposed method consists of three steps: (1) removal of the skull and extraction of the brain; (2) thresholding for the extraction of initial candidates; and (3) extracting features and applying classification models such as random forest and naïve Bayes classifiers for the detection of true positive CMBs. The proposed technique is validated on a dataset consisting of 20 subjects. The dataset is divided into training data that consist of 14 subjects with 104 microbleeds and testing data that consist of 6 subjects with 63 microbleeds. We were able to achieve 85.7% sensitivity using the random forest classifier with 4.2 false positives per CMB, and the naïve Bayes classifier achieved 90.5% sensitivity with 5.5 false positives per CMB. The proposed technique outperformed many state-of-the-art methods proposed in previous studies.
Collapse
Affiliation(s)
- Tayyab Ateeq
- Department of Computer Engineering, The University of Lahore, Lahore 54000, Pakistan
| | - Zaid Bin Faheem
- Department of Computer Science & IT, The Islamia University of Bahawalpur, Bahawalpur, Punjab 63100, Pakistan
| | - Mohamed Ghoneimy
- Faculty of Computer Science, Modern Science & Arts (MSA) University, Giza, Egypt
| | - Jehad Ali
- Department of AI Convergence Network, Ajou University, Suwon, South Korea
| | - Yang Li
- College of Mechanical and Electrical Engineering, Shihezi University, Shihezi, China
| | - Abdullah Baz
- Department of Computer Engineering, College of Computer and Information Systems, Umm Al-Qura University, Makkah, Saudi Arabia
| |
Collapse
|
2
|
Sundaresan V, Arthofer C, Zamboni G, Murchison AG, Dineen RA, Rothwell PM, Auer DP, Wang C, Miller KL, Tendler BC, Alfaro-Almagro F, Sotiropoulos SN, Sprigg N, Griffanti L, Jenkinson M. Automated detection of cerebral microbleeds on MR images using knowledge distillation framework. Front Neuroinform 2023; 17:1204186. [PMID: 37492242 PMCID: PMC10363739 DOI: 10.3389/fninf.2023.1204186] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Accepted: 06/19/2023] [Indexed: 07/27/2023] Open
Abstract
Introduction Cerebral microbleeds (CMBs) are associated with white matter damage, and various neurodegenerative and cerebrovascular diseases. CMBs occur as small, circular hypointense lesions on T2*-weighted gradient recalled echo (GRE) and susceptibility-weighted imaging (SWI) images, and hyperintense on quantitative susceptibility mapping (QSM) images due to their paramagnetic nature. Accurate automated detection of CMBs would help to determine quantitative imaging biomarkers (e.g., CMB count) on large datasets. In this work, we propose a fully automated, deep learning-based, 3-step algorithm, using structural and anatomical properties of CMBs from any single input image modality (e.g., GRE/SWI/QSM) for their accurate detections. Methods In our method, the first step consists of an initial candidate detection step that detects CMBs with high sensitivity. In the second step, candidate discrimination step is performed using a knowledge distillation framework, with a multi-tasking teacher network that guides the student network to classify CMB and non-CMB instances in an offline manner. Finally, a morphological clean-up step further reduces false positives using anatomical constraints. We used four datasets consisting of different modalities specified above, acquired using various protocols and with a variety of pathological and demographic characteristics. Results On cross-validation within datasets, our method achieved a cluster-wise true positive rate (TPR) of over 90% with an average of <2 false positives per subject. The knowledge distillation framework improves the cluster-wise TPR of the student model by 15%. Our method is flexible in terms of the input modality and provides comparable cluster-wise TPR and better cluster-wise precision compared to existing state-of-the-art methods. When evaluating across different datasets, our method showed good generalizability with a cluster-wise TPR >80 % with different modalities. The python implementation of the proposed method is openly available.
Collapse
Affiliation(s)
- Vaanathi Sundaresan
- Department of Computational and Data Sciences, Indian Institute of Science, Bengaluru, Karnataka, India
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Christoph Arthofer
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
- National Institute for Health and Care Research (NIHR) Nottingham Biomedical Research Centre, Queen's Medical Centre, University of Nottingham, Nottingham, United Kingdom
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
| | - Giovanna Zamboni
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
- Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
- Dipartimento di Scienze Biomediche, Metaboliche e Neuroscienze, Universitá di Modena e Reggio Emilia, Modena, Italy
| | - Andrew G. Murchison
- Department of Neuroradiology, Oxford University Hospitals National Health Service (NHS) Foundation Trust, Oxford, United Kingdom
| | - Robert A. Dineen
- National Institute for Health and Care Research (NIHR) Nottingham Biomedical Research Centre, Queen's Medical Centre, University of Nottingham, Nottingham, United Kingdom
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
- Radiological Sciences, Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Peter M. Rothwell
- Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Dorothee P. Auer
- National Institute for Health and Care Research (NIHR) Nottingham Biomedical Research Centre, Queen's Medical Centre, University of Nottingham, Nottingham, United Kingdom
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
- Radiological Sciences, Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Chaoyue Wang
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Karla L. Miller
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Benjamin C. Tendler
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Fidel Alfaro-Almagro
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Stamatios N. Sotiropoulos
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
- National Institute for Health and Care Research (NIHR) Nottingham Biomedical Research Centre, Queen's Medical Centre, University of Nottingham, Nottingham, United Kingdom
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
| | - Nikola Sprigg
- Stroke Trials Unit, Mental Health and Clinical Neuroscience, University of Nottingham, Nottingham, United Kingdom
| | - Ludovica Griffanti
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Human Brain Activity, Department of Psychiatry, University of Oxford, Oxford, United Kingdom
| | - Mark Jenkinson
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
- South Australian Health and Medical Research Institute, Adelaide, SA, Australia
- Australian Institute for Machine Learning, School of Computer Science, The University of Adelaide, Adelaide, SA, Australia
| |
Collapse
|
3
|
Deep learning-based detection algorithm for brain metastases on black blood imaging. Sci Rep 2022; 12:19503. [PMID: 36376364 PMCID: PMC9663732 DOI: 10.1038/s41598-022-23687-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Accepted: 11/03/2022] [Indexed: 11/16/2022] Open
Abstract
Brain metastases (BM) are the most common intracranial tumors, and their prevalence is increasing. High-resolution black-blood (BB) imaging was used to complement the conventional contrast-enhanced 3D gradient-echo imaging to detect BM. In this study, we propose an efficient deep learning algorithm (DLA) for BM detection in BB imaging with contrast enhancement scans, and assess the efficacy of an automatic detection algorithm for BM. A total of 113 BM participants with 585 metastases were included in the training cohort for five-fold cross-validation. The You Only Look Once (YOLO) V2 network was trained with 3D BB sampling perfection with application-optimized contrasts using different flip angle evolution (SPACE) images to investigate the BM detection. For the observer performance, two board-certified radiologists and two second-year radiology residents detected the BM and recorded the reading time. For the training cohort, the overall performance of the five-fold cross-validation was 87.95%, 24.82%, 19.35%, 14.48, and 18.40 for sensitivity, precision, F1-Score, the false positive average for the BM dataset, and the false positive average for the normal individual dataset, respectively. For the comparison of reading time with and without DLA, the average reading time was reduced by 20.86% in the range of 15.22-25.77%. The proposed method has the potential to detect BM with a high sensitivity and has a limited number of false positives using BB imaging.
Collapse
|
4
|
Region Convolutional Neural Network for Brain Tumor Segmentation. COMPUTATIONAL INTELLIGENCE AND NEUROSCIENCE 2022; 2022:8335255. [PMID: 36124122 PMCID: PMC9482475 DOI: 10.1155/2022/8335255] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/25/2022] [Revised: 07/20/2022] [Accepted: 07/22/2022] [Indexed: 11/17/2022]
Abstract
Gliomas are often difficult to find and distinguish using typical manual segmentation approaches because of their vast range of changes in size, shape, and appearance. Furthermore, the manual annotation of cancer tissue segmentation under the close supervision of a human professional is both time-consuming and exhausting to perform. It will be easier and faster in the future to get accurate and quick diagnoses and treatments thanks to automated segmentation and survival rate prediction models that can be used now. In this article, a segmentation model is designed using RCNN that enables automatic prognosis on brain tumors using MRI. The study adopts a U-Net encoder for capturing the features during the training of the model. The feature extraction extracts geometric features for the estimation of tumor size. It is seen that the shape, location, and size of a tumor are significant factors in the estimation of prognosis. The experimental methods are conducted to test the efficacy of the model, and the results of the simulation show that the proposed method achieves a reduced error rate with increased accuracy than other methods.
Collapse
|
5
|
Matsoukas S, Scaggiante J, Schuldt BR, Smith CJ, Chennareddy S, Kalagara R, Majidi S, Bederson JB, Fifi JT, Mocco J, Kellner CP. Accuracy of artificial intelligence for the detection of intracranial hemorrhage and chronic cerebral microbleeds: a systematic review and pooled analysis. LA RADIOLOGIA MEDICA 2022; 127:1106-1123. [PMID: 35962888 DOI: 10.1007/s11547-022-01530-4] [Citation(s) in RCA: 15] [Impact Index Per Article: 7.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 10/20/2021] [Accepted: 07/12/2022] [Indexed: 11/25/2022]
Abstract
BACKGROUND Artificial intelligence (AI)-driven software has been developed and become commercially available within the past few years for the detection of intracranial hemorrhage (ICH) and chronic cerebral microbleeds (CMBs). However, there is currently no systematic review that summarizes all of these tools or provides pooled estimates of their performance. METHODS In this PROSPERO-registered, PRISMA compliant systematic review, we sought to compile and review all MEDLINE and EMBASE published studies that have developed and/or tested AI algorithms for ICH detection on non-contrast CT scans (NCCTs) or MRI scans and CMBs detection on MRI scans. RESULTS In total, 40 studies described AI algorithms for ICH detection in NCCTs/MRIs and 19 for CMBs detection in MRIs. The overall sensitivity, specificity, and accuracy were 92.06%, 93.54%, and 93.46%, respectively, for ICH detection and 91.6%, 93.9%, and 92.7% for CMBs detection. Some of the challenges encountered in the development of these algorithms include the laborious work of creating large, labeled and balanced datasets, the volumetric nature of the imaging examinations, the fine tuning of the algorithms, and the reduction in false positives. CONCLUSIONS Numerous AI-driven software tools have been developed over the last decade. On average, they are characterized by high performance and expert-level accuracy for the diagnosis of ICH and CMBs. As a result, implementing these tools in clinical practice may improve workflow and act as a failsafe for the detection of such lesions. REGISTRATION-URL: https://www.crd.york.ac.uk/prospero/ Unique Identifier: CRD42021246848.
Collapse
Affiliation(s)
- Stavros Matsoukas
- Department of Neurosurgery, Mount Sinai Health System, Annenberg Building, Room 20-86, 1468 Madison Ave, New York, NY, 10029, USA.
| | - Jacopo Scaggiante
- Department of Neurosurgery, Mount Sinai Health System, Annenberg Building, Room 20-86, 1468 Madison Ave, New York, NY, 10029, USA
| | - Braxton R Schuldt
- Department of Neurosurgery, Mount Sinai Health System, Annenberg Building, Room 20-86, 1468 Madison Ave, New York, NY, 10029, USA
| | - Colton J Smith
- Department of Neurosurgery, Mount Sinai Health System, Annenberg Building, Room 20-86, 1468 Madison Ave, New York, NY, 10029, USA
| | - Susmita Chennareddy
- Department of Neurosurgery, Mount Sinai Health System, Annenberg Building, Room 20-86, 1468 Madison Ave, New York, NY, 10029, USA
| | - Roshini Kalagara
- Department of Neurosurgery, Mount Sinai Health System, Annenberg Building, Room 20-86, 1468 Madison Ave, New York, NY, 10029, USA
| | - Shahram Majidi
- Department of Neurosurgery, Mount Sinai Health System, Annenberg Building, Room 20-86, 1468 Madison Ave, New York, NY, 10029, USA
| | - Joshua B Bederson
- Department of Neurosurgery, Mount Sinai Health System, Annenberg Building, Room 20-86, 1468 Madison Ave, New York, NY, 10029, USA
| | - Johanna T Fifi
- Department of Neurosurgery, Mount Sinai Health System, Annenberg Building, Room 20-86, 1468 Madison Ave, New York, NY, 10029, USA
| | - J Mocco
- Department of Neurosurgery, Mount Sinai Health System, Annenberg Building, Room 20-86, 1468 Madison Ave, New York, NY, 10029, USA
| | - Christopher P Kellner
- Department of Neurosurgery, Mount Sinai Health System, Annenberg Building, Room 20-86, 1468 Madison Ave, New York, NY, 10029, USA
| |
Collapse
|
6
|
Sundaresan V, Arthofer C, Zamboni G, Dineen RA, Rothwell PM, Sotiropoulos SN, Auer DP, Tozer DJ, Markus HS, Miller KL, Dragonu I, Sprigg N, Alfaro-Almagro F, Jenkinson M, Griffanti L. Automated Detection of Candidate Subjects With Cerebral Microbleeds Using Machine Learning. Front Neuroinform 2022; 15:777828. [PMID: 35126079 PMCID: PMC8811357 DOI: 10.3389/fninf.2021.777828] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2021] [Accepted: 12/23/2021] [Indexed: 11/21/2022] Open
Abstract
Cerebral microbleeds (CMBs) appear as small, circular, well defined hypointense lesions of a few mm in size on T2*-weighted gradient recalled echo (T2*-GRE) images and appear enhanced on susceptibility weighted images (SWI). Due to their small size, contrast variations and other mimics (e.g., blood vessels), CMBs are highly challenging to detect automatically. In large datasets (e.g., the UK Biobank dataset), exhaustively labelling CMBs manually is difficult and time consuming. Hence it would be useful to preselect candidate CMB subjects in order to focus on those for manual labelling, which is essential for training and testing automated CMB detection tools on these datasets. In this work, we aim to detect CMB candidate subjects from a larger dataset, UK Biobank, using a machine learning-based, computationally light pipeline. For our evaluation, we used 3 different datasets, with different intensity characteristics, acquired with different scanners. They include the UK Biobank dataset and two clinical datasets with different pathological conditions. We developed and evaluated our pipelines on different types of images, consisting of SWI or GRE images. We also used the UK Biobank dataset to compare our approach with alternative CMB preselection methods using non-imaging factors and/or imaging data. Finally, we evaluated the pipeline's generalisability across datasets. Our method provided subject-level detection accuracy > 80% on all the datasets (within-dataset results), and showed good generalisability across datasets, providing a consistent accuracy of over 80%, even when evaluated across different modalities.
Collapse
Affiliation(s)
- Vaanathi Sundaresan
- Nuffield Department of Clinical Neurosciences, Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, University of Oxford, Oxford, United Kingdom
- Oxford-Nottingham Centre for Doctoral Training in Biomedical Imaging, University of Oxford, Oxford, United Kingdom
| | - Christoph Arthofer
- Nuffield Department of Clinical Neurosciences, Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, University of Oxford, Oxford, United Kingdom
- NIHR Nottingham Biomedical Research Centre, Queen's Medical Centre, University of Nottingham, Nottingham, United Kingdom
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
| | - Giovanna Zamboni
- Nuffield Department of Clinical Neurosciences, Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, University of Oxford, Oxford, United Kingdom
- Wolfson Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
- Dipartimento di Scienze Biomediche, Metaboliche e Neuroscienze, Università di Modena e Reggio Emilia, Modena, Italy
| | - Robert A. Dineen
- NIHR Nottingham Biomedical Research Centre, Queen's Medical Centre, University of Nottingham, Nottingham, United Kingdom
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
- Radiological Sciences, Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Peter M. Rothwell
- Wolfson Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, United Kingdom
| | - Stamatios N. Sotiropoulos
- Nuffield Department of Clinical Neurosciences, Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, University of Oxford, Oxford, United Kingdom
- NIHR Nottingham Biomedical Research Centre, Queen's Medical Centre, University of Nottingham, Nottingham, United Kingdom
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
| | - Dorothee P. Auer
- NIHR Nottingham Biomedical Research Centre, Queen's Medical Centre, University of Nottingham, Nottingham, United Kingdom
- Sir Peter Mansfield Imaging Centre, University of Nottingham, Nottingham, United Kingdom
- Radiological Sciences, Mental Health and Clinical Neurosciences, School of Medicine, University of Nottingham, Nottingham, United Kingdom
| | - Daniel J. Tozer
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, United Kingdom
| | - Hugh S. Markus
- Department of Clinical Neurosciences, University of Cambridge, Cambridge, United Kingdom
| | - Karla L. Miller
- Nuffield Department of Clinical Neurosciences, Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, University of Oxford, Oxford, United Kingdom
| | - Iulius Dragonu
- Siemens Healthcare Ltd., Research and Collaborations GB & I, Frimley, United Kingdom
| | - Nikola Sprigg
- Stroke Trials Unit, Mental Health and Clinical Neuroscience, University of Nottingham, Nottingham, United Kingdom
| | - Fidel Alfaro-Almagro
- Nuffield Department of Clinical Neurosciences, Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, University of Oxford, Oxford, United Kingdom
| | - Mark Jenkinson
- Nuffield Department of Clinical Neurosciences, Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, University of Oxford, Oxford, United Kingdom
- South Australian Health and Medical Research Institute (SAHMRI), Adelaide, SA, Australia
- Australian Institute for Machine Learning (AIML), School of Computer Science, The University of Adelaide, Adelaide, SA, Australia
| | - Ludovica Griffanti
- Nuffield Department of Clinical Neurosciences, Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, University of Oxford, Oxford, United Kingdom
- Department of Psychiatry, Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Human Brain Activity, University of Oxford, Oxford, United Kingdom
- *Correspondence: Ludovica Griffanti
| |
Collapse
|
7
|
Ghafoorian M, Karssemeijer N, Heskes T, van Uden IWM, Sanchez CI, Litjens G, de Leeuw FE, van Ginneken B, Marchiori E, Platel B. Location Sensitive Deep Convolutional Neural Networks for Segmentation of White Matter Hyperintensities. Sci Rep 2017; 7:5110. [PMID: 28698556 PMCID: PMC5505987 DOI: 10.1038/s41598-017-05300-5] [Citation(s) in RCA: 115] [Impact Index Per Article: 16.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/15/2016] [Accepted: 05/26/2017] [Indexed: 02/06/2023] Open
Abstract
The anatomical location of imaging features is of crucial importance for accurate diagnosis in many medical tasks. Convolutional neural networks (CNN) have had huge successes in computer vision, but they lack the natural ability to incorporate the anatomical location in their decision making process, hindering success in some medical image analysis tasks. In this paper, to integrate the anatomical location information into the network, we propose several deep CNN architectures that consider multi-scale patches or take explicit location features while training. We apply and compare the proposed architectures for segmentation of white matter hyperintensities in brain MR images on a large dataset. As a result, we observe that the CNNs that incorporate location information substantially outperform a conventional segmentation method with handcrafted features as well as CNNs that do not integrate location information. On a test set of 50 scans, the best configuration of our networks obtained a Dice score of 0.792, compared to 0.805 for an independent human observer. Performance levels of the machine and the independent human observer were not statistically significantly different (p-value = 0.06).
Collapse
Affiliation(s)
- Mohsen Ghafoorian
- Institute for Computing and Information Sciences, Radboud University, Nijmegen, The Netherlands.
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands.
| | - Nico Karssemeijer
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Tom Heskes
- Institute for Computing and Information Sciences, Radboud University, Nijmegen, The Netherlands
| | - Inge W M van Uden
- Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Clara I Sanchez
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Geert Litjens
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Frank-Erik de Leeuw
- Donders Institute for Brain, Cognition and Behaviour, Department of Neurology, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Bram van Ginneken
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| | - Elena Marchiori
- Institute for Computing and Information Sciences, Radboud University, Nijmegen, The Netherlands
| | - Bram Platel
- Diagnostic Image Analysis Group, Department of Radiology and Nuclear Medicine, Radboud University Medical Center, Nijmegen, The Netherlands
| |
Collapse
|