1
|
Zhang L, Wu J, Wang L, Wang L, Steffens DC, Qiu S, Potter GG, Liu M. Brain Anatomy-Guided MRI Analysis for Assessing Clinical Progression of Cognitive Impairment with Structural MRI. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2023; 14227:109-119. [PMID: 38390033 PMCID: PMC10883230 DOI: 10.1007/978-3-031-43993-3_11] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/24/2024]
Abstract
Brain structural MRI has been widely used for assessing future progression of cognitive impairment (CI) based on learning-based methods. Previous studies generally suffer from the limited number of labeled training data, while there exists a huge amount of MRIs in large-scale public databases. Even without task-specific label information, brain anatomical structures provided by these MRIs can be used to boost learning performance intuitively. Unfortunately, existing research seldom takes advantage of such brain anatomy prior. To this end, this paper proposes a brain anatomy-guided representation (BAR) learning framework for assessing the clinical progression of cognitive impairment with T1-weighted MRIs. The BAR consists of a pretext model and a downstream model, with a shared brain anatomy-guided encoder for MRI feature extraction. The pretext model also contains a decoder for brain tissue segmentation, while the downstream model relies on a predictor for classification. We first train the pretext model through a brain tissue segmentation task on 9,544 auxiliary T1-weighted MRIs, yielding a generalizable encoder. The downstream model with the learned encoder is further fine-tuned on target MRIs for prediction tasks. We validate the proposed BAR on two CI-related studies with a total of 391 subjects with T1-weighted MRIs. Experimental results suggest that the BAR outperforms several state-of-the-art (SOTA) methods. The source code and pre-trained models are available at https://github.com/goodaycoder/BAR.
Collapse
Affiliation(s)
- Lintao Zhang
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - Jinjian Wu
- The First School of Clinical Medicine, Guangzhou University of Chinese Medicine, Guangzhou, Guangdong, China
| | - Lihong Wang
- Department of Psychiatry, University of Connecticut School of Medicine, University of Connecticut, Farmington, CT, USA
| | - Li Wang
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| | - David C Steffens
- Department of Psychiatry, University of Connecticut School of Medicine, University of Connecticut, Farmington, CT, USA
| | - Shijun Qiu
- The First School of Clinical Medicine, Guangzhou University of Chinese Medicine, Guangzhou, Guangdong, China
| | - Guy G Potter
- Department of Psychiatry and Behavioral Sciences, Duke University Medical Center, Durham, NC, USA
| | - Mingxia Liu
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, USA
| |
Collapse
|
2
|
Bhalodiya JM, Lim Choi Keung SN, Arvanitis TN. Magnetic resonance image-based brain tumour segmentation methods: A systematic review. Digit Health 2022; 8:20552076221074122. [PMID: 35340900 PMCID: PMC8943308 DOI: 10.1177/20552076221074122] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2021] [Revised: 11/20/2021] [Accepted: 12/27/2021] [Indexed: 01/10/2023] Open
Abstract
Background Image segmentation is an essential step in the analysis and subsequent characterisation of brain tumours through magnetic resonance imaging. In the literature, segmentation methods are empowered by open-access magnetic resonance imaging datasets, such as the brain tumour segmentation dataset. Moreover, with the increased use of artificial intelligence methods in medical imaging, access to larger data repositories has become vital in method development. Purpose To determine what automated brain tumour segmentation techniques can medical imaging specialists and clinicians use to identify tumour components, compared to manual segmentation. Methods We conducted a systematic review of 572 brain tumour segmentation studies during 2015-2020. We reviewed segmentation techniques using T1-weighted, T2-weighted, gadolinium-enhanced T1-weighted, fluid-attenuated inversion recovery, diffusion-weighted and perfusion-weighted magnetic resonance imaging sequences. Moreover, we assessed physics or mathematics-based methods, deep learning methods, and software-based or semi-automatic methods, as applied to magnetic resonance imaging techniques. Particularly, we synthesised each method as per the utilised magnetic resonance imaging sequences, study population, technical approach (such as deep learning) and performance score measures (such as Dice score). Statistical tests We compared median Dice score in segmenting the whole tumour, tumour core and enhanced tumour. Results We found that T1-weighted, gadolinium-enhanced T1-weighted, T2-weighted and fluid-attenuated inversion recovery magnetic resonance imaging are used the most in various segmentation algorithms. However, there is limited use of perfusion-weighted and diffusion-weighted magnetic resonance imaging. Moreover, we found that the U-Net deep learning technology is cited the most, and has high accuracy (Dice score 0.9) for magnetic resonance imaging-based brain tumour segmentation. Conclusion U-Net is a promising deep learning technology for magnetic resonance imaging-based brain tumour segmentation. The community should be encouraged to contribute open-access datasets so training, testing and validation of deep learning algorithms can be improved, particularly for diffusion- and perfusion-weighted magnetic resonance imaging, where there are limited datasets available.
Collapse
Affiliation(s)
- Jayendra M Bhalodiya
- Institute of Digital Healthcare, Warwick Manufacturing Group, The University of Warwick, UK
| | - Sarah N Lim Choi Keung
- Institute of Digital Healthcare, Warwick Manufacturing Group, The University of Warwick, UK
| | - Theodoros N Arvanitis
- Institute of Digital Healthcare, Warwick Manufacturing Group, The University of Warwick, UK
| |
Collapse
|
3
|
Liu L, Wolterink JM, Brune C, Veldhuis RNJ. Anatomy-aided deep learning for medical image segmentation: a review. Phys Med Biol 2021; 66. [PMID: 33906186 DOI: 10.1088/1361-6560/abfbf4] [Citation(s) in RCA: 19] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2021] [Accepted: 04/27/2021] [Indexed: 01/17/2023]
Abstract
Deep learning (DL) has become widely used for medical image segmentation in recent years. However, despite these advances, there are still problems for which DL-based segmentation fails. Recently, some DL approaches had a breakthrough by using anatomical information which is the crucial cue for manual segmentation. In this paper, we provide a review of anatomy-aided DL for medical image segmentation which covers systematically summarized anatomical information categories and corresponding representation methods. We address known and potentially solvable challenges in anatomy-aided DL and present a categorized methodology overview on using anatomical information with DL from over 70 papers. Finally, we discuss the strengths and limitations of the current anatomy-aided DL approaches and suggest potential future work.
Collapse
Affiliation(s)
- Lu Liu
- Applied Analysis, Department of Applied Mathematics, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Drienerlolaan 5, 7522 NB, Enschede, The Netherlands.,Data Management and Biometrics, Department of Computer Science, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Drienerlolaan 5, 7522 NB, Enschede, The Netherlands
| | - Jelmer M Wolterink
- Applied Analysis, Department of Applied Mathematics, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Drienerlolaan 5, 7522 NB, Enschede, The Netherlands
| | - Christoph Brune
- Applied Analysis, Department of Applied Mathematics, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Drienerlolaan 5, 7522 NB, Enschede, The Netherlands
| | - Raymond N J Veldhuis
- Data Management and Biometrics, Department of Computer Science, Faculty of Electrical Engineering, Mathematics and Computer Science, University of Twente, Drienerlolaan 5, 7522 NB, Enschede, The Netherlands
| |
Collapse
|
4
|
Kanber B, Vos SB, de Tisi J, Wood TC, Barker GJ, Rodionov R, Chowdhury FA, Thom M, Alexander DC, Duncan JS, Winston GP. Detection of covert lesions in focal epilepsy using computational analysis of multimodal magnetic resonance imaging data. Epilepsia 2021; 62:807-816. [PMID: 33567113 PMCID: PMC8436754 DOI: 10.1111/epi.16836] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Revised: 12/24/2020] [Accepted: 01/21/2021] [Indexed: 02/01/2023]
Abstract
Objective To compare the location of suspect lesions detected by computational analysis of multimodal magnetic resonance imaging data with areas of seizure onset, early propagation, and interictal epileptiform discharges (IEDs) identified with stereoelectroencephalography (SEEG) in a cohort of patients with medically refractory focal epilepsy and radiologically normal magnetic resonance imaging (MRI) scans. Methods We developed a method of lesion detection using computational analysis of multimodal MRI data in a cohort of 62 control subjects, and 42 patients with focal epilepsy and MRI‐visible lesions. We then applied it to detect covert lesions in 27 focal epilepsy patients with radiologically normal MRI scans, comparing our findings with the areas of seizure onset, early propagation, and IEDs identified at SEEG. Results Seizure‐onset zones (SoZs) were identified at SEEG in 18 of the 27 patients (67%) with radiologically normal MRI scans. In 11 of these 18 cases (61%), concordant abnormalities were detected by our method. In the remaining seven cases, either early seizure propagation or IEDs were observed within the abnormalities detected, or there were additional areas of imaging abnormalities found by our method that were not sampled at SEEG. In one of the nine patients (11%) in whom SEEG was inconclusive, an abnormality, which may have been involved in seizures, was identified by our method and was not sampled at SEEG. Significance Computational analysis of multimodal MRI data revealed covert abnormalities in the majority of patients with refractory focal epilepsy and radiologically normal MRI that co‐located with SEEG defined zones of seizure onset. The method could help identify areas that should be targeted with SEEG when considering epilepsy surgery.
Collapse
Affiliation(s)
- Baris Kanber
- Centre for Medical Image Computing, University College London, London, UK.,Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,MRI Unit, Epilepsy Society, Chalfont St Peter, UK.,National Institute for Health Research Biomedical Research Centre at University College London and University College London NHS Foundation Trust, London, UK
| | - Sjoerd B Vos
- Centre for Medical Image Computing, University College London, London, UK.,Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,MRI Unit, Epilepsy Society, Chalfont St Peter, UK.,National Institute for Health Research Biomedical Research Centre at University College London and University College London NHS Foundation Trust, London, UK.,Neuroradiological Academic Unit, UCL Queen Square Institute of Neurology, London, UK
| | - Jane de Tisi
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK
| | - Tobias C Wood
- Department of Neuroimaging, King's College London, London, UK
| | - Gareth J Barker
- Department of Neuroimaging, King's College London, London, UK
| | - Roman Rodionov
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,MRI Unit, Epilepsy Society, Chalfont St Peter, UK
| | - Fahmida Amin Chowdhury
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK
| | - Maria Thom
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,Division of Neuropathology, The National Hospital for Neurology and Neurosurgery, London, UK
| | - Daniel C Alexander
- Centre for Medical Image Computing, University College London, London, UK.,National Institute for Health Research Biomedical Research Centre at University College London and University College London NHS Foundation Trust, London, UK
| | - John S Duncan
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,MRI Unit, Epilepsy Society, Chalfont St Peter, UK.,National Institute for Health Research Biomedical Research Centre at University College London and University College London NHS Foundation Trust, London, UK
| | - Gavin P Winston
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,MRI Unit, Epilepsy Society, Chalfont St Peter, UK.,Department of Medicine, Division of Neurology, Queen's University, Kingston, Canada
| |
Collapse
|
5
|
Gryska E, Schneiderman J, Björkman-Burtscher I, Heckemann RA. Automatic brain lesion segmentation on standard magnetic resonance images: a scoping review. BMJ Open 2021; 11:e042660. [PMID: 33514580 PMCID: PMC7849889 DOI: 10.1136/bmjopen-2020-042660] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/11/2020] [Revised: 01/09/2021] [Accepted: 01/12/2021] [Indexed: 12/11/2022] Open
Abstract
OBJECTIVES Medical image analysis practices face challenges that can potentially be addressed with algorithm-based segmentation tools. In this study, we map the field of automatic MR brain lesion segmentation to understand the clinical applicability of prevalent methods and study designs, as well as challenges and limitations in the field. DESIGN Scoping review. SETTING Three databases (PubMed, IEEE Xplore and Scopus) were searched with tailored queries. Studies were included based on predefined criteria. Emerging themes during consecutive title, abstract, methods and whole-text screening were identified. The full-text analysis focused on materials, preprocessing, performance evaluation and comparison. RESULTS Out of 2990 unique articles identified through the search, 441 articles met the eligibility criteria, with an estimated growth rate of 10% per year. We present a general overview and trends in the field with regard to publication sources, segmentation principles used and types of lesions. Algorithms are predominantly evaluated by measuring the agreement of segmentation results with a trusted reference. Few articles describe measures of clinical validity. CONCLUSIONS The observed reporting practices leave room for improvement with a view to studying replication, method comparison and clinical applicability. To promote this improvement, we propose a list of recommendations for future studies in the field.
Collapse
Affiliation(s)
- Emilia Gryska
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| | - Justin Schneiderman
- Sektionen för klinisk neurovetenskap, Goteborgs Universitet Institutionen for Neurovetenskap och fysiologi, Goteborg, Sweden
| | | | - Rolf A Heckemann
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| |
Collapse
|