1
|
Feng Y, Chow LS, Gowdh NM, Ramli N, Tan LK, Abdullah S. Classification of optic neuritis in neuromyelitis optica spectrum disorders (NMOSD) on MRI using CNN with transfer learning and manipulation of pre-processing on augmentation. Biomed Phys Eng Express 2024; 10:055030. [PMID: 39142299 DOI: 10.1088/2057-1976/ad6f17] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2024] [Accepted: 08/13/2024] [Indexed: 08/16/2024]
Abstract
Neuromyelitis optica spectrum disorder (NMOSD), also known as Devic disease, is an autoimmune central nervous system disorder in humans that commonly causes inflammatory demyelination in the optic nerves and spinal cord. Inflammation in the optic nerves is termed optic neuritis (ON). ON is a common clinical presentation; however, it is not necessarily present in all NMOSD patients. ON in NMOSD can be relapsing and result in severe vision loss. To the best of our knowledge, no study utilises deep learning to classify ON changes on MRI among patients with NMOSD. Therefore, this study aims to deploy eight state-of-the-art CNN models (Inception-v3, Inception-ResNet-v2, ResNet-101, Xception, ShuffleNet, DenseNet-201, MobileNet-v2, and EfficientNet-B0) with transfer learning to classify NMOSD patients with and without chronic ON using optic nerve magnetic resonance imaging. This study also investigated the effects of data augmentation before and after dataset splitting on cropped and whole images. Both quantitative and qualitative assessments (with Grad-Cam) were used to evaluate the performances of the CNN models. The Inception-v3 was identified as the best CNN model for classifying ON among NMOSD patients, with accuracy of 99.5%, sensitivity of 98.9%, specificity of 93.0%, precision of 100%, NPV of 99.0%, and F1-score of 99.4%. This study also demonstrated that the application of augmentation after dataset splitting could avoid information leaking into the testing datasets, hence producing more realistic and reliable results.
Collapse
Affiliation(s)
- Yang Feng
- Department of Electrical and Electronic Engineering, Faculty of Engineering and Built Environment, UCSI University, 1, Jalan Puncak Menara Gading, Taman Connaught, 56000, Cheras, Kuala Lumpur, Malaysia
| | - Li Sze Chow
- Department of Electrical and Electronic Engineering, Faculty of Engineering and Built Environment, UCSI University, 1, Jalan Puncak Menara Gading, Taman Connaught, 56000, Cheras, Kuala Lumpur, Malaysia
| | - Nadia Muhammad Gowdh
- Department of Biomedical Imaging, Faculty of Medicine, Universiti Malaya, 50603, Kuala Lumpur, Malaysia
| | - Norlisah Ramli
- Department of Biomedical Imaging, Faculty of Medicine, Universiti Malaya, 50603, Kuala Lumpur, Malaysia
| | - Li Kuo Tan
- Department of Biomedical Imaging, Faculty of Medicine, Universiti Malaya, 50603, Kuala Lumpur, Malaysia
| | - Suhailah Abdullah
- Department of Medicine, Faculty of Medicine, Universiti Malaya, 50603, Kuala Lumpur, Malaysia
| |
Collapse
|
4
|
Clarke L, Arnett S, Bukhari W, Khalilidehkordi E, Jimenez Sanchez S, O'Gorman C, Sun J, Prain KM, Woodhall M, Silvestrini R, Bundell CS, Abernethy DA, Bhuta S, Blum S, Boggild M, Boundy K, Brew BJ, Brownlee W, Butzkueven H, Carroll WM, Chen C, Coulthard A, Dale RC, Das C, Fabis-Pedrini MJ, Gillis D, Hawke S, Heard R, Henderson APD, Heshmat S, Hodgkinson S, Kilpatrick TJ, King J, Kneebone C, Kornberg AJ, Lechner-Scott J, Lin MW, Lynch C, Macdonell RAL, Mason DF, McCombe PA, Pereira J, Pollard JD, Ramanathan S, Reddel SW, Shaw CP, Spies JM, Stankovich J, Sutton I, Vucic S, Walsh M, Wong RC, Yiu EM, Barnett MH, Kermode AGK, Marriott MP, Parratt JDE, Slee M, Taylor BV, Willoughby E, Brilot F, Vincent A, Waters P, Broadley SA. MRI Patterns Distinguish AQP4 Antibody Positive Neuromyelitis Optica Spectrum Disorder From Multiple Sclerosis. Front Neurol 2021; 12:722237. [PMID: 34566866 PMCID: PMC8458658 DOI: 10.3389/fneur.2021.722237] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2021] [Accepted: 08/10/2021] [Indexed: 01/01/2023] Open
Abstract
Neuromyelitis optica spectrum disorder (NMOSD) and multiple sclerosis (MS) are inflammatory diseases of the CNS. Overlap in the clinical and MRI features of NMOSD and MS means that distinguishing these conditions can be difficult. With the aim of evaluating the diagnostic utility of MRI features in distinguishing NMOSD from MS, we have conducted a cross-sectional analysis of imaging data and developed predictive models to distinguish the two conditions. NMOSD and MS MRI lesions were identified and defined through a literature search. Aquaporin-4 (AQP4) antibody positive NMOSD cases and age- and sex-matched MS cases were collected. MRI of orbits, brain and spine were reported by at least two blinded reviewers. MRI brain or spine was available for 166/168 (99%) of cases. Longitudinally extensive (OR = 203), "bright spotty" (OR = 93.8), whole (axial; OR = 57.8) or gadolinium (Gd) enhancing (OR = 28.6) spinal cord lesions, bilateral (OR = 31.3) or Gd-enhancing (OR = 15.4) optic nerve lesions, and nucleus tractus solitarius (OR = 19.2), periaqueductal (OR = 16.8) or hypothalamic (OR = 7.2) brain lesions were associated with NMOSD. Ovoid (OR = 0.029), Dawson's fingers (OR = 0.031), pyramidal corpus callosum (OR = 0.058), periventricular (OR = 0.136), temporal lobe (OR = 0.137) and T1 black holes (OR = 0.154) brain lesions were associated with MS. A score-based algorithm and a decision tree determined by machine learning accurately predicted more than 85% of both diagnoses using first available imaging alone. We have confirmed NMOSD and MS specific MRI features and combined these in predictive models that can accurately identify more than 85% of cases as either AQP4 seropositive NMOSD or MS.
Collapse
Affiliation(s)
- Laura Clarke
- Menzies Health Institute Queensland, Gold Coast, Griffith University, Southport, QLD, Australia
| | - Simon Arnett
- Menzies Health Institute Queensland, Gold Coast, Griffith University, Southport, QLD, Australia
| | - Wajih Bukhari
- Menzies Health Institute Queensland, Gold Coast, Griffith University, Southport, QLD, Australia
| | - Elham Khalilidehkordi
- Menzies Health Institute Queensland, Gold Coast, Griffith University, Southport, QLD, Australia
| | - Sofia Jimenez Sanchez
- Menzies Health Institute Queensland, Gold Coast, Griffith University, Southport, QLD, Australia
| | - Cullen O'Gorman
- Menzies Health Institute Queensland, Gold Coast, Griffith University, Southport, QLD, Australia
| | - Jing Sun
- Menzies Health Institute Queensland, Gold Coast, Griffith University, Southport, QLD, Australia
| | - Kerri M Prain
- Department of Immunology, Pathology Queensland, Royal Brisbane and Women's Hospital, Herston, QLD, Australia
| | - Mark Woodhall
- Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, United Kingdom
| | - Roger Silvestrini
- Department of Immunopathology, Westmead Hospital, Westmead, NSW, Australia
| | - Christine S Bundell
- School of Pathology and Laboratory Medicine, University of Western Australia, Nedlands, WA, Australia
| | | | - Sandeep Bhuta
- Menzies Health Institute Queensland, Gold Coast, Griffith University, Southport, QLD, Australia
| | - Stefan Blum
- Department of Neurology, Princess Alexandra Hospital, Woolloongabba, QLD, Australia
| | - Mike Boggild
- Department of Neurology, Townsville Hospital, Douglas, QLD, Australia
| | - Karyn Boundy
- Department of Neurology, College of Medicine and Public Health, Flinders University, Bedford Park, SA, Australia
| | - Bruce J Brew
- Centre for Applied Medical Research, St. Vincent's Hospital, University of New South Wales, Darlinghurst, NSW, Australia
| | - Wallace Brownlee
- Department of Neurology, Auckland City Hospital, Grafton, New Zealand
| | - Helmut Butzkueven
- Melbourne Brain Centre, Royal Melbourne Hospital, University of Melbourne, Parkville, VIC, Australia
| | - William M Carroll
- Centre for Neuromuscular and Neurological Disorders, Queen Elizabeth II Medical Centre, Perron Institute for Neurological and Translational Science, University of Western Australia, Nedlands, WA, Australia
| | - Cella Chen
- Department of Ophthalmology, Flinders Medical Centre, Flinders University, Bedford Park, SA, Australia
| | - Alan Coulthard
- School of Medicine, Royal Brisbane and Women's Hospital, University of Queensland, Herston, QLD, Australia
| | - Russell C Dale
- Brain and Mind Centre, University of Sydney, Camperdown, NSW, Australia
| | - Chandi Das
- Department of Neurology, Canberra Hospital, Garran, ACT, Australia
| | - Marzena J Fabis-Pedrini
- Centre for Neuromuscular and Neurological Disorders, Queen Elizabeth II Medical Centre, Perron Institute for Neurological and Translational Science, University of Western Australia, Nedlands, WA, Australia
| | - David Gillis
- School of Medicine, Royal Brisbane and Women's Hospital, University of Queensland, Herston, QLD, Australia
| | - Simon Hawke
- Sydney Medical School, Royal Prince Alfred Hospital, University of Sydney, Camperdown, NSW, Australia
| | - Robert Heard
- Brain and Mind Centre, University of Sydney, Camperdown, NSW, Australia
| | | | - Saman Heshmat
- Menzies Health Institute Queensland, Gold Coast, Griffith University, Southport, QLD, Australia
| | - Suzanne Hodgkinson
- South Western Sydney Medical School, Liverpool Hospital, University of New South Wales, Liverpool, NSW, Australia
| | - Trevor J Kilpatrick
- Florey Institute of Neuroscience and Mental Health, University of Melbourne, Parkville, VIC, Australia
| | - John King
- Department of Neurology, Royal Melbourne Hospital, Parkville, VIC, Australia
| | | | - Andrew J Kornberg
- School of Paediatrics, Royal Children's Hospital, University of Melbourne, Parkville, VIC, Australia
| | - Jeannette Lechner-Scott
- Hunter Medical Research Institute, University of Newcastle, New Lambton Heights, NSW, Australia
| | - Ming-Wei Lin
- Sydney Medical School, Royal Prince Alfred Hospital, University of Sydney, Camperdown, NSW, Australia
| | | | | | - Deborah F Mason
- Department of Neurology, Christchurch Hospital, Christchurch, New Zealand
| | - Pamela A McCombe
- Centre for Clinical Research, Royal Brisbane and Women's Hospital, University of Queensland, Herston, QLD, Australia
| | - Jennifer Pereira
- School of Medicine, University of Auckland, Grafton, New Zealand
| | - John D Pollard
- Sydney Medical School, Royal Prince Alfred Hospital, University of Sydney, Camperdown, NSW, Australia
| | - Sudarshini Ramanathan
- Neuroimmunology Group, Kids Neurosciences Centre, Children's Hospital at Westmead, University of Sydney, Westmead, NSW, Australia.,Department of Neurology, Concord Repatriation General Hospital, Concord, NSW, Australia
| | - Stephen W Reddel
- Brain and Mind Centre, University of Sydney, Camperdown, NSW, Australia
| | - Cameron P Shaw
- School of Medicine, Deakin University, Waurn Ponds, VIC, Australia
| | - Judith M Spies
- Sydney Medical School, Royal Prince Alfred Hospital, University of Sydney, Camperdown, NSW, Australia
| | - James Stankovich
- Menzies Research Institute, University of Tasmania, Hobart, TAS, Australia
| | - Ian Sutton
- Department of Neurology, St. Vincent's Hospital, Darlinghurst, NSW, Australia
| | - Steve Vucic
- Department of Neurology, Westmead Hospital, Westmead, NSW, Australia
| | - Michael Walsh
- Department of Neurology, Princess Alexandra Hospital, Woolloongabba, QLD, Australia
| | - Richard C Wong
- School of Medicine, Royal Brisbane and Women's Hospital, University of Queensland, Herston, QLD, Australia
| | - Eppie M Yiu
- School of Paediatrics, Royal Children's Hospital, University of Melbourne, Parkville, VIC, Australia
| | - Michael H Barnett
- Brain and Mind Centre, University of Sydney, Camperdown, NSW, Australia
| | - Allan G K Kermode
- Centre for Neuromuscular and Neurological Disorders, Queen Elizabeth II Medical Centre, Perron Institute for Neurological and Translational Science, University of Western Australia, Nedlands, WA, Australia
| | - Mark P Marriott
- Melbourne Brain Centre, Royal Melbourne Hospital, University of Melbourne, Parkville, VIC, Australia
| | - John D E Parratt
- Sydney Medical School, Royal Prince Alfred Hospital, University of Sydney, Camperdown, NSW, Australia
| | - Mark Slee
- Department of Neurology, College of Medicine and Public Health, Flinders University, Bedford Park, SA, Australia
| | - Bruce V Taylor
- Menzies Research Institute, University of Tasmania, Hobart, TAS, Australia
| | - Ernest Willoughby
- Department of Neurology, Auckland City Hospital, Grafton, New Zealand
| | - Fabienne Brilot
- Brain and Mind Centre, University of Sydney, Camperdown, NSW, Australia.,Neuroimmunology Group, Kids Neurosciences Centre, Children's Hospital at Westmead, University of Sydney, Westmead, NSW, Australia
| | - Angela Vincent
- Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, United Kingdom
| | - Patrick Waters
- Nuffield Department of Clinical Neurosciences, John Radcliffe Hospital, University of Oxford, Oxford, United Kingdom
| | - Simon A Broadley
- Menzies Health Institute Queensland, Gold Coast, Griffith University, Southport, QLD, Australia.,Department of Neurology, Gold Coast University Hospital, Southport, QLD, Australia
| |
Collapse
|
5
|
Clarke L, Arnett S, Lilley K, Liao J, Bhuta S, Broadley SA. Magnetic resonance imaging in neuromyelitis optica spectrum disorder. Clin Exp Immunol 2021; 206:251-265. [PMID: 34080180 DOI: 10.1111/cei.13630] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2021] [Revised: 05/19/2021] [Accepted: 05/20/2021] [Indexed: 12/30/2022] Open
Abstract
Neuromyelitis optica spectrum disorder (NMOSD) is an inflammatory disease of the central nervous system (CNS) associated with antibodies to aquaporin-4 (AQP4), which has distinct clinical, radiological and pathological features, but also has some overlap with multiple sclerosis and myelin oligodendrocyte glycoprotein (MOG) antibody associated disease. Early recognition of NMOSD is important because of differing responses to both acute and preventive therapy. Magnetic resonance (MR) imaging has proved essential in this process. Key MR imaging clues to the diagnosis of NMOSD are longitudinally extensive lesions of the optic nerve (more than half the length) and spinal cord (three or more vertebral segments), bilateral optic nerve lesions and lesions of the optic chiasm, area postrema, floor of the IV ventricle, periaqueductal grey matter, hypothalamus and walls of the III ventricle. Other NMOSD-specific lesions are denoted by their unique morphology: heterogeneous lesions of the corpus callosum, 'cloud-like' gadolinium (Gd)-enhancing white matter lesions and 'bright spotty' lesions of the spinal cord. Other lesions described in NMOSD, including linear periventricular peri-ependymal lesions and patch subcortical white matter lesions, may be less specific. The use of advanced MR imaging techniques is yielding further useful information regarding focal degeneration of the thalamus and optic radiation in NMOSD and suggests that paramagnetic rim patterns and changes in normal appearing white matter are specific to MS. MR imaging is crucial in the early recognition of NMOSD and in directing testing for AQP4 antibodies and guiding immediate acute treatment decisions. Increasingly, MR imaging is playing a role in diagnosing seronegative cases of NMOSD.
Collapse
Affiliation(s)
- Laura Clarke
- Menzies Health Institute Queensland, Gold Coast Campus, Griffith University, Nathan, QLD, Australia.,Department of Neurology, Princess Alexandra Hospital, Brisbane, QLD, Australia
| | - Simon Arnett
- Menzies Health Institute Queensland, Gold Coast Campus, Griffith University, Nathan, QLD, Australia.,Department of Neurology, Gold Coast University Hospital, Southport, QLD, Australia
| | - Kate Lilley
- Menzies Health Institute Queensland, Gold Coast Campus, Griffith University, Nathan, QLD, Australia.,Department of Neurology, Gold Coast University Hospital, Southport, QLD, Australia
| | - Jacky Liao
- Menzies Health Institute Queensland, Gold Coast Campus, Griffith University, Nathan, QLD, Australia
| | - Sandeep Bhuta
- Menzies Health Institute Queensland, Gold Coast Campus, Griffith University, Nathan, QLD, Australia.,Department of Radiology, Gold Coast University Hospital, Southport, QLD, Australia
| | - Simon A Broadley
- Menzies Health Institute Queensland, Gold Coast Campus, Griffith University, Nathan, QLD, Australia.,Department of Neurology, Gold Coast University Hospital, Southport, QLD, Australia
| |
Collapse
|
10
|
Vanikieti K, Poonyathalang A, Jindahra P, Bouzika P, Rizzo JF, Cestari DM. Clinical characteristics and long-term visual outcome of optic neuritis in neuromyelitis optica spectrum disorder: A comparison between Thai and American-Caucasian cohorts. Mult Scler Relat Disord 2017; 17:87-91. [PMID: 29055481 DOI: 10.1016/j.msard.2017.07.013] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2017] [Revised: 07/06/2017] [Accepted: 07/08/2017] [Indexed: 01/06/2023]
Abstract
BACKGROUND Neuromyelitis optica spectrum disorder (NMOSD) occurs more commonly in Asian than Caucasian populations. Few studies have examined the clinical features and visual outcome of optic neuritis (ON) within NMOSD in different racial populations. The objective of this study was to compare the clinical characteristics and long-term visual outcome of a Thai and an American-Caucasian cohort with NMOSD-related ON. METHODS Medical records including brain and orbital magnetic resonance imaging (MRI) of 16 consecutive subjects who developed visual loss due to ON as part of NMOSD evaluated at a single American tertiary referral center between 2006 and 2015 were reviewed and compared to those of 16 consecutive similar subjects evaluated at a single Thai tertiary referral center between 2010 and 2016. These cohorts represented the total number of NMOSD-related ON subjects seen during that time at those institutions. Statistical analyses were used for continuous and categorical data sets, and multiple regression analysis was used to adjust for differences in duration of follow-up and number of episodes of ON in each affected eye. RESULTS All subjects within the Thai cohort were Asian, while the American cohort initially consisted of 14 Caucasian, 1 Asian and 1 African-American subject, but the latter two were excluded from analysis. In the Thai cohort, ON occurred in 21 eyes, with a total of 19 episodes, while in the American-Caucasian cohort ON occurred in 22 eyes, with a total of 21 episodes. Aquaporin 4 (AQP4)-antibody was positive in all subjects except for one American-Caucasian subject. The mean follow-up time was 17.8 (± 16.0) and 52.8 (± 51.9) months for the Thai and American-Caucasian populations, respectively. There was no difference between the two cohorts with respect to gender, age of NMOSD and NMOSD-related ON onset, initial clinical presentation of NMOSD, initial visual acuity and automated visual fields, prevalence of swollen optic disc in the acute phase, presence of pain on the affected side, mean time of onset of ON symptoms to MRI examination, distribution of segmental involvement of the anterior visual pathway abnormalities based on MRI findings, mean time of onset of ON symptoms to treatment, final visual acuity and automated visual fields. However, a higher proportion of Thai affected eyes were found to have an initial visual acuity of 20/200 or worse compared with the American-Caucasian cohort. Azathioprine was the most common maintenance treatment (75%) used among Thai subjects in contrast to rituximab (78.6%) among American-Caucasian subjects. CONCLUSION Despite the different prevalence among Thai and American-Caucasian populations, the clinical characteristics of ON in the NMOSD were very similar across these two populations, other than for more severe visual loss initially among Thai subjects. Notably, long-term visual outcome did not differ between these cohorts despite significant difference in the maintenance treatment regimen. This study did not assess neurological status or outcome.
Collapse
Affiliation(s)
- Kavin Vanikieti
- Department of Ophthalmology, Faculty of Medicine Ramathibodi Hospital, Mahidol University, 270 Rama VI Road, Bangkok 10400, Thailand; Department of Ophthalmology, Harvard Medical School and the Massachusetts Eye and Ear Infirmary, 243 Charles Street, Boston, MA 02114, United States.
| | - Anuchit Poonyathalang
- Department of Ophthalmology, Faculty of Medicine Ramathibodi Hospital, Mahidol University, 270 Rama VI Road, Bangkok 10400, Thailand.
| | - Panitha Jindahra
- Department of Medicine, Faculty of Medicine Ramathibodi Hospital, Mahidol University, 270 Rama VI Road, Bangkok 10400, Thailand.
| | - Peggy Bouzika
- Department of Ophthalmology, Harvard Medical School and the Massachusetts Eye and Ear Infirmary, 243 Charles Street, Boston, MA 02114, United States.
| | - Joseph F Rizzo
- Department of Ophthalmology, Harvard Medical School and the Massachusetts Eye and Ear Infirmary, 243 Charles Street, Boston, MA 02114, United States.
| | - Dean M Cestari
- Department of Ophthalmology, Harvard Medical School and the Massachusetts Eye and Ear Infirmary, 243 Charles Street, Boston, MA 02114, United States.
| |
Collapse
|