1
|
Spitzer H, Ripart M, Whitaker K, D’Arco F, Mankad K, Chen AA, Napolitano A, De Palma L, De Benedictis A, Foldes S, Humphreys Z, Zhang K, Hu W, Mo J, Likeman M, Davies S, Güttler C, Lenge M, Cohen NT, Tang Y, Wang S, Chari A, Tisdall M, Bargallo N, Conde-Blanco E, Pariente JC, Pascual-Diaz S, Delgado-Martínez I, Pérez-Enríquez C, Lagorio I, Abela E, Mullatti N, O’Muircheartaigh J, Vecchiato K, Liu Y, Caligiuri ME, Sinclair B, Vivash L, Willard A, Kandasamy J, McLellan A, Sokol D, Semmelroch M, Kloster AG, Opheim G, Ribeiro L, Yasuda C, Rossi-Espagnet C, Hamandi K, Tietze A, Barba C, Guerrini R, Gaillard WD, You X, Wang I, González-Ortiz S, Severino M, Striano P, Tortora D, Kälviäinen R, Gambardella A, Labate A, Desmond P, Lui E, O’Brien T, Shetty J, Jackson G, Duncan JS, Winston GP, Pinborg LH, Cendes F, Theis FJ, Shinohara RT, Cross JH, Baldeweg T, Adler S, Wagstyl K. Interpretable surface-based detection of focal cortical dysplasias: a Multi-centre Epilepsy Lesion Detection study. Brain 2022; 145:3859-3871. [PMID: 35953082 PMCID: PMC9679165 DOI: 10.1093/brain/awac224] [Citation(s) in RCA: 25] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [What about the content of this article? (0)] [Affiliation(s)] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 04/22/2022] [Accepted: 05/26/2022] [Indexed: 11/13/2022] Open
Abstract
One outstanding challenge for machine learning in diagnostic biomedical imaging is algorithm interpretability. A key application is the identification of subtle epileptogenic focal cortical dysplasias (FCDs) from structural MRI. FCDs are difficult to visualize on structural MRI but are often amenable to surgical resection. We aimed to develop an open-source, interpretable, surface-based machine-learning algorithm to automatically identify FCDs on heterogeneous structural MRI data from epilepsy surgery centres worldwide. The Multi-centre Epilepsy Lesion Detection (MELD) Project collated and harmonized a retrospective MRI cohort of 1015 participants, 618 patients with focal FCD-related epilepsy and 397 controls, from 22 epilepsy centres worldwide. We created a neural network for FCD detection based on 33 surface-based features. The network was trained and cross-validated on 50% of the total cohort and tested on the remaining 50% as well as on 2 independent test sites. Multidimensional feature analysis and integrated gradient saliencies were used to interrogate network performance. Our pipeline outputs individual patient reports, which identify the location of predicted lesions, alongside their imaging features and relative saliency to the classifier. On a restricted 'gold-standard' subcohort of seizure-free patients with FCD type IIB who had T1 and fluid-attenuated inversion recovery MRI data, the MELD FCD surface-based algorithm had a sensitivity of 85%. Across the entire withheld test cohort the sensitivity was 59% and specificity was 54%. After including a border zone around lesions, to account for uncertainty around the borders of manually delineated lesion masks, the sensitivity was 67%. This multicentre, multinational study with open access protocols and code has developed a robust and interpretable machine-learning algorithm for automated detection of focal cortical dysplasias, giving physicians greater confidence in the identification of subtle MRI lesions in individuals with epilepsy.
Collapse
Affiliation(s)
- Hannah Spitzer
- Institute of Computational Biology, Helmholtz Center Munich, Munich 85764, Germany
| | - Mathilde Ripart
- Department of Developmental Neuroscience, UCL Great Ormond Street Institute for Child Health, London WC1N 1EH, UK
| | | | - Felice D’Arco
- Great Ormond Street Hospital NHS Foundation Trust, London WC1N 3JH, UK
| | - Kshitij Mankad
- Great Ormond Street Hospital NHS Foundation Trust, London WC1N 3JH, UK
| | - Andrew A Chen
- Penn Statistics in Imaging and Visualization Center, Department of Biostatistics, Epidemiology, and Informatics, University of Pennsylvania, Philadelphia, PA 19104, USA
- Center for Biomedical Image Computing and Analytics, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Antonio Napolitano
- Medical Physics Department, Bambino Gesù Children’s Hospital, Rome 00165, Italy
| | - Luca De Palma
- Rare and Complex Epilepsies, Department of Neurosciences, Bambino Gesù Children’s Hospital, IRCCS, Rome 00165, Italy
| | - Alessandro De Benedictis
- Neurosurgery Unit, Department of Neurosciences, Bambino Gesù Children’s Hospital, IRCCS, Rome 00165, Italy
| | - Stephen Foldes
- Barrow Neurological Institute at Phoenix Children’s Hospital, Phoenix, AZ 85016, USA
| | - Zachary Humphreys
- Barrow Neurological Institute at Phoenix Children’s Hospital, Phoenix, AZ 85016, USA
| | - Kai Zhang
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing 100054, China
| | - Wenhan Hu
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing 100054, China
| | - Jiajie Mo
- Department of Neurosurgery, Beijing Tiantan Hospital, Capital Medical University, Beijing 100054, China
| | - Marcus Likeman
- Bristol Royal Hospital for Children, Bristol BS2 8BJ, UK
| | - Shirin Davies
- School of Psychology, Cardiff University Brain Research Imaging Centre, Cardiff CF24 4HQ, UK
- The Welsh Epilepsy Unit, Cardiff and Vale University Health Board, University Hospital of Wales, Cardiff CF14 4XW, UK
| | | | - Matteo Lenge
- Neuroscience Department, Children’s Hospital Meyer-University of Florence, Florence 50139, Italy
| | - Nathan T Cohen
- Center for Neuroscience, Children’s National Hospital, Washington, DC 20012, USA
| | - Yingying Tang
- Department of Neurology, West China Hospital of Sichuan University, Chengdu 610093, China
- Epilepsy Center, Cleveland Clinic, Cleveland, OH 44106, USA
| | - Shan Wang
- Epilepsy Center, Cleveland Clinic, Cleveland, OH 44106, USA
- Department of Neurology, Epilepsy Center, Second Affiliated Hospital, School of Medicine, Zhejiang University, Hangzhou 310058, China
| | - Aswin Chari
- Department of Developmental Neuroscience, UCL Great Ormond Street Institute for Child Health, London WC1N 1EH, UK
- Great Ormond Street Hospital NHS Foundation Trust, London WC1N 3JH, UK
| | - Martin Tisdall
- Department of Developmental Neuroscience, UCL Great Ormond Street Institute for Child Health, London WC1N 1EH, UK
- Great Ormond Street Hospital NHS Foundation Trust, London WC1N 3JH, UK
| | - Nuria Bargallo
- Department of Neuroradiology, Hospital Clinic Barcelona and Magnetic Resonance Imaging, Core Facility, IDIBAPS, Barcelona 08036, Spain
- Centro de Investigación Biomédica en Red de Salud Mental, CIBERSAM, Madrid 28029, Spain
| | | | | | - Saül Pascual-Diaz
- Magnetic Resonance Imaging, Core Facility, IDIBAPS, Barcelona 08036, Spain
| | | | | | | | - Eugenio Abela
- Center for Neuropsychiatry and Intellectual Disability, Psychiatrische Dienste Aargau AG, Windisch 5120, Switzerland
| | - Nandini Mullatti
- Institute of Psychiatry, Psychology and Neuroscience, King’s College, London SE5 8AF, UK
| | - Jonathan O’Muircheartaigh
- Institute of Psychiatry, Psychology and Neuroscience, King’s College, London SE5 8AF, UK
- Department of Perinatal Imaging and Health, St. Thomas’ Hospital, King’s College London, London SE1 7EH, UK
| | - Katy Vecchiato
- Department of Perinatal Imaging and Health, St. Thomas’ Hospital, King’s College London, London SE1 7EH, UK
- Department of Forensic and Neurodevelopmental Sciences, Institute of Psychiatry, Psychology and Neuroscience, King’s College, London SE5 8AF, UK
| | - Yawu Liu
- Department of Neurology, University of Eastern Finland, Kuopio 70210, Finland
| | - Maria Eugenia Caligiuri
- Department of Medical and Surgical Sciences, Magna Graecia University of Catanzaro, Catanzaro 88100, Italy
| | - Ben Sinclair
- Department of Neuroscience, Central Clinical School, Monash University, Melbourne, VIC 3004, Australia
| | - Lucy Vivash
- Department of Neuroscience, Central Clinical School, Monash University, Melbourne, VIC 3004, Australia
- Department of Neurology, Monash University, Melbourne, VIC 3004, Australia
| | - Anna Willard
- Department of Neuroscience, Central Clinical School, Monash University, Melbourne, VIC 3004, Australia
| | - Jothy Kandasamy
- Royal Hospital for Children and Young People, Edinburgh EH16 4TJ, UK
| | - Ailsa McLellan
- Royal Hospital for Children and Young People, Edinburgh EH16 4TJ, UK
| | - Drahoslav Sokol
- Royal Hospital for Children and Young People, Edinburgh EH16 4TJ, UK
| | - Mira Semmelroch
- The Florey Institute of Neuroscience and Mental Health, University of Melbourne, Parkville, VIC 3052, Australia
| | - Ane G Kloster
- Neurobiology Research Unit, Copenhagen University Hospital—Rigshospitalet, Copenhagen 2100, Denmark
| | - Giske Opheim
- Neurobiology Research Unit, Copenhagen University Hospital—Rigshospitalet, Copenhagen 2100, Denmark
- Department of Neuroradiology, Copenhagen University Hospital—Rigshospitalet, Copenhagen 2100, Denmark
| | - Letícia Ribeiro
- Department of Neurology, University of Campinas, Campinas 13083-888, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology (BRAINN), University of Campinas, Campinas 13083-888, Brazil
| | - Clarissa Yasuda
- Department of Neurology, University of Campinas, Campinas 13083-888, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology (BRAINN), University of Campinas, Campinas 13083-888, Brazil
| | | | - Khalid Hamandi
- School of Psychology, Cardiff University Brain Research Imaging Centre, Cardiff CF24 4HQ, UK
- The Welsh Epilepsy Unit, University Hospital of Wales, Cardiff CF14 4XW, UK
| | - Anna Tietze
- Charité University Hospital, Berlin 10117, Germany
| | - Carmen Barba
- Neuroscience Department, Children’s Hospital Meyer-University of Florence, Florence 50139, Italy
| | - Renzo Guerrini
- Neuroscience Department, Children’s Hospital Meyer-University of Florence, Florence 50139, Italy
| | | | - Xiaozhen You
- Center for Neuroscience, Children’s National Hospital, Washington, DC 20012, USA
| | - Irene Wang
- Epilepsy Center, Cleveland Clinic, Cleveland, OH 44106, USA
| | - Sofía González-Ortiz
- Department of Neuroradiology, Hospital del Mar, Barcelona 08003, Spain
- Magnetic Resonance Imaging Core Facility, Institut d’Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona 08036, Spain
| | | | - Pasquale Striano
- IRCCS Istituto Giannina Gaslini, Genova 16147, Italy
- Department of Neurosciences, Rehabilitation, Ophthalmology, Genetics, Maternal and Child Health, University of Genova, Genova, Italy
| | | | - Reetta Kälviäinen
- Department of Neurology, University of Eastern Finland, Kuopio 70210, Finland
- Kuopio Epilepsy Center, Neurocenter, Kuopio University Hospital, Kuopio 70210, Finland
| | - Antonio Gambardella
- Institute of Neurology, Department of Medical and Surgical Sciences, Magna Graecia University, Catanzaro 88100, Italy
| | - Angelo Labate
- Neurology Unit, Department of BIOMORF, University of Messina, Messina 98168, Italy
| | - Patricia Desmond
- Department of Radiology, The Royal Melbourne Hospital, University of Melbourne, Parkville, VIC 3050, Australia
| | - Elaine Lui
- Department of Radiology, The Royal Melbourne Hospital, University of Melbourne, Parkville, VIC 3050, Australia
| | - Terence O’Brien
- Department of Neuroscience, Central Clinical School, Monash University, Melbourne, VIC 3004, Australia
- Department of Medicine, The Royal Melbourne Hospital, Parkville, VIC, 3052, Australia
| | - Jay Shetty
- Royal Hospital for Children and Young People, Edinburgh EH16 4TJ, UK
| | - Graeme Jackson
- The Florey Institute of Neuroscience and Mental Health, Austin Campus, Heidelberg, VIC 3071, Australia
- Department of Neurology, Austin Health, Heidelberg, VIC 3084, Australia
| | - John S Duncan
- UCL Queen Square Institute of Neurology, London WC1N 3BG, UK
| | - Gavin P Winston
- UCL Queen Square Institute of Neurology, London WC1N 3BG, UK
- Department of Medicine, Division of Neurology, Queen’s University, Kingston, ON, Canada K7L 3N6
| | - Lars H Pinborg
- Neurobiology Research Unit, Copenhagen University Hospital—Rigshospitalet, Copenhagen 2100, Denmark
- Epilepsy Clinic, Department of Neurology, Copenhagen University Hospital—Rigshopsitalet, Copenhagen 2100, Denmark
| | - Fernando Cendes
- Department of Neurology, University of Campinas, Campinas 13083-888, Brazil
- Brazilian Institute of Neuroscience and Neurotechnology (BRAINN), University of Campinas, Campinas 13083-888, Brazil
| | - Fabian J Theis
- Institute of Computational Biology, Helmholtz Center Munich, Munich 85764, Germany
- Department of Mathematics, Technical University of Munich, Garching 85748, Germany
| | - Russell T Shinohara
- Penn Statistics in Imaging and Visualization Center, Department of Biostatistics, Epidemiology, and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - J Helen Cross
- Department of Developmental Neuroscience, UCL Great Ormond Street Institute for Child Health, London WC1N 1EH, UK
- Young Epilepsy, Lingfield, Surrey RH7 6PW, UK
| | - Torsten Baldeweg
- Department of Developmental Neuroscience, UCL Great Ormond Street Institute for Child Health, London WC1N 1EH, UK
- Great Ormond Street Hospital NHS Foundation Trust, London WC1N 3JH, UK
| | - Sophie Adler
- Department of Developmental Neuroscience, UCL Great Ormond Street Institute for Child Health, London WC1N 1EH, UK
| | - Konrad Wagstyl
- Department of Developmental Neuroscience, UCL Great Ormond Street Institute for Child Health, London WC1N 1EH, UK
- Wellcome Centre for Human Neuroimaging, University College London, London WC1N 3AR, UK
| |
Collapse
|