1
|
Petersen M, Coenen M, DeCarli C, De Luca A, van der Lelij E, Barkhof F, Benke T, Chen CPLH, Dal-Bianco P, Dewenter A, Duering M, Enzinger C, Ewers M, Exalto LG, Fletcher EM, Franzmeier N, Hilal S, Hofer E, Koek HL, Maier AB, Maillard PM, McCreary CR, Papma JM, Pijnenburg YAL, Schmidt R, Smith EE, Steketee RME, van den Berg E, van der Flier WM, Venkatraghavan V, Venketasubramanian N, Vernooij MW, Wolters FJ, Xu X, Horn A, Patil KR, Eickhoff SB, Thomalla G, Biesbroek JM, Biessels GJ, Cheng B. Enhancing cognitive performance prediction by white matter hyperintensity connectivity assessment. Brain 2024; 147:4265-4279. [PMID: 39400198 PMCID: PMC11629703 DOI: 10.1093/brain/awae315] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2024] [Revised: 08/14/2024] [Accepted: 09/21/2024] [Indexed: 10/15/2024] Open
Abstract
White matter hyperintensities of presumed vascular origin (WMH) are associated with cognitive impairment and are a key imaging marker in evaluating brain health. However, WMH volume alone does not fully account for the extent of cognitive deficits and the mechanisms linking WMH to these deficits remain unclear. Lesion network mapping (LNM) enables us to infer if brain networks are connected to lesions and could be a promising technique for enhancing our understanding of the role of WMH in cognitive disorders. Our study employed LNM to test the following hypotheses: (i) LNM-informed markers surpass WMH volumes in predicting cognitive performance; and (ii) WMH contributing to cognitive impairment map to specific brain networks. We analysed cross-sectional data of 3485 patients from 10 memory clinic cohorts within the Meta VCI Map Consortium, using harmonized test results in four cognitive domains and WMH segmentations. WMH segmentations were registered to a standard space and mapped onto existing normative structural and functional brain connectome data. We employed LNM to quantify WMH connectivity to 480 atlas-based grey and white matter regions of interest (ROI), resulting in ROI-level structural and functional LNM scores. We compared the capacity of total and regional WMH volumes and LNM scores in predicting cognitive function using ridge regression models in a nested cross-validation. LNM scores predicted performance in three cognitive domains (attention/executive function, information processing speed, and verbal memory) significantly better than WMH volumes. LNM scores did not improve prediction for language functions. ROI-level analysis revealed that higher LNM scores, representing greater connectivity to WMH, in grey and white matter regions of the dorsal and ventral attention networks were associated with lower cognitive performance. Measures of WMH-related brain network connectivity significantly improve the prediction of current cognitive performance in memory clinic patients compared to WMH volume as a traditional imaging marker of cerebrovascular disease. This highlights the crucial role of network integrity, particularly in attention-related brain regions, improving our understanding of vascular contributions to cognitive impairment. Moving forward, refining WMH information with connectivity data could contribute to patient-tailored therapeutic interventions and facilitate the identification of subgroups at risk of cognitive disorders.
Collapse
Affiliation(s)
- Marvin Petersen
- Department of Neurology, University Medical Center Hamburg-Eppendorf, Hamburg 20251Germany
| | - Mirthe Coenen
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht 3584 CX, The Netherlands
| | - Charles DeCarli
- Department of Neurology, University of California, Davis, CA 95616USA
| | - Alberto De Luca
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht 3584 CX, The Netherlands
- Division Imaging and Oncology, Image Sciences Institute, UMC Utrecht, Utrecht 3584 CX, The Netherlands
| | - Ewoud van der Lelij
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht 3584 CX, The Netherlands
| | - Frederik Barkhof
- Department of Radiology and Nuclear Medicine, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam 1081 BT, The Netherlands
- Queen Square Institute of Neurology and Centre for Medical Image Computing, University College, London WC1N 3BG, UK
| | - Thomas Benke
- Clinic of Neurology, Medical University Innsbruck, Innsbruck 6020, Austria
| | - Christopher P L H Chen
- Department of Pharmacology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore
- Department of Psychological Medicine, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore
- Memory, Aging and Cognition Center, National University Health System, Singapore 119228, Singapore
| | - Peter Dal-Bianco
- Department of Neurology, Medical University Vienna, Vienna 1090, Austria
| | - Anna Dewenter
- Institute for Stroke and Dementia Research (ISD), LMU University Hospital, LMU Munich, Munich 81377, Germany
| | - Marco Duering
- Institute for Stroke and Dementia Research (ISD), LMU University Hospital, LMU Munich, Munich 81377, Germany
- Medical Image Analysis Center (MIAC) and Department of Biomedical Engineering, University of Basel, Basel 4051, Switzerland
| | - Christian Enzinger
- Division of General Neurology, Department of Neurology, Medical University Graz, Graz 8036, Austria
- Division of Neuroradiology, Interventional and Vascular Radiology, Department of Radiology, Medical University of Graz, Graz 8036, Austria
| | - Michael Ewers
- Institute for Stroke and Dementia Research (ISD), LMU University Hospital, LMU Munich, Munich 81377, Germany
| | - Lieza G Exalto
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht 3584 CX, The Netherlands
| | - Evan M Fletcher
- Department of Neurology, University of California, Davis, CA 95616USA
| | - Nicolai Franzmeier
- Institute for Stroke and Dementia Research (ISD), LMU University Hospital, LMU Munich, Munich 81377, Germany
| | - Saima Hilal
- Department of Psychological Medicine, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore
- Saw Swee Hock School of Public Health, National University of Singapore and National University Health System, Singapore 119228, Singapore
| | - Edith Hofer
- Division of Neurogeriatrics, Department of Neurology, Medical University of Graz, Graz 8036, Austria
- Institute for Medical Informatics, Statistics and Documentation, Medical University of Graz, Graz 8036, Austria
| | - Huiberdina L Koek
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht 3584 CX, The Netherlands
- Department of Geriatric Medicine, University Medical Center Utrecht, Utrecht University, Utrecht 3584 CX, The Netherlands
| | - Andrea B Maier
- Department of Pharmacology, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore
- Department of Psychological Medicine, Yong Loo Lin School of Medicine, National University of Singapore, Singapore 119228, Singapore
- Memory, Aging and Cognition Center, National University Health System, Singapore 119228, Singapore
| | | | - Cheryl R McCreary
- Department of Clinical Neurosciences and Radiology and Hotchkiss Brain Institute, University of Calgary, Calgary AB T2N 4N1, Canada
| | - Janne M Papma
- Alzheimer Center Erasmus MC, Erasmus MC University Medical Center, Rotterdam 3015 GD, The Netherlands
- Department of Neurology, Erasmus MC University Medical Center, Rotterdam 3015 GD, The Netherlands
- Department of Internal Medicine, Erasmus MC University Medical Center, Rotterdam 3015 GD, The Netherlands
| | - Yolande A L Pijnenburg
- Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam 1081 BT, The Netherlands
| | - Reinhold Schmidt
- Division of Neurogeriatrics, Department of Neurology, Medical University of Graz, Graz 8036, Austria
- Institute for Medical Informatics, Statistics and Documentation, Medical University of Graz, Graz 8036, Austria
| | - Eric E Smith
- Department of Clinical Neurosciences and Radiology and Hotchkiss Brain Institute, University of Calgary, Calgary AB T2N 4N1, Canada
| | - Rebecca M E Steketee
- Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam 1081 BT, The Netherlands
| | - Esther van den Berg
- Alzheimer Center Erasmus MC, Erasmus MC University Medical Center, Rotterdam 3015 GD, The Netherlands
- Department of Neurology, Erasmus MC University Medical Center, Rotterdam 3015 GD, The Netherlands
| | - Wiesje M van der Flier
- Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam 1081 BT, The Netherlands
| | - Vikram Venkatraghavan
- Alzheimer Center Amsterdam, Department of Neurology, Amsterdam Neuroscience, Amsterdam UMC, Vrije Universiteit Amsterdam, Amsterdam 1081 BT, The Netherlands
| | - Narayanaswamy Venketasubramanian
- Memory, Aging and Cognition Center, National University Health System, Singapore 119228, Singapore
- Raffles Neuroscience Center, Raffles Hospital, Singapore 119228, Singapore
| | - Meike W Vernooij
- Alzheimer Center Erasmus MC, Erasmus MC University Medical Center, Rotterdam 3015 GD, The Netherlands
- Department of Radiology and Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam 3015 GD, The Netherlands
- Department of Epidemiology, Erasmus MC University Medical Center, Rotterdam 3015 GD, The Netherlands
| | - Frank J Wolters
- Department of Radiology and Nuclear Medicine, Erasmus MC University Medical Center, Rotterdam 3015 GD, The Netherlands
- Department of Epidemiology, Erasmus MC University Medical Center, Rotterdam 3015 GD, The Netherlands
| | - Xin Xu
- Memory, Aging and Cognition Center, National University Health System, Singapore 119228, Singapore
- School of Public Health and the Second Affiliated Hospital of School of Medicine, Zhejiang University, Zhejiang 310009, China
| | - Andreas Horn
- Department of Neurology with Experimental Neurology, Charité - Universitätsmedizin Berlin, Movement Disorders and Neuromodulation Unit, Berlin 10117, Germany
- Department of Neurology, Psychiatry, and Radiology, Center for Brain Circuit Therapeutics, Brigham and Women’s Hospital, Harvard Medical School, Boston, MA 02115, USA
| | - Kaustubh R Patil
- Institute for Systems Neuroscience, Medical Faculty, Heinrich-Heine University Düsseldorf, Düsseldorf 40225, Germany
- Institute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Center Jülich, Jülich 52428, Germany
| | - Simon B Eickhoff
- Institute for Systems Neuroscience, Medical Faculty, Heinrich-Heine University Düsseldorf, Düsseldorf 40225, Germany
- Institute of Neuroscience and Medicine, Brain and Behaviour (INM-7), Research Center Jülich, Jülich 52428, Germany
| | - Götz Thomalla
- Department of Neurology, University Medical Center Hamburg-Eppendorf, Hamburg 20251Germany
| | - J Matthijs Biesbroek
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht 3584 CX, The Netherlands
- Department of Neurology, Diakonessenhuis Hospital, Utrecht 3582 KE, The Netherlands
| | - Geert Jan Biessels
- Department of Neurology and Neurosurgery, University Medical Center Utrecht Brain Center, Utrecht 3584 CX, The Netherlands
| | - Bastian Cheng
- Department of Neurology, University Medical Center Hamburg-Eppendorf, Hamburg 20251Germany
| |
Collapse
|
2
|
Pérez-Guerrero EE, Guillén-Medina MR, Márquez-Sandoval F, Vera-Cruz JM, Gallegos-Arreola MP, Rico-Méndez MA, Aguilar-Velázquez JA, Gutiérrez-Hurtado IA. Methodological and Statistical Considerations for Cross-Sectional, Case-Control, and Cohort Studies. J Clin Med 2024; 13:4005. [PMID: 39064045 PMCID: PMC11277135 DOI: 10.3390/jcm13144005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/18/2024] [Revised: 07/01/2024] [Accepted: 07/03/2024] [Indexed: 07/28/2024] Open
Abstract
Epidemiological studies are essential in medicine and public health as they help identify risk factors and causes of diseases. Additionally, they are key to planning, implementing, and evaluating health interventions aimed at preventing and controlling the spread of diseases. Among these studies, analytical observational studies, such as cross-sectional, case-control, and cohort studies, are the most used. The validity of their results largely depends on the robustness of the design, execution, and statistical analysis. Objective: The objective of this study is to examine the most common errors in the selection of methodological design and statistical tests in analytical observational studies and to provide recommendations to correct them. Methodology: A comprehensive review of the available literature on methodology in epidemiological observational studies was conducted, focusing on cross-sectional, case-control, and cohort studies. Common errors in the selection of designs and statistical tests were identified and analyzed. Results and Conclusions: Errors in the selection of methodological design and statistical tests are common in epidemiological observational studies. Based on the identified errors, a series of recommendations is provided to improve the selection of methodological design and statistical tests, thereby increasing the reliability of the results in cross-sectional, case-control, and cohort studies.
Collapse
Affiliation(s)
- Edsaúl Emilio Pérez-Guerrero
- Departamento de Biología Molecular y Genómica, Instituto de Investigación en Ciencias Biomédicas, Centro Universitario de Ciencias de la Salud, Universidad de Guadalajara, Guadalajara 44340, Mexico
| | - Miryam Rosario Guillén-Medina
- Doctorado en Farmacología, Instituto de Investigación en Ciencias Biomédicas, Centro Universitario de Ciencias de la Salud, Universidad de Guadalajara, Guadalajara 44340, Mexico
| | - Fabiola Márquez-Sandoval
- Doctorado en Ciencias de la Nutrición Traslacional, Departamento de Clínicas de la Reproducción Humana, Crecimiento y Desarrollo Infantil, Centro Universitario de Ciencias de la Salud, Universidad de Guadalajara, Guadalajara 44340, Mexico
| | - José María Vera-Cruz
- Departamento de Biología Molecular y Genómica, Instituto de Nutrigenética y Nutrigenómica Traslacional, Centro Universitario de Ciencias de la Salud, Universidad de Guadalajara, Guadalajara 44340, Mexico
| | - Martha Patricia Gallegos-Arreola
- División de Genética, Centro de Investigación Biomédica de Occidente (CIBO), Centro Médico Nacional de Occidente (CMNO), Instituto Mexicano del Seguro Social (IMSS), Guadalajara 44340, Mexico
| | - Manuel Alejandro Rico-Méndez
- Doctorado en Genética Humana, Centro Universitario de Ciencias de la Salud, Universidad de Guadalajara, Guadalajara 44340, Mexico
| | - José Alonso Aguilar-Velázquez
- Laboratorio de Ciencias Morfológico Forenses y Medicina Molecular, Departamento de Morfología, Centro Universitario de Ciencias de la Salud, Universidad de Guadalajara, Guadalajara 44340, Mexico
| | - Itzae Adonai Gutiérrez-Hurtado
- Departamento de Biología Molecular y Genómica, Centro Universitario de Ciencias de la Salud, Universidad de Guadalajara, Guadalajara 44340, Mexico
| |
Collapse
|
3
|
Boverhof BJ, Redekop WK, Bos D, Starmans MPA, Birch J, Rockall A, Visser JJ. Radiology AI Deployment and Assessment Rubric (RADAR) to bring value-based AI into radiological practice. Insights Imaging 2024; 15:34. [PMID: 38315288 PMCID: PMC10844175 DOI: 10.1186/s13244-023-01599-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2023] [Accepted: 11/14/2023] [Indexed: 02/07/2024] Open
Abstract
OBJECTIVE To provide a comprehensive framework for value assessment of artificial intelligence (AI) in radiology. METHODS This paper presents the RADAR framework, which has been adapted from Fryback and Thornbury's imaging efficacy framework to facilitate the valuation of radiology AI from conception to local implementation. Local efficacy has been newly introduced to underscore the importance of appraising an AI technology within its local environment. Furthermore, the RADAR framework is illustrated through a myriad of study designs that help assess value. RESULTS RADAR presents a seven-level hierarchy, providing radiologists, researchers, and policymakers with a structured approach to the comprehensive assessment of value in radiology AI. RADAR is designed to be dynamic and meet the different valuation needs throughout the AI's lifecycle. Initial phases like technical and diagnostic efficacy (RADAR-1 and RADAR-2) are assessed pre-clinical deployment via in silico clinical trials and cross-sectional studies. Subsequent stages, spanning from diagnostic thinking to patient outcome efficacy (RADAR-3 to RADAR-5), require clinical integration and are explored via randomized controlled trials and cohort studies. Cost-effectiveness efficacy (RADAR-6) takes a societal perspective on financial feasibility, addressed via health-economic evaluations. The final level, RADAR-7, determines how prior valuations translate locally, evaluated through budget impact analysis, multi-criteria decision analyses, and prospective monitoring. CONCLUSION The RADAR framework offers a comprehensive framework for valuing radiology AI. Its layered, hierarchical structure, combined with a focus on local relevance, aligns RADAR seamlessly with the principles of value-based radiology. CRITICAL RELEVANCE STATEMENT The RADAR framework advances artificial intelligence in radiology by delineating a much-needed framework for comprehensive valuation. KEYPOINTS • Radiology artificial intelligence lacks a comprehensive approach to value assessment. • The RADAR framework provides a dynamic, hierarchical method for thorough valuation of radiology AI. • RADAR advances clinical radiology by bridging the artificial intelligence implementation gap.
Collapse
Affiliation(s)
- Bart-Jan Boverhof
- Erasmus School of Health Policy and Management, Erasmus University Rotterdam, Rotterdam, The Netherlands
| | - W Ken Redekop
- Erasmus School of Health Policy and Management, Erasmus University Rotterdam, Rotterdam, The Netherlands
| | - Daniel Bos
- Department of Epidemiology, Erasmus University Medical Centre, Rotterdam, The Netherlands
- Department of Radiology & Nuclear Medicine, Erasmus University Medical Centre, Rotterdam, The Netherlands
| | - Martijn P A Starmans
- Department of Radiology & Nuclear Medicine, Erasmus University Medical Centre, Rotterdam, The Netherlands
| | | | - Andrea Rockall
- Department of Surgery & Cancer, Imperial College London, London, UK
| | - Jacob J Visser
- Department of Radiology & Nuclear Medicine, Erasmus University Medical Centre, Rotterdam, The Netherlands.
| |
Collapse
|