1
|
Feng J, Hui D, Zheng Q, Guo Y, Xia Y, Shi F, Zhou Q, Yu F, He X, Wang S, Li C. Automatic detection of cognitive impairment in patients with white matter hyperintensity and causal analysis of related factors using artificial intelligence of MRI. Comput Biol Med 2024; 178:108684. [PMID: 38852399 DOI: 10.1016/j.compbiomed.2024.108684] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2023] [Revised: 05/28/2024] [Accepted: 05/31/2024] [Indexed: 06/11/2024]
Abstract
PURPOSE White matter hyperintensity (WMH) is a common feature of brain aging, often linked with cognitive decline and dementia. This study aimed to employ deep learning and radiomics to develop models for detecting cognitive impairment in WMH patients and to analyze the causal relationships among cognitive impairment and related factors. MATERIALS AND METHODS A total of 79 WMH patients from hospital 1 were randomly divided into a training set (62 patients) and a testing set (17 patients). Additionally, 29 patients from hospital 2 were included as an independent testing set. All participants underwent formal neuropsychological assessments to determine cognitive status. Automated identification and segmentation of WMH were conducted using VB-net, with extraction of radiomics features from cortex, white matter, and nuclei. Four machine learning classifiers were trained on the training set and validated on the testing set to detect cognitive impairment. Model performances were evaluated and compared. Causal analyses were conducted among cortex, white matter, nuclei alterations, and cognitive impairment. RESULTS Among the models, the logistic regression (LR) model based on white matter features demonstrated the highest performance, achieving an AUC of 0.819 in the external test dataset. Causal analyses indicated that age, education level, alterations in cortex, white matter, and nuclei were causal factors of cognitive impairment. CONCLUSION The LR model based on white matter features exhibited high accuracy in detecting cognitive impairment in WMH patients. Furthermore, the possible causal relationships among alterations in cortex, white matter, nuclei, and cognitive impairment were elucidated.
Collapse
Affiliation(s)
- Junbang Feng
- Medical Imaging Department, Chongqing University Central Hospital, Chongqing Emergency Medical Center, Chongqing, China; Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Dongming Hui
- Department of Radiology, Chongqing Western Hospital, Chongqing, China
| | - Qingqing Zheng
- Department of Radiology, The First Affiliated Hospital of Chongqing Medical and Pharmaceutical College, Chongqing, China
| | - Yi Guo
- Medical Imaging Department, Chongqing University Central Hospital, Chongqing Emergency Medical Center, Chongqing, China
| | - Yuwei Xia
- Department of Research and Development, Shanghai United Imaging Intelligence, Co., Ltd., Shanghai, China
| | - Feng Shi
- Department of Research and Development, Shanghai United Imaging Intelligence, Co., Ltd., Shanghai, China
| | - Qing Zhou
- Department of Research and Development, Shanghai United Imaging Intelligence, Co., Ltd., Shanghai, China
| | - Fei Yu
- Medical Imaging Department, Chongqing University Central Hospital, Chongqing Emergency Medical Center, Chongqing, China
| | - Xiaojing He
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Shike Wang
- Department of Radiology, The Second Affiliated Hospital of Chongqing Medical University, Chongqing, China
| | - Chuanming Li
- Medical Imaging Department, Chongqing University Central Hospital, Chongqing Emergency Medical Center, Chongqing, China.
| |
Collapse
|
2
|
Brookshire G, Kasper J, Blauch NM, Wu YC, Glatt R, Merrill DA, Gerrol S, Yoder KJ, Quirk C, Lucero C. Data leakage in deep learning studies of translational EEG. Front Neurosci 2024; 18:1373515. [PMID: 38765672 PMCID: PMC11099244 DOI: 10.3389/fnins.2024.1373515] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/19/2024] [Accepted: 04/04/2024] [Indexed: 05/22/2024] Open
Abstract
A growing number of studies apply deep neural networks (DNNs) to recordings of human electroencephalography (EEG) to identify a range of disorders. In many studies, EEG recordings are split into segments, and each segment is randomly assigned to the training or test set. As a consequence, data from individual subjects appears in both the training and the test set. Could high test-set accuracy reflect data leakage from subject-specific patterns in the data, rather than patterns that identify a disease? We address this question by testing the performance of DNN classifiers using segment-based holdout (in which segments from one subject can appear in both the training and test set), and comparing this to their performance using subject-based holdout (where all segments from one subject appear exclusively in either the training set or the test set). In two datasets (one classifying Alzheimer's disease, and the other classifying epileptic seizures), we find that performance on previously-unseen subjects is strongly overestimated when models are trained using segment-based holdout. Finally, we survey the literature and find that the majority of translational DNN-EEG studies use segment-based holdout. Most published DNN-EEG studies may dramatically overestimate their classification performance on new subjects.
Collapse
Affiliation(s)
| | - Jake Kasper
- SPARK Neuro Inc., New York, NY, United States
| | - Nicholas M. Blauch
- SPARK Neuro Inc., New York, NY, United States
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, United States
| | | | - Ryan Glatt
- Pacific Brain Health Center, Pacific Neuroscience Institute and Foundation, Santa Monica, CA, United States
| | - David A. Merrill
- Pacific Brain Health Center, Pacific Neuroscience Institute and Foundation, Santa Monica, CA, United States
- Saint John's Cancer Institute at Providence Saint John's Health Center, Santa Monica, CA, United States
- Psychiatry and Biobehavioral Sciences, Semel Institute for Neuroscience and Human Behavior, David Geffen School of Medicine at University of California, Los Angeles, Los Angeles, CA, United States
| | | | | | - Colin Quirk
- SPARK Neuro Inc., New York, NY, United States
| | - Ché Lucero
- SPARK Neuro Inc., New York, NY, United States
| |
Collapse
|
3
|
Eyamu J, Kim WS, Kim K, Lee KH, Kim JU. Prefrontal intra-individual ERP variability and its asymmetry: exploring its biomarker potential in mild cognitive impairment. Alzheimers Res Ther 2024; 16:83. [PMID: 38615028 PMCID: PMC11015694 DOI: 10.1186/s13195-024-01452-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Accepted: 04/04/2024] [Indexed: 04/15/2024]
Abstract
BACKGROUND The worldwide trend of demographic aging highlights the progress made in healthcare, albeit with health challenges like Alzheimer's Disease (AD), prevalent in individuals aged 65 and above. Its early detection at the mild cognitive impairment (MCI) stage is crucial. Event-related potentials (ERPs) obtained by averaging EEG segments responded to repeated events are vital for cognitive impairment research. Consequently, examining intra-trial ERP variability is vital for comprehending fluctuations within psychophysiological processes of interest. This study aimed to investigate cognitive deficiencies and instability in MCI using ERP variability and its asymmetry from a prefrontal two-channel EEG device. METHODS In this study, ERP variability for both target and non-target responses was examined using the response variance curve (RVC) in a sample comprising 481 participants with MCI and 1,043 age-matched healthy individuals. The participants engaged in auditory selective attention tasks. Cognitive decline was assessed using the Seoul Neuropsychological Screening Battery (SNSB) and the Mini-Mental State Examination (MMSE). The research employed various statistical methods, including independent t-tests, and univariate and multiple logistic regression analyses. These analyses were conducted to investigate group differences and explore the relationships between neuropsychological test results, ERP variability and its asymmetry measures, and the prevalence of MCI. RESULTS Our results showed that patients with MCI exhibited unstable cognitive processing, characterized by increased ERP variability compared to cognitively normal (CN) adults. Multiple logistic regression analyses confirmed the association between ERP variability in the target and non-target responses with MCI prevalence, independent of demographic and neuropsychological factors. DISCUSSION The unstable cognitive processing in the MCI group compared to the CN individuals implies abnormal neurological changes and reduced and (or) unstable attentional maintenance during cognitive processing. Consequently, utilizing ERP variability measures from a portable EEG device could serve as a valuable addition to the conventional ERP measures of latency and amplitude. This approach holds significant promise for identifying mild cognitive deficits and neural alterations in individuals with MCI.
Collapse
Affiliation(s)
- Joel Eyamu
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, South Korea
- KM Convergence Science, University of Science and Technology, Daejeon, South Korea
| | - Wuon-Shik Kim
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, South Korea
| | - Kahye Kim
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, South Korea
| | - Kun Ho Lee
- Gwangju Alzheimer's Disease and Related Dementias (GARD) Cohort Research Center, Chosun University, Gwangju, South Korea
- Department of Biomedical Science, Chosun University, Gwangju, South Korea
- Dementia Research Group, Korea Brain Research Institute, Daegu, South Korea
| | - Jaeuk U Kim
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, South Korea.
- KM Convergence Science, University of Science and Technology, Daejeon, South Korea.
| |
Collapse
|
4
|
Ling X, Wang S, Zhang S, Li W, Zhang Q, Cai W, Li H. Contingent negative variation as an evaluation indicator of neurocognitive disorder after traumatic brain injury. Front Psychiatry 2023; 14:1255608. [PMID: 38169851 PMCID: PMC10758395 DOI: 10.3389/fpsyt.2023.1255608] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/09/2023] [Accepted: 11/30/2023] [Indexed: 01/05/2024] Open
Abstract
Introduction Neurocognitive disorders are commonly observed in patients suffering from traumatic brain injury (TBI). Methods to assess neurocognitive disorders have thus drawn the general attention of the public, especially electrophysiology parameter such as contingent negative variation (CNV), which has been given more emphasis as a neurophysiological marker in event-related potentials (ERPs) for diagnosing a neurocognitive disorder and assessing its severity. The present study focused on the correlations between CNV parameters and levels of daily living activities and social function to explore the potential of CNV as an objective assessment tool. Methods Thirty-one patients with a diagnosis of neurocognitive disorder after a TBI according to ICD-10 were enrolled as the patient group, and 24 matched healthy volunteers were enrolled as the control group. The activity of daily living scale, functional activities questionnaire, social disability screening schedule, and scale of personality change following TBI were used to assess daily living activity and social function. Results The scale scores in patients were significantly higher than those in controls. Maximum amplitudes before S2 and during the post-imperative negative variation (PINV) period were also significantly higher in the patient group compared to the control group and were positively correlated with four scale scores. The duration of PINV at Fz and Cz was significantly shorter in the patient group than in the control group. The CNV return to baseline from a positive wave at electrode Fz and Cz occurred significantly earlier in the control group than in the patient group, while at Pz, the result showed the opposite. Conclusion Lower amplitudes of CNV were associated with more severe neurocognitive disorder and greater impairments in daily life abilities and social function. The duration of PINV and the latency of returning to baseline from a positive wave were correlated with the neurocognitive disorder to some extent. CNV could be used as an objective, electrophysiology-based parameter for evaluating the severity of the neurocognitive disorder and personality changes after TBI.
Collapse
Affiliation(s)
- Xindi Ling
- Shanghai Key Lab of Forensic Medicine, Key Lab of Forensic Science, Ministry of Justice, Shanghai Forensic Service Platform, Academy of Forensic Science, Shanghai, China
- Department of Forensic Medicine, School of Basic Medical Sciences, Fudan University, Shanghai, China
| | - Shujian Wang
- Shanghai Key Lab of Forensic Medicine, Key Lab of Forensic Science, Ministry of Justice, Shanghai Forensic Service Platform, Academy of Forensic Science, Shanghai, China
| | - Shengyu Zhang
- Shanghai Key Lab of Forensic Medicine, Key Lab of Forensic Science, Ministry of Justice, Shanghai Forensic Service Platform, Academy of Forensic Science, Shanghai, China
| | - Wen Li
- Shanghai Key Lab of Forensic Medicine, Key Lab of Forensic Science, Ministry of Justice, Shanghai Forensic Service Platform, Academy of Forensic Science, Shanghai, China
| | - Qinting Zhang
- Shanghai Key Lab of Forensic Medicine, Key Lab of Forensic Science, Ministry of Justice, Shanghai Forensic Service Platform, Academy of Forensic Science, Shanghai, China
| | - Weixiong Cai
- Shanghai Key Lab of Forensic Medicine, Key Lab of Forensic Science, Ministry of Justice, Shanghai Forensic Service Platform, Academy of Forensic Science, Shanghai, China
- Department of Forensic Medicine, School of Basic Medical Sciences, Fudan University, Shanghai, China
| | - Haozhe Li
- Shanghai Key Lab of Forensic Medicine, Key Lab of Forensic Science, Ministry of Justice, Shanghai Forensic Service Platform, Academy of Forensic Science, Shanghai, China
| |
Collapse
|
5
|
Eyamu J, Kim WS, Kim K, Lee KH, Kim JU. Prefrontal event-related potential markers in association with mild cognitive impairment. Front Aging Neurosci 2023; 15:1273008. [PMID: 37927335 PMCID: PMC10620700 DOI: 10.3389/fnagi.2023.1273008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2023] [Accepted: 09/28/2023] [Indexed: 11/07/2023] Open
Abstract
Background Alzheimer's disease (AD) is among the leading contributors of dementia globally with approximately 60-70% of its cases. Current research is focused on the mild cognitive impairment (MCI), which is associated with cognitive decline but does not disrupt routine activities. Event-related potential (ERP) research is essential in screening patients with MCI. Low-density channel electroencephalography (EEG) is frequently used due to its convenience, portability, and affordability, making it suitable for resource-constrained environments. Despite extensive research on neural biomarkers for cognitive impairment, there is a considerable gap in understanding the effects on early stages of cognitive processes, particularly when combining physiological and cognitive markers using portable devices. The present study aimed to examine cognitive shortfalls and behavioral changes in patients with MCI using prefrontal selective attention ERP recorded from a prefrontal two-channel EEG device. Methods We assessed cognitive decline using the Mini-Mental State Examination (MMSE) and the Seoul Neuropsychological Screening Battery (SNSB). We administered auditory selective attention tasks to 598 elderly participants, including those with MCI (160) and cognitively normal (CN) individuals (407). We conducted statistical analyses such as independent t-tests, Pearson's correlations, and univariate and multiple logistic regression analyses to assess group differences and associations between neuropsychological tests, ERP measures, behavioral measures, and MCI prevalence. Results Our findings revealed that patients with MCI demonstrated slower information-processing abilities, and exhibited poorer task execution, characterized by reduced accuracy, increased errors, and higher variability in response time, compared to CN adults. Multiple logistic regression analyses confirmed the association between some ERP and behavioral measures with MCI prevalence, independent of demographic and neuropsychological factors. A relationship was observed between neuropsychological scores, ERP, and behavioral measures. Discussion The slower information processing abilities, and poor task execution in the MCI group compared to the CN individuals suggests flawed neurological changes and reduced attentional maintenance during cognitive processing, respectively. Hence, the utilization of portable EEG devices to capture prefrontal selective attention ERPs, in combination with behavioral assessments, holds promise for the identification of mild cognitive deficits and neural alterations in individuals with MCI. This approach could potentially augment the traditional neuropsychological tests during clinical screening for MCI.
Collapse
Affiliation(s)
- Joel Eyamu
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, Republic of Korea
- KM Convergence Science, University of Science and Technology, Daejeon, Republic of Korea
| | - Wuon-Shik Kim
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, Republic of Korea
| | - Kahye Kim
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, Republic of Korea
| | - Kun Ho Lee
- Gwangju Alzheimer’s Disease and Related Dementias (GARD) Cohort Research Center, Chosun University, Gwangju, Republic of Korea
- Department of Biomedical Science, Chosun University, Gwangju, Republic of Korea
- Dementia Research Group, Korea Brain Research Institute, Daegu, Republic of Korea
| | - Jaeuk U. Kim
- Digital Health Research Division, Korea Institute of Oriental Medicine, Daejeon, Republic of Korea
- KM Convergence Science, University of Science and Technology, Daejeon, Republic of Korea
| |
Collapse
|
6
|
Ulbl J, Rakusa M. The Importance of Subjective Cognitive Decline Recognition and the Potential of Molecular and Neurophysiological Biomarkers-A Systematic Review. Int J Mol Sci 2023; 24:10158. [PMID: 37373304 DOI: 10.3390/ijms241210158] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2023] [Revised: 06/01/2023] [Accepted: 06/10/2023] [Indexed: 06/29/2023] Open
Abstract
Subjective cognitive decline (SCD) and mild cognitive impairment (MCI) are early stages of Alzheimer's disease (AD). Neurophysiological markers such as electroencephalography (EEG) and event-related potential (ERP) are emerging as alternatives to traditional molecular and imaging markers. This paper aimed to review the literature on EEG and ERP markers in individuals with SCD. We analysed 30 studies that met our criteria, with 17 focusing on resting-state or cognitive task EEG, 11 on ERPs, and two on both EEG and ERP parameters. Typical spectral changes were indicative of EEG rhythm slowing and were associated with faster clinical progression, lower education levels, and abnormal cerebrospinal fluid biomarkers profiles. Some studies found no difference in ERP components between SCD subjects, controls, or MCI, while others reported lower amplitudes in the SCD group compared to controls. Further research is needed to explore the prognostic value of EEG and ERP in relation to molecular markers in individuals with SCD.
Collapse
Affiliation(s)
- Janina Ulbl
- Division of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia
- Faculty of Medicine, University of Maribor, 2000 Maribor, Slovenia
| | - Martin Rakusa
- Division of Neurology, University Medical Centre Maribor, 2000 Maribor, Slovenia
- Faculty of Medicine, University of Maribor, 2000 Maribor, Slovenia
| |
Collapse
|