1
|
Jiao M, Yang S, Xian X, Fotedar N, Liu F. Multi-Modal Electrophysiological Source Imaging With Attention Neural Networks Based on Deep Fusion of EEG and MEG. IEEE Trans Neural Syst Rehabil Eng 2024; 32:2492-2502. [PMID: 38976470 PMCID: PMC11329068 DOI: 10.1109/tnsre.2024.3424669] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/10/2024]
Abstract
The process of reconstructing underlying cortical and subcortical electrical activities from Electroencephalography (EEG) or Magnetoencephalography (MEG) recordings is called Electrophysiological Source Imaging (ESI). Given the complementarity between EEG and MEG in measuring radial and tangential cortical sources, combined EEG/MEG is considered beneficial in improving the reconstruction performance of ESI algorithms. Traditional algorithms mainly emphasize incorporating predesigned neurophysiological priors to solve the ESI problem. Deep learning frameworks aim to directly learn the mapping from scalp EEG/MEG measurements to the underlying brain source activities in a data-driven manner, demonstrating superior performance compared to traditional methods. However, most of the existing deep learning approaches for the ESI problem are performed on a single modality of EEG or MEG, meaning the complementarity of these two modalities has not been fully utilized. How to fuse the EEG and MEG in a more principled manner under the deep learning paradigm remains a challenging question. This study develops a Multi-Modal Deep Fusion (MMDF) framework using Attention Neural Networks (ANN) to fully leverage the complementary information between EEG and MEG for solving the ESI inverse problem, which is termed as MMDF-ANN. Specifically, our proposed brain source imaging approach consists of four phases, including feature extraction, weight generation, deep feature fusion, and source mapping. Our experimental results on both synthetic dataset and real dataset demonstrated that using a fusion of EEG and MEG can significantly improve the source localization accuracy compared to using a single-modality of EEG or MEG. Compared to the benchmark algorithms, MMDF-ANN demonstrated good stability when reconstructing sources with extended activation areas and situations of EEG/MEG measurements with a low signal-to-noise ratio.
Collapse
|
2
|
Hecker L, Tebartz van Elst L, Kornmeier J. Source localization using recursively applied and projected MUSIC with flexible extent estimation. Front Neurosci 2023; 17:1170862. [PMID: 37255753 PMCID: PMC10225686 DOI: 10.3389/fnins.2023.1170862] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/21/2023] [Accepted: 04/17/2023] [Indexed: 06/01/2023] Open
Abstract
Magneto- and electroencephalography (M/EEG) are widespread techniques to measure neural activity in-vivo at a high temporal resolution but low spatial resolution. Locating the neural sources underlying the M/EEG poses an inverse problem, which is ill-posed. We developed a new method based on Recursive Application of Multiple Signal Classification (MUSIC). Our proposed method is able to recover not only the locations but, in contrast to other inverse solutions, also the extent of active brain regions flexibly (FLEX-MUSIC). This is achieved by allowing it to search not only for single dipoles but also dipole clusters of increasing extent to find the best fit during each recursion. FLEX-MUSIC achieved the highest accuracy for both single dipole and extended sources compared to all other methods tested. Remarkably, FLEX-MUSIC was capable to accurately estimate the level of sparsity in the source space (r = 0.82), whereas all other approaches tested failed to do so (r ≤ 0.18). The average computation time of FLEX-MUSIC was considerably lower compared to a popular Bayesian approach and comparable to that of another recursive MUSIC approach and eLORETA. FLEX-MUSIC produces only few errors and was capable to reliably estimate the extent of sources. The accuracy and low computation time of FLEX-MUSIC renders it an improved technique to solve M/EEG inverse problems both in neuroscience research and potentially in pre-surgery diagnostic in epilepsy.
Collapse
Affiliation(s)
- Lukas Hecker
- Department of Psychiatry and Psychotherapy, University of Freiburg Medical Center, Freiburg, Germany
- Department of Psychosomatic Medicine and Psychotherapy, University of Freiburg Medical Center, Freiburg, Germany
- Perception and Cognition Lab, Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
- Faculty of Biology, University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Ludger Tebartz van Elst
- Department of Psychiatry and Psychotherapy, University of Freiburg Medical Center, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
| | - Jürgen Kornmeier
- Department of Psychiatry and Psychotherapy, University of Freiburg Medical Center, Freiburg, Germany
- Perception and Cognition Lab, Institute for Frontier Areas of Psychology and Mental Health, Freiburg, Germany
- Faculty of Biology, University of Freiburg, Freiburg, Germany
- Faculty of Medicine, University of Freiburg, Freiburg, Germany
| |
Collapse
|
3
|
Wang H, Guo Y, Tu Y, Peng W, Lu X, Bi Y, Iannetti GD, Hu L. Neural processes responsible for the translation of sustained nociceptive inputs into subjective pain experience. Cereb Cortex 2022; 33:634-650. [PMID: 35244170 PMCID: PMC9890464 DOI: 10.1093/cercor/bhac090] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2021] [Revised: 01/24/2022] [Accepted: 02/11/2022] [Indexed: 02/04/2023] Open
Abstract
Tracking and predicting the temporal structure of nociceptive inputs is crucial to promote survival, as proper and immediate reactions are necessary to avoid actual or potential bodily injury. Neural activities elicited by nociceptive stimuli with different temporal structures have been described, but the neural processes responsible for translating nociception into pain perception are not fully elucidated. To tap into this issue, we recorded electroencephalographic signals from 48 healthy participants receiving thermo-nociceptive stimuli with 3 different durations and 2 different intensities. We observed that pain perception and several brain responses are modulated by stimulus duration and intensity. Crucially, we identified 2 sustained brain responses that were related to the emergence of painful percepts: a low-frequency component (LFC, < 1 Hz) originated from the insula and anterior cingulate cortex, and an alpha-band event-related desynchronization (α-ERD, 8-13 Hz) generated from the sensorimotor cortex. These 2 sustained brain responses were highly coupled, with the α-oscillation amplitude that fluctuated with the LFC phase. Furthermore, the translation of stimulus duration into pain perception was serially mediated by α-ERD and LFC. The present study reveals how brain responses elicited by nociceptive stimulation reflect the complex processes occurring during the translation of nociceptive information into pain perception.
Collapse
Affiliation(s)
- Hailu Wang
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yifei Guo
- Neuroscience and Behaviour Laboratory, Istituto Italiano di Tecnologia, Rome 30 16163, Italy,Department of Neuroscience, Physiology and Pharmacology, University College London, London WC1E 6BT, United Kingdom
| | - Yiheng Tu
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Weiwei Peng
- Brain Function and Psychological Science Research Center, Shenzhen University, Shenzhen 518061, China
| | - Xuejing Lu
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Yanzhi Bi
- CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China,Department of Psychology, University of Chinese Academy of Sciences, Beijing 100049, China
| | - Gian Domenico Iannetti
- Neuroscience and Behaviour Laboratory, Istituto Italiano di Tecnologia, Rome 30 16163, Italy,Department of Neuroscience, Physiology and Pharmacology, University College London, London WC1E 6BT, United Kingdom
| | - Li Hu
- Corresponding author: CAS Key Laboratory of Mental Health, Institute of Psychology, Chinese Academy of Sciences, Beijing 100101, China.
| |
Collapse
|
4
|
Piotrowski T, Nikadon J, Moiseev A. Localization of brain activity from EEG/MEG using MV-PURE framework. Biomed Signal Process Control 2021. [DOI: 10.1016/j.bspc.2020.102243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/23/2022]
|
5
|
Ramírez-Toraño F, Bruña R, de Frutos-Lucas J, Rodríguez-Rojo IC, Marcos de Pedro S, Delgado-Losada ML, Gómez-Ruiz N, Barabash A, Marcos A, López Higes R, Maestú F. Functional Connectivity Hypersynchronization in Relatives of Alzheimer’s Disease Patients: An Early E/I Balance Dysfunction? Cereb Cortex 2020; 31:1201-1210. [DOI: 10.1093/cercor/bhaa286] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2020] [Revised: 08/05/2020] [Accepted: 09/01/2020] [Indexed: 12/13/2022] Open
Abstract
Abstract
Alzheimer’s disease (AD) studies on animal models, and humans showed a tendency of the brain tissue to become hyperexcitable and hypersynchronized, causing neurodegeneration. However, we know little about either the onset of this phenomenon or its early effects on functional brain networks. We studied functional connectivity (FC) on 127 participants (92 middle-age relatives of AD patients and 35 age-matched nonrelatives) using magnetoencephalography. FC was estimated in the alpha band in areas known both for early amyloid accumulation and disrupted FC in MCI converters to AD. We found a frontoparietal network (anterior cingulate cortex, dorsal frontal, and precuneus) where relatives of AD patients showed hypersynchronization in high alpha (not modulated by APOE-ε4 genotype) in comparison to age-matched nonrelatives. These results represent the first evidence of neurophysiological events causing early network disruption in humans, opening a new perspective for intervention on the excitation/inhibition unbalance.
Collapse
Affiliation(s)
- F Ramírez-Toraño
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Technical University of Madrid, Madrid, Comunidad de Madrid 28223, Spain
- Department of Experimental Psychology, Universidad Complutense de Madrid, Madrid, Comunidad de Madrid 28223, Spain
| | - R Bruña
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Technical University of Madrid, Madrid, Comunidad de Madrid 28223, Spain
- Department of Experimental Psychology, Universidad Complutense de Madrid, Madrid, Comunidad de Madrid 28223, Spain
- Networking Research Center on Bioengineering, Biomaterials, and Nanomedicine (CIBER-BBN), Madrid, Comunidad de Madrid 28029, Spain
| | - J de Frutos-Lucas
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Technical University of Madrid, Madrid, Comunidad de Madrid 28223, Spain
- Biological and Health Psychology Department, Universidad Autonoma de Madrid, Madrid, Comunidad de Madrid 28049, Spain
| | - I C Rodríguez-Rojo
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Technical University of Madrid, Madrid, Comunidad de Madrid 28223, Spain
- Facultad de Psicología, Centro Universitario Villanueva, Madrid, Comunidad de Madrid 28034, Spain
| | - S Marcos de Pedro
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Technical University of Madrid, Madrid, Comunidad de Madrid 28223, Spain
- Facultad de Educación y Salud, Universidad Camilo José Cela, Madrid, Comunidad de Madrid 28010, Spain
| | - M L Delgado-Losada
- Department of Experimental Psychology, Universidad Complutense de Madrid, Madrid, Comunidad de Madrid 28223, Spain
| | - N Gómez-Ruiz
- Sección Neurorradiología, Servicio de Diagnóstico por Imagen, Hospital Clínico San Carlos, Madrid, Comunidad de Madrid 28040, Spain
| | - A Barabash
- Endocrinology and Nutrition Department, Hospital Clinico San Carlos and Instituto de Investigación Sanitaria del Hospital Clínico San Carlos, Madrid, Comunidad de Madrid 28040, Spain
- Centro de Investigación Biomédica en Red de Diabetes y Enfermedades Metabólicas Asociadas, Madrid, Comunidad de Madrid 28029, Spain
| | - A Marcos
- Neurology Department, Hospital Clinico San Carlos and Instituto de Investigación Sanitaria del Hospital Clínico San Carlos, Madrid, Comunidad de Madrid 28040, Spain
| | - R López Higes
- Department of Experimental Psychology, Universidad Complutense de Madrid, Madrid, Comunidad de Madrid 28223, Spain
| | - F Maestú
- Laboratory of Cognitive and Computational Neuroscience, Center for Biomedical Technology, Technical University of Madrid, Madrid, Comunidad de Madrid 28223, Spain
- Department of Experimental Psychology, Universidad Complutense de Madrid, Madrid, Comunidad de Madrid 28223, Spain
- Networking Research Center on Bioengineering, Biomaterials, and Nanomedicine (CIBER-BBN), Madrid, Comunidad de Madrid 28029, Spain
| |
Collapse
|
6
|
Nunes AS, Kozhemiako N, Hutcheon E, Chau C, Ribary U, Grunau RE, Doesburg SM. Atypical neuromagnetic resting activity associated with thalamic volume and cognitive outcome in very preterm children. Neuroimage Clin 2020; 27:102275. [PMID: 32480286 PMCID: PMC7264077 DOI: 10.1016/j.nicl.2020.102275] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2019] [Revised: 04/21/2020] [Accepted: 04/22/2020] [Indexed: 11/11/2022]
Abstract
Children born very preterm, even in the absence of overt brain injury or major impairment, are at increased risk of cognitive difficulties. This risk is associated with developmental disruptions of the thalamocortical system during critical periods while in the neonatal intensive care unit. The thalamus is an important structure that not only relays sensory information but acts as a hub for integration of cortical activity which regulates cortical power across a range of frequencies. In this study, we investigate the association between atypical power at rest in children born very preterm at school age using magnetoencephalography (MEG), neurocognitive function and structural alterations related to the thalamus using MRI. Our results indicate that children born extremely preterm have higher power at slow frequencies (delta and theta) and lower power at faster frequencies (alpha and beta), compared to controls born full-term. A similar pattern of spectral power was found to be associated with poorer neurocognitive outcomes, as well as with normalized T1 intensity and the volume of the thalamus. Overall, this study provides evidence regarding relations between structural alterations related to very preterm birth, atypical oscillatory power at rest and neurocognitive difficulties at school-age children born very preterm.
Collapse
Affiliation(s)
- Adonay S Nunes
- Biomedical Physiology and Kinesiology, Simon Fraser University, Burnaby, BC, Canada.
| | - Nataliia Kozhemiako
- Biomedical Physiology and Kinesiology, Simon Fraser University, Burnaby, BC, Canada
| | - Evan Hutcheon
- Biomedical Physiology and Kinesiology, Simon Fraser University, Burnaby, BC, Canada
| | - Cecil Chau
- Pediatrics Department, University of British Columbia, Vancouver, BC, Canada; B.C. Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Urs Ribary
- Behavioral & Cognitive Neuroscience Institute, Simon Fraser University, Burnaby, BC, Canada; Pediatrics Department, University of British Columbia, Vancouver, BC, Canada; B.C. Children's Hospital Research Institute, Vancouver, BC, Canada; Department of Psychology, Simon Fraser University, Burnaby, BC, Canada
| | - Ruth E Grunau
- Pediatrics Department, University of British Columbia, Vancouver, BC, Canada; B.C. Children's Hospital Research Institute, Vancouver, BC, Canada
| | - Sam M Doesburg
- Biomedical Physiology and Kinesiology, Simon Fraser University, Burnaby, BC, Canada; Behavioral & Cognitive Neuroscience Institute, Simon Fraser University, Burnaby, BC, Canada
| |
Collapse
|
7
|
Bells S, Isabella SL, Brien DC, Coe BC, Munoz DP, Mabbott DJ, Cheyne DO. Mapping neural dynamics underlying saccade preparation and execution and their relation to reaction time and direction errors. Hum Brain Mapp 2020; 41:1934-1949. [PMID: 31916374 PMCID: PMC7268073 DOI: 10.1002/hbm.24922] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/18/2019] [Revised: 12/18/2019] [Accepted: 12/29/2019] [Indexed: 12/21/2022] Open
Abstract
Our ability to control and inhibit automatic behaviors is crucial for negotiating complex environments, all of which require rapid communication between sensory, motor, and cognitive networks. Here, we measured neuromagnetic brain activity to investigate the neural timing of cortical areas needed for inhibitory control, while 14 healthy young adults performed an interleaved prosaccade (look at a peripheral visual stimulus) and antisaccade (look away from stimulus) task. Analysis of how neural activity relates to saccade reaction time (SRT) and occurrence of direction errors (look at stimulus on antisaccade trials) provides insight into inhibitory control. Neuromagnetic source activity was used to extract stimulus‐aligned and saccade‐aligned activity to examine temporal differences between prosaccade and antisaccade trials in brain regions associated with saccade control. For stimulus‐aligned antisaccade trials, a longer SRT was associated with delayed onset of neural activity within the ipsilateral parietal eye field (PEF) and bilateral frontal eye field (FEF). Saccade‐aligned activity demonstrated peak activation 10ms before saccade‐onset within the contralateral PEF for prosaccade trials and within the bilateral FEF for antisaccade trials. In addition, failure to inhibit prosaccades on anti‐saccade trials was associated with increased activity prior to saccade onset within the FEF contralateral to the peripheral stimulus. This work on dynamic activity adds to our knowledge that direction errors were due, at least in part, to a failure to inhibit automatic prosaccades. These findings provide novel evidence in humans regarding the temporal dynamics within oculomotor areas needed for saccade programming and the role frontal brain regions have on top‐down inhibitory control.
Collapse
Affiliation(s)
- Sonya Bells
- Program in Neurosciences and Mental Health, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada
| | - Silvia L Isabella
- Program in Neurosciences and Mental Health, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada.,Institute of Medical Sciences, Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada
| | - Donald C Brien
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Brian C Coe
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Douglas P Munoz
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Donald J Mabbott
- Program in Neurosciences and Mental Health, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada.,Department of Psychology, University of Toronto, Toronto, Ontario, Canada
| | - Douglas O Cheyne
- Program in Neurosciences and Mental Health, The Hospital for Sick Children Research Institute, Toronto, Ontario, Canada.,Institute of Medical Sciences, Institute of Biomaterials and Biomedical Engineering, University of Toronto, Toronto, Ontario, Canada.,Department of Medical Imaging, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|