1
|
Philiastides MG, Tu T, Sajda P. Inferring Macroscale Brain Dynamics via Fusion of Simultaneous EEG-fMRI. Annu Rev Neurosci 2021; 44:315-334. [PMID: 33761268 DOI: 10.1146/annurev-neuro-100220-093239] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
Abstract
Advances in the instrumentation and signal processing for simultaneously acquired electroencephalography and functional magnetic resonance imaging (EEG-fMRI) have enabled new ways to observe the spatiotemporal neural dynamics of the human brain. Central to the utility of EEG-fMRI neuroimaging systems are the methods for fusing the two data streams, with machine learning playing a key role. These methods can be dichotomized into those that are symmetric and asymmetric in terms of how the two modalities inform the fusion. Studies using these methods have shown that fusion yields new insights into brain function that are not possible when each modality is acquired separately. As technology improves and methods for fusion become more sophisticated, the future of EEG-fMRI for noninvasive measurement of brain dynamics includes mesoscale mapping at ultrahigh magnetic resonance fields, targeted perturbation-based neuroimaging, and using deep learning to uncover nonlinear representations that link the electrophysiological and hemodynamic measurements.
Collapse
Affiliation(s)
- Marios G Philiastides
- Institute of Neuroscience and Psychology, University of Glasgow, Glasgow G12 8AD, Scotland;
| | - Tao Tu
- Department of Biomedical Engineering, Columbia University, New York, NY 10027, USA
| | - Paul Sajda
- Departments of Biomedical Engineering, Electrical Engineering, and Radiology and the Data Science Institute, Columbia University, New York, NY 10027, USA;
| |
Collapse
|
2
|
Paz-Linares D, Vega-Hernández M, Rojas-López PA, Valdés-Hernández PA, Martínez-Montes E, Valdés-Sosa PA. Spatio Temporal EEG Source Imaging with the Hierarchical Bayesian Elastic Net and Elitist Lasso Models. Front Neurosci 2017; 11:635. [PMID: 29200994 PMCID: PMC5696363 DOI: 10.3389/fnins.2017.00635] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2017] [Accepted: 11/01/2017] [Indexed: 11/13/2022] Open
Abstract
The estimation of EEG generating sources constitutes an Inverse Problem (IP) in Neuroscience. This is an ill-posed problem due to the non-uniqueness of the solution and regularization or prior information is needed to undertake Electrophysiology Source Imaging. Structured Sparsity priors can be attained through combinations of (L1 norm-based) and (L2 norm-based) constraints such as the Elastic Net (ENET) and Elitist Lasso (ELASSO) models. The former model is used to find solutions with a small number of smooth nonzero patches, while the latter imposes different degrees of sparsity simultaneously along different dimensions of the spatio-temporal matrix solutions. Both models have been addressed within the penalized regression approach, where the regularization parameters are selected heuristically, leading usually to non-optimal and computationally expensive solutions. The existing Bayesian formulation of ENET allows hyperparameter learning, but using the computationally intensive Monte Carlo/Expectation Maximization methods, which makes impractical its application to the EEG IP. While the ELASSO have not been considered before into the Bayesian context. In this work, we attempt to solve the EEG IP using a Bayesian framework for ENET and ELASSO models. We propose a Structured Sparse Bayesian Learning algorithm based on combining the Empirical Bayes and the iterative coordinate descent procedures to estimate both the parameters and hyperparameters. Using realistic simulations and avoiding the inverse crime we illustrate that our methods are able to recover complicated source setups more accurately and with a more robust estimation of the hyperparameters and behavior under different sparsity scenarios than classical LORETA, ENET and LASSO Fusion solutions. We also solve the EEG IP using data from a visual attention experiment, finding more interpretable neurophysiological patterns with our methods. The Matlab codes used in this work, including Simulations, Methods, Quality Measures and Visualization Routines are freely available in a public website.
Collapse
Affiliation(s)
- Deirel Paz-Linares
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China.,Neuroinformatics Department, Cuban Neuroscience Center, Havana, Cuba
| | | | - Pedro A Rojas-López
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China.,Neuroinformatics Department, Cuban Neuroscience Center, Havana, Cuba
| | - Pedro A Valdés-Hernández
- Neuroinformatics Department, Cuban Neuroscience Center, Havana, Cuba.,Department of Biomedical Engineering, Florida International University, Miami, FL, United States
| | - Eduardo Martínez-Montes
- Neuroinformatics Department, Cuban Neuroscience Center, Havana, Cuba.,Politecnico di Torino, Turin, Italy
| | - Pedro A Valdés-Sosa
- The Clinical Hospital of Chengdu Brain Science Institute, MOE Key Lab for Neuroinformation, University of Electronic Science and Technology of China, Chengdu, China.,Neuroinformatics Department, Cuban Neuroscience Center, Havana, Cuba
| |
Collapse
|
3
|
Croce P, Basti A, Marzetti L, Zappasodi F, Gratta CD. EEG-fMRI Bayesian framework for neural activity estimation: a simulation study. J Neural Eng 2016; 13:066017. [PMID: 27788127 DOI: 10.1088/1741-2560/13/6/066017] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
OBJECTIVE Due to the complementary nature of electroencephalography (EEG) and functional magnetic resonance imaging (fMRI), and given the possibility of simultaneous acquisition, the joint data analysis can afford a better understanding of the underlying neural activity estimation. In this simulation study we want to show the benefit of the joint EEG-fMRI neural activity estimation in a Bayesian framework. APPROACH We built a dynamic Bayesian framework in order to perform joint EEG-fMRI neural activity time course estimation. The neural activity is originated by a given brain area and detected by means of both measurement techniques. We have chosen a resting state neural activity situation to address the worst case in terms of the signal-to-noise ratio. To infer information by EEG and fMRI concurrently we used a tool belonging to the sequential Monte Carlo (SMC) methods: the particle filter (PF). MAIN RESULTS First, despite a high computational cost, we showed the feasibility of such an approach. Second, we obtained an improvement in neural activity reconstruction when using both EEG and fMRI measurements. SIGNIFICANCE The proposed simulation shows the improvements in neural activity reconstruction with EEG-fMRI simultaneous data. The application of such an approach to real data allows a better comprehension of the neural dynamics.
Collapse
Affiliation(s)
- Pierpaolo Croce
- Department of Neuroscience, Imaging and Clinical Sciences, "G.d'Annunzio" University, Chieti, Italy. Institute of Advanced Biomedical Technologies, "G.d'Annunzio" University, Chieti, Italy
| | | | | | | | | |
Collapse
|
4
|
Zhang L, Guindani M, Vannucci M. Bayesian Models for fMRI Data Analysis. WILEY INTERDISCIPLINARY REVIEWS. COMPUTATIONAL STATISTICS 2015; 7:21-41. [PMID: 25750690 PMCID: PMC4346370 DOI: 10.1002/wics.1339] [Citation(s) in RCA: 46] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Functional magnetic resonance imaging (fMRI), a noninvasive neuroimaging method that provides an indirect measure of neuronal activity by detecting blood flow changes, has experienced an explosive growth in the past years. Statistical methods play a crucial role in understanding and analyzing fMRI data. Bayesian approaches, in particular, have shown great promise in applications. A remarkable feature of fully Bayesian approaches is that they allow a flexible modeling of spatial and temporal correlations in the data. This paper provides a review of the most relevant models developed in recent years. We divide methods according to the objective of the analysis. We start from spatio-temporal models for fMRI data that detect task-related activation patterns. We then address the very important problem of estimating brain connectivity. We also touch upon methods that focus on making predictions of an individual's brain activity or a clinical or behavioral response. We conclude with a discussion of recent integrative models that aim at combining fMRI data with other imaging modalities, such as EEG/MEG and DTI data, measured on the same subjects. We also briefly discuss the emerging field of imaging genetics.
Collapse
Affiliation(s)
- Linlin Zhang
- Department of Statistics, Rice University, Houston, TX 77005, USA
| | - Michele Guindani
- Department of Biostatistics, UT M.D. Anderson Cancer Center, Houston, TX 77230, USA
| | - Marina Vannucci
- Department of Statistics, Rice University, Houston, TX 77005, USA
| |
Collapse
|
5
|
Hong JH, Ahn M, Kim K, Jun SC. Localization of coherent sources by simultaneous MEG and EEG beamformer. Med Biol Eng Comput 2013; 51:1121-35. [PMID: 23793511 DOI: 10.1007/s11517-013-1092-z] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2013] [Accepted: 06/08/2013] [Indexed: 10/26/2022]
Abstract
Simultaneous magnetoencephalography (MEG) and electroencephalography (EEG) analysis is known generally to yield better localization performance than a single modality only. For simultaneous analysis, MEG and EEG data should be combined to maximize synergistic effects. Recently, beamformer for simultaneous MEG/EEG analysis was proposed to localize both radial and tangential components well, while single modality analyses could not detect them, or had relatively higher location bias. In practice, most interesting brain sources are likely to be activated coherently; however, conventional beamformer may not work properly for such coherent sources. To overcome this difficulty, a linearly constrained minimum variance (LCMV) beamformer may be used with a source suppression strategy. In this work, simultaneous MEG/EEG LCMV beamformer using source suppression was formulated firstly to investigate its capability over various suppression strategies. The localization performance of our proposed approach was examined mainly for coherent sources and compared thoroughly with the conventional simultaneous and single modality approaches, over various suppression strategies. For this purpose, we used numerous simulated data, as well as empirical auditory stimulation data. In addition, some strategic issues of simultaneous MEG/EEG analysis were discussed. Overall, we found that our simultaneous MEG/EEG LCMV beamformer using a source suppression strategy is greatly beneficial in localizing coherent sources.
Collapse
Affiliation(s)
- Jun Hee Hong
- School of Information and Communications, Gwangju Institute of Science and Technology, Gwangju, 500-712, Republic of Korea
| | | | | | | |
Collapse
|
6
|
Prior knowledge on cortex organization in the reconstruction of source current densities from EEG. Neuroimage 2013; 67:7-24. [DOI: 10.1016/j.neuroimage.2012.11.013] [Citation(s) in RCA: 15] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2012] [Revised: 09/19/2012] [Accepted: 11/08/2012] [Indexed: 11/18/2022] Open
|
7
|
Bravo EC, Martínez-Montes E, Farach-Fumero M, Machado-Curbelo C. Computing sources of epileptic discharges using the novel BMA approach: comparison with other distributed inverse solution methods. Clin EEG Neurosci 2013; 44:3-15. [PMID: 23248336 DOI: 10.1177/1550059412451706] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
Abstract
Electroencephalography (EEG) source localization in epileptology continues to be a challenge for neuroscientists. A number of inverse solution (IS) methodologies have been proposed to solve this problem, and their advantages and limitations have been described. In the present work, a previously developed IS approach called Bayesian model averaging (BMA) is introduced in clinical practice in order to improve the localization accuracy of epileptic discharge sources. For this study, 31 patients with the diagnosis of partial epilepsies were studied: 14 had benign childhood epilepsy with centrotemporal spikes and 17 had temporal lobe epilepsy (TLE). The underlying epileptic sources were localized using the BMA approach, and the results were compared with those expected from the clinical diagnosis. Additional comparisons with results obtained from 3 of the most commonly used distributed IS methods for these purposes (minimum norm [MN], weighted minimum norm [WMN], and low-resolution electromagnetic tomography [LORETA]) were carried out in terms of source localization accuracy and spatial resolutions. The BMA approach estimated discharge sources that were consistent with the clinical diagnosis, and this method outperformed LORETA, MN, and WMN in terms of both localization accuracy and spatial resolution. The BMA was able to localize deeper generators with high accuracy. In conclusion, the BMA methodology has a great potential for the noninvasive accurate localization of epileptic sources, even those located in deeper structures. Therefore, it could be a promising tool for clinical practice in epileptology, although additional studies in other types of epileptic syndromes are necessary.
Collapse
|
8
|
Lucka F, Pursiainen S, Burger M, Wolters CH. Hierarchical Bayesian inference for the EEG inverse problem using realistic FE head models: Depth localization and source separation for focal primary currents. Neuroimage 2012; 61:1364-82. [DOI: 10.1016/j.neuroimage.2012.04.017] [Citation(s) in RCA: 58] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/13/2011] [Revised: 03/23/2012] [Accepted: 04/07/2012] [Indexed: 11/25/2022] Open
|
9
|
Biessmann F, Plis S, Meinecke FC, Eichele T, Muller KR. Analysis of Multimodal Neuroimaging Data. IEEE Rev Biomed Eng 2011; 4:26-58. [DOI: 10.1109/rbme.2011.2170675] [Citation(s) in RCA: 105] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
10
|
Bayesian symmetrical EEG/fMRI fusion with spatially adaptive priors. Neuroimage 2010; 55:113-32. [PMID: 21130173 DOI: 10.1016/j.neuroimage.2010.11.037] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2010] [Revised: 11/10/2010] [Accepted: 11/11/2010] [Indexed: 11/22/2022] Open
Abstract
In this paper, we propose a novel symmetrical EEG/fMRI fusion method which combines EEG and fMRI by means of a common generative model. We use a total variation (TV) prior to model the spatial distribution of the cortical current responses and hemodynamic response functions, and utilize spatially adaptive temporal priors to model their temporal shapes. The spatial adaptivity of the prior model allows for adaptation to the local characteristics of the estimated responses and leads to high estimation performance for the cortical current distribution and the hemodynamic response functions. We utilize a Bayesian formulation with a variational Bayesian framework and obtain a fully automatic fusion algorithm. Simulations with synthetic data and experiments with real data from a multimodal study on face perception demonstrate the performance of the proposed method.
Collapse
|
11
|
Plis SM, Calhoun VD, Weisend MP, Eichele T, Lane T. MEG and fMRI Fusion for Non-Linear Estimation of Neural and BOLD Signal Changes. Front Neuroinform 2010; 4:114. [PMID: 21120141 PMCID: PMC2991230 DOI: 10.3389/fninf.2010.00114] [Citation(s) in RCA: 19] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2010] [Accepted: 09/26/2010] [Indexed: 11/13/2022] Open
Abstract
The combined analysis of magnetoencephalography (MEG)/electroencephalography and functional magnetic resonance imaging (fMRI) measurements can lead to improvement in the description of the dynamical and spatial properties of brain activity. In this paper we empirically demonstrate this improvement using simulated and recorded task related MEG and fMRI activity. Neural activity estimates were derived using a dynamic Bayesian network with continuous real valued parameters by means of a sequential Monte Carlo technique. In synthetic data, we show that MEG and fMRI fusion improves estimation of the indirectly observed neural activity and smooths tracking of the blood oxygenation level dependent (BOLD) response. In recordings of task related neural activity the combination of MEG and fMRI produces a result with greater signal-to-noise ratio, that confirms the expectation arising from the nature of the experiment. The highly non-linear model of the BOLD response poses a difficult inference problem for neural activity estimation; computational requirements are also high due to the time and space complexity. We show that joint analysis of the data improves the system's behavior by stabilizing the differential equations system and by requiring fewer computational resources.
Collapse
|
12
|
Akhtari M, Mandelkern M, Bui D, Salamon N, Vinters HV, Mathern GW. Variable anisotropic brain electrical conductivities in epileptogenic foci. Brain Topogr 2010; 23:292-300. [PMID: 20440549 PMCID: PMC2914871 DOI: 10.1007/s10548-010-0144-z] [Citation(s) in RCA: 17] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2009] [Accepted: 04/02/2010] [Indexed: 12/20/2022]
Abstract
Source localization models assume brain electrical conductivities are isotropic at about 0.33 S/m. These assumptions have not been confirmed ex vivo in humans. This study determined bidirectional electrical conductivities from pediatric epilepsy surgery patients. Electrical conductivities perpendicular and parallel to the pial surface of neocortex and subcortical white matter (n = 15) were measured using the 4-electrode technique and compared with clinical variables. Mean (±SD) electrical conductivities were 0.10 ± 0.01 S/m, and varied by 243% from patient to patient. Perpendicular and parallel conductivities differed by 45%, and the larger values were perpendicular to the pial surface in 47% and parallel in 40% of patients. A perpendicular principal axis was associated with normal, while isotropy and parallel principal axes were linked with epileptogenic lesions by MRI. Electrical conductivities were decreased in patients with cortical dysplasia compared with non-dysplasia etiologies. The electrical conductivity values of freshly excised human brain tissues were approximately 30% of assumed values, varied by over 200% from patient to patient, and had erratic anisotropic and isotropic shapes if the MRI showed a lesion. Understanding brain electrical conductivity and ways to non-invasively measure them are probably necessary to enhance the ability to localize EEG sources from epilepsy surgery patients.
Collapse
Affiliation(s)
- M Akhtari
- Neuropsychiatric Institutes, David Geffen School of Medicine, University of California, Los Angeles, CA 90015, USA.
| | | | | | | | | | | |
Collapse
|
13
|
Ou W, Nummenmaa A, Ahveninen J, Belliveau JW, Hämäläinen MS, Golland P. Multimodal functional imaging using fMRI-informed regional EEG/MEG source estimation. Neuroimage 2010; 52:97-108. [PMID: 20211266 DOI: 10.1016/j.neuroimage.2010.03.001] [Citation(s) in RCA: 45] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2009] [Revised: 02/15/2010] [Accepted: 03/01/2010] [Indexed: 11/29/2022] Open
Abstract
We propose a novel method, fMRI-Informed Regional Estimation (FIRE), which utilizes information from fMRI in E/MEG source reconstruction. FIRE takes advantage of the spatial alignment between the neural and the vascular activities, while allowing for substantial differences in their dynamics. Furthermore, with a region-based approach, FIRE estimates the model parameters for each region independently. Hence, it can be efficiently applied on a dense grid of source locations. The optimization procedure at the core of FIRE is related to the re-weighted minimum-norm algorithms. The weights in the proposed approach are computed from both the current source estimates and fMRI data, leading to robust estimates in the presence of silent sources in either fMRI or E/MEG measurements. We employ a Monte Carlo evaluation procedure to compare the proposed method to several other joint E/MEG-fMRI algorithms. Our results show that FIRE provides the best trade-off in estimation accuracy between the spatial and the temporal accuracy. Analysis using human E/MEG-fMRI data reveals that FIRE significantly reduces the ambiguities in source localization present in the minimum-norm estimates, and that it accurately captures activation timing in adjacent functional regions.
Collapse
Affiliation(s)
- Wanmei Ou
- Computer Science and Artificial Intelligence Laboratory, Massachusetts Institute of Technology, Cambridge, MA, USA.
| | | | | | | | | | | |
Collapse
|