201
|
Sun J, Jia T, Lin PJ, Li Z, Ji L, Li C. Multiscale Canonical Coherence for Functional Corticomuscular Coupling Analysis. IEEE J Biomed Health Inform 2024; 28:812-822. [PMID: 37963005 DOI: 10.1109/jbhi.2023.3332657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2023]
Abstract
Functional corticomuscular coupling (FCMC) probes multi-level information communication in the sensorimotor system. The canonical Coherence (caCOH) method has been leveraged to measure the FCMC between two multivariate signals within the single scale. In this paper, we propose the concept of multiscale canonical Coherence (MS-caCOH) to disentangle complex multi-layer information and extract coupling features in multivariate spaces from multiple scales. Then, we verified the reliability and effectiveness of MS-caCOH on two types of data sets, i.e., a synthetic multivariate data set and a real-world multivariate data set. Our simulation results showed that compared with caCOH, MS-caCOH enhanced coupling detection and achieved lower pattern recovery errors at multiple frequency scales. Further analysis on experimental data demonstrated that the proposed MS-caCOH method could also capture detailed multiscale spatial-frequency characteristics. This study leverages the multiscale analysis framework and multivariate method to give a new insight into corticomuscular coupling analysis.
Collapse
|
202
|
Moratti S, Gundlach C, de Echegaray J, Müller MM. Distinct patterns of spatial attentional modulation of steady-state visual evoked magnetic fields (SSVEFs) in subdivisions of the human early visual cortex. Psychophysiology 2024; 61:e14452. [PMID: 37787386 DOI: 10.1111/psyp.14452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Revised: 08/23/2023] [Accepted: 09/15/2023] [Indexed: 10/04/2023]
Abstract
In recent years, steady-state visual evoked potentials (SSVEPs) became an increasingly valuable tool to investigate neural dynamics of competitive attentional interactions and brain-computer interfaces. This is due to their good signal-to-noise ratio, allowing for single-trial analysis, and their ongoing oscillating nature that enables to analyze temporal dynamics of facilitation and suppression. Given the popularity of SSVEPs, it is surprising that only a few studies looked at the cortical sources of these responses. This is in particular the case when searching for studies that assessed the cortical sources of attentional SSVEP amplitude modulations. To address this issue, we used a typical spatial attention task and recorded neuromagnetic fields (MEG) while presenting frequency-tagged stimuli in the left and right visual fields, respectively. Importantly, we controlled for attentional deployment in a baseline period before the shifting cue. Subjects either attended to a central fixation cross or to two peripheral stimuli simultaneously. Results clearly showed that signal sources and attention effects were restricted to the early visual cortex: V1, V2, hMT+, precuneus, occipital-parietal, and inferior-temporal cortex. When subjects attended to central fixation first, shifting attention to one of the peripheral stimuli resulted in a significant activation increase for the to-be-attended stimulus with no activation decrease for the to-be-ignored stimulus in hMT+ and inferio-temporal cortex, but significant SSVEF decreases from V1 to occipito-parietal cortex. When attention was first deployed to both rings, shifting attention away from one ring basically resulted in a significant activation decrease in all areas for the then-to-be-ignored stimulus.
Collapse
Affiliation(s)
- Stephan Moratti
- Department of Experimental Psychology, Complutense University of Madrid, Madrid, Spain
- Center for Cognitive and Computational Neuroscience, Complutense University of Madrid, Madrid, Spain
| | | | - Javier de Echegaray
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Leipzig, Germany
| | - Matthias M Müller
- Wilhelm Wundt Institute for Psychology, University of Leipzig, Leipzig, Germany
| |
Collapse
|
203
|
Mori F, Sugino M, Kabashima K, Nara T, Jimbo Y, Kotani K. Limiting parameter range for cortical-spherical mapping improves activated domain estimation for attention modulated auditory response. J Neurosci Methods 2024; 402:110032. [PMID: 38043853 DOI: 10.1016/j.jneumeth.2023.110032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/08/2023] [Revised: 11/21/2023] [Accepted: 11/29/2023] [Indexed: 12/05/2023]
Abstract
BACKGROUND Attention is one of the factors involved in selecting input information for the brain. We applied a method for estimating domains with clear boundaries using magnetoencephalography (the domain estimation method) for auditory-evoked responses (N100m) to evaluate the effects of attention in milliseconds. However, because the surface around the auditory cortex is folded in a complicated manner, it is unknown whether the activity in the auditory cortex can be estimated. NEW METHOD The parameter range to express current sources was set to include the auditory cortex. Their search region was expressed as a direct product of the parameter ranges used in the adaptive diagonal curves. RESULTS Without a limitation of the range, activity was estimated in regions other than the auditory cortex in all cases. However, with the limitation of the range, the activity was estimated in the primary or higher auditory cortex. Further analysis of the limitation of the range showed that the domains activated during attention included the regions activated during no attention for the participants whose amplitudes of N100m were higher during attention. COMPARISON WITH EXISTING METHOD We proposed a method for effectively limiting the search region to evaluate the extent of the activated domain in regions with complex folded structures. CONCLUSION To evaluate the extent of activated domains in regions with complex folded structures, it is necessary to limit the parameter search range. The area of the activated domains in the auditory cortex may increase by attention on the millisecond timescale.
Collapse
Affiliation(s)
- Fumina Mori
- School of Engineering, The University of Tokyo, Tokyo, Japan.
| | - Masato Sugino
- School of Engineering, The University of Tokyo, Tokyo, Japan
| | - Kenta Kabashima
- Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
| | - Takaaki Nara
- Graduate School of Information Science and Technology, The University of Tokyo, Tokyo, Japan
| | - Yasuhiko Jimbo
- School of Engineering, The University of Tokyo, Tokyo, Japan
| | - Kiyoshi Kotani
- The Graduate School of Frontier Science, The University of Tokyo, Chiba, Japan
| |
Collapse
|
204
|
Fang F, Teixeira AL, Li R, Zou L, Zhang Y. The control patterns of affective processing and cognitive reappraisal: insights from brain controllability analysis. Cereb Cortex 2024; 34:bhad500. [PMID: 38216523 DOI: 10.1093/cercor/bhad500] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2023] [Revised: 12/03/2023] [Accepted: 12/05/2023] [Indexed: 01/14/2024] Open
Abstract
Perceiving and modulating emotions is vital for cognitive function and is often impaired in neuropsychiatric conditions. Current tools for evaluating emotional dysregulation suffer from subjectivity and lack of precision, especially when it comes to understanding emotion from a regulatory or control-based perspective. To address these limitations, this study leverages an advanced methodology known as functional brain controllability analysis. We simultaneously recorded electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) data from 17 healthy subjects engaged in emotion processing and regulation tasks. We then employed a novel EEG/fMRI integration technique to reconstruct cortical activity in a high spatiotemporal resolution manner. Subsequently, we conducted functional brain controllability analysis to explore the neural network control patterns underlying different emotion conditions. Our findings demonstrated that the dorsolateral and ventrolateral prefrontal cortex exhibited increased controllability during the processing and regulation of negative emotions compared to processing of neutral emotion. Besides, the anterior cingulate cortex was notably more active in managing negative emotion than in either controlling neutral emotion or regulating negative emotion. Finally, the posterior parietal cortex emerged as a central network controller for the regulation of negative emotion. This study offers valuable insights into the cortical control mechanisms that support emotion perception and regulation.
Collapse
Affiliation(s)
- Feng Fang
- Department of Biomedical Engineering, University of Houston, Houston, TX, United States
| | - Antonio L Teixeira
- Department of Psychiatry and Behavioral Sciences, The University of Texas Health Science Center at Houston, Houston, TX, United States
| | - Rihui Li
- Center for Cognitive and Brain Sciences, Institute of Collaborative Innovation, University of Macau, Macau, China
| | - Ling Zou
- School of Information Science and Engineering, Changzhou University, Changzhou, Jiangsu, China
| | - Yingchun Zhang
- Department of Biomedical Engineering, University of Houston, Houston, TX, United States
| |
Collapse
|
205
|
Ericson J, Palva S, Palva M, Klingberg T. Strengthening of alpha synchronization is a neural correlate of cognitive transfer. Cereb Cortex 2024; 34:bhad527. [PMID: 38220577 PMCID: PMC10839847 DOI: 10.1093/cercor/bhad527] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 12/15/2023] [Accepted: 12/16/2023] [Indexed: 01/16/2024] Open
Abstract
Cognitive training can lead to improvements in both task-specific strategies and general capacities, such as visuo-spatial working memory (VSWM). The latter emerge slowly and linearly throughout training, in contrast to strategy where changes typically occur within the first days of training. Changes in strategy and capacity have not been separated in prior neuroimaging studies. Here, we used a within-participants design with dense temporal sampling to capture the time dynamics of neural mechanisms associated with change in capacity. In four participants, neural activity was recorded with magnetoencephalography on seven occasions over two months of visuo-spatial working memory training. During scanning, the participants performed a trained visuo-spatial working memory task, a transfer task, and a control task. First, we extracted an individual visuo-spatial working memory-load-dependent synchronization network for each participant. Next, we identified linear changes over time in the network, congruent with the temporal dynamics of capacity change. Three out of four participants showed a gradual strengthening of alpha synchronization. Strengthening of the same connections was also found in the transfer task but not in the control task. This suggests that cognitive transfer occurs through slow, gradual strengthening of alpha synchronization between cortical regions that are vital for both the trained task and the transfer task.
Collapse
Affiliation(s)
- Julia Ericson
- Department of Neuroscience, Karolinska Institutet, 17177 Stockholm, Sweden
| | - Satu Palva
- Neuroscience Center, HilIFE-Helsinki Institute of Lifescience, University of Helsinki, 00014 Helsinki, Finland
- Centre for Cognitive Neuroimaging (CCNi), School Psychology and Neuroscience, University of Glasgow, Glasgow G12 8QQ, Scotland
| | - Matias Palva
- Neuroscience Center, HilIFE-Helsinki Institute of Lifescience, University of Helsinki, 00014 Helsinki, Finland
- Centre for Cognitive Neuroimaging (CCNi), School Psychology and Neuroscience, University of Glasgow, Glasgow G12 8QQ, Scotland
- Department of Neuroscience and Bioengineering (NBE), Aalto University, 00076 Aalto, Finland
| | - Torkel Klingberg
- Department of Neuroscience, Karolinska Institutet, 17177 Stockholm, Sweden
| |
Collapse
|
206
|
Corsi MC, Sorrentino P, Schwartz D, George N, Gollo LL, Chevallier S, Hugueville L, Kahn AE, Dupont S, Bassett DS, Jirsa V, De Vico Fallani F. Measuring neuronal avalanches to inform brain-computer interfaces. iScience 2024; 27:108734. [PMID: 38226174 PMCID: PMC10788504 DOI: 10.1016/j.isci.2023.108734] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Revised: 10/18/2023] [Accepted: 12/12/2023] [Indexed: 01/17/2024] Open
Abstract
Large-scale interactions among multiple brain regions manifest as bursts of activations called neuronal avalanches, which reconfigure according to the task at hand and, hence, might constitute natural candidates to design brain-computer interfaces (BCIs). To test this hypothesis, we used source-reconstructed magneto/electroencephalography during resting state and a motor imagery task performed within a BCI protocol. To track the probability that an avalanche would spread across any two regions, we built an avalanche transition matrix (ATM) and demonstrated that the edges whose transition probabilities significantly differed between conditions hinged selectively on premotor regions in all subjects. Furthermore, we showed that the topology of the ATMs allows task-decoding above the current gold standard. Hence, our results suggest that neuronal avalanches might capture interpretable differences between tasks that can be used to inform brain-computer interfaces.
Collapse
Affiliation(s)
- Marie-Constance Corsi
- Sorbonne Université, Institut du cerveau - Paris Brain Institute - ICM, CNRS, Inserm, APHP, Hôpital de la Pitié Salpêtrière, Paris, France
- Inria, Aramis Team, Paris, France
| | - Pierpaolo Sorrentino
- Institut de Neuroscience des Systèmes, Aix-Marseille University, Inserm, Marseille, France
| | - Denis Schwartz
- Institut du Cerveau - Paris Brain Institute, ICM, Inserm U 1127, CNRS UMR 7225, Sorbonne Université, CENIR, Centre MEG-EEG, Paris, France
| | - Nathalie George
- Sorbonne Université, Institut du cerveau - Paris Brain Institute - ICM, CNRS, Inserm, APHP, Hôpital de la Pitié Salpêtrière, Paris, France
- Institut du Cerveau - Paris Brain Institute, ICM, Inserm U 1127, CNRS UMR 7225, Sorbonne Université, CENIR, Centre MEG-EEG, Paris, France
| | - Leonardo L. Gollo
- The Turner Institute for Brain and Mental Health, School of Psychological Sciences, and Monash Biomedical Imaging, Monash University, Victoria 3168, Australia
| | | | - Laurent Hugueville
- Institut de Neuroscience des Systèmes, Aix-Marseille University, Inserm, Marseille, France
| | - Ari E. Kahn
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ 08540, USA
| | - Sophie Dupont
- Sorbonne Université, Institut du cerveau - Paris Brain Institute - ICM, CNRS, Inserm, APHP, Hôpital de la Pitié Salpêtrière, Paris, France
| | | | - Viktor Jirsa
- Institut de Neuroscience des Systèmes, Aix-Marseille University, Inserm, Marseille, France
| | - Fabrizio De Vico Fallani
- Sorbonne Université, Institut du cerveau - Paris Brain Institute - ICM, CNRS, Inserm, APHP, Hôpital de la Pitié Salpêtrière, Paris, France
- Inria, Aramis Team, Paris, France
| |
Collapse
|
207
|
Qin Y, Yang B, Ke S, Liu P, Rong F, Xia X. M-FANet: Multi-Feature Attention Convolutional Neural Network for Motor Imagery Decoding. IEEE Trans Neural Syst Rehabil Eng 2024; 32:401-411. [PMID: 38194394 DOI: 10.1109/tnsre.2024.3351863] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/11/2024]
Abstract
Motor imagery (MI) decoding methods are pivotal in advancing rehabilitation and motor control research. Effective extraction of spectral-spatial-temporal features is crucial for MI decoding from limited and low signal-to-noise ratio electroencephalogram (EEG) signal samples based on brain-computer interface (BCI). In this paper, we propose a lightweight Multi-Feature Attention Neural Network (M-FANet) for feature extraction and selection of multi-feature data. M-FANet employs several unique attention modules to eliminate redundant information in the frequency domain, enhance local spatial feature extraction and calibrate feature maps. We introduce a training method called Regularized Dropout (R-Drop) to address training-inference inconsistency caused by dropout and improve the model's generalization capability. We conduct extensive experiments on the BCI Competition IV 2a (BCIC-IV-2a) dataset and the 2019 World robot conference contest-BCI Robot Contest MI (WBCIC-MI) dataset. M-FANet achieves superior performance compared to state-of-the-art MI decoding methods, with 79.28% 4-class classification accuracy (kappa: 0.7259) on the BCIC-IV-2a dataset and 77.86% 3-class classification accuracy (kappa: 0.6650) on the WBCIC-MI dataset. The application of multi-feature attention modules and R-Drop in our lightweight model significantly enhances its performance, validated through comprehensive ablation experiments and visualizations.
Collapse
|
208
|
Har-Shai Yahav P, Sharaabi A, Zion Golumbic E. The effect of voice familiarity on attention to speech in a cocktail party scenario. Cereb Cortex 2024; 34:bhad475. [PMID: 38142293 DOI: 10.1093/cercor/bhad475] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/04/2023] [Revised: 11/20/2023] [Accepted: 11/20/2023] [Indexed: 12/25/2023] Open
Abstract
Selective attention to one speaker in multi-talker environments can be affected by the acoustic and semantic properties of speech. One highly ecological feature of speech that has the potential to assist in selective attention is voice familiarity. Here, we tested how voice familiarity interacts with selective attention by measuring the neural speech-tracking response to both target and non-target speech in a dichotic listening "Cocktail Party" paradigm. We measured Magnetoencephalography from n = 33 participants, presented with concurrent narratives in two different voices, and instructed to pay attention to one ear ("target") and ignore the other ("non-target"). Participants were familiarized with one of the voices during the week prior to the experiment, rendering this voice familiar to them. Using multivariate speech-tracking analysis we estimated the neural responses to both stimuli and replicate their well-established modulation by selective attention. Importantly, speech-tracking was also affected by voice familiarity, showing enhanced response for target speech and reduced response for non-target speech in the contra-lateral hemisphere, when these were in a familiar vs. an unfamiliar voice. These findings offer valuable insight into how voice familiarity, and by extension, auditory-semantics, interact with goal-driven attention, and facilitate perceptual organization and speech processing in noisy environments.
Collapse
Affiliation(s)
- Paz Har-Shai Yahav
- The Gonda Center for Multidisciplinary Brain Research, Bar Ilan University, Ramat Gan 5290002, Israel
| | - Aviya Sharaabi
- The Gonda Center for Multidisciplinary Brain Research, Bar Ilan University, Ramat Gan 5290002, Israel
| | - Elana Zion Golumbic
- The Gonda Center for Multidisciplinary Brain Research, Bar Ilan University, Ramat Gan 5290002, Israel
| |
Collapse
|
209
|
Ezzyat Y, Kragel JE, Solomon EA, Lega BC, Aronson JP, Jobst BC, Gross RE, Sperling MR, Worrell GA, Sheth SA, Wanda PA, Rizzuto DS, Kahana MJ. Functional and anatomical connectivity predict brain stimulation's mnemonic effects. Cereb Cortex 2024; 34:bhad427. [PMID: 38041253 PMCID: PMC10793570 DOI: 10.1093/cercor/bhad427] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/27/2023] [Revised: 10/05/2023] [Accepted: 10/06/2023] [Indexed: 12/03/2023] Open
Abstract
Closed-loop direct brain stimulation is a promising tool for modulating neural activity and behavior. However, it remains unclear how to optimally target stimulation to modulate brain activity in particular brain networks that underlie particular cognitive functions. Here, we test the hypothesis that stimulation's behavioral and physiological effects depend on the stimulation target's anatomical and functional network properties. We delivered closed-loop stimulation as 47 neurosurgical patients studied and recalled word lists. Multivariate classifiers, trained to predict momentary lapses in memory function, triggered the stimulation of the lateral temporal cortex (LTC) during the study phase of the task. We found that LTC stimulation specifically improved memory when delivered to targets near white matter pathways. Memory improvement was largest for targets near white matter that also showed high functional connectivity to the brain's memory network. These targets also reduced low-frequency activity in this network, an established marker of successful memory encoding. These data reveal how anatomical and functional networks mediate stimulation's behavioral and physiological effects, provide further evidence that closed-loop LTC stimulation can improve episodic memory, and suggest a method for optimizing neuromodulation through improved stimulation targeting.
Collapse
Affiliation(s)
- Youssef Ezzyat
- Dept. of Psychology, Wesleyan University, Middletown, CT 06459, USA
| | - James E Kragel
- Dept. of Neurology, University of Chicago, Chicago, IL 60637, USA
| | - Ethan A Solomon
- Perelman School of Medicine, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Bradley C Lega
- Dept. of Neurosurgery, University of Texas Southwestern, Dallas, TX 75390, USA
| | - Joshua P Aronson
- Dept. of Neurosurgery, Beth Israel Deaconess Medical Center, Boston, MA 02215, USA
| | - Barbara C Jobst
- Dept. of Neurology, Dartmouth-Hitchcock Medical Center, Lebanon, NH 03756, USA
| | - Robert E Gross
- Dept. of Neurosurgery, Emory University Hospital, Atlanta, GA 30322, USA
| | - Michael R Sperling
- Dept. of Neurology, Sidney Kimmel Medical College at Thomas Jefferson University, Philadelphia, PA 19107, USA
| | | | - Sameer A Sheth
- Dept. of Neurosurgery, Baylor College of Medicine, Houston, TX 77030, USA
| | - Paul A Wanda
- Dept. of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Daniel S Rizzuto
- Dept. of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA
| | - Michael J Kahana
- Dept. of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA
| |
Collapse
|
210
|
Brodbeck C, Kandylaki KD, Scharenborg O. Neural Representations of Non-native Speech Reflect Proficiency and Interference from Native Language Knowledge. J Neurosci 2024; 44:e0666232023. [PMID: 37963763 PMCID: PMC10851685 DOI: 10.1523/jneurosci.0666-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/14/2023] [Revised: 06/23/2023] [Accepted: 08/01/2023] [Indexed: 11/16/2023] Open
Abstract
Learning to process speech in a foreign language involves learning new representations for mapping the auditory signal to linguistic structure. Behavioral experiments suggest that even listeners that are highly proficient in a non-native language experience interference from representations of their native language. However, much of the evidence for such interference comes from tasks that may inadvertently increase the salience of native language competitors. Here we tested for neural evidence of proficiency and native language interference in a naturalistic story listening task. We studied electroencephalography responses of 39 native speakers of Dutch (14 male) to an English short story, spoken by a native speaker of either American English or Dutch. We modeled brain responses with multivariate temporal response functions, using acoustic and language models. We found evidence for activation of Dutch language statistics when listening to English, but only when it was spoken with a Dutch accent. This suggests that a naturalistic, monolingual setting decreases the interference from native language representations, whereas an accent in the listener's own native language may increase native language interference, by increasing the salience of the native language and activating native language phonetic and lexical representations. Brain responses suggest that such interference stems from words from the native language competing with the foreign language in a single word recognition system, rather than being activated in a parallel lexicon. We further found that secondary acoustic representations of speech (after 200 ms latency) decreased with increasing proficiency. This may reflect improved acoustic-phonetic models in more proficient listeners.Significance Statement Behavioral experiments suggest that native language knowledge interferes with foreign language listening, but such effects may be sensitive to task manipulations, as tasks that increase metalinguistic awareness may also increase native language interference. This highlights the need for studying non-native speech processing using naturalistic tasks. We measured neural responses unobtrusively while participants listened for comprehension and characterized the influence of proficiency at multiple levels of representation. We found that salience of the native language, as manipulated through speaker accent, affected activation of native language representations: significant evidence for activation of native language (Dutch) categories was only obtained when the speaker had a Dutch accent, whereas no significant interference was found to a speaker with a native (American) accent.
Collapse
Affiliation(s)
- Christian Brodbeck
- Department of Psychological Sciences, University of Connecticut, Storrs, Connecticut 06269
| | - Katerina Danae Kandylaki
- Department of Neuropsychology and Psychopharmacology, Maastricht University, 6200 MD, Maastricht, The Netherlands
| | - Odette Scharenborg
- Multimedia Computing Group, Delft University of Technology, 2628 XE, Delft, The Netherlands
| |
Collapse
|
211
|
Sun Y, Liang L, Li Y, Chen X, Gao X. Dual-Alpha: a large EEG study for dual-frequency SSVEP brain-computer interface. Gigascience 2024; 13:giae041. [PMID: 39110623 PMCID: PMC11304967 DOI: 10.1093/gigascience/giae041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Revised: 05/25/2024] [Accepted: 06/20/2024] [Indexed: 08/10/2024] Open
Abstract
BACKGROUND The domain of brain-computer interface (BCI) technology has experienced significant expansion in recent years. However, the field continues to face a pivotal challenge due to the dearth of high-quality datasets. This lack of robust datasets serves as a bottleneck, constraining the progression of algorithmic innovations and, by extension, the maturation of the BCI field. FINDINGS This study details the acquisition and compilation of electroencephalogram data across 3 distinct dual-frequency steady-state visual evoked potential (SSVEP) paradigms, encompassing over 100 participants. Each experimental condition featured 40 individual targets with 5 repetitions per target, culminating in a comprehensive dataset consisting of 21,000 trials of dual-frequency SSVEP recordings. We performed an exhaustive validation of the dataset through signal-to-noise ratio analyses and task-related component analysis, thereby substantiating its reliability and effectiveness for classification tasks. CONCLUSIONS The extensive dataset presented is set to be a catalyst for the accelerated development of BCI technologies. Its significance extends beyond the BCI sphere and holds considerable promise for propelling research in psychology and neuroscience. The dataset is particularly invaluable for discerning the complex dynamics of binocular visual resource distribution.
Collapse
Affiliation(s)
- Yike Sun
- The School of Biomedical Engineering, Tsinghua University, Beijing 100084, China
| | - Liyan Liang
- The China Academy of Information and Communications Technology, Beijing 100191, China
| | - Yuhan Li
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin 300192, China
- The School of Life Sciences, Tiangong University, Tianjin 300387, China
| | - Xiaogang Chen
- Institute of Biomedical Engineering, Chinese Academy of Medical Sciences and Peking Union Medical College, Tianjin 300192, China
| | - Xiaorong Gao
- The School of Biomedical Engineering, Tsinghua University, Beijing 100084, China
| |
Collapse
|
212
|
Mei J, Luo R, Xu L, Zhao W, Wen S, Wang K, Xiao X, Meng J, Huang Y, Tang J, Cheng L, Xu M, Ming D. MetaBCI: An open-source platform for brain-computer interfaces. Comput Biol Med 2024; 168:107806. [PMID: 38081116 DOI: 10.1016/j.compbiomed.2023.107806] [Citation(s) in RCA: 5] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 11/29/2023] [Accepted: 11/29/2023] [Indexed: 01/10/2024]
Abstract
BACKGROUND Recently, brain-computer interfaces (BCIs) have attracted worldwide attention for their great potential in clinical and real-life applications. To implement a complete BCI system, one must set up several links to translate the brain intent into computer commands. However, there is not an open-source software platform that can cover all links of the BCI chain. METHOD This study developed a one-stop open-source BCI software, namely MetaBCI, to facilitate the construction of a BCI system. MetaBCI is written in Python, and has the functions of stimulus presentation (Brainstim), data loading and processing (Brainda), and online information flow (Brainflow). This paper introduces the detailed information of MetaBCI and presents four typical application cases. RESULTS The results showed that MetaBCI was an extensible and feature-rich software platform for BCI research and application, which could effectively encode, decode, and feedback brain activities. CONCLUSIONS MetaBCI can greatly lower the BCI's technical threshold for BCI beginners and can save time and cost to build up a practical BCI system. The source code is available at https://github.com/TBC-TJU/MetaBCI, expecting new contributions from the BCI community.
Collapse
Affiliation(s)
- Jie Mei
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China.
| | - Ruixin Luo
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China.
| | - Lichao Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China
| | - Wei Zhao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China
| | - Shengfu Wen
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China
| | - Kun Wang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China
| | - Xiaolin Xiao
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China
| | - Jiayuan Meng
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China
| | - Yongzhi Huang
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China
| | - Jiabei Tang
- Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China; Tiankai Suishi (Tianjin) Intelligence Ltd., Tianjin, 300192, People's Republic of China
| | - Longlong Cheng
- China Electronics Cloud Brain (Tianjin) Technology Co., Ltd., Tianjin, 300392, People's Republic of China
| | - Minpeng Xu
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China.
| | - Dong Ming
- Academy of Medical Engineering and Translational Medicine, Tianjin University, Tianjin, 300072, People's Republic of China; Department of Biomedical Engineering, College of Precision Instruments and Optoelectronics Engineering, Tianjin University, Tianjin, 300072, People's Republic of China; Haihe Laboratory of Brain-computer Interaction and Human-machine Integration, Tianjin, 300392, People's Republic of China
| |
Collapse
|
213
|
Vallinoja J, Nurmi T, Jaatela J, Wens V, Bourguignon M, Mäenpää H, Piitulainen H. Functional connectivity of sensorimotor network is enhanced in spastic diplegic cerebral palsy: A multimodal study using fMRI and MEG. Clin Neurophysiol 2024; 157:4-14. [PMID: 38006621 DOI: 10.1016/j.clinph.2023.10.014] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2022] [Revised: 06/02/2023] [Accepted: 10/15/2023] [Indexed: 11/27/2023]
Abstract
OBJECTIVE To assess the effects to functional connectivity (FC) caused by lesions related to spastic diplegic cerebral palsy (CP) in children and adolescents using multiple imaging modalities. METHODS We used resting state magnetoencephalography (MEG) envelope signals in alpha, beta and gamma ranges and resting state functional magnetic resonance imaging (fMRI) signals to quantify FC between selected sensorimotor regions of interest (ROIs) in 11 adolescents with spastic diplegic cerebral palsy and 24 typically developing controls. Motor performance of the hands was quantified with gross motor, fine motor and kinesthesia tests. RESULTS In fMRI, participants with CP showed enhanced FC within posterior parietal regions; in MEG, they showed enhanced interhemispheric FC between sensorimotor regions and posterior parietal regions both in alpha and lower beta bands. There was a correlation between the kinesthesia score and fronto-parietal connectivity in the control population. CONCLUSIONS CP is associated with enhanced FC in sensorimotor network. This difference is not correlated with hand coordination performance. The effect of the lesion is likely not fully captured by temporal correlation of ROI signals. SIGNIFICANCE Brain lesions can show as increased temporal correlation of activity between remote brain areas. We suggest this effect is likely separate from typical physiological correlates of functional connectivity.
Collapse
Affiliation(s)
- Jaakko Vallinoja
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. BOX 12200, 00076 AALTO Espoo, Finland.
| | - Timo Nurmi
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. BOX 12200, 00076 AALTO Espoo, Finland; Faculty of Sport and Health Sciences, University of Jyväskylä, P.O. BOX 35, FI-40014 Jyväskylä, Finland
| | - Julia Jaatela
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. BOX 12200, 00076 AALTO Espoo, Finland
| | - Vincent Wens
- Laboratoire de Neuroanatomie et Neuroimagerie Translationnelles (LN(2)T), UNI - ULB Neuroscience Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium; Department of Translational Neuroimaging, HUB - Hôpital Erasme, Brussels, Belgium
| | - Mathieu Bourguignon
- Laboratoire de Neuroanatomie et Neuroimagerie Translationnelles (LN(2)T), UNI - ULB Neuroscience Institute, Université Libre de Bruxelles (ULB), Brussels, Belgium; Laboratory of Neurophysiology and Movement Biomechanics, UNI - ULB Neuroscience Institute, Université Libre de Bruxelles (ULB), 1070 Brussels, Belgium; BCBL, Basque Center on Cognition, Brain and Language, 20009 San Sebastian, Spain
| | - Helena Mäenpää
- Department of Child Neurology, New Children's Hospital, University of Helsinki and Helsinki University Hospital, FI-00029 Helsinki, Finland
| | - Harri Piitulainen
- Department of Neuroscience and Biomedical Engineering, Aalto University School of Science, P.O. BOX 12200, 00076 AALTO Espoo, Finland; Faculty of Sport and Health Sciences, University of Jyväskylä, P.O. BOX 35, FI-40014 Jyväskylä, Finland; Aalto NeuroImaging, Aalto University School of Science, Espoo, Finland
| |
Collapse
|
214
|
Todorov D, Schnitzler A, Hirschmann J. Parkinsonian rest tremor can be distinguished from voluntary hand movements based on subthalamic and cortical activity. Clin Neurophysiol 2024; 157:146-155. [PMID: 38030516 DOI: 10.1016/j.clinph.2023.10.018] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Revised: 10/19/2023] [Accepted: 10/31/2023] [Indexed: 12/01/2023]
Abstract
OBJECTIVE To distinguish Parkinsonian rest tremor and different voluntary hand movements by analyzing brain activity. METHODS We re-analyzed magnetoencephalography and local field potential recordings from the subthalamic nucleus of six patients with Parkinson's disease. Data were obtained after withdrawal from dopaminergic medication (Med Off) and after administration of levodopa (Med On). Using gradient-boosted tree learning, we classified epochs as tremor, fist-clenching, forearm extension or tremor-free rest. RESULTS Subthalamic activity alone was insufficient for distinguishing the four different motor states (balanced accuracy mean: 38%, std: 7%). The combination of cortical and subthalamic features, in contrast, allowed for a much more accurate classification (balanced accuracy mean: 75%, std: 17%). Adding a single cortical area improved balanced accuracy by 17% on average, as compared to classification based on subthalamic activity alone. In most patients, the most informative cortical areas were sensorimotor cortical regions. Decoding performance was similar in Med On and Med Off. CONCLUSIONS Electrophysiological recordings allow for distinguishing several motor states, provided that cortical signals are monitored in addition to subthalamic activity. SIGNIFICANCE By combining cortical recordings, subcortical recordings and machine learning, adaptive deep brain stimulation systems might be able to detect tremor specifically and to respond adequately to several motor states.
Collapse
Affiliation(s)
- Dmitrii Todorov
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Germany; Centre de Recherche en Neurosciences de Lyon - Inserm U1028, 69675 Bron, France; Centre de Recerca Matemática, Campus UAB edifici C, 08193 Bellaterra, Barcelona, Spain
| | - Alfons Schnitzler
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Germany; Center for Movement Disorders and Neuromodulation, Department of Neurology Medical Faculty, Heinrich Heine University, 40225 Düsseldorf, Germany
| | - Jan Hirschmann
- Institute of Clinical Neuroscience and Medical Psychology, Medical Faculty and University Hospital Düsseldorf, Heinrich Heine University Düsseldorf, Germany.
| |
Collapse
|
215
|
Sklar AL, Yeh FC, Curtis M, Seebold D, Coffman BA, Salisbury DF. Functional and structural connectivity correlates of semantic verbal fluency deficits in first-episode psychosis. J Psychiatr Res 2024; 169:73-80. [PMID: 38000187 PMCID: PMC10843642 DOI: 10.1016/j.jpsychires.2023.11.032] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 10/31/2023] [Accepted: 11/16/2023] [Indexed: 11/26/2023]
Abstract
INTRODUCTION Semantic verbal fluency (SVF) impairments are debilitating and present early in the course of psychotic illness. Deficits within frontal, parietal, and temporal brain regions contribute to this deficit, as long-range communication across this functionally integrated network is critical to SVF. This study sought to isolate disruptions in functional and structural connectivity contributing to SVF deficits during first-episode psychosis in the schizophrenia spectrum (FESz). METHODS Thirty-three FESz and 34 matched healthy controls (HC) completed the Animal Naming Task to assess SVF. Magnetoencephalography was recorded during an analogous covert SVF task, and phase-locking value (PLV) used to measure functional connectivity between inferior frontal and temporoparietal structures bilaterally. Diffusion imaging was collected to measure fractional anisotropy (FA) of the arcuate fasciculus, the major tract connecting frontal and temporoparietal language areas. RESULTS SVF scores were lower among FESz compared to HC. While PLV and FA did not differ between groups overall, FESz exhibited an absence of the left-lateralized nature of both measures observed in HC. Among FESz, larger right-hemisphere PLV was associated with worse SVF performance (ρ = -0.51) and longer DUP (ρ = -0.50). DISCUSSION In addition to worse SVF, FESz exhibited diminished leftward asymmetry of structural and functional connectivity in fronto-temporoparietal SVF network. The relationship between theta-band hyperconnectivity and poorer performance suggests a disorganized executive network and may reflect dysfunction of frontal cognitive control centers. These findings illustrate an aberrant pattern across the distributed SVF network at disease onset and merit further investigation into development of asymmetrical hemispheric connectivity and its failure among high-risk populations.
Collapse
Affiliation(s)
- Alfredo L Sklar
- University of Pittsburgh School of Medicine, Department of Psychiatry, Pittsburgh, PA, USA
| | - Fang-Cheng Yeh
- University of Pittsburgh School of Medicine, Department of Neurological Surgery, Pittsburgh, PA, USA
| | - Mark Curtis
- University of Pittsburgh School of Medicine, Department of Psychiatry, Pittsburgh, PA, USA
| | - Dylan Seebold
- University of Pittsburgh School of Medicine, Department of Psychiatry, Pittsburgh, PA, USA
| | - Brian A Coffman
- University of Pittsburgh School of Medicine, Department of Psychiatry, Pittsburgh, PA, USA
| | - Dean F Salisbury
- University of Pittsburgh School of Medicine, Department of Psychiatry, Pittsburgh, PA, USA.
| |
Collapse
|
216
|
Kujala J, Mäkelä S, Ojala P, Hyönä J, Salmelin R. Beta- and gamma-band cortico-cortical interactions support naturalistic reading of continuous text. Eur J Neurosci 2024; 59:238-251. [PMID: 38062542 DOI: 10.1111/ejn.16212] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Revised: 11/06/2023] [Accepted: 11/15/2023] [Indexed: 01/23/2024]
Abstract
Large-scale integration of information across cortical structures, building on neural connectivity, has been proposed to be a key element in supporting human cognitive processing. In electrophysiological neuroimaging studies of reading, quantification of neural interactions has been limited to the level of isolated words or sentences due to artefacts induced by eye movements. Here, we combined magnetoencephalography recording with advanced artefact rejection tools to investigate both cortico-cortical coherence and directed neural interactions during naturalistic reading of full-page texts. Our results show that reading versus visual scanning of text was associated with wide-spread increases of cortico-cortical coherence in the beta and gamma bands. We further show that the reading task was linked to increased directed neural interactions compared to the scanning task across a sparse set of connections within a wide range of frequencies. Together, the results demonstrate that neural connectivity flexibly builds on different frequency bands to support continuous natural reading.
Collapse
Affiliation(s)
- Jan Kujala
- Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Sasu Mäkelä
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Pauliina Ojala
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
- Aalto NeuroImaging, Aalto University, Espoo, Finland
| | - Jukka Hyönä
- Department of Psychology and Speech-Language Pathology, University of Turku, Turku, Finland
| | - Riitta Salmelin
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
- Aalto NeuroImaging, Aalto University, Espoo, Finland
| |
Collapse
|
217
|
Fang X, Perfetti CA. Consolidation improves the learning of new meanings for known words but not necessarily their integration into semantic memory. LANGUAGE, COGNITION AND NEUROSCIENCE 2023; 39:351-366. [PMID: 38962374 PMCID: PMC11219009 DOI: 10.1080/23273798.2023.2293853] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/14/2023] [Accepted: 10/26/2023] [Indexed: 07/05/2024]
Abstract
Consolidation is essential to the integration of novel words into the mental lexicon; however, its role in learning new meanings for known words remains unclear. This old-form-new-meaning learning is very common, as when one learns that "skate" is also a type of fish in addition to its familiar roller- or ice-skating meaning. To address consolidation effects for new meanings, we compared the behavioral and ERP measures on new and original meanings tested 24 hours after learning with words tested immediately after learning. Semantic judgments of both new and original meanings benefitted from the study-test interval. However, N400 amplitudes on studied words-indicators of meaning access from semantic memory-were unaffected by learning or consolidation. These results suggest that while sleep benefits memory for new meanings, the new meanings do not become integrated into the mental lexicon within that period. Instead, episodic retrieval remains functional in accessing new meanings even after 24 hours.
Collapse
Affiliation(s)
- Xiaoping Fang
- School of Psychology, Beijing Language and Culture University
| | - Charles A. Perfetti
- Learning Research and Development Center, University of Pittsburgh
- Center for Neural Basis of Cognition
| |
Collapse
|
218
|
Yan Y, Zhan J, Garrod O, Cui X, Ince RAA, Schyns PG. Strength of predicted information content in the brain biases decision behavior. Curr Biol 2023; 33:5505-5514.e6. [PMID: 38065096 DOI: 10.1016/j.cub.2023.10.042] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/22/2023] [Revised: 10/11/2023] [Accepted: 10/23/2023] [Indexed: 12/21/2023]
Abstract
Prediction-for-perception theories suggest that the brain predicts incoming stimuli to facilitate their categorization.1,2,3,4,5,6,7,8,9,10,11,12,13,14,15,16,17 However, it remains unknown what the information contents of these predictions are, which hinders mechanistic explanations. This is because typical approaches cast predictions as an underconstrained contrast between two categories18,19,20,21,22,23,24-e.g., faces versus cars, which could lead to predictions of features specific to faces or cars, or features from both categories. Here, to pinpoint the information contents of predictions and thus their mechanistic processing in the brain, we identified the features that enable two different categorical perceptions of the same stimuli. We then trained multivariate classifiers to discern, from dynamic MEG brain responses, the features tied to each perception. With an auditory cueing design, we reveal where, when, and how the brain reactivates visual category features (versus the typical category contrast) before the stimulus is shown. We demonstrate that the predictions of category features have a more direct influence (bias) on subsequent decision behavior in participants than the typical category contrast. Specifically, these predictions are more precisely localized in the brain (lateralized), are more specifically driven by the auditory cues, and their reactivation strength before a stimulus presentation exerts a greater bias on how the individual participant later categorizes this stimulus. By characterizing the specific information contents that the brain predicts and then processes, our findings provide new insights into the brain's mechanisms of prediction for perception.
Collapse
Affiliation(s)
- Yuening Yan
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK
| | - Jiayu Zhan
- School of Psychological and Cognitive Sciences, Peking University, 5 Yiheyuan Road, Beijing 100871, China
| | - Oliver Garrod
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK
| | - Xuan Cui
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK
| | - Robin A A Ince
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK
| | - Philippe G Schyns
- School of Psychology and Neuroscience, University of Glasgow, 62 Hillhead Street, Glasgow G12 8QB, UK.
| |
Collapse
|
219
|
Shin Y, Hwang S, Lee SB, Son H, Chu K, Jung KY, Lee SK, Park KI, Kim YG. Using spectral and temporal filters with EEG signal to predict the temporal lobe epilepsy outcome after antiseizure medication via machine learning. Sci Rep 2023; 13:22532. [PMID: 38110465 PMCID: PMC10728218 DOI: 10.1038/s41598-023-49255-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2023] [Accepted: 12/06/2023] [Indexed: 12/20/2023] Open
Abstract
Epilepsy is a neurological disorder in which the brain is transiently altered. Predicting outcomes in epilepsy is essential for providing feedback that can foster improved outcomes in the future. This study aimed to investigate whether applying spectral and temporal filters to resting-state electroencephalography (EEG) signals could improve the prediction of outcomes for patients taking antiseizure medication to treat temporal lobe epilepsy (TLE). We collected EEG data from a total of 46 patients (divided into a seizure-free group (SF, n = 22) and a non-seizure-free group (NSF, n = 24)) with TLE and retrospectively reviewed their clinical data. We segmented spectral and temporal ranges with various time-domain features (Hjorth parameters, statistical parameters, energy, zero-crossing rate, inter-channel correlation, inter-channel phase locking value and spectral information derived from Fourier transform, Stockwell transform, and wavelet transform) and compared their performance by applying an optimal frequency strategy, an optimal duration strategy, and a combination strategy. For all time-domain features, the optimal frequency and time combination strategy showed the highest performance in distinguishing SF patients from NSF patients (area under the curve (AUC) = 0.790 ± 0.159). Furthermore, optimal performance was achieved by utilizing a feature vector derived from statistical parameters within the 39- to 41-Hz frequency band with a window length of 210 s, as evidenced by an AUC of 0.748. By identifying the optimal parameters, we improved the performance of the prediction model. These parameters can serve as standard parameters for predicting outcomes based on resting-state EEG signals.
Collapse
Affiliation(s)
- Youmin Shin
- Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, Republic of Korea
- Interdisciplinary Program in Bio-Engineering, Seoul National University, Seoul, Korea
| | - Sungeun Hwang
- Department of Neurology, Ewha Womans University Mokdong Hospital, Seoul, Republic of Korea
| | - Seung-Bo Lee
- Department of Medical Informatics, Keimyung University School of Medicine, Daegu, Republic of Korea
| | - Hyoshin Son
- Department of Neurosurgery, Seoul National University Hospital, Seoul, Republic of Korea
| | - Kon Chu
- Department of Neurology, Seoul National University Hospital, Seoul, Republic of Korea
- Department of Neurology, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Ki-Young Jung
- Department of Neurology, Seoul National University Hospital, Seoul, Republic of Korea
- Department of Neurology, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Sang Kun Lee
- Department of Neurology, Seoul National University Hospital, Seoul, Republic of Korea
- Department of Neurology, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Kyung-Il Park
- Department of Neurology, Seoul National University College of Medicine, Seoul, Republic of Korea.
- Department of Neurology, Seoul National University Hospital Healthcare System Gangnam Center, Seoul, Republic of Korea.
| | - Young-Gon Kim
- Department of Transdisciplinary Medicine, Seoul National University Hospital, Seoul, Republic of Korea.
- Department of Medicine, Seoul National University College of Medicine, Seoul, Korea.
| |
Collapse
|
220
|
Fujiyama H, Williams A, Tan J, Levin O, Hinder MR. Comparison of online and offline applications of dual-site transcranial alternating current stimulation (tACS) over the pre-supplementary motor area (preSMA) and right inferior frontal gyrus (rIFG) for improving response inhibition. Neuropsychologia 2023; 191:108737. [PMID: 37995902 DOI: 10.1016/j.neuropsychologia.2023.108737] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2023] [Revised: 09/25/2023] [Accepted: 11/16/2023] [Indexed: 11/25/2023]
Abstract
The efficacy of transcranial alternating current stimulation (tACS) is thought to be brain state-dependent, such that tACS during task performance would be hypothesised to offer greater potential for improving performance compared to tACS at rest. However, to date, no empirical study has tested this postulation. The current study compared the effects of dual-site beta tACS applied during a stop signal task (online) to the effects of the same tACS protocol applied prior to the task (offline) and a sham control stimulation in 53 young, healthy adults (32 female; 18-35 yrs). The right inferior frontal gyrus (rIFG) and centre (midline) of the pre-supplementary motor area (preSMA), which are thought to play critical roles in action cancellation, were simultaneously stimulated, sending phase-synchronised stimulation for 15 min with the aim of increasing functional connectivity. The offline group showed significant within-group improvement in response inhibition without showing overt task-related changes in functional connectivity measured with EEG connectivity analysis, suggesting offline tACS is efficacious in inducing behavioural changes potentially via a post-stimulation early plasticity mechanism. In contrast, neither the online nor sham group showed significant improvements in response inhibition. However, EEG connectivity analysis revealed significantly increased task-related functional connectivity following online stimulation and a medium effect size observed in correlation analyses suggested that an increase in functional connectivity in the beta band at rest was potentially associated with an improvement in response inhibition. Overall, the results indicate that both online and offline dual-site beta tACS can be beneficial in improving inhibitory control via distinct underlying mechanisms.
Collapse
Affiliation(s)
- Hakuei Fujiyama
- School of Psychology, Murdoch University, Western Australia, Australia; Centre for Healthy Ageing, Health Futures Institute, Murdoch University, Western Australia, Australia; Centre for Molecular Medicine and Innovative Therapeutics, Murdoch University, Western Australia, Australia.
| | | | - Jane Tan
- School of Psychology, Murdoch University, Western Australia, Australia; Centre for Healthy Ageing, Health Futures Institute, Murdoch University, Western Australia, Australia
| | - Oron Levin
- Department of Health Promotion and Rehabilitation, Lithuanian Sports University, Kaunas, Lithuania; Movement Control & Neuroplasticity Research Group, Group Biomedical Sciences, Catholic University Leuven, Leuven, Belgium
| | - Mark R Hinder
- Sensorimotor Neuroscience and Ageing Research Group, School of Psychological Sciences, College of Health and Medicine, University of Tasmania, Tasmania, Australia
| |
Collapse
|
221
|
Datta K, Bhutambare A, V. L. M, Narawa Y, Srinath R, Kanitkar M. Improved sleep, cognitive processing and enhanced learning and memory task accuracy with Yoga nidra practice in novices. PLoS One 2023; 18:e0294678. [PMID: 38091317 PMCID: PMC10718434 DOI: 10.1371/journal.pone.0294678] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2023] [Accepted: 10/25/2023] [Indexed: 12/18/2023] Open
Abstract
Complementary and Alternative medicine is known to have health benefits. Yoga nidra practice is an easy-to-do practice and has shown beneficial effects on stress reduction and is found to improve sleep in insomnia patients. Effect of yoga nidra practice on subjective sleep is known but its effect on sleep and cognition objectively is not documented. The aim of the study was to study the effect of yoga nidra practice on cognition and sleep using objective parameters. 41 participants were enrolled, and baseline sleep diary (SD) collected. Participants volunteered for overnight polysomnography (PSG) and cognition testing battery (CTB) comprising of Motor praxis test, emotion recognition task (ERT), digital symbol substitution task, visual object learning task (VOLT), abstract matching (AIM), line orientation task, matrix reasoning task, fractal-2-back test (NBACK), psychomotor vigilance task and balloon analog risk task. Baseline CTB and after one and two weeks of practice was compared. Power spectra density for EEG at central, frontal, and occipital locations during CTB was compared. Repeat SD and PSG after four weeks of practice were done. After yoga nidra practice, improved reaction times for all cognition tasks were seen. Post intervention compared to baseline (95%CI; p-value, effect size) showed a significant improvement in sleep efficiency of +3.62% (0.3, 5.15; p = 0.03, r = 0.42), -20min (-35.78, -5.02; p = 0.003, d = 0.84) for wake after sleep onset and +4.19 μV2 (0.5, 9.5; p = 0.04, r = 0.43) in delta during deep sleep. Accuracy increased in VOLT (95% CI: 0.08, 0.17; p = 0.002, d = 0.79), AIM (95% CI: 0.03, 0.12; p = 0.02, d = 0.61) and NBACK (95% CI: 0.02, 0.13; p = 0.04, d = 0.56); ERT accuracy increased for happy, fear and anger (95% CI: 0.07, 0.24; p = 0.004, d = 0.75) but reduced for neutral stimuli (95% CI: -0.31, -0.12; p = 0.04, r = 0.33) after yoga nidra practice. Yoga Nidra practice improved cognitive processing and night-time sleep.
Collapse
Affiliation(s)
- Karuna Datta
- Human Sleep Research Lab, c/o Department of Sports Medicine, Armed Forces Medical College, Pune, Maharashtra, India
| | - Anna Bhutambare
- JRF, DST SATYAM Project, Human Sleep Research Lab, c/o Department of Sports Medicine, Armed Forces Medical College, Pune, Maharashtra, India
| | - Mamatha V. L.
- DST SATYAM Project, Human Sleep Research Lab, c/o Department of Sports Medicine, Armed Forces Medical College, Pune, Maharashtra, India
| | - Yogita Narawa
- JRF, DST SATYAM Project, Human Sleep Research Lab, c/o Department of Sports Medicine, Armed Forces Medical College, Pune, Maharashtra, India
| | - Rajagopal Srinath
- Department of Internal Medicine, Armed Forces Medical College, Pune, Maharashtra, India
| | - Madhuri Kanitkar
- Maharashtra University of Health Sciences, Nashik, Maharashtra, India
| |
Collapse
|
222
|
Klink H, Kaiser D, Stecher R, Ambrus GG, Kovács G. Your place or mine? The neural dynamics of personally familiar scene recognition suggests category independent familiarity encoding. Cereb Cortex 2023; 33:11634-11645. [PMID: 37885126 DOI: 10.1093/cercor/bhad397] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/29/2023] [Revised: 09/29/2023] [Accepted: 09/30/2023] [Indexed: 10/28/2023] Open
Abstract
Recognizing a stimulus as familiar is an important capacity in our everyday life. Recent investigation of visual processes has led to important insights into the nature of the neural representations of familiarity for human faces. Still, little is known about how familiarity affects the neural dynamics of non-face stimulus processing. Here we report the results of an EEG study, examining the representational dynamics of personally familiar scenes. Participants viewed highly variable images of their own apartments and unfamiliar ones, as well as personally familiar and unfamiliar faces. Multivariate pattern analyses were used to examine the time course of differential processing of familiar and unfamiliar stimuli. Time-resolved classification revealed that familiarity is decodable from the EEG data similarly for scenes and faces. The temporal dynamics showed delayed onsets and peaks for scenes as compared to faces. Familiarity information, starting at 200 ms, generalized across stimulus categories and led to a robust familiarity effect. In addition, familiarity enhanced category representations in early (250-300 ms) and later (>400 ms) processing stages. Our results extend previous face familiarity results to another stimulus category and suggest that familiarity as a construct can be understood as a general, stimulus-independent processing step during recognition.
Collapse
Affiliation(s)
- Hannah Klink
- Department of Neurology, Universitätsklinikum, Kastanienstraße1 Jena, D-07747 Jena, Thüringen, Germany
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich Schiller University Jena, Leutragraben 1, D-07743 Jena, Thüringen, Germany
| | - Daniel Kaiser
- Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus-Liebig-University Gießen, Arndtstraße 2, D-35392 Gießen, Hessen, Germany
- Center for Mind, Brain and Behavior (CMBB), Justus-Liebig-University Gießen and Philipps-University Marburg, Hans-Meerwein-Straße 6 Mehrzweckgeb, 03C022, Marburg, D-35032, Hessen, Germany
| | - Rico Stecher
- Mathematical Institute, Department of Mathematics and Computer Science, Physics, Geography, Justus-Liebig-University Gießen, Arndtstraße 2, D-35392 Gießen, Hessen, Germany
| | - Géza G Ambrus
- Department of Psychology, Bournemouth University, Poole House P319, Talbot Campus, Fern Barrow, Poole, Dorset BH12 5BB, United Kingdom
| | - Gyula Kovács
- Department of Biological Psychology and Cognitive Neurosciences, Institute of Psychology, Friedrich Schiller University Jena, Leutragraben 1, D-07743 Jena, Thüringen, Germany
| |
Collapse
|
223
|
Medel V, Irani M, Crossley N, Ossandón T, Boncompte G. Complexity and 1/f slope jointly reflect brain states. Sci Rep 2023; 13:21700. [PMID: 38065976 PMCID: PMC10709649 DOI: 10.1038/s41598-023-47316-0] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Accepted: 11/12/2023] [Indexed: 12/18/2023] Open
Abstract
Characterization of brain states is essential for understanding its functioning in the absence of external stimuli. Brain states differ on their balance between excitation and inhibition, and on the diversity of their activity patterns. These can be respectively indexed by 1/f slope and Lempel-Ziv complexity (LZc). However, whether and how these two brain state properties relate remain elusive. Here we analyzed the relation between 1/f slope and LZc with two in-silico approaches and in both rat EEG and monkey ECoG data. We contrasted resting state with propofol anesthesia, which directly modulates the excitation-inhibition balance. We found convergent results among simulated and empirical data, showing a strong, inverse and non trivial monotonic relation between 1/f slope and complexity, consistent at both ECoG and EEG scales. We hypothesize that differentially entropic regimes could underlie the link between the excitation-inhibition balance and the vastness of the repertoire of brain systems.
Collapse
Affiliation(s)
- Vicente Medel
- Latin American Health Brain Institute (BrainLat), Universidad Adolfo Ibáñez, Santiago, Chile.
| | - Martín Irani
- Department of Psychology, University of Illinois Urbana-Champaign, IL, USA
| | - Nicolás Crossley
- Departamento de Psiquiatría, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile
| | - Tomás Ossandón
- Departamento de Psiquiatría, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
- Institute for Biological and Medical Engineering, Schools of Engineering, Medicine and Biological Sciences, Pontificia Universidad Católica de Chile, Santiago, Chile.
| | - Gonzalo Boncompte
- Departamento de Psiquiatría, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
- División de Anestesiología, Escuela de Medicina, Pontificia Universidad Católica de Chile, Santiago, Chile.
| |
Collapse
|
224
|
Braun A, Donner TH. Adaptive biasing of action-selective cortical build-up activity by stimulus history. eLife 2023; 12:RP86740. [PMID: 38054952 DOI: 10.7554/elife.86740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/07/2023] Open
Abstract
Decisions under uncertainty are often biased by the history of preceding sensory input, behavioral choices, or received outcomes. Behavioral studies of perceptual decisions suggest that such history-dependent biases affect the accumulation of evidence and can be adapted to the correlation structure of the sensory environment. Here, we systematically varied this correlation structure while human participants performed a canonical perceptual choice task. We tracked the trial-by-trial variations of history biases via behavioral modeling and of a neural signature of decision formation via magnetoencephalography (MEG). The history bias was flexibly adapted to the environment and exerted a selective effect on the build-up (not baseline level) of action-selective motor cortical activity during decision formation. This effect added to the impact of the current stimulus. We conclude that the build-up of action plans in human motor cortical circuits is shaped by dynamic prior expectations that result from an adaptive interaction with the environment.
Collapse
Affiliation(s)
- Anke Braun
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Psychiatry and Neurosciences, Berlin, Germany
- Charité - Universitätsmedizin Berlin, corporate member of Freie Universität Berlin and Humboldt-Universität zu Berlin, Department of Child and Adolescent Psychiatry, Berlin, Germany
| | - Tobias H Donner
- Section Computational Cognitive Neuroscience, Department of Neurophysiology and Pathophysiology, University Medical Center Hamburg-Eppendorf, Hamburg, Germany
- Bernstein Center for Computational Neuroscience, Charité - Universitätsmedizin Berlin, Berlin, Germany
| |
Collapse
|
225
|
Rayson H, Szul MJ, El-Khoueiry P, Debnath R, Gautier-Martins M, Ferrari PF, Fox N, Bonaiuto JJ. Bursting with Potential: How Sensorimotor Beta Bursts Develop from Infancy to Adulthood. J Neurosci 2023; 43:8487-8503. [PMID: 37833066 PMCID: PMC10711718 DOI: 10.1523/jneurosci.0886-23.2023] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2023] [Revised: 07/15/2023] [Accepted: 07/20/2023] [Indexed: 10/15/2023] Open
Abstract
Beta activity is thought to play a critical role in sensorimotor processes. However, little is known about how activity in this frequency band develops. Here, we investigated the developmental trajectory of sensorimotor beta activity from infancy to adulthood. We recorded EEG from 9-month-old, 12-month-old, and adult humans (male and female) while they observed and executed grasping movements. We analyzed "beta burst" activity using a novel method that combines time-frequency decomposition and principal component analysis. We then examined the changes in burst rate and waveform motifs along the selected principal components. Our results reveal systematic changes in beta activity during action execution across development. We found a decrease in beta burst rate during movement execution in all age groups, with the greatest decrease observed in adults. Additionally, we identified three principal components that defined waveform motifs that systematically changed throughout the trial. We found that bursts with waveform shapes closer to the median waveform were not rate-modulated, whereas those with waveform shapes further from the median were differentially rate-modulated. Interestingly, the decrease in the rate of certain burst motifs occurred earlier during movement and was more lateralized in adults than in infants, suggesting that the rate modulation of specific types of beta bursts becomes increasingly refined with age.SIGNIFICANCE STATEMENT We demonstrate that, like in adults, sensorimotor beta activity in infants during reaching and grasping movements occurs in bursts, not oscillations like thought traditionally. Furthermore, different beta waveform shapes were differentially modulated with age, including more lateralization in adults. Aberrant beta activity characterizes various developmental disorders and motor difficulties linked to early brain injury, so looking at burst waveform shape could provide more sensitivity for early identification and treatment of affected individuals before any behavioral symptoms emerge. More generally, comparison of beta burst activity in typical versus atypical motor development will also be instrumental in teasing apart the mechanistic functional roles of different types of beta bursts.
Collapse
Affiliation(s)
- Holly Rayson
- Institut des Sciences, Cognitives Marc Jeannerod, Centre National de la Recherche Scientifique Unité Mixte de Recherche 5229, Bron, 69500, France
- Université de Lyon, Université Claude Bernard Lyon 1, Lyon, 69100, France
- Inovarion, Paris, 75005, France
| | - Maciej J Szul
- Institut des Sciences, Cognitives Marc Jeannerod, Centre National de la Recherche Scientifique Unité Mixte de Recherche 5229, Bron, 69500, France
- Université de Lyon, Université Claude Bernard Lyon 1, Lyon, 69100, France
| | - Perla El-Khoueiry
- Institut des Sciences, Cognitives Marc Jeannerod, Centre National de la Recherche Scientifique Unité Mixte de Recherche 5229, Bron, 69500, France
- Université de Lyon, Université Claude Bernard Lyon 1, Lyon, 69100, France
| | - Ranjan Debnath
- Center for Psychiatry and Psychotherapy, Justus-Liebig University, Giessen, 35394, Germany
| | - Marine Gautier-Martins
- Institut des Sciences, Cognitives Marc Jeannerod, Centre National de la Recherche Scientifique Unité Mixte de Recherche 5229, Bron, 69500, France
- Université de Lyon, Université Claude Bernard Lyon 1, Lyon, 69100, France
| | - Pier F Ferrari
- Institut des Sciences, Cognitives Marc Jeannerod, Centre National de la Recherche Scientifique Unité Mixte de Recherche 5229, Bron, 69500, France
- Université de Lyon, Université Claude Bernard Lyon 1, Lyon, 69100, France
| | - Nathan Fox
- Department of Human Development and Quantitative Methodology, University of Maryland, College Park, Maryland, 20742
| | - James J Bonaiuto
- Institut des Sciences, Cognitives Marc Jeannerod, Centre National de la Recherche Scientifique Unité Mixte de Recherche 5229, Bron, 69500, France
- Université de Lyon, Université Claude Bernard Lyon 1, Lyon, 69100, France
| |
Collapse
|
226
|
Karunathilake IMD, Kulasingham JP, Simon JZ. Neural tracking measures of speech intelligibility: Manipulating intelligibility while keeping acoustics unchanged. Proc Natl Acad Sci U S A 2023; 120:e2309166120. [PMID: 38032934 PMCID: PMC10710032 DOI: 10.1073/pnas.2309166120] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/01/2023] [Accepted: 10/21/2023] [Indexed: 12/02/2023] Open
Abstract
Neural speech tracking has advanced our understanding of how our brains rapidly map an acoustic speech signal onto linguistic representations and ultimately meaning. It remains unclear, however, how speech intelligibility is related to the corresponding neural responses. Many studies addressing this question vary the level of intelligibility by manipulating the acoustic waveform, but this makes it difficult to cleanly disentangle the effects of intelligibility from underlying acoustical confounds. Here, using magnetoencephalography recordings, we study neural measures of speech intelligibility by manipulating intelligibility while keeping the acoustics strictly unchanged. Acoustically identical degraded speech stimuli (three-band noise-vocoded, ~20 s duration) are presented twice, but the second presentation is preceded by the original (nondegraded) version of the speech. This intermediate priming, which generates a "pop-out" percept, substantially improves the intelligibility of the second degraded speech passage. We investigate how intelligibility and acoustical structure affect acoustic and linguistic neural representations using multivariate temporal response functions (mTRFs). As expected, behavioral results confirm that perceived speech clarity is improved by priming. mTRFs analysis reveals that auditory (speech envelope and envelope onset) neural representations are not affected by priming but only by the acoustics of the stimuli (bottom-up driven). Critically, our findings suggest that segmentation of sounds into words emerges with better speech intelligibility, and most strongly at the later (~400 ms latency) word processing stage, in prefrontal cortex, in line with engagement of top-down mechanisms associated with priming. Taken together, our results show that word representations may provide some objective measures of speech comprehension.
Collapse
Affiliation(s)
| | | | - Jonathan Z. Simon
- Department of Electrical and Computer Engineering, University of Maryland, College Park, MD20742
- Department of Biology, University of Maryland, College Park, MD20742
- Institute for Systems Research, University of Maryland, College Park, MD20742
| |
Collapse
|
227
|
Duncan DH, Theeuwes J, van Moorselaar D. The Electrophysiological Markers of Statistically Learned Attentional Enhancement: Evidence for a Saliency-based Mechanism. J Cogn Neurosci 2023; 35:2110-2125. [PMID: 37801336 DOI: 10.1162/jocn_a_02066] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/07/2023]
Abstract
It is well established that attention can be sharpened through the process of statistical learning (e.g., visual search becomes faster when targets appear at high-relative-to-low probability locations). Although this process of statistically learned attentional enhancement differs behaviorally from the well-studied top-down and bottom-up forms of attention, relatively little work has been done to characterize the electrophysiological correlates of statistically learned attentional enhancement. It thus remains unclear whether statistically learned enhancement recruits any of the same cognitive mechanisms as top-down or bottom-up attention. In the current study, EEG data were collected while participants searched for an ambiguous unique shape in a visual array (the additional singleton task). Unbeknownst to the participants, targets appeared more frequently in one location in space (probability cuing). Encephalographic data were then analyzed in two phases: an anticipatory phase and a reactive phase. In the anticipatory phase preceding search stimuli onset, alpha lateralization as well as the Anterior Directing Attention Negativity and Late Directing Attention Positivity components-signs of preparatory attention known to characterize top-down enhancement-were tested. In the reactive phase, the N2pc component-a well-studied marker of target processing-was examined following stimuli onset. Our results showed that statistically learned attentional enhancement is not characterized by any of the well-known anticipatory markers of top-down attention; yet targets at high probability locations did reliably evoke larger N2pc amplitudes, a finding that is associated with bottom-up attention and saliency. Overall, our findings are consistent with the notion that statistically learned attentional enhancement increases the perceptual salience of items appearing at high-probability locations relative to low-probability locations.
Collapse
Affiliation(s)
- Dock H Duncan
- Vrije Universiteit Amsterdam, The Netherlands
- Institute Brain and Behavior Amsterdam (iBBA), The Netherlands
| | - Jan Theeuwes
- Vrije Universiteit Amsterdam, The Netherlands
- Institute Brain and Behavior Amsterdam (iBBA), The Netherlands
- ISPA-Instituto Universitario, Lisbon, Portugal
| | - Dirk van Moorselaar
- Vrije Universiteit Amsterdam, The Netherlands
- Institute Brain and Behavior Amsterdam (iBBA), The Netherlands
| |
Collapse
|
228
|
Colas T, Farrugia N, Hendrickx E, Paquier M. Sound externalization in dynamic binaural listening: A comparative behavioral and EEG study. Hear Res 2023; 440:108912. [PMID: 37952369 DOI: 10.1016/j.heares.2023.108912] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Revised: 10/23/2023] [Accepted: 11/02/2023] [Indexed: 11/14/2023]
Abstract
Binaural reproduction aims at recreating a realistic sound scene at the ears of the listener using headphones. Unfortunately, externalization for frontal and rear sources is often poor (virtual sources are perceived inside the head, instead of outside the head). Nevertheless, previous studies have shown that large head-tracked movements could substantially improve externalization and that this improvement persisted once the subject had stopped moving his/her head. The present study investigates the relation between externalization and evoked response potentials (ERPs) by performing behavioral and EEG measurements in the same experimental conditions. Different degrees of externalization were achieved by preceding measurements with 1) head-tracked movements, 2) untracked head movements, and 3) no head movement. Results showed that performing a head movement, whether the head tracking was active or not, increased the amplitude of ERP components after 100 ms, which suggests that preceding head movements alters the auditory processing. Moreover, untracked head movements gave a stronger amplitude on the N1 component, which might be a marker of a consistency break in regards to the real world. While externalization scores were higher after head-tracked movements in the behavioral experiment, no marker of externalization could be found in the EEG results.
Collapse
Affiliation(s)
- Tom Colas
- University of Brest, CNRS Lab-STICC UMR 6285, 6 avenue Victor Le Gorgeu, CS 93837, 29238 Brest Cedex 3, France.
| | - Nicolas Farrugia
- IMT Atlantique, CNRS Lab-STICC UMR 6285, 655 avenue du Technopole, 29280 Plouzane, France
| | - Etienne Hendrickx
- University of Brest, CNRS Lab-STICC UMR 6285, 6 avenue Victor Le Gorgeu, CS 93837, 29238 Brest Cedex 3, France
| | - Mathieu Paquier
- University of Brest, CNRS Lab-STICC UMR 6285, 6 avenue Victor Le Gorgeu, CS 93837, 29238 Brest Cedex 3, France
| |
Collapse
|
229
|
Brodbeck C, Das P, Gillis M, Kulasingham JP, Bhattasali S, Gaston P, Resnik P, Simon JZ. Eelbrain, a Python toolkit for time-continuous analysis with temporal response functions. eLife 2023; 12:e85012. [PMID: 38018501 PMCID: PMC10783870 DOI: 10.7554/elife.85012] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Accepted: 11/24/2023] [Indexed: 11/30/2023] Open
Abstract
Even though human experience unfolds continuously in time, it is not strictly linear; instead, it entails cascading processes building hierarchical cognitive structures. For instance, during speech perception, humans transform a continuously varying acoustic signal into phonemes, words, and meaning, and these levels all have distinct but interdependent temporal structures. Time-lagged regression using temporal response functions (TRFs) has recently emerged as a promising tool for disentangling electrophysiological brain responses related to such complex models of perception. Here, we introduce the Eelbrain Python toolkit, which makes this kind of analysis easy and accessible. We demonstrate its use, using continuous speech as a sample paradigm, with a freely available EEG dataset of audiobook listening. A companion GitHub repository provides the complete source code for the analysis, from raw data to group-level statistics. More generally, we advocate a hypothesis-driven approach in which the experimenter specifies a hierarchy of time-continuous representations that are hypothesized to have contributed to brain responses, and uses those as predictor variables for the electrophysiological signal. This is analogous to a multiple regression problem, but with the addition of a time dimension. TRF analysis decomposes the brain signal into distinct responses associated with the different predictor variables by estimating a multivariate TRF (mTRF), quantifying the influence of each predictor on brain responses as a function of time(-lags). This allows asking two questions about the predictor variables: (1) Is there a significant neural representation corresponding to this predictor variable? And if so, (2) what are the temporal characteristics of the neural response associated with it? Thus, different predictor variables can be systematically combined and evaluated to jointly model neural processing at multiple hierarchical levels. We discuss applications of this approach, including the potential for linking algorithmic/representational theories at different cognitive levels to brain responses through computational models with appropriate linking hypotheses.
Collapse
Affiliation(s)
| | - Proloy Das
- Stanford UniversityStanfordUnited States
| | | | | | | | | | - Philip Resnik
- University of Maryland, College ParkCollege ParkUnited States
| | | |
Collapse
|
230
|
Solomon EA, Wang JB, Oya H, Howard MA, Trapp NT, Uitermarkt BD, Boes AD, Keller CJ. TMS provokes target-dependent intracranial rhythms across human cortical and subcortical sites. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.08.09.552524. [PMID: 37645954 PMCID: PMC10461914 DOI: 10.1101/2023.08.09.552524] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Abstract
Transcranial magnetic stimulation (TMS) is increasingly deployed in the treatment of neuropsychiatric illness, under the presumption that stimulation of specific cortical targets can alter ongoing neural activity and cause circuit-level changes in brain function. While the electrophysiological effects of TMS have been extensively studied with scalp electroencephalography (EEG), this approach is most useful for evaluating low-frequency neural activity at the cortical surface. As such, little is known about how TMS perturbs rhythmic activity among deeper structures - such as the hippocampus and amygdala - and whether stimulation can alter higher-frequency oscillations. Recent work has established that TMS can be safely used in patients with intracranial electrodes (iEEG), allowing for direct neural recordings at sufficient spatiotemporal resolution to examine localized oscillatory responses across the frequency spectrum. To that end, we recruited 17 neurosurgical patients with indwelling electrodes and recorded neural activity while patients underwent repeated trials of single-pulse TMS at several cortical sites. Stimulation to the dorsolateral prefrontal cortex (DLPFC) drove widespread low-frequency increases (3-8Hz) in frontolimbic cortices, as well as high-frequency decreases (30-110Hz) in frontotemporal areas, including the hippocampus. Stimulation to parietal cortex specifically provoked low-frequency responses in the medial temporal lobe. While most low-frequency activity was consistent with brief evoked responses, anterior frontal regions exhibited induced theta oscillations following DLPFC stimulation. Taken together, we established that non-invasive stimulation can (1) provoke a mixture of low-frequency evoked power and induced theta oscillations and (2) suppress high-frequency activity in deeper brain structures not directly accessed by stimulation itself.
Collapse
Affiliation(s)
- Ethan A. Solomon
- Dept. of Psychiatry and Behavioral Sciences, Stanford University Medical Center, Palo Alto CA 94305
| | - Jeffrey B. Wang
- Dept. of Psychiatry and Behavioral Sciences, Stanford University Medical Center, Palo Alto CA 94305
- Biophysics Graduate Program, Stanford University Medical Center, Stanford, CA 94305
| | - Hiroyuki Oya
- Department of Neurosurgery, Carver College of Medicine, University of Iowa, Iowa City, IA, 52242
| | - Matthew A. Howard
- Department of Neurosurgery, Carver College of Medicine, University of Iowa, Iowa City, IA, 52242
| | - Nicholas T. Trapp
- Department of Neurology, Carver College of Medicine, University of Iowa, Iowa City, IA, 52242
- Department of Psychiatry, Carver College of Medicine, University of Iowa, Iowa City, IA, 52242
| | - Brandt D. Uitermarkt
- Department of Pediatrics, Carver College of Medicine, University of Iowa, Iowa City, IA, 52242
| | - Aaron D. Boes
- Department of Neurology, Carver College of Medicine, University of Iowa, Iowa City, IA, 52242
- Department of Psychiatry, Carver College of Medicine, University of Iowa, Iowa City, IA, 52242
- Department of Pediatrics, Carver College of Medicine, University of Iowa, Iowa City, IA, 52242
| | - Corey J. Keller
- Dept. of Psychiatry and Behavioral Sciences, Stanford University Medical Center, Palo Alto CA 94305
- Veterans Affairs Palo Alto Healthcare System, and the Sierra Pacific Mental Illness, Research, Education, and Clinical Center (MIRECC), Palo Alto, CA, 94305
| |
Collapse
|
231
|
Veillette JP, Lopes P, Nusbaum HC. Temporal Dynamics of Brain Activity Predicting Sense of Agency over Muscle Movements. J Neurosci 2023; 43:7842-7852. [PMID: 37722848 PMCID: PMC10648515 DOI: 10.1523/jneurosci.1116-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/16/2023] [Revised: 08/07/2023] [Accepted: 09/04/2023] [Indexed: 09/20/2023] Open
Abstract
Our muscles are the primary means through which we affect the external world, and the sense of agency (SoA) over the action through those muscles is fundamental to our self-awareness. However, SoA research to date has focused almost exclusively on agency over action outcomes rather than over the musculature itself, as it was believed that SoA over the musculature could not be manipulated directly. Drawing on methods from human-computer interaction and adaptive experimentation, we use human-in-the-loop Bayesian optimization to tune the timing of electrical muscle stimulation so as to robustly elicit a SoA over electrically actuated muscle movements in male and female human subjects. We use time-resolved decoding of subjects' EEG to estimate the time course of neural activity which predicts reported agency on a trial-by-trial basis. Like paradigms which assess SoA over action consequences, we found that the late (post-conscious) neural activity predicts SoA. Unlike typical paradigms, however, we also find patterns of early (sensorimotor) activity with distinct temporal dynamics predicts agency over muscle movements, suggesting that the "neural correlates of agency" may depend on the level of abstraction (i.e., direct sensorimotor feedback versus downstream consequences) most relevant to a given agency judgment. Moreover, fractal analysis of the EEG suggests that SoA-contingent dynamics of neural activity may modulate the sensitivity of the motor system to external input.SIGNIFICANCE STATEMENT The sense of agency, the feeling of "I did that," when directing one's own musculature is a core feature of human experience. We show that we can robustly manipulate the sense of agency over electrically actuated muscle movements, and we investigate the time course of neural activity that predicts the sense of agency over these actuated movements. We find evidence of two distinct neural processes: a transient sequence of patterns that begins in the early sensorineural response to muscle stimulation and a later, sustained signature of agency. These results shed light on the neural mechanisms by which we experience our movements as volitional.
Collapse
Affiliation(s)
- John P Veillette
- Department of Psychology, University of Chicago, Chicago, Illinois 60637
| | - Pedro Lopes
- Department of Computer Science, University of Chicago, Chicago, Illinois 60637
| | - Howard C Nusbaum
- Department of Psychology, University of Chicago, Chicago, Illinois 60637
| |
Collapse
|
232
|
Lingelbach K, Gado S, Wirzberger M, Vukelić M. Workload-dependent hemispheric asymmetries during the emotion-cognition interaction: a close-to-naturalistic fNIRS study. FRONTIERS IN NEUROERGONOMICS 2023; 4:1273810. [PMID: 38234490 PMCID: PMC10790862 DOI: 10.3389/fnrgo.2023.1273810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 08/07/2023] [Accepted: 10/23/2023] [Indexed: 01/19/2024]
Abstract
Introduction We investigated brain activation patterns of interacting emotional distractions and cognitive processes in a close-to-naturalistic functional near-infrared spectroscopy (fNIRS) study. Methods Eighteen participants engaged in a monitoring-control task, mimicking common air traffic controller requirements. The scenario entailed experiencing both low and high workload, while concurrently being exposed to emotional speech distractions of positive, negative, and neutral valence. Results Our investigation identified hemispheric asymmetries in prefrontal cortex (PFC) activity during the presentation of negative and positive emotional speech distractions at different workload levels. Thereby, in particular, activation in the left inferior frontal gyrus (IFG) and orbitofrontal cortex (OFC) seems to play a crucial role. Brain activation patterns revealed a cross-over interaction indicating workload-dependent left hemispheric inhibition processes during negative distractions and high workload. For positive emotional distractions under low workload, we observed left-hemispheric PFC recruitment potentially associated with speech-related processes. Furthermore, we found a workload-independent negativity bias for neutral distractions, showing brain activation patterns similar to those of negative distractions. Discussion In conclusion, lateralized hemispheric processing, regulating emotional speech distractions and integrating emotional and cognitive processes, is influenced by workload levels and stimulus characteristics. These findings advance our understanding of the factors modulating hemispheric asymmetries during the processing and inhibition of emotional distractions, as well as the interplay between emotion and cognition. Moreover, they emphasize the significance of exploring emotion-cognition interactions in more naturalistic settings to gain a deeper understanding of their implications in real-world application scenarios (e.g., working and learning environments).
Collapse
Affiliation(s)
- Katharina Lingelbach
- Applied Neurocognitive Systems, Fraunhofer Institute for Industrial Engineering IAO, Stuttgart, Germany
- Applied Neurocognitive Psychology, Carl von Ossietzky University, Oldenburg, Germany
| | - Sabrina Gado
- Experimental Clinical Psychology, Department of Psychology, University of Würzburg, Würzburg, Germany
| | - Maria Wirzberger
- Department of Teaching and Learning with Intelligent Systems, University of Stuttgart, Stuttgart, Germany
- LEAD Graduate School and Research Network, University of Tübingen, Tübingen, Germany
| | - Mathias Vukelić
- Applied Neurocognitive Systems, Fraunhofer Institute for Industrial Engineering IAO, Stuttgart, Germany
| |
Collapse
|
233
|
Kummar AS, Correia H, Tan J, Fujiyama H. An 8-week compassion and mindfulness-based exposure therapy program improves posttraumatic stress symptoms. Clin Psychol Psychother 2023. [PMID: 37947043 DOI: 10.1002/cpp.2929] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Revised: 10/09/2023] [Accepted: 10/15/2023] [Indexed: 11/12/2023]
Abstract
The persistence of posttraumatic stress symptoms (PTSS) can be debilitating. However, many people experiencing such symptoms may not qualify for or may not seek treatment. Potentially contributing to ongoing residual symptoms of PTSS is emotion dysregulation. Meanwhile, the research area of mindfulness and compassion has grown to imply emotion regulation as one of its underlying mechanisms; yet, its influence on emotion regulation in PTSS cohort is unknown. Here, we explored the potential effectiveness of an 8-week Compassion-oriented and Mindfulness-based Exposure Therapy (CoMET) for individuals with PTSS using a waitlist control design. A total of 28 individuals (27 females, age range = 18-39 years) participated in the study (17 CoMET; 11 waitlist control). Following CoMET, participants reported significant decreases in PTSS severity (from clinical to non-clinical levels), emotion dysregulation and experiential avoidance, as well as significant increases in mindfulness, self-compassion and quality of life. Electroencephalogram-based brain network connectivity analysis revealed an increase in alpha-band connectivity following CoMET in a network that includes the amygdala, suggesting that CoMET successfully induced changes in functional connectivity between brain regions that play a crucial role in emotion regulation. In sum, the current study demonstrated promising intervention outcomes of CoMET in effectively alleviating the symptoms of PTSS via enhanced emotion regulation.
Collapse
Affiliation(s)
- Auretta Sonia Kummar
- School of Psychology, College of Health & Education, Murdoch University, Perth, Western Australia, Australia
| | - Helen Correia
- School of Psychology, College of Health & Education, Murdoch University, Perth, Western Australia, Australia
- Psychological Sciences, Australian College of Applied Professions, Perth, Western Australia, Australia
| | - Jane Tan
- School of Psychology, College of Health & Education, Murdoch University, Perth, Western Australia, Australia
| | - Hakuei Fujiyama
- School of Psychology, College of Health & Education, Murdoch University, Perth, Western Australia, Australia
- Centre for Healthy Ageing, Health Futures Institute, Murdoch University, Perth, Western Australia, Australia
- Centre for Molecular Medicine and Innovative Therapeutics, Murdoch University, Perth, Western Australia, Australia
| |
Collapse
|
234
|
Pesonen H, Strömmer J, Li X, Parkkari J, Tarkka IM, Astikainen P. Magnetoencephalography reveals impaired sensory gating and change detection in older adults in the somatosensory system. Neuropsychologia 2023; 190:108702. [PMID: 37838067 DOI: 10.1016/j.neuropsychologia.2023.108702] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Revised: 08/31/2023] [Accepted: 10/10/2023] [Indexed: 10/16/2023]
Abstract
Brain electrophysiological responses can provide information about age-related decline in sensory-cognitive functions with high temporal accuracy. Studies have revealed impairments in early sensory gating and pre-attentive change detection mechanisms in older adults, but no magnetoencephalographic (MEG) studies have been undertaken into both non-attentive and attentive somatosensory functions and their relationship to ageing. Magnetoencephalography was utilized to record cortical somatosensory brain responses in young (20-28 yrs), middle-aged (46-56 yrs), and older adults (64-78 yrs) under active and passive somatosensory oddball conditions. A repeated standard stimulus was occasionally replaced by a deviant stimulus (p = .1), which was an electrical pulse on a different finger. We examined the amplitudes of M50 and M100 responses reflecting sensory gating, and later components reflecting change detection and attention shifting (M190 and M250 for the passive condition, and M200 and M350 for the active condition, respectively). Spatiotemporal cluster-based permutation tests revealed that older adults had significantly larger M100 component amplitudes than young adults for task-irrelevant stimuli in both passive and active condition. Older adults also showed a reduced M250 component and an altered M350 in response to deviant stimuli. The responses of middle-aged adults did not differ from those of younger adults, but this study should be repeated with a larger sample size. By demonstrating changes in both somatosensory gating and attentional shifting mechanisms, our findings extend previous research on the effects of ageing on pre-attentive and attentive brain functions.
Collapse
Affiliation(s)
- Heidi Pesonen
- Faculty of Sport and Health Sciences, University of Jyväskylä, Jyväskylä, Finland.
| | - Juho Strömmer
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
| | - Xueqiao Li
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
| | - Jari Parkkari
- Faculty of Sport and Health Sciences, University of Jyväskylä, Jyväskylä, Finland
| | - Ina M Tarkka
- Faculty of Sport and Health Sciences, University of Jyväskylä, Jyväskylä, Finland
| | - Piia Astikainen
- Centre for Interdisciplinary Brain Research, Department of Psychology, University of Jyväskylä, Jyväskylä, Finland
| |
Collapse
|
235
|
Sawalma AS, Kiefer CM, Boers F, Shah NJ, Khudeish N, Neuner I, Herzallah MM, Dammers J. The effects of trauma on feedback processing: an MEG study. Front Neurosci 2023; 17:1172549. [PMID: 38027493 PMCID: PMC10651751 DOI: 10.3389/fnins.2023.1172549] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2023] [Accepted: 10/17/2023] [Indexed: 12/01/2023] Open
Abstract
The cognitive impact of psychological trauma can manifest as a range of post-traumatic stress symptoms that are often attributed to impairments in learning from positive and negative outcomes, aka reinforcement learning. Research on the impact of trauma on reinforcement learning has mainly been inconclusive. This study aimed to circumscribe the impact of psychological trauma on reinforcement learning in the context of neural response in time and frequency domains. Two groups of participants were tested - those who had experienced psychological trauma and a control group who had not - while they performed a probabilistic classification task that dissociates learning from positive and negative feedback during a magnetoencephalography (MEG) examination. While the exposure to trauma did not exhibit any effects on learning accuracy or response time for positive or negative feedback, MEG cortical activity was modulated in response to positive feedback. In particular, the medial and lateral orbitofrontal cortices (mOFC and lOFC) exhibited increased activity, while the insular and supramarginal cortices showed decreased activity during positive feedback presentation. Furthermore, when receiving negative feedback, the trauma group displayed higher activity in the medial portion of the superior frontal cortex. The timing of these activity changes occurred between 160 and 600 ms post feedback presentation. Analysis of the time-frequency domain revealed heightened activity in theta and alpha frequency bands (4-10 Hz) in the lOFC in the trauma group. Moreover, dividing the two groups according to their learning performance, the activity for the non-learner subgroup was found to be lower in lOFC and higher in the supramarginal cortex. These differences were found in the trauma group only. The results highlight the localization and neural dynamics of feedback processing that could be affected by exposure to psychological trauma. This approach and associated findings provide a novel framework for understanding the cognitive correlates of psychological trauma in relation to neural dynamics in the space, time, and frequency domains. Subsequent work will focus on the stratification of cognitive and neural correlates as a function of various symptoms of psychological trauma. Clinically, the study findings and approach open the possibility for neuromodulation interventions that synchronize cognitive and psychological constructs for individualized treatment.
Collapse
Affiliation(s)
- Abdulrahman S. Sawalma
- Institute of Neuroscience and Medicine (INM-4), Forschungszentrum Jülich GmbH, Jülich, Germany
- Faculty of Medicine, RWTH Aachen University, Aachen, Germany
- Palestinian Neuroscience Initiative, Al-Quds University, Abu Dis, Palestine
| | - Christian M. Kiefer
- Institute of Neuroscience and Medicine (INM-4), Forschungszentrum Jülich GmbH, Jülich, Germany
- Faculty of Mathematics, Computer Science and Natural Sciences, RWTH Aachen University, Aachen, Germany
| | - Frank Boers
- Institute of Neuroscience and Medicine (INM-4), Forschungszentrum Jülich GmbH, Jülich, Germany
| | - N. Jon Shah
- Institute of Neuroscience and Medicine (INM-4), Forschungszentrum Jülich GmbH, Jülich, Germany
- Institute of Neuroscience and Medicine (INM-11), Jülich Aachen Research Alliance (JARA), Forschungszentrum Jülich GmbH, Jülich, Germany
- Jülich Aachen Research Alliance (JARA)-Brain – Translational Medicine, Aachen, Germany
- Department of Neurology, University Hospital RWTH Aachen, Aachen, Germany
| | - Nibal Khudeish
- Institute of Neuroscience and Medicine (INM-4), Forschungszentrum Jülich GmbH, Jülich, Germany
- Faculty of Medicine, RWTH Aachen University, Aachen, Germany
| | - Irene Neuner
- Institute of Neuroscience and Medicine (INM-4), Forschungszentrum Jülich GmbH, Jülich, Germany
- Jülich Aachen Research Alliance (JARA)-Brain – Translational Medicine, Aachen, Germany
- Department of Psychiatry, Psychotherapy and Psychosomatics, RWTH Aachen University, Aachen, Germany
| | - Mohammad M. Herzallah
- Palestinian Neuroscience Initiative, Al-Quds University, Abu Dis, Palestine
- Center for Molecular and Behavioral Neuroscience, Rutgers University, Newark, NJ, United States
| | - Jürgen Dammers
- Institute of Neuroscience and Medicine (INM-4), Forschungszentrum Jülich GmbH, Jülich, Germany
- Faculty of Medicine, RWTH Aachen University, Aachen, Germany
| |
Collapse
|
236
|
Vallarino E, Hincapié AS, Jerbi K, Leahy RM, Pascarella A, Sorrentino A, Sommariva S. Tuning Minimum-Norm regularization parameters for optimal MEG connectivity estimation. Neuroimage 2023; 281:120356. [PMID: 37703939 DOI: 10.1016/j.neuroimage.2023.120356] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/15/2023] [Revised: 08/25/2023] [Accepted: 08/30/2023] [Indexed: 09/15/2023] Open
Abstract
The accurate characterization of cortical functional connectivity from Magnetoencephalography (MEG) data remains a challenging problem due to the subjective nature of the analysis, which requires several decisions at each step of the analysis pipeline, such as the choice of a source estimation algorithm, a connectivity metric and a cortical parcellation, to name but a few. Recent studies have emphasized the importance of selecting the regularization parameter in minimum norm estimates with caution, as variations in its value can result in significant differences in connectivity estimates. In particular, the amount of regularization that is optimal for MEG source estimation can actually be suboptimal for coherence-based MEG connectivity analysis. In this study, we expand upon previous work by examining a broader range of commonly used connectivity metrics, including the imaginary part of coherence, corrected imaginary part of Phase Locking Value, and weighted Phase Lag Index, within a larger and more realistic simulation scenario. Our results show that the best estimate of connectivity is achieved using a regularization parameter that is 1 or 2 orders of magnitude smaller than the one that yields the best source estimation. This remarkable difference may imply that previous work assessing source-space connectivity using minimum-norm may have benefited from using less regularization, as this may have helped reduce false positives. Importantly, we provide the code for MEG data simulation and analysis, offering the research community a valuable open source tool for informed selections of the regularization parameter when using minimum-norm for source space connectivity analyses.
Collapse
Affiliation(s)
| | - Ana Sofia Hincapié
- Computational and Cognitive Neuroscience Lab, Psychology Department, Université de Montréal, Montréal, Québec, Canada
| | - Karim Jerbi
- Computational and Cognitive Neuroscience Lab, Psychology Department, Université de Montréal, Montréal, Québec, Canada; MEG Center, Psychology Department, Université de Montréal, Montréal, Québec, Canada; MILA (Quebec Artificial Intelligence Institute), Montréal, Québec, Canada; Unique Center (Québec Neuro-AI Research Center), Montréal, Québec, Canada
| | - Richard M Leahy
- Ming Hsieh Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, CA, USA
| | - Annalisa Pascarella
- Istituto per le Applicazioni del Calcolo, Consiglio Nazionale delle Ricerche, Roma, Italy
| | | | - Sara Sommariva
- Dipartimento di Matematica, Università di Genova, Genova, Italy
| |
Collapse
|
237
|
Schüller A, Schilling A, Krauss P, Rampp S, Reichenbach T. Attentional Modulation of the Cortical Contribution to the Frequency-Following Response Evoked by Continuous Speech. J Neurosci 2023; 43:7429-7440. [PMID: 37793908 PMCID: PMC10621774 DOI: 10.1523/jneurosci.1247-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/06/2023] [Revised: 09/07/2023] [Accepted: 09/21/2023] [Indexed: 10/06/2023] Open
Abstract
Selective attention to one of several competing speakers is required for comprehending a target speaker among other voices and for successful communication with them. It moreover has been found to involve the neural tracking of low-frequency speech rhythms in the auditory cortex. Effects of selective attention have also been found in subcortical neural activities, in particular regarding the frequency-following response related to the fundamental frequency of speech (speech-FFR). Recent investigations have, however, shown that the speech-FFR contains cortical contributions as well. It remains unclear whether these are also modulated by selective attention. Here we used magnetoencephalography to assess the attentional modulation of the cortical contributions to the speech-FFR. We presented both male and female participants with two competing speech signals and analyzed the cortical responses during attentional switching between the two speakers. Our findings revealed robust attentional modulation of the cortical contribution to the speech-FFR: the neural responses were higher when the speaker was attended than when they were ignored. We also found that, regardless of attention, a voice with a lower fundamental frequency elicited a larger cortical contribution to the speech-FFR than a voice with a higher fundamental frequency. Our results show that the attentional modulation of the speech-FFR does not only occur subcortically but extends to the auditory cortex as well.SIGNIFICANCE STATEMENT Understanding speech in noise requires attention to a target speaker. One of the speech features that a listener can use to identify a target voice among others and attend it is the fundamental frequency, together with its higher harmonics. The fundamental frequency arises from the opening and closing of the vocal folds and is tracked by high-frequency neural activity in the auditory brainstem and in the cortex. Previous investigations showed that the subcortical neural tracking is modulated by selective attention. Here we show that attention affects the cortical tracking of the fundamental frequency as well: it is stronger when a particular voice is attended than when it is ignored.
Collapse
Affiliation(s)
- Alina Schüller
- Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-University Erlangen-Nürnberg, 91054 Erlangen, Germany
| | - Achim Schilling
- Neuroscience Laboratory, University Hospital Erlangen, 91058 Erlangen, Germany
| | - Patrick Krauss
- Neuroscience Laboratory, University Hospital Erlangen, 91058 Erlangen, Germany
- Pattern Recognition Lab, Department Computer Science, Friedrich-Alexander-University Erlangen-Nürnberg, 91054 Erlangen, Germany
| | - Stefan Rampp
- Department of Neurosurgery, University Hospital Erlangen, 91058 Erlangen, Germany
- Department of Neurosurgery, University Hospital Halle (Saale), 06120 Halle (Saale), Germany
- Department of Neuroradiology, University Hospital Erlangen, 91058 Erlangen, Germany
| | - Tobias Reichenbach
- Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-University Erlangen-Nürnberg, 91054 Erlangen, Germany
| |
Collapse
|
238
|
Sunaga M, Takei Y, Kato Y, Tagawa M, Suto T, Hironaga N, Sakurai N, Fukuda M. The Characteristics of Power Spectral Density in Bipolar Disorder at the Resting State. Clin EEG Neurosci 2023; 54:574-583. [PMID: 34677105 DOI: 10.1177/15500594211050487] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
Bipolar disorder (BD) is a common psychiatric disorder, but its pathophysiology is not fully elucidated. The current study focused on its electrophysiological characteristics, especially power spectral density (PSD). Resting state with eyes opened magnetoencephalography data were collected from 21 patients with BD and 22 healthy controls. The whole brain's PSD was calculated from source reconstructed waveforms at each frequency band (delta: 1-3 Hz, theta: 4-7 Hz, alpha: 8-12 Hz, low beta: 13-19 Hz, high beta: 20-29 Hz, and gamma: 30-80 Hz). We compared PSD values on the marked vertices at each frequency band between healthy and patient groups using a Mann-Whitney rank test to examine the relationship between significantly different PSD and clinical measures. The PSD in patients with BD was significantly decreased in lower frequency bands, mainly in the default mode network (DMN) areas (bilateral medial prefrontal cortex, bilateral precuneus, left inferior parietal lobe, and right temporal cortex in the alpha band) and salience network areas (SAL; left anterior insula [AI] at the delta band, anterior cingulate cortex at the theta band, and right AI at the alpha band). No significant differences in PSD were observed at low beta and high beta. PSD was not correlated with age or other clinical scales. Altered PSDs of the DMN and SAL were observed in the delta, theta, and alpha bands. These alterations contribute to the vulnerability of BD through the disturbance of self-referential mental activity and switching between the default mode and frontoparietal networks.
Collapse
Affiliation(s)
- Masakazu Sunaga
- Gunma Prefectural Psychiatric Medical Center, Isesaki, Japan
| | - Yuichi Takei
- Gunma University Graduate School of Medicine, Maebashi, Japan
| | - Yutaka Kato
- Gunma University Graduate School of Medicine, Maebashi, Japan
- Tsutsuji Mental Hospital, Tatebayashi, Japan
| | - Minami Tagawa
- Gunma Prefectural Psychiatric Medical Center, Isesaki, Japan
- Gunma University Graduate School of Medicine, Maebashi, Japan
| | - Tomohiro Suto
- Gunma Prefectural Psychiatric Medical Center, Isesaki, Japan
| | | | - Noriko Sakurai
- Gunma University Graduate School of Medicine, Maebashi, Japan
| | - Masato Fukuda
- Gunma University Graduate School of Medicine, Maebashi, Japan
| |
Collapse
|
239
|
Brkić D, Sommariva S, Schuler AL, Pascarella A, Belardinelli P, Isabella SL, Pino GD, Zago S, Ferrazzi G, Rasero J, Arcara G, Marinazzo D, Pellegrino G. The impact of ROI extraction method for MEG connectivity estimation: practical recommendations for the study of resting state data. Neuroimage 2023; 284:120424. [PMID: 39492417 DOI: 10.1016/j.neuroimage.2023.120424] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/28/2023] [Revised: 09/18/2023] [Accepted: 10/23/2023] [Indexed: 11/05/2024] Open
Abstract
Magnetoencephalography and electroencephalography (M/EEG) seed-based connectivity analysis requires the extraction of measures from regions of interest (ROI). M/EEG ROI-derived source activity can be treated in different ways. It is possible, for instance, to average each ROI's time series prior to calculating connectivity measures. Alternatively, one can compute connectivity maps for each element of the ROI prior to dimensionality reduction to obtain a single map. The impact of these different strategies on connectivity results is still unclear. Here, we address this question within a large MEG resting state cohort (N=113) and within simulated data. We consider 68 ROIs (Desikan-Kiliany atlas), two measures of connectivity (phase locking value-PLV, and its imaginary counterpart- ciPLV), and three frequency bands (theta 4-8 Hz, alpha 9-12 Hz, beta 15-30 Hz). We compare four extraction methods: (i) mean, or (ii) PCA of the activity within the seed or ROI before computing connectivity, map of the (iii) average, or (iv) maximum connectivity after computing connectivity for each element of the seed. Hierarchical clustering is then applied to compare connectivity outputs across multiple strategies, followed by direct contrasts across extraction methods. Finally, the results are validated by using a set of realistic simulations. We show that ROI-based connectivity maps vary remarkably across strategies in terms of connectivity magnitude and spatial distribution. Dimensionality reduction procedures conducted after computing connectivity are more similar to each-other, while PCA before approach is the most dissimilar to other approaches. Although differences across methods are consistent across frequency bands, they are influenced by the connectivity metric and ROI size. Greater differences were observed for ciPLV than PLV, and in larger ROIs. Realistic simulations confirmed that after aggregation procedures are generally more accurate but have lower specificity (higher rate of false positive connections). Though computationally demanding, after dimensionality reduction strategies should be preferred when higher sensitivity is desired. Given the remarkable differences across aggregation procedures, caution is warranted in comparing results across studies applying different methods.
Collapse
Affiliation(s)
| | - Sara Sommariva
- Dipartimento di Matematica, Università di Genova, Genova, Italy
| | - Anna-Lisa Schuler
- Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - Annalisa Pascarella
- Istituto per le Applicazioni del Calcolo "M. Picone", National Research Council, Rome, Italy
| | | | - Silvia L Isabella
- IRCCS San Camillo, Venice, Italy; Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico di Roma, Rome, Italy
| | - Giovanni Di Pino
- Research Unit of Neurophysiology and Neuroengineering of Human-Technology Interaction (NeXTlab), Università Campus Bio-Medico di Roma, Rome, Italy
| | | | | | - Javier Rasero
- CoAx Lab, Carnegie Mellon University, Pittsburgh, USA; School of Data Science, University of Virginia, Charlottesville, USA.
| | | | - Daniele Marinazzo
- Faculty of Psychology and Educational Sciences, Department of Data Analysis, University of Ghent, Ghent, Belgium
| | - Giovanni Pellegrino
- Department of Clinical Neurological Sciences, Western University, London, Ontario, Canada
| |
Collapse
|
240
|
van Bijnen S, Muotka J, Parviainen T. Divergent auditory activation in relation to inhibition task performance in children and adults. Hum Brain Mapp 2023; 44:4972-4985. [PMID: 37493309 PMCID: PMC10502686 DOI: 10.1002/hbm.26418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Revised: 06/16/2023] [Accepted: 06/26/2023] [Indexed: 07/27/2023] Open
Abstract
Adults and children show remarkable differences in cortical auditory activation which, in children, have shown relevance for cognitive performance, specifically inhibitory control. However, it has not been tested whether these differences translate to functional differences in response inhibition between adults and children. We recorded auditory responses of adults and school-aged children (6-14 years) using combined magneto- and electroencephalography (M/EEG) during passive listening conditions and an auditory Go/No-go task. The associations between auditory cortical responses and inhibition performance measures diverge between adults and children; while in children the brain-behavior associations are not significant, or stronger responses are beneficial, adults show negative associations between auditory cortical responses and inhibitory performance. Furthermore, we found differences in brain responses between adults and children; the late (~200 ms post stimulation) adult peak activation shifts from auditory to frontomedial areas. In contrast, children show prolonged obligatory responses in the auditory cortex. Together this likely translates to a functional difference between adults and children in the cortical resources for performance consistency in auditory-based cognitive tasks.
Collapse
Affiliation(s)
- Sam van Bijnen
- Centre for Interdisciplinary Brain Research, Department of PsychologyUniversity of JyväskyläJyväskyläFinland
- Faculty of Social and Behavioural ScienceUtrecht UniversityThe Netherlands
| | - Joona Muotka
- Centre for Interdisciplinary Brain Research, Department of PsychologyUniversity of JyväskyläJyväskyläFinland
| | - Tiina Parviainen
- Centre for Interdisciplinary Brain Research, Department of PsychologyUniversity of JyväskyläJyväskyläFinland
| |
Collapse
|
241
|
Karunathilake ID, Kulasingham JP, Simon JZ. Neural Tracking Measures of Speech Intelligibility: Manipulating Intelligibility while Keeping Acoustics Unchanged. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.05.18.541269. [PMID: 37292644 PMCID: PMC10245672 DOI: 10.1101/2023.05.18.541269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
Neural speech tracking has advanced our understanding of how our brains rapidly map an acoustic speech signal onto linguistic representations and ultimately meaning. It remains unclear, however, how speech intelligibility is related to the corresponding neural responses. Many studies addressing this question vary the level of intelligibility by manipulating the acoustic waveform, but this makes it difficult to cleanly disentangle effects of intelligibility from underlying acoustical confounds. Here, using magnetoencephalography (MEG) recordings, we study neural measures of speech intelligibility by manipulating intelligibility while keeping the acoustics strictly unchanged. Acoustically identical degraded speech stimuli (three-band noise vocoded, ~20 s duration) are presented twice, but the second presentation is preceded by the original (non-degraded) version of the speech. This intermediate priming, which generates a 'pop-out' percept, substantially improves the intelligibility of the second degraded speech passage. We investigate how intelligibility and acoustical structure affects acoustic and linguistic neural representations using multivariate Temporal Response Functions (mTRFs). As expected, behavioral results confirm that perceived speech clarity is improved by priming. TRF analysis reveals that auditory (speech envelope and envelope onset) neural representations are not affected by priming, but only by the acoustics of the stimuli (bottom-up driven). Critically, our findings suggest that segmentation of sounds into words emerges with better speech intelligibility, and most strongly at the later (~400 ms latency) word processing stage, in prefrontal cortex (PFC), in line with engagement of top-down mechanisms associated with priming. Taken together, our results show that word representations may provide some objective measures of speech comprehension.
Collapse
Affiliation(s)
| | | | - Jonathan Z. Simon
- Department of Electrical and Computer Engineering, University of Maryland, College Park, MD, 20742, USA
- Department of Biology, University of Maryland, College Park, MD 20742, USA
- Institute for Systems Research, University of Maryland, College Park, MD 20742, USA
| |
Collapse
|
242
|
O'Reilly C, Huberty S, van Noordt S, Desjardins J, Wright N, Scorah J, Webb SJ, Elsabbagh M. EEG functional connectivity in infants at elevated familial likelihood for autism spectrum disorder. Mol Autism 2023; 14:37. [PMID: 37805500 PMCID: PMC10559476 DOI: 10.1186/s13229-023-00570-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Accepted: 09/29/2023] [Indexed: 10/09/2023] Open
Abstract
BACKGROUND Many studies have reported that autism spectrum disorder (ASD) is associated with atypical structural and functional connectivity. However, we know relatively little about the development of these differences in infancy. METHODS We used a high-density electroencephalogram (EEG) dataset pooled from two independent infant sibling cohorts, to characterize such neurodevelopmental deviations during the first years of life. EEG was recorded at 6 and 12 months of age in infants at typical (N = 92) or elevated likelihood for ASD (N = 90), determined by the presence of an older sibling with ASD. We computed the functional connectivity between cortical sources of EEG during video watching using the corrected imaginary part of phase-locking values. RESULTS Our main analysis found no significant association between functional connectivity and ASD, showing only significant effects for age, sex, age-sex interaction, and site. Given these null results, we performed an exploratory analysis and observed, at 12 months, a negative correlation between functional connectivity and ADOS calibrated severity scores for restrictive and repetitive behaviors (RRB). LIMITATIONS The small sample of ASD participants inherent to sibling studies limits diagnostic group comparisons. Also, results from our secondary exploratory analysis should be considered only as potential relationships to further explore, given their increased vulnerability to false positives. CONCLUSIONS These results are inconclusive concerning an association between EEG functional connectivity and ASD in infancy. Exploratory analyses provided preliminary support for a relationship between RRB and functional connectivity specifically, but these preliminary observations need corroboration on larger samples.
Collapse
Affiliation(s)
- Christian O'Reilly
- Department of Computer Science and Engineering, University of South Carolina, Columbia, SC, USA.
- Artificial Intelligence Institute of South Carolina, University of South Carolina, 1112 Greene St, Columbia, SC, 29208, USA.
- Carolina Autism and Neurodevelopment Research Center, University of South Carolina, Columbia, SC, USA.
| | - Scott Huberty
- Azrieli Centre for Autism Research, Montreal Neurological Institute-Hospital, McGill University, Montreal, Canada
| | - Stefon van Noordt
- Department of Psychology, Mount Saint Vincent University, Halifax, NS, Canada
| | | | - Nicky Wright
- Department of Psychology, Manchester Metropolitan University, Manchester, UK
| | - Julie Scorah
- Azrieli Centre for Autism Research, Montreal Neurological Institute-Hospital, McGill University, Montreal, Canada
| | | | - Mayada Elsabbagh
- Azrieli Centre for Autism Research, Montreal Neurological Institute-Hospital, McGill University, Montreal, Canada
| |
Collapse
|
243
|
Iivanainen J, Carter TR, Trumbo MCS, McKay J, Taulu S, Wang J, Stephen JM, Schwindt PDD, Borna A. Single-trial classification of evoked responses to auditory tones using OPM- and SQUID-MEG. J Neural Eng 2023; 20:056032. [PMID: 37748476 DOI: 10.1088/1741-2552/acfcd9] [Citation(s) in RCA: 9] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2023] [Accepted: 09/25/2023] [Indexed: 09/27/2023]
Abstract
Objective.Optically pumped magnetometers (OPMs) are emerging as a near-room-temperature alternative to superconducting quantum interference devices (SQUIDs) for magnetoencephalography (MEG). In contrast to SQUIDs, OPMs can be placed in a close proximity to subject's scalp potentially increasing the signal-to-noise ratio and spatial resolution of MEG. However, experimental demonstrations of these suggested benefits are still scarce. Here, to compare a 24-channel OPM-MEG system to a commercial whole-head SQUID system in a data-driven way, we quantified their performance in classifying single-trial evoked responses.Approach.We measured evoked responses to three auditory tones in six participants using both OPM- and SQUID-MEG systems. We performed pairwise temporal classification of the single-trial responses with linear discriminant analysis as well as multiclass classification with both EEGNet convolutional neural network and xDAWN decoding.Main results.OPMs provided higher classification accuracies than SQUIDs having a similar coverage of the left hemisphere of the participant. However, the SQUID sensors covering the whole helmet had classification scores larger than those of OPMs for two of the tone pairs, demonstrating the benefits of a whole-head measurement.Significance.The results demonstrate that the current OPM-MEG system provides high-quality data about the brain with room for improvement for high bandwidth non-invasive brain-computer interfacing.
Collapse
Affiliation(s)
- Joonas Iivanainen
- Sandia National Laboratories, Albuquerque, NM 87185, United States of America
| | - Tony R Carter
- Sandia National Laboratories, Albuquerque, NM 87185, United States of America
| | - Michael C S Trumbo
- Sandia National Laboratories, Albuquerque, NM 87185, United States of America
| | - Jim McKay
- Candoo Systems Inc, Port Coquitlam, BC, Canada
| | - Samu Taulu
- University of Washington, Seattle, WA, United States of America
| | - Jun Wang
- Department of Speech, Language, and Hearing Sciences, The University of Texas at Austin, Austin, TX, United States of America
- Department of Neurology, The University of Texas at Austin, Austin, TX, United States of America
| | - Julia M Stephen
- The Mind Research Network a Division of Lovelace Biomedical Research Institute, Albuquerque, NM 87106, United States of America
| | - Peter D D Schwindt
- Sandia National Laboratories, Albuquerque, NM 87185, United States of America
| | - Amir Borna
- Sandia National Laboratories, Albuquerque, NM 87185, United States of America
| |
Collapse
|
244
|
Carrle FP, Hollenbenders Y, Reichenbach A. Generation of synthetic EEG data for training algorithms supporting the diagnosis of major depressive disorder. Front Neurosci 2023; 17:1219133. [PMID: 37849893 PMCID: PMC10577178 DOI: 10.3389/fnins.2023.1219133] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Accepted: 09/05/2023] [Indexed: 10/19/2023] Open
Abstract
Introduction Major depressive disorder (MDD) is the most common mental disorder worldwide, leading to impairment in quality and independence of life. Electroencephalography (EEG) biomarkers processed with machine learning (ML) algorithms have been explored for objective diagnoses with promising results. However, the generalizability of those models, a prerequisite for clinical application, is restricted by small datasets. One approach to train ML models with good generalizability is complementing the original with synthetic data produced by generative algorithms. Another advantage of synthetic data is the possibility of publishing the data for other researchers without risking patient data privacy. Synthetic EEG time-series have not yet been generated for two clinical populations like MDD patients and healthy controls. Methods We first reviewed 27 studies presenting EEG data augmentation with generative algorithms for classification tasks, like diagnosis, for the possibilities and shortcomings of recent methods. The subsequent empirical study generated EEG time-series based on two public datasets with 30/28 and 24/29 subjects (MDD/controls). To obtain baseline diagnostic accuracies, convolutional neural networks (CNN) were trained with time-series from each dataset. The data were synthesized with generative adversarial networks (GAN) consisting of CNNs. We evaluated the synthetic data qualitatively and quantitatively and finally used it for re-training the diagnostic model. Results The reviewed studies improved their classification accuracies by between 1 and 40% with the synthetic data. Our own diagnostic accuracy improved up to 10% for one dataset but not significantly for the other. We found a rich repertoire of generative models in the reviewed literature, solving various technical issues. A major shortcoming in the field is the lack of meaningful evaluation metrics for synthetic data. The few studies analyzing the data in the frequency domain, including our own, show that only some features can be produced truthfully. Discussion The systematic review combined with our own investigation provides an overview of the available methods for generating EEG data for a classification task, their possibilities, and shortcomings. The approach is promising and the technical basis is set. For a broad application of these techniques in neuroscience research or clinical application, the methods need fine-tuning facilitated by domain expertise in (clinical) EEG research.
Collapse
Affiliation(s)
- Friedrich Philipp Carrle
- Center for Machine Learning, Heilbronn University, Heilbronn, Germany
- Medical Faculty Heidelberg, University of Heidelberg, Heidelberg, Germany
| | - Yasmin Hollenbenders
- Center for Machine Learning, Heilbronn University, Heilbronn, Germany
- Medical Faculty Heidelberg, University of Heidelberg, Heidelberg, Germany
| | - Alexandra Reichenbach
- Center for Machine Learning, Heilbronn University, Heilbronn, Germany
- Medical Faculty Heidelberg, University of Heidelberg, Heidelberg, Germany
| |
Collapse
|
245
|
Kurteff GL, Lester-Smith RA, Martinez A, Currens N, Holder J, Villarreal C, Mercado VR, Truong C, Huber C, Pokharel P, Hamilton LS. Speaker-induced Suppression in EEG during a Naturalistic Reading and Listening Task. J Cogn Neurosci 2023; 35:1538-1556. [PMID: 37584593 DOI: 10.1162/jocn_a_02037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/17/2023]
Abstract
Speaking elicits a suppressed neural response when compared with listening to others' speech, a phenomenon known as speaker-induced suppression (SIS). Previous research has focused on investigating SIS at constrained levels of linguistic representation, such as the individual phoneme and word level. Here, we present scalp EEG data from a dual speech perception and production task where participants read sentences aloud then listened to playback of themselves reading those sentences. Playback was separated into immediate repetition of the previous trial and randomized repetition of a former trial to investigate if forward modeling of responses during passive listening suppresses the neural response. Concurrent EMG was recorded to control for movement artifact during speech production. In line with previous research, ERP analyses at the sentence level demonstrated suppression of early auditory components of the EEG for production compared with perception. To evaluate whether linguistic abstractions (in the form of phonological feature tuning) are suppressed during speech production alongside lower-level acoustic information, we fit linear encoding models that predicted scalp EEG based on phonological features, EMG activity, and task condition. We found that phonological features were encoded similarly between production and perception. However, this similarity was only observed when controlling for movement by using the EMG response as an additional regressor. Our results suggest that SIS operates at a sensory representational level and is dissociated from higher order cognitive and linguistic processing that takes place during speech perception and production. We also detail some important considerations when analyzing EEG during continuous speech production.
Collapse
|
246
|
Wiens S, Andersson A, Gravenfors J. Neural electrophysiological correlates of detection and identification awareness. COGNITIVE, AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2023; 23:1303-1321. [PMID: 37656374 PMCID: PMC10545648 DOI: 10.3758/s13415-023-01120-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 06/28/2023] [Indexed: 09/02/2023]
Abstract
Humans have conscious experiences of the events in their environment. Previous research from electroencephalography (EEG) has shown visual awareness negativity (VAN) at about 200 ms to be a neural correlate of consciousness (NCC). However, when considering VAN as an NCC, it is important to explore which particular experiences are associated with VAN. Recent research proposes that VAN is an NCC of lower-level experiences (detection) rather than higher-level experiences (identification). However, previous results are mixed and have several limitations. In the present study, the stimulus was a ring with a Gabor patch tilting either left or right. On each trial, subjects rated their awareness on a three-level perceptual awareness scale that captured both detection (something vs. nothing) and identification (identification vs. something). Separate staircases were used to adjust stimulus opacity to the detection threshold and the identification threshold. Bayesian linear mixed models provided extreme evidence (BF10 = 131) that VAN was stronger at the detection threshold than at the identification threshold. Mean VAN decreased from [Formula: see text]2.12 microV [[Formula: see text]2.86, [Formula: see text]1.42] at detection to [Formula: see text]0.46 microV [[Formula: see text]0.79, [Formula: see text]0.11] at identification. These results strongly support the claim that VAN is an NCC of lower-level experiences of seeing something rather than of higher-level experiences of specific properties of the stimuli. Thus, results are consistent with recurrent processing theory in that phenomenal visual consciousness is reflected by VAN. Further, results emphasize that it is important to consider the level of experience when searching for NCC.
Collapse
Affiliation(s)
- Stefan Wiens
- Department of Psychology, Stockholm University, Stockholm, Sweden.
| | - Annika Andersson
- Department of Psychology, Stockholm University, Stockholm, Sweden
| | | |
Collapse
|
247
|
Williams N, Ojanperä A, Siebenhühner F, Toselli B, Palva S, Arnulfo G, Kaski S, Palva JM. The influence of inter-regional delays in generating large-scale brain networks of phase synchronization. Neuroimage 2023; 279:120318. [PMID: 37572765 DOI: 10.1016/j.neuroimage.2023.120318] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2023] [Revised: 07/14/2023] [Accepted: 08/10/2023] [Indexed: 08/14/2023] Open
Abstract
Large-scale networks of phase synchronization are considered to regulate the communication between brain regions fundamental to cognitive function, but the mapping to their structural substrates, i.e., the structure-function relationship, remains poorly understood. Biophysical Network Models (BNMs) have demonstrated the influences of local oscillatory activity and inter-regional anatomical connections in generating alpha-band (8-12 Hz) networks of phase synchronization observed with Electroencephalography (EEG) and Magnetoencephalography (MEG). Yet, the influence of inter-regional conduction delays remains unknown. In this study, we compared a BNM with standard "distance-dependent delays", which assumes constant conduction velocity, to BNMs with delays specified by two alternative methods accounting for spatially varying conduction velocities, "isochronous delays" and "mixed delays". We followed the Approximate Bayesian Computation (ABC) workflow, i) specifying neurophysiologically informed prior distributions of BNM parameters, ii) verifying the suitability of the prior distributions with Prior Predictive Checks, iii) fitting each of the three BNMs to alpha-band MEG resting-state data (N = 75) with Bayesian optimization for Likelihood-Free Inference (BOLFI), and iv) choosing between the fitted BNMs with ABC model comparison on a separate MEG dataset (N = 30). Prior Predictive Checks revealed the range of dynamics generated by each of the BNMs to encompass those seen in the MEG data, suggesting the suitability of the prior distributions. Fitting the models to MEG data yielded reliable posterior distributions of the parameters of each of the BNMs. Finally, model comparison revealed the BNM with "distance-dependent delays", as the most probable to describe the generation of alpha-band networks of phase synchronization seen in MEG. These findings suggest that distance-dependent delays might contribute to the neocortical architecture of human alpha-band networks of phase synchronization. Hence, our study illuminates the role of inter-regional delays in generating the large-scale networks of phase synchronization that might subserve the communication between regions vital to cognition.
Collapse
Affiliation(s)
- N Williams
- Helsinki Institute of Information Technology, Department of Computer Science, Aalto University, Finland; Department of Neuroscience and Biomedical Engineering, Aalto University, Finland.
| | - A Ojanperä
- Department of Computer Science, Aalto University, Finland
| | - F Siebenhühner
- Neuroscience Center, Helsinki Institute of Life Science, University of Helsinki, Finland; BioMag laboratory, HUS Medical Imaging Center, Helsinki, Finland
| | - B Toselli
- Department of Informatics, Bioengineering, Robotics & Systems Engineering, University of Genoa, Italy
| | - S Palva
- Neuroscience Center, Helsinki Institute of Life Science, University of Helsinki, Finland; Centre for Cognitive Neuroimaging, School of Neuroscience & Psychology, University of Glasgow, United Kingdom
| | - G Arnulfo
- Neuroscience Center, Helsinki Institute of Life Science, University of Helsinki, Finland; Department of Informatics, Bioengineering, Robotics & Systems Engineering, University of Genoa, Italy
| | - S Kaski
- Helsinki Institute of Information Technology, Department of Computer Science, Aalto University, Finland; Department of Computer Science, Aalto University, Finland; Department of Computer Science, University of Manchester, United Kingdom
| | - J M Palva
- Department of Neuroscience and Biomedical Engineering, Aalto University, Finland; Neuroscience Center, Helsinki Institute of Life Science, University of Helsinki, Finland; Centre for Cognitive Neuroimaging, School of Neuroscience & Psychology, University of Glasgow, United Kingdom
| |
Collapse
|
248
|
Lerud KD, Hancock R, Skoe E. A high-density EEG and structural MRI source analysis of the frequency following response to missing fundamental stimuli reveals subcortical and cortical activation to low and high frequency stimuli. Neuroimage 2023; 279:120330. [PMID: 37598815 DOI: 10.1016/j.neuroimage.2023.120330] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Revised: 07/29/2023] [Accepted: 08/14/2023] [Indexed: 08/22/2023] Open
Abstract
Pitch is a perceptual rather than physical phenomenon, important for spoken language use, musical communication, and other aspects of everyday life. Auditory stimuli can be designed to probe the relationship between perception and physiological responses to pitch-evoking stimuli. One technique for measuring physiological responses to pitch-evoking stimuli is the frequency following response (FFR). The FFR is an electroencephalographic (EEG) response to periodic auditory stimuli. The FFR contains nonlinearities not present in the stimuli, including correlates of the amplitude envelope of the stimulus; however, these nonlinearities remain undercharacterized. The FFR is a composite response reflecting multiple neural and peripheral generators, and their contributions to the scalp-recorded FFR vary in ill-understood ways depending on the electrode montage, stimulus, and imaging technique. The FFR is typically assumed to be generated in the auditory brainstem; there is also evidence both for and against a cortical contribution to the FFR. Here a methodology is used to examine the FFR correlates of pitch and the generators of the FFR to stimuli with different pitches. Stimuli were designed to tease apart biological correlates of pitch and amplitude envelope. FFRs were recorded with 256-electrode EEG nets, in contrast to a typical FFR setup which only contains a single active electrode. Structural MRI scans were obtained for each participant to co-register with the electrode locations and constrain a source localization algorithm. The results of this localization shed light on the generating mechanisms of the FFR, including providing evidence for both cortical and subcortical auditory sources.
Collapse
Affiliation(s)
- Karl D Lerud
- University of Maryland College Park, Institute for Systems Research, 20742, United States of America.
| | - Roeland Hancock
- Yale University, Wu Tsai Institute, 06510, United States of America
| | - Erika Skoe
- University of Connecticut, Department of Speech, Language, and Hearing Sciences, Cognitive Sciences Program, 06269, United States of America
| |
Collapse
|
249
|
Crétot-Richert G, De Vos M, Debener S, Bleichner MG, Voix J. Assessing focus through ear-EEG: a comparative study between conventional cap EEG and mobile in- and around-the-ear EEG systems. Front Neurosci 2023; 17:895094. [PMID: 37829725 PMCID: PMC10565859 DOI: 10.3389/fnins.2023.895094] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2022] [Accepted: 07/12/2023] [Indexed: 10/14/2023] Open
Abstract
Introduction As our attention is becoming a commodity that an ever-increasing number of applications are competing for, investing in modern day tools and devices that can detect our mental states and protect them from outside interruptions holds great value. Mental fatigue and distractions are impacting our ability to focus and can cause workplace injuries. Electroencephalography (EEG) may reflect concentration, and if EEG equipment became wearable and inconspicuous, innovative brain-computer interfaces (BCI) could be developed to monitor mental load in daily life situations. The purpose of this study is to investigate the potential of EEG recorded inside and around the human ear to determine levels of attention and focus. Methods In this study, mobile and wireless ear-EEG were concurrently recorded with conventional EEG (cap) systems to collect data during tasks related to focus: an N-back task to assess working memory and a mental arithmetic task to assess cognitive workload. The power spectral density (PSD) of the EEG signal was analyzed to isolate consistent differences between mental load conditions and classify epochs using step-wise linear discriminant analysis (swLDA). Results and discussion Results revealed that spectral features differed statistically between levels of cognitive load for both tasks. Classification algorithms were tested on spectral features from twelve and two selected channels, for the cap and the ear-EEG. A two-channel ear-EEG model evaluated the performance of two dry in-ear electrodes specifically. Single-trial classification for both tasks revealed above chance-level accuracies for all subjects, with mean accuracies of: 96% (cap-EEG) and 95% (ear-EEG) for the twelve-channel models, 76% (cap-EEG) and 74% (in-ear-EEG) for the two-channel model for the N-back task; and 82% (cap-EEG) and 85% (ear-EEG) for the twelve-channel, 70% (cap-EEG) and 69% (in-ear-EEG) for the two-channel model for the arithmetic task. These results suggest that neural oscillations recorded with ear-EEG can be used to reliably differentiate between levels of cognitive workload and working memory, in particular when multi-channel recordings are available, and could, in the near future, be integrated into wearable devices.
Collapse
Affiliation(s)
| | - Maarten De Vos
- Stadius, Department of Electrical Engineering, Faculty of Engineering Sciences & Department of Development and Regeneration, Faculty of Medicine, KU Leuven, Leuven, Belgium
| | - Stefan Debener
- Neuropsychology Lab, Department of Psychology, University of Oldenburg, Oldenburg, Germany
- Research Center for Neurosensory Science, University of Oldenburg, Oldenburg, Germany
| | - Martin G. Bleichner
- Research Center for Neurosensory Science, University of Oldenburg, Oldenburg, Germany
- Neurophysiology of Everyday Life Group, Department of Psychology, University of Oldenburg, Oldenburg, Germany
| | - Jérémie Voix
- École de technologie supérieure (ÉTS), Université du Québec, Montréal, QC, Canada
| |
Collapse
|
250
|
Obukhov A, Krasnyanskiy M, Volkov A, Nazarova A, Teselkin D, Patutin K, Zajceva D. Method for Assessing the Influence of Phobic Stimuli in Virtual Simulators. J Imaging 2023; 9:195. [PMID: 37888302 PMCID: PMC10607658 DOI: 10.3390/jimaging9100195] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 09/17/2023] [Accepted: 09/22/2023] [Indexed: 10/28/2023] Open
Abstract
In the organizing of professional training, the assessment of the trainee's reaction and state in stressful situations is of great importance. Phobic reactions are a specific type of stress reaction that, however, is rarely taken into account when developing virtual simulators, and are a risk factor in the workplace. A method for evaluating the impact of various phobic stimuli on the quality of training is considered, which takes into account the time, accuracy, and speed of performing professional tasks, as well as the characteristics of electroencephalograms (the amplitude, power, coherence, Hurst exponent, and degree of interhemispheric asymmetry). To evaluate the impact of phobias during experimental research, participants in the experimental group performed exercises in different environments: under normal conditions and under the influence of acrophobic and arachnophobic stimuli. The participants were divided into subgroups using clustering algorithms and an expert neurologist. After that, a comparison of the subgroup metrics was carried out. The research conducted makes it possible to partially confirm our hypotheses about the negative impact of phobic effects on some participants in the experimental group. The relationship between the reaction to a phobia and the characteristics of brain activity was revealed, and the characteristics of the electroencephalogram signal were considered as the metrics for detecting a phobic reaction.
Collapse
Affiliation(s)
- Artem Obukhov
- The Laboratory of Medical VR Simulator Systems for Training, Diagnostics and Rehabilitation, Tambov State Technical University, Tambov 392000, Russia; (M.K.); (A.V.); (A.N.); (D.T.); (K.P.); (D.Z.)
| | | | | | | | | | | | | |
Collapse
|