Exploring Frequency-Dependent Brain Networks from Ongoing EEG Using Spatial ICA During Music Listening

Cortical linear encoding and decoding of sounds: Similarities and differences between naturalistic speech and music listening

Linear models are becoming increasingly popular to investigate brain activity in response to continuous and naturalistic stimuli. In the context of auditory perception, these predictive models can be 'encoding', when stimulus features are used to reconstruct brain activity, or 'decoding' when neural features are used to reconstruct the audio stimuli. These linear models are a central component of some brain-computer interfaces that can be integrated into hearing assistive devices (e.g., hearing aids). Such advanced neurotechnologies have been widely investigated when listening to speech stimuli but rarely when listening to music. Recent attempts at neural tracking of music show that the reconstruction performances are reduced compared with speech decoding. The present study investigates the performance of stimuli reconstruction and electroencephalogram prediction (decoding and encoding models) based on the cortical entrainment of temporal variations of the audio stimuli for both music and speech listening. Three hypotheses that may explain differences between speech and music stimuli reconstruction were tested to assess the importance of the speech-specific acoustic and linguistic factors. While the results obtained with encoding models suggest different underlying cortical processing between speech and music listening, no differences were found in terms of reconstruction of the stimuli or the cortical data. The results suggest that envelope-based linear modelling can be used to study both speech and music listening, despite the differences in the underlying cortical mechanisms.

IABC: A Toolbox for Intelligent Analysis of Brain Connectivity

Brain functional networks and connectivity have played an important role in exploring brain function for understanding the brain and disclosing the mechanisms of brain disorders. Independent component analysis (ICA) is one of the most widely applied data-driven methods to extract brain functional networks/connectivity. However, it is hard to guarantee the reliability of networks/connectivity due to the randomness of component order and the difficulty in selecting an optimal component number in ICA. To facilitate the analysis of brain functional networks and connectivity using ICA, we developed a MATLAB toolbox called Intelligent Analysis of Brain Connectivity (IABC). IABC incorporates our previously proposed group information guided independent component analysis (GIG-ICA), NeuroMark, and splitting-merging assisted reliable ICA (SMART ICA) methods, which can estimate reliable individual-subject neuroimaging measures for further analysis. After user inputs functional magnetic resonance imaging (fMRI) data of multiple subjects that are regularly organized (e.g., in Brain Imaging Data Structure (BIDS)) and clicks a few buttons to set parameters, IABC automatically outputs brain functional networks, their related time courses, and functional network connectivity of each subject. All these neuroimaging measures are promising for providing clues in understanding brain function and differentiating brain disorders.

Dynamic auditory contributions to error detection revealed in the discrimination of Same and Different syllable pairs

During speech production auditory regions operate in concert with the anterior dorsal stream to facilitate online error detection. As the dorsal stream also is known to activate in speech perception, the purpose of the current study was to probe the role of auditory regions in error detection during auditory discrimination tasks as stimuli are encoded and maintained in working memory. A priori assumptions are that sensory mismatch (i.e., error) occurs during the discrimination of Different (mismatched) but not Same (matched) syllable pairs. Independent component analysis was applied to raw EEG data recorded from 42 participants to identify bilateral auditory alpha rhythms, which were decomposed across time and frequency to reveal robust patterns of event related synchronization (ERS; inhibition) and desynchronization (ERD; processing) over the time course of discrimination events. Results were characterized by bilateral peri-stimulus alpha ERD transitioning to alpha ERS in the late trial epoch, with ERD interpreted as evidence of working memory encoding via Analysis by Synthesis and ERS considered evidence of speech-induced-suppression arising during covert articulatory rehearsal to facilitate working memory maintenance. The transition from ERD to ERS occurred later in the left hemisphere in Different trials than in Same trials, with ERD and ERS temporally overlapping during the early post-stimulus window. Results were interpreted to suggest that the sensory mismatch (i.e., error) arising from the comparison of the first and second syllable elicits further processing in the left hemisphere to support working memory encoding and maintenance. Results are consistent with auditory contributions to error detection during both encoding and maintenance stages of working memory, with encoding stage error detection associated with stimulus concordance and maintenance stage error detection associated with task-specific retention demands.

Integrating music-based interventions with Gamma-frequency stimulation: Implications for healthy ageing

In recent years, music-based interventions (MBIs) have risen in popularity as a non-invasive, sustainable form of care for treating dementia-related disorders, such as Mild Cognitive Impairment (MCI) and Alzheimer's disease (AD). Despite their clinical potential, evidence regarding the efficacy of MBIs on patient outcomes is mixed. Recently, a line of related research has begun to investigate the clinical impact of non-invasive Gamma-frequency (e.g., 40 Hz) sensory stimulation on dementia. Current work, using non-human-animal models of AD, suggests that non-invasive Gamma-frequency stimulation can remediate multiple pathophysiologies of dementia at the molecular, cellular and neural-systems scales, and, importantly, improve cognitive functioning. These findings suggest that the efficacy of MBIs could, in theory, be enhanced by incorporating Gamma-frequency stimulation into current MBI protocols. In the current review, we propose a novel clinical framework for non-invasively treating dementia-related disorders that combines previous MBIs with current approaches employing Gamma-frequency sensory stimulation. We theorize that combining MBIs with Gamma-frequency stimulation could increase the therapeutic power of MBIs by simultaneously targeting multiple biomarkers of dementia, restoring neural activity that underlies learning and memory (e.g., Gamma-frequency neural activity, Theta-Gamma coupling), and actively engaging auditory and reward networks in the brain to promote behavioural change.

Key Feature Extraction Method of Electroencephalogram Signal by Independent Component Analysis for Athlete Selection and Training

Emotion is an important expression generated by human beings to external stimuli in the process of interaction with the external environment. It affects all aspects of our lives all the time. Accurate identification of human emotional states and further application in artificial intelligence can better improve and assist human life. Therefore, the research on emotion recognition has attracted the attention of many scholars in the field of artificial intelligence in recent years. Brain electrical signal conversion becomes critical, and it needs a brain electrical signal processing method to extract the effective signal to realize the human-computer interaction However, nonstationary nonlinear characteristics of EEG signals bring great challenge in characteristic signal extraction. At present, although there are many feature extraction methods, none of them can reflect the global feature of the signal. The following solutions are used to solve the above problems: (1) this paper proposed an ICA and sample entropy algorithm-based framework for feature extraction of EEG signals, which has not been applied for EEG and (2) simulation signals were used to verify the feasibility of this method, and experiments were carried out on two real-world data sets, to show the advantages of the new algorithm in feature extraction of EEG signals.

Exploring Oscillatory Dysconnectivity Networks in Major Depression during Resting State Using Coupled Tensor Decomposition

Dysconnectivity of large-scale brain networks has been linked to major depression disorder (MDD) during resting state. Recent researches show that the temporal evolution of brain networks regulated by oscillations reveals novel mechanisms and neural characteristics of MDD. Our study applied a novel coupled tensor decomposition model to investigate the dysconnectivity networks characterized by spatio-temporal-spectral modes of covariation in MDD using resting electroencephalography. The phase lag index is used to calculate the functional connectivity within each time window at each frequency bin. Then, two adjacency tensors with the dimension of time frequency connectivity subject are constructed for the healthy group and the major depression group. We assume that the two groups share the same features for group similarity and retain individual characteristics for group differences. Considering that the constructed tensors are nonnegative and the components in spectral and adjacency modes are partially consistent among the two groups, we formulate a double-coupled nonnegative tensor decomposition model. To reduce computational complexity, we introduce the lowrank approximation. Then, the fast hierarchical alternative least squares algorithm is applied for model optimization. After clustering analysis, we summarize four oscillatory networks characterizing the healthy group and four oscillatory networks characterizing the major depression group, respectively. The proposed model may reveal novel mechanisms of pathoconnectomics in MDD during rest, and it can be easily extended to other psychiatric disorders.

Identifying Oscillatory Hyperconnectivity and Hypoconnectivity Networks in Major Depression Using Coupled Tensor Decomposition

Previous researches demonstrate that major depression disorder (MDD) is associated with widespread network dysconnectivity, and the dynamics of functional connectivity networks are important to delineate the neural mechanisms of MDD. Neural oscillations exert a key role in coordinating the activity of remote brain regions, and various assemblies of oscillations can modulate different networks to support different cognitive tasks. Studies have demonstrated that the dysconnectivity of electroencephalography (EEG) oscillatory networks is related with MDD. In this study, we investigated the oscillatory hyperconnectivity and hypoconnectivity networks in MDD under a naturalistic and continuous stimuli condition of music listening. With the assumption that the healthy group and the MDD group share similar brain topology from the same stimuli and also retain individual brain topology for group differences, we applied the coupled nonnegative tensor decomposition algorithm on two adjacency tensors with the dimension of time × frequency × connectivity × subject, and imposed double-coupled constraints on spatial and spectral modes. The music-induced oscillatory networks were identified by a correlation analysis approach based on the permutation test between extracted temporal factors and musical features. We obtained three hyperconnectivity networks from the individual features of MDD and three hypoconnectivity networks from common features. The results demonstrated that the dysfunction of oscillatory networks could affect the involvement in music perception for MDD patients. Those oscillatory dysconnectivity networks may provide promising references to reveal the pathoconnectomics of MDD and potential biomarkers for the diagnosis of MDD.

On the estimate of music appraisal from surface EEG: a dynamic-network approach based on cross-sensor PAC measurements

Objective.The aesthetic evaluation of music is strongly dependent on the listener and reflects manifold brain processes that go well beyond the perception of incident sound. Being a high-level cognitive reaction, it is difficult to predict merely from the acoustic features of the audio signal and this poses serious challenges to contemporary music recommendation systems. We attempted to decode music appraisal from brain activity, recorded via wearable EEG, during music listening.Approach.To comply with the dynamic nature of music stimuli, cross-frequency coupling measurements were employed in a time-evolving manner to capture the evolving interactions between distinct brain-rhythms during music listening. Brain response to music was first represented as a continuous flow of functional couplings referring to both regional and inter-regional brain dynamics and then modelled as an ensemble of time-varying (sub)networks. Dynamic graph centrality measures were derived, next, as the final feature-engineering step and, lastly, a support-vector machine was trained to decode the subjective music appraisal. A carefully designed experimental paradigm provided the labeled brain signals.Main results.Using data from 20 subjects, dynamic programming to tailor the decoder to each subject individually and cross-validation, we demonstrated highly satisfactory performance (MAE= 0.948,R²= 0.63) that can be attributed, mostly, to interactions of left frontal gamma rhythm. In addition, our music-appraisal decoder was also employed in a part of the DEAP dataset with similar success. Finally, even a generic version of the decoder (common for all subjects) was found to perform sufficiently.Significance.A novel brain signal decoding scheme was introduced and validated empirically on suitable experimental data. It requires simple operations and leaves room for real-time implementation. Both the code and the experimental data are publicly available.

Altered EEG Oscillatory Brain Networks During Music-Listening in Major Depression

To examine the electrophysiological underpinnings of the functional networks involved in music listening, previous approaches based on spatial independent component analysis (ICA) have recently been used to ongoing electroencephalography (EEG) and magnetoencephalography (MEG). However, those studies focused on healthy subjects, and failed to examine the group-level comparisons during music listening. Here, we combined group-level spatial Fourier ICA with acoustic feature extraction, to enable group comparisons in frequency-specific brain networks of musical feature processing. It was then applied to healthy subjects and subjects with major depressive disorder (MDD). The music-induced oscillatory brain patterns were determined by permutation correlation analysis between individual time courses of Fourier-ICA components and musical features. We found that (1) three components, including a beta sensorimotor network, a beta auditory network and an alpha medial visual network, were involved in music processing among most healthy subjects; and that (2) one alpha lateral component located in the left angular gyrus was engaged in music perception in most individuals with MDD. The proposed method allowed the statistical group comparison, and we found that: (1) the alpha lateral component was activated more strongly in healthy subjects than in the MDD individuals, and that (2) the derived frequency-dependent networks of musical feature processing seemed to be altered in MDD participants compared to healthy subjects. The proposed pipeline appears to be valuable for studying disrupted brain oscillations in psychiatric disorders during naturalistic paradigms.

Sustaining Attention for a Prolonged Duration Affects Dynamic Organizations of Frequency-Specific Functional Connectivity

Sustained attention encompasses a cascade of fundamental functions. The human ability to implement a sustained attention task is supported by brain networks that dynamically formed and dissolved through oscillatory synchronization. The decrement of vigilance induced by prolonged task engagement affects sustained attention. However, little is known about which stage or combinations are affected by vigilance decrement. Here, we applied an analysis framework composed of weighted phase lag index (wPLI) and tensor component analysis (TCA) to an EEG dataset collected during 80 min sustained attention task to examine the electrophysiological basis of such effect. We aimed to characterize the phase-coupling networks to untangle different phases involved in sustained attention and study how they are modulated by vigilance decrement. We computed the time–frequency domain wPLI from each block and subject and constructed a fourth-order tensor, containing the time, frequency, functional connectivity (FC), and blocks × subjects. This tensor was subjected to the TCA to identify the interacted and low-dimensional components representing the frequency-specific dynamic FC (fdFC). We extracted four types of neuromakers during a sustained attention task, namely the pre-stimulus alpha right-lateralized parieto-occipital FC, the post-stimulus theta fronto-parieto-occipital FC, delta fronto-parieto-occipital FC, and beta right/left sensorimotor FCs. All these fdFCs were impaired by vigilance decrement. These fdFCs, except for the beta left sensorimotor network, were restored by rewards, although the restoration by reward in the beta right sensorimotor network was transient. These findings provide implications for dissociable effects of vigilance decrement on sustained attention by utilizing the tensor-based framework.