Analyses of EEG Oscillatory Activities during Slow and Fast Repetitive Movements using Holo-Hilbert Spectral Analysis

Analysis of Amplitude Modulation of EEG Based on Holo-Hilbert Spectrum Analysis During General Anesthesia

OBJECTIVE

The study aims to investigate the relationship between amplitude modulation (AM) of EEG and anesthesia depth during general anesthesia.

METHODS

In this study, Holo-Hilbert spectrum analysis (HHSA) was used to decompose the multichannel EEG signals of 15 patients to obtain the spatial distribution of AM in the brain. Subsequently, HHSA was applied to the prefrontal EEG (Fp1) obtained during general anesthesia surgery in 15 and 34 patients, and the α-θ and α-δ regions of feature (ROFs) were defined in Holo-Hilbert spectrum (HHS) and three features were derived to quantify AM in ROFs.

RESULTS

During anesthetized phase, an anteriorization of the spatial distribution of AMs of α-carrier in brain was observed, as well as AMs of α-θ and α-δ in the EEG of Fp1. The total power ([Formula: see text]), mean carrier frequency ([Formula: see text]) and mean amplitude frequency ([Formula: see text]) of AMs changed during different anesthesia states.

CONCLUSION

HHSA can effectively analyze the cross-frequency coupling of EEG during anesthesia and the AM features may be applied to anesthesia monitoring.

SIGNIFICANCE

The study provides a new perspective for the characterization of brain states during general anesthesia, which is of great significance for exploring new features of anesthesia monitoring.

Cross-modal credibility modelling for EEG-based multimodal emotion recognition

Objective.The study of emotion recognition through electroencephalography (EEG) has garnered significant attention recently. Integrating EEG with other peripheral physiological signals may greatly enhance performance in emotion recognition. Nonetheless, existing approaches still suffer from two predominant challenges: modality heterogeneity, stemming from the diverse mechanisms across modalities, and fusion credibility, which arises when one or multiple modalities fail to provide highly credible signals.Approach.In this paper, we introduce a novel multimodal physiological signal fusion model that incorporates both intra-inter modality reconstruction and sequential pattern consistency, thereby ensuring a computable and credible EEG-based multimodal emotion recognition. For the modality heterogeneity issue, we first implement a local self-attention transformer to obtain intra-modal features for each respective modality. Subsequently, we devise a pairwise cross-attention transformer to reveal the inter-modal correlations among different modalities, thereby rendering different modalities compatible and diminishing the heterogeneity concern. For the fusion credibility issue, we introduce the concept of sequential pattern consistency to measure whether different modalities evolve in a consistent way. Specifically, we propose to measure the varying trends of different modalities, and compute the inter-modality consistency scores to ascertain fusion credibility.Main results.We conduct extensive experiments on two benchmarked datasets (DEAP and MAHNOB-HCI) with the subject-dependent paradigm. For the DEAP dataset, our method improves the accuracy by 4.58%, and the F1 score by 0.63%, compared to the state-of-the-art baseline. Similarly, for the MAHNOB-HCI dataset, our method improves the accuracy by 3.97%, and the F1 score by 4.21%. In addition, we gain much insight into the proposed framework through significance test, ablation experiments, confusion matrices and hyperparameter analysis. Consequently, we demonstrate the effectiveness of the proposed credibility modelling through statistical analysis and carefully designed experiments.Significance.All experimental results demonstrate the effectiveness of our proposed architecture and indicate that credibility modelling is essential for multimodal emotion recognition.

Improvement of brain-computer interface in motor imagery training through the designing of a dynamic experiment and FBCSP

Motor imagery (MI) can produce a specific brain pattern when the subject imagines performing a particular action without any actual body movements. According to related previous research, the improvement of the training of MI brainwaves can be adopted by feedback methods in which the analysis of brainwave characteristics is very important. The aim of this study was to improve the subject's MI and the accuracy of classification. In order to ameliorate the accuracy of the MI of the left and right hand, the present study designed static and dynamic visual stimuli in experiments so as to evaluate which one can improve subjects' imagination training. Additionally, the filter bank common spatial pattern (FBCSP) method was used to divide the frequency band range of the brainwaves into multiple segments, following which linear discriminant analysis (LDA) was adopted for classification. The results revealed that the averaged false positive rate (FPR) under FBCSP-LDA in the dynamic MI experiment was the lowest FPR (23.76%). As such, this study suggested that a combination of the dynamic MI experiment and the FBCSP-LDA method improved the overall prediction error rate and ameliorated the performance of the MI brain-computer interface.

From thinking fast to moving fast: motor control of fast limb movements in healthy individuals

The ability to produce high movement speeds is a crucial factor in human motor performance, from the skilled athlete to someone avoiding a fall. Despite this relevance, there remains a lack of both an integrative brain-to-behavior analysis of these movements and applied studies linking the known dependence on open-loop, central control mechanisms of these movements to their real-world implications, whether in the sports, performance arts, or occupational setting. In this review, we cover factors associated with the planning and performance of fast limb movements, from the generation of the motor command in the brain to the observed motor output. At each level (supraspinal, peripheral, and motor output), the influencing factors are presented and the changes brought by training and fatigue are discussed. The existing evidence of more applied studies relevant to practical aspects of human performance is also discussed. Inconsistencies in the existing literature both in the definitions and findings are highlighted, along with suggestions for further studies on the topic of fast limb movement control. The current heterogeneity in what is considered a fast movement and in experimental protocols makes it difficult to compare findings in the existing literature. We identified the role of the cerebellum in movement prediction and of surround inhibition in motor slowing, as well as the effects of fatigue and training on central motor control, as possible avenues for further research, especially in performance-driven populations.

The Full Informational Spectral Analysis for Auditory Steady-State Responses in Human Brain Using the Combination of Canonical Correlation Analysis and Holo-Hilbert Spectral Analysis

Auditory steady-state response (ASSR) is a translational biomarker for several neurological and psychiatric disorders, such as hearing loss, schizophrenia, bipolar disorder, autism, etc. The ASSR is sinusoidal electroencephalography (EEG)/magnetoencephalography (MEG) responses induced by periodically presented auditory stimuli. Traditional frequency analysis assumes ASSR is a stationary response, which can be analyzed using linear analysis approaches, such as Fourier analysis or Wavelet. However, recent studies have reported that the human steady-state responses are dynamic and can be modulated by the subject’s attention, wakefulness state, mental load, and mental fatigue. The amplitude modulations on the measured oscillatory responses can result in the spectral broadening or frequency splitting on the Fourier spectrum, owing to the trigonometric product-to-sum formula. Accordingly, in this study, we analyzed the human ASSR by the combination of canonical correlation analysis (CCA) and Holo-Hilbert spectral analysis (HHSA). The CCA was used to extract ASSR-related signal features, and the HHSA was used to decompose the extracted ASSR responses into amplitude modulation (AM) components and frequency modulation (FM) components, in which the FM frequency represents the fast-changing intra-mode frequency and the AM frequency represents the slow-changing inter-mode frequency. In this paper, we aimed to study the AM and FM spectra of ASSR responses in a 37 Hz steady-state auditory stimulation. Twenty-five healthy subjects were recruited for this study, and each subject was requested to participate in two auditory stimulation sessions, including one right-ear and one left-ear monaural steady-state auditory stimulation. With the HHSA, both the 37 Hz (fundamental frequency) and the 74 Hz (first harmonic frequency) auditory responses were successfully extracted. Examining the AM spectra, the 37 Hz and the 74 Hz auditory responses were modulated by distinct AM spectra, each with at least three composite frequencies. In contrast to the results of traditional Fourier spectra, frequency splitting was seen at 37 Hz, and a spectral peak was obscured at 74 Hz in Fourier spectra. The proposed method effectively corrects the frequency splitting problem resulting from time-varying amplitude changes. Our results have validated the HHSA as a useful tool for steady-state response (SSR) studies so that the misleading or wrong interpretation caused by amplitude modulation in the traditional Fourier spectrum can be avoided.

Holo-Hilbert spectral-based noise removal method for EEG high-frequency bands

Simultaneous EEG-fMRI is a growing and promising field, as it has great potential to further our understanding of the spatiotemporal dynamics of brain function in health and disease. In particular, there is much interest in understanding the fMRI correlates of brain activity in the gamma band (> 30 Hz), as these frequencies are thought to be associated with cognitive processes involving perception, attention, and memory, as well as with disorders such as schizophrenia and autism. However, progress in this area has been limited due to issues such as MR-induced artifacts in EEG recordings, which seem to be more problematic for gamma frequencies. This paper presents a noise removal method for the gamma band of EEG that is based on the Holo-Hilbert spectral analysis (HHSA), but with a new implementation strategy. HHSA uses a nested empirical mode decomposition (EMD) to identify amplitude and frequency modulations (AM and FM, respectively) by averaging over frequencies with high and significant powers. Our method examines gamma band by applying two layers of EMD to the FM and AM components, removing components with very low power based on the power-instantaneous frequency spectrum, and subsequently reconstructs the denoised gamma-band signal from the remaining components. Simulations demonstrate that our proposed method efficiently reduces artifacts while preserving the original gamma signal which is especially critical for simultaneous EEG/fMRI studies.