Language and motor processing in reading and typing: Insights from beta-frequency band power modulations

Improved emotion differentiation under reduced acoustic variability of speech in autism

BACKGROUND

Socio-emotional impairments are among the diagnostic criteria for autism spectrum disorder (ASD), but the actual knowledge has substantiated both altered and intact emotional prosodies recognition. Here, a Bayesian framework of perception is considered suggesting that the oversampling of sensory evidence would impair perception within highly variable environments. However, reliable hierarchical structures for spectral and temporal cues would foster emotion discrimination by autistics.

METHODS

Event-related spectral perturbations (ERSP) extracted from electroencephalographic (EEG) data indexed the perception of anger, disgust, fear, happiness, neutral, and sadness prosodies while listening to speech uttered by (a) human or (b) synthesized voices characterized by reduced volatility and variability of acoustic environments. The assessment of mechanisms for perception was extended to the visual domain by analyzing the behavioral accuracy within a non-social task in which dynamics of precision weighting between bottom-up evidence and top-down inferences were emphasized. Eighty children (mean 9.7 years old; standard deviation 1.8) volunteered including 40 autistics. The symptomatology was assessed at the time of the study via the Autism Diagnostic Observation Schedule, Second Edition, and parents' responses on the Autism Spectrum Rating Scales. A mixed within-between analysis of variance was conducted to assess the effects of group (autism versus typical development), voice, emotions, and interaction between factors. A Bayesian analysis was implemented to quantify the evidence in favor of the null hypothesis in case of non-significance. Post hoc comparisons were corrected for multiple testing.

RESULTS

Autistic children presented impaired emotion differentiation while listening to speech uttered by human voices, which was improved when the acoustic volatility and variability of voices were reduced. Divergent neural patterns were observed from neurotypicals to autistics, emphasizing different mechanisms for perception. Accordingly, behavioral measurements on the visual task were consistent with the over-precision ascribed to the environmental variability (sensory processing) that weakened performance. Unlike autistic children, neurotypicals could differentiate emotions induced by all voices.

CONCLUSIONS

This study outlines behavioral and neurophysiological mechanisms that underpin responses to sensory variability. Neurobiological insights into the processing of emotional prosodies emphasized the potential of acoustically modified emotional prosodies to improve emotion differentiation by autistics.

TRIAL REGISTRATION

BioMed Central ISRCTN Registry, ISRCTN18117434. Registered on September 20, 2020.

Patients with epilepsy without cognitive impairment show altered brain networks in multiple frequency bands in an audiovisual integration task

OBJECTIVES

Comorbid cognitive and behavioral deficits are often observed in patients with epilepsy. It is not clear whether the brain networks of patients with epilepsy without cognitive decline differs from that of healthy controls in different frequency bands in the task-state. The purpose of our study was to explore whether epilepsy affects the structure of brain networks associated with cognitive processing, even when patients with epilepsy do not have cognitive impairment.

METHODS

We designed an audiovisual discrimination task and recorded electroencephalogram (EEG) data from healthy controls and patients with epilepsy. We established constructed time-varying brain networks across the delta, theta, alpha, and beta bands on the task-state EEG data during audiovisual integration processing.

RESULTS

The results showed changes in the structure of the brain networks in the theta, alpha, and beta bands in patients with epilepsy who had no cognitive deficit. No significant difference in the connectivity strength, clustering coefficient, characteristic path length, or global efficiency was noted between patients and healthy controls. Moreover, the structure of brain networks in patients showed no correlation with the behavioral performance.

CONCLUSION

The repeated abnormal firing of neurons in the brain of patients with epilepsy may inhibit it from optimizing networks into more efficient structures. Epilepsy might affect decision-making ability by damaging the neural activity in the beta band and preventing its correlation with decision-making behaviors.

Examination of distraction and discomfort caused by using glare monitors: a simultaneous electroencephalography and eye-tracking study

Background

Since the COVID-19 pandemic started, remote work and education and digital display use have become more prevalent. However, compared with printed material, digital displays cause more eye fatigue and may decrease task performance. For instance, the reflections on the monitor can cause discomfort or distraction, particularly when glare monitors are used with black backgrounds.

Methods

This study simultaneously uses electroencephalography (EEG) and an eye-tracker to measure the possible negative effects of using a glare monitor on the illegibility of sentences.

Results

The experiment results showed no difference in reading time and subjective illegibility rating between glare and non-glare monitors. However, with glare monitors, eye fixation when reading lasted longer. Further, EEG beta (15-20 Hz) power variations suggested that the participants were less engaged in the reading task when a glare monitor was used with a black background.

Conclusions

These results indicate that the negative effects of using a glare monitor are subtle but certainly present. They also show that physiological measures such as EEG and eye tracking can assess the subtle effects in an objective manner, even if behavioral measures such as subjective illegibility ratings or reading time may not show the differences.

Intelligibility of speech in Parkinson's disease relies on anatomically segregated subthalamic beta oscillations

BACKGROUND

Speech impairment is commonly reported in Parkinson's disease and is not consistently improved by available therapies - including deep brain stimulation of the subthalamic nucleus (STN-DBS), which can worsen communication performance in some patients. Improving the outcome of STN-DBS on speech is difficult due to our incomplete understanding of the contribution of the STN to fluent speaking.

OBJECTIVE

To assess the relationship between subthalamic neural activity and speech production and intelligibility.

METHODS

We investigated bilateral STN local field potentials (LFPs) in nine parkinsonian patients chronically implanted with DBS during overt reading. LFP spectral features were correlated with clinical scores and measures of speech intelligibility.

RESULTS

Overt reading was associated with increased beta-low ([1220) Hz) power in the left STN, whereas speech intelligibility correlated positively with beta-high ([2030) Hz) power in the right STN.

CONCLUSION

We identified separate contributions from frequency and brain lateralization of the STN in the execution of an overt reading motor task and its intelligibility. This subcortical organization could be exploited for new adaptive stimulation strategies capable of identifying the occurrence of speaking behavior and facilitating its functional execution.

Executive function during typing on computer

In recent decades, computer typing has become one of the fundamental tools for personal communication in everyday life. Typing is a multi-level hierarchical process that involves a large number of cognitive and physiological functions. Executive functions (EF), such as working memory and executive control, actively influence the inhibitory and activation processes during typing. Using the example of the work of the IF, one can observe the hierarchical organization of the central and peripheral parts of the nervous system during typing. However, there are not so many studies aimed at studying the neurophysiology of typing, and there were no works devoted to the study of EF in typing. In this regard, this article discusses the potential possibilities of studying EF by typing on a computer and provides examples of experiments and models that can be used in such studies. The article also describes the main psychophysiological studies in which typing was involved and a review of methods for studying and analyzing typing was conducted.

Decoding EEG Brain Activity for Multi-Modal Natural Language Processing

Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language processing tasks. Using EEG brain activity for this purpose is largely unexplored as of yet. In this paper, we present the first large-scale study of systematically analyzing the potential of EEG brain activity data for improving natural language processing tasks, with a special focus on which features of the signal are most beneficial. We present a multi-modal machine learning architecture that learns jointly from textual input as well as from EEG features. We find that filtering the EEG signals into frequency bands is more beneficial than using the broadband signal. Moreover, for a range of word embedding types, EEG data improves binary and ternary sentiment classification and outperforms multiple baselines. For more complex tasks such as relation detection, only the contextualized BERT embeddings outperform the baselines in our experiments, which raises the need for further research. Finally, EEG data shows to be particularly promising when limited training data is available.

On the Role of Bilateral Brain Hypofunction and Abnormal Lateralization of Cortical Information Flow as Neural Underpinnings of Conventional Metaphor Processing Impairment in Schizophrenia: An fMRI and EEG Study

Figurative language processing (e.g. metaphors) is commonly impaired in schizophrenia. In the present study, we investigated the neural activity and propagation of information within neural circuits related to the figurative speech, as a neural substrate of impaired conventional metaphor processing in schizophrenia. The study included 30 schizophrenia outpatients and 30 healthy controls, all of whom were assessed with a functional Magnetic Resonance Imaging (fMRI) and electroencephalography (EEG) punchline-based metaphor comprehension task including literal (neutral), figurative (metaphorical) and nonsense (absurd) endings. The blood oxygenation level-dependent signal was recorded with 3T MRI scanner and direction and strength of cortical information flow in the time course of task processing was estimated with a 64-channel EEG input for directed transfer function. The presented results revealed that the behavioral manifestation of impaired figurative language in schizophrenia is related to the hypofunction in the bilateral fronto-temporo-parietal brain regions (fMRI) and various differences in effective connectivity in the fronto-temporo-parietal circuit (EEG). Schizophrenia outpatients showed an abnormal pattern of connectivity during metaphor processing which was related to bilateral (but more pronounced at the left hemisphere) hypoactivation of the brain. Moreover, we found reversed lateralization patterns, i.e. a rightward-shifted pattern during metaphor processing in schizophrenia compared to the control group. In conclusion, the presented findings revealed that the impairment of the conventional metaphor processing in schizophrenia is related to the bilateral brain hypofunction, which supports the evidence on reversed lateralization of the language neural network and the existence of compensatory recruitment of alternative neural circuits in schizophrenia.

Synchronization between Keyboard Typing and Neural Oscillations

Rhythmic neural activity synchronizes with certain rhythmic behaviors, such as breathing, sniffing, saccades, and speech. The extent to which neural oscillations synchronize with higher-level and more complex behaviors is largely unknown. Here, we investigated electrophysiological synchronization with keyboard typing, which is an omnipresent behavior daily engaged by an uncountably large number of people. Keyboard typing is rhythmic, with frequency characteristics roughly the same as neural oscillatory dynamics associated with cognitive control, notably through midfrontal theta (4-7 Hz) oscillations. We tested the hypothesis that synchronization occurs between typing and midfrontal theta and breaks down when errors are committed. Thirty healthy participants typed words and sentences on a keyboard without visual feedback, while EEG was recorded. Typing rhythmicity was investigated by interkeystroke interval analyses and by a kernel density estimation method. We used a multivariate spatial filtering technique to investigate frequency-specific synchronization between typing and neuronal oscillations. Our results demonstrate theta rhythmicity in typing (around 6.5 Hz) through the two different behavioral analyses. Synchronization between typing and neuronal oscillations occurred at frequencies ranging from 4 to 15 Hz, but to a larger extent for lower frequencies. However, peak synchronization frequency was idiosyncratic across participants, therefore not specific to theta nor to midfrontal regions, and correlated somewhat with peak typing frequency. Errors and trials associated with stronger cognitive control were not associated with changes in synchronization at any frequency. As a whole, this study shows that brain-behavior synchronization does occur during keyboard typing but is not specific to midfrontal theta.

Electroencephalographic characteristics of word finding during phonological and semantic verbal fluency tasks

Aims

Verbal Fluency is sensitive to brain damage and is employed to assess language abilities like the size of vocabulary and the semantic‐lexical networks’ integrity and executive functioning abilities particularly inhibition, working memory, and self‐monitoring. Various studies revealed oscillatory changes related to word retrieval during different tasks. However, there are not enough studies on electroencephalographic characteristics of word retrieval routes (phonological or semantic pathway) during free recall. The purpose of our study was to investigate electroencephalography power relationship with semantic and phonological word finding routes during verbal fluency.

Methods

In this within‐subject study, the electroencephalography of 20 healthy participants was recorded during written category and letter fluency tasks and compared with the rest state. Absolute power of the signals in delta (1‐3.5 Hz), theta (4‐7.5 Hz), alpha (8‐12 Hz), and beta (12.5‐30 Hz) was calculated in three lobes (frontal, parietal, and temporal).

Results

A repeated measures ANOVA showed significant interaction of condition × lobe × frequency × side (P < .001). Post hoc test for each lobe showed significant changes in the absolute power of delta, theta and beta for frontal, delta and theta for parietal, and theta and beta for temporal lobes (P‐values < .05).

Conclusion

Searching the words by phonological entries is associated with decreased beta and increased theta in left frontal lobe. These changes are not necessary for semantic word retrieval strategy.

Word retrieval either by phonological entries or semantic categories is accompanied by increased delta in frontal and parietal lobes. Decreased beta and increased theta bands in the left frontal lobe are associated with phonological word retrieval strategy while during semantic word finding, increased beta was observed in the left temporal lobe.