Successful Encoding during Natural Reading Is Associated with Fixation-Related Potentials and Large-Scale Network Deactivation

Dynamics of working memory process revealed by independent component analysis in an fMRI study

Human memory is prone to errors in many everyday activities but also when cultivating hobbies such as traveling and/or learning a new language. For instance, while visiting foreign countries, people erroneously recall foreign language words that are meaningless to them. Our research simulated such errors in a modified Deese-Roediger-McDermott paradigm for short-term memory with phonologically related stimuli aimed at uncovering behavioral and neuronal indices of false memory formation with regard to time-of-day, a variable known to influence memory. Fifty-eight participants were tested in a magnetic resonance (MR) scanner twice. The results of an Independent Component Analysis revealed encoding-related activity of the medial visual network preceding correct recognition of positive probes and correct rejection of lure probes. The engagement of this network preceding false alarms was not observed. We also explored if diurnal rhythmicity influences working memory processes. Diurnal differences were seen in the default mode network and the medial visual network with lower deactivation in the evening hours. The GLM results showed greater activation of the right lingual gyrus, part of the visual cortex and the left cerebellum in the evening. The study offers new insight into the mechanisms associated with false memories, suggesting that deficient engagement of the medial visual network during the memorization phase of a task results in short-term memory distortions. The results shed new light on the dynamics of working memory processes by taking into account the effect of time-of-day on memory performance.

Neuroergonomics on the Go: An Evaluation of the Potential of Mobile EEG for Workplace Assessment and Design

OBJECTIVE

We demonstrate and discuss the use of mobile electroencephalogram (EEG) for neuroergonomics. Both technical state of the art as well as measures and cognitive concepts are systematically addressed.

BACKGROUND

Modern work is increasingly characterized by information processing. Therefore, the examination of mental states, mental load, or cognitive processing during work is becoming increasingly important for ergonomics.

RESULTS

Mobile EEG allows to measure mental states and processes under real live conditions. It can be used for various research questions in cognitive neuroergonomics. Besides measures in the frequency domain that have a long tradition in the investigation of mental fatigue, task load, and task engagement, new approaches-like blink-evoked potentials-render event-related analyses of the EEG possible also during unrestricted behavior.

CONCLUSION

Mobile EEG has become a valuable tool for evaluating mental states and mental processes on a highly objective level during work. The main advantage of this technique is that working environments don't have to be changed while systematically measuring brain functions at work. Moreover, the workflow is unaffected by such neuroergonomic approaches.

Cortical traveling waves reflect state-dependent hierarchical sequencing of local regions in the human connectome network

Recent human studies using electrocorticography have demonstrated that alpha and theta band oscillations form traveling waves on the cortical surface. According to neural synchronization theories, the cortical traveling waves may group local cortical regions and sequence them by phase synchronization; however these contributions have not yet been assessed. This study aimed to evaluate the functional contributions of traveling waves using connectome-based network modeling. In the simulation, we observed stable traveling waves on the entire cortical surface wherein the topographical pattern of these phases was substantially correlated with the empirically obtained resting-state networks, and local radial waves also appeared within the size of the empirical networks (< 50 mm). Importantly, individual regions in the entire network were instantaneously sequenced by their internal frequencies, and regions with higher intrinsic frequency were seen in the earlier phases of the traveling waves. Based on the communication-through-coherence theory, this phase configuration produced a hierarchical organization of each region by unidirectional communication between the arbitrarily paired regions. In conclusion, cortical traveling waves reflect the intrinsic frequency-dependent hierarchical sequencing of local regions, global traveling waves sequence the set of large-scale cortical networks, and local traveling waves sequence local regions within individual cortical networks.

Frequency-Dependent Cortical Interactions during Semantic Processing: An Electrocorticogram Cross-spectrum Analysis Using a Semantic Space Model

Convergent evidence has demonstrated that semantics are represented by the interaction between a multimodal semantic hub at the anterior temporal lobe (ATL) and other modality-specific association cortical areas. Electrocorticogram (ECoG) recording with high spatiotemporal resolutions is efficient in evaluating such cortical interactions; however, this has not been a focus of preceding studies. The present study evaluated cortical interactions during picture naming using a novel ECoG cross-spectrum analysis, which was formulated from a computational simulation of neuronal networks and combined with a vector space model of semantics. The results clarified three types of frequency-dependent cortical networks: 1) an earlier-period (0.2-0.8 s from stimulus onset) high-gamma-band (90-150 Hz) network with a hub at the posterior fusiform gyrus, 2) a later-period (0.4-1.0 s) beta-band (15-40 Hz) network with multiple hubs at the ventral ATL and posterior middle temporal gyrus, and 3) a pre-articulation theta-band (4-7 Hz) network distributed over widely located cortical regions. These results suggest that frequency-dependent cortical interactions can characterize the underlying processes of semantic cognition, and the beta-band network with a hub at the ventral ATL is especially associated with the formation of semantic representation.

Decoding EEG Brain Activity for Multi-Modal Natural Language Processing

Until recently, human behavioral data from reading has mainly been of interest to researchers to understand human cognition. However, these human language processing signals can also be beneficial in machine learning-based natural language processing tasks. Using EEG brain activity for this purpose is largely unexplored as of yet. In this paper, we present the first large-scale study of systematically analyzing the potential of EEG brain activity data for improving natural language processing tasks, with a special focus on which features of the signal are most beneficial. We present a multi-modal machine learning architecture that learns jointly from textual input as well as from EEG features. We find that filtering the EEG signals into frequency bands is more beneficial than using the broadband signal. Moreover, for a range of word embedding types, EEG data improves binary and ternary sentiment classification and outperforms multiple baselines. For more complex tasks such as relation detection, only the contextualized BERT embeddings outperform the baselines in our experiments, which raises the need for further research. Finally, EEG data shows to be particularly promising when limited training data is available.

Single-Trial EEG Connectivity of Default Mode Network Before and During Encoding Predicts Subsequent Memory Outcome

The successful memory process produces specific activity in the brain network. As the brain activity of the prestimulus and encoding phases has a crucial effect on subsequent memory outcomes (e.g., remembered or forgotten), previous studies have tried to predict the memory performance in this period. Conventional studies have used the spectral power or event-related potential of specific regions as the classification feature. However, as multiple brain regions work collaboratively to process memory, it could be a better option to use functional connectivity within the memory-related brain network to predict subsequent memory performance. In this study, we acquired the EEG signals while performing an associative memory task that remembers scene-word pairs. For the connectivity analysis, we estimated the cross-mutual information within the default mode network with the time-frequency spectra at the prestimulus and encoding phases. Then, we predicted the success or failure of subsequent memory outcome with the connectivity features. We found that the classifier with support vector machine achieved the highest classification accuracy of 80.83% ± 12.65% (mean ± standard deviation) using the beta (13-30 Hz) connectivity at encoding phase among the multiple frequency bands and task phases. Using the prestimulus beta connectivity, the classification accuracy of 72.45% ± 12.52% is also achieved. Among the features, the connectivity related to the dorsomedial prefrontal cortex was found to contribute to successful memory encoding. The connectivity related to the posterior cingulate cortex was found to contribute to the failure of memory encoding. The present study showed for the first time the successful prediction with high accuracy of subsequent memory outcome using single-trial functional connectivity.

Neural dynamics of sentiment processing during naturalistic sentence reading

When we read, our eyes move through the text in a series of fixations and high-velocity saccades to extract visual information. This process allows the brain to obtain meaning, e.g., about sentiment, or the emotional valence, expressed in the written text. How exactly the brain extracts the sentiment of single words during naturalistic reading is largely unknown. This is due to the challenges of naturalistic imaging, which has previously led researchers to employ highly controlled, timed word-by-word presentations of custom reading materials that lack ecological validity. Here, we aimed to assess the electrical neural correlates of word sentiment processing during naturalistic reading of English sentences. We used a publicly available dataset of simultaneous electroencephalography (EEG), eye-tracking recordings, and word-level semantic annotations from 7129 words in 400 sentences (Zurich Cognitive Language Processing Corpus; Hollenstein et al., 2018). We computed fixation-related potentials (FRPs), which are evoked electrical responses time-locked to the onset of fixations. A general linear mixed model analysis of FRPs cleaned from visual- and motor-evoked activity showed a topographical difference between the positive and negative sentiment condition in the 224-304 ​ms interval after fixation onset in left-central and right-posterior electrode clusters. An additional analysis that included word-, phrase-, and sentence-level sentiment predictors showed the same FRP differences for the word-level sentiment, but no additional FRP differences for phrase- and sentence-level sentiment. Furthermore, decoding analysis that classified word sentiment (positive or negative) from sentiment-matched 40-trial average FRPs showed a 0.60 average accuracy (95% confidence interval: [0.58, 0.61]). Control analyses ruled out that these results were based on differences in eye movements or linguistic features other than word sentiment. Our results extend previous research by showing that the emotional valence of lexico-semantic stimuli evoke a fast electrical neural response upon word fixation during naturalistic reading. These results provide an important step to identify the neural processes of lexico-semantic processing in ecologically valid conditions and can serve to improve computer algorithms for natural language processing.

Brain activation patterns associated with paragraph learning in persons with multiple sclerosis: The MEMREHAB trial

The modified Story Memory Technique (mSMT) is a memory rehabilitation program that combines training in visualization and context formation to improve learning and memory. Previous studies have shown improvement in learning and memory in individuals with multiple sclerosis (MS) after undergoing the mSMT, including changes in brain activity related to working memory and word encoding. The current study examined changes in brain activity in 16 individuals diagnosed with MS (n _treatment = 6; n _{placebo control} = 10) when they were presented with to-be-remembered information within a meaningful context (i.e. a paragraph) from before to after mSMT treatment. We expected treatment-related changes in brain activation in the language network (LAN), default mode network (DMN), and executive control network (ECN). Consistent with this prediction, fMRI results revealed reduced brain activation in the LAN, DMN and ECN after completing the mSMT treatment in the context of paragraph learning. While no significant behavioral changes were observed, a marginally significant improvement with a large effect size was noted between baseline and follow-up performance on the Rivermead Behavioral Memory Test in persons who completed treatment. Results are discussed in terms of the impact of imagery training on patterns of cerebral activation when learning words presented within a context.

Advancing Our Understandings of Healthcare Team Dynamics From the Simulation Room to the Operating Room: A Neurodynamic Perspective

The initial models of team and team member dynamics using biometric data in healthcare will likely come from simulations. But how confident are we that the simulation-derived high-resolution dynamics will reflect those of teams working with live patients? We have developed neurodynamic models of a neurosurgery team while they performed a peroneal nerve decompression surgery on a patient to approach this question. The models were constructed from EEG-derived measures that provided second-by-second estimates of the neurodynamic responses of the team and team members to task uncertainty. The anesthesiologist and two neurosurgeons developed peaks, often coordinated, of elevated neurodynamic organization during the patient preparation and surgery which were similar to those seen during simulation training, and which occurred near important episodes of the patient preparation and surgery. As the analyses moved down the neurodynamic hierarchy, and the simulation and live patient neurodynamics occurring during the intubation procedure were compared at progressively smaller time scales, differences emerged across scalp locations and EEG frequencies. The most significant was the pronounced suppression of gamma rhythms detected by the frontal scalp sensors during the live patient intubation which was absent in simulation trials of the intubation procedure. These results indicate that while profiles of the second-by-second neurodynamics of teams were similar in both the simulation and live patient environments, a deeper analysis revealed differences in the EEG frequencies and scalp locations of the signals responsible for those team dynamics. As measures of individual and team performance become more micro-scale and dynamic, and simulations become extended into virtual environments, these results argue for the need for parallel studies in live environments to validate the dynamics of cognition being observed.