Multi-level decoding of task sets in neurophysiological data during cognitive flexibility

The metacontrol of event segmentation-A neurophysiological and behavioral perspective

During our everyday life, the constant flow of information is divided into discrete events, a process conceptualized in Event Segmentation Theory (EST). How people perform event segmentation and the resulting granularity of encapsulated segments likely depends on their metacontrol style. Yet, the underlying neural mechanisms remain undetermined. The current study examines how the metacontrol style affects event segmentation through the analysis of EEG data using multivariate pattern analysis (MVPA) and source localization analysis. We instructed two groups of healthy participants to either segment a movie as fine-grained as possible (fine-grain group) or provided no such instruction (free-segmentation group). The fine-grain group showed more segments and a higher likelihood to set event boundaries upon scene changes, which supports the notion that cognitive control influences segmentation granularity. On a neural level, representational dynamics were decodable 400 ms prior to the decision to close a segment and open a new one, and especially fronto-polar regions (BA10) were associated with this representational dynamic. Groups differed in their use of this representational dynamics to guide behavior and there was a higher sensitivity to incoming information in the Fine-grain group. Moreover, a higher likelihood to set event boundaries was reflected by activity increases in the insular cortex suggesting an increased monitoring of potentially relevant upcoming events. The study connects the EST with the metacontrol framework and relates these to overarching neural concepts of prefrontal cortex function.

Carrier-frequency specific omission-related neural activity in ordered sound sequences is independent of omission-predictability

Regularities in our surroundings lead to predictions about upcoming events. Previous research has shown that omitted sounds during otherwise regular tone sequences elicit frequency-specific neural activity related to the upcoming but omitted tone. We tested whether this neural response is depending on the unpredictability of the omission. Therefore, we recorded magnetencephalography (MEG) data while participants listened to ordered or random tone sequences with omissions occurring either ordered or randomly. Using multivariate pattern analysis shows that the frequency-specific neural pattern during omission within ordered tone sequences occurs independent of the regularity of the omissions. These results suggest that the auditory predictions based on sensory experiences are not immediately updated by violations of those expectations.

Neural representations of statistical and rule-based predictions in Gilles de la Tourette syndrome

Gilles de la Tourette syndrome (GTS) is a disorder characterised by motor and vocal tics, which may represent habitual actions as a result of enhanced learning of associations between stimuli and responses (S-R). In this study, we investigated how adults with GTS and healthy controls (HC) learn two types of regularities in a sequence: statistics (non-adjacent probabilities) and rules (predefined order). Participants completed a visuomotor sequence learning task while EEG was recorded. To understand the neurophysiological underpinnings of these regularities in GTS, multivariate pattern analyses on the temporally decomposed EEG signal as well as sLORETA source localisation method were conducted. We found that people with GTS showed superior statistical learning but comparable rule-based learning compared to HC participants. Adults with GTS had different neural representations for both statistics and rules than HC adults; specifically, adults with GTS maintained the regularity representations longer and had more overlap between them than HCs. Moreover, over different time scales, distinct fronto-parietal structures contribute to statistical learning in the GTS and HC groups. We propose that hyper-learning in GTS is a consequence of the altered sensitivity to encode complex statistics, which might lead to habitual actions.

Interplay between alpha and theta band activity enables management of perception-action representations for goal-directed behavior

Goal-directed behavior requires integrated mental representations of perceptions and actions. The neurophysiological underpinnings of these processes, however, are not yet understood. It is particularly undetermined, which oscillatory activities in which brain regions are involved in the management of perception-action representations. We examine this question with a focus on response inhibition processes and show that the dynamics of perception-action representations reflected in theta band activity (TBA) are particularly evident in the supplementary motor area and the occipito-temporal cortex. Mental representations coded in alpha band activity (ABA) during perception-action integration are associated with the occipito-temporal cortex. Crucially, perception-action representations are exchanged between theta and alpha frequency bands. The results imply that ABA functions as dynamic top-down control over binding, retrieval and reconfiguration processes during response inhibition, which in turn are reflected by TBA. Our study thus highlights how the interplay of oscillatory activity enables the management of perception-action representations for goal-directed behavior.

Perception-action integration during inhibitory control is reflected in a concomitant multi-region processing of specific codes in the neurophysiological signal

The integration of perception and action has long been studied in psychological science using overarching cognitive frameworks. Despite these being very successful in explaining perception-action integration, little is known about its neurophysiological and especially the functional neuroanatomical foundations. It is unknown whether distinct brain structures are simultaneously involved in the processing of perception-action integration codes and also to what extent demands on perception-action integration modulate activities in these structures. We investigate these questions in an EEG study integrating temporal and ICA-based EEG signal decomposition with source localization. For this purpose, we used data from 32 healthy participants who performed a 'TEC Go/Nogo' task. We show that the EEG signal can be decomposed into components carrying different informational aspects or processing codes relevant for perception-action integration. Importantly, these specific codes are processed independently in different brain structures, and their specific roles during the processing of perception-action integration differ. Some regions (i.e., the anterior cingulate and insular cortex) take a 'default role' because these are not modulated in their activity by demands or the complexity of event file coding processes. In contrast, regions in the motor cortex, middle frontal, temporal, and superior parietal cortices were not activated by 'default' but revealed modulations depending on the complexity of perception-action integration (i.e., whether an event file has to be reconfigured). Perception-action integration thus reflects a multi-region processing of specific fractions of information in the neurophysiological signal. This needs to be taken into account when further developing a cognitive science framework detailing perception-action integration.

Neurophysiological principles of inhibitory control processes during cognitive flexibility

Inhibitory control plays an indispensable role in cognitive flexibility. Nevertheless, the neurophysiological principles underlying this are incompletely understood. This owes to the fact that the representational dynamics, as coded in oscillatory neural activity of different frequency bands has not been considered until now-despite being of conceptual relevance. Moreover, it is unclear in how far distinct functional neuroanatomical regions are concomitantly involved in the processing of representational dynamics. We examine these questions using a combination of EEG methods. We show that theta-band activity plays an essential role for inhibitory control processes during cognitive flexibility across informational aspects coded in distinct fractions of the neurophysiological signal. It is shown that posterior parietal structures and the inferior parietal cortex seem to be the most important cortical region for inhibitory control processes during cognitive flexibility. Theta-band activity plays an essential role in processes of retrieving the previously inhibited representations related to the current task during cognitive flexibility. The representational content relevant for inhibitory processes during cognitive flexibility is coded in the theta frequency band. We outline how the observed neural mechanisms inform recent overarching cognitive frameworks on how flexible action control is accomplished.

On the Role of Stimulus-Response Context in Inhibitory Control in Alcohol Use Disorder

The behavioral and neural dynamics of response inhibition deficits in alcohol use disorder (AUD) are still largely unclear, despite them possibly being key to the mechanistic understanding of the disorder. Our study investigated the effect of automatic vs. controlled processing during response inhibition in participants with mild-to-moderate AUD and matched healthy controls. For this, a Simon Nogo task was combined with EEG signal decomposition, multivariate pattern analysis (MVPA), and source localization methods. The final sample comprised n = 59 (32♂) AUD participants and n = 64 (28♂) control participants. Compared with the control group, AUD participants showed overall better response inhibition performance. Furthermore, the AUD group was less influenced by the modulatory effect of automatic vs. controlled processes during response inhibition (i.e., had a smaller Simon Nogo effect). The neurophysiological data revealed that the reduced Simon Nogo effect in the AUD group was associated with reduced activation differences between congruent and incongruent Nogo trials in the inferior and middle frontal gyrus. Notably, the drinking frequency (but not the number of AUD criteria we had used to distinguish groups) predicted the extent of the Simon Nogo effect. We suggest that the counterintuitive advantage of participants with mild-to-moderate AUD over those in the control group could be explained by the allostatic model of drinking effects.

Evidence for independent representational contents in inhibitory control subprocesses associated with frontoparietal cortices

Inhibitory control processes have intensively been studied in cognitive science for the past decades. Even though the neural dynamics underlying these processes are increasingly better understood, a critical open question is how the representational dynamics of the inhibitory control processes are modulated when engaging in response inhibition in a relatively automatic or a controlled mode. Against the background of an overarching theory of perception-action integration, we combine temporal and spatial EEG signal decomposition methods with multivariate pattern analysis and source localization to obtain fine-grained insights into the neural dynamics of the representational content of response inhibition. For this purpose, we used a sample of N = 40 healthy adult participants. The behavioural data suggest that response inhibition was better in a more controlled than a more automated response execution mode. Regarding neural dynamics, effects of response inhibition modes relied on a concomitant coding of stimulus-related information and rules of how stimulus information is related to the appropriate motor programme. Crucially, these fractions of information, which are encoded at the same time in the neurophysiological signal, are based on two independent spatial neurophysiological activity patterns, also showing differences in the temporal stability of the representational content. Source localizations revealed that the precuneus and inferior parietal cortex regions are more relevant than prefrontal areas for the representation of stimulus-response selection codes. We provide a blueprint how a concatenation of EEG signal analysis methods, capturing distinct aspects of neural dynamics, can be connected to cognitive science theory on the importance of representations in action control.

A ventral stream-prefrontal cortex processing cascade enables working memory gating dynamics

The representation of incoming information, goals and the flexible processing of these are required for cognitive control. Efficient mechanisms are needed to decide when it is important that novel information enters working memory (WM) and when these WM 'gates' have to be closed. Compared to neural foundations of maintaining information in WM, considerably less is known about what neural mechanisms underlie the representational dynamics during WM gating. Using different EEG analysis methods, we trace the path of mental representations along the human cortex during WM gate opening and closing. We show temporally nested representational dynamics during WM gate opening and closing depending on multiple independent neural activity profiles. These activity profiles are attributable to a ventral stream-prefrontal cortex processing cascade. The representational dynamics start in the ventral stream during WM gate opening and WM gate closing before prefrontal cortical regions are modulated. A regional specific activity profile is shown within the prefrontal cortex depending on whether WM gates are opened or closed, matching overarching concepts of prefrontal cortex functions. The study closes an essential conceptual gap detailing the neural dynamics underlying how mental representations drive the WM gate to open or close to enable WM functions such as updating and maintenance.

Cognitive science theory-driven pharmacology elucidates the neurobiological basis of perception-motor integration

An efficient integration of sensory and motor processes is crucial to goal-directed behavior. Despite this high relevance, and although cognitive theories provide clear conceptual frameworks, the neurobiological basis of these processes remains insufficiently understood. In a double-blind, randomized placebo-controlled pharmacological study, we examine the relevance of catecholamines for perception-motor integration processes. Using EEG data, we perform an in-depth analysis of the underlying neurophysiological mechanisms, focusing on sensorimotor integration processes during response inhibition. We show that the catecholaminergic system affects sensorimotor integration during response inhibition by modulating the stability of the representational content. Importantly, catecholamine levels do not affect the stability of all aspects of information processing during sensorimotor integration, but rather-as suggested by cognitive theory-of specific codes in the neurophysiological signal. Particularly fronto-parietal cortical regions are associated with the identified mechanisms. The study shows how cognitive science theory-driven pharmacology can shed light on the neurobiological basis of perception-motor integration and how catecholamines affect specific information codes relevant to cognitive control.

The neural stability of perception-motor representations affects action outcomes and behavioral adaptation

Actions can fail - even though this is well known, little is known about what distinguishes neurophysiological processes preceding errors and correct actions. In this study, relying on the Theory of Event Coding, we test the assumption that only specific aspects of information coded in EEG activity are relevant for understanding processes leading to response errors. We examined N = 69 healthy participants who performed a mental rotation task and combined temporal EEG signal decomposition with multivariate pattern analysis (MVPA) and source localization analyses. We show that fractions of the EEG signal, primarily representing stimulus-response translation (event file) processes and motor response representations, are essential. Stimulus representations were less critical. The source localization results revealed widespread activity modulations in structures including the frontopolar, the middle and superior frontal, the anterior cingulate cortex, the cuneus, the inferior parietal cortex, and the ventral stream regions. These are associated with differential effects of the neural dynamics preceding correct/erroneous responses. The temporal-generalization MVPA showed that event file representations and representations of the motor response were already distinct 200 ms after stimulus presentation and this lasted till around 700 ms. The stability of this representational content was predictive for the magnitude of posterror slowing, which was particularly strong when there was no clear distinction between the neural activity profile of event file representations associated with a correct or an erroneous response. The study provides a detailed analysis of the dynamics leading to an error/correct response in connection to an overarching framework on action control.

On the Role of Memory Representations in Action Control: Neurophysiological Decoding Reveals the Reactivation of Integrated Stimulus-Response Feature Representations

Efficient response selection is essential to flexible, goal-directed behavior. Prominent theoretical frameworks such as the Theory of Event Coding and Binding and Retrieval in Action Control have provided insights regarding the dynamics of perception-action integration processes. According to Theory of Event Coding and Binding and Retrieval in Action Control, encoded representations of stimulus-response bindings influence later retrieval processes of these bindings. However, this concept still lacks conclusive empirical evidence. In the current study, we applied representational decoding to EEG data. On the behavioral level, the findings replicated binding effects that have been established in previous studies: The task performance was impaired when an event file had to be reconfigured. The EEG-decoding results showed that retrieval processes of stimulus-response bindings could be decoded using the representational content developed after the initial establishment of these stimulus-response bindings. We showed that stimulus-related properties became immediately reactivated when re-encountering the respective stimulus-response association. These reactivations were temporally stable. In contrast, representations of stimulus-response mappings revealed a transient pattern of activity and could not successfully be decoded directly after stimulus-response binding. Information detailing the bindings between stimuli and responses were also retrieved, but only after having been loaded into a memory system. The current study supports the notion that stimulus-response integration and memory processes are intertwined at multiple levels.

Protocol to decode representations from EEG data with intermixed signals using temporal signal decomposition and multivariate pattern-analysis

The electroencephalogram (EEG) is one of the most widely used techniques in cognitive neuroscience. We present a protocol showing how to combine a temporal signal decomposition approach (RIDE, Residue iteration decomposition) with multivariate pattern analysis (MVPA) to obtain insights into the temporal stability of representations coded in distinct informational fractions of the EEG signal. In this protocol, we describe pre-processing of human EEG data, followed by the set-up and use of MATLAB-based toolboxes for RIDE and MVPA analysis.

For complete details on the use and execution of this protocol, please refer to Petruo et al. (2021).

•

A protocol for decoding temporally decomposed EEG signal

•

Steps for Residue iteration decomposition (RIDE) and handling the decomposed data

•

Steps for subsequent multivariate pattern analysis (MVPA) with different toolboxes

•

Recommendations for combined RIDE-MVPA research applications

Publisher’s note: Undertaking any experimental protocol requires adherence to local institutional guidelines for laboratory safety and ethics.

Flexible engineering of advanced phase change materials

Liquid phase leakage, intrinsic rigidity, and easy brittle failure are the longstanding bottlenecks of phase change materials (PCMs) for thermal energy storage, which seriously hinder their widespread applications in advanced energy-efficient systems. Emerging flexible composite PCMs that are capable of enduring certain deformation and guaranteeing superior mutual contact with integrated devices are considered as a cutting-edge effective solution. Flexible PCMs-based thermal regulation technology can reallocate thermal energy and regulate the temperature within an optimal range. Currently, tireless efforts are devoted to the development of versatile flexible PCMs-based thermal regulation devices, and a big step forward has been taken. Herein, we systematically outline fabrication techniques, flexibility evaluation strategies, advanced functions and advances of flexible composite PCMs. Furthermore, existing challenges and future perspectives are provided in terms of flexible PCMs-based thermal regulation techniques. This insightful review aims to provide an in-depth understanding and constructive guidance of engineering advanced flexible multifunctional PCMs.