Connecting EEG signal decomposition and response selection processes using the theory of event coding framework

Neurophysiological and functional neuroanatomical coding of statistical and deterministic rule information during sequence learning

Humans are capable of acquiring multiple types of information presented in the same information stream. It has been suggested that at least two parallel learning processes are important during learning of sequential patterns-statistical learning and rule-based learning. Yet, the neurophysiological underpinnings of these parallel learning processes are not fully understood. To differentiate between the simultaneous mechanisms at the single trial level, we apply a temporal EEG signal decomposition approach together with sLORETA source localization method to delineate whether distinct statistical and rule-based learning codes can be distinguished in EEG data and can be related to distinct functional neuroanatomical structures. We demonstrate that concomitant but distinct aspects of information coded in the N2 time window play a role in these mechanisms: mismatch detection and response control underlie statistical learning and rule-based learning, respectively, albeit with different levels of time-sensitivity. Moreover, the effects of the two learning mechanisms in the different temporally decomposed clusters of neural activity also differed from each other in neural sources. Importantly, the right inferior frontal cortex (BA44) was specifically implicated in visuomotor statistical learning, confirming its role in the acquisition of transitional probabilities. In contrast, visuomotor rule-based learning was associated with the prefrontal gyrus (BA6). The results show how simultaneous learning mechanisms operate at the neurophysiological level and are orchestrated by distinct prefrontal cortical areas. The current findings deepen our understanding on the mechanisms of how humans are capable of learning multiple types of information from the same stimulus stream in a parallel fashion.

Watching the Brain as It (Un)Binds: Beta Synchronization Relates to Distractor-Response Binding

Human action control relies on event files, that is, short-term stimulus-response bindings that result from the integration of perception and action. The present EEG study examined oscillatory brain activities related to the integration and disintegration of event files in the distractor-response binding (DRB) task, which relies on a sequential prime-probe structure with orthogonal variation of distractor and response relations between prime and probe. Behavioral results indicated a DRB effect in RTs, which was moderated by the duration of the response-stimulus interval (RSI) between prime response and probe stimulus onset. Indeed, a DRB effect was observed for a short RSI of 500 msec but not for a longer RSI of 2000 msec, indicating disintegration of event files over time. EEG results revealed a positive correlation between individual DRB in the RSI-2000 condition and postmovement beta synchronization after both prime and probe responses. Beamformer analysis localized this correlation effect to the middle occipital gyrus, which also showed highest coherency with precentral and inferior parietal brain regions. Together, these findings suggest that postmovement beta synchronization is a marker of event file disintegration, with the left middle occipital gyrus being a hub region for stimulus-response bindings in the visual DRB task.

Event-related synchronization/desynchronization and functional neuroanatomical regions associated with fatigue effects on cognitive flexibility

Cognitive flexibility is an essential prerequisite for goal-directed behavior, and daily observations already show that it deteriorates when one is engaged in a task for a (too) long time. Yet, the neural mechanisms underlying such fatigability effect in cognitive flexibility are poorly understood. We examined how theta, alpha, and beta frequency event-related synchronization and desynchronization processes during cued memory-based task switching are modulated by time-on-task effects. We put special emphasis on the examination of functional neuroanatomical regions being associated with these modulations, using EEG beamforming. We show clear declines in task switching performance (increased switch costs) with time on task. For processes occurring before rule switching or repetition processes, we show that anticipatory attentional sampling and selection mechanisms associated with fronto-parietal structures are modulated by time-on-task effects but sensory areas (occipital cortex) also show fatigability-dependent modulations. After target stimulus presentation, the allocation of processing resources for response selection as reflected by theta-related activity in parietal cortices is compromised with time on task and similarly a concomitant increase in alpha and beta band-related attentional processing or gating mechanisms in frontal and occipital regions. Yet, considering the behavioral data showing an apparent decline in performance, this probably compensatory increase is still insufficient to allow reasonable performance. The same is likely the case for processes occurring before rule switching or repetition processes. Comparative analyses show that modulations of alpha band activity are as strongly modulated by fatigability as theta band activity. Implications of these findings for theoretical concepts on fatigability are discussed.NEW & NOTEWORTHY We examine the neurophysiological and functional neuroanatomical basis of fatigability in cognitive flexibility. We show that alpha and theta modulations in fronto-parietal and primary sensory areas are central for the understanding of fatigability effects in cognitive flexibility.

Somatosensory perception-action binding in Tourette syndrome

It is a common phenomenon that somatosensory sensations can trigger actions to alleviate experienced tension. Such “urges” are particularly relevant in patients with Gilles de la Tourette (GTS) syndrome since they often precede tics, the cardinal feature of this common neurodevelopmental disorder. Altered sensorimotor integration processes in GTS as well as evidence for increased binding of stimulus- and response-related features (“hyper-binding”) in the visual domain suggest enhanced perception–action binding also in the somatosensory modality. In the current study, the Theory of Event Coding (TEC) was used as an overarching cognitive framework to examine somatosensory-motor binding. For this purpose, a somatosensory-motor version of a task measuring stimulus–response binding (S-R task) was tested using electro-tactile stimuli. Contrary to the main hypothesis, there were no group differences in binding effects between GTS patients and healthy controls in the somatosensory-motor paradigm. Behavioral data did not indicate differences in binding between examined groups. These data can be interpreted such that a compensatory “downregulation” of increased somatosensory stimulus saliency, e.g., due to the occurrence of somatosensory urges and hypersensitivity to external stimuli, results in reduced binding with associated motor output, which brings binding to a “normal” level. Therefore, “hyper-binding” in GTS seems to be modality-specific.

Anodal tDCS modulates specific processing codes during conflict monitoring associated with superior and middle frontal cortices

Conflict monitoring processes are central for cognitive control. Neurophysiological correlates of conflict monitoring (i.e. the N2 ERP) likely represent a mixture of different cognitive processes. Based on theoretical considerations, we hypothesized that effects of anodal tDCS (atDCS) in superior frontal areas affect specific subprocesses in neurophysiological activity during conflict monitoring. To investigate this, young healthy adults performed a Simon task while EEG was recorded. atDCS and sham tDCS were applied in a single-blind, cross-over study design. Using temporal signal decomposition in combination with source localization analyses, we demonstrated that atDCS effects on cognitive control are very specific: the detrimental effect of atDCS on response speed was largest in case of response conflicts. This however only showed in aspects of the decomposed N2 component, reflecting stimulus-response translation processes. In contrast to this, stimulus-related aspects of the N2 as well as purely response-related processes were not modulated by atDCS. EEG source localization analyses revealed that the effect was likely driven by activity modulations in the superior frontal areas, including the supplementary motor cortex (BA6), as well as middle frontal (BA9) and medial frontal areas (BA32). atDCS did not modulate effects of proprioceptive information on hand position, even though this aspect is known to be processed within the same brain areas. Physiological effects of atDCS likely modulate specific aspects of information processing during cognitive control.

Affective Dysregulation in Children Is Associated With Difficulties in Response Control in Emotional Ambiguous Situations

BACKGROUND

Affective dysregulation (AD), or synonymously "irritability," is a transdiagnostic construct that serves as a diagnostic criterion in various childhood mental disorders. It is characterized by severe or persistent outbursts of anger and aggression. Emotional self-regulation is highly dependent on the ability to process relevant and ignore conflicting emotional information. Understanding neurophysiological mechanisms underlying impairment in AD may provide a starting point for research on pharmacological treatment options and evaluation of psychotherapeutic intervention.

METHODS

A total of 120 children 8 to 12 years of age (63 with AD and 57 typically developing) were examined using an emotional Stroop task. Signal-decomposed electroencephalographic recordings providing information about the affected sensory-perceptual, response selection, or motor information processing stage were combined with source localization.

RESULTS

Behavioral performance revealed dysfunctional cognitive-emotional conflict monitoring in children with AD, suggesting difficulties in differentiating between conflicting and nonconflicting cognitive-emotional information. This was confirmed by the electroencephalographic data showing that they cannot intensify response selection processes during conflicting cognitive-emotional situations. Typically developing children were able to do so and activated a functional-neuroanatomical network comprising the left inferior parietal cortex (Brodmann area 40), right middle frontal (Brodmann area 10), and right inferior/orbitofrontal (Brodmann area 47) regions. Purely sensory-perceptual selection and motor execution processes were not modulated in AD, as evidenced by Bayesian analyses.

CONCLUSIONS

Behavioral and electroencephalogram data suggest that children with AD cannot adequately modulate controlled response selection processes given emotionally ambiguous information. Which neurotransmitter systems underlie these deficits and how they can be improved are important questions for future research.

On the functional role of striatal and anterior cingulate GABA+ in stimulus-response binding

Successful response selection relies on constantly updating stimulus-response associations. The Theory of Event Coding (TEC) proposes that perception and action are conjointly coded in event files, for which fronto-striatal networks seem to play an important role. However, the exact neurobiochemical mechanism behind event file coding has remained unknown. We investigated the functional relevance of the striatal and anterior cingulate (ACC) GABAergic system using magnetic resonance spectroscopy (MRS). Specifically, the striatal and ACC concentrations of GABA+ referenced against N-acetylaspartate (NAA) were assessed in 35 young healthy males, who subsequently performed a standard event file task. As predicted by the TEC, the participants' responses were modulated by pre-established stimulus response bindings in event files. GABA+/NAA concentrations in the striatum and ACC were not correlated with the overall event binding effect. However, higher GABA+/NAA concentrations in the ACC were correlated with stronger event file binding processes in the early phase of the task. This association disappeared by the end of the task. Taken together, our findings show that striatal GABA+ levels does not seem to modulate event file binding, while ACC GABA+ seem to improve event file binding, but only as long as the participants have not yet gathered sufficient task experience. To the best of our knowledge, this is the first study providing direct evidence for the role of striatal and ACC GABA+ in stimulus-response bindings and thus insights into the brain structure-specific neurobiological aspects of the TEC.

Neurophysiological mechanisms underlying motor feature binding processes and representations

Coherent, voluntary action requires an integrated representation of these actions and their defining features. Although theories delineate how action integration requiring binding between different action features may be accomplished, the underlying neurophysiological mechanisms are largely elusive. The present study examined the neurophysiological mechanisms underlying binding processes in actions. To this end, we conducted EEG recordings and applied standard event-related potential analyses, temporal EEG signal decomposition and multivariate pattern analyses (MVPA). According to the code occupation account, an overlap between a planned and a to-be-performed action impairs performance. The level, to which performance is attenuated depends on the strength of binding of action features. This binding process then determines the representation of them, the so-called action files. We show that code occupation and bindings between action features specifically modulate processes preceding motor execution as showed by the stimulus-locked lateralized readiness potential (LRP). Conversely, motor execution processes reflected by the response-locked LRP were not modulated by action file binding. The temporal decomposition of the EEG signal, further distinguished between action file related processes: the planned response determining code occupation was reflected in general (voluntary) response selection but not in involuntary (response priming-related) activation. Moreover, MVPA on temporally decomposed neural signals indicated that action files are represented as a continuous chain of activations. Within this chain, inhibitory and response re-activation patterns can be distinguished. Taken together, the neurophysiological correlates of action file binding suggest that parallel, stimulus- and response-related pre-motor processes are responsible for the code occupation in the human motor system.

A neural noise account of Gilles de la Tourette syndrome

•

A neural noise account on Tourette syndrome is conceptualized.

•

We outline how neurophysiological methods can be used to test this account.

•

The neural noise account may lead to novel treatment options.

Tics, often preceded by premonitory urges, are the clinical hallmark of Tourette syndrome. They resemble spontaneous movements, but are exaggerated, repetitive and appear misplaced in a given communication context. Given that tics often go unnoticed, it has been suggested that they represent a surplus of action, or motor noise. In this conceptual position paper, we propose that tics and urges, but also patterns of the cognitive profile in Tourette syndrome might be explained by the principle of processing of neural noise and adaptation to it during information processing. We review evidence for this notion in the light of Tourette pathophysiology and outline why neurophysiological and imaging approaches are central to examine a possibly novel view on Tourette syndrome. We discuss how neurophysiological data at multiple levels of inspections, i.e., from local field potentials using intra-cranial recording to scalp-measured EEG data, in combination with imaging approaches, can be used to examine the neural noise account in Tourette syndrome. We outline what signal processing methods may be suitable for that. We argue that, as a starting point, the analysis of 1/f neural noise or scale-free activity may be suitable to investigate the role of neural noise and its adaptation during information processing in Tourette syndrome. We outline, how the neural noise perspective, if substantiated by further neurophysiological studies and re-analyses of existing data, may pave the way to novel interventions directly targeting neural noise levels and patterns in Tourette syndrome.

Neurophysiology of embedded response plans: age effects in action execution but not in feature integration from preadolescence to adulthood

Performing a goal-directed movement consists of a chain of complex preparatory mechanisms. Such planning especially requires integration (or binding) of various action features, a process that has been conceptualized in the "theory of event coding." Theoretical considerations and empirical research suggest that these processes are subject to developmental effects from adolescence to adulthood. The aim of the present study was to investigate age-related modulations in action feature binding processes and to shed light on underlying neurophysiological development from preadolescence to early adulthood. We examined a group of healthy participants (n = 61) between 10 and 30 yr of age, who performed a task that requires a series of bimanual response selections in an embedded paradigm. For an in-depth analysis of the underlying neural correlates, we applied EEG signal decomposition together with source localization analyses. Behavioral results across the whole group did not show binding effects in reaction times but in intraindividual response variability. From age 10 to 30 yr, there was a decrease in reaction times and reaction time variability but no age-related effect in action file binding. The latter were corroborated by Bayesian data analyses. On the brain level, the developmental effects on response selection were associated with activation modulations in the superior parietal cortex (BA7). The results show that mechanisms of action execution and speed, but not those of action feature binding, are subject to age-related changes between the age of 10 and 30 yr.NEW & NOTEWORTHY Different aspects of an action need to be integrated to allow smooth unfolding of behavior. We examine developmental effects in these processes and show that mechanisms of action execution and speed, but not those of action feature binding, are subject to age-related changes between the age of 10 and 30 yr.

Resting theta activity is associated with specific coding levels in event-related theta activity during conflict monitoring

Brain electrical activity in the theta frequency band is essential for cognitive control (e.g., during conflict monitoring), but is also evident in the resting state. The link between resting state theta activity and its relevance for theta-related neural mechanisms during cognitive control is still undetermined. Yet, theoretical considerations suggest that there may be a connection. To examine the link between resting state theta activity and conflict-related theta activity, we combined temporal EEG signal decomposition methods with time-frequency decomposition and beamforming methods in N = 86 healthy participants. Results indicate that resting state theta activity is closely associated with the strength of conflict-related neural activity at the level of ERPs and total theta power (consisting of phase-locked and nonphase-locked aspects of theta activity). The data reveal that resting state theta activity is related to a specific aspect of conflict-related theta activity, mainly in superior frontal regions and in the supplemental motor area (SMA, BA6) in particular. The signal decomposition showed that only stimulus-related, but not motor-response-related coding levels in the EEG signal and the event-related total theta activity were associated with resting theta activity. This specificity of effects may explain why the association between resting state theta activity and overt conflict monitoring performance may not be as strong as often assumed. The results suggest that resting state theta activity is particularly important to consider for input integration processes during cognitive control.

Gilles de la Tourette Syndrome-A Disorder of Action-Perception Integration

Gilles de la Tourette syndrome is a multifaceted and complex neuropsychiatric disorder. Given that tics as motor phenomena are the defining and cardinal feature of Tourette syndrome, it has long been conceptualized as a motor/movement disorder. However, considering premonitory urges preceding tics, hypersensitivity to external stimuli and abnormalities in sensorimotor integration perceptual processes also seem to be relevant in the pathophysiology of Tourette syndrome. In addition, tic expression depends on attention and tics can, at least partly and transiently, be controlled, so that cognitive processes need to be considered as well. Against this background, explanatory concepts should encompass not only the motor phenomenon tic but also perceptual and cognitive processes. Representing a comprehensive theory of the processing of perceptions and actions paying particular attention to their interdependency and the role of cognitive control, the Theory of Event Coding seems to be a suitable conceptual framework for the understanding of Tourette syndrome. In fact, recent data suggests that addressing the relation between actions (i.e., tics) and perceptions (i.e., sensory phenomena like premonitory urges) in the context of event coding allows to gaining relevant insights into perception-action coding in Tourette syndrome indicating that perception action binding is abnormally strong in this disorder.

Neurophysiological correlates of perception-action binding in the somatosensory system

Action control requires precisely and flexibly linking sensory input and motor output. This is true for both, visuo-motor and somatosensory-motor integration. However, while perception–action integration has been extensively investigated for the visual modality, data on how somatosensory and action-related information is associated are scarce. We use the Theory of Event Coding (TEC) as a framework to investigate perception–action integration in the somatosensory-motor domain. Based on studies examining the neural mechanisms underlying stimulus–response binding in the visuo-motor domain, the current study investigates binding mechanisms in the somatosensory-motor domain using EEG signal decomposition and source localization analyses. The present study clearly demonstrates binding between somatosensory stimulus and response features. Importantly, repetition benefits but no repetition costs are evident in the somatosensory modality, which differs from findings in the visual domain. EEG signal decomposition indicates that response selection mechanisms, rather than stimulus-related processes, account for the behavioral binding effects. This modulation is associated with activation differences in the left superior parietal cortex (BA 7), an important relay of sensorimotor integration.

Decoding Stimulus-Response Representations and Their Stability Using EEG-Based Multivariate Pattern Analysis

Goal-directed actions require proper associations between stimuli and response. This has been delineated by cognitive theory, for example, in the theory of event coding framework, which proposes that event files represent such bindings. Yet, how such event file representations are coded on a neurophysiological level is unknown. We close this gap combining temporal electroencephalography (EEG) signal decomposition methods and multivariate pattern analysis (MVPA). We show that undecomposed neurophysiological data is unsuitable to decode event file representations because different aspects of information coded in the neurophysiological signal reveal distinct and partly opposed dynamics in the representational content. This is confirmed by applying MVPA to temporal decomposed EEG data. After intermixed aspects of information in the EEG during response selection have been separated, a reliable examination of the event file’s representational content and its temporal stability was possible. We show that representations of stimulus–response bindings are activated and decay in a gradual manner and that event file representations resemble distributed neural activity. Especially representations of stimulus–response bindings, as well as stimulus-related representations, are coded and reveal temporal stability. Purely motor-related representations are not found in neurophysiological signals during event coding.

Connecting EEG signal decomposition and response selection processes using the theory of event coding framework

The neurophysiological mechanisms underlying the integration of perception and action are an important topic in cognitive neuroscience. Yet, connections between neurophysiology and cognitive theoretical frameworks have rarely been established. The theory of event coding (TEC) details how perceptions and actions are associated (bound) in a common representational domain (the “event file”), but the neurophysiological mechanisms underlying these processes are hardly understood. We used complementary neurophysiological methods to examine the neurophysiology of event file processing (i.e., event‐related potentials [ERPs], temporal EEG signal decomposition, EEG source localization, time‐frequency decomposition, EEG network analysis). We show that the P3 ERP component and activity modulations in inferior parietal regions (BA40) reflect event file binding processes. The relevance of this parietal region is corroborated by source localization of temporally decomposed EEG data. We also show that temporal EEG signal decomposition reveals a pattern of results suggesting that event file processes can be dissociated from pure stimulus and response‐related processes in the EEG signal. Importantly, it is also documented that event file binding processes are reflected by modulations in the network architecture of theta frequency band activity. That is, when stimulus–response bindings in event files hamper response selection this was associated with a less efficient theta network organization. A more efficient organization was evident when stimulus–response binding in event files facilitated response selection. Small‐world network measures seem to reflect event file processing. The results show how cognitive‐theoretical assumptions of TEC can directly be mapped to the neurophysiology of response selection.