Perception-action integration in young age-A cross-sectional EEG study

Separating binding and retrieval of event files in older adults

In the literature on human action control, it is assumed that features of stimuli (S) and responses (R) are integrated into internal representations (so-called event files) that are involved in the execution of an action. Experimentally, the impact of this integration on action control is typically analyzed via S-R binding effects. Recent theorizing in the BRAC framework (Frings et al., 2020) suggests to disentangle the processes of S-R binding proper from S-R retrieval as two independent components contributing to S-R binding effects. Since the literature on age effects on S-R binding effects is scarce and does not provide information on whether the existing findings about the two processes can be generalized to older age groups, this is the first study addressing the effects of older age separately on S-R binding proper vs. S-R retrieval. In two established variants of S-R binding tasks (cumulative n = 262), we contrasted binding (by using a saliency manipulation at the time of binding proper) versus retrieval processes (by manipulating the onset of the distractor at the time of retrieval), replicating previous results in younger (18-30 years) and also in older healthy controls (50-70 years). We therefore found no evidence for age effects on S-R binding proper or S-R retrieval. We thus conclude that the processes contributing to S-R binding effects are - at least in the age groups analyzed in this study - robust and age-independent. STATEMENT OF SIGNIFICANCE: In human action control, binding proper and retrieval of features in stimulus-response episodes typically lead to so-called S-R binding effects. Against the background of recent theorizing, binding proper and retrieval should be studied independently. In this article, we ran a younger and an older age group and analyzed possible age-related differences in integration or retrieval. Both groups showed the expected pattern for binding and retrieval as expected from the literature.

Neurophysiological processes reflecting the effects of the immediate past during the dynamic management of actions

In recent years, there has been many efforts to establish a comprehensive theoretical framework explaining the working mechanisms involved in perception-action integration. This framework stresses the importance of the immediate past on mechanisms supporting perception-action integration. The present study investigates the neurophysiological principles of dynamic perception-action bindings, particularly considering the influence of the immediate history on action control mechanisms. For this purpose, we conducted an established stimulus-response binding paradigm during EEG recording. The SR-task measures stimulus-response binding in terms of accuracy and reaction time differences depending on the degree of feature overlap between conditions. Alpha, beta and theta band activity in distinct time domains as well as associated brain regions were investigated applying time-frequency analyses, a beamforming approach as well as correlation analyses. We demonstrate, for the first time, interdependencies of neuronal processes relying on the immediate past. The reconfiguration of an action seems to overwrite immediately preceding processes. The analyses revealed modulations of theta (TBA), alpha (ABA) and beta band activity (BBA) in connection with fronto-temporal structures supporting the theoretical assumptions of the considered conceptual framework. The close interplay of attentional modulation by gating irrelevant information (ABA) and binding and retrieval processes (TBA) is reflected by the correlation of ABA in all pre-probe-intervals with post-probe TBA. Likewise, the role of BBA in maintaining the event file until retrieval is corroborated by BBA preceding the TBA-associated retrieval of perception-action codes. Following action execution, TBA shifted towards visual association cortices probably reflecting preparation for upcoming information, while ABA and BBA continue to reflect processes of attentional control and information selection for goal-directed behavior. The present work provides the first empirical support for concepts about the neurophysiological mechanisms of dynamic management of perception and action.

Preserved perception-action integration in adolescents after a COVID-19 infection

Evidence is accumulating that the Coronavirus disease (COVID-19) can bring forth deficits in executive functioning via alterations in the dopaminergic system. Importantly, dopaminergic pathways have been shown to modulate how actions and perceptions are integrated within the brain. Such alterations in event file binding could thus underlie the cognitive deficits developing after a COVID-19 infection. We examined action-perception integration in a group of young people (11-19 years of age) that had been infected with COVID-19 before study participation (n = 34) and compared them to a group of uninfected healthy controls (n = 29) on the behavioral (i.e., task accuracy, reaction time) and neurophysiological (EEG) level using an established event file binding paradigm. Groups did not differ from each other regarding demographic variables or in reporting psychiatric symptoms. Overall, multiple lines of evidence (behavioral and neurophysiological) suggest that action-perception integration is preserved in adolescents who suffered from COVID-19 prior to study participation. Event file binding processes were intact in both groups on all levels. While cognitive impairments can occur following a COVID-19 infection, the study demonstrates that action-perception integration as one of the basic building blocks of cognition seems to be largely unaffected in adolescents with a rather mild course of the disease.

Perception-Action Integration Is Altered in Functional Movement Disorders

BACKGROUND

Although functional neurological movement disorders (FMD) are characterized by motor symptoms, sensory processing has also been shown to be disturbed. However, how the integration of perception and motor processes, essential for the control of goal-directed behavior, is altered in patients with FMD is less clear. A detailed investigation of these processes is crucial to foster a better understanding of the pathophysiology of FMD and can systematically be achieved in the framework of the theory of event coding (TEC).

OBJECTIVE

The aim was to investigate perception-action integration processes on a behavioral and neurophysiological level in patients with FMD.

METHODS

A total of 21 patients and 21 controls were investigated with a TEC-related task, including concomitant electroencephalogram (EEG) recording. We focused on EEG correlates established to reflect perception-action integration processes. Temporal decomposition allowed to distinguish between EEG codes reflecting sensory (S-cluster), motor (R-cluster), and integrated sensory-motor processing (C-cluster). We also applied source localization analyses.

RESULTS

Behaviorally, patients revealed stronger binding between perception and action, as evidenced by difficulties in reconfiguring previously established stimulus-response associations. Such hyperbinding was paralleled by a modulation of neuronal activity clusters, including reduced C-cluster modulations of the inferior parietal cortex and altered R-cluster modulations in the inferior frontal gyrus. Correlations of these modulations with symptom severity were also evident.

CONCLUSIONS

Our study shows that FMD is characterized by altered integration of sensory information with motor processes. Relations between clinical severity and both behavioral performance and neurophysiological abnormalities indicate that perception-action integration processes are central and a promising concept for the understanding of FMD. © 2023 The Authors. Movement Disorders published by Wiley Periodicals LLC on behalf of International Parkinson and Movement Disorder Society.

Towards a systematization of brain oscillatory activity in actions

Information processing in the brain is governed by oscillatory activity. Activity oscillations in specific frequency bands (theta, alpha, beta and gamma) have been associated with various cognitive functions. A drawback of this is that the plethora of findings led to considerable uncertainty as to the functional relevance of activity in different frequency bands and their interrelation. Here, we use a novel cognitive-science theoretical framework to better understand and conceptually harmonize neurophysiological research on human action control. We outline how this validated starting point can systematize and probably reframe the functional relevance of oscillatory activity relevant for action control and beyond.

Neurophysiological principles of inhibitory control processes during cognitive flexibility

Inhibitory control plays an indispensable role in cognitive flexibility. Nevertheless, the neurophysiological principles underlying this are incompletely understood. This owes to the fact that the representational dynamics, as coded in oscillatory neural activity of different frequency bands has not been considered until now-despite being of conceptual relevance. Moreover, it is unclear in how far distinct functional neuroanatomical regions are concomitantly involved in the processing of representational dynamics. We examine these questions using a combination of EEG methods. We show that theta-band activity plays an essential role for inhibitory control processes during cognitive flexibility across informational aspects coded in distinct fractions of the neurophysiological signal. It is shown that posterior parietal structures and the inferior parietal cortex seem to be the most important cortical region for inhibitory control processes during cognitive flexibility. Theta-band activity plays an essential role in processes of retrieving the previously inhibited representations related to the current task during cognitive flexibility. The representational content relevant for inhibitory processes during cognitive flexibility is coded in the theta frequency band. We outline how the observed neural mechanisms inform recent overarching cognitive frameworks on how flexible action control is accomplished.

Evidence for independent representational contents in inhibitory control subprocesses associated with frontoparietal cortices

Inhibitory control processes have intensively been studied in cognitive science for the past decades. Even though the neural dynamics underlying these processes are increasingly better understood, a critical open question is how the representational dynamics of the inhibitory control processes are modulated when engaging in response inhibition in a relatively automatic or a controlled mode. Against the background of an overarching theory of perception-action integration, we combine temporal and spatial EEG signal decomposition methods with multivariate pattern analysis and source localization to obtain fine-grained insights into the neural dynamics of the representational content of response inhibition. For this purpose, we used a sample of N = 40 healthy adult participants. The behavioural data suggest that response inhibition was better in a more controlled than a more automated response execution mode. Regarding neural dynamics, effects of response inhibition modes relied on a concomitant coding of stimulus-related information and rules of how stimulus information is related to the appropriate motor programme. Crucially, these fractions of information, which are encoded at the same time in the neurophysiological signal, are based on two independent spatial neurophysiological activity patterns, also showing differences in the temporal stability of the representational content. Source localizations revealed that the precuneus and inferior parietal cortex regions are more relevant than prefrontal areas for the representation of stimulus-response selection codes. We provide a blueprint how a concatenation of EEG signal analysis methods, capturing distinct aspects of neural dynamics, can be connected to cognitive science theory on the importance of representations in action control.

On the Role of Memory Representations in Action Control: Neurophysiological Decoding Reveals the Reactivation of Integrated Stimulus-Response Feature Representations

Efficient response selection is essential to flexible, goal-directed behavior. Prominent theoretical frameworks such as the Theory of Event Coding and Binding and Retrieval in Action Control have provided insights regarding the dynamics of perception-action integration processes. According to Theory of Event Coding and Binding and Retrieval in Action Control, encoded representations of stimulus-response bindings influence later retrieval processes of these bindings. However, this concept still lacks conclusive empirical evidence. In the current study, we applied representational decoding to EEG data. On the behavioral level, the findings replicated binding effects that have been established in previous studies: The task performance was impaired when an event file had to be reconfigured. The EEG-decoding results showed that retrieval processes of stimulus-response bindings could be decoded using the representational content developed after the initial establishment of these stimulus-response bindings. We showed that stimulus-related properties became immediately reactivated when re-encountering the respective stimulus-response association. These reactivations were temporally stable. In contrast, representations of stimulus-response mappings revealed a transient pattern of activity and could not successfully be decoded directly after stimulus-response binding. Information detailing the bindings between stimuli and responses were also retrieved, but only after having been loaded into a memory system. The current study supports the notion that stimulus-response integration and memory processes are intertwined at multiple levels.