Processing of embedded response plans is modulated by an interplay of fronto-parietal theta and beta activity

Neurophysiological principles underlying predictive coding during dynamic perception-action integration

A major concept in cognitive neuroscience is that brains are "prediction machines". Yet, conceptual frameworks on how perception and action become integrated still lack the concept of predictability and it is unclear how neural processes may implement predictive coding during dynamic perception-action integration. We show that distinct neurophysiological mechanisms of nonlinearly directed connectivities in the theta and alpha band between cortical structures underlie these processes. During the integration of perception and motor codes, especially theta band activity in the insular cortex and temporo-hippocampal structures is modulated by the predictability of upcoming information. Here, the insular cortex seems to guide processes. Conversely, the retrieval of such integrated perception-action codes during actions heavily relies on alpha band activity. Here, directed top-down influence of alpha band activity from inferior frontal structures on insular and temporo-hippocampal structures is key. This suggests that these top-down effects reflect attentional shielding of retrieval processes operating in the same neuroanatomical structures previously involved in the integration of perceptual and motor codes. Through neurophysiology, the present study connects predictive coding mechanisms with frameworks specifying the dynamic integration of perception and action.

EEG tensor decomposition delineates neurophysiological principles underlying conflict-modulated action restraint and action cancellation

Executive functions are essential for adaptive behavior. One executive function is the so-called 'interference control' or conflict monitoring another one is inhibitory control (i.e., action restraint and action cancelation). Recent evidence suggests an interplay of these processes, which is conceptually relevant given that newer conceptual frameworks imply that nominally different action/response control processes are explainable by a small set of cognitive and neurophysiological processes. The existence of such overarching neural principles has as yet not directly been examined. In the current study, we therefore use EEG tensor decomposition methods, to look into possible common neurophysiological signatures underlying conflict-modulated action restraint and action cancelation as mechanism underlying response inhibition. We show how conflicts differentially modulate action restraint and action cancelation processes and delineate common and distinct neural processes underlying this interplay. Concerning the spatial information modulations are similar in terms of an importance of processes reflected by parieto-occipital electrodes, suggesting that attentional selection processes play a role. Especially theta and alpha activity seem to play important roles. The data also show that tensor decomposition is sensitive to the manner of task implementation, thereby suggesting that switch probability/transitional probabilities should be taken into consideration when choosing tensor decomposition as analysis method. The study provides a blueprint of how to use tensor decomposition methods to delineate common and distinct neural mechanisms underlying action control functions using EEG data.

Neural oscillations guiding action during effects imagery

Goal-directed acting requires the integration of sensory information but can also be performed without direct sensory input. Examples of this can be found in sports and can be conceptualized by feedforward processes. There is, however, still a lack of understanding of the temporal neural dynamics and neuroanatomical structures involved in such processes. In the current study, we used EEG beamforming methods and examined 37 healthy participants in two well-controlled experiments varying the necessity of anticipatory processes during goal-directed action. We found that alpha and beta activity in the medial and posterior cingulate cortex enabled feedforward predictions about the position of an object based on the latest sensorimotor state. On this basis, theta band activity seems more related to sensorimotor representations, while beta band activity would be more involved in setting up the structure of the neural representations themselves. Alpha band activity in sensory cortices reflects an intensified gating of the anticipated perceptual consequences of the to-be-executed action. Together, the findings indicate that goal-directed acting through the anticipation of the predicted state of an effector is based on accompanying processes in multiple frequency bands in midcingulate and sensory brain regions.

It's not distance but similarity of distance: changing stimulus relations affect the control of action sequences

Interacting with our environment happens on different levels of complexity: While there are individual and simple actions like an isolated button press, most actions are more complex and involve sequences of simpler actions. The degree to which multiple simple actions are represented as one action sequence can be measured via so-called response-response binding effects. When two or more responses are executed consecutively, they are integrated into one representation so that repetition of one response can start retrieval of the other. Executing such an action sequence typically involves responding to multiple objects or stimuli. Here, we investigated whether the spatial relation of these stimuli affects action sequence execution. To that end, we varied the distance between stimuli in a response-response binding task. Stimulus distance might affect response-response binding effects in one of two ways: It might directly affect the representation of the response sequence, making integration and retrieval between responses more likely if the responses relate to close stimuli. Alternatively, the similarity of stimulus distribution during integration and retrieval might be decisive, leading to larger binding effects if stimulus distance is identical during integration and retrieval. We found stronger binding effects with constant than with changing stimulus distance, indicating that action integration and retrieval can easily affect performance also if responses refer to separated objects. However, this effect on performance is diminished by changing spatial distribution of stimuli at the times of integration and retrieval.

Event segmentation in ADHD: neglect of social information and deviant theta activity point to a mechanism underlying ADHD

Background

Attention-deficit/hyperactivity disorder (ADHD) is one of the most frequently diagnosed psychiatric conditions in children and adolescents. Although the symptoms appear to be well described, no coherent conceptual mechanistic framework integrates their occurrence and variance and the associated problems that people with ADHD face.

Aims

The current study proposes that altered event segmentation processes provide a novel mechanistic framework for understanding deficits in ADHD.

Methods

Adolescents with ADHD and neurotypically developing (NT) peers watched a short movie and were then asked to indicate the boundaries between meaningful segments of the movie. Concomitantly recorded electroencephalography (EEG) data were analysed for differences in frequency band activity and effective connectivity between brain areas.

Results

Compared with their NT peers, the ADHD group showed less dependence of their segmentation behaviour on social information, indicating that they did not consider social information to the same extent as their unaffected peers. This divergence was accompanied by differences in EEG theta band activity and a different effective connectivity network architecture at the source level. Specifically, NT adolescents primarily showed error signalling in and between the left and right fusiform gyri related to social information processing, which was not the case in the ADHD group. For the ADHD group, the inferior frontal cortex associated with attentional sampling served as a hub instead, indicating problems in the deployment of attentional control.

Conclusions

This study shows that adolescents with ADHD perceive events differently from their NT peers, in association with a different brain network architecture that reflects less adaptation to the situation and problems in attentional sampling of environmental information. The results call for a novel conceptual view of ADHD, based on event segmentation theory.

Neurophysiological processes reflecting the effects of the immediate past during the dynamic management of actions

In recent years, there has been many efforts to establish a comprehensive theoretical framework explaining the working mechanisms involved in perception-action integration. This framework stresses the importance of the immediate past on mechanisms supporting perception-action integration. The present study investigates the neurophysiological principles of dynamic perception-action bindings, particularly considering the influence of the immediate history on action control mechanisms. For this purpose, we conducted an established stimulus-response binding paradigm during EEG recording. The SR-task measures stimulus-response binding in terms of accuracy and reaction time differences depending on the degree of feature overlap between conditions. Alpha, beta and theta band activity in distinct time domains as well as associated brain regions were investigated applying time-frequency analyses, a beamforming approach as well as correlation analyses. We demonstrate, for the first time, interdependencies of neuronal processes relying on the immediate past. The reconfiguration of an action seems to overwrite immediately preceding processes. The analyses revealed modulations of theta (TBA), alpha (ABA) and beta band activity (BBA) in connection with fronto-temporal structures supporting the theoretical assumptions of the considered conceptual framework. The close interplay of attentional modulation by gating irrelevant information (ABA) and binding and retrieval processes (TBA) is reflected by the correlation of ABA in all pre-probe-intervals with post-probe TBA. Likewise, the role of BBA in maintaining the event file until retrieval is corroborated by BBA preceding the TBA-associated retrieval of perception-action codes. Following action execution, TBA shifted towards visual association cortices probably reflecting preparation for upcoming information, while ABA and BBA continue to reflect processes of attentional control and information selection for goal-directed behavior. The present work provides the first empirical support for concepts about the neurophysiological mechanisms of dynamic management of perception and action.

The temporal dynamics of how the brain structures natural scenes

Individuals organize the evolving stream of events in their environment by partitioning it into discrete units. Event segmentation theory (EST) provides a cognitive explanation for the process of this partitioning. Critically, the underlying time-resolved neural mechanisms are not understood, and thus a central conceptual aspect of how humans implement this central ability is missing. To gain better insight into the fundamental temporal dynamics of event segmentation, EEG oscillatory activity was measured while participants watched a narrative video and partitioned the movie into meaningful segments. Using EEG beamforming methods, we show that theta, alpha, and beta band activity in frontal, parietal, and occipital areas, as well as their interactions, reflect critical elements of the event segmentation process established by EST. In sum, we see a mechanistic temporal chain of processes that provides the neurophysiological basis for how the brain partitions and structures continuously evolving scenes and points to an integrated system that organizes the various subprocesses of event segmentation. This study thus integrates neurophysiology and cognitive theory to better understand how the human brain operates in rather variable and unpredictable situations. Therefore, it represents an important step toward studying neurophysiological dynamics in ecologically valid and naturalistic settings and, in doing so, addresses a critical gap in knowledge regarding the temporal dynamics of how the brain structures natural scenes.

Turning the Light Switch on Binding: Prefrontal Activity for Binding and Retrieval in Action Control

According to action control theories, responding to a stimulus leads to the binding of response and stimulus features into a common representation, that is, an event file. Repeating any component of an event file retrieves all previously bound information, leading to performance costs for partial repetitions measured in so-called binding effects. Although otherwise robust and stable, binding effects are typically completely absent in "localization tasks," in which participants localize targets with spatially compatible responses. Yet, it is possible to observe binding effects in such when location features have to be translated into response features. We hypothesized that this modulation of binding effects is reflected in task involvement of the dorsolateral pFC (DLPFC). Participants localized targets with either direct (i.e., spatially compatible key) or translated (i.e., diagonally opposite to the spatially compatible key) responses. We measured DLPFC activity with functional near-infrared spectroscopy. On the behavioral level, we observed binding effects in the translated response condition, but not in the direct response condition. Importantly, prefrontal activity was also higher in the translated mapping condition. In addition, we found some evidence for the strength of the difference in binding effects in behavioral data being correlated with the corresponding effects in prefrontal activity. This suggests that activity in the DLPFC reflects the amount of executive control needed for translating location features into responses. More generally, binding effects seem to emerge only when the task at hand involves DLPFC recruitment.

Regular cannabis use alters the neural dynamics serving complex motor control

Cannabis is the most widely used recreational drug in the United States and regular use has been linked to deficits in attention and memory. However, the effects of regular use on motor control are less understood, with some studies showing deficits and others indicating normal performance. Eighteen users and 23 nonusers performed a motor sequencing task during high-density magnetoencephalography (MEG). The MEG data was transformed into the time-frequency domain and beta responses (16-24 Hz) during motor planning and execution phases were imaged separately using a beamformer approach. Whole-brain maps were examined for group (cannabis user/nonuser) and time window (planning/execution) effects. As expected, there were no group differences in task performance (e.g., reaction time, accuracy, etc.). Regular cannabis users exhibited stronger beta oscillations in the contralateral primary motor cortex compared to nonusers during the execution phase of the motor sequences, but not during the motor planning phase. Similar group-by-time window interactions were observed in the left superior parietal, right inferior frontal cortices, right posterior insular cortex, and the bilateral motor cortex. We observed differences in the neural dynamics serving motor control in regular cannabis users compared to nonusers, suggesting regular users may employ compensatory processing in both primary motor and higher-order motor cortices to maintain adequate task performance. Future studies will need to examine more complex motor control tasks to ascertain whether this putative compensatory activity eventually becomes exhausted and behavioral differences emerge.

The neurophysiology of continuous action monitoring

Monitoring actions is essential for goal-directed behavior. However, as opposed to short-lasting, and regularly reinstating monitoring functions, the neural processes underlying continuous action monitoring are poorly understood. We investigate this using a pursuit-tracking paradigm. We show that beta band activity likely maintains the sensorimotor program, while theta and alpha bands probably support attentional sampling and information gating, respectively. Alpha and beta band activity are most relevant during the initial tracking period, when sensorimotor calibrations are most intense. Theta band shifts from parietal to frontal cortices throughout tracking, likely reflecting a shift in the functional relevance from attentional sampling to action monitoring. This study shows that resource allocation mechanisms in prefrontal areas and stimulus-response mapping processes in the parietal cortex are crucial for adapting sensorimotor processes. It fills a knowledge gap in understanding the neural processes underlying action monitoring and suggests new directions for examining sensorimotor integration in more naturalistic experiments.

A dissociable functional relevance of theta- and beta-band activities during complex sensorimotor integration

Sensorimotor integration processes play a central role in daily life and require that different sources of sensory information become integrated: i.e. the information related to the object being under control of the agent (i.e. indicator) and the information about the goal of acting. Yet, how this is accomplished on a neurophysiological level is contentious. We focus on the role of theta- and beta-band activities and examine which neuroanatomical structures are involved. Healthy participants (n = 41) performed 3 consecutive pursuit-tracking EEG experiments in which the source of visual information available for tracking was varied (i.e. that of the indicator and the goal of acting). The initial specification of indicator dynamics is determined through beta-band activity in parietal cortices. When information about the goal was not accessible, but operating the indicator was required nevertheless, this incurred increased theta-band activity in the superior frontal cortex, signaling a higher need for control. Later, theta- and beta-band activities encode distinct information within the ventral processing stream: Theta-band activity is affected by the indicator information, while beta-band activity is affected by the information about the action goal. Complex sensorimotor integration is realized through a cascade of theta- and beta-band activities in a ventral-stream-parieto-frontal network.

Unsigned surprise but not reward magnitude modulates the integration of motor elements during actions

It seems natural that motor responses unfold smoothly and that we are able to easily concatenate different components of movements to achieve goal-directed actions. Theoretical frameworks suggest that different motor features have to be bound to each other to achieve a coherent action. Yet, the nature of the "glue" (i.e., bindings) between elements constituting a motor sequence and enabling a smooth unfolding of motor acts is not well understood. We examined in how far motor feature bindings are affected by reward magnitude or the effects of an unsigned surprise signal. We show that the consistency of action file binding strength is modulated by unsigned surprise, but not by reward magnitude. On a conceptual and theoretical level, the results provide links between frameworks, which have until now not been brought into connection. In particular, theoretical accounts stating that only the unexpectedness (surprisingness) is essential for action control are connected to meta-control accounts of human action control.

Towards a systematization of brain oscillatory activity in actions

Information processing in the brain is governed by oscillatory activity. Activity oscillations in specific frequency bands (theta, alpha, beta and gamma) have been associated with various cognitive functions. A drawback of this is that the plethora of findings led to considerable uncertainty as to the functional relevance of activity in different frequency bands and their interrelation. Here, we use a novel cognitive-science theoretical framework to better understand and conceptually harmonize neurophysiological research on human action control. We outline how this validated starting point can systematize and probably reframe the functional relevance of oscillatory activity relevant for action control and beyond.

Neurophysiological principles of inhibitory control processes during cognitive flexibility

Inhibitory control plays an indispensable role in cognitive flexibility. Nevertheless, the neurophysiological principles underlying this are incompletely understood. This owes to the fact that the representational dynamics, as coded in oscillatory neural activity of different frequency bands has not been considered until now-despite being of conceptual relevance. Moreover, it is unclear in how far distinct functional neuroanatomical regions are concomitantly involved in the processing of representational dynamics. We examine these questions using a combination of EEG methods. We show that theta-band activity plays an essential role for inhibitory control processes during cognitive flexibility across informational aspects coded in distinct fractions of the neurophysiological signal. It is shown that posterior parietal structures and the inferior parietal cortex seem to be the most important cortical region for inhibitory control processes during cognitive flexibility. Theta-band activity plays an essential role in processes of retrieving the previously inhibited representations related to the current task during cognitive flexibility. The representational content relevant for inhibitory processes during cognitive flexibility is coded in the theta frequency band. We outline how the observed neural mechanisms inform recent overarching cognitive frameworks on how flexible action control is accomplished.