Neurophysiological correlates of perception-action binding in the somatosensory system

Neurophysiological processes reflecting the effects of the immediate past during the dynamic management of actions

In recent years, there has been many efforts to establish a comprehensive theoretical framework explaining the working mechanisms involved in perception-action integration. This framework stresses the importance of the immediate past on mechanisms supporting perception-action integration. The present study investigates the neurophysiological principles of dynamic perception-action bindings, particularly considering the influence of the immediate history on action control mechanisms. For this purpose, we conducted an established stimulus-response binding paradigm during EEG recording. The SR-task measures stimulus-response binding in terms of accuracy and reaction time differences depending on the degree of feature overlap between conditions. Alpha, beta and theta band activity in distinct time domains as well as associated brain regions were investigated applying time-frequency analyses, a beamforming approach as well as correlation analyses. We demonstrate, for the first time, interdependencies of neuronal processes relying on the immediate past. The reconfiguration of an action seems to overwrite immediately preceding processes. The analyses revealed modulations of theta (TBA), alpha (ABA) and beta band activity (BBA) in connection with fronto-temporal structures supporting the theoretical assumptions of the considered conceptual framework. The close interplay of attentional modulation by gating irrelevant information (ABA) and binding and retrieval processes (TBA) is reflected by the correlation of ABA in all pre-probe-intervals with post-probe TBA. Likewise, the role of BBA in maintaining the event file until retrieval is corroborated by BBA preceding the TBA-associated retrieval of perception-action codes. Following action execution, TBA shifted towards visual association cortices probably reflecting preparation for upcoming information, while ABA and BBA continue to reflect processes of attentional control and information selection for goal-directed behavior. The present work provides the first empirical support for concepts about the neurophysiological mechanisms of dynamic management of perception and action.

What is left after an error? Towards a comprehensive account of goal-based binding and retrieval

The cognitive system readily detects and corrects erroneous actions by establishing episodic bindings between representations of the acted upon stimuli and the intended correct response. If these stimuli are encountered again, they trigger the retrieval of the correct response. Thus, binding and retrieval efficiently pave the way for future success. The current study set out to define the role of the erroneous response itself and explicit feedback for the error during these processes of goal-based binding and retrieval. Two experiments showed robust and similar binding and retrieval effects with and without feedback and pointed towards sustained activation of the unbound, erroneous response. The third experiment confirmed that the erroneous response is more readily available than a neutral alternative. Together, the results demonstrate that episodic binding biases future actions toward success, guided primarily through internal feedback processes, while the erroneous response still leaves detectable traces in human action control.

Illuminating the prefrontal neural correlates of action sequence disassembling in response-response binding

Execution of two independent actions in quick succession results in transient binding of these two actions. Subsequent repetition of any of these actions automatically retrieves the other. This process is probably fundamental for developing complex action sequences. However, rigid bindings between two actions are not always adaptive. Sometimes, it is necessary to repeat only one of the two previously executed actions. In such situations, stored action sequences must be disassembled, for the sake of flexibility. Exact mechanisms that allow for such an active unbinding of actions remain largely unknown, but it stands to reason, that some form of prefrontal executive control is necessary. Building on prior neuronal research that explored other forms of binding (e.g. between distractors and responses and abstract representations and responses), we explored middle and superior frontal correlates of -response binding in a sequential classification task with functional near-infrared spectroscopy. We found that anterior dorsolateral prefrontal cortex activity varied as a function of response-repetition condition. Activity in the right anterior dorsolateral prefrontal cortex correlated with changes in reaction times due to response-response binding. Our results indicate that the right anterior dorsolateral prefrontal cortex dismantles bindings between consecutive actions, whenever such bindings interfere with current action goals.

Activation of sensorimotor integration processes with a brain-computer interface

A BCI-controlled hand exoskeleton activates neuroplasticity mechanisms, promoting motor learning. The contribution of perception to this phenomenon is understudied. The aim of this study was to assess the impact of sensorimotor integration on the effectiveness of neurorehabilitation based on the learning of a hand opening movement by stroke patients using BCI and to investigate the effect of ideomotor training on spasticity in the paretic hand. The study was conducted in 58 patients (median age: 63 (22; 83) years) with traumatic brain injury, ischemic (76%) or hemorrhagic (24%) stroke in the preceding 2 (1.0; 12.0) months. The patients received 15 (12; 21) ideomotor training sessions with a BMI-controlled hand exoskeleton. Hand function was assessed before and after rehabilitation on the Fugl–Meyer, ARAT, Frenchay, FIM, Rivermead, and Ashworth scales. An increase in muscle strength was observed in 40% of patients during flexion and extension of the radiocarpal joint and in 29% of patients during the abduction and adduction of the joint. Muscle strength simultaneously increased during the abduction and adduction of the radiocarpal joint (p < 0.004). Ideomotor training is ineffective for reducing spasticity because no statistically significant reduction in muscle tone was detected. Improved motor performance of the paretic hand was positively correlated with improvements in daily activities. Motor training of the paretic hand with a robotic orthosis activates kinesthetic receptors, restores sensation and improves fine motor skills through better sensorimotor integration.

Watching the Brain as It (Un)Binds: Beta Synchronization Relates to Distractor-Response Binding

Human action control relies on event files, that is, short-term stimulus-response bindings that result from the integration of perception and action. The present EEG study examined oscillatory brain activities related to the integration and disintegration of event files in the distractor-response binding (DRB) task, which relies on a sequential prime-probe structure with orthogonal variation of distractor and response relations between prime and probe. Behavioral results indicated a DRB effect in RTs, which was moderated by the duration of the response-stimulus interval (RSI) between prime response and probe stimulus onset. Indeed, a DRB effect was observed for a short RSI of 500 msec but not for a longer RSI of 2000 msec, indicating disintegration of event files over time. EEG results revealed a positive correlation between individual DRB in the RSI-2000 condition and postmovement beta synchronization after both prime and probe responses. Beamformer analysis localized this correlation effect to the middle occipital gyrus, which also showed highest coherency with precentral and inferior parietal brain regions. Together, these findings suggest that postmovement beta synchronization is a marker of event file disintegration, with the left middle occipital gyrus being a hub region for stimulus-response bindings in the visual DRB task.

Somatosensory perception-action binding in Tourette syndrome

It is a common phenomenon that somatosensory sensations can trigger actions to alleviate experienced tension. Such “urges” are particularly relevant in patients with Gilles de la Tourette (GTS) syndrome since they often precede tics, the cardinal feature of this common neurodevelopmental disorder. Altered sensorimotor integration processes in GTS as well as evidence for increased binding of stimulus- and response-related features (“hyper-binding”) in the visual domain suggest enhanced perception–action binding also in the somatosensory modality. In the current study, the Theory of Event Coding (TEC) was used as an overarching cognitive framework to examine somatosensory-motor binding. For this purpose, a somatosensory-motor version of a task measuring stimulus–response binding (S-R task) was tested using electro-tactile stimuli. Contrary to the main hypothesis, there were no group differences in binding effects between GTS patients and healthy controls in the somatosensory-motor paradigm. Behavioral data did not indicate differences in binding between examined groups. These data can be interpreted such that a compensatory “downregulation” of increased somatosensory stimulus saliency, e.g., due to the occurrence of somatosensory urges and hypersensitivity to external stimuli, results in reduced binding with associated motor output, which brings binding to a “normal” level. Therefore, “hyper-binding” in GTS seems to be modality-specific.