Voluntary Actions Modulate Perception and Neural Representation of Action-Consequences in a Hand-Dependent Manner

What the visual system can learn from the non-dominant hand: The effect of graphomotor engagement on visual discrimination

Previous studies have demonstrated that engaging in graphomotor activity for creating graphemes can enhance their subsequent visual discrimination. This suggests a positive influence of the motor system on visual learning. However, existing studies have emphasized the dominant hand, which is superiorly dexterous in fine-motor movements. This near-exclusive focus prompts the inquiry of whether the observed perceptual facilitation is a general characteristic of the motor system, or specific to pathways controlling the skilled over-trained dominant hand. Furthermore, the mechanistic underpinning of visual facilitation from graphomotor training (i.e., the individual contribution of motor activity, temporal evolution of the visual trace, variability of visual output) remain unclear. To address these questions, we assessed visual discrimination capabilities of healthy right-handed participants (N = 60) before and after graphomotor or visual training. Contrary to our initial expectation, graphomotor engagement with the non-dominant hand did not yield additional benefits to visual learning beyond those attainable through visual training alone. Moreover, graphomotor training with the non-dominant hand resulted in visual discrimination improvements comparable to those of dominant hand training, despite the inherent differences between hands in motor performance and in the amount of improvement in shape tracing throughout training. We conclude that the motor components of graphomotor activity may not be critical for visual learning of shapes through tracing activity. Instead, our results are in agreement with the symbolic theoretical account, suggesting that basic shape features required for discrimination can be acquired through visual inspection alone, providing a perspective on the improvements observed in prior studies.

Voluntary blinks and eye-widenings, but not spontaneous blinks, facilitate perceptual alternation during continuous flash suppression

The fact that blinks occur more often than necessary for ocular lubrication has led to the proposal that blinks are involved in altering some aspects of visual cognition. Previous studies have suggested that blinking can modulate the alternation of different visual interpretations of the same stimulus, that is, perceptual alternation in multistable perception. This study investigated whether and how different types of blinks, spontaneous and voluntary, interact with perceptual alternation in a multistable perception paradigm called continuous flash suppression. The results showed that voluntary blinking facilitated perceptual alternation, whereas spontaneous blinking did not. Moreover, voluntary eye-widening, as well as eyelid closing, facilitated perceptual alternation. Physical blackouts, which had timing and duration comparable to those of voluntary blinks, did not produce facilitatory effects. These findings suggest that the effects of voluntary eyelid movements are mediated by extraretinal processes and are consistent with previous findings that different types of blinks are at least partially mediated by different neurophysiological processes. Furthermore, perceptual alternation was also found to facilitate spontaneous blinking. These results indicate that eyelid movements and perceptual alternation interact reciprocally with each other.

High or low expectations: Expected intensity of action outcome is embedded in action kinetics

Goal-directed actions are performed in order to attain certain sensory consequences in the world. However, expected attributes of these consequences can affect the kinetics of the action. In a set of three studies (n = 120), we examined how expected attributes of stimulus outcome (intensity) shape the kinetics of the triggering action (applied force), even when the action kinetic and attribute are independent. We show that during action execution (button presses), the expected intensity of sensory outcome affects the applied force of the stimulus-producing action in an inverse fashion. Thus, participants applied more force when the expected intensity of the outcome was low (vs. high intensity outcome). In the absence of expectations or when actions were performed in response to the sensory event, no intensity-dependent force modulations were found. Thus, expectations of stimulus intensity and causality play an important role in shaping action kinetics. Finally, we examined the relationship between kinetics and perception and found no influence of applied force level on perceptual detection of low intensity (near-threshold) outcome stimuli, suggesting no causal link between the two. Taken together, our results demonstrate that action kinetics are embedded with high-level context such as the expectation of consequence intensity and the causal relationship with environmental cues.

Motor dominance and movement-outcome congruency influence the electrophysiological correlates of sensory attenuation for self-induced visual stimuli

This study explores the impact of movement-outcome congruency and motor dominance on the action-associated modulations of early visual event-related potentials (ERPs). Employing the contingent paradigm, participants with varying degrees of motor dominance were exposed to stimuli depicting left or right human hands in the corresponding visual hemifields. Stimuli were either passively observed or evoked by voluntary button-presses with the dominant or non-dominant hand, in a manner that was either congruent or incongruent with stimulus laterality and hemifield. Early occipital responses (C1 and P1 components) revealed modulations consistent with sensory attenuation (SA) for self-evoked stimuli. Our findings suggest that sensory attenuation during the initial stages of visual processing (C1 component) is a general phenomenon across all degrees of handedness and stimulus/movement combinations. However, the magnitude of C1 suppression was modulated by handedness and movement-stimulus congruency, reflecting stronger SA in right-handed participants for stimuli depicting the right hand, when elicited by actions of the corresponding hand, and measured above the contralateral occipital lobe. P1 modulation suggested concurrent but opposing influences of attention and sensory prediction, with more pronounced suppression following stimulus-congruent button-presses over the hemisphere contralateral to movement, especially in left-handed individuals. We suggest that effects of motor dominance on the degree of SA may stem from functional/anatomical asymmetries in the processing of body parts (C1) and attention networks (P1). Overall, our results demonstrate the modulating effect of hand dominance and movement-outcome congruency on SA, underscoring the need for deeper exploration of their interplay. Additional empirical evidence in this direction could substantiate a premotor account for action-associated modulation of early sensory processing in the visual domain.

Temporal hierarchy of observed goal-directed actions

During social interactions, we continuously integrate current and previous information over varying timescales to infer other people's action intentions. Motor cognition theories argue for a hierarchical organization of goal-directed actions based on temporal scales. Accordingly, transient motor primitives are represented at lower levels of the hierarchy, a combination of primitives building motor sequences at subordinate levels, and more stable overarching action goals at superordinate levels. A neural topography of hierarchal timescales for information accumulation was previously shown in the visual and auditory domains. However, whether such a temporal hierarchy can also account for observed goal-directed action representations in motor pathways remains to be determined. Thus, the current study examined the neural architecture underlying the processing of observed goal-directed actions using inter-subject correlation (ISC) of fMRI activity. Observers (n = 24) viewed sequential hand movements presented in their intact order or piecewise scrambled at three timescales pertaining to goal-directed action evolution (Primitives: ± 1.5 s, Sub-Goals: ± 4 s, and High-Goals: ± 10 s). The results revealed differential intrinsic temporal capacities for integrating goal-directed action information across brain areas engaged in action observation. Longer timescales (> ± 10 s) were found in the posterior parietal and dorsal premotor compared to the ventral premotor (± 4 s) and anterior parietal (± 1.5 s) cortex. Moreover, our results revealed a hemispheric bias with more extended timescales in the right MT+, primary somatosensory, and early visual cortices compared to their homotopic regions in the left hemisphere. Our findings corroborate a hierarchical neural mapping of observed actions based on temporal scales of goals and provide further support for a ubiquitous time-dependent neural organization of information processing across multiple modalities.

Playing with your ears: Audio-motor skill learning is sensitive to the lateral relationship between trained hand and ear

A salient feature of motor and sensory circuits in the brain is their contralateral hemispheric bias-a feature that might play a role in integration and learning of sensorimotor skills. In the current behavioral study, we examined whether the lateral configuration between sound-producing hand and feedback-receiving ear affects performance and learning of an audio-motor skill. Right-handed participants (n = 117) trained to play a piano sequence using their right or left hand while auditory feedback was presented monaurally, either to the right or left ear. Participants receiving auditory feedback to the contralateral ear during training performed better than participants receiving ipsilateral feedback (with respect to the training hand). Furthermore, in the Left-Hand training groups, the contralateral training advantage persisted in a generalization task. Our results demonstrate that audio-motor learning is sensitive to the lateral configuration between motor and sensory circuits and suggest that integration of neural activity across hemispheres facilitates such learning.

Same Action, Different Meaning: Neural Substrates of Action Semantic Meaning

Voluntary actions are shaped by desired goals and internal intentions. Multiple factors, including the planning of subsequent actions and the expectation of sensory outcome, were shown to modulate kinetics and neural activity patterns associated with similar goal-directed actions. Notably, in many real-world tasks, actions can also vary across the semantic meaning they convey, although little is known about how semantic meaning modulates associated neurobehavioral measures. Here, we examined how behavioral and functional magnetic resonance imaging measures are modulated when subjects execute similar actions (button presses) for two different semantic meanings-to answer "yes" or "no" to a binary question. Our findings reveal that, when subjects answer using their right hand, the two semantic meanings are differentiated based on voxel patterns in the frontoparietal cortex and lateral-occipital complex bilaterally. When using their left hand, similar regions were found, albeit only with a more liberal threshold. Although subjects were faster to answer "yes" versus "no" when using their right hand, the neural differences cannot be explained by these kinetic differences. To the best of our knowledge, this is the first evidence showing that semantic meaning is embedded in the neural representation of actions, independent of alternative modulating factors such as kinetic and sensory features.

White matter degeneration in remote brain areas of stroke patients with motor impairment due to basal ganglia lesions

Diffusion tensor imaging (DTI) studies have revealed distinct white matter (WM) characteristics of the brain following diseases. Beyond the lesion‐symptom maps, stroke is characterized by extensive structural and functional alterations of brain areas remote to local lesions. Here, we further investigated the structural changes over a global level by using DTI data of 10 ischemic stroke patients showing motor impairment due to basal ganglia lesions and 11 healthy controls. DTI data were processed to obtain fractional anisotropy (FA) maps, and multivariate pattern analysis was used to explore brain regions that play an important role in classification based on FA maps. The WM structural network was constructed by the deterministic fiber‐tracking approach. In comparison with the controls, the stroke patients showed FA reductions in the perilesional basal ganglia, brainstem, and bilateral frontal lobes. Using network‐based statistics, we found a significant reduction in the WM subnetwork in stroke patients. We identified the patterns of WM degeneration affecting brain areas remote to the lesions, revealing the abnormal organization of the structural network in stroke patients, which may be helpful in understanding of the neural mechanisms underlying hemiplegia.

Action-locked Neural Responses in Auditory Cortex to Self-generated Sounds

Sensory perception is a product of interactions between the internal state of an organism and the physical attributes of a stimulus. It has been shown across the animal kingdom that perception and sensory-evoked physiological responses are modulated depending on whether or not the stimulus is the consequence of voluntary actions. These phenomena are often attributed to motor signals sent to relevant sensory regions that convey information about upcoming sensory consequences. However, the neurophysiological signature of action-locked modulations in sensory cortex, and their relationship with perception, is still unclear. In the current study, we recorded neurophysiological (using Magnetoencephalography) and behavioral responses from 16 healthy subjects performing an auditory detection task of faint tones. Tones were either generated by subjects' voluntary button presses or occurred predictably following a visual cue. By introducing a constant temporal delay between button press/cue and tone delivery, and applying source-level analysis, we decoupled action-locked and auditory-locked activity in auditory cortex. We show action-locked evoked-responses in auditory cortex following sound-triggering actions and preceding sound onset. Such evoked-responses were not found for button-presses that were not coupled with sounds, or sounds delivered following a predictive visual cue. Our results provide evidence for efferent signals in human auditory cortex that are locked to voluntary actions coupled with future auditory consequences.

Neural correlates of implicit agency during the transition from adolescence to adulthood: An ERP study

Sense of agency (SoA), the experience of being in control of our voluntary actions and their outcomes, is a key feature of normal human experience. Frontoparietal brain circuits associated with SoA undergo a major maturational process during adolescence. To examine whether this translates to neurodevelopmental changes in agency experience, we investigated two key neural processes associated with SoA, the activity that is leading to voluntary action (Readiness Potential) and the activity that is associated with the action outcome processing (attenuation of auditory N1 and P2 event related potentials, ERPs) in mid-adolescents (13-14), late-adolescents (18-20) and adults (25-28) while they perform an intentional binding task. In this task, participants pressed a button (action) that delivered a tone (outcome) after a small delay and reported the time of the tone using the Libet clock. This action-outcome condition alternated with a no-action condition where an identical tone was triggered by a computer. Mid-adolescents showed greater outcome binding, such that they perceived self-triggered tones as being temporally closer to their actions compared to adults. Suggesting greater agency experience over the outcomes of their voluntary actions during mid-adolescence. Consistent with this, greater levels of attenuated neural response to self-triggered auditory tones (specifically P2 attenuation) were found during mid-adolescence compared to older age groups. This enhanced attenuation decreased with age as observed in outcome binding. However, there were no age-related differences in the readiness potential leading to the voluntary action (button press) as well as in the N1 attenuation to the self-triggered tones. Notably, in mid-adolescents greater outcome binding scores were positively associated with greater P2 attenuation, and smaller negativity in the late readiness potential. These findings suggest that the greater experience of implicit agency observed during mid-adolescence may be mediated by a neural over-suppression of action outcomes (auditory P2 attenuation), and over-reliance on motor preparation (late readiness potential), which we found to become adult-like during late-adolescence. Implications for adolescent development and SoA related neurodevelopmental disorders are discussed.