Reward-driven enhancements in motor control are robust to TMS manipulation

Non-invasive stimulation of the human striatum disrupts reinforcement learning of motor skills

Reinforcement feedback can improve motor learning, but the underlying brain mechanisms remain underexplored. In particular, the causal contribution of specific patterns of oscillatory activity within the human striatum is unknown. To address this question, we exploited a recently developed non-invasive deep brain stimulation technique called transcranial temporal interference stimulation (tTIS) during reinforcement motor learning with concurrent neuroimaging, in a randomized, sham-controlled, double-blind study. Striatal tTIS applied at 80 Hz, but not at 20 Hz, abolished the benefits of reinforcement on motor learning. This effect was related to a selective modulation of neural activity within the striatum. Moreover, 80 Hz, but not 20 Hz, tTIS increased the neuromodulatory influence of the striatum on frontal areas involved in reinforcement motor learning. These results show that tTIS can non-invasively and selectively modulate a striatal mechanism involved in reinforcement learning, expanding our tools for the study of causal relationships between deep brain structures and human behaviour.

Connecting the dots: harnessing dual-site transcranial magnetic stimulation to quantify the causal influence of medial frontal areas on the motor cortex

Dual-site transcranial magnetic stimulation has been widely employed to investigate the influence of cortical structures on the primary motor cortex. Here, we leveraged this technique to probe the causal influence of two key areas of the medial frontal cortex, namely the supplementary motor area and the medial orbitofrontal cortex, on primary motor cortex. We show that supplementary motor area stimulation facilitates primary motor cortex activity across short (6 and 8 ms) and long (12 ms) inter-stimulation intervals, putatively recruiting cortico-cortical and cortico-subcortico-cortical circuits, respectively. Crucially, magnetic resonance imaging revealed that this facilitatory effect depended on a key morphometric feature of supplementary motor area: individuals with larger supplementary motor area volumes exhibited more facilitation from supplementary motor area to primary motor cortex for both short and long inter-stimulation intervals. Notably, we also provide evidence that the facilitatory effect of supplementary motor area stimulation at short intervals is unlikely to arise from spinal interactions of volleys descending simultaneously from supplementary motor area and primary motor cortex. On the other hand, medial orbitofrontal cortex stimulation moderately suppressed primary motor cortex activity at both short and long intervals, irrespective of medial orbitofrontal cortex volume. These results suggest that dual-site transcranial magnetic stimulation is a fruitful approach to investigate the differential influence of supplementary motor area and medial orbitofrontal cortex on primary motor cortex activity, paving the way for the multimodal assessment of these fronto-motor circuits in health and disease.

Sensorimotor feedback loops are selectively sensitive to reward

Although it is well established that motivational factors such as earning more money for performing well improve motor performance, how the motor system implements this improvement remains unclear. For instance, feedback-based control, which uses sensory feedback from the body to correct for errors in movement, improves with greater reward. But feedback control encompasses many feedback loops with diverse characteristics such as the brain regions involved and their response time. Which specific loops drive these performance improvements with reward is unknown, even though their diversity makes it unlikely that they are contributing uniformly. We systematically tested the effect of reward on the latency (how long for a corrective response to arise?) and gain (how large is the corrective response?) of seven distinct sensorimotor feedback loops in humans. Only the fastest feedback loops were insensitive to reward, and the earliest reward-driven changes were consistently an increase in feedback gains, not a reduction in latency. Rather, a reduction of response latencies only tended to occur in slower feedback loops. These observations were similar across sensory modalities (vision and proprioception). Our results may have implications regarding feedback control performance in athletic coaching. For instance, coaching methodologies that rely on reinforcement or 'reward shaping' may need to specifically target aspects of movement that rely on reward-sensitive feedback responses.

The reward for placebos: mechanisms underpinning placebo-induced effects on motor performance

Different from the most popular thinking, the placebo effect is not a purely psychological phenomenon. A body of knowledge from multidisciplinary fields has shown that the expectation of a potential benefit when receiving a treatment induces a cascade of neurochemical-electrophysiological alterations in brain reward areas, including motor-related ones. Alterations in the dopamine, opioid, and glutamate metabolism are the neural representation converting reward-derived declarative forms into an attractive and wanted behavior, thereby changing the activation in reward subcortical and cortical structures involved in motor planning, motor execution, and emotional-cognitive attributes of decision-making. We propose that the expectation of receiving a treatment that is beneficial to motor performance triggers a cascade of activations in brain reward areas that travels from motor planning and motor command areas, passing through corticospinal pathways until driving the skeletal muscles, therefore facilitating the motor performance. Although alternative explanations cannot be totally ruled out, this mechanistic route is robust in explaining the results of placebo-induced effects on motor performance and could lead to novel insights and applications in the exercise sciences. Factors such as sex differences in reward-related mechanisms and aversion-induced nocebo effects should also be addressed.

The dissociable effects of reward on sequential motor behavior

Reward has consistently been shown to enhance motor behavior; however, its beneficial effects appear to be largely unspecific. For example, reward is associated with both rapid and training-dependent improvements in performance, with a mechanistic account of these effects currently lacking. Here we tested the hypothesis that these distinct reward-based improvements are driven by dissociable reward types: monetary incentive and performance feedback. Whereas performance feedback provides information on how well a motor task has been completed (knowledge of performance), monetary incentive increases the motivation to perform optimally without providing a performance-based learning signal. Experiment 1 showed that groups who received monetary incentive rapidly improved movement times (MTs), using a novel sequential reaching task. In contrast, only groups with correct performance-based feedback showed learning-related improvements. Importantly, pairing both maximized MT performance gains and accelerated movement fusion. Fusion describes an optimization process during which neighboring sequential movements blend together to form singular actions. Results from experiment 2 served as a replication and showed that fusion led to enhanced performance speed while also improving movement efficiency through increased smoothness. Finally, experiment 3 showed that these improvements in performance persist for 24 h even without reward availability. This highlights the dissociable impact of monetary incentive and performance feedback, with their combination maximizing performance gains and leading to stable improvements in the speed and efficiency of sequential actions.NEW & NOTEWORTHY Our work provides a mechanistic framework for how reward influences motor behavior. Specifically, we show that rapid improvements in speed and accuracy are driven by reward presented in the form of money, whereas knowledge of performance through performance feedback leads to training-based improvements. Importantly, combining both maximized performance gains and led to improvements in movement quality through fusion, which describes an optimization process during which sequential movements blend into a single action.

Low-Frequency TMS Results in Condition-Related Dynamic Activation Changes of Stimulated and Contralateral Inferior Parietal Lobule

Non-invasive brain stimulation is a promising approach to study the causal relationship between brain function and behavior. However, it is difficult to interpret behavioral null results as dynamic brain network changes have the potential to prevent stimulation from affecting behavior, ultimately compensating for the stimulation. The present study investigated local and remote changes in brain activity via functional magnetic resonance imaging (fMRI) after offline disruption of the inferior parietal lobule (IPL) or the vertex in human participants via 1 Hz repetitive transcranial magnetic stimulation (rTMS). Since the IPL acts as a multimodal hub of several networks, we implemented two experimental conditions in order to robustly engage task-positive networks, such as the fronto-parietal control network (on-task condition) and the default mode network (off-task condition). The condition-dependent neural after-effects following rTMS applied to the IPL were dynamic in affecting post-rTMS BOLD activity depending on the exact time-window. More specifically, we found that 1 Hz rTMS applied to the right IPL led to a delayed activity increase in both, the stimulated and the contralateral IPL, as well as in other brain regions of a task-positive network. This was markedly more pronounced in the on-task condition suggesting a condition-related delayed upregulation. Thus together, our results revealed a dynamic compensatory reorganization including upregulation and intra-network compensation which may explain mixed findings after low-frequency offline TMS.