Financial incentives enhance adaptation to a sensorimotor transformation

Large-scale citizen science reveals predictors of sensorimotor adaptation

Sensorimotor adaptation is essential for keeping our movements well calibrated in response to changes in the body and environment. For over a century, researchers have studied sensorimotor adaptation in laboratory settings that typically involve small sample sizes. While this approach has proved useful for characterizing different learning processes, laboratory studies are not well suited for exploring the myriad of factors that may modulate human performance. Here, using a citizen science website, we collected over 2,000 sessions of data on a visuomotor rotation task. This unique dataset has allowed us to replicate, reconcile and challenge classic findings in the learning and memory literature, as well as discover unappreciated demographic constraints associated with implicit and explicit processes that support sensorimotor adaptation. More generally, this study exemplifies how a large-scale exploratory approach can complement traditional hypothesis-driven laboratory research in advancing sensorimotor neuroscience.

Motivation as a function of success frequency

It is well-established that intermediate challenge is optimally motivating. We tested whether this can be quantified into an inverted-U relationship between motivation and success frequency. Participants played a game in which they navigated a scene to catch targets. In Experiment 1 (N = 101), play duration was free and the motivating value of success frequency was measured from the probability that a player would continue at that frequency. In Experiment 2 (N = 70), play duration was fixed, and motivation was measured using repeated self-reports. In Experiment 1, the probability to continue increased linearly with the success frequency whereas play duration did show the inverted-U relationship with success frequency. In Experiment 2, self-reported motivation showed the inverted-U relationship with success frequency. Together, this shows that motivation depends on success frequency. In addition, we provide tentative evidence that the concept of intermediate challenge being most motivating can be quantified into an inverted-U relationship between motivation and success frequency.

Rewards interact with repetition-dependent learning to enhance long-term retention of motor memories

The combination of behavioral experiences that enhance long-term retention remains largely unknown. Informed by neurophysiological lines of work, this study tested the hypothesis that performance-contingent monetary rewards potentiate repetition-dependent forms of learning, as induced by extensive practice at asymptote, to enhance long-term retention of motor memories. To this end, six groups of 14 participants (n = 84) acquired novel motor behaviors by adapting to a gradual visuomotor rotation while these factors were manipulated. Retention was assessed 24 h later. While all groups similarly acquired the novel motor behaviors, results from the retention session revealed an interaction indicating that rewards enhanced long-term retention, but only when practice was extended to asymptote. Specifically, the interaction indicated that this effect selectively occurred when rewards were intermittently available (i.e., 50%), but not when they were absent (i.e., 0%) or continuously available (i.e., 100%) during acquisition. This suggests that the influence of rewards on extensive practice and long-term retention is nonlinear, as continuous rewards did not further enhance retention as compared with intermittent rewards. One possibility is that rewards' intermittent availability allows to maintain their subjective value during acquisition, which may be key to potentiate long-term retention.

Gamification as a Sustainable Source of Enjoyment During Balance and Gait Exercises

We may be motivated to engage in a certain motor activity because it is instrumental to obtaining reward (e.g., money) or because we enjoy the activity, making it intrinsically rewarding. Enjoyment is related to intrinsic motivation which is considered to be a durable form of motivation. Therefore, many rehabilitation programs aim to increase task enjoyment by adding game elements ("gamification"). Here we ask how the influence of game elements on motivation develops over time and additionally explore whether enjoyment influences motor performance. We describe two different studies that varied game elements in different exercises. Experiment 1 compared the durability of enjoyment for a gamified and a conventional balance exercise in elderly. Experiment 2 addressed the question whether adding game elements to a gait adaptability exercise enhances the durability of enjoyment and additionally tested whether the game elements influenced movement vigor and accuracy (motor performance). The results show that the game elements enhanced enjoyment. Enjoyment faded over time, but this decrease tended to be less pronounced in gamified exercises. There was no evidence that the game elements affected movement vigor or accuracy.

Task errors contribute to implicit aftereffects in sensorimotor adaptation

Perturbations of sensory feedback evoke sensory prediction errors (discrepancies between predicted and actual sensory outcomes of movements), and reward prediction errors (discrepancies between predicted rewards and actual rewards). When our task is to hit a target, we expect to succeed in hitting the target, and so we experience a reward prediction error if the perturbation causes us to miss it. These discrepancies between intended task outcomes and actual task outcomes, termed "task errors," are thought to drive the use of strategic processes to restore success, although their role is incompletely understood. Here, as participants adapted to a 30° rotation of cursor feedback representing hand position, we investigated the role of task errors in sensorimotor adaptation: during target-reaching, we either removed task errors by moving the target mid-movement to align with cursor feedback of hand position, or enforced task error by moving the target away from the cursor feedback of hand position, by 20-30° randomly (clockwise in half the trials, counterclockwise in half the trials). Removing task errors not only reduced the extent of adaptation during exposure to the perturbation, but also reduced the amount of post-adaptation aftereffects that persisted despite explicit knowledge of the perturbation removal. Hence, task errors contribute to implicit adaptation resulting from sensory prediction errors. This suggests that the system which predicts the sensory consequences of actions via exposure to sensory prediction errors is also sensitive to reward prediction errors.

Pharmacological Dopamine Manipulation Does Not Alter Reward-Based Improvements in Memory Retention during a Visuomotor Adaptation Task

Motor adaptation tasks investigate our ability to adjust motor behaviors to an ever-changing and unpredictable world. Previous work has shown that punishment-based feedback delivered during a visuomotor adaptation task enhances error-reduction, whereas reward increases memory retention. While the neural underpinnings of the influence of punishment on the adaptation phase remain unclear, reward has been hypothesized to increase retention through dopaminergic mechanisms. We directly tested this hypothesis through pharmacological manipulation of the dopaminergic system. A total of 96 young healthy human participants were tested in a placebo-controlled double-blind between-subjects design in which they adapted to a 40° visuomotor rotation under reward or punishment conditions. We confirmed previous evidence that reward enhances retention, but the dopamine (DA) precursor levodopa (LD) or the DA antagonist haloperidol failed to influence performance. We reason that such a negative result could be due to experimental limitations or it may suggest that the effect of reward on motor memory retention is not driven by dopaminergic processes. This provides further insight regarding the role of motivational feedback in optimizing motor learning, and the basis for further decomposing the effect of reward on the subprocesses known to underlie motor adaptation paradigms.

Added value of money on motor performance feedback: Increased left central beta-band power for rewards and fronto-central theta-band power for punishments

Monetary rewards and punishments have been shown to respectively enhance retention of motor memories and short-term motor performance, but their underlying neural bases in the context of motor control tasks remain unclear. Using electroencephalography (EEG), the present study tested the hypothesis that monetary rewards and punishments are respectively reflected in post-feedback beta-band (20-30 Hz) and theta-band (3-8 Hz) oscillatory power. While participants performed upper limb reaching movements toward visual targets using their right hand, the delivery of monetary rewards and punishments was manipulated as well as their probability (i.e., by changing target size). Compared to unrewarded and unpunished trials, monetary rewards and the successful avoidance of punishments both entailed greater beta-band power at left central electrodes overlaying contralateral motor areas. In contrast, monetary punishments and reward omissions both entailed increased theta-band power at fronto-central scalp sites. Additional analyses revealed that beta-band power was further increased when rewards were lowly probable. In light of previous work demonstrating similar beta-band modulations in basal ganglia during reward processing, the present results may reflect functional communication of reward-related information between the basal ganglia and motor cortical regions. In turn, the increase in fronto-central theta-band power after monetary punishments may reflect an emphasized cognitive need for behavioral adjustments. Globally, the present work identifies possible neural substrates for the growing behavioral evidence showing beneficial effects of monetary feedback on motor learning and performance.

Reward abundance interferes with error-based learning in a visuomotor adaptation task

The brain rapidly adapts reaching movements to changing circumstances by using visual feedback about errors. Providing reward in addition to error feedback facilitates the adaptation but the underlying mechanism is unknown. Here, we investigate whether the proportion of trials rewarded (the 'reward abundance') influences how much participants adapt to their errors. We used a 3D multi-target pointing task in which reward alone is insufficient for motor adaptation. Participants (N = 423) performed the pointing task with feedback based on a shifted hand-position. On a proportion of trials we gave them rewarding feedback that their hand hit the target. Half of the participants only received this reward feedback. The other half also received feedback about endpoint errors. In different groups, we varied the proportion of trials that was rewarded. As expected, participants who received feedback about their errors did adapt, but participants who only received reward-feedback did not. Critically, participants who received abundant rewards adapted less to their errors than participants who received less reward. Thus, reward abundance negatively influences how much participants learn from their errors. Probably participants used a mechanism that relied more on the reward feedback when the reward was abundant. Because participants could not adapt to the reward, this interfered with adaptation to errors.

The impact of reward and punishment on skill learning depends on task demands

Reward and punishment motivate behavior, but it is unclear exactly how they impact skill performance and whether the effect varies across skills. The present study investigated the effect of reward and punishment in both a sequencing skill and a motor skill context. Participants trained on either a sequencing skill (serial reaction time task) or a motor skill (force-tracking task). Skill knowledge was tested immediately after training, and again 1 hour, 24–48 hours, and 30 days after training. We found a dissociation of the effects of reward and punishment on the tasks, primarily reflecting the impact of punishment. While punishment improved serial reaction time task performance, it impaired force-tracking task performance. In contrast to prior literature, neither reward nor punishment benefitted memory retention, arguing against the common assumption that reward ubiquitously benefits skill retention. Collectively, these results suggest that punishment impacts skilled behavior more than reward in a complex, task dependent fashion.