Visuomotor errors drive step length and step time adaptation during 'virtual' split-belt walking: the effects of reinforcement feedback

Sleep benefits perceptual but not movement-based learning of locomotor sequences

Practicing complex locomotor skills, such as those involving a step sequence engages distinct perceptual and motor mechanisms that support the recall of learning under new conditions (i.e., skill transfer). While sleep has been shown to enhance learning of sequences of fine movements (i.e., sleep-dependent consolidation), here we examined whether this benefit extends to learning of a locomotor pattern. Specifically, we tested the perceptual and motor learning of a locomotor sequence following sleep compared to wake. We hypothesized that post-practice sleep would increase locomotor sequence learning in the perceptual, but not in the motor domain. In this study, healthy young adult participants (n = 48; 18-33 years) practiced a step length sequence on a treadmill cued by visual stimuli displayed on a screen during training. Participants were then tested in a perceptual condition (backward walking with the same visual stimuli), or a motor condition (forward walking but with an inverted screen). Skill was assessed immediately, and again after a 12-h delay following overnight sleep or daytime wake (n = 12 for each interval/condition). Off-line learning improved following sleep compared to wake, but only for the perceptual condition. Our results suggest that perceptual and motor sequence learning are processed separately after locomotor training, and further points to a benefit of sleep that is rooted in the perceptual as opposed to the motor aspects of motor learning.

The effects of auditory consequences on visuomotor adaptation and motor memory

Sensorimotor adaptation is a form of motor learning that is essential for maintaining motor performance across the lifespan and is integral to recovery of function after neurological injury. Recent research indicates that experiencing a balance-threatening physical consequence when making a movement error during adaptation can enhance subsequent motor memory. This is perhaps not surprising, as learning to avoid injury is critical for our survival and well-being. Reward and punishment can also differentially modify aspects of motor learning. However, it remains unclear whether other forms of non-physical consequences can impact motor learning. Here we tested the hypothesis that a loud acoustic stimulus linked to a movement error during adaptation could lead to greater generalization and consolidation. Two groups of participants (n = 12 each) adapted to a new, prism-induced visuomotor mapping while performing a precision walking task. One group experienced an unexpected loud acoustic stimulus (85 dB tone) when making foot-placement errors during adaptation. This auditory consequence group adapted faster and showed greater generalization with an interlimb transfer task, but not greater generalization to an obstacle avoidance task. Both groups showed faster relearning (i.e., savings) during the second testing session one week later despite the presence of an interference block of trials following initial adaptation, indicating successful consolidation. However, we did not find significant differences between groups with relearning during session 2. Overall, our results suggest that auditory consequences may serve as a useful method to improve motor learning, though further research is required.

Reinforcement feedback impairs locomotor adaptation and retention

Introduction

Locomotor adaptation is a motor learning process used to alter spatiotemporal elements of walking that are driven by prediction errors, a discrepancy between the expected and actual outcomes of our actions. Sensory and reward prediction errors are two different types of prediction errors that can facilitate locomotor adaptation. Reward and punishment feedback generate reward prediction errors but have demonstrated mixed effects on upper extremity motor learning, with punishment enhancing adaptation, and reward supporting motor memory. However, an in-depth behavioral analysis of these distinct forms of feedback is sparse in locomotor tasks.

Methods

For this study, three groups of healthy young adults were divided into distinct feedback groups [Supervised, Reward, Punishment] and performed a novel locomotor adaptation task where each participant adapted their knee flexion to 30 degrees greater than baseline, guided by visual supervised or reinforcement feedback (Adaptation). Participants were then asked to recall the new walking pattern without feedback (Retention) and after a washout period with feedback restored (Savings).

Results

We found that all groups learned the adaptation task with external feedback. However, contrary to our initial hypothesis, enhancing sensory feedback with a visual representation of the knee angle (Supervised) accelerated the rate of learning and short-term retention in comparison to monetary reinforcement feedback. Reward and Punishment displayed similar rates of adaptation, short-term retention, and savings, suggesting both types of reinforcement feedback work similarly in locomotor adaptation. Moreover, all feedback enhanced the aftereffect of locomotor task indicating changes to implicit learning.

Discussion

These results demonstrate the multi-faceted nature of reinforcement feedback on locomotor adaptation and demonstrate the possible different neural substrates that underly reward and sensory prediction errors during different motor tasks.

Reinforcement Learning during Locomotion

When learning a new motor skill, people often must use trial and error to discover which movement is best. In the reinforcement learning framework, this concept is known as exploration and has been linked to increased movement variability in motor tasks. For locomotor tasks, however, increased variability decreases upright stability. As such, exploration during gait may jeopardize balance and safety, making reinforcement learning less effective. Therefore, we set out to determine if humans could acquire and retain a novel locomotor pattern using reinforcement learning alone. Young healthy male and female participants walked on a treadmill and were provided with binary reward feedback (indicated by a green checkmark on the screen) that was tied to a fixed monetary bonus, to learn a novel stepping pattern. We also recruited a comparison group who walked with the same novel stepping pattern but did so by correcting for target error, induced by providing real-time veridical visual feedback of steps and a target. In two experiments, we compared learning, motor variability, and two forms of motor memories between the groups. We found that individuals in the binary reward group did, in fact, acquire the new walking pattern by exploring (increasing motor variability). Additionally, while reinforcement learning did not increase implicit motor memories, it resulted in more accurate explicit motor memories compared with the target error group. Overall, these results demonstrate that humans can acquire new walking patterns with reinforcement learning and retain much of the learning over 24 h.

Reduced corticospinal drive and inflexible temporal adaptation during visually guided walking in older adults

Corticospinal drive during walking is reduced in older adults compared with young adults, but it is not clear how this decrease might compromise one's ability to adjust stepping, particularly during visuomotor adaptation. We hypothesize that age-related changes in corticospinal drive could predict differences in older adults' step length and step time adjustments in response to visual perturbations compared with younger adults. Healthy young (n = 21; age 18-33 yr) and older adults (n = 20; age 68-80 yr) were tested with a treadmill task, incorporating visual feedback of the foot position and stepping targets in real-time. During adaptation, the visuomotor gain was reduced on one side, causing the foot cursor and step targets to move slower on that side of the screen (i.e., split-visuomotor adaptation). Corticospinal drive was quantified by coherence between electromyographic signals in the beta-gamma frequency band (15-45 Hz). The results showed that 1) older adults adapted to visuomotor perturbations during walking, with a similar reduction in error asymmetry compared with younger adults; 2) however, older adults showed reduced adaptation in step time symmetry, despite demonstrating similar adaptation in step length asymmetry compared with younger adults; and 3) smaller overall changes in step time asymmetry was associated with reduced corticospinal drive to the tibialis anterior in the slow leg during split-visuomotor adaptation. These findings suggest that changes in corticospinal drive may affect older adults' control of step timing in response to visual challenges. This could be important for safe navigation when walking in different environments or dealing with unexpected circumstances.NEW & NOTEWORTHY Corticospinal input is essential for visually guided walking, especially when the walking pattern must be modified to accurately step on safe locations. Age-related changes in corticospinal drive are associated with inflexible step time, which necessitates different locomotor adaptation strategies in older adults.