Mini-max feedback control as a computational theory of sensorimotor control in the presence of structural uncertainty

Basketball free-throw training with augmented reality-based optimal shot trajectory for novice shooters

We propose an augmented reality (AR)-based training system for basketball free-throws. The optimal shot trajectory for free-throws is projected by a head-mounted display according to the shooter's release point. The efficacy of the training system was assessed in novice shooters by comparing changes in success rates and eye-gaze behavior (quiet eye [QE]) between AR-training and control-training groups. The success rate during the AR training with the optimal trajectory did not differ from the pre-training rate; however, in post-AR training, i.e., after removal of the optimal trajectory, the success rate increased. Additionally, AR training increased the QE duration (QED) compared with that recorded during pre- and post-training blocks. In contrast, the control group showed no change in the success rate or QED. These findings imply that our AR training system affected QE behavior and improved free-throwing shooting performance after training. Thus, our system is expected to enhance basketball free-throw shooting performance.

Human motor learning is robust to control-dependent noise

Noises are ubiquitous in sensorimotor interactions and contaminate the information provided to the central nervous system (CNS) for motor learning. An interesting question is how the CNS manages motor learning with imprecise information. Integrating ideas from reinforcement learning and adaptive optimal control, this paper develops a novel computational mechanism to explain the robustness of human motor learning to the imprecise information, caused by control-dependent noise that exists inherently in the sensorimotor systems. Starting from an initial admissible control policy, in each learning trial the mechanism collects and uses the noisy sensory data (caused by the control-dependent noise) to form an imprecise evaluation of the performance of the current policy and then constructs an updated policy based on the imprecise evaluation. As the number of learning trials increases, the generated policies mathematically provably converge to a (potentially small) neighborhood of the optimal policy under mild conditions, despite the imprecise information in the learning process. The mechanism directly synthesizes the policies from the sensory data, without identifying an internal forward model. Our preliminary computational results on two classic arm reaching tasks are in line with experimental observations reported in the literature. The model-free control principle proposed in the paper sheds more lights into the inherent robustness of human sensorimotor systems to the imprecise information, especially control-dependent noise, in the CNS.

Costs of position, velocity, and force requirements in optimal control induce triphasic muscle activation during reaching movement

The nervous system activates a pair of agonist and antagonist muscles to determine the muscle activation pattern for a desired movement. Although there is a problem with redundancy, it is solved immediately, and movements are generated with characteristic muscle activation patterns in which antagonistic muscle pairs show alternate bursts with a triphasic shape. To investigate the requirements for deriving this pattern, this study simulated arm movement numerically by adopting a musculoskeletal arm model and an optimal control. The simulation reproduced the triphasic electromyogram (EMG) pattern observed in a reaching movement using a cost function that considered three terms: end-point position, velocity, and force required; the function minimised neural input. The first, second, and third bursts of muscle activity were generated by the cost terms of position, velocity, and force, respectively. Thus, we concluded that the costs of position, velocity, and force requirements in optimal control can induce triphasic EMG patterns. Therefore, we suggest that the nervous system may control the body by using an optimal control mechanism that adopts the costs of position, velocity, and force required; these costs serve to initiate, decelerate, and stabilise movement, respectively.

How does the CNS control arm reaching movements? Introducing a hierarchical nonlinear predictive control organization based on the idea of muscle synergies

In this study, we introduce a hierarchical and modular computational model to explain how the CNS (Central Nervous System) controls arm reaching movement (ARM) in the frontal plane and under different conditions. The proposed hierarchical organization was established at three levels: 1) motor planning, 2) command production, and 3) motor execution. Since in this work we are not discussing motion learning, no learning procedure was considered in the model. Previous models mainly assume that the motor planning level produces the desired trajectories of the joints and feeds it to the next level to be tracked. In the proposed model, the motion control is described based on a regulatory control policy, that is, the output of the motor planning level is a step function defining the initial and final desired position of the hand. For the command production level, a nonlinear predictive model was developed to explain how the time-invariant muscle synergies (MSs) are recruited. We used the same computational model to explain the arm reaching motion for a combined ARM task. The combined ARM is defined as two successive ARM such that it starts from point A and reaches to point C via point B. To develop the model, kinematic and kinetic data from six subjects were recorded and analyzed during ARM task performance. The subjects used a robotic manipulator while moving their hand in the frontal plane. The EMG data of 15 muscles were also recorded. The MSs used in the model were extracted from the recorded EMG data. The proposed model explains two aspects of the motor control system by a novel computational approach: 1) the CNS reduces the dimension of the control space using the notion of MSs and thereby, avoids immense computational loads; 2) at the level of motor planning, the CNS generates the desired position of the hand at the starting, via and the final points, and this amounts to a regulatory and non-tracking structure.

Robust Control in Human Reaching Movements: A Model-Free Strategy to Compensate for Unpredictable Disturbances

Current models of motor learning suggest that multiple timescales support adaptation to changes in visual or mechanical properties of the environment. These models capture patterns of learning and memory across a broad range of tasks, yet do not consider the possibility that rapid changes in behavior may occur without adaptation. Such changes in behavior may be desirable when facing transient disturbances, or when unpredictable changes in visual or mechanical properties of the task make it difficult to form an accurate model of the perturbation. Whether humans can modulate control strategies without an accurate model of the perturbation remains unknown. Here we frame this question in the context of robust control (H _∞-control), a control strategy that specifically considers unpredictable disturbances by increasing initial movement speed and feedback gains. Correspondingly, we demonstrate in two human reaching experiments including males and females that the occurrence of a single unpredictable disturbance led to an increase in movement speed and in the gain of rapid feedback responses to mechanical disturbances on subsequent movements. This strategy reduced perturbation-related motion regardless of the direction of the perturbation. Furthermore, we found that changes in the control strategy were associated with co-contraction, which amplified the gain of muscle responses to both lengthening and shortening perturbations. These results have important implications for studies on motor adaptation because they highlight that trial-by-trial changes in limb motion also reflected changes in control strategies dissociable from error-based adaptation.SIGNIFICANCE STATEMENT Humans and animals use internal representations of movement dynamics to anticipate the impact of predictable disturbances. However, we are often confronted with transient or unpredictable disturbances, and it remains unknown whether and how the nervous system handles these disturbances over fast time scales. Here we hypothesized that humans can modulate their control strategy to make reaching movements less sensitive to perturbations. We tested this hypothesis in the framework of robust control, and found changes in movement speed and feedback gains consistent with the model predictions. These changes impacted participants' behavior on a trial-by-trial basis. We conclude that compensation for disturbances over fast time scales involves a robust control strategy, which potentially plays a key role in motor planning and execution.

Optimal feedback control to describe multiple representations of primary motor cortex neurons

Primary motor cortex (M1) neurons are tuned in response to several parameters related to motor control, and it was recently reported that M1 is important in feedback control. However, it remains unclear how M1 neurons encode information to control the musculoskeletal system. In this study, we examined the underlying computational mechanisms of M1 based on optimal feedback control (OFC) theory, which is a plausible hypothesis for neuromotor control. We modelled an isometric torque production task that required joint torque to be regulated and maintained at desired levels in a musculoskeletal system physically constrained by muscles, which act by pulling rather than pushing. Then, a feedback controller was computed using an optimisation approach under the constraint. In the presence of neuromotor noise, known as signal-dependent noise, the sensory feedback gain is tuned to an extrinsic motor output, such as the hand force, like a population response of M1 neurons. Moreover, a distribution of the preferred directions (PDs) of M1 neurons can be predicted via feedback gain. Therefore, we suggest that neural activity in M1 is optimised for the musculoskeletal system. Furthermore, if the feedback controller is represented in M1, OFC can describe multiple representations of M1, including not only the distribution of PDs but also the response of the neuronal population.