Adaptive intermittent control: A computational model explaining motor intermittency observed in human behavior

The microstructure of intra- and interpersonal coordination

Movements are naturally composed of submovements, i.e. recurrent speed pulses (2-3 Hz), possibly reflecting intermittent feedback-based motor adjustments. In visuomotor (unimanual) synchronization tasks, partners alternate submovements over time, indicating mutual coregulation. However, it is unclear whether submovement coordination is organized differently between and within individuals. Indeed, different types of information may be variably exploited for intrapersonal and interpersonal coordination. Participants performed a series of bimanual tasks alone or in pairs, with or without visual feedback (solo task only). We analysed the relative timing of submovements between their own hands or between their own hands and those of their partner. Distinct coordinative structures emerged at the submovement level depending on the relevance of visual feedback. Specifically, the relative timing of submovements (between partners/effectors) shifts from alternation to simultaneity and a mixture of both when coordination is achieved using vision (interpersonal), proprioception/efference-copy only (intrapersonal, without vision) or all information sources (intrapersonal, with vision), respectively. These results suggest that submovement coordination represents a behavioural proxy for the adaptive weighting of different sources of information within action-perception loops. In sum, the microstructure of movement reveals common principles governing the dynamics of sensorimotor control to achieve both intra- and interpersonal coordination.

Humans need only 200 ms to generate posture-specific muscle activation patterns for successful vertical jumps in reaction to an auditory trigger

Introduction

It is currently unknown how the central nervous system controls ballistic whole-body movements like vertical jumps. Here we set out to study the time frame of generating muscle activation patterns for maximum-effort jumps from different initial postures.

Methods

We had ten healthy male participants make a slow countermovement from an upright position and initiate a maximal vertical jump as soon as possible following an auditory trigger. The trigger was produced when hip height dropped below one of three preselected values, unknown in advance to the participant, so that the participant was uncertain about the posture from which to initiate the jump. Furthermore, we determined the ensuing bottom postures reached during jumps, and from these postures had the participants perform maximum-effort squat jumps in two conditions: whenever they felt ready, or as soon as possible following an auditory trigger. Kinematics and ground reaction forces were measured, and electromyograms were collected from gluteus maximus, biceps femoris, rectus femoris, vastus lateralis, gastrocnemius and soleus. For each muscle, we detected activation onsets, as well as reaction times defined as the delay between trigger onset and activation onset.

Results

In the jumps preceded by a slow countermovement, the posture from which to initiate the jump was unknown before trigger onset. Nevertheless, in these jumps, posture-specific muscle activation patterns were already released within 200 ms after trigger onset and reaction times were not longer and jump heights not less than in squat jumps from corresponding bottom postures.

Discussion

Our findings suggest that the generation of muscle activation patterns for jumping does not start before trigger onset and requires only about 200 ms.

Motor invariants in action execution and perception

The nervous system is sensitive to statistical regularities of the external world and forms internal models of these regularities to predict environmental dynamics. Given the inherently social nature of human behavior, being capable of building reliable predictive models of others' actions may be essential for successful interaction. While social prediction might seem to be a daunting task, the study of human motor control has accumulated ample evidence that our movements follow a series of kinematic invariants, which can be used by observers to reduce their uncertainty during social exchanges. Here, we provide an overview of the most salient regularities that shape biological motion, examine the role of these invariants in recognizing others' actions, and speculate that anchoring socially-relevant perceptual decisions to such kinematic invariants provides a key computational advantage for inferring conspecifics' goals and intentions.

Asynchronous Intermittent Regulation of Human Arm Movement with Markovian Jumping Parameters

In this paper, the regulation stability problem of the human arm continuous movement is investigated based on Markovian jumping parameters. In particular, the intermittent control mechanism is adopted in the arm movement regulation procedure to model the human intermittent motor control strategy. Furthermore, by taking into account the Markovian jumping parameters with different modes, the asynchronous regulation issue is proposed to model mode mismatch between the motor control and arm movement. On the basis of model transformation, sufficient stability conditions are established during the arm movements, and the desired regulation gain can be obtained by the convex optimization method. In the end, an illustrative example is presented to show the applicability and effectiveness of our developed model and optimized regulation approach.

Predictor feedback models for stick balancing with delay mismatch and sensory dead zones

Human stick balancing is investigated in terms of reaction time delay and sensory dead zones for position and velocity perception using a special combination of delayed state feedback and mismatched predictor feedback as a control model. The corresponding mathematical model is a delay-differential equation with event-driven switching in the control action. Due to the sensory dead zones, initial conditions of the actual state cannot always be provided for an internal-model-based prediction, which indicates that (1) perfect prediction is not possible and (2) the delay in the switching condition cannot be compensated. The imperfection of the predictor is described by the delay mismatch, which is treated as a lumped parameter that creates a transition between perfect predictor feedback (zero delay mismatch) and delayed state feedback (mismatch equal to switching delay). The maximum admissible switching delay (critical delay) is determined numerically based on a practical stabilizability concept. This critical delay is compared to a realistic reference value of 230 ms in order to assess the possible regions of the threshold values for position and velocity perception. The ratio of the angular position and angular velocity for 44 successful balancing trials by 8 human subjects was used to validate the numerical results. Comparison of actual human stick balancing data and numerical simulations based on the mismatched predictor feedback model provided a plausible range of parameters: position detection threshold 1°, velocity detection threshold between 4.24 and 9.35°/s, and delay mismatch around 100-150 ms.

Interpersonal synchronization of movement intermittency

Most animal species group together and coordinate their behavior in quite sophisticated manners for mating, hunting, or defense purposes. In humans, coordination at a macroscopic level (the pacing of movements) is evident both in daily life (e.g., walking) and skilled (e.g., music and dance) behaviors. By examining the fine structure of movement, we here show that interpersonal coordination is established also at a microscopic – submovement – level. Natural movements appear as marked by recurrent (2–3 Hz) speed breaks, i.e., submovements, that are traditionally considered the result of intermittency in (visuo)motor feedback-based control. In a series of interpersonal coordination tasks, we show that submovements produced by interacting partners are not independent but alternate tightly over time, reflecting online mutual adaptation. These findings unveil a potential core mechanism for behavioral coordination that is based on between-persons synchronization of the intrinsic dynamics of action-perception cycles.

•

Movements show intermittent speed pulses occurring at 2–3 Hz, called submovements

•

Submovements are actively coordinated in counter-phase by interacting partners

•

Submovements coordination depends on spatial alignment but not movement congruency

•

Behavioral coordination occurs both at macro- and microscopic movement scales

Constraint-Based Sound-Motion Objects in Music Performance

The aim of this paper is to present principles of constraint-based sound-motion objects in music performance. Sound-motion objects are multimodal fragments of combined sound and sound-producing body motion, usually in the duration range of just a few seconds, and conceived, produced, and perceived as intrinsically coherent units. Sound-motion objects have a privileged role as building blocks in music because of their duration, coherence, and salient features and emerge from combined instrumental, biomechanical, and motor control constraints at work in performance. Exploring these constraints and the crucial role of the sound-motion objects can enhance our understanding of generative processes in music and have practical applications in performance, improvisation, and composition.

Costs of position, velocity, and force requirements in optimal control induce triphasic muscle activation during reaching movement

The nervous system activates a pair of agonist and antagonist muscles to determine the muscle activation pattern for a desired movement. Although there is a problem with redundancy, it is solved immediately, and movements are generated with characteristic muscle activation patterns in which antagonistic muscle pairs show alternate bursts with a triphasic shape. To investigate the requirements for deriving this pattern, this study simulated arm movement numerically by adopting a musculoskeletal arm model and an optimal control. The simulation reproduced the triphasic electromyogram (EMG) pattern observed in a reaching movement using a cost function that considered three terms: end-point position, velocity, and force required; the function minimised neural input. The first, second, and third bursts of muscle activity were generated by the cost terms of position, velocity, and force, respectively. Thus, we concluded that the costs of position, velocity, and force requirements in optimal control can induce triphasic EMG patterns. Therefore, we suggest that the nervous system may control the body by using an optimal control mechanism that adopts the costs of position, velocity, and force required; these costs serve to initiate, decelerate, and stabilise movement, respectively.

Analysis of motor control strategy for frontal and sagittal planes of circular tracking movements using visual feedback noise from velocity change and depth information

We aim to investigate a control strategy for the circular tracking movement in a three-dimensional (3D) space based on the accuracy of the visual information. After setting the circular orbits for the frontal and sagittal planes in the 3D virtual space, the subjects track a target moving at a constant velocity. The analysis is applied to two parameters of the polar coordinates, namely, ΔR (the difference in the distance from the center of a circular orbit) and Δω (the difference in the angular velocity). The movement in the sagittal plane provides different depth information depending on the position of the target in orbit, unlike the task of the frontal plane. Therefore, the circular orbit is divided into four quadrants for a statistical analysis of ΔR. In the sagittal plane, the error was two to three times larger in quadrants 1 and 4 than in quadrants 2 and 3 close to the subject. Here, Δω is estimated using a frequency analysis; the lower the accuracy of the visual information, the greater the periodicity. When comparing two different planes, the periodicity in the sagittal plane was approximately 1.7 to 2 times larger than that of the frontal plane. In addition, the average angular velocity of the target and tracer was within 0.6% during a single cycle. We found that if the amount of visual information is reduced, an optimal feedback control strategy can be used to reduce the positional error within a specific area.

State-space intermittent feedback stabilization of a dual balancing task

Balancing the body in upright standing and balancing a stick on the fingertip are two examples of unstable tasks that, in spite of strong motor and sensory differences, appear to share a similar motor control paradigm, namely a state-space intermittent feedback stabilization mechanism. In this study subjects were required to perform the two tasks simultaneously, with the purpose of highlighting both the coordination between the two skills and the underlying interaction between the corresponding controllers. The experimental results reveal, in particular, that upright standing (the less critical task) is modified in an adaptive way, in order to facilitate the more critical task (stick balancing), but keeping the overall spatio-temporal signature well known in regular upright standing. We were then faced with the following question: to which extent the physical/biomechanical interaction between the two independent intermittent controllers is capable to explain the dual task coordination patterns, without the need to introduce an additional, supervisory layer/module? By comparing the experimental data with the output of a simulation study we support the former hypothesis, suggesting that it is made possible by the intrinsic robustness of both state-space intermittent feedback stabilization mechanisms.

Extrinsic and intrinsic dynamics in movement intermittency

What determines how we move in the world? Motor neuroscience often focusses either on intrinsic rhythmical properties of motor circuits or extrinsic sensorimotor feedback loops. Here we show that the interplay of both intrinsic and extrinsic dynamics is required to explain the intermittency observed in continuous tracking movements. Using spatiotemporal perturbations in humans, we demonstrate that apparently discrete submovements made 2-3 times per second reflect constructive interference between motor errors and continuous feedback corrections that are filtered by intrinsic circuitry in the motor system. Local field potentials in monkey motor cortex revealed characteristic signatures of a Kalman filter, giving rise to both low-frequency cortical cycles during movement, and delta oscillations during sleep. We interpret these results within the framework of optimal feedback control, and suggest that the intrinsic rhythmicity of motor cortical networks reflects an internal model of external dynamics, which is used for state estimation during feedback-guided movement.

Editorial note

This article has been through an editorial process in which the authors decide how to respond to the issues raised during peer review. The Reviewing Editor's assessment is that all the issues have been addressed (see decision letter).

Characterizing Movement Fluency in Musical Performance: Toward a Generic Measure for Technology Enhanced Learning

Virtuosity in music performance is often associated with fast, precise, and efficient sound-producing movements. The generation of such highly skilled movements involves complex joint and muscle control by the central nervous system, and depends on the ability to anticipate, segment, and coarticulate motor elements, all within the biomechanical constraints of the human body. When successful, such motor skill should lead to what we characterize as fluency in musical performance. Detecting typical features of fluency could be very useful for technology-enhanced learning systems, assisting and supporting students during their individual practice sessions by giving feedback and helping them to adopt sustainable movement patterns. In this study, we propose to assess fluency in musical performance as the ability to smoothly and efficiently coordinate while accurately performing slow, transitionary, and rapid movements. To this end, the movements of three cello players and three drummers at different levels of skill were recorded with an optical motion capture system, while a wireless electromyography (EMG) system recorded the corresponding muscle activity from relevant landmarks. We analyzed the kinematic and coarticulation characteristics of these recordings separately and then propose a combined model of fluency in musical performance predicting music sophistication. Results suggest that expert performers' movements are characterized by consistently smooth strokes and scaling of muscle phasic coactivation. The explored model of fluency as a function of movement smoothness and coarticulation patterns was shown to be limited by the sample size, but it serves as a proof of concept. Results from this study show the potential of a technology-enhanced objective measure of fluency in musical performance, which could lead to improved practices for aspiring musicians, instructors, and researchers.

Experimental and theoretical study of velocity fluctuations during slow movements in humans

Moving smoothly is generally considered as a higher-order goal of motor control and moving jerkily as a witness of clumsiness or pathology, yet many common and well-controlled movements (e.g., tracking movements) have irregular velocity profiles with widespread fluctuations. The origin and nature of these fluctuations have been associated with the operation of an intermittent process but in fact remain poorly understood. Here we studied velocity fluctuations during slow movements, using combined experimental and theoretical tools. We recorded arm movement trajectories in a group of healthy participants performing back-and-forth movements at different speeds, and we analyzed velocity profiles in terms of series of segments (portions of velocity between 2 minima). We found that most of the segments were smooth (i.e., corresponding to a biphasic acceleration) and had constant duration irrespective of movement speed and linearly increasing amplitude with movement speed. We accounted for these observations with an optimal feedback control model driven by a staircase goal position signal in the presence of sensory noise. Our study suggests that one and the same control process can explain the production of fast and slow movements, i.e., fast movements emerge from the immediate tracking of a global goal position and slow movements from the successive tracking of intermittently updated intermediate goal positions. NEW & NOTEWORTHY We show in experiments and modeling that slow movements could result from the brain tracking a sequence of via points regularly distributed in time and space. Accordingly, slow movements would differ from fast movement by the nature of the guidance and not by the nature of control. This result could help in understanding the origin and nature of slow and segmented movements frequently observed in brain disorders.

Sustained sensorimotor control as intermittent decisions about prediction errors: computational framework and application to ground vehicle steering

A conceptual and computational framework is proposed for modelling of human sensorimotor control and is exemplified for the sensorimotor task of steering a car. The framework emphasises control intermittency and extends on existing models by suggesting that the nervous system implements intermittent control using a combination of (1) motor primitives, (2) prediction of sensory outcomes of motor actions, and (3) evidence accumulation of prediction errors. It is shown that approximate but useful sensory predictions in the intermittent control context can be constructed without detailed forward models, as a superposition of simple prediction primitives, resembling neurobiologically observed corollary discharges. The proposed mathematical framework allows straightforward extension to intermittent behaviour from existing one-dimensional continuous models in the linear control and ecological psychology traditions. Empirical data from a driving simulator are used in model-fitting analyses to test some of the framework's main theoretical predictions: it is shown that human steering control, in routine lane-keeping and in a demanding near-limit task, is better described as a sequence of discrete stepwise control adjustments, than as continuous control. Results on the possible roles of sensory prediction in control adjustment amplitudes, and of evidence accumulation mechanisms in control onset timing, show trends that match the theoretical predictions; these warrant further investigation. The results for the accumulation-based model align with other recent literature, in a possibly converging case against the type of threshold mechanisms that are often assumed in existing models of intermittent control.