1
|
Oubre B, Lee SI. Detection and Assessment of Point-to-Point Movements During Functional Activities Using Deep Learning and Kinematic Analyses of the Stroke-Affected Wrist. IEEE J Biomed Health Inform 2024; 28:1022-1030. [PMID: 38015679 DOI: 10.1109/jbhi.2023.3337156] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/30/2023]
Abstract
Stoke is a leading cause of long-term disability, including upper-limb hemiparesis. Frequent, unobtrusive assessment of naturalistic motor performance could enable clinicians to better assess rehabilitation effectiveness and monitor patients' recovery trajectories. We therefore propose and validate a two-phase data analytic pipeline to estimate upper-limb impairment based on the naturalistic performance of activities of daily living (ADLs). Eighteen stroke survivors were equipped with an inertial sensor on the stroke-affected wrist and performed up to four ADLs in a naturalistic manner. Continuous inertial time series were segmented into sliding windows, and a machine-learned model identified windows containing instances of point-to-point (P2P) movements. Using kinematic features extracted from the detected windows, a subsequent model was used to estimate upper-limb motor impairment, as measured by the Fugl-Meyer Assessment (FMA). Both models were evaluated using leave-one-subject-out cross-validation. The P2P movement detection model had an area under the precision-recall curve of 0.72. FMA estimates had a normalized root mean square error of 18.8% with R2=0.72. These promising results support the potential to develop seamless, ecologically valid measures of real-world motor performance.
Collapse
|
2
|
Hage P, Jang IK, Looi V, Fakharian MA, Orozco SP, Pi JS, Sedaghat-Nejad E, Shadmehr R. Effort cost of harvest affects decisions and movement vigor of marmosets during foraging. eLife 2023; 12:RP87238. [PMID: 38079467 PMCID: PMC10715725 DOI: 10.7554/elife.87238] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2023] Open
Abstract
Our decisions are guided by how we perceive the value of an option, but this evaluation also affects how we move to acquire that option. Why should economic variables such as reward and effort alter the vigor of our movements? In theory, both the option that we choose and the vigor with which we move contribute to a measure of fitness in which the objective is to maximize rewards minus efforts, divided by time. To explore this idea, we engaged marmosets in a foraging task in which on each trial they decided whether to work by making saccades to visual targets, thus accumulating food, or to harvest by licking what they had earned. We varied the effort cost of harvest by moving the food tube with respect to the mouth. Theory predicted that the subjects should respond to the increased effort costs by choosing to work longer, stockpiling food before commencing harvest, but reduce their movement vigor to conserve energy. Indeed, in response to an increased effort cost of harvest, marmosets extended their work duration, but slowed their movements. These changes in decisions and movements coincided with changes in pupil size. As the effort cost of harvest declined, work duration decreased, the pupils dilated, and the vigor of licks and saccades increased. Thus, when acquisition of reward became effortful, the pupils constricted, the decisions exhibited delayed gratification, and the movements displayed reduced vigor.
Collapse
Affiliation(s)
- Paul Hage
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
| | - In Kyu Jang
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
| | - Vivian Looi
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
| | - Mohammad Amin Fakharian
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
| | - Simon P Orozco
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
| | - Jay S Pi
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
| | - Ehsan Sedaghat-Nejad
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
| | - Reza Shadmehr
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of MedicineBaltimoreUnited States
| |
Collapse
|
3
|
Verdel D, Bruneau O, Sahm G, Vignais N, Berret B. The value of time in the invigoration of human movements when interacting with a robotic exoskeleton. SCIENCE ADVANCES 2023; 9:eadh9533. [PMID: 37729420 PMCID: PMC10511201 DOI: 10.1126/sciadv.adh9533] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/24/2023] [Accepted: 08/18/2023] [Indexed: 09/22/2023]
Abstract
Time and effort are thought to be subjectively balanced during the planning of goal-directed actions, thereby setting the vigor of volitional movements. Theoretical models predicted that the value of time should then amount to high levels of effort. However, the time-effort trade-off has so far only been studied for a narrow range of efforts. To investigate the extent to which humans can invest in a time-saving effort, we used a robotic exoskeleton to substantially vary the energetic cost associated with a certain vigor during reaching movements. In this situation, minimizing the time-effort trade-off should lead to high and low human efforts for upward and downward movements, respectively. Consistently, all participants expended substantial amounts of energy upward and remained essentially inactive by harnessing the work of gravity downward, while saving time in both cases. A common time-effort trade-off may therefore determine the vigor of reaching movements for a wide range of efforts.
Collapse
Affiliation(s)
- Dorian Verdel
- Université Paris-Saclay, CIAMS, 91405 Orsay, France
- CIAMS, Université d’Orléans, Orléans, France
| | - Olivier Bruneau
- LURPA, Mechanical Engineering Department, ENS Paris-Saclay, Université Paris-Saclay, 91190 Gif-sur-Yvette, France
| | - Guillaume Sahm
- Université Paris-Saclay, CIAMS, 91405 Orsay, France
- CIAMS, Université d’Orléans, Orléans, France
| | - Nicolas Vignais
- Université Paris-Saclay, CIAMS, 91405 Orsay, France
- CIAMS, Université d’Orléans, Orléans, France
| | - Bastien Berret
- Université Paris-Saclay, CIAMS, 91405 Orsay, France
- CIAMS, Université d’Orléans, Orléans, France
- Institut Universitaire de France, Paris, France
| |
Collapse
|
4
|
Hage P, Jang IK, Looi V, Fakharian MA, Orozco SP, Pi JS, Sedaghat-Nejad E, Shadmehr R. Effort cost of harvest affects decisions and movement vigor of marmosets during foraging. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.02.04.527146. [PMID: 36798274 PMCID: PMC9934576 DOI: 10.1101/2023.02.04.527146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Our decisions are guided by how we perceive the value of an option, but this evaluation also affects how we move to acquire that option. Why should economic variables such as reward and effort alter the vigor of our movements? In theory, both the option that we choose and the vigor with which we move contribute to a measure of fitness in which the objective is to maximize rewards minus efforts, divided by time. To explore this idea, we engaged marmosets in a foraging task in which on each trial they decided whether to work by making saccades to visual targets, thus accumulating food, or to harvest by licking what they had earned. We varied the effort cost of harvest by moving the food tube with respect to the mouth. Theory predicted that the subjects should respond to the increased effort costs by choosing to work longer, stockpiling food before commencing harvest, but reduce their movement vigor to conserve energy. Indeed, in response to an increased effort cost of harvest, marmosets extended their work duration, but slowed their movements. These changes in decisions and movements coincided with changes in pupil size. As the effort cost of harvest declined, work duration decreased, the pupils dilated, and the vigor of licks and saccades increased. Thus, when acquisition of reward became effortful, the pupils constricted, the decisions exhibited delayed gratification, and the movements displayed reduced vigor. Significance statement Our results suggest that as the brainstem neuromodulatory circuits that control pupil size respond to effort costs, they alter computations in the brain regions that control decisions, encouraging work and delaying gratification, and the brain regions that control movements, reducing vigor and suppressing energy expenditure. This coordinated response suggests that decisions and actions are part of a single control policy that aims to maximize a variable relevant to fitness: the capture rate.
Collapse
|
5
|
Torricelli F, Tomassini A, Pezzulo G, Pozzo T, Fadiga L, D'Ausilio A. Motor invariants in action execution and perception. Phys Life Rev 2023; 44:13-47. [PMID: 36462345 DOI: 10.1016/j.plrev.2022.11.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Accepted: 11/21/2022] [Indexed: 11/27/2022]
Abstract
The nervous system is sensitive to statistical regularities of the external world and forms internal models of these regularities to predict environmental dynamics. Given the inherently social nature of human behavior, being capable of building reliable predictive models of others' actions may be essential for successful interaction. While social prediction might seem to be a daunting task, the study of human motor control has accumulated ample evidence that our movements follow a series of kinematic invariants, which can be used by observers to reduce their uncertainty during social exchanges. Here, we provide an overview of the most salient regularities that shape biological motion, examine the role of these invariants in recognizing others' actions, and speculate that anchoring socially-relevant perceptual decisions to such kinematic invariants provides a key computational advantage for inferring conspecifics' goals and intentions.
Collapse
Affiliation(s)
- Francesco Torricelli
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Alice Tomassini
- Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Via San Martino della Battaglia 44, 00185 Rome, Italy
| | - Thierry Pozzo
- Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; INSERM UMR1093-CAPS, UFR des Sciences du Sport, Université Bourgogne Franche-Comté, F-21000, Dijon, France
| | - Luciano Fadiga
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Alessandro D'Ausilio
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy.
| |
Collapse
|
6
|
Design and Scaling of Exoskeleton Power Units Considering Load Cycles of Humans. ROBOTICS 2022. [DOI: 10.3390/robotics11050107] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022] Open
Abstract
Exoskeletons are powerful tools for aiding humans with pathological conditions, in dangerous environments or in manually exhausting tasks. Typically, they are designed for specific maximum scenarios without taking into account the diversity of tasks and the individuality of the user. To address this discrepancy, a framework was developed for personalizing an exoskeleton by scaling the components, especially the electrical machine, based on different simulated human muscle forces. The main idea was to scale a numerical arm model based on body mass and height to predict different movements representing both manual labor and daily activities. The predicted torques necessary to produce these movements were then used to generate a load/performance cycle for the power unit design. Considering these torques, main operation points of this load cycle were defined and a reference power unit was scaled and optimized. Therefore, a scalability model for an electrical machine is introduced. This individual adaptation and scaling of the power unit for different users leads to a better performance and a lighter design.
Collapse
|
7
|
Ballester BR, Winstein C, Schweighofer N. Virtuous and Vicious Cycles of Arm Use and Function Post-stroke. Front Neurol 2022; 13:804211. [PMID: 35422752 PMCID: PMC9004626 DOI: 10.3389/fneur.2022.804211] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2021] [Accepted: 02/03/2022] [Indexed: 12/22/2022] Open
Abstract
Large doses of movement practice have been shown to restore upper extremities' motor function in a significant subset of individuals post-stroke. However, such large doses are both difficult to implement in the clinic and highly inefficient. In addition, an important reduction in upper extremity function and use is commonly seen following rehabilitation-induced gains, resulting in "rehabilitation in vain". For those with mild to moderate sensorimotor impairment, the limited spontaneous use of the more affected limb during activities of daily living has been previously proposed to cause a decline of motor function, initiating a vicious cycle of recovery, in which non-use and poor performance reinforce each other. Here, we review computational, experimental, and clinical studies that support the view that if arm use is raised above an effective threshold, one enters a virtuous cycle in which arm use and function can reinforce each other via self-practice in the wild. If not, one enters a vicious cycle of declining arm use and function. In turn, and in line with best practice therapy recommendations, this virtuous/vicious cycle model advocates for a paradigm shift in neurorehabilitation whereby rehabilitation be embedded in activities of daily living such that self-practice with the aid of wearable technology that reminds and motivates can enhance paretic limb use of those who possess adequate residual sensorimotor capacity. Altogether, this model points to a user-centered approach to recovery post-stroke that is tailored to the participant's level of arm use and designed to motivate and engage in self-practice through progressive success in accomplishing meaningful activities in the wild.
Collapse
Affiliation(s)
- Belen R. Ballester
- Synthetic, Perceptive, Emotive and Cognitive Systems Laboratory, Institute for Bioengineering in Catalonia, Barcelona, Spain
| | - Carolee Winstein
- Division of Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, United States
| | - Nicolas Schweighofer
- Division of Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, CA, United States
| |
Collapse
|
8
|
Berret B, Baud-Bovy G. Evidence for a cost of time in the invigoration of isometric reaching movements. J Neurophysiol 2022; 127:689-701. [PMID: 35138953 DOI: 10.1152/jn.00536.2021] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
How the brain determines the vigor of goal-directed movements is a fundamental question in neuroscience. Recent evidence has suggested that vigor results from a trade-off between a cost related to movement production (cost of movement) and a cost related to our brain's tendency to temporally discount the value of future reward (cost of time). However, whether it is critical to hypothesize a cost of time to explain the vigor of basic reaching movements with intangible reward is unclear because the cost of movement may be theoretically sufficient for this purpose. Here we directly address this issue by designing an isometric reaching task whose completion can be accurate and effortless in prefixed durations. The cost of time hypothesis predicts that participants should be prone to spend energy to save time even if the task can be accomplished at virtually no motor cost. Accordingly, we found that all participants generated substantial amounts of force to invigorate task accomplishment, especially when the prefixed duration was long enough. Remarkably, the time saved by each participant was linked to their original vigor in the task and predicted by an optimal control model balancing out movement and time costs. Taken together, these results supports the existence of an idiosyncratic, cognitive cost of time that underlies the invigoration of basic isometric reaching movements.
Collapse
Affiliation(s)
- Bastien Berret
- Université Paris-Saclay CIAMS, 91405, Orsay, France.,CIAMS, Université d'Orléans, 45067, Orléans, France.,Institut Universitaire de France, Paris, France
| | - Gabriel Baud-Bovy
- Robotics, Brain and Cognitive Sciences Unit, Istituto Italiano di Tecnologia, Genoa, Italy.,Faculty of Psychology, Vita-Salute San Raffaele University, Milan, Italy
| |
Collapse
|
9
|
Kim S, Han CE, Kim B, Winstein CJ, Schweighofer N. Effort, success, and side of lesion determine arm choice in individuals with chronic stroke. J Neurophysiol 2022; 127:255-266. [PMID: 34879206 PMCID: PMC8782657 DOI: 10.1152/jn.00532.2020] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/03/2023] Open
Abstract
In neurotypical individuals, arm choice in reaching movements depends on expected biomechanical effort, expected success, and a handedness bias. Following a stroke, does arm choice change to account for the decreased motor performance, or does it follow a preinjury habitual preference pattern? Participants with mild-to-moderate chronic stroke who were right-handed before stroke performed reaching movements in both spontaneous and forced-choice blocks, under no-time, medium-time, and fast-time constraint conditions designed to modulate reaching success. Mixed-effects logistic regression models of arm choice revealed that expected effort predicted choices. However, expected success only strongly predicted choice in left-hemiparetic individuals. In addition, reaction times decreased in left-hemiparetic individuals between the no-time and the fast-time constraint conditions but showed no changes in right-hemiparetic individuals. Finally, arm choice in the no-time constraint condition correlated with a clinical measure of spontaneous arm use for right-, but not for left-hemiparetic individuals. Our results are consistent with the view that right-hemiparetic individuals show a habitual pattern of arm choice for reaching movements relatively independent of failures. In contrast, left-hemiparetic individuals appear to choose their paretic left arm more optimally: that is, if a movement with the paretic arm is predicted to be not successful in the upcoming movement, the nonparetic right arm is chosen instead.NEW & NOTEWORTHY Although we are seldom aware of it, we constantly make decisions to use one arm or the other in daily activities. Here, we studied whether these decisions change following stroke. Our results show that effort, success, and side of lesion determine arm choice in a reaching task: whereas left-paretic individuals modified their arm choice in response to failures in reaching the target, right-paretic individuals showed a pattern of choice independent of failures.
Collapse
Affiliation(s)
- Sujin Kim
- 1Division of Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, California,2Department of Physical Therapy, Jeonju University, Jeonju, Republic of Korea
| | - Cheol E. Han
- 3Department of Electronics and Information Engineering, Korea University, Sejong, Republic of Korea
| | - Bokkyu Kim
- 1Division of Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, California,4Department of Physical Therapy Education, SUNY Upstate Medical University, Syracuse, New York
| | - Carolee J. Winstein
- 1Division of Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, California
| | - Nicolas Schweighofer
- 1Division of Biokinesiology and Physical Therapy, University of Southern California, Los Angeles, California
| |
Collapse
|
10
|
Faity G, Mottet D, Pla S, Froger J. The reserve of joint torque determines movement coordination. Sci Rep 2021; 11:23008. [PMID: 34836976 PMCID: PMC8626510 DOI: 10.1038/s41598-021-02338-4] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2021] [Accepted: 11/12/2021] [Indexed: 11/09/2022] Open
Abstract
Humans coordinate biomechanical degrees of freedom to perform tasks at minimum cost. When reaching a target from a seated position, the trunk-arm-forearm coordination moves the hand to the well-defined spatial goal, while typically minimising hand jerk and trunk motion. However, due to fatigue or stroke, people visibly move the trunk more, and it is unclear what cost can account for this. Here we show that people recruit their trunk when the torque at the shoulder is too close to the maximum. We asked 26 healthy participants to reach a target while seated and we found that the trunk contribution to hand displacement increases from 11 to 27% when an additional load is handled. By flexing and rotating the trunk, participants spontaneously increase the reserve of anti-gravitational torque at the shoulder from 25 to 40% of maximal voluntary torque. Our findings provide hints on how to include the reserve of torque in the cost function of optimal control models of human coordination in healthy fatigued persons or in stroke victims.
Collapse
Affiliation(s)
- Germain Faity
- EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Alès, Montpellier, France
| | - Denis Mottet
- EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Alès, Montpellier, France.
| | - Simon Pla
- EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Alès, Montpellier, France
| | - Jérôme Froger
- EuroMov Digital Health in Motion, Univ Montpellier, IMT Mines Alès, CHU Nîmes, Le Grau du Roi, France
| |
Collapse
|
11
|
Jovanovic L, López-Moliner J, Mamassian P. Contrasting contributions of movement onset and duration to self-evaluation of sensorimotor timing performance. Eur J Neurosci 2021; 54:5092-5111. [PMID: 34196067 PMCID: PMC9291449 DOI: 10.1111/ejn.15378] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2020] [Accepted: 06/22/2021] [Indexed: 12/01/2022]
Abstract
Movement execution is not always optimal. Understanding how humans evaluate their own motor decisions can give us insights into their suboptimality. Here, we investigated how humans time the action of synchronizing an arm movement with a predictable visual event and how well they can evaluate the outcome of this action. On each trial, participants had to decide when to start (reaction time) and for how long to move (movement duration) to reach a target on time. After each trial, participants judged the confidence they had that their performance on that trial was better than average. We found that participants mostly varied their reaction time, keeping the average movement duration short and relatively constant across conditions. Interestingly, confidence judgements reflected deviations from the planned reaction time and were not related to planned movement duration. In two other experiments, we replicated these results in conditions where the contribution of sensory uncertainty was reduced. In contrast to confidence judgements, when asked to make an explicit estimation of their temporal error, participants' estimates were related in a similar manner to both reaction time and movement duration. In summary, humans control the timing of their actions primarily by adjusting the delay to initiate the action, and they estimate their confidence in their action from the difference between the planned and executed movement onset. Our results highlight the critical role of the internal model for the self‐evaluation of one's motor performance.
Collapse
Affiliation(s)
- Ljubica Jovanovic
- Laboratoire des systèmes perceptifs, Département d'études cognitives, École normale supérieure, PSL University, CNRS, Paris, France.,School of Psychology, University of Nottingham, Nottingham, UK
| | - Joan López-Moliner
- Vision and Control of Action (VISCA) Group, Department of Cognition, Development and Psychology of Education, Institut de Neurociències, Universitat de Barcelona, Barcelona, Catalonia, Spain
| | - Pascal Mamassian
- Laboratoire des systèmes perceptifs, Département d'études cognitives, École normale supérieure, PSL University, CNRS, Paris, France
| |
Collapse
|
12
|
Berret B, Conessa A, Schweighofer N, Burdet E. Stochastic optimal feedforward-feedback control determines timing and variability of arm movements with or without vision. PLoS Comput Biol 2021; 17:e1009047. [PMID: 34115757 PMCID: PMC8221793 DOI: 10.1371/journal.pcbi.1009047] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2020] [Revised: 06/23/2021] [Accepted: 05/05/2021] [Indexed: 11/18/2022] Open
Abstract
Human movements with or without vision exhibit timing (i.e. speed and duration) and variability characteristics which are not well captured by existing computational models. Here, we introduce a stochastic optimal feedforward-feedback control (SFFC) model that can predict the nominal timing and trial-by-trial variability of self-paced arm reaching movements carried out with or without online visual feedback of the hand. In SFFC, movement timing results from the minimization of the intrinsic factors of effort and variance due to constant and signal-dependent motor noise, and movement variability depends on the integration of visual feedback. Reaching arm movements data are used to examine the effect of online vision on movement timing and variability, and test the model. This modelling suggests that the central nervous system predicts the effects of sensorimotor noise to generate an optimal feedforward motor command, and triggers optimal feedback corrections to task-related errors based on the available limb state estimate.
Collapse
Affiliation(s)
- Bastien Berret
- Université Paris-Saclay CIAMS, Orsay, France
- CIAMS, Université d’Orléans, Orléans, France
- Institut Universitaire de France, Paris, France
- * E-mail:
| | - Adrien Conessa
- Université Paris-Saclay CIAMS, Orsay, France
- CIAMS, Université d’Orléans, Orléans, France
| | - Nicolas Schweighofer
- University of Southern California, Los Angeles, California, United States of America
| | - Etienne Burdet
- University of Southern California, Los Angeles, California, United States of America
| |
Collapse
|
13
|
|
14
|
Berret B, Jean F. Stochastic optimal open-loop control as a theory of force and impedance planning via muscle co-contraction. PLoS Comput Biol 2020; 16:e1007414. [PMID: 32109941 PMCID: PMC7065824 DOI: 10.1371/journal.pcbi.1007414] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/17/2019] [Revised: 03/11/2020] [Accepted: 12/23/2019] [Indexed: 11/22/2022] Open
Abstract
Understanding the underpinnings of biological motor control is an important issue in movement neuroscience. Optimal control theory is a leading framework to rationalize this problem in computational terms. Previously, optimal control models have been devised either in deterministic or in stochastic settings to account for different aspects of motor control (e.g. average behavior versus trial-to-trial variability). While these approaches have yielded valuable insights about motor control, they typically fail in explaining muscle co-contraction. Co-contraction of a group of muscles associated to a motor function (e.g. agonist and antagonist muscles spanning a joint) contributes to modulate the mechanical impedance of the neuromusculoskeletal system (e.g. joint viscoelasticity) and is thought to be mainly under the influence of descending signals from the brain. Here we present a theory suggesting that one primary goal of motor planning may be to issue feedforward (open-loop) motor commands that optimally specify both force and impedance, according to noisy neuromusculoskeletal dynamics and to optimality criteria based on effort and variance. We show that the proposed framework naturally accounts for several previous experimental findings regarding the regulation of force and impedance via muscle co-contraction in the upper-limb. Stochastic optimal (closed-loop) control, preprogramming feedback gains but requiring on-line state estimation processes through long-latency sensory feedback loops, may then complement this nominal feedforward motor command to fully determine the limb’s mechanical impedance. The proposed stochastic optimal open-loop control theory may provide new insights about the general articulation of feedforward/feedback control mechanisms and justify the occurrence of muscle co-contraction in the neural control of movement. This study presents a novel computational theory to explain the planning of force and impedance (e.g. viscoelasticity) in the neural control of movement. It assumes that one main goal of motor planning is to elaborate feedforward motor commands that determine both the force and the impedance required for the task at hand. These feedforward motor commands (i.e. that are defined prior to movement execution) are designed to minimize effort and variance costs considering the uncertainty arising from sensorimotor or environmental noise. A major outcome of this mathematical framework is the explanation of muscle co-contraction (i.e. the concurrent contraction of a group of muscles involved in a motor function). Muscle co-contraction has been shown to occur in many situations but previous modeling works struggled to account for it. Although effortful, co-contraction contributes to increase the robustness of motor behavior (e.g. small variance) upstream of sophisticated optimal closed-loop control processes that require state estimation from delayed sensory feedback to function. This work may have implications regarding our understanding of the neural control of movement in computational terms. It also provides a theoretical ground to explain how to optimally plan force and impedance within a general and versatile framework.
Collapse
Affiliation(s)
- Bastien Berret
- Université Paris-Saclay CIAMS, Orsay, France
- CIAMS, Université d’Orléans, Orléans, France
- Institut Universitaire de France, Paris, France
- * E-mail:
| | - Frédéric Jean
- Unité de Mathématiques Appliquées, ENSTA Paris, Institut Polytechnique de Paris, Palaiseau, France
| |
Collapse
|
15
|
Labaune O, Deroche T, Teulier C, Berret B. Vigor of reaching, walking, and gazing movements: on the consistency of interindividual differences. J Neurophysiol 2019; 123:234-242. [PMID: 31774359 DOI: 10.1152/jn.00344.2019] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/01/2023] Open
Abstract
Movement vigor is an important feature of motor control that is thought to originate from cortico-basal ganglia circuits and processes shared with decision-making, such as temporal reward discounting. Accordingly, vigor may be related to one's relationship with time, which may, in turn, reflect a general trait-like feature of individuality. While significant interindividual differences of vigor have been typically reported for isolated motor tasks, little is known about the consistency of such differences across tasks and movement effectors. Here, we assessed interindividual consistency of vigor across reaching (both dominant and nondominant arm), walking, and gazing movements of various distances within the same group of 20 participants. Given distinct neural pathways and biomechanical specificities of each movement modality, a significant consistency would corroborate the trait-like aspect of vigor. Vigor scores for dominant and nondominant arm movements were found to be highly correlated across individuals. Vigor scores of reaching and walking were also significantly correlated across individuals, indicating that people who reach faster than others also tend to walk faster. At last, vigor scores of saccades were uncorrelated with those of reaching and walking, reaffirming that the vigor of stimulus-elicited eye saccades is distinct. These findings highlight the trait-like aspect of vigor for reaching movements with either arms and, to a lesser extent, walking.NEW & NOTEWORTHY Robust interindividual differences of movement vigor have been reported for arm reaching and saccades. Beyond biomechanics, personality trait-like characteristics have been proposed to account for those differences. Here, we examined for the first time the consistency of interindividual differences of vigor during dominant/nondominant arm reaching, walking, and gazing to assess the trait-like aspect of vigor. We found a significant consistency of vigor within our group of individuals for all tested tasks/effectors except saccades.
Collapse
Affiliation(s)
- Ombeline Labaune
- Complexité, innovation, activités motrices et sportives (CIAMS), Université Paris Sud, Université Paris-Saclay, Orsay, France.,CIAMS, Université d'Orléans, Orléans, France
| | - Thomas Deroche
- Complexité, innovation, activités motrices et sportives (CIAMS), Université Paris Sud, Université Paris-Saclay, Orsay, France.,CIAMS, Université d'Orléans, Orléans, France
| | - Caroline Teulier
- Complexité, innovation, activités motrices et sportives (CIAMS), Université Paris Sud, Université Paris-Saclay, Orsay, France.,CIAMS, Université d'Orléans, Orléans, France
| | - Bastien Berret
- Complexité, innovation, activités motrices et sportives (CIAMS), Université Paris Sud, Université Paris-Saclay, Orsay, France.,CIAMS, Université d'Orléans, Orléans, France.,Institut Universitaire de France, Paris, France
| |
Collapse
|
16
|
Abstract
The capacity to move is essential for independence and declines with age. Limitations in mobility impact ~35% of adults over 70 and the majority of adults over 85. These limitations are highly associated with disability, dependency, and survival. More than 25-years ago the term “sarcopenia” was coined to highlight the age-related loss of muscle mass and strength with the assumption being that sarcopenia led to limitations in mobility. However, contrary to expectations, recent findings clearly indicate these variables only modestly explain limitations in mobility. One likely reason the current sarcopenia variables of muscle mass and strength do not discriminate, or predict, mobility limitations well is because they are heavily influenced by musculoskeletal mechanisms and do not incorporate measures reflective of the central neural control of mobility. Unfortunately, the precise central neural changes associated with aging that lead to decreased mobility are poorly understood. This knowledge gap has hampered the development of effective interventions for mobility limitations and the subsequent reduction of major functional disability for older adults. Here, we discuss the potential role of the motor control circuit of the dorsal basal ganglia as well as dopaminergic function in age-related reductions in mobility.
Collapse
|
17
|
Shih HJS, Jarvis DN, Mikkelsen P, Kulig K. Interlimb Force Coordination in Bipedal Dance Jumps: Comparison Between Experts and Novices. J Appl Biomech 2018; 34:462-468. [PMID: 29809067 DOI: 10.1123/jab.2017-0216] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/13/2017] [Revised: 04/13/2018] [Accepted: 05/10/2018] [Indexed: 11/18/2022]
Abstract
Bipedal tasks require interlimb coordination that improves with practice and acquisition of skills. The purpose of this study was to compare interlimb force coordination during dance-specific rate-controlled consecutive bipedal jumps (sautés) between expert dancers and nondancers. To analyze coordination of vertical ground reaction forces recorded under each leg, the vector coding approach was used. Although there were no differences in the patterns of interlimb force coordination between groups, the dancers exhibited less variability of interlimb force coordination during the transition phase from weight acceptance to propulsion as well as during the propulsion phase itself. The interlimb force coordination variability was associated with task performance only during the transition phase, which highlights the potential importance of control during this phase. In conclusion, expert dancers were better at reducing interlimb force coordination variability during the task-relevant transition phase, which was related to better performance at maintaining jump rate and jump height consistency.
Collapse
|
18
|
Abstract
During foraging, animals decide how long to stay at a patch and harvest reward, and then, they move with certain vigor to another location. How does the brain decide when to leave, and how does it determine the speed of the ensuing movement? Here, we considered the possibility that both the decision-making and the motor control problems aimed to maximize a single normative utility: the sum of all rewards acquired minus all efforts expended divided by total time. This optimization could be achieved if the brain compared a local measure of utility with its history. To test the theory, we examined behavior of people as they gazed at images: they chose how long to look at the image (harvesting information) and then moved their eyes to another image, controlling saccade speed. We varied reward via image content and effort via image eccentricity, and then, we measured how these changes affected decision making (gaze duration) and motor control (saccade speed). After a history of low rewards, people increased gaze duration and decreased saccade speed. In anticipation of future effort, they lowered saccade speed and increased gaze duration. After a history of high effort, they elevated their saccade speed and increased gaze duration. Therefore, the theory presented a principled way with which the brain may control two aspects of behavior: movement speed and harvest duration. Our experiments confirmed many (but not all) of the predictions, suggesting that harvest duration and movement speed, fundamental aspects of behavior during foraging, may be governed by a shared principle of control.
Collapse
|
19
|
Vigour of self-paced reaching movement: cost of time and individual traits. Sci Rep 2018; 8:10655. [PMID: 30006639 PMCID: PMC6045586 DOI: 10.1038/s41598-018-28979-6] [Citation(s) in RCA: 24] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2018] [Accepted: 07/03/2018] [Indexed: 11/16/2022] Open
Abstract
People usually move at a self-selected pace in everyday life. Yet, the principles underlying the formation of human movement vigour remain unclear, particularly in view of intriguing inter-individual variability. It has been hypothesized that how the brain values time may be the cornerstone of such differences, beyond biomechanics. Here, we focused on the vigour of self-paced reaching movement and assessed the stability of vigour via repeated measurements within participants. We used an optimal control methodology to identify a cost of time (CoT) function underlying each participant’s vigour, considering a model of the biomechanical cost of movement. We then tested the extent to which anthropometric or psychological traits, namely boredom proneness and impulsivity, could account for a significant part of inter-individual variance in vigour and CoT parameters. Our findings show that the vigour of reaching is largely idiosyncratic and tend to corroborate a relation between the relative steepness of the identified CoT and boredom proneness, a psychological trait relevant to one’s relationship with time in decision-making.
Collapse
|
20
|
Reppert TR, Rigas I, Herzfeld DJ, Sedaghat-Nejad E, Komogortsev O, Shadmehr R. Movement vigor as a traitlike attribute of individuality. J Neurophysiol 2018; 120:741-757. [PMID: 29766769 DOI: 10.1152/jn.00033.2018] [Citation(s) in RCA: 41] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
A common aspect of individuality is our subjective preferences in evaluation of reward and effort. The neural circuits that evaluate these commodities influence circuits that control our movements, raising the possibility that vigor differences between individuals may also be a trait of individuality, reflecting a willingness to expend effort. In contrast, classic theories in motor control suggest that vigor differences reflect a speed-accuracy trade-off, predicting that those who move fast are sacrificing accuracy for speed. Here we tested these contrasting hypotheses. We measured motion of the eyes, head, and arm in healthy humans during various elementary movements (saccades, head-free gaze shifts, and reaching). For each person we characterized their vigor, i.e., the speed with which they moved a body part (peak velocity) with respect to the population mean. Some moved with low vigor, while others moved with high vigor. Those with high vigor tended to react sooner to a visual stimulus, moving both their eyes and arm with a shorter reaction time. Arm and head vigor were tightly linked: individuals who moved their head with high vigor also moved their arm with high vigor. However, eye vigor did not correspond strongly with arm or head vigor. In all modalities, vigor had no impact on end-point accuracy, demonstrating that differences in vigor were not due to a speed-accuracy trade-off. Our results suggest that movement vigor may be a trait of individuality, not reflecting a willingness to accept inaccuracy but demonstrating a propensity to expend effort. NEW & NOTEWORTHY A common aspect of individuality is how we evaluate economic variables like reward and effort. This valuation affects not only decision making but also motor control, raising the possibility that vigor may be distinct between individuals but conserved across movements within an individual. Here we report conservation of vigor across elementary skeletal movements, but not eye movements, raising the possibility that the individuality of our movements may be driven by a common neural mechanism of effort evaluation across modalities of skeletal motor control.
Collapse
Affiliation(s)
- Thomas R Reppert
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine , Baltimore, Maryland
| | - Ioannis Rigas
- Department of Computer Science, Texas State University , San Marcos, Texas
| | - David J Herzfeld
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine , Baltimore, Maryland
| | - Ehsan Sedaghat-Nejad
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine , Baltimore, Maryland
| | - Oleg Komogortsev
- Department of Computer Science and Engineering, Michigan State University, East Lansing, Michigan
| | - Reza Shadmehr
- Laboratory for Computational Motor Control, Department of Biomedical Engineering, Johns Hopkins School of Medicine , Baltimore, Maryland
| |
Collapse
|
21
|
Summerside EM, Shadmehr R, Ahmed AA. Vigor of reaching movements: reward discounts the cost of effort. J Neurophysiol 2018. [PMID: 29537911 DOI: 10.1152/jn.00872.2017] [Citation(s) in RCA: 89] [Impact Index Per Article: 14.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023] Open
Abstract
Making a movement may be thought of as an economic decision in which one spends effort to acquire reward. Time discounts reward, which predicts that the magnitude of reward should affect movement vigor: we should move faster, spending greater effort, when there is greater reward at stake. Indeed, saccade peak velocities are greater and reaction-times shorter when a target is paired with reward. In this study, we focused on human reaching and asked whether movement kinematics were affected by expectation of reward. Participants made out-and-back reaching movements to one of four quadrants of a 14-cm circle. During various periods of the experiment only one of the four quadrants was paired with reward, and the transition from reward to nonreward status of a quadrant occurred randomly. Our experiment design minimized dependence of reward on accuracy, granting the subjects wide latitude in self-selecting their movement speed, amplitude, and variability. When a quadrant was paired with reward, reaching movements had a shorter reaction time, higher peak velocity, and greater amplitude. Despite this greater vigor, movements toward the rewarded quadrant suffered from less variability: both reaction times and reach kinematics were less variable when there was expectation of reward. Importantly, the effect of reward on vigor was specific to the movement component that preceded the time of reward (outward reach), not the movement component that followed it (return reach). Our results suggest that expectation of reward not only increases vigor of human reaching but also decreases its variability. NEW & NOTEWORTHY Movements may be thought of as an economic transaction where the vigor of the movement represents the effort that the brain is willing to expend to acquire a rewarding state. We show that in reaching, reward discounts the cost of effort, producing movements with shorter reaction time, higher velocity, greater amplitude, and reduced reaction-time variability. These results complement earlier observations in saccades, suggesting a common principle of economics across modalities of motor control.
Collapse
Affiliation(s)
- Erik M Summerside
- Department of Integrative Physiology, University of Colorado , Boulder, Colorado
| | - Reza Shadmehr
- Department of Biomedical Engineering, Johns Hopkins University , Baltimore, Maryland
| | - Alaa A Ahmed
- Department of Integrative Physiology, University of Colorado , Boulder, Colorado
| |
Collapse
|
22
|
Peternel L, Sigaud O, Babič J. Unifying Speed-Accuracy Trade-Off and Cost-Benefit Trade-Off in Human Reaching Movements. Front Hum Neurosci 2017; 11:615. [PMID: 29379424 PMCID: PMC5770750 DOI: 10.3389/fnhum.2017.00615] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/29/2017] [Accepted: 12/05/2017] [Indexed: 11/18/2022] Open
Abstract
Two basic trade-offs interact while our brain decides how to move our body. First, with the cost-benefit trade-off, the brain trades between the importance of moving faster toward a target that is more rewarding and the increased muscular cost resulting from a faster movement. Second, with the speed-accuracy trade-off, the brain trades between how accurate the movement needs to be and the time it takes to achieve such accuracy. So far, these two trade-offs have been well studied in isolation, despite their obvious interdependence. To overcome this limitation, we propose a new model that is able to simultaneously account for both trade-offs. The model assumes that the central nervous system maximizes the expected utility resulting from the potential reward and the cost over the repetition of many movements, taking into account the probability to miss the target. The resulting model is able to account for both the speed-accuracy and the cost-benefit trade-offs. To validate the proposed hypothesis, we confront the properties of the computational model to data from an experimental study where subjects have to reach for targets by performing arm movements in a horizontal plane. The results qualitatively show that the proposed model successfully accounts for both cost-benefit and speed-accuracy trade-offs.
Collapse
Affiliation(s)
- Luka Peternel
- HRII Lab, Advanced Robotics, Istituto Italiano di Technologia, Genoa, Italy.,Department for Automation, Biocybernetics and Robotics, Jožef Stefan Institute, Ljubljana, Slovenia
| | - Olivier Sigaud
- Sorbonne Universités, UPMC Univ Paris 06, CNRS UMR 7222, Institut des Systèmes Intelligents et de Robotique, Paris, France
| | - Jan Babič
- Department for Automation, Biocybernetics and Robotics, Jožef Stefan Institute, Ljubljana, Slovenia
| |
Collapse
|