1
|
Jakubowitz E, Schmidt L, Obermeier A, Spindeldreier S, Windhagen H, Hurschler C. Investigation of adaptive muscle synergy modulated motor responses to grasping perturbations. Sci Rep 2024; 14:18493. [PMID: 39122740 PMCID: PMC11315883 DOI: 10.1038/s41598-024-68386-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2024] [Accepted: 07/23/2024] [Indexed: 08/12/2024] Open
Abstract
This study investigated how muscle synergies adapt in response to unexpected changes in object weight during lifting tasks. The aim was to discover which motor control strategies individuals use to maintain their grasping performance. Muscle synergies were extracted from the muscle activity of fifteen healthy participants who lifted objects of identical appearance but varying weights in a randomized order, which introduced artificial perturbations. Reaching and manipulation phases of object lifting were analyzed using constrained non-negative matrix factorization and k-means clustering. Participants exhibited a perturbation-independent and thus consistent recruitment of spatial synergy components, while significant adaptations in muscle synergy activation occurred in response to unexpected perturbations. Perturbations caused by unexpectedly heavy objects led to delayed and gradual increases in muscle synergy activation until the force required to lift the object was reached. In contrast, perturbations caused by lighter objects led to reductions in excess muscle synergy activation occurring later. Sensorimotor control maintains the modularity of muscle synergies. Even when external mechanical perturbations occur, the grasping performance is preserved, and control is adapted solely through muscle synergy activation. These results suggest that using pure spatial synergy components as control signals for myoelectric arm prostheses may prevent them from malfunctioning due to external perturbations.
Collapse
Affiliation(s)
- Eike Jakubowitz
- Laboratory for Biomechanics and Biomaterials, Department of Orthopaedic Surgery, Hannover Medical School, Anna-Von-Borries-Strasse 1-7, 30625, Hannover, Germany.
| | - Leonard Schmidt
- Laboratory for Biomechanics and Biomaterials, Department of Orthopaedic Surgery, Hannover Medical School, Anna-Von-Borries-Strasse 1-7, 30625, Hannover, Germany
| | - Alina Obermeier
- Laboratory for Biomechanics and Biomaterials, Department of Orthopaedic Surgery, Hannover Medical School, Anna-Von-Borries-Strasse 1-7, 30625, Hannover, Germany
| | - Svenja Spindeldreier
- Institute of Mechatronic Systems, Leibniz University Hannover, An Der Universität 1, 30823, Garbsen, Germany
| | - Henning Windhagen
- Laboratory for Biomechanics and Biomaterials, Department of Orthopaedic Surgery, Hannover Medical School, Anna-Von-Borries-Strasse 1-7, 30625, Hannover, Germany
- Department of Orthopaedic Surgery, Hannover Medical School, Anna-Von-Borries-Strasse 1-7, 30625, Hannover, Germany
| | - Christof Hurschler
- Laboratory for Biomechanics and Biomaterials, Department of Orthopaedic Surgery, Hannover Medical School, Anna-Von-Borries-Strasse 1-7, 30625, Hannover, Germany
| |
Collapse
|
2
|
Alterman BL, Ali S, Keeton E, Binkley K, Hendrix W, Lee PJ, Johnson JT, Wang S, Kling J, Gale MK, Wheaton LA. Grasp Posture Variability Leads to Greater Ipsilateral Sensorimotor Beta Activation During Simulated Prosthesis Use. J Mot Behav 2024:1-13. [PMID: 39041372 DOI: 10.1080/00222895.2024.2364657] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Accepted: 05/30/2024] [Indexed: 07/24/2024]
Abstract
Motor behaviour using upper-extremity prostheses of different levels is greatly variable, leading to challenges interpreting ideal rehabilitation strategies. Elucidating the underlying neural control mechanisms driving variability benefits our understanding of adaptation after limb loss. In this follow-up study, non-amputated participants completed simple and complex reach-to-grasp motor tasks using a body-powered transradial or partial-hand prosthesis simulator. We hypothesised that under complex task constraints, individuals employing variable grasp postures will show greater sensorimotor beta activation compared to individuals relying on uniform grasping, and activation will occur later in variable compared to uniform graspers. In the simple task, partial-hand variable and transradial users showed increased neural activation from the early to late phase of the reach, predominantly in the hemisphere ipsilateral to device use. In the complex task, only partial-hand variable graspers showed a significant increase in neural activation of the sensorimotor cortex from the early to the late phase of the reach. These results suggest that grasp variability may be a crucial component in the mechanism of neural adaptation to prosthesis use, and may be mediated by device level and task complexity, with implications for rehabilitation after amputation.
Collapse
Affiliation(s)
- Bennett L Alterman
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, GA, USA
| | - Saif Ali
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, GA, USA
| | - Emily Keeton
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, GA, USA
| | - Katrina Binkley
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, GA, USA
| | - William Hendrix
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, GA, USA
| | - Perry J Lee
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, GA, USA
| | - John T Johnson
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, GA, USA
| | - Shuo Wang
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, GA, USA
| | - James Kling
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, GA, USA
| | - Mary Kate Gale
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, GA, USA
| | - Lewis A Wheaton
- School of Biological Sciences, Georgia Institute of Technology, Atlanta, GA, USA
| |
Collapse
|
3
|
Muller KS, Panfili D, Shields S, Matthis JS, Bonnen K, Hayhoe MM. Foothold selection during locomotion in uneven terrain: Results from the integration of eye tracking, motion capture, and photogrammetry. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.08.18.553818. [PMID: 37645862 PMCID: PMC10462120 DOI: 10.1101/2023.08.18.553818] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 08/31/2023]
Abstract
Relatively little is known about the way vision is used to guide locomotion in the natural world. What visual features are used to choose paths in natural complex terrain? To answer this question, we measured eye and body movements while participants walked in natural outdoor environments. We incorporated measurements of the 3D terrain structure into our analyses and reconstructed the terrain along the walker's path, applying photogrammetry techniques to the eyetracker's scene camera videos. Combining these reconstructions with the walker's body movements, we demonstrate that walkers take terrain structure into account when selecting paths through an environment. We find that they change direction to avoid taking steeper steps that involve large height changes, instead of choosing more circuitous, relatively flat paths. Our data suggest walkers plan the location of individual footholds and plan ahead to select flatter paths. These results provide evidence that locomotor behavior in natural environments is controlled by decision mechanisms that account for multiple factors, including sensory and motor information, costs, and path planning.
Collapse
|
4
|
Grünbaum T, Christensen MS. The functional role of conscious sensation of movement. Neurosci Biobehav Rev 2024; 164:105813. [PMID: 39019245 DOI: 10.1016/j.neubiorev.2024.105813] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/01/2024] [Revised: 06/25/2024] [Accepted: 07/13/2024] [Indexed: 07/19/2024]
Abstract
This paper proposes a new framework for investigating neural signals sufficient for a conscious sensation of movement and their role in motor control. We focus on signals sufficient for proprioceptive awareness, particularly from muscle spindle activation and from primary motor cortex (M1). Our review of muscle vibration studies reveals that afferent signals alone can induce conscious sensations of movement. Similarly, studies employing peripheral nerve blocks suggest that efferent signals from M1 are sufficient for sensations of movement. On this basis, we show that competing theories of motor control assign different roles to sensation of movement. According to motor command theories, sensation of movement corresponds to an estimation of the current state based on afferent signals, efferent signals, and predictions. In contrast, within active inference architectures, sensations correspond to proprioceptive predictions driven by efferent signals from M1. The focus on sensation of movement provides a way to critically compare and evaluate the two theories. Our analysis offers new insights into the functional roles of movement sensations in motor control and consciousness.
Collapse
Affiliation(s)
- Thor Grünbaum
- Department of Psychology, University of Copenhagen, Denmark; CoInAct Research Group, University of Copenhagen, Denmark; Section for Philosophy, University of Copenhagen, Denmark.
| | - Mark Schram Christensen
- Department of Psychology, University of Copenhagen, Denmark; CoInAct Research Group, University of Copenhagen, Denmark
| |
Collapse
|
5
|
Le Bras T, Allibe B, Doré-Mazars K. The way we look at an image or a webpage can reveal personality traits. Sci Rep 2024; 14:15488. [PMID: 38969715 PMCID: PMC11226433 DOI: 10.1038/s41598-024-62210-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/06/2024] [Accepted: 05/14/2024] [Indexed: 07/07/2024] Open
Abstract
Personality is a central concept and a cross-domain explanatory factor in psychology to characterize and differentiate individuals. Surprisingly, among the many studies on oculomotor behavior, only a few have investigated how personality influences the exploration of a visual stimulus. Due to the limited number of existing studies, it is still uncertain if markers of personality in eye movements are always observable in eye movements across various exploration contexts. Here, introducing a novel concept of gaze-based signatures of personality, we used visual exploration metrics to detect personality signatures across various exploration contexts (visual search and free-viewing on images and webpages) in 91 participants. Personality data were collected as in the reference paper that validated the French version of the Big Five Inventory. Linear regression analyses demonstrated that while Extraversion and Openness to Experience did not correlate with any particular exploration metric, the other three traits-Conscientiousness, Agreeableness, and Neuroticism-correlated robustly with all exploration metrics in different visual exploration contexts. Our study provides evidence for the capture of the gaze-based signature of personality from very brief eye movement recordings.
Collapse
Affiliation(s)
- Thomas Le Bras
- Vision Action Cognition Laboratory, Université Paris Cité, 92700, Boulogne-Billancourt, France.
- Research and Development Department, AB Tasty, 75013, Paris, France.
| | - Benoit Allibe
- Research and Development Department, AB Tasty, 75013, Paris, France
| | - Karine Doré-Mazars
- Vision Action Cognition Laboratory, Université Paris Cité, 92700, Boulogne-Billancourt, France
| |
Collapse
|
6
|
Selimi S, Frings C, Münchau A, Beste C, Moeller B. It's not distance but similarity of distance: changing stimulus relations affect the control of action sequences. PSYCHOLOGICAL RESEARCH 2024; 88:1727-1736. [PMID: 38733538 PMCID: PMC11281967 DOI: 10.1007/s00426-024-01973-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2023] [Accepted: 04/29/2024] [Indexed: 05/13/2024]
Abstract
Interacting with our environment happens on different levels of complexity: While there are individual and simple actions like an isolated button press, most actions are more complex and involve sequences of simpler actions. The degree to which multiple simple actions are represented as one action sequence can be measured via so-called response-response binding effects. When two or more responses are executed consecutively, they are integrated into one representation so that repetition of one response can start retrieval of the other. Executing such an action sequence typically involves responding to multiple objects or stimuli. Here, we investigated whether the spatial relation of these stimuli affects action sequence execution. To that end, we varied the distance between stimuli in a response-response binding task. Stimulus distance might affect response-response binding effects in one of two ways: It might directly affect the representation of the response sequence, making integration and retrieval between responses more likely if the responses relate to close stimuli. Alternatively, the similarity of stimulus distribution during integration and retrieval might be decisive, leading to larger binding effects if stimulus distance is identical during integration and retrieval. We found stronger binding effects with constant than with changing stimulus distance, indicating that action integration and retrieval can easily affect performance also if responses refer to separated objects. However, this effect on performance is diminished by changing spatial distribution of stimuli at the times of integration and retrieval.
Collapse
Affiliation(s)
- Silvia Selimi
- Department of Cognitive Psychology, Trier University, D-54286, Trier, Germany
| | - Christian Frings
- Department of Cognitive Psychology, Trier University, D-54286, Trier, Germany
| | - Alexander Münchau
- Institute of Systems Motor Science, Center of Brain, Behavior and Metabolism, Universität zu Lübeck, Lübeck, Germany
| | - Christian Beste
- Cognitive Neurophysiology, Department of Child and Adolescent Psychiatry, Faculty of Medicine, TU Dresden, Dresden, Germany
| | - Birte Moeller
- Department of Cognitive Psychology, Trier University, D-54286, Trier, Germany.
| |
Collapse
|
7
|
Xie H, Zhang F, Gan S, Wu J, Wu B, Qin K, Wang S, Sweeney JA, Gong Q, Jia Z. Body Satisfaction, Exercise Dependence, and White Matter Microstructure in Young Adults. J Magn Reson Imaging 2024. [PMID: 38874990 DOI: 10.1002/jmri.29485] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2024] [Revised: 05/29/2024] [Accepted: 05/30/2024] [Indexed: 06/15/2024] Open
Abstract
BACKGROUND Self-body satisfaction is considered a psychological factor for exercise dependence (EXD). However, the potential neuropsychological mechanisms underlying this association remain unclear. PURPOSE To investigate the role of white matter microstructure in the association between body satisfaction and EXD. STUDY TYPE Prospective. POPULATION One hundred eight regular exercisers (age 22.11 ± 2.62 years; 58 female). FIELD STRENGTH/SEQUENCE 3.0 Tesla; diffusion-weighted echo planar imaging with 30 directions. ASSESSMENT The Body Shape Satisfaction (BSS) and Exercise Dependence Scale (EDS); whole-brain tract-based spatial statistics (TBSS) and correlational tractography analyses; average fractional anisotropy (FA) and quantitative anisotropy (QA) values of obtained tracts. STATISTICAL TESTS The whole-brain regression model, mediation analysis, and simple slope analysis. P values <0.05 were defined as statistically significant. RESULTS The BSS and EDS scores were 37.33 ± 6.32 and 68.22 ± 13.88, respectively. TBSS showed negative correlations between EDS and FA values in the bilateral corticospinal tract (CST, r = -0.41), right cingulum (r = -0.41), and left superior thalamic radiation (STR, r = -0.50). Correlational tractography showed negative associations between EDS and QA values of the left inferior frontal occipital fasciculus (r = -0.35), STR (r = -0.42), CST (r = -0.31), and right cingulum (r = -0.28). The FA values, rather than QA values, mediated the BSS-EDS association (indirect effects = 0.30). The BSS was significantly associated with the EDS score at both low (β = 1.02) and high (β = 0.43) levels of FA value, while the association was significant only at the high level of QA value (β = 1.26). DATA CONCLUSION EXD was correlated with white matter in frontal-subcortical and sensorimotor networks, and these tracts mediated the body satisfaction-EXD association. White matter microstructure could be a promising neural signature for understanding the underlying neuropsychological mechanisms of EXD. LEVEL OF EVIDENCE 2 TECHNICAL EFFICACY: Stage 1.
Collapse
Affiliation(s)
- Hongsheng Xie
- Department of Nuclear Medicine, West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
| | - Feifei Zhang
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
- Department of Radiology, First Hospital of Shanxi Medical University, Taiyuan, Shanxi, China
| | - Sanshan Gan
- Department of Nuclear Medicine, West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
| | - Jiahao Wu
- Department of Nuclear Medicine, West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
| | - Baolin Wu
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
- Department of Radiology and Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, China
| | - Kun Qin
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
- Department of Radiology and Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, China
| | - Song Wang
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
- Department of Radiology and Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, China
| | - John A Sweeney
- Department of Radiology and Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, China
- Department of Psychiatry and Behavioral Neuroscience, University of Cincinnati, Cincinnati, Ohio, USA
| | - Qiyong Gong
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
- Department of Radiology and Huaxi MR Research Center (HMRRC), Functional and Molecular Imaging Key Laboratory of Sichuan Province, West China Hospital, Sichuan University, Chengdu, China
- Department of Radiology, West China Xiamen Hospital of Sichuan University, Xiamen, Fujian, China
| | - Zhiyun Jia
- Department of Nuclear Medicine, West China Hospital of Sichuan University, Chengdu, China
- Research Unit of Psychoradiology, Chinese Academy of Medical Sciences, Chengdu, China
| |
Collapse
|
8
|
Chouinard B, Pesquita A, Enns JT, Chapman CS. Processing of visual social-communication cues during a social-perception of action task in autistic and non-autistic observers. Neuropsychologia 2024; 198:108880. [PMID: 38555063 DOI: 10.1016/j.neuropsychologia.2024.108880] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2023] [Revised: 03/14/2024] [Accepted: 03/26/2024] [Indexed: 04/02/2024]
Abstract
Social perception and communication differ between those with and without autism, even when verbal fluency and intellectual ability are equated. Previous work found that observers responded more quickly to an actor's points if the actor had chosen by themselves where to point instead of being directed where to point. Notably, this 'choice-advantage' effect decreased across non-autistic participants as the number of autistic-like traits and tendencies increased (Pesquita et al., 2016). Here, we build on that work using the same task to study individuals over a broader range of the spectrum, from autistic to non-autistic, measuring both response initiation and mouse movement times, and considering the response to each actor separately. Autistic and non-autistic observers viewed videos of three different actors pointing to one of two locations, without knowing that the actors were sometimes freely choosing to point to one target and other times being directed where to point. All observers exhibited a choice-advantage overall, meaning they responded more rapidly when actors were freely choosing versus when they were directed, indicating a sensitivity to the actors' postural cues and movements. Our fine-grained analyses found a more robust choice-advantage to some actors than others, with autistic observers showing a choice-advantage only in response to one of the actors, suggesting that both actor and observer characteristics influence the overall effect. We briefly explore existing actor characteristics that may have contributed to this effect, finding that both duration of exposure to pre-movement cues and kinematic cues of the actors likely influence the choice advantage to different degrees across the groups. Altogether, the evidence suggested that both autistic and non-autistic individuals could detect the choice-advantage signal, but that for autistic observers the choice-advantage was actor specific. Notably, we found that the influence of the signal, when present, was detected early for all actors by the non-autistic observers, but detected later and only for one actor by the autistic observers. Altogether, we have more accurately characterized the ability of social-perception in autistic individuals as intact, but highlighted that detection of signal is likely delayed/distributed compared to non-autistic observers and that it is important to investigate actor characteristics that may influence detection and use of their social-perception signals.
Collapse
Affiliation(s)
| | | | - J T Enns
- University of British Columbia, Canada
| | | |
Collapse
|
9
|
Cisek P, Green AM. Toward a neuroscience of natural behavior. Curr Opin Neurobiol 2024; 86:102859. [PMID: 38583263 DOI: 10.1016/j.conb.2024.102859] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2023] [Accepted: 03/04/2024] [Indexed: 04/09/2024]
Abstract
One of the most exciting new developments in systems neuroscience is the progress being made toward neurophysiological experiments that move beyond simplified laboratory settings and address the richness of natural behavior. This is enabled by technological advances such as wireless recording in freely moving animals, automated quantification of behavior, and new methods for analyzing large data sets. Beyond new empirical methods and data, however, there is also a need for new theories and concepts to interpret that data. Such theories need to address the particular challenges of natural behavior, which often differ significantly from the scenarios studied in traditional laboratory settings. Here, we discuss some strategies for developing such novel theories and concepts and some example hypotheses being proposed.
Collapse
Affiliation(s)
- Paul Cisek
- Department of Neuroscience, University of Montréal, Montréal, Québec, Canada.
| | - Andrea M Green
- Department of Neuroscience, University of Montréal, Montréal, Québec, Canada
| |
Collapse
|
10
|
Selbing I, Skewes J. The expression of decision and learning variables in movement patterns related to decision actions. Exp Brain Res 2024; 242:1311-1325. [PMID: 38551690 PMCID: PMC11108959 DOI: 10.1007/s00221-024-06805-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/08/2023] [Accepted: 02/09/2024] [Indexed: 05/23/2024]
Abstract
Decisions are not necessarily easy to separate into a planning and an execution phase and the decision-making process can often be reflected in the movement associated with the decision. Here, we used formalized definitions of concepts relevant in decision-making and learning to explore if and how these concepts correlate with decision-related movement paths, both during and after a choice is made. To this end, we let 120 participants (46 males, mean age = 24.5 years) undergo a repeated probabilistic two-choice task with changing probabilities where we used mouse-tracking, a simple non-invasive technique, to study the movements related to decisions. The decisions of the participants were modelled using Bayesian inference which enabled the computation of variables related to decision-making and learning. Analyses of the movement during the decision showed effects of relevant decision variables, such as confidence, on aspects related to, for instance, timing and pausing, range of movement and deviation from the shortest distance. For the movements after a decision there were some effects of relevant learning variables, mainly related to timing and speed. We believe our findings can be of interest for researchers within several fields, spanning from social learning to experimental methods and human-machine/robot interaction.
Collapse
Affiliation(s)
- Ida Selbing
- Division of Psychology, Karolinska Institutet, Nobels väg 9, Solna, Stockholm, Sweden.
- Interacting Minds Centre, Aarhus University, Aarhus, Denmark.
| | - Joshua Skewes
- Department for Linguistics, Cognitive Science, and Semiotics, Aarhus University, Aarhus, Denmark
- Interacting Minds Centre, Aarhus University, Aarhus, Denmark
| |
Collapse
|
11
|
Allen KR, Smith KA, Bird LA, Tenenbaum JB, Makin TR, Cowie D. Lifelong learning of cognitive styles for physical problem-solving: The effect of embodied experience. Psychon Bull Rev 2024; 31:1364-1375. [PMID: 38049575 PMCID: PMC11192818 DOI: 10.3758/s13423-023-02400-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 10/03/2023] [Indexed: 12/06/2023]
Abstract
'Embodied cognition' suggests that our bodily experiences broadly shape our cognitive capabilities. We study how embodied experience affects the abstract physical problem-solving styles people use in a virtual task where embodiment does not affect action capabilities. We compare how groups with different embodied experience - 25 children and 35 adults with congenital limb differences versus 45 children and 40 adults born with two hands - perform this task, and find that while there is no difference in overall competence, the groups use different cognitive styles to find solutions. People born with limb differences think more before acting but take fewer attempts to reach solutions. Conversely, development affects the particular actions children use, as well as their persistence with their current strategy. Our findings suggest that while development alters action choices and persistence, differences in embodied experience drive changes in the acquisition of cognitive styles for balancing acting with thinking.
Collapse
Affiliation(s)
- Kelsey R Allen
- Department of Brain and Cognitive Sciences, MIT and Center for Brains, Minds, and Machines, Cambridge, MA, USA.
| | - Kevin A Smith
- Department of Brain and Cognitive Sciences, MIT and Center for Brains, Minds, and Machines, Cambridge, MA, USA
| | | | - Joshua B Tenenbaum
- Department of Brain and Cognitive Sciences, MIT and Center for Brains, Minds, and Machines, Cambridge, MA, USA
| | - Tamar R Makin
- MRC Cognition Brain Sciences Unit, University of Cambridge, Cambridge, UK
- Institute of Cognitive Neuroscience, University College London, London, UK
| | - Dorothy Cowie
- Department of Psychology, Durham University, Durham, UK
| |
Collapse
|
12
|
van Ede F, Nobre AC. A Neural Decision Signal during Internal Sampling from Working Memory in Humans. J Neurosci 2024; 44:e1475232024. [PMID: 38538144 PMCID: PMC11079964 DOI: 10.1523/jneurosci.1475-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2023] [Revised: 01/11/2024] [Accepted: 02/16/2024] [Indexed: 05/12/2024] Open
Abstract
How humans transform sensory information into decisions that steer purposeful behavior is a central question in psychology and neuroscience that is traditionally investigated during the sampling of external environmental signals. The decision-making framework of gradual information sampling toward a decision has also been proposed to apply when sampling internal sensory evidence from working memory. However, neural evidence for this proposal remains scarce. Here we show (using scalp EEG in male and female human volunteers) that sampling internal visual representations from working memory elicits a scalp EEG potential associated with gradual evidence accumulation-the central parietal positivity. Consistent with an evolving decision process, we show how this signal (1) scales with the time participants require to reach a decision about the cued memory content and (2) is amplified when having to decide among multiple contents in working memory. These results bring the electrophysiology of decision-making into the domain of working memory and suggest that variability in memory-guided behavior may be driven (at least in part) by variations in the sampling of our inner mental contents.
Collapse
Affiliation(s)
- Freek van Ede
- Institute for Brain and Behavior Amsterdam, Department of Experimental and Applied Psychology, Vrije Universiteit Amsterdam, 1081 BT, Amsterdam, The Netherlands
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
| | - Anna C Nobre
- Oxford Centre for Human Brain Activity, Wellcome Centre for Integrative Neuroimaging, Department of Psychiatry, University of Oxford, Oxford OX3 7JX, United Kingdom
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, United Kingdom
- Wu Tsai Institute and Department of Psychology, Yale University, New Haven, Connecticut 06510
| |
Collapse
|
13
|
Krüger M, Puri R, Summers JJ, Hinder MR. Influence of age and cognitive demand on motor decision making under uncertainty: a study on goal directed reaching movements. Sci Rep 2024; 14:9119. [PMID: 38643224 PMCID: PMC11032380 DOI: 10.1038/s41598-024-59415-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/19/2023] [Accepted: 04/10/2024] [Indexed: 04/22/2024] Open
Abstract
In everyday life, we constantly make decisions about actions to be performed subsequently. Research on motor decision making has provided empirical evidence for an influence of decision uncertainty on movement execution in young adults. Further, decision uncertainty was suggested to be increased in older adults due to limited cognitive resources for the integration of information and the prediction of the decision outcomes. However, the influence of cognitive aging on decision uncertainty during motor decision making and movement execution has not been investigated, yet. Thus, in the current study, we presented young and older adults with a motor decision making task, in which participants had to decide on pointing towards one out of five potential targets under varying cognitive demands. Statistical analyses revealed stronger decreases in correctly deciding upon the pointing target, i.e. task performance, from low to higher cognitive demand in older as compared to young adults. Decision confidence also decreased more strongly in older adults with increasing cognitive demand, however, only when collapsing across correct and incorrect decision trials, but not when considering correct decision trials, only. Further, older adults executed reaching movements with longer reaction times and increased path length, though the latter, again, not when considering correct decision trials, only. Last, reaction time and variability in movement execution were both affected by cognitive demand. The outcomes of this study provide a differentiated picture of the distinct and joint effects of aging and cognitive demand during motor decision making.
Collapse
Affiliation(s)
- Melanie Krüger
- Institute of Sports Science, Faculty of Humanities, Leibniz University Hannover, Am Moritzwinkel 6, 30167, Hannover, Germany.
| | - Rohan Puri
- Sensorimotor Neuroscience and Ageing Research Laboratory, School of Psychological Sciences, College of Health and Medicine, University of Tasmania, Hobart, Australia
| | - Jeffery J Summers
- Sensorimotor Neuroscience and Ageing Research Laboratory, School of Psychological Sciences, College of Health and Medicine, University of Tasmania, Hobart, Australia
| | - Mark R Hinder
- Sensorimotor Neuroscience and Ageing Research Laboratory, School of Psychological Sciences, College of Health and Medicine, University of Tasmania, Hobart, Australia
| |
Collapse
|
14
|
Phillips JG, Van Gemmert AWA, Hughes B. Incompatibility Influences Cursor Placement When Pointing to Images of Cups. HUMAN FACTORS 2024; 66:1004-1016. [PMID: 35971754 DOI: 10.1177/00187208221121203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/15/2023]
Abstract
OBJECTIVE As images are used within graphical user interfaces to signify menu selection, it is important to understand how image properties can influence cursor placement online. BACKGROUND Objects have multiple dimensions that create potential ambiguity and Stroop-like confusions for the operator if a previously habitual response conflicts with the required response. METHODS To examine the impact of compatibility and other contextual factors, 41 participants used a computer Mouse or touch screen to place the cursor upon images of full or empty cups that varied in size, and direction of handle. RESULTS Cursor placements took longer using the Mouse than touch screen. Although participants were placing the cursor on images, the size of the cup, whether it was empty or full, and the handle orientation interacted in their effects upon response duration and cursor placement. The effects of cup size reversed for empty cups or those with incompatible handles. CONCLUSION Context can influence cursor placement. Perceived spillability influenced precision requirements, and the cup handle can serve as target or a flanking distractor. APPLICATION Image content can influence screen hotspots. As performance can change with cup spillability, this bodes well for attempts to detect intent from cursor trajectories.
Collapse
|
15
|
Kayser C, Heuer H. Multisensory perception depends on the reliability of the type of judgment. J Neurophysiol 2024; 131:723-737. [PMID: 38416720 DOI: 10.1152/jn.00451.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2023] [Revised: 02/05/2024] [Accepted: 02/24/2024] [Indexed: 03/01/2024] Open
Abstract
The brain engages the processes of multisensory integration and recalibration to deal with discrepant multisensory signals. These processes consider the reliability of each sensory input, with the more reliable modality receiving the stronger weight. Sensory reliability is typically assessed via the variability of participants' judgments, yet these can be shaped by factors both external and internal to the nervous system. For example, motor noise and participant's dexterity with the specific response method contribute to judgment variability, and different response methods applied to the same stimuli can result in different estimates of sensory reliabilities. Here we ask how such variations in reliability induced by variations in the response method affect multisensory integration and sensory recalibration, as well as motor adaptation, in a visuomotor paradigm. Participants performed center-out hand movements and were asked to judge the position of the hand or rotated visual feedback at the movement end points. We manipulated the variability, and thus the reliability, of repeated judgments by asking participants to respond using either a visual or a proprioceptive matching procedure. We find that the relative weights of visual and proprioceptive signals, and thus the asymmetry of multisensory integration and recalibration, depend on the reliability modulated by the judgment method. Motor adaptation, in contrast, was insensitive to this manipulation. Hence, the outcome of multisensory binding is shaped by the noise introduced by sensorimotor processing, in line with perception and action being intertwined.NEW & NOTEWORTHY Our brain tends to combine multisensory signals based on their respective reliability. This reliability depends on sensory noise in the environment, noise in the nervous system, and, as we show here, variability induced by the specific judgment procedure.
Collapse
Affiliation(s)
- Christoph Kayser
- Department of Cognitive Neuroscience, Universität Bielefeld, Bielefeld, Germany
| | - Herbert Heuer
- Department of Cognitive Neuroscience, Universität Bielefeld, Bielefeld, Germany
- Leibniz Research Centre for Working Environment and Human Factors, Dortmund, Germany
| |
Collapse
|
16
|
Wang XM, Welsh TN. TAT-HUM: Trajectory analysis toolkit for human movements in Python. Behav Res Methods 2024; 56:4103-4129. [PMID: 38504077 DOI: 10.3758/s13428-024-02378-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 02/21/2024] [Indexed: 03/21/2024]
Abstract
Human movement trajectories can reveal useful insights regarding the underlying mechanisms of human behaviors. Extracting information from movement trajectories, however, can be challenging because of their complex and dynamic nature. The current paper presents a Python toolkit developed to help users analyze and extract meaningful information from the trajectories of discrete rapid aiming movements executed by humans. This toolkit uses various open-source Python libraries, such as NumPy and SciPy, and offers a collection of common functionalities to analyze movement trajectory data. To ensure flexibility and ease of use, the toolkit offers two approaches: an automated approach that processes raw data and generates relevant measures automatically, and a manual approach that allows users to selectively use different functions based on their specific needs. A behavioral experiment based on the spatial cueing paradigm was conducted to illustrate how one can use this toolkit in practice. Readers are encouraged to access the publicly available data and relevant analysis scripts as an opportunity to learn about kinematic analysis for human movements.
Collapse
Affiliation(s)
- Xiaoye Michael Wang
- Centre for Motor Control, Faculty of Kinesiology & Physical Education, University of Toronto, Toronto, Ontario, Canada.
| | - Timothy N Welsh
- Centre for Motor Control, Faculty of Kinesiology & Physical Education, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
17
|
Gokeler A, Tosarelli F, Buckthorpe M, Della Villa F. Neurocognitive Errors and Noncontact Anterior Cruciate Ligament Injuries in Professional Male Soccer Players. J Athl Train 2024; 59:262-269. [PMID: 37248515 PMCID: PMC10976343 DOI: 10.4085/1062-6050-0209.22] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
CONTEXT Evidence is emerging that core neurocognitive functions such as working memory and inhibitory control (ie, motor-response and attentional inhibition) are linked to the anterior cruciate ligament (ACL) injury risk. Research has been conducted in laboratory settings, but the contribution of neurocognition to actual ACL injuries under real-world conditions is unknown. OBJECTIVE To describe the possible neurocognitive errors involved in noncontact ACL injury mechanisms. DESIGN Case series. SETTING Soccer matches. PATIENTS OR OTHER PARTICIPANTS A total of 47 professional male soccer players. MAIN OUTCOME MEASURE(S) Three independent reviewers evaluated 47 videos of players sustaining noncontact ACL injuries. Neurocognitive errors in inhibitory control were operationalized as follows: (1) motor-response inhibition was scored when a player demonstrated poor decision-making and approached the opponent with high speed that reduced the ability to stop or change the intended action and (2) an attentional error was scored when a player shifted his selective attention away from the relevant task to irrelevant stimuli. RESULTS Of 47 noncontact ACL injuries, 26 (55%) were related to a pressing-type injury, 19 (73%) of which involved a deceiving action made by the opponent, suggesting poor inhibitory control of the defender. Of the remaining 21 noncontact ACL injuries (45%), 16 (76%) could be attributed to attentional errors. Agreement among the 3 raters was very good for all items except poor decision-making, which showed fair to good agreement (Fleiss κ = 0.71). Interrater reliability was excellent (intraclass correlation coefficient = 0.99-1.00). CONCLUSIONS Errors in motor-response inhibitory control and attentional inhibition were common during noncontact ACL injury events in professional male soccer players. The interrater agreement in detecting neurocognitive errors in general was very good.
Collapse
Affiliation(s)
- Alli Gokeler
- Exercise Science and Neuroscience Unit, Department of Exercise & Health, Faculty of Science, Paderborn University, Germany
| | - Filippo Tosarelli
- Education & Research Department, Isokinetic Medical Group, FIFA Medical Centre of Excellence, Bologna, Italy
| | - Matthew Buckthorpe
- Education & Research Department, Isokinetic Medical Group, FIFA Medical Centre of Excellence, Bologna, Italy
- Faculty of Sport, Allied Health and Performance Science, St Mary’s University, Twickenham, London, United Kingdom
| | - Francesco Della Villa
- Education & Research Department, Isokinetic Medical Group, FIFA Medical Centre of Excellence, Bologna, Italy
| |
Collapse
|
18
|
Potamianou H, Bryce D. How flexible is cognitive control? (Mouse) tracking conflict adaptation across context similarities. PSYCHOLOGICAL RESEARCH 2024; 88:562-579. [PMID: 37770556 PMCID: PMC10858099 DOI: 10.1007/s00426-023-01874-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/28/2023] [Accepted: 09/01/2023] [Indexed: 09/30/2023]
Abstract
Exerting cognitive control to remain on-task and reach our goals is a crucial skill, as is the ability to flexibly adapt our responding in rapidly changing environments. The dynamics of cognitive control are typically studied by examining how participants process stimuli that contain competing relevant and irrelevant information in so-called conflict tasks. Adjustments in performance following the experience of conflict, also termed conflict adaptation, suggests a certain degree of flexibility in the deployment of cognitive control. The present study investigated to what extent conflict adaptation effects transfer across trials of the same and different tasks in three online mouse-tracking experiments. Adaptations of the Simon and Stroop tasks were combined to create different levels of context similarity between the paired tasks. Based on a previous review (Braem et al., Frontiers in Psychology 5:1-13, 2014), across-task conflict adaptation was expected only in the most and least similar contexts. In contrast to our hypothesis, conflict adaptation effects were observed in at least one measure in all three experiments. To our surprise, task order also seemed to impact the size of across-task conflict adaptation effects. The heterogeneity in the current results highlight the importance of using sensitive measurement tools to evaluate conflict adaptation and suggest that the occurrence of across-task conflict adaptation may be conditional on more than just shared relevant and irrelevant dimensions.
Collapse
Affiliation(s)
- Hera Potamianou
- Department of Psychology, Eberhard Karls University of Tübingen, Schleichstrasse 4, 72076, Tübingen, Germany.
| | - Donna Bryce
- Department of Psychology, Eberhard Karls University of Tübingen, Schleichstrasse 4, 72076, Tübingen, Germany
- Department of Psychology, University of Augsburg, Augsburg, Germany
| |
Collapse
|
19
|
Dai W, Tang N, Zhu Y, Wang J, Hu W, Fei F, Chai X, Tian H, Lu W. Sandwich-Type Self-Healing Sensor with Multilevel for Motion Detection. ACS APPLIED MATERIALS & INTERFACES 2024; 16:7927-7938. [PMID: 38289238 DOI: 10.1021/acsami.3c18633] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/16/2024]
Abstract
Real-time detection of various parts of the human body is crucial in medical monitoring and human-machine technology. However, existing self-healing flexible sensing materials are limited in real-life applications due to the weak stability of conductive networks and difficulty in balancing stretchability and self-healing properties. Therefore, the development of wearable flexible sensors with high sensitivity and fast response with self-healing properties is of great interest. In this paper, a novel multilevel self-healing polydimethylsiloxane (PDMS) material is proposed for enhanced sensing capabilities. The PDMS was designed to have multiple bonding mechanisms including hydrogen bonding, coordination bonding, disulfide bonding, and local covalent bonding. To further enhance its sensing properties, modified carbon nanotubes (CNTs) were embedded within the PDMS matrix using a solvent etching technique. This created a sandwich-type sensing material with improved stability and sensitivity. This self-healing flexible sensing material (self-healing efficiency = 70.1% at 80 °C and 6 h) has good mechanical properties (stretchability ≈413%, tensile strength ≈0.69 MPa), thermal conductivity, and electrical conductivity. It has ultrahigh sensitivity, which makes it possible to be manufactured as a multifunctional flexible sensor.
Collapse
Affiliation(s)
- Weisen Dai
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Nvfan Tang
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Yiyao Zhu
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Jincheng Wang
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Wanying Hu
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Fan Fei
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Xin Chai
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Hao Tian
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Wentong Lu
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| |
Collapse
|
20
|
Wang XM, Karlinsky A, Constable MD, Gregory SEA, Welsh TN. Social gaze cueing elicits facilitatory and inhibitory effects on movement execution when the model might act on an object. Q J Exp Psychol (Hove) 2024; 77:230-241. [PMID: 36999402 PMCID: PMC10798020 DOI: 10.1177/17470218231162546] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/17/2022] [Revised: 02/08/2023] [Accepted: 02/16/2023] [Indexed: 04/01/2023]
Abstract
Social cues, such as eye gaze and pointing fingers, can increase the prioritisation of specific locations for cognitive processing. A previous study using a manual reaching task showed that, although both gaze and pointing cues altered target prioritisation (reaction times [RTs]), only pointing cues affected action execution (trajectory deviations). These differential effects of gaze and pointing cues on action execution could be because the gaze cue was conveyed through a disembodied head; hence, the model lacked the potential for a body part (i.e., hands) to interact with the target. In the present study, the image of a male gaze model, whose gaze direction coincided with two potential target locations, was centrally presented. The model either had his arms and hands extended underneath the potential target locations, indicating the potential to act on the targets (Experiment 1), or had his arms crossed in front of his chest, indicating the absence of potential to act (Experiment 2). Participants reached to a target that followed a nonpredictive gaze cue at one of three stimulus onset asynchronies. RTs and reach trajectories of the movements to cued and uncued targets were analysed. RTs showed a facilitation effect for both experiments, whereas trajectory analysis revealed facilitatory and inhibitory effects, but only in Experiment 1 when the model could potentially act on the targets. The results of this study suggested that when the gaze model had the potential to interact with the cued target location, the model's gaze affected not only target prioritisation but also movement execution.
Collapse
Affiliation(s)
- Xiaoye Michael Wang
- Faculty of Kinesiology & Physical Education, Centre for Motor Control, University of Toronto, Toronto, Ontario, Canada
| | - April Karlinsky
- Department of Kinesiology, California State University, San Bernardino, San Bernardino, CA, USA
| | - Merryn D Constable
- Department of Psychology, Northumbria University, Newcastle upon Tyne, UK
| | | | - Timothy N Welsh
- Faculty of Kinesiology & Physical Education, Centre for Motor Control, University of Toronto, Toronto, Ontario, Canada
| |
Collapse
|
21
|
Molano-Mazón M, Garcia-Duran A, Pastor-Ciurana J, Hernández-Navarro L, Bektic L, Lombardo D, de la Rocha J, Hyafil A. Rapid, systematic updating of movement by accumulated decision evidence. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.11.09.566389. [PMID: 38352370 PMCID: PMC10862760 DOI: 10.1101/2023.11.09.566389] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/19/2024]
Abstract
Acting in the natural world requires not only deciding among multiple options but also converting decisions into motor commands. How the dynamics of decision formation influence the fine kinematics of response movement remains, however, poorly understood. Here we investigate how the accumulation of decision evidence shapes the response orienting trajectories in a task where freely-moving rats combine prior expectations and auditory information to select between two possible options. Response trajectories and their motor vigor are initially determined by the prior. Rats movements then incorporate sensory information as early as 60 ms after stimulus onset by accelerating or slowing depending on how much the stimulus supports their initial choice. When the stimulus evidence is in strong contradiction, rats change their mind and reverse their initial trajectory. Human subjects performing an equivalent task display a remarkably similar behavior. We encapsulate these results in a computational model that, by mapping the decision variable onto the movement kinematics at discrete time points, captures subjects' choices, trajectories and changes of mind. Our results show that motor responses are not ballistic. Instead, they are systematically and rapidly updated, as they smoothly unfold over time, by the parallel dynamics of the underlying decision process.
Collapse
Affiliation(s)
- Manuel Molano-Mazón
- IDIBAPS, Rosselló 149, Barcelona, 08036, Spain
- Centre de Recerca Matemàtica (CRM), Bellaterra, Spain
- These authors contributed equally
| | | | | | | | | | | | - Jaime de la Rocha
- IDIBAPS, Rosselló 149, Barcelona, 08036, Spain
- These authors contributed equally
| | - Alexandre Hyafil
- Centre de Recerca Matemàtica (CRM), Bellaterra, Spain
- These authors contributed equally
| |
Collapse
|
22
|
Weidler T, Goebel R, Senden M. AngoraPy: A Python toolkit for modeling anthropomorphic goal-driven sensorimotor systems. Front Neuroinform 2023; 17:1223687. [PMID: 38204578 PMCID: PMC10777840 DOI: 10.3389/fninf.2023.1223687] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/16/2023] [Accepted: 11/27/2023] [Indexed: 01/12/2024] Open
Abstract
Goal-driven deep learning increasingly supplements classical modeling approaches in computational neuroscience. The strength of deep neural networks as models of the brain lies in their ability to autonomously learn the connectivity required to solve complex and ecologically valid tasks, obviating the need for hand-engineered or hypothesis-driven connectivity patterns. Consequently, goal-driven models can generate hypotheses about the neurocomputations underlying cortical processing that are grounded in macro- and mesoscopic anatomical properties of the network's biological counterpart. Whereas, goal-driven modeling is already becoming prevalent in the neuroscience of perception, its application to the sensorimotor domain is currently hampered by the complexity of the methods required to train models comprising the closed sensation-action loop. This paper describes AngoraPy, a Python library that mitigates this obstacle by providing researchers with the tools necessary to train complex recurrent convolutional neural networks that model the human sensorimotor system. To make the technical details of this toolkit more approachable, an illustrative example that trains a recurrent toy model on in-hand object manipulation accompanies the theoretical remarks. An extensive benchmark on various classical, 3D robotic, and anthropomorphic control tasks demonstrates AngoraPy's general applicability to a wide range of tasks. Together with its ability to adaptively handle custom architectures, the flexibility of this toolkit demonstrates its power for goal-driven sensorimotor modeling.
Collapse
Affiliation(s)
- Tonio Weidler
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
- Maastricht Brain Imaging Centre, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
| | - Rainer Goebel
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
- Maastricht Brain Imaging Centre, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
| | - Mario Senden
- Department of Cognitive Neuroscience, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
- Maastricht Brain Imaging Centre, Faculty of Psychology and Neuroscience, Maastricht University, Maastricht, Netherlands
| |
Collapse
|
23
|
McGarity-Shipley MR, Markovik Jantz S, Johansson RS, Wolpert DM, Flanagan JR. Fast Feedback Responses to Categorical Sensorimotor Errors That Do Not Indicate Error Magnitude Are Optimized Based on Short- and Long-Term Memory. J Neurosci 2023; 43:8525-8535. [PMID: 37884350 PMCID: PMC10711696 DOI: 10.1523/jneurosci.1990-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/06/2022] [Revised: 09/25/2023] [Accepted: 10/03/2023] [Indexed: 10/28/2023] Open
Abstract
Skilled motor performance depends critically on rapid corrective responses that act to preserve the goal of the movement in the face of perturbations. Although it is well established that the gain of corrective responses elicited while reaching toward objects adapts to different contexts, little is known about the adaptability of corrective responses supporting the manipulation of objects after they are grasped. Here, we investigated the adaptability of the corrective response elicited when an object being lifted is heavier than expected and fails to lift off when predicted. This response involves a monotonic increase in vertical load force triggered, within ∼90 ms, by the absence of expected sensory feedback signaling lift off and terminated when actual lift off occurs. Critically, because the actual weight of the object cannot be directly sensed at the moment the object fails to lift off, any adaptation of the corrective response would have to be based on memory from previous lifts. We show that when humans, including men and women, repeatedly lift an object that on occasional catch trials increases from a baseline weight to a fixed heavier weight, they scale the gain of the response (i.e., the rate of force increase) to the heavier weight within two to three catch trials. We also show that the gain of the response scales, on the first catch trial, with the baseline weight of the object. Thus, the gain of the lifting response can be adapted by both short- and long-term experience. Finally, we demonstrate that this adaptation preserves the efficacy of the response across contexts.SIGNIFICANCE STATEMENT Here, we present the first investigation of the adaptability of the corrective lifting response elicited when an object is heavier than expected and fails to lift off when predicted. A striking feature of the response, which is driven by a sensory prediction error arising from the absence of expected sensory feedback, is that the magnitude of the error is unknown. That is, the motor system only receives a categorical error indicating that the object is heavier than expected but not its actual weight. Although the error magnitude is not known at the moment the response is elicited, we show that the response can be scaled to predictions of error magnitude based on both recent and long-term memories.
Collapse
Affiliation(s)
| | - Simona Markovik Jantz
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario K7L 3N6, Canada
| | - Roland S Johansson
- Physiology Section, Department of Integrative Medical Biology, Umeå University, SE-901 87 Umeå, Sweden
| | - Daniel M Wolpert
- Department of Neuroscience, Columbia University, New York, New York, 10027
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, New York 10027
| | - J Randall Flanagan
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario K7L 3N6, Canada
- Department of Psychology, Queen's University, Kingston, Ontario K7L 3N6, Canada
| |
Collapse
|
24
|
Manzone JX, Welsh TN. Explicit effort may not influence perceptuomotor decision-making. Exp Brain Res 2023; 241:2715-2733. [PMID: 37831096 DOI: 10.1007/s00221-023-06710-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2023] [Accepted: 09/15/2023] [Indexed: 10/14/2023]
Abstract
Many decisions that humans make are enacted by the action system. For example, humans use reach-to-grasp movements when making perceptuomotor decisions between and obtaining fruits of varying quality from a pile. Recent work suggests that the characteristics of each action alternative may influence the decision itself-there may be a bias away from making perceptuomotor alternatives associated with high effort when participants are unaware of the effort differences between responses. The present study examined if perceptuomotor decisions were influenced by explicit reaching effort differences. Neurotypical human participants were presented with random dot motion stimuli in which most dots moved in random directions and varying percentages of remaining dots moved coherently left- or rightward. Participants reported leftward motion judgements by performing leftward (or left hand) reaching movements and rightward motion judgements by performing rightward (or right hand) reaching movements. A resistance band was affixed to participants' wrists and to the table in different configurations. The configurations allowed for one movement/motion direction judgement to always require stretching of the band and, therefore, require relatively more effort. Across a set of experiments, the response context (i.e. selecting directions within a limb or selecting between limbs) and the effort difference between responses were manipulated. Overall, no experiment revealed a bias away from the perceptuomotor decision associated with high effort. Based on these results, it is concluded that, in this biomechanical context, explicit effort may not influence perceptuomotor decision-making and may point to a contextual influence of action effort on perceptuomotor decision-making.
Collapse
Affiliation(s)
- Joseph X Manzone
- Faculty of Kinesiology and Physical Education, Centre for Motor Control, University of Toronto, 55 Harbord Street, Toronto, ON, M5S 2W6, Canada.
| | - Timothy N Welsh
- Faculty of Kinesiology and Physical Education, Centre for Motor Control, University of Toronto, 55 Harbord Street, Toronto, ON, M5S 2W6, Canada
| |
Collapse
|
25
|
Tao L, Wechsler SP, Bhandawat V. Sensorimotor transformation underlying odor-modulated locomotion in walking Drosophila. Nat Commun 2023; 14:6818. [PMID: 37884581 PMCID: PMC10603174 DOI: 10.1038/s41467-023-42613-8] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Accepted: 10/17/2023] [Indexed: 10/28/2023] Open
Abstract
Most real-world behaviors - such as odor-guided locomotion - are performed with incomplete information. Activity in olfactory receptor neuron (ORN) classes provides information about odor identity but not the location of its source. In this study, we investigate the sensorimotor transformation that relates ORN activation to locomotion changes in Drosophila by optogenetically activating different combinations of ORN classes and measuring the resulting changes in locomotion. Three features describe this sensorimotor transformation: First, locomotion depends on both the instantaneous firing frequency (f) and its change (df); the two together serve as a short-term memory that allows the fly to adapt its motor program to sensory context automatically. Second, the mapping between (f, df) and locomotor parameters such as speed or curvature is distinct for each pattern of activated ORNs. Finally, the sensorimotor mapping changes with time after odor exposure, allowing information integration over a longer timescale.
Collapse
Affiliation(s)
- Liangyu Tao
- School of Biomedical Engineering and Health Sciences, Drexel University, Philadelphia, PA, USA
| | - Samuel P Wechsler
- School of Biomedical Engineering and Health Sciences, Drexel University, Philadelphia, PA, USA
- Department of Neurobiology and Anatomy, Drexel University, Philadelphia, PA, USA
| | - Vikas Bhandawat
- School of Biomedical Engineering and Health Sciences, Drexel University, Philadelphia, PA, USA.
| |
Collapse
|
26
|
Goldenkoff ER, Deluisi JA, Destiny DP, Lee TG, Michon KJ, Brissenden JA, Taylor SF, Polk TA, Vesia M. The behavioral and neural effects of parietal theta burst stimulation on the grasp network are stronger during a grasping task than at rest. Front Neurosci 2023; 17:1198222. [PMID: 37954875 PMCID: PMC10637360 DOI: 10.3389/fnins.2023.1198222] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2023] [Accepted: 10/05/2023] [Indexed: 11/14/2023] Open
Abstract
Repetitive transcranial magnetic stimulation (TMS) is widely used in neuroscience and clinical settings to modulate human cortical activity. The effects of TMS on neural activity depend on the excitability of specific neural populations at the time of stimulation. Accordingly, the brain state at the time of stimulation may influence the persistent effects of repetitive TMS on distal brain activity and associated behaviors. We applied intermittent theta burst stimulation (iTBS) to a region in the posterior parietal cortex (PPC) associated with grasp control to evaluate the interaction between stimulation and brain state. Across two experiments, we demonstrate the immediate responses of motor cortex activity and motor performance to state-dependent parietal stimulation. We randomly assigned 72 healthy adult participants to one of three TMS intervention groups, followed by electrophysiological measures with TMS and behavioral measures. Participants in the first group received iTBS to PPC while performing a grasping task concurrently. Participants in the second group received iTBS to PPC while in a task-free, resting state. A third group of participants received iTBS to a parietal region outside the cortical grasping network while performing a grasping task concurrently. We compared changes in motor cortical excitability and motor performance in the three stimulation groups within an hour of each intervention. We found that parietal stimulation during a behavioral manipulation that activates the cortical grasping network increased downstream motor cortical excitability and improved motor performance relative to stimulation during rest. We conclude that constraining the brain state with a behavioral task during brain stimulation has the potential to optimize plasticity induction in cortical circuit mechanisms that mediate movement processes.
Collapse
Affiliation(s)
| | - Joseph A. Deluisi
- School of Kinesiology, University of Michigan, Ann Arbor, MI, United States
| | - Danielle P. Destiny
- Department of Psychology, University of Michigan, Ann Arbor, MI, United States
| | - Taraz G. Lee
- Department of Psychology, University of Michigan, Ann Arbor, MI, United States
| | - Katherine J. Michon
- Department of Psychology, University of Michigan, Ann Arbor, MI, United States
| | - James A. Brissenden
- Department of Psychology, University of Michigan, Ann Arbor, MI, United States
| | - Stephan F. Taylor
- Department of Psychiatry, University of Michigan, Ann Arbor, MI, United States
| | - Thad A. Polk
- Department of Psychology, University of Michigan, Ann Arbor, MI, United States
| | - Michael Vesia
- School of Kinesiology, University of Michigan, Ann Arbor, MI, United States
| |
Collapse
|
27
|
Bramson B, Toni I, Roelofs K. Emotion regulation from an action-control perspective. Neurosci Biobehav Rev 2023; 153:105397. [PMID: 37739325 DOI: 10.1016/j.neubiorev.2023.105397] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 09/10/2023] [Accepted: 09/17/2023] [Indexed: 09/24/2023]
Abstract
Despite increasing interest in emotional processes in cognitive science, theories on emotion regulation have remained rather isolated, predominantly focused on cognitive regulation strategies such as reappraisal. However, recent neurocognitive evidence suggests that early emotion regulation may involve sensorimotor control in addition to other emotion-regulation processes. We propose an action-oriented view of emotion regulation, in which feedforward predictions develop from action-selection mechanisms. Those can account for acute emotional-action control as well as more abstract instances of emotion regulation such as cognitive reappraisal. We argue the latter occurs in absence of overt motor output, yet in the presence of full-blown autonomic, visceral, and subjective changes. This provides an integrated framework with testable neuro-computational predictions and concrete starting points for intervention to improve emotion control in affective disorders.
Collapse
Affiliation(s)
- Bob Bramson
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, 6525 EN Nijmegen, the Netherlands; Behavioural Science Institute (BSI), Radboud University Nijmegen, 6525 HR Nijmegen, the Netherlands.
| | - Ivan Toni
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, 6525 EN Nijmegen, the Netherlands
| | - Karin Roelofs
- Donders Institute for Brain, Cognition and Behaviour, Centre for Cognitive Neuroimaging, Radboud University Nijmegen, 6525 EN Nijmegen, the Netherlands; Behavioural Science Institute (BSI), Radboud University Nijmegen, 6525 HR Nijmegen, the Netherlands
| |
Collapse
|
28
|
Mangin EN, Chen J, Lin J, Li N. Behavioral measurements of motor readiness in mice. Curr Biol 2023; 33:3610-3624.e4. [PMID: 37582373 PMCID: PMC10529875 DOI: 10.1016/j.cub.2023.07.029] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2023] [Revised: 05/09/2023] [Accepted: 07/18/2023] [Indexed: 08/17/2023]
Abstract
Motor planning facilitates rapid and precise execution of volitional movements. Although motor planning has been classically studied in humans and monkeys, the mouse has become an increasingly popular model system to study neural mechanisms of motor planning. It remains yet untested whether mice and primates share common behavioral features of motor planning. We combined videography and a delayed response task paradigm in an autonomous behavioral system to measure motor planning in non-body-restrained mice. Motor planning resulted in both reaction time (RT) savings and increased movement accuracy, replicating classic effects in primates. We found that motor planning was reflected in task-relevant body features. Both the specific actions prepared and the degree of motor readiness could be read out online during motor planning. The online readout further revealed behavioral evidence of simultaneous preparation for multiple actions under uncertain conditions. These results validate the mouse as a model to study motor planning, demonstrate body feature movements as a powerful real-time readout of motor readiness, and offer behavioral evidence that motor planning can be a parallel process that permits rapid selection of multiple prepared actions.
Collapse
Affiliation(s)
- Elise N Mangin
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA
| | - Jian Chen
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA
| | - Jing Lin
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA
| | - Nuo Li
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA.
| |
Collapse
|
29
|
Visser YF, Medendorp WP, Selen LPJ. Muscular reflex gains reflect changes of mind in reaching. J Neurophysiol 2023; 130:640-651. [PMID: 37584102 DOI: 10.1152/jn.00197.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/12/2023] [Revised: 07/18/2023] [Accepted: 08/10/2023] [Indexed: 08/17/2023] Open
Abstract
Decisions for action are accompanied by a continual processing of sensory information, sometimes resulting in a revision of the initial choice, called a change of mind (CoM). Although the motor system is tuned during the formation of a reach decision, it is unclear whether its preparatory state differs between CoM and non-CoM decisions. To test this, participants (n = 14) viewed a random-dot motion (RDM) stimulus of various coherence levels for a random viewing duration. At the onset of a mechanical perturbation that rapidly stretched the pectoralis muscle, they indicated the perceived motion direction by making a reaching movement to one of two targets. Using electromyography (EMG), we quantified the reflex gains of the pectoralis and posterior deltoid muscles. Results show that reflex gains scaled with both the coherence level and the viewing duration of the stimulus. We fit a drift diffusion model (DDM) to the behavioral choices. The decision variable (DV), derived from the DDM, correlated well with the measured reflex gain at the single-trial level. However, when matched on DV magnitude, reflex gains were significantly lower in CoM than non-CoM trials. We conclude that the internal state of the motor system, as measured by the spinal reflexes, reflects the continual deliberation on sensory evidence for action selection, including the postdecisional evidence that can lead to a change of mind.NEW & NOTEWORTHY Using behavioral findings, EMG, and computational modeling, we show that not only the perceptual decision outcome but also the accumulating evidence for that outcome is continuously sent to the relevant muscles. Moreover, we show that an upcoming change of mind can be detected in the motor periphery, suggesting that a correlate of the internal decision making process is being sent along.
Collapse
Affiliation(s)
- Yvonne F Visser
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands
| | - W Pieter Medendorp
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands
| | - Luc P J Selen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University Nijmegen, Nijmegen, The Netherlands
| |
Collapse
|
30
|
Matsumiya K, Furukawa S. Perceptual decisions interfere more with eye movements than with reach movements. Commun Biol 2023; 6:882. [PMID: 37648896 PMCID: PMC10468498 DOI: 10.1038/s42003-023-05249-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/17/2023] [Accepted: 08/16/2023] [Indexed: 09/01/2023] Open
Abstract
Perceptual judgements are formed through invisible cognitive processes. Reading out these judgements is essential for advancing our understanding of decision making and requires inferring covert cognitive states based on overt motor actions. Although intuition suggests that these actions must be related to the formation of decisions about where to move body parts, actions have been reported to be influenced by perceptual judgements even when the action is irrelevant to the perceptual judgement. However, despite performing multiple actions in our daily lives, how perceptual judgements influence multiple judgement-irrelevant actions is unknown. Here we show that perceptual judgements affect only saccadic eye movements when simultaneous judgement-irrelevant saccades and reaches are made, demonstrating that perceptual judgement-related signals continuously flow into the oculomotor system alone when multiple judgement-irrelevant actions are performed. This suggests that saccades are useful for making inferences about covert perceptual decisions, even when the actions are not tied to decision making.
Collapse
Affiliation(s)
| | - Shota Furukawa
- Graduate School of Information Sciences, Tohoku University, Sendai, Japan
| |
Collapse
|
31
|
Germanova K, Panidi K, Ivanov T, Novikov P, Ivanova GE, Villringer A, Nikulin VV, Nazarova M. Motor Decision-Making as a Common Denominator in Motor Pathology and a Possible Rehabilitation Target. Neurorehabil Neural Repair 2023; 37:577-586. [PMID: 37476957 DOI: 10.1177/15459683231186986] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/22/2023]
Abstract
Despite the substantial progress in motor rehabilitation, patient involvement and motivation remain major challenges. They are typically addressed with communicational and environmental strategies, as well as with improved goal-setting procedures. Here we suggest a new research direction and framework involving Neuroeconomics principles to investigate the role of Motor Decision-Making (MDM) parameters in motivational component and motor performance in rehabilitation. We argue that investigating NE principles could bring new approaches aimed at increasing active patient engagement in the rehabilitation process by introducing more movement choice, and adapting existing goal-setting procedures. We discuss possible MDM implementation strategies and illustrate possible research directions using examples of stroke and psychiatric disorders.
Collapse
Affiliation(s)
- K Germanova
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Laboratory of the neurovisceral integration and neuromodulation, National Medical Research Center for Therapy and Preventive Medicine of the Ministry of Healthcare of the Russian Federation, Moscow, Russian Federation
| | - K Panidi
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
| | - T Ivanov
- FSBI "Federal Center for Brain and Neurotechnologies" of FMBA of Russian Federation, Moscow, Russia
| | - P Novikov
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
| | - G E Ivanova
- FSBI "Federal Center for Brain and Neurotechnologies" of FMBA of Russian Federation, Moscow, Russia
| | - A Villringer
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - V V Nikulin
- Department of Neurology, Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany
| | - M Nazarova
- Centre for Cognition and Decision Making, Institute for Cognitive Neuroscience, HSE University, Russian Federation
- Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Harvard Medical School, Boston, USA
| |
Collapse
|
32
|
Malone Q, Glazebrook CM, Passmore SR. A Violation of Fitts' Law is Maintained in Ecologically Valid Settings. J Mot Behav 2023; 56:1-13. [PMID: 37394465 DOI: 10.1080/00222895.2023.2210530] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/30/2022] [Revised: 04/25/2023] [Accepted: 04/30/2023] [Indexed: 07/04/2023]
Abstract
A 'violation' of Fitts' Law, or Fitts' Equation, occurs when each potential target location is outlined before and during a reaching movement. Past studies have measured the violation in highly controlled laboratory environments, limiting the generalizability of findings. The purpose of the study was to replicate the violation of Fitts' Equation in the homes of participants using a novel portable apparatus during the COVID-19 pandemic. Movements were measured independently with an accelerometer and touch screen, which allowed for kinematic, temporal, and spatial outcomes to be measured in remote environments. The violation of Fitts' Equation was found with the touch and acceleration measurements and was thus seen in ecologically valid environments. The apparatus used may be used as a model for future field research.
Collapse
Affiliation(s)
- Quinn Malone
- Faculty of Kinesiology and Recreation Management, University of Manitoba, Winnipeg, MB, Canada
| | - Cheryl M Glazebrook
- Faculty of Kinesiology and Recreation Management, University of Manitoba, Winnipeg, MB, Canada
| | - Steven R Passmore
- Faculty of Kinesiology and Recreation Management, University of Manitoba, Winnipeg, MB, Canada
| |
Collapse
|
33
|
Scaliti E, Pullar K, Borghini G, Cavallo A, Panzeri S, Becchio C. Kinematic priming of action predictions. Curr Biol 2023:S0960-9822(23)00687-5. [PMID: 37339628 DOI: 10.1016/j.cub.2023.05.055] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2022] [Revised: 04/06/2023] [Accepted: 05/24/2023] [Indexed: 06/22/2023]
Abstract
The ability to anticipate what others will do next is crucial for navigating social, interactive environments. Here, we develop an experimental and analytical framework to measure the implicit readout of prospective intention information from movement kinematics. Using a primed action categorization task, we first demonstrate implicit access to intention information by establishing a novel form of priming, which we term kinematic priming: subtle differences in movement kinematics prime action prediction. Next, using data collected from the same participants in a forced-choice intention discrimination task 1 h later, we quantify single-trial intention readout-the amount of intention information read by individual perceivers in individual kinematic primes-and assess whether it can be used to predict the amount of kinematic priming. We demonstrate that the amount of kinematic priming, as indexed by both response times (RTs) and initial fixations to a given probe, is directly proportional to the amount of intention information read by the individual perceiver at the single-trial level. These results demonstrate that human perceivers have rapid, implicit access to intention information encoded in movement kinematics and highlight the potential of our approach to reveal the computations that permit the readout of this information with single-subject, single-trial resolution.
Collapse
Affiliation(s)
- Eugenio Scaliti
- Center for Human Technologies, Fondazione Istituto Italiano di Tecnologia, Via Enrico Melen, 83, 16152 Genova, Italy; Department of Neurology, University Medical Center Hamburg-Eppendorf (UKE), Martinistrasse 52, 20246 Hamburg, Germany
| | - Kiri Pullar
- Center for Human Technologies, Fondazione Istituto Italiano di Tecnologia, Via Enrico Melen, 83, 16152 Genova, Italy
| | - Giulia Borghini
- Center for Human Technologies, Fondazione Istituto Italiano di Tecnologia, Via Enrico Melen, 83, 16152 Genova, Italy
| | - Andrea Cavallo
- Center for Human Technologies, Fondazione Istituto Italiano di Tecnologia, Via Enrico Melen, 83, 16152 Genova, Italy; Department of Psychology, Università degli Studi di Torino, Via Giuseppe Verdi, 10, 10124 Torino, Italy
| | - Stefano Panzeri
- Center for Human Technologies, Fondazione Istituto Italiano di Tecnologia, Via Enrico Melen, 83, 16152 Genova, Italy; Department of Excellence for Neural Information Processing, Center for Molecular Neurobiology (ZMNH), University Medical Center Hamburg-Eppendorf (UKE), Falkenried 94, 20251 Hamburg, Germany.
| | - Cristina Becchio
- Center for Human Technologies, Fondazione Istituto Italiano di Tecnologia, Via Enrico Melen, 83, 16152 Genova, Italy; Department of Neurology, University Medical Center Hamburg-Eppendorf (UKE), Martinistrasse 52, 20246 Hamburg, Germany.
| |
Collapse
|
34
|
Dai W, Wang J, Xiang K, Hu W, Sun J, Zhang H, Wang L. Highly Stretchable, Ultra-Sensitive, and Self-Healable Multifunctional Flexible Conductive Hydrogel Sensor for Motion Detection and Information Transmission. ACS APPLIED MATERIALS & INTERFACES 2023. [PMID: 37302071 DOI: 10.1021/acsami.3c06222] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/13/2023]
Abstract
Self-healable flexible sensing materials are extensively investigated for their potential use in human motion detection, healthcare monitoring, and other fields. However, the existing self-healable flexible sensing materials have limited their application in real life due to the weak stability of the conductive network and the difficulty in balancing stretchability and self-healing performances. In this paper, a flexible sensor with skin-like properties was prepared by composing a polymer composite hydrogel with a multiple network structure consisting of polyaniline, polyvinyl alcohol, chitosan, and phytic acid. The composite hydrogel was tested and proved to own high mechanical properties (stretchability ≈ 565%, strength ≈ 1.4 MPa), good electrical conductivity (0.214 S cm-1), excellent self-healing properties (>99% healing efficiency in a 4 h healing period), and antibacterial properties. It had high sensitivity and a wide sensing range for strain and pressure, making it possible to manufacture multifunctional flexible sensors with comprehensive performance exceeding that of most flexible sensing materials. Notably, this polymer composite hydrogel can be manufactured in a large area and at a low cost, which is beneficial for its further application in many fields.
Collapse
Affiliation(s)
- Weisen Dai
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Jincheng Wang
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Kailing Xiang
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Wanying Hu
- College of Chemistry and Chemical Engineering, Shanghai University of Engineering Science, 333 Longteng Street, Shanghai 201620, China
| | - Jibo Sun
- Wopu New Material Technology (Shanghai) Co., Ltd., Shanghai 201620, P. R. China
| | - Hua Zhang
- Qidong Xirui New Material Technology Co., Ltd., Jiangsu 226200, P. R. China
| | - Liming Wang
- Zhejiang Tianshu Seal Co., Ltd., Zhejiang 314105, P. R. China
| |
Collapse
|
35
|
Wang ZA, Chen S, Liu Y, Liu D, Svoboda K, Li N, Druckmann S. Not everything, not everywhere, not all at once: a study of brain-wide encoding of movement. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.06.08.544257. [PMID: 37333216 PMCID: PMC10274914 DOI: 10.1101/2023.06.08.544257] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/20/2023]
Abstract
Activity related to movement is found throughout sensory and motor regions of the brain. However, it remains unclear how movement-related activity is distributed across the brain and whether systematic differences exist between brain areas. Here, we analyzed movement related activity in brain-wide recordings containing more than 50,000 neurons in mice performing a decision-making task. Using multiple techniques, from markers to deep neural networks, we find that movement-related signals were pervasive across the brain, but systematically differed across areas. Movement-related activity was stronger in areas closer to the motor or sensory periphery. Delineating activity in terms of sensory- and motor-related components revealed finer scale structures of their encodings within brain areas. We further identified activity modulation that correlates with decision-making and uninstructed movement. Our work charts out a largescale map of movement encoding and provides a roadmap for dissecting different forms of movement and decision-making related encoding across multi-regional neural circuits.
Collapse
|
36
|
Seminara L, Dosen S, Mastrogiovanni F, Bianchi M, Watt S, Beckerle P, Nanayakkara T, Drewing K, Moscatelli A, Klatzky RL, Loeb GE. A hierarchical sensorimotor control framework for human-in-the-loop robotic hands. Sci Robot 2023; 8:eadd5434. [PMID: 37196072 DOI: 10.1126/scirobotics.add5434] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/19/2023]
Abstract
Human manual dexterity relies critically on touch. Robotic and prosthetic hands are much less dexterous and make little use of the many tactile sensors available. We propose a framework modeled on the hierarchical sensorimotor controllers of the nervous system to link sensing to action in human-in-the-loop, haptically enabled, artificial hands.
Collapse
Affiliation(s)
- Lucia Seminara
- Department of Electrical, Electronic, and Telecommunication Engineering and Naval Architecture, University of Genoa, Genoa, Italy
| | - Strahinja Dosen
- Department of Health Science and Technology, Aalborg University, Aalborg, Denmark
| | - Fulvio Mastrogiovanni
- Department of Informatics, Bioengineering, Robotics, and Systems Engineering, University of Genoa, Genoa, Italy
| | - Matteo Bianchi
- Research Center "E. Piaggio" and Department of Information Engineering, University of Pisa, Pisa, Italy
| | - Simon Watt
- School of Human and Behavioural Sciences, Bangor University, Bangor, UK
| | - Philipp Beckerle
- Department of Electrical Engineering, Friedrich-Alexander Universität Erlangen-Nürnberg, Nürnberg, Germany
- Department of Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander Universität Erlangen-Nürnberg, Nürnberg, Germany
| | | | - Knut Drewing
- Department of Experimental Psychology, HapLab, University of Giessen, Giessen, Germany
| | - Alessandro Moscatelli
- Laboratory of Neuromotor Physiology, Fondazione Santa Lucia IRCCS, Rome, Italy
- Department of Systems Medicine and Centre of Space Biomedicine, University of Rome Tor Vergata, Rome, Italy
| | - Roberta L Klatzky
- Department of Psychology and Human-Computer Interaction Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Gerald E Loeb
- Alfred E. Mann Department of Biomedical Engineering, Keck School of Medicine, and Viterbi School of Engineering, University of Southern California, Los Angeles, CA, USA
| |
Collapse
|
37
|
Camponogara I. The integration of action-oriented multisensory information from target and limb within the movement planning and execution. Neurosci Biobehav Rev 2023; 151:105228. [PMID: 37201591 DOI: 10.1016/j.neubiorev.2023.105228] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2023] [Revised: 04/14/2023] [Accepted: 05/07/2023] [Indexed: 05/20/2023]
Abstract
The planning and execution of a grasping or reaching movement toward targets we sense with the other hand requires integrating multiple sources of sensory information about the limb performing the movement and the target of the action. In the last two decades, several sensory and motor control theories have thoroughly described how this multisensory-motor integration process occurs. However, even though these theories were very influential in their respective field, they lack a clear, unified vision of how target-related and movement-related multisensory information integrates within the action planning and execution phases. This brief review aims to summarize the most influential theories in multisensory integration and sensory-motor control by underscoring their critical points and hidden connections, providing new ideas on the multisensory-motor integration process. Throughout the review, I wll propose an alternative view of how the multisensory integration process unfolds along the action planning and execution and I will make several connections with the existent multisensory-motor control theories.
Collapse
Affiliation(s)
- Ivan Camponogara
- Division of Science, New York University Abu Dhabi, Abu Dhabi, United Arab Emirates.
| |
Collapse
|
38
|
Tamilselvam YK, Jog M, Patel RV. Robot-assisted investigation of sensorimotor control in Parkinson's disease. Sci Rep 2023; 13:4751. [PMID: 36959273 PMCID: PMC10036530 DOI: 10.1038/s41598-023-31299-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/25/2022] [Accepted: 03/09/2023] [Indexed: 03/25/2023] Open
Abstract
Sensorimotor control (SMC) is a complex function that involves sensory, cognitive, and motor systems working together to plan, update and execute voluntary movements. Any abnormality in these systems could lead to deficits in SMC, which would negatively impact an individual's ability to execute goal-directed motions. Recent studies have shown that patients diagnosed with Parkinson's disease (PD) have dysfunctions in sensory, motor, and cognitive systems, which could give rise to SMC deficits. However, SMC deficits in PD and how they affect a patient's upper-limb movements have not been well understood. The objective of the study was to investigate SMC deficits in PD and how they affect the planning and correction of upper-limb motions. This was accomplished using a robotic manipulandum equipped with a virtual-reality system. Twenty age-matched healthy controls and fifty-six PD patients (before and after medication) completed an obstacle avoidance task under dynamic conditions (target and obstacles in moving or stationary form, with and without mechanical perturbations). Kinematic information from the robot was used to extract eighteen features that evaluated the SMC functions of the participants. The findings show that the PD patients before medication were 32% slower, reached 16% fewer targets, hit 41% more obstacles, and were 26% less efficient than the control participants, and the difference in these features was statistically significant under dynamic conditions. In addition to the motor deficits, the PD patients also showed deficits in handling high cognitive loads and interpreting sensory cues. Further, the PD patients after medication exhibited worse sensory and cognitive performance than before medication under complex testing conditions. The PD patients also showed deficits in following the computational models leading to poor motor planning.
Collapse
Affiliation(s)
- Yokhesh K Tamilselvam
- Canadian Surgical Technologies and Advanced Robotics (CSTAR), University of Western Ontario (UWO), London, ON, N6A 5B9, Canada.
- Department of Electrical and Computer Engineering, University of Western Ontario (UWO), London, ON, N6A 5B9, Canada.
| | - Mandar Jog
- Department of Electrical and Computer Engineering, University of Western Ontario (UWO), London, ON, N6A 5B9, Canada
- Department of Clinical Neurological Sciences, UWO, and the London Movement Disorders Centre, London, ON, Canada
| | - Rajni V Patel
- Canadian Surgical Technologies and Advanced Robotics (CSTAR), University of Western Ontario (UWO), London, ON, N6A 5B9, Canada
- Department of Electrical and Computer Engineering, University of Western Ontario (UWO), London, ON, N6A 5B9, Canada
- Department of Clinical Neurological Sciences, UWO, London, ON, Canada
- Department of Surgery, UWO, London, ON, Canada
| |
Collapse
|
39
|
Teunissen L, Selen LPJ, Medendorp WP. Abrupt, but not gradual, motor adaptation biases saccadic target selection. J Neurophysiol 2023; 129:733-748. [PMID: 36812151 DOI: 10.1152/jn.00223.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/24/2023] Open
Abstract
Motor costs influence movement selection. These costs could change when movements are adapted in response to errors. When the motor system attributes the encountered errors to an external cause, appropriate movement selection requires an update of the movement goal, which prompts the selection of a different control policy. However, when errors are attributed to an internal cause, the initially selected control policy could remain unchanged, but the internal forward model of the body needs to be updated, resulting in an online correction of the movement. We hypothesized that external attribution of errors leads to the selection of a different control policy, and thus to a change in the expected cost of movements. This should also affect subsequent motor decisions. Conversely, internal attribution of errors may (initially) only evoke online corrections, and thus is expected to leave the motor decision process unchanged. We tested this hypothesis using a saccadic adaptation paradigm, designed to change the relative motor cost of two targets. Motor decisions were measured using a target selection task between the two saccadic targets before and after adaptation. Adaptation was induced by either abrupt or gradual perturbation schedules, which are thought to induce more external or internal attribution of errors, respectively. By taking individual variability into account, our results show that saccadic decisions shift toward the least costly target after adaptation, but only when the perturbation is abruptly, and not gradually, introduced. We suggest that credit assignment of errors not only influences motor adaptation but also subsequent motor decisions.NEW & NOTEWORTHY Decisions between potential motor actions are influenced by their costs, but costs change when movements are adapted. Using a saccadic target selection task, we show that target preference shifts after abrupt, but not after gradual adaptation. We suggest that this difference emerges because abrupt adaptation results in target remapping, and thus directly influences cost calculations, whereas gradual adaptation is mainly driven by corrections to a forward model that is not involved in cost calculations.
Collapse
Affiliation(s)
- Lonneke Teunissen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - Luc P J Selen
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| | - W Pieter Medendorp
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, Nijmegen, The Netherlands
| |
Collapse
|
40
|
Torricelli F, Tomassini A, Pezzulo G, Pozzo T, Fadiga L, D'Ausilio A. Motor invariants in action execution and perception. Phys Life Rev 2023; 44:13-47. [PMID: 36462345 DOI: 10.1016/j.plrev.2022.11.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/18/2022] [Accepted: 11/21/2022] [Indexed: 11/27/2022]
Abstract
The nervous system is sensitive to statistical regularities of the external world and forms internal models of these regularities to predict environmental dynamics. Given the inherently social nature of human behavior, being capable of building reliable predictive models of others' actions may be essential for successful interaction. While social prediction might seem to be a daunting task, the study of human motor control has accumulated ample evidence that our movements follow a series of kinematic invariants, which can be used by observers to reduce their uncertainty during social exchanges. Here, we provide an overview of the most salient regularities that shape biological motion, examine the role of these invariants in recognizing others' actions, and speculate that anchoring socially-relevant perceptual decisions to such kinematic invariants provides a key computational advantage for inferring conspecifics' goals and intentions.
Collapse
Affiliation(s)
- Francesco Torricelli
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Alice Tomassini
- Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Via San Martino della Battaglia 44, 00185 Rome, Italy
| | - Thierry Pozzo
- Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; INSERM UMR1093-CAPS, UFR des Sciences du Sport, Université Bourgogne Franche-Comté, F-21000, Dijon, France
| | - Luciano Fadiga
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy
| | - Alessandro D'Ausilio
- Department of Neuroscience and Rehabilitation, University of Ferrara, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy; Center for Translational Neurophysiology of Speech and Communication, Italian Institute of Technology, Via Fossato di Mortara, 17-19, 44121 Ferrara, Italy.
| |
Collapse
|
41
|
Moulton RH, Rudie K, Dukelow SP, Benson BW, Scott SH. Capacity Limits Lead to Information Bottlenecks in Ongoing Rapid Motor Behaviors. eNeuro 2023; 10:ENEURO.0289-22.2023. [PMID: 36858823 PMCID: PMC10012325 DOI: 10.1523/eneuro.0289-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2022] [Revised: 12/16/2022] [Accepted: 02/13/2023] [Indexed: 03/03/2023] Open
Abstract
Studies of ongoing, rapid motor behaviors have often focused on the decision-making implicit in the task. Here, we instead study how decision-making integrates with the perceptual and motor systems and propose a framework of limited-capacity, pipelined processing with flexible resources to understand rapid motor behaviors. Results from three experiments show that human performance is consistent with our framework: participants perform objectively worse as task difficulty increases, and, surprisingly, this drop in performance is largest for the most skilled performers. As well, our analysis shows that the worst-performing participants can perform equally well under increased task demands, which is consistent with flexible neural resources being allocated to reduce bottleneck effects and improve overall performance. We conclude that capacity limits lead to information bottlenecks and that processes like attention help reduce the effects that these bottlenecks have on maximal performance.
Collapse
Affiliation(s)
- Richard Hugh Moulton
- Department of Electrical and Computer Engineering, Queen's University, Kingston, Ontario, ON K7L 3N6, Canada
| | - Karen Rudie
- Department of Electrical and Computer Engineering, Queen's University, Kingston, Ontario, ON K7L 3N6, Canada
- School of Computing, Queen's University, Kingston, Ontario, ON K7L 2N8, Canada
- Ingenuity Labs Research Institute, Queen's University, Kingston, Ontario, ON K7L 3N6, Canada
| | - Sean P Dukelow
- Department of Clinical Neurosciences, University of Calgary, Calgary, Alberta, AB T2N 1N4, Canada
- Hotchkiss Brain Institute, University of Calgary, Calgary, Alberta, AB T2N 1N4, Canada
| | - Brian W Benson
- Department of Clinical Neurosciences, University of Calgary, Calgary, Alberta, AB T2N 1N4, Canada
- Cumming School of Medicine, University of Calgary, Calgary, Alberta, AB T2N 1N4, Canada
- Benson Concussion Institute, Calgary, Alberta, AB T3B 6B7, Canada
- Canadian Sport Institute Calgary, Calgary, Alberta, AB T3B 5R5, Canada
| | - Stephen H Scott
- Department of Biomedical and Molecular Sciences, Queen's University, Kingston, Ontario, ON K7L 3N6, Canada
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, ON K7L 3N6, Canada
- Department of Medicine, Queen's University, Kingston, Ontario, ON K7L 3N6, Canada
| |
Collapse
|
42
|
Snider J, Spence RJ, Engler AM, Moran R, Hacker S, Chukoskie L, Townsend J, Hill L. Distraction "Hangover": Characterization of the Delayed Return to Baseline Driving Risk After Distracting Behaviors. HUMAN FACTORS 2023; 65:306-320. [PMID: 33908806 DOI: 10.1177/00187208211012218] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
OBJECTIVE We measured how long distraction by a smartphone affects simulated driving behaviors after the tasks are completed (i.e., the distraction hangover). BACKGROUND Most drivers know that smartphones distract. Trying to limit distraction, drivers can use hands-free devices, where they only briefly glance at the smartphone. However, the cognitive cost of switching tasks from driving to communicating and back to driving adds an underappreciated, potentially long period to the total distraction time. METHOD Ninety-seven 21- to 78-year-old individuals who self-identified as active drivers and smartphone users engaged in a simulated driving scenario that included smartphone distractions. Peripheral-cue and car-following tasks were used to assess driving behavior, along with synchronized eye tracking. RESULTS The participants' lateral speed was larger than baseline for 15 s after the end of a voice distraction and for up to 25 s after a text distraction. Correct identification of peripheral cues dropped about 5% per decade of age, and participants from the 71+ age group missed seeing about 50% of peripheral cues within 4 s of the distraction. During distraction, coherence with the lead car in a following task dropped from 0.54 to 0.045, and seven participants rear-ended the lead car. Breadth of scanning contracted by 50% after distraction. CONCLUSION Simulated driving performance drops dramatically after smartphone distraction for all ages and for both voice and texting. APPLICATION Public education should include the dangers of any smartphone use during driving, including hands-free.
Collapse
Affiliation(s)
| | | | | | - Ryan Moran
- 8784 UC San Diego, La Jolla, California, USA
| | | | | | | | - Linda Hill
- 8784 UC San Diego, La Jolla, California, USA
| |
Collapse
|
43
|
Mangin EN, Chen J, Lin J, Li N. Behavioral measurements of motor readiness in mice. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.02.03.527054. [PMID: 36778494 PMCID: PMC9915731 DOI: 10.1101/2023.02.03.527054] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 02/07/2023]
Abstract
Motor planning facilitates rapid and precise execution of volitional movements. Although motor planning has been classically studied in humans and monkeys, the mouse has become an increasingly popular model system to study neural mechanisms of motor planning. It remains yet untested whether mice and primates share common behavioral features of motor planning. We combined videography and a delayed response task paradigm in an autonomous behavioral system to measure motor planning in non-body- restrained mice. Motor planning resulted in both reaction time savings and increased movement accuracy, replicating classic effects in primates. We found that motor planning was reflected in task-relevant body features. Both the specific actions prepared and the degree of motor readiness could be read out online during motor planning. The online readout further revealed behavioral evidence of simultaneous preparation for multiple actions under uncertain conditions. These results validate the mouse as a model to study motor planning, demonstrate body feature movements as a powerful real-time readout of motor readiness, and offer behavioral evidence that motor planning can be a parallel process that permits rapid selection of multiple prepared actions.
Collapse
Affiliation(s)
| | - Jian Chen
- Department of Neuroscience, Baylor College of Medicine
| | - Jing Lin
- Department of Neuroscience, Baylor College of Medicine
| | - Nuo Li
- Department of Neuroscience, Baylor College of Medicine
| |
Collapse
|
44
|
Catenacci Volpi N, Greaves M, Trendafilov D, Salge C, Pezzulo G, Polani D. Skilled motor control of an inverted pendulum implies low entropy of states but high entropy of actions. PLoS Comput Biol 2023; 19:e1010810. [PMID: 36608159 PMCID: PMC9851554 DOI: 10.1371/journal.pcbi.1010810] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/22/2022] [Revised: 01/19/2023] [Accepted: 12/12/2022] [Indexed: 01/07/2023] Open
Abstract
The mastery of skills, such as balancing an inverted pendulum, implies a very accurate control of movements to achieve the task goals. Traditional accounts of skilled action control that focus on either routinization or perceptual control make opposite predictions about the ways we achieve mastery. The notion of routinization emphasizes the decrease of the variance of our actions, whereas the notion of perceptual control emphasizes the decrease of the variance of the states we visit, but not of the actions we execute. Here, we studied how participants managed control tasks of varying levels of difficulty, which consisted of controlling inverted pendulums of different lengths. We used information-theoretic measures to compare the predictions of alternative accounts that focus on routinization and perceptual control, respectively. Our results indicate that the successful performance of the control task strongly correlates with the decrease of state variability and the increase of action variability. As postulated by perceptual control theory, the mastery of skilled pendulum control consists in achieving stable control of goals by flexible means.
Collapse
Affiliation(s)
- Nicola Catenacci Volpi
- Department of Computer Science, University of Hertfordshire, Hatfield, England, United Kingdom
- * E-mail:
| | - Martin Greaves
- Department of Computer Science, University of Hertfordshire, Hatfield, England, United Kingdom
| | - Dari Trendafilov
- Institute for Pervasive Computing, Johannes Kepler University, Linz, Austria
| | - Christoph Salge
- Department of Computer Science, University of Hertfordshire, Hatfield, England, United Kingdom
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| | - Daniel Polani
- Department of Computer Science, University of Hertfordshire, Hatfield, England, United Kingdom
| |
Collapse
|
45
|
Gussow AE. Language production under message uncertainty: When, how, and why we speak before we think. PSYCHOLOGY OF LEARNING AND MOTIVATION 2023. [DOI: 10.1016/bs.plm.2023.02.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
|
46
|
Loeb GE. Remembrance of things perceived: Adding thalamocortical function to artificial neural networks. Front Integr Neurosci 2023; 17:1108271. [PMID: 36959924 PMCID: PMC10027940 DOI: 10.3389/fnint.2023.1108271] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/25/2022] [Accepted: 02/13/2023] [Indexed: 03/09/2023] Open
Abstract
Recent research has illuminated the complexity and importance of the thalamocortical system but it has been difficult to identify what computational functions it performs. Meanwhile, deep-learning artificial neural networks (ANNs) based on bio-inspired models of purely cortical circuits have achieved surprising success solving sophisticated cognitive problems associated historically with human intelligence. Nevertheless, the limitations and shortcomings of artificial intelligence (AI) based on such ANNs are becoming increasingly clear. This review considers how the addition of thalamocortical connectivity and its putative functions related to cortical attention might address some of those shortcomings. Such bio-inspired models are now providing both testable theories of biological cognition and improved AI technology, much of which is happening outside the usual academic venues.
Collapse
|
47
|
Moskowitz JB, Berger SA, Fooken J, Castelhano MS, Gallivan JP, Flanagan JR. The influence of movement-related costs when searching to act and acting to search. J Neurophysiol 2023; 129:115-130. [PMID: 36475897 DOI: 10.1152/jn.00305.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
Real-world search behavior often involves limb movements, either during search or after search. Here we investigated whether movement-related costs influence search behavior in two kinds of search tasks. In our visual search tasks, participants made saccades to find a target object among distractors and then moved a cursor, controlled by the handle of a robotic manipulandum, to the target. In our manual search tasks, participants moved the cursor to perform the search, placing it onto objects to reveal their identity as either a target or a distractor. In all tasks, there were multiple targets. Across experiments, we manipulated either the effort or time costs associated with movement such that these costs varied across the search space. We varied effort by applying different resistive forces to the handle, and we varied time costs by altering the speed of the cursor. Our analysis of cursor and eye movements during manual and visual search, respectively, showed that effort influenced manual search but did not influence visual search. In contrast, time costs influenced both visual and manual search. Our results demonstrate that, in addition to perceptual and cognitive factors, movement-related costs can also influence search behavior.NEW & NOTEWORTHY Numerous studies have investigated the perceptual and cognitive factors that influence decision making about where to look, or move, in search tasks. However, little is known about how search is influenced by movement-related costs associated with acting on an object once it has been visually located or acting during manual search. In this article, we show that movement time costs can bias visual and manual search and that movement effort costs bias manual search.
Collapse
Affiliation(s)
- Joshua B Moskowitz
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada.,Department of Psychology, Queen's University, Kingston, Ontario, Canada
| | - Sarah A Berger
- Department of Psychology, Queen's University, Kingston, Ontario, Canada
| | - Jolande Fooken
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada
| | - Monica S Castelhano
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada.,Department of Psychology, Queen's University, Kingston, Ontario, Canada
| | - Jason P Gallivan
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada.,Department of Psychology, Queen's University, Kingston, Ontario, Canada.,Department of Biomedical and Molecular Sciences, Queen's University, Kingston, Ontario, Canada
| | - J Randall Flanagan
- Centre for Neuroscience Studies, Queen's University, Kingston, Ontario, Canada.,Department of Psychology, Queen's University, Kingston, Ontario, Canada
| |
Collapse
|
48
|
A neurocomputational theory of action regulation predicts motor behavior in neurotypical individuals and patients with Parkinson’s disease. PLoS Comput Biol 2022; 18:e1010111. [DOI: 10.1371/journal.pcbi.1010111] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2022] [Revised: 12/01/2022] [Accepted: 10/27/2022] [Indexed: 11/18/2022] Open
Abstract
Surviving in an uncertain environment requires not only the ability to select the best action, but also the flexibility to withhold inappropriate actions when the environmental conditions change. Although selecting and withholding actions have been extensively studied in both human and animals, there is still lack of consensus on the mechanism underlying these action regulation functions, and more importantly, how they inter-relate. A critical gap impeding progress is the lack of a computational theory that will integrate the mechanisms of action regulation into a unified framework. The current study aims to advance our understanding by developing a neurodynamical computational theory that models the mechanism of action regulation that involves suppressing responses, and predicts how disruption of this mechanism can lead to motor deficits in Parkinson’s disease (PD) patients. We tested the model predictions in neurotypical individuals and PD patients in three behavioral tasks that involve free action selection between two opposed directions, action selection in the presence of conflicting information and abandoning an ongoing action when a stop signal is presented. Our results and theory suggest an integrated mechanism of action regulation that affects both action initiation and inhibition. When this mechanism is disrupted, motor behavior is affected, leading to longer reaction times and higher error rates in action inhibition.
Collapse
|
49
|
Moving beyond response times with accessible measures of manual dynamics. Sci Rep 2022; 12:19065. [PMID: 36351962 PMCID: PMC9646795 DOI: 10.1038/s41598-022-20579-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2021] [Accepted: 09/15/2022] [Indexed: 11/11/2022] Open
Abstract
Button-press measures of response time (RT) and accuracy have long served a central role in psychological research. However, RT and accuracy provide limited insight into how cognitive processes unfold over time. To address this limitation, researchers have used hand-tracking techniques to investigate how cognitive processes unfold over the course of a response, are modulated by recent experience, and function across the lifespan. Despite the efficacy of these techniques for investigating a wide range of psychological phenomena, widespread adoption of hand-tracking techniques within the field is hindered by a range of factors, including equipment costs and the use of specialized software. Here, we demonstrate that the behavioral dynamics previously observed with specialized motion-tracking equipment in an Eriksen flanker task can be captured with an affordable, portable, and easy-to-assemble response box. Six-to-eight-year-olds and adults (N = 90) completed a computerized version of the flanker task by pressing and holding a central button until a stimulus array appeared. Participants then responded by releasing the central button and reaching to press one of two response buttons. This method allowed RT to be separated into initiation time (when the central button was released) and movement time (time elapsed between initiation and completion of the response). Consistent with previous research using motion-tracking techniques, initiation times and movement times revealed distinct patterns of effects across trials and between age groups, indicating that the method used in the current study presents a simple solution for researchers from across the psychological and brain sciences looking to move beyond RTs.
Collapse
|
50
|
Allocation of Visuospatial Attention Indexes Evidence Accumulation for Reach Decisions. eNeuro 2022; 9:ENEURO.0313-22.2022. [PMID: 36302633 PMCID: PMC9651207 DOI: 10.1523/eneuro.0313-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2022] [Revised: 09/19/2022] [Accepted: 09/22/2022] [Indexed: 12/24/2022] Open
Abstract
Visuospatial attention is a prerequisite for the performance of visually guided movements: perceptual discrimination is regularly enhanced at target locations before movement initiation. It is known that this attentional prioritization evolves over the time of movement preparation; however, it is not clear whether this build-up simply reflects a time requirement of attention formation or whether, instead, attention build-up reflects the emergence of the movement decision. To address this question, we combined behavioral experiments, psychophysics, and computational decision-making models to characterize the time course of attention build-up during motor preparation. Participants (n = 46, 29 female) executed center-out reaches to one of two potential target locations and reported the identity of a visual discrimination target (DT) that occurred concurrently at one of various time-points during movement preparation and execution. Visual discrimination increased simultaneously at the two potential target locations but was modulated by the experiment-wide probability that a given location would become the final goal. Attention increased further for the location that was then designated as the final goal location, with a time course closely related to movement initiation. A sequential sampling model of decision-making faithfully predicted key temporal characteristics of attentional allocation. Together, these findings provide evidence that visuospatial attentional prioritization during motor preparation does not simply reflect that a spatial location has been selected as movement goal, but rather indexes the time-extended, cumulative decision that leads to the selection, hence constituting a link between perceptual and motor aspects of sensorimotor decisions.
Collapse
|