1
|
Cesanek E, Shivkumar S, Ingram JN, Wolpert DM. Ouvrai opens access to remote virtual reality studies of human behavioural neuroscience. Nat Hum Behav 2024; 8:1209-1224. [PMID: 38671286 PMCID: PMC11199109 DOI: 10.1038/s41562-024-01834-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/05/2023] [Accepted: 01/18/2024] [Indexed: 04/28/2024]
Abstract
Modern virtual reality (VR) devices record six-degree-of-freedom kinematic data with high spatial and temporal resolution and display high-resolution stereoscopic three-dimensional graphics. These capabilities make VR a powerful tool for many types of behavioural research, including studies of sensorimotor, perceptual and cognitive functions. Here we introduce Ouvrai, an open-source solution that facilitates the design and execution of remote VR studies, capitalizing on the surge in VR headset ownership. This tool allows researchers to develop sophisticated experiments using cutting-edge web technologies such as WebXR to enable browser-based VR, without compromising on experimental design. Ouvrai's features include easy installation, intuitive JavaScript templates, a component library managing front- and backend processes and a streamlined workflow. It integrates with Firebase, Prolific and Amazon Mechanical Turk and provides data processing utilities for analysis. Unlike other tools, Ouvrai remains free, with researchers managing their web hosting and cloud database via personal Firebase accounts. Ouvrai is not limited to VR studies; researchers can also develop and run desktop or touchscreen studies using the same streamlined workflow. Through three distinct motor learning experiments, we confirm Ouvrai's efficiency and viability for conducting remote VR studies.
Collapse
Affiliation(s)
- Evan Cesanek
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY, USA.
| | - Sabyasachi Shivkumar
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY, USA
| | - James N Ingram
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY, USA
| | - Daniel M Wolpert
- Zuckerman Mind Brain Behavior Institute, Department of Neuroscience, Columbia University, New York, NY, USA
| |
Collapse
|
2
|
Fukumoto Y, Todo M, Suzuki M, Kimura D, Suzuki T. Changes in spinal motoneuron excitability during the improvement of fingertip dexterity by actual execution combined with motor imagery practice. Heliyon 2024; 10:e30016. [PMID: 38707302 PMCID: PMC11066649 DOI: 10.1016/j.heliyon.2024.e30016] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2023] [Revised: 04/07/2024] [Accepted: 04/18/2024] [Indexed: 05/07/2024] Open
Abstract
Since there is an upper limit to skill improvement through the repetition of actual execution, we examined whether motor imagery could be used in combination with actual execution to maximize motor skill improvement. Fingertip dexterity was evaluated in 25 healthy participants performing a force adjustment task using a pinch movement with the left thumb and index finger. In the intervention condition, six sets of repetitions of combined actual execution and motor imagery were performed, while in the control condition, the same flow was performed, but with motor imagery replaced by rest. Changes in the excitability of spinal motoneurons during motor imagery compared to rest were compared in terms of the F/M amplitude ratio. Motor skill changes were compared before and after repeated practice and between the conditions, respectively, using the absolute amount of adjustment error between the target pinch force value and the delivered pinch force value (absolute error) as an index. The results showed that the repetition of exercise practice and motor imagery decreased the absolute error, which was greater than that of exercise practice alone in terms of motor skill improvement. The F/M amplitude ratio for motor imagery compared to rest did not increase. This suggests that motor imagery is involved in the degree of the increase of spinal motoneuron excitability based on the real-time prediction of motor execution and that there may be no need for an increase in excitability during motor skill control.
Collapse
Affiliation(s)
- Yuki Fukumoto
- Kansai University of Health Sciences, Faculty of Health Sciences, Department of Physical Therapy, 2-11-1 Wakaba Sennangun Kumatori, Osaka, 590-0482, Japan
- Graduate School of Kansai University of Health Sciences, Graduate School of Health Sciences, 2-11-1 Wakaba Sennangun Kumatori, Osaka, 590-0482, Japan
| | - Marina Todo
- Kansai University of Health Sciences, Faculty of Health Sciences, Department of Physical Therapy, 2-11-1 Wakaba Sennangun Kumatori, Osaka, 590-0482, Japan
- Graduate School of Kansai University of Health Sciences, Graduate School of Health Sciences, 2-11-1 Wakaba Sennangun Kumatori, Osaka, 590-0482, Japan
| | - Makoto Suzuki
- Bukkyo University, Faculty of Health Sciences, Department of Occupational Therapy, 7 Higashitochio-cho Nishinokyo Nakagyo-ku, Kyoto, 604-8418, Japan
| | - Daisuke Kimura
- Nagoya Women's University, Faculty of Medical Science, Department of Occupational Therapy, 3-40 Shioji Mizuho Nagoya, Aichi, 467-8610, Japan
| | - Toshiaki Suzuki
- Kansai University of Health Sciences, Faculty of Health Sciences, Department of Physical Therapy, 2-11-1 Wakaba Sennangun Kumatori, Osaka, 590-0482, Japan
- Graduate School of Kansai University of Health Sciences, Graduate School of Health Sciences, 2-11-1 Wakaba Sennangun Kumatori, Osaka, 590-0482, Japan
| |
Collapse
|
3
|
Yildirim I, Paul LA. From task structures to world models: what do LLMs know? Trends Cogn Sci 2024; 28:404-415. [PMID: 38443199 DOI: 10.1016/j.tics.2024.02.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/12/2023] [Revised: 02/03/2024] [Accepted: 02/13/2024] [Indexed: 03/07/2024]
Abstract
In what sense does a large language model (LLM) have knowledge? We answer by granting LLMs 'instrumental knowledge': knowledge gained by using next-word generation as an instrument. We then ask how instrumental knowledge is related to the ordinary, 'worldly knowledge' exhibited by humans, and explore this question in terms of the degree to which instrumental knowledge can be said to incorporate the structured world models of cognitive science. We discuss ways LLMs could recover degrees of worldly knowledge and suggest that such recovery will be governed by an implicit, resource-rational tradeoff between world models and tasks. Our answer to this question extends beyond the capabilities of a particular AI system and challenges assumptions about the nature of knowledge and intelligence.
Collapse
Affiliation(s)
- Ilker Yildirim
- Department of Psychology, Yale University, New Haven, CT, USA; Department of Statistics and Data Science, Yale University, New Haven, CT, USA; Wu-Tsai Institute, Yale University, New Haven, CT, USA; Foundations of Data Science Institute, Yale University, New Haven, CT, USA.
| | - L A Paul
- Department of Philosophy, Yale University, New Haven, CT, USA; Wu-Tsai Institute, Yale University, New Haven, CT, USA; Munich Center for Mathematical Philosophy, Ludwig Maximilian University of Munich, Munich, Germany.
| |
Collapse
|
4
|
Dekleva BM, Chowdhury RH, Batista AP, Chase SM, Yu BM, Boninger ML, Collinger JL. Motor cortex retains and reorients neural dynamics during motor imagery. Nat Hum Behav 2024; 8:729-742. [PMID: 38287177 PMCID: PMC11089477 DOI: 10.1038/s41562-023-01804-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Accepted: 12/13/2023] [Indexed: 01/31/2024]
Abstract
The most prominent characteristic of motor cortex is its activation during movement execution, but it is also active when we simply imagine movements in the absence of actual motor output. Despite decades of behavioural and imaging studies, it is unknown how the specific activity patterns and temporal dynamics in motor cortex during covert motor imagery relate to those during motor execution. Here we recorded intracortical activity from the motor cortex of two people who retain some residual wrist function following incomplete spinal cord injury as they performed both actual and imagined isometric wrist extensions. We found that we could decompose the population activity into three orthogonal subspaces, where one was similarly active during both action and imagery, and the others were active only during a single task type-action or imagery. Although they inhabited orthogonal neural dimensions, the action-unique and imagery-unique subspaces contained a strikingly similar set of dynamic features. Our results suggest that during motor imagery, motor cortex maintains the same overall population dynamics as during execution by reorienting the components related to motor output and/or feedback into a unique, output-null imagery subspace.
Collapse
Affiliation(s)
- Brian M Dekleva
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Physical Medicine & Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
| | - Raeed H Chowdhury
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Aaron P Batista
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Steven M Chase
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Byron M Yu
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Michael L Boninger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Physical Medicine & Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Jennifer L Collinger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA.
- Department of Physical Medicine & Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA.
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA.
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA.
| |
Collapse
|
5
|
Seegelke C, Heed T. It is time to integrate models across disciplines: a commentary on Krüger et al. (2022). PSYCHOLOGICAL RESEARCH 2024:10.1007/s00426-024-01930-3. [PMID: 38430251 DOI: 10.1007/s00426-024-01930-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/08/2023] [Accepted: 01/26/2024] [Indexed: 03/03/2024]
Affiliation(s)
- Christian Seegelke
- Department of Psychology, University of Salzburg, Hellbrunner Straße 34, 5020, Salzburg, Austria.
- Centre for Cognitive Neuroscience, University of Salzburg, Salzburg, Austria.
| | - Tobias Heed
- Department of Psychology, University of Salzburg, Hellbrunner Straße 34, 5020, Salzburg, Austria
- Centre for Cognitive Neuroscience, University of Salzburg, Salzburg, Austria
| |
Collapse
|
6
|
O'Shea H, Bek J. The complex interplay between perception, cognition, and action: a commentary on Bach et al. 2022. PSYCHOLOGICAL RESEARCH 2024:10.1007/s00426-023-01921-w. [PMID: 38294530 DOI: 10.1007/s00426-023-01921-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Accepted: 12/25/2023] [Indexed: 02/01/2024]
Abstract
Bach (Psychological Research 2022, https://doi.org/10.1007/s00426-022-01773-w ) offer a re-conceptualisation of motor imagery, influenced by older ideas of ideomotor action and formulated in terms of action effects rather than motor output. We share the view of an essential role of action effect in action planning and motor imagery processes, but we challenge the claim that motor imagery is non-motoric in nature. In the present article, we critically review some of Bach et al.'s proposed ideas and pose questions of whether effect and motor processes are functionally separable, and if not, what mechanisms underlie motor imagery and what terminology best captures its function.
Collapse
Affiliation(s)
- Helen O'Shea
- School of Psychology, University College Dublin, Belfield, Dublin 4, Ireland
| | - Judith Bek
- School of Psychology, University College Dublin, Belfield, Dublin 4, Ireland.
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, Canada.
| |
Collapse
|
7
|
Pawlowsky C, Thénault F, Bernier PM. Implicit Sensorimotor Adaptation Proceeds in Absence of Movement Execution. eNeuro 2023; 10:ENEURO.0508-22.2023. [PMID: 37463743 PMCID: PMC10405882 DOI: 10.1523/eneuro.0508-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2022] [Revised: 06/19/2023] [Accepted: 07/07/2023] [Indexed: 07/20/2023] Open
Abstract
In implicit sensorimotor adaptation, a mismatch between the predicted and actual sensory feedback results in a sensory prediction error (SPE). Sensory predictions have long been thought to be linked to descending motor commands, implying a necessary contribution of movement execution to adaptation. However, recent work has shown that mere motor imagery (MI) also engages predictive mechanisms, opening up the possibility that MI might be sufficient to drive implicit adaptation. In a within-subject design in humans (n = 30), implicit adaptation was assessed in a center-out reaching task, following a single exposure to a visuomotor rotation. It was hypothesized that performing MI of a reaching movement while being provided with an animation of rotated visual feedback (MI condition) would lead to postrotation biases (PRBs) similar to those observed when the movement is executed (Execution condition). Results revealed that both the MI and Execution conditions led to significant directional biases following rotated trials. Yet the magnitude of these biases was significantly larger in the Execution condition. To further probe the contribution of MI to adaptation, a Control condition was conducted in which participants were presented with the same rotated visual animation as in the MI condition, but in which they were prevented from performing MI. Surprisingly, significant biases were also observed in the Control condition, suggesting that MI per se may not have accounted for adaptation. Overall, these results suggest that implicit adaptation can be partially supported by processes other than those that strictly pertain to generating motor commands, although movement execution does potentiate it.
Collapse
Affiliation(s)
- Constance Pawlowsky
- Département de kinanthropologie, Faculté des Sciences de l'Activité Physique, Université de Sherbrooke, Sherbrooke, Québec, J1K 2R1, Canada
| | - François Thénault
- Département de kinanthropologie, Faculté des Sciences de l'Activité Physique, Université de Sherbrooke, Sherbrooke, Québec, J1K 2R1, Canada
| | - Pierre-Michel Bernier
- Département de kinanthropologie, Faculté des Sciences de l'Activité Physique, Université de Sherbrooke, Sherbrooke, Québec, J1K 2R1, Canada
| |
Collapse
|
8
|
Avraham G, Taylor JA, Breska A, Ivry RB, McDougle SD. Contextual effects in sensorimotor adaptation adhere to associative learning rules. eLife 2022; 11:e75801. [PMID: 36197002 PMCID: PMC9635873 DOI: 10.7554/elife.75801] [Citation(s) in RCA: 5] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/24/2021] [Accepted: 10/04/2022] [Indexed: 11/20/2022] Open
Abstract
Traditional associative learning tasks focus on the formation of associations between salient events and arbitrary stimuli that predict those events. This is exemplified in cerebellar-dependent delay eyeblink conditioning, where arbitrary cues such as a tone or light act as conditioned stimuli (CSs) that predict aversive sensations at the cornea (unconditioned stimulus [US]). Here, we ask if a similar framework could be applied to another type of cerebellar-dependent sensorimotor learning - sensorimotor adaptation. Models of sensorimotor adaptation posit that the introduction of an environmental perturbation results in an error signal that is used to update an internal model of a sensorimotor map for motor planning. Here, we take a step toward an integrative account of these two forms of cerebellar-dependent learning, examining the relevance of core concepts from associative learning for sensorimotor adaptation. Using a visuomotor adaptation reaching task, we paired movement-related feedback (US) with neutral auditory or visual contextual cues that served as CSs. Trial-by-trial changes in feedforward movement kinematics exhibited three key signatures of associative learning: differential conditioning, sensitivity to the CS-US interval, and compound conditioning. Moreover, after compound conditioning, a robust negative correlation was observed between responses to the two elemental CSs of the compound (i.e. overshadowing), consistent with the additivity principle posited by theories of associative learning. The existence of associative learning effects in sensorimotor adaptation provides a proof-of-concept for linking cerebellar-dependent learning paradigms within a common theoretical framework.
Collapse
Affiliation(s)
- Guy Avraham
- Department of Psychology, University of California, BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
| | - Jordan A Taylor
- Department of Psychology, Princeton UniversityPrincetonUnited States
| | - Assaf Breska
- Department of Psychology, University of California, BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
- Max Planck Institute for Biological CyberneticsTübingenGermany
| | - Richard B Ivry
- Department of Psychology, University of California, BerkeleyBerkeleyUnited States
- Helen Wills Neuroscience Institute, University of California, BerkeleyBerkeleyUnited States
| | | |
Collapse
|
9
|
Facco E. Hypnosis and Hypnotic ability between old beliefs and new evidences: An epistemological reflection. AMERICAN JOURNAL OF CLINICAL HYPNOSIS 2022; 64:20-35. [PMID: 34748464 DOI: 10.1080/00029157.2020.1863181] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/04/2023]
Abstract
The history of hypnosis has been marked by its effectiveness paralleled by prejudicial refusal, due to its ostensible incompatibility with the ruling Weltbild (picture of the world). Its interpretation has been mainly based on concepts like suggestibility, dissociation, hallucination, impairment of sense of agency, and free will. Nevertheless, little evidence and agreement has been reached so far on the nature of hypnosis and hypnotic ability, an uncertainty enhanced by the wide range of meanings and ambiguities of the used terms. This article analyzes the main epistemological implications involved in the topic.
Collapse
Affiliation(s)
- Enrico Facco
- University of Padua, Padua, Italy
- Inst. Franco Granone – Italian Center of Clinical and Experimental Hypnosis (CIIICS), Turin, Italy
| |
Collapse
|
10
|
Kim OA, Forrence AD, McDougle SD. Motor learning without movement. Proc Natl Acad Sci U S A 2022; 119:e2204379119. [PMID: 35858450 PMCID: PMC9335319 DOI: 10.1073/pnas.2204379119] [Citation(s) in RCA: 16] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2022] [Accepted: 06/09/2022] [Indexed: 01/21/2023] Open
Abstract
Prediction errors guide many forms of learning, providing teaching signals that help us improve our performance. Implicit motor adaptation, for instance, is thought to be driven by sensory prediction errors (SPEs), which occur when the expected and observed consequences of a movement differ. Traditionally, SPE computation is thought to require movement execution. However, recent work suggesting that the brain can generate sensory predictions based on motor imagery or planning alone calls this assumption into question. Here, by measuring implicit motor adaptation during a visuomotor task, we tested whether motor planning and well-timed sensory feedback are sufficient for adaptation. Human participants were cued to reach to a target and were, on a subset of trials, rapidly cued to withhold these movements. Errors displayed both on trials with and without movements induced single-trial adaptation. Learning following trials without movements persisted even when movement trials had never been paired with errors and when the direction of movement and sensory feedback trajectories were decoupled. These observations indicate that the brain can compute errors that drive implicit adaptation without generating overt movements, leading to the adaptation of motor commands that are not overtly produced.
Collapse
Affiliation(s)
- Olivia A. Kim
- Department of Psychology, Princeton University, Princeton, NJ 08544
| | | | - Samuel D. McDougle
- Department of Psychology, Yale University, New Haven, CT 06511
- Wu Tsai Institute, Yale University, New Haven, CT 06511
| |
Collapse
|
11
|
Sun X, O'Shea DJ, Golub MD, Trautmann EM, Vyas S, Ryu SI, Shenoy KV. Cortical preparatory activity indexes learned motor memories. Nature 2022; 602:274-279. [PMID: 35082444 PMCID: PMC9851374 DOI: 10.1038/s41586-021-04329-x] [Citation(s) in RCA: 34] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2020] [Accepted: 12/09/2021] [Indexed: 01/21/2023]
Abstract
The brain's remarkable ability to learn and execute various motor behaviours harnesses the capacity of neural populations to generate a variety of activity patterns. Here we explore systematic changes in preparatory activity in motor cortex that accompany motor learning. We trained rhesus monkeys to learn an arm-reaching task1 in a curl force field that elicited new muscle forces for some, but not all, movement directions2,3. We found that in a neural subspace predictive of hand forces, changes in preparatory activity tracked the learned behavioural modifications and reassociated4 existing activity patterns with updated movements. Along a neural population dimension orthogonal to the force-predictive subspace, we discovered that preparatory activity shifted uniformly for all movement directions, including those unaltered by learning. During a washout period when the curl field was removed, preparatory activity gradually reverted in the force-predictive subspace, but the uniform shift persisted. These persistent preparatory activity patterns may retain a motor memory of the learned field5,6 and support accelerated relearning of the same curl field. When a set of distinct curl fields was learned in sequence, we observed a corresponding set of field-specific uniform shifts which separated the associated motor memories in the neural state space7-9. The precise geometry of these uniform shifts in preparatory activity could serve to index motor memories, facilitating the acquisition, retention and retrieval of a broad motor repertoire.
Collapse
Affiliation(s)
- Xulu Sun
- Department of Biology, Stanford University, Stanford, CA, USA.
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA.
| | - Daniel J O'Shea
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Matthew D Golub
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Eric M Trautmann
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
| | - Saurabh Vyas
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Department of Bioengineering, Stanford University, Stanford, CA, USA
| | - Stephen I Ryu
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
- Department of Neurosurgery, Palo Alto Medical Foundation, Palo Alto, CA, USA
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
| | - Krishna V Shenoy
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA.
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA.
- Department of Bioengineering, Stanford University, Stanford, CA, USA.
- Department of Neurosurgery, Stanford University, Stanford, CA, USA.
- Department of Neurobiology, Stanford University, Stanford, CA, USA.
- Howard Hughes Medical Institute, Stanford University, Stanford, CA, USA.
| |
Collapse
|
12
|
Zhou L, Zhu Q, Wu B, Qin B, Hu H, Qian Z. A comparison of directed functional connectivity among fist-related brain activities during movement imagery, movement execution, and movement observation. Brain Res 2021; 1777:147769. [PMID: 34971597 DOI: 10.1016/j.brainres.2021.147769] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2021] [Revised: 12/03/2021] [Accepted: 12/24/2021] [Indexed: 12/22/2022]
Abstract
Brain-computer interface (BCI) has been widely used in sports training and rehabilitation training. It is primarily based on action simulation, including movement imagery (MI) and movement observation (MO). However, the development of BCI technology is limited due to the challenge of getting an in-depth understanding of brain networks involved in MI, MO, and movement execution (ME). To better understand the brain activity changes and the communications across various brain regions under MO, ME, and MI, this study conducted the fist experiment under MO, ME, and MI. We recorded 64-channel electroencephalography (EEG) from 39 healthy subjects (25 males, 14 females, all right-handed) during fist tasks, obtained intensities and locations of sources using EEG source imaging (ESI), computed source activation modes, and finally investigated the brain networks using spectral Granger causality (GC). The brain regions involved in the three motor conditions are similar, but the degree of participation of each brain region and the network connections among the brain regions are different. MO, ME, and MI did not recruit shared brain connectivity networks. In addition, both source activation modes and brain network connectivity had lateralization advantages.
Collapse
Affiliation(s)
- Lu Zhou
- Department of Biomedical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Qiaoqiao Zhu
- Department of Biomedical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Biao Wu
- Electronic Information Department, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Bing Qin
- Department of Biomedical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China
| | - Haixu Hu
- Sports Training Academy, Nanjing Sport Institute, Nanjing, China
| | - Zhiyu Qian
- Department of Biomedical Engineering, Nanjing University of Aeronautics and Astronautics, Nanjing, China.
| |
Collapse
|
13
|
Van der Lubbe RHJ, Sobierajewicz J, Jongsma MLA, Verwey WB, Przekoracka-Krawczyk A. Frontal brain areas are more involved during motor imagery than during motor execution/preparation of a response sequence. Int J Psychophysiol 2021; 164:71-86. [PMID: 33647383 DOI: 10.1016/j.ijpsycho.2021.02.020] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2020] [Revised: 01/23/2021] [Accepted: 02/24/2021] [Indexed: 11/16/2022]
Abstract
Results of several neuroimaging studies support the functional equivalence model, which states that motor imagery (MI) and motor execution (ME) involve the same processes, except for the final execution component. In contrast, the motor-cognitive model implies that MI additionally involves frontal executive control processes. However, according to some authors MI may actually be more comparable to motor preparation (MP). In the current electroencephalographic study, a version of the discrete sequence production paradigm was employed in which human participants initially had to prepare a sequence of five finger movements that subsequently had to be executed, imagined, or withheld. MI, ME, and MP were compared by computing event-related (de)-synchronization in the theta, alpha/mu, and beta bands. Results revealed a major increase in frontal theta power during MI as compared to ME and MP. At the end of the examined intervals, a posterior reduction in alpha power was present during ME and MP, but not during MI. Finally, above sensorimotor areas a decrease in beta power was observed that was most pronounced in the case of ME. The increase of frontal theta activity during MI may reflect increased effort, while the absence of a reduction in posterior alpha power suggests no major involvement of visuospatial attention and/or visual imagery. The present findings favor the motor-cognitive model, as it predicts extra involvement of frontal executive processes during MI.
Collapse
Affiliation(s)
- Rob H J Van der Lubbe
- Cognitive Psychology and Ergonomics, Faculty of Behavior, Management, and Social Sciences, University of Twente, the Netherlands; Laboratory of Vision Science and Optometry, Faculty of Physics, Adam Mickiewicz University, Poznań, Poland; Laboratory of Vision and Neuroscience, NanoBiomedical Center, Adam Mickiewicz University, Poznań, Poland.
| | - Jagna Sobierajewicz
- Laboratory of Vision Science and Optometry, Faculty of Physics, Adam Mickiewicz University, Poznań, Poland; Laboratory of Vision and Neuroscience, NanoBiomedical Center, Adam Mickiewicz University, Poznań, Poland
| | - Marijtje L A Jongsma
- Behavioral Science Institute, Radboud University Nijmegen, Nijmegen, the Netherlands
| | - Willem B Verwey
- Cognitive Psychology and Ergonomics, Faculty of Behavior, Management, and Social Sciences, University of Twente, the Netherlands
| | - Anna Przekoracka-Krawczyk
- Laboratory of Vision Science and Optometry, Faculty of Physics, Adam Mickiewicz University, Poznań, Poland; Laboratory of Vision and Neuroscience, NanoBiomedical Center, Adam Mickiewicz University, Poznań, Poland
| |
Collapse
|
14
|
Rapid Changes in Movement Representations during Human Reaching Could Be Preserved in Memory for at Least 850 ms. eNeuro 2020; 7:ENEURO.0266-20.2020. [PMID: 32948645 PMCID: PMC7716430 DOI: 10.1523/eneuro.0266-20.2020] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2020] [Revised: 08/19/2020] [Accepted: 09/09/2020] [Indexed: 11/21/2022] Open
Abstract
Humans adapt to mechanical perturbations such as forcefields (FFs) during reaching within tens of trials. However, recent findings suggested that this adaptation may start within one single trial, i.e., online corrective movements can become tuned to the unanticipated perturbations within a trial. This was highlighted in previous works with a reaching experiment in which participants had to stop at a via-point (VP) located between the start and the goal. An FF was applied during the first and second parts of the movement and then occasionally unexpectedly switched off at the VP during catch trials. The results showed an after-effect during the second part of the movement when participants exited the VP. This behavioral result was interpreted as a standard after-effect, but it remained unclear how it was related to conventional trial-by-trial learning. The current study aimed to investigate how long do such changes in movement representations last in memory. For this, we have studied the same reaching task with VP in two situations: one with very short residing time in the VP and the second with an imposed minimum 500 ms dwell time in the VP. In both situations, during the unexpected absence of the FF after VP, after-effects were observed. This suggests that online corrections to the internal representation of reach dynamics can be preserved in memory for around 850 ms of resting time on average. Therefore, rapid changes occurring within movements can thus be preserved in memory long enough to influence trial-by-trial motor adaptation.
Collapse
|
15
|
Jiang X, Saggar H, Ryu SI, Shenoy KV, Kao JC. Structure in Neural Activity during Observed and Executed Movements Is Shared at the Neural Population Level, Not in Single Neurons. Cell Rep 2020; 32:108006. [DOI: 10.1016/j.celrep.2020.108006] [Citation(s) in RCA: 12] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/15/2020] [Revised: 05/24/2020] [Accepted: 07/16/2020] [Indexed: 12/30/2022] Open
|
16
|
Rojasavastera R, Bovonsunthonchai S, Hiengkaew V, Senanarong V. Action observation combined with gait training to improve gait and cognition in elderly with mild cognitive impairment A randomized controlled trial. Dement Neuropsychol 2020; 14:118-127. [PMID: 32595880 PMCID: PMC7304276 DOI: 10.1590/1980-57642020dn14-020004] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Owing to advancement of medical technology and current knowledge, the population has a longer life expectancy, leading to an increase in the proportion of elderly.
Collapse
Affiliation(s)
- Rommanee Rojasavastera
- Faculty of Physical Therapy, Mahidol University, Nakhon Pathom, Thailand.,Gait and Balance Group, Faculty of Physical Therapy, Mahidol University, Nakhon Pathom, Thailand
| | - Sunee Bovonsunthonchai
- Faculty of Physical Therapy, Mahidol University, Nakhon Pathom, Thailand.,Gait and Balance Group, Faculty of Physical Therapy, Mahidol University, Nakhon Pathom, Thailand
| | - Vimonwan Hiengkaew
- Faculty of Physical Therapy, Mahidol University, Nakhon Pathom, Thailand
| | - Vorapun Senanarong
- Division of Neurology, Faculty of Medicine Siriraj Hospital, Mahidol University, Bangkok, Thailand
| |
Collapse
|
17
|
Souto DO, Cruz TKF, Fontes PLB, Batista RC, Haase VG. Motor Imagery Development in Children: Changes in Speed and Accuracy With Increasing Age. Front Pediatr 2020; 8:100. [PMID: 32232021 PMCID: PMC7082325 DOI: 10.3389/fped.2020.00100] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Accepted: 02/26/2020] [Indexed: 12/20/2022] Open
Abstract
Although motor imagery has been pointed as a promising strategy for the rehabilitation of children with neurological disorders, information on their development throughout childhood and adolescence is still scarce. For instance, it is still unclear at what age they reach a development comparable to the motor imagery performance observed in adults. Herein we used a mental rotation task to assess motor imagery in 164 typically developing children and adolescents, which were divided into four age groups (6-7, 8-9, 10-11, and 12-13 years) and 30 adults. The effects of biomechanical constraints, accuracy, and reaction time of the mental rotation task were considered. ANOVA showed that all groups had the effect of biomechanical restrictions of the mental rotation task. We found a group effect for accuracy [F (4, 180) = 17,560; p < 0.00; η2 = 3.79] and reaction time [F (4, 180) = 17.5; p < 0.001, η2 = 0.615], with the results of children groups 6-7 and 8-9 years being significantly lower than the other groups (p < 0.05). In all the analyses, there were no differences regarding accuracy and reaction time among the participants of the age groups 10-11 and 12-13 years and adults (p > 0.05). Concluding, children aged 6-7 years were able to perform motor imagery, motor imagery ability improved as the participants' ages increased, and children aged 10 and over-performed similarly to adults.
Collapse
Affiliation(s)
- Deisiane Oliveira Souto
- Graduate Program in Neurosciences, Federal University of Minas Gerais, Belo Horizonte, Brazil
- Developmental Neuropsychology Laboratory, Department of Psychology, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
| | - Thalita Karla Flores Cruz
- Graduate Program in Neurosciences, Federal University of Minas Gerais, Belo Horizonte, Brazil
- Developmental Neuropsychology Laboratory, Department of Psychology, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
| | - Patrícia Lemos Bueno Fontes
- Graduate Program in Neurosciences, Federal University of Minas Gerais, Belo Horizonte, Brazil
- Department of Physiotherapy, Pontifícia Universidade Católica de Minas Gerais, Betim, Brazil
| | - Rodrigo Caetano Batista
- Developmental Neuropsychology Laboratory, Department of Psychology, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
| | - Vitor Geraldi Haase
- Graduate Program in Neurosciences, Federal University of Minas Gerais, Belo Horizonte, Brazil
- Developmental Neuropsychology Laboratory, Department of Psychology, Universidade Federal de Minas Gerais, Belo Horizonte, Brazil
- National Institute of Science and Technology on Behavior, CNPq, Belo Horizonte, Brazil
| |
Collapse
|
18
|
Jayasinghe SAL, Ranganathan R. Effects of Short-Term Mental Imagery and Supplemental Visual Feedback on Muscle Coordination in a Myoelectric Task. J Mot Behav 2020; 53:59-71. [PMID: 32041488 DOI: 10.1080/00222895.2020.1723482] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/25/2022]
Abstract
Changing muscle coordination patterns is a critical part of motor learning - yet there is a lack of simple, clinically feasible techniques to alter these patterns. Here, we investigated the effects of short-term mental imagery and supplemental visual feedback on muscle coordination using a myoelectric reaching task with complex mapping of arm and hand muscles to cursor position. Forty participants were divided into four groups, and practiced this task over 180 trials. During a short intervention period, the controls rested, the task- and muscle-imagery groups were given specific instructions meant to simplify the task, and the supplemental feedback group was provided extra visual information of muscle-to-cursor mapping. Results showed that there were no changes in task performance between groups. However, we found that in terms of muscle coordination, the supplemental visual feedback group showed the most efficient coordination. Furthermore, across all groups, individuals with greater efficiency and exploration showed better task performance at the end of practice. The results from this pilot study point to a greater need for understanding strategies for changing muscle coordination, which could be applicable in a rehabilitation setting.
Collapse
Affiliation(s)
| | - Rajiv Ranganathan
- Department of Kinesiology, Michigan State University, East Lansing, MI, USA.,Mechanical Engineering, Michigan State University, East Lansing, MI, USA
| |
Collapse
|
19
|
Cuenca-Martínez F, Suso-Martí L, León-Hernández JV, La Touche R. The Role of Movement Representation Techniques in the Motor Learning Process: A Neurophysiological Hypothesis and a Narrative Review. Brain Sci 2020; 10:brainsci10010027. [PMID: 31906593 PMCID: PMC7016972 DOI: 10.3390/brainsci10010027] [Citation(s) in RCA: 17] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/22/2019] [Revised: 12/19/2019] [Accepted: 12/30/2019] [Indexed: 01/27/2023] Open
Abstract
We present a neurophysiological hypothesis for the role of motor imagery (MI) and action observation (AO) training in the motor learning process. The effects of movement representation in the brain and those of the cortical–subcortical networks related to planning, executing, adjusting, and automating real movements share a similar neurophysiological activity. Coupled with the influence of certain variables related to the movement representation process, this neurophysiological activity is a key component of the present hypothesis. These variables can be classified into four domains: physical, cognitive–evaluative, motivational–emotional, and direct-modulation. The neurophysiological activity underlying the creation and consolidation of mnemonic representations of motor gestures as a prerequisite to motor learning might differ between AO and MI. Together with variations in cognitive loads, these differences might explain the differing results in motor learning. The mirror neuron system appears to function more efficiently through AO training than MI, and AO is less demanding in terms of cognitive load than MI. AO might be less susceptible to the influence of variables related to movement representation.
Collapse
Affiliation(s)
- Ferran Cuenca-Martínez
- Departamento de Fisioterapia, Centro Superior de Estudios Universitarios La Salle, Universidad Autónoma de Madrid, 28023 Madrid, Spain; (J.V.L.-H.); (R.L.T.)
- Motion in Brains Research Group, Institute of Neuroscience and Sciences of the Movement (INCIMOV), Centro Superior de Estudios Universitarios La Salle, Universidad Autónoma de Madrid, 28023 Madrid, Spain;
- Correspondence: ; Tel.: +34-91-740-1980 (ext. 310)
| | - Luis Suso-Martí
- Motion in Brains Research Group, Institute of Neuroscience and Sciences of the Movement (INCIMOV), Centro Superior de Estudios Universitarios La Salle, Universidad Autónoma de Madrid, 28023 Madrid, Spain;
- Department of Physiotherapy, Cardenal Herrera University-CEU, CEU Universities, 46115 Valencia, Spain
| | - Jose Vicente León-Hernández
- Departamento de Fisioterapia, Centro Superior de Estudios Universitarios La Salle, Universidad Autónoma de Madrid, 28023 Madrid, Spain; (J.V.L.-H.); (R.L.T.)
- Motion in Brains Research Group, Institute of Neuroscience and Sciences of the Movement (INCIMOV), Centro Superior de Estudios Universitarios La Salle, Universidad Autónoma de Madrid, 28023 Madrid, Spain;
| | - Roy La Touche
- Departamento de Fisioterapia, Centro Superior de Estudios Universitarios La Salle, Universidad Autónoma de Madrid, 28023 Madrid, Spain; (J.V.L.-H.); (R.L.T.)
- Motion in Brains Research Group, Institute of Neuroscience and Sciences of the Movement (INCIMOV), Centro Superior de Estudios Universitarios La Salle, Universidad Autónoma de Madrid, 28023 Madrid, Spain;
- Instituto de Neurociencia y Dolor Craneofacial (INDCRAN), 28008 Madrid, Spain
- Instituto de Investigación Sanitaria del Hospital Universitario La Paz (IdiPAZ), 28029 Madrid, Spain
| |
Collapse
|
20
|
Schween R, Langsdorf L, Taylor JA, Hegele M. How different effectors and action effects modulate the formation of separate motor memories. Sci Rep 2019; 9:17040. [PMID: 31745122 PMCID: PMC6864246 DOI: 10.1038/s41598-019-53543-1] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/14/2019] [Accepted: 11/04/2019] [Indexed: 12/20/2022] Open
Abstract
Humans can operate a variety of modern tools, which are often associated with different visuomotor transformations. Studies investigating this ability have shown that separate motor memories can be acquired implicitly when different sensorimotor transformations are associated with distinct (intended) postures or explicitly when abstract contextual cues are leveraged by aiming strategies. It still remains unclear how different transformations are remembered implicitly when postures are similar. We investigated whether features of planning to manipulate a visual tool, such as its visual identity or the environmental effect intended by its use (i.e. action effect) would enable implicit learning of opposing visuomotor rotations. Results show that neither contextual cue led to distinct implicit motor memories, but that cues only affected implicit adaptation indirectly through generalization around explicit strategies. In contrast, a control experiment where participants practiced opposing transformations with different hands did result in contextualized aftereffects differing between hands across generalization targets. It appears that different (intended) body states are necessary for separate aftereffects to emerge, suggesting that the role of sensory prediction error-based adaptation may be limited to the recalibration of a body model, whereas establishing separate tool models may proceed along a different route.
Collapse
Affiliation(s)
- Raphael Schween
- Justus Liebig University, Department of Psychology and Sport Science, Neuromotor Behavior Laboratory, Section Experimental Sensomotorics, Giessen, Germany.
| | - Lisa Langsdorf
- Justus Liebig University, Department of Psychology and Sport Science, Neuromotor Behavior Laboratory, Section Experimental Sensomotorics, Giessen, Germany
- Center for Mind, Brain and Behavior (CMBB) Universities of Marburg and Giessen, Giessen, Germany
| | - Jordan A Taylor
- Princeton University, Department of Psychology Intelligent Performance and Adaptation Laboratory, Princeton, USA
| | - Mathias Hegele
- Justus Liebig University, Department of Psychology and Sport Science, Neuromotor Behavior Laboratory, Section Experimental Sensomotorics, Giessen, Germany
- Center for Mind, Brain and Behavior (CMBB) Universities of Marburg and Giessen, Giessen, Germany
| |
Collapse
|
21
|
Schween R, Taylor JA, Hegele M. Plan-based generalization shapes local implicit adaptation to opposing visuomotor transformations. J Neurophysiol 2018; 120:2775-2787. [PMID: 30230987 PMCID: PMC6442918 DOI: 10.1152/jn.00451.2018] [Citation(s) in RCA: 19] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The human ability to use different tools demonstrates our capability of forming and maintaining multiple, context-specific motor memories. Experimentally, this has been investigated in dual adaptation, where participants adjust their reaching movements to opposing visuomotor transformations. Adaptation in these paradigms occurs by distinct processes, such as strategies for each transformation or the implicit acquisition of distinct visuomotor mappings. Although distinct, transformation-dependent aftereffects have been interpreted as support for the latter, they could reflect adaptation of a single visuomotor map, which is locally adjusted in different regions of the workspace. Indeed, recent studies suggest that explicit aiming strategies direct where in the workspace implicit adaptation occurs, thus potentially serving as a cue to enable dual adaptation. Disentangling these possibilities is critical to understanding how humans acquire and maintain motor memories for different skills and tools. We therefore investigated generalization of explicit and implicit adaptation to untrained movement directions after participants practiced two opposing cursor rotations, which were associated with the visual display being presented in the left or right half of the screen. Whereas participants learned to compensate for opposing rotations by explicit strategies specific to this visual workspace cue, aftereffects were not cue sensitive. Instead, aftereffects displayed bimodal generalization patterns that appeared to reflect locally limited learning of both transformations. By varying target arrangements and instructions, we show that these patterns are consistent with implicit adaptation that generalizes locally around movement plans associated with opposing visuomotor transformations. Our findings show that strategies can shape implicit adaptation in a complex manner. NEW & NOTEWORTHY Visuomotor dual adaptation experiments have identified contextual cues that enable learning of separate visuomotor mappings, but the underlying representations of learning are unclear. We report that visual workspace separation as a contextual cue enables the compensation of opposing cursor rotations by a combination of explicit and implicit processes: Learners developed context-dependent explicit aiming strategies, whereas an implicit visuomotor map represented dual adaptation independent from arbitrary context cues by local adaptation around the explicit movement plan.
Collapse
Affiliation(s)
- Raphael Schween
- Neuromotor Behavior Laboratory, Department of Sport Science, Justus Liebig University , Giessen , Germany
| | - Jordan A Taylor
- Intelligent Performance and Adaptation Laboratory, Department of Psychology, Princeton University , Princeton, New Jersey
| | - Mathias Hegele
- Neuromotor Behavior Laboratory, Department of Sport Science, Justus Liebig University , Giessen , Germany
| |
Collapse
|