1
|
Guo LL, Niemeier M. Phase-Dependent Visual and Sensorimotor Integration of Features for Grasp Computations before and after Effector Specification. J Neurosci 2024; 44:e2208232024. [PMID: 39019614 PMCID: PMC11326866 DOI: 10.1523/jneurosci.2208-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/08/2023] [Revised: 07/03/2024] [Accepted: 07/10/2024] [Indexed: 07/19/2024] Open
Abstract
The simple act of viewing and grasping an object involves complex sensorimotor control mechanisms that have been shown to vary as a function of multiple object and other task features such as object size, shape, weight, and wrist orientation. However, these features have been mostly studied in isolation. In contrast, given the nonlinearity of motor control, its computations require multiple features to be incorporated concurrently. Therefore, the present study tested the hypothesis that grasp computations integrate multiple task features superadditively in particular when these features are relevant for the same action phase. We asked male and female human participants to reach-to-grasp objects of different shapes and sizes with different wrist orientations. Also, we delayed the movement onset using auditory signals to specify which effector to use. Using electroencephalography and representative dissimilarity analysis to map the time course of cortical activity, we found that grasp computations formed superadditive integrated representations of grasp features during different planning phases of grasping. Shape-by-size representations and size-by-orientation representations occurred before and after effector specification, respectively, and could not be explained by single-feature models. These observations are consistent with the brain performing different preparatory, phase-specific computations; visual object analysis to identify grasp points at abstract visual levels; and downstream sensorimotor preparatory computations for reach-to-grasp trajectories. Our results suggest the brain adheres to the needs of nonlinear motor control for integration. Furthermore, they show that examining the superadditive influence of integrated representations can serve as a novel lens to map the computations underlying sensorimotor control.
Collapse
Affiliation(s)
- Lin Lawrence Guo
- Department of Psychology Scarborough, University of Toronto, Toronto, Ontario M1C1A4, Canada
| | - Matthias Niemeier
- Department of Psychology Scarborough, University of Toronto, Toronto, Ontario M1C1A4, Canada
- Centre for Vision Research, York University, Toronto, Ontario M4N3M6, Canada
| |
Collapse
|
2
|
Fattori P, De Vitis M, Filippini M, Vaccari FE, Diomedi S, Gamberini M, Galletti C. Visual sensitivity at the service of action control in posterior parietal cortex. Front Physiol 2024; 15:1408010. [PMID: 38841208 PMCID: PMC11151461 DOI: 10.3389/fphys.2024.1408010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/27/2024] [Accepted: 04/22/2024] [Indexed: 06/07/2024] Open
Abstract
The posterior parietal cortex (PPC) serves as a crucial hub for the integration of sensory with motor cues related to voluntary actions. Visual input is used in different ways along the dorsomedial and the dorsolateral visual pathways. Here we focus on the dorsomedial pathway and recognize a visual representation at the service of action control. Employing different experimental paradigms applied to behaving monkeys while single neural activity is recorded from the medial PPC (area V6A), we show how plastic visual representation can be, matching the different contexts in which the same object is proposed. We also present data on the exchange between vision and arm actions and highlight how this rich interplay can be used to weight different sensory inputs in order to monitor and correct arm actions online. Indeed, neural activity during reaching or reach-to-grasp actions can be excited or inhibited by visual information, suggesting that the visual perception of action, rather than object recognition, is the most effective factor for area V6A. Also, three-dimensional object shape is encoded dynamically by the neural population, according to the behavioral context of the monkey. Along this line, mirror neuron discharges in V6A indicate the plasticity of visual representation of the graspable objects, that changes according to the context and peaks when the object is the target of one's own action. In other words, object encoding in V6A is a visual encoding for action.
Collapse
Affiliation(s)
- Patrizia Fattori
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Marina De Vitis
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Matteo Filippini
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | | | - Stefano Diomedi
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
- Institute of Cognitive Sciences and Technologies (ISTC), National Research Council (CNR), Padova, Italy
| | - Michela Gamberini
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Claudio Galletti
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| |
Collapse
|
3
|
Maranesi M, Lanzilotto M, Arcuri E, Bonini L. Mixed selectivity in monkey anterior intraparietal area during visual and motor processes. Prog Neurobiol 2024; 236:102611. [PMID: 38604583 DOI: 10.1016/j.pneurobio.2024.102611] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/17/2023] [Revised: 02/29/2024] [Accepted: 04/08/2024] [Indexed: 04/13/2024]
Abstract
Classical studies suggest that the anterior intraparietal area (AIP) contributes to the encoding of specific information such as objects and actions of self and others, through a variety of neuronal classes, such as canonical, motor and mirror neurons. However, these studies typically focused on a single variable, leaving it unclear whether distinct sets of AIP neurons encode a single or multiple sources of information and how multimodal coding emerges. Here, we chronically recorded monkey AIP neurons in a variety of tasks and conditions classically employed in separate experiments. Most cells exhibited mixed selectivity for observed objects, executed actions, and observed actions, enhanced when this information came from the monkey's peripersonal working space. In contrast with the classical view, our findings indicate that multimodal coding emerges in AIP from partially-mixed selectivity of individual neurons for a variety of information relevant for planning actions directed to both physical objects and other subjects.
Collapse
Affiliation(s)
- Monica Maranesi
- Department of Medicine and Surgery, University of Parma, Parma 43125, Italy.
| | - Marco Lanzilotto
- Department of Medicine and Surgery, University of Parma, Parma 43125, Italy
| | - Edoardo Arcuri
- Department of Medicine and Surgery, University of Parma, Parma 43125, Italy
| | - Luca Bonini
- Department of Medicine and Surgery, University of Parma, Parma 43125, Italy
| |
Collapse
|
4
|
Gomez MA, Snow JC. How to construct liquid-crystal spectacles to control vision of real-world objects and environments. Behav Res Methods 2024; 56:563-576. [PMID: 36737581 PMCID: PMC10424568 DOI: 10.3758/s13428-023-02059-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/05/2023] [Indexed: 02/05/2023]
Abstract
A major challenge in studying naturalistic vision lies in controlling stimulus and scene viewing time. This is especially the case for studies using real-world objects as stimuli (rather than computerized images) because real objects cannot be "onset" and "offset" in the same way that images can be. Since the late 1980s, one solution to this problem has been to have the observer wear electro-optic spectacles with computer-controlled liquid-crystal lenses that switch between transparent ("open") and translucent ("closed") states. Unfortunately, the commercially available glasses (PLATO Visual Occlusion Spectacles) command a high price tag, the hardware is fragile, and the glasses cannot be customized. This led us to explore how to manufacture liquid-crystal occlusion glasses in our own laboratory. Here, we share the products of our work by providing step-by-step instructions for researchers to design, build, operate, and test liquid-crystal glasses for use in experimental contexts. The glasses can be assembled with minimal technical knowledge using readily available components, and they can be customized for different populations and applications. The glasses are robust, and they can be produced at a fraction of the cost of commercial alternatives. Tests of reliability and temporal accuracy show that the performance of our laboratory prototype was comparable to that of the PLATO glasses. We discuss the results of our work with respect to implications for promoting rigor and reproducibility, potential use cases, comparisons with other liquid-crystal shutter glasses, and how users can find information regarding future updates and developments.
Collapse
Affiliation(s)
- Michael A Gomez
- Department of Psychology, The University of Nevada, Reno, 1664 N. Virginia Street, Reno, NV, USA.
- Psychology Department, Clovis Community College, 10309 N. Willow Ave, Fresno, CA, USA.
| | - Jacqueline C Snow
- Department of Psychology, The University of Nevada, Reno, 1664 N. Virginia Street, Reno, NV, USA.
| |
Collapse
|
5
|
Bufacchi RJ, Battaglia-Mayer A, Iannetti GD, Caminiti R. Cortico-spinal modularity in the parieto-frontal system: A new perspective on action control. Prog Neurobiol 2023; 231:102537. [PMID: 37832714 DOI: 10.1016/j.pneurobio.2023.102537] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2023] [Revised: 08/22/2023] [Accepted: 10/04/2023] [Indexed: 10/15/2023]
Abstract
Classical neurophysiology suggests that the motor cortex (MI) has a unique role in action control. In contrast, this review presents evidence for multiple parieto-frontal spinal command modules that can bypass MI. Five observations support this modular perspective: (i) the statistics of cortical connectivity demonstrate functionally-related clusters of cortical areas, defining functional modules in the premotor, cingulate, and parietal cortices; (ii) different corticospinal pathways originate from the above areas, each with a distinct range of conduction velocities; (iii) the activation time of each module varies depending on task, and different modules can be activated simultaneously; (iv) a modular architecture with direct motor output is faster and less metabolically expensive than an architecture that relies on MI, given the slow connections between MI and other cortical areas; (v) lesions of the areas composing parieto-frontal modules have different effects from lesions of MI. Here we provide examples of six cortico-spinal modules and functions they subserve: module 1) arm reaching, tool use and object construction; module 2) spatial navigation and locomotion; module 3) grasping and observation of hand and mouth actions; module 4) action initiation, motor sequences, time encoding; module 5) conditional motor association and learning, action plan switching and action inhibition; module 6) planning defensive actions. These modules can serve as a library of tools to be recombined when faced with novel tasks, and MI might serve as a recombinatory hub. In conclusion, the availability of locally-stored information and multiple outflow paths supports the physiological plausibility of the proposed modular perspective.
Collapse
Affiliation(s)
- R J Bufacchi
- Neuroscience and Behaviour Laboratory, Istituto Italiano di Tecnologia, Rome, Italy; International Center for Primate Brain Research (ICPBR), Center for Excellence in Brain Science and Intelligence Technology (CEBSIT), Chinese Academy of Sciences (CAS), Shanghai, China
| | - A Battaglia-Mayer
- Department of Physiology and Pharmacology, University of Rome, Sapienza, Italy
| | - G D Iannetti
- Neuroscience and Behaviour Laboratory, Istituto Italiano di Tecnologia, Rome, Italy; Department of Neuroscience, Physiology and Pharmacology, University College London (UCL), London, UK
| | - R Caminiti
- Neuroscience and Behaviour Laboratory, Istituto Italiano di Tecnologia, Rome, Italy.
| |
Collapse
|
6
|
Pomper JK, Shams M, Wen S, Bunjes F, Thier P. Non-shared coding of observed and executed actions prevails in macaque ventral premotor mirror neurons. eLife 2023; 12:e77513. [PMID: 37458338 PMCID: PMC10411969 DOI: 10.7554/elife.77513] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2022] [Accepted: 07/14/2023] [Indexed: 08/10/2023] Open
Abstract
According to the mirror mechanism the discharge of F5 mirror neurons of a monkey observing another individual performing an action is a motor representation of the observed action that may serve to understand or learn from the action. This hypothesis, if strictly interpreted, requires mirror neurons to exhibit an action tuning that is shared between action observation and execution. Due to insufficient data it remains contentious if this requirement is met. To fill in the gaps, we conducted an experiment in which identical objects had to be manipulated in three different ways in order to serve distinct action goals. Using three methods, including cross-task classification, we found that at most time points F5 mirror neurons did not encode observed actions with the same code underlying action execution. However, in about 20% of neurons there were time periods with a shared code. These time periods formed a distinct cluster and cannot be considered a product of chance. Population classification yielded non-shared coding for observed actions in the whole population, which was at times optimal and consistently better than shared coding in differentially selected subpopulations. These results support the hypothesis of a representation of observed actions based on a strictly defined mirror mechanism only for small subsets of neurons and only under the assumption of time-resolved readout. Considering alternative concepts and recent findings, we propose that during observation mirror neurons represent the process of a goal pursuit from the observer's viewpoint. Whether the observer's goal pursuit, in which the other's action goal becomes the observer's action goal, or the other's goal pursuit is represented remains to be clarified. In any case, it may allow the observer to use expectations associated with a goal pursuit to directly intervene in or learn from another's action.
Collapse
Affiliation(s)
- Jörn K Pomper
- Cognitive Neurology Laboratory, Hertie Institute for Clinical Brain Research, University of TübingenTübingenGermany
- Department of Neurology & Stroke, Hertie Institute for Clinical Brain Research, University of TübingenTübingenGermany
| | - Mohammad Shams
- Cognitive Neurology Laboratory, Hertie Institute for Clinical Brain Research, University of TübingenTübingenGermany
- Graduate Training Centre of Neuroscience, International Max Planck Research School, University of Tübingen, 72076 , GermanyTübingenGermany
- Department of Psychology, York UniversityTorontoCanada
| | - Shengjun Wen
- Cognitive Neurology Laboratory, Hertie Institute for Clinical Brain Research, University of TübingenTübingenGermany
- Graduate Training Centre of Neuroscience, International Max Planck Research School, University of Tübingen, 72076 , GermanyTübingenGermany
| | - Friedemann Bunjes
- Cognitive Neurology Laboratory, Hertie Institute for Clinical Brain Research, University of TübingenTübingenGermany
| | - Peter Thier
- Cognitive Neurology Laboratory, Hertie Institute for Clinical Brain Research, University of TübingenTübingenGermany
| |
Collapse
|
7
|
Guan C, Aflalo T, Kadlec K, Gámez de Leon J, Rosario ER, Bari A, Pouratian N, Andersen RA. Decoding and geometry of ten finger movements in human posterior parietal cortex and motor cortex. J Neural Eng 2023; 20:036020. [PMID: 37160127 PMCID: PMC10209510 DOI: 10.1088/1741-2552/acd3b1] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Revised: 03/24/2023] [Accepted: 05/09/2023] [Indexed: 05/11/2023]
Abstract
Objective. Enable neural control of individual prosthetic fingers for participants with upper-limb paralysis.Approach. Two tetraplegic participants were each implanted with a 96-channel array in the left posterior parietal cortex (PPC). One of the participants was additionally implanted with a 96-channel array near the hand knob of the left motor cortex (MC). Across tens of sessions, we recorded neural activity while the participants attempted to move individual fingers of the right hand. Offline, we classified attempted finger movements from neural firing rates using linear discriminant analysis with cross-validation. The participants then used the neural classifier online to control individual fingers of a brain-machine interface (BMI). Finally, we characterized the neural representational geometry during individual finger movements of both hands.Main Results. The two participants achieved 86% and 92% online accuracy during BMI control of the contralateral fingers (chance = 17%). Offline, a linear decoder achieved ten-finger decoding accuracies of 70% and 66% using respective PPC recordings and 75% using MC recordings (chance = 10%). In MC and in one PPC array, a factorized code linked corresponding finger movements of the contralateral and ipsilateral hands.Significance. This is the first study to decode both contralateral and ipsilateral finger movements from PPC. Online BMI control of contralateral fingers exceeded that of previous finger BMIs. PPC and MC signals can be used to control individual prosthetic fingers, which may contribute to a hand restoration strategy for people with tetraplegia.
Collapse
Affiliation(s)
- Charles Guan
- California Institute of Technology, Pasadena, CA, United States of America
| | - Tyson Aflalo
- California Institute of Technology, Pasadena, CA, United States of America
- T&C Chen Brain-Machine Interface Center at Caltech, Pasadena, CA, United States of America
| | - Kelly Kadlec
- California Institute of Technology, Pasadena, CA, United States of America
| | | | - Emily R Rosario
- Casa Colina Hospital and Centers for Healthcare, Pomona, CA, United States of America
| | - Ausaf Bari
- David Geffen School of Medicine at UCLA, Los Angeles, CA, United States of America
| | - Nader Pouratian
- University of Texas Southwestern Medical Center, Dallas, TX, United States of America
| | - Richard A Andersen
- California Institute of Technology, Pasadena, CA, United States of America
- T&C Chen Brain-Machine Interface Center at Caltech, Pasadena, CA, United States of America
| |
Collapse
|
8
|
Marciniak Dg Agra K, Dg Agra P. F = ma. Is the macaque brain Newtonian? Cogn Neuropsychol 2023; 39:376-408. [PMID: 37045793 DOI: 10.1080/02643294.2023.2191843] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 04/14/2023]
Abstract
Intuitive Physics, the ability to anticipate how the physical events involving mass objects unfold in time and space, is a central component of intelligent systems. Intuitive physics is a promising tool for gaining insight into mechanisms that generalize across species because both humans and non-human primates are subject to the same physical constraints when engaging with the environment. Physical reasoning abilities are widely present within the animal kingdom, but monkeys, with acute 3D vision and a high level of dexterity, appreciate and manipulate the physical world in much the same way humans do.
Collapse
Affiliation(s)
- Karolina Marciniak Dg Agra
- The Rockefeller University, Laboratory of Neural Circuits, New York, NY, USA
- Center for Brain, Minds and Machines, Cambridge, MA, USA
| | - Pedro Dg Agra
- The Rockefeller University, Laboratory of Neural Circuits, New York, NY, USA
- Center for Brain, Minds and Machines, Cambridge, MA, USA
| |
Collapse
|
9
|
Varley TF, Sporns O, Schaffelhofer S, Scherberger H, Dann B. Information-processing dynamics in neural networks of macaque cerebral cortex reflect cognitive state and behavior. Proc Natl Acad Sci U S A 2023; 120:e2207677120. [PMID: 36603032 PMCID: PMC9926243 DOI: 10.1073/pnas.2207677120] [Citation(s) in RCA: 12] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/03/2022] [Accepted: 11/29/2022] [Indexed: 01/06/2023] Open
Abstract
One of the essential functions of biological neural networks is the processing of information. This includes everything from processing sensory information to perceive the environment, up to processing motor information to interact with the environment. Due to methodological limitations, it has been historically unclear how information processing changes during different cognitive or behavioral states and to what extent information is processed within or between the network of neurons in different brain areas. In this study, we leverage recent advances in the calculation of information dynamics to explore neural-level processing within and between the frontoparietal areas AIP, F5, and M1 during a delayed grasping task performed by three macaque monkeys. While information processing was high within all areas during all cognitive and behavioral states of the task, interareal processing varied widely: During visuomotor transformation, AIP and F5 formed a reciprocally connected processing unit, while no processing was present between areas during the memory period. Movement execution was processed globally across all areas with predominance of processing in the feedback direction. Furthermore, the fine-scale network structure reconfigured at the neuron level in response to different grasping conditions, despite no differences in the overall amount of information present. These results suggest that areas dynamically form higher-order processing units according to the cognitive or behavioral demand and that the information-processing network is hierarchically organized at the neuron level, with the coarse network structure determining the behavioral state and finer changes reflecting different conditions.
Collapse
Affiliation(s)
- Thomas F. Varley
- Department of Psychological & Brain Sciences, Indiana University47405-7007, Bloomington, IN
- School of Informatics, Computing, and Engineering, Indiana University47405-7007, Bloomington, IN
| | - Olaf Sporns
- Department of Psychological & Brain Sciences, Indiana University47405-7007, Bloomington, IN
| | - Stefan Schaffelhofer
- Neurobiology Laboratory, German Primate Center37077, Goettingen, Germany
- Faculty of Biology and Psychology, University of Goettingen37073, Goettingen, Germany
| | - Hansjörg Scherberger
- Neurobiology Laboratory, German Primate Center37077, Goettingen, Germany
- Faculty of Biology and Psychology, University of Goettingen37073, Goettingen, Germany
| | - Benjamin Dann
- Neurobiology Laboratory, German Primate Center37077, Goettingen, Germany
| |
Collapse
|
10
|
Breveglieri R, Borgomaneri S, Filippini M, Tessari A, Galletti C, Davare M, Fattori P. Complementary contribution of the medial and lateral human parietal cortex to grasping: a repetitive TMS study. Cereb Cortex 2022; 33:5122-5134. [PMID: 36245221 PMCID: PMC10152058 DOI: 10.1093/cercor/bhac404] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/17/2022] [Revised: 08/13/2022] [Accepted: 09/15/2022] [Indexed: 11/14/2022] Open
Abstract
Abstract
The dexterous control of our grasping actions relies on the cooperative activation of many brain areas. In the parietal lobe, 2 grasp-related areas collaborate to orchestrate an accurate grasping action: dorsolateral area AIP and dorsomedial area V6A. Single-cell recordings in monkeys and fMRI studies in humans have suggested that both these areas specify grip aperture and wrist orientation, but encode these grasping parameters differently, depending on the context. To elucidate the causal role of phAIP and hV6A, we stimulated these areas, while participants were performing grasping actions (unperturbed grasping). rTMS over phAIP impaired the wrist orientation process, whereas stimulation over hV6A impaired grip aperture encoding. In a small percentage of trials, an unexpected reprogramming of grip aperture or wrist orientation was required (perturbed grasping). In these cases, rTMS over hV6A or over phAIP impaired reprogramming of both grip aperture and wrist orientation. These results represent the first direct demonstration of a different encoding of grasping parameters by 2 grasp-related parietal areas.
Collapse
Affiliation(s)
- Rossella Breveglieri
- University of Bologna Department of Biomedical and Neuromotor Sciences, , 40126 Bologna , Italy
| | - Sara Borgomaneri
- University of Bologna Center for studies and research in Cognitive Neuroscience, , 47521 Cesena , Italy
- IRCCS Santa Lucia Foundation , 00179 Rome , Italy
| | - Matteo Filippini
- University of Bologna Department of Biomedical and Neuromotor Sciences, , 40126 Bologna , Italy
| | - Alessia Tessari
- University of Bologna Department of Psychology, , 40127 Bologna , Italy
| | - Claudio Galletti
- University of Bologna Department of Biomedical and Neuromotor Sciences, , 40126 Bologna , Italy
| | - Marco Davare
- Faculty of Life Sciences and Medicine, King's College London, SE1 1UL London, United Kingdom
| | - Patrizia Fattori
- University of Bologna Department of Biomedical and Neuromotor Sciences, , 40126 Bologna , Italy
- University of Bologna Alma Mater Research Institute For Human-Centered Artificial Intelligence (Alma Human AI), , Bologna , Italy
| |
Collapse
|
11
|
Ganguly K, Khanna P, Morecraft RJ, Lin DJ. Modulation of neural co-firing to enhance network transmission and improve motor function after stroke. Neuron 2022; 110:2363-2385. [PMID: 35926452 PMCID: PMC9366919 DOI: 10.1016/j.neuron.2022.06.024] [Citation(s) in RCA: 13] [Impact Index Per Article: 6.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2022] [Revised: 05/15/2022] [Accepted: 06/28/2022] [Indexed: 01/28/2023]
Abstract
Stroke is a leading cause of disability. While neurotechnology has shown promise for improving upper limb recovery after stroke, efficacy in clinical trials has been variable. Our central thesis is that to improve clinical translation, we need to develop a common neurophysiological framework for understanding how neurotechnology alters network activity. Our perspective discusses principles for how motor networks, both healthy and those recovering from stroke, subserve reach-to-grasp movements. We focus on neural processing at the resolution of single movements, the timescale at which neurotechnologies are applied, and discuss how this activity might drive long-term plasticity. We propose that future studies should focus on cross-area communication and bridging our understanding of timescales ranging from single trials within a session to across multiple sessions. We hope that this perspective establishes a combined path forward for preclinical and clinical research with the goal of more robust clinical translation of neurotechnology.
Collapse
Affiliation(s)
- Karunesh Ganguly
- Department of Neurology, Weill Institute for Neuroscience, University of California San Francisco, San Francisco, CA, USA; Neurology Service, SFVAHCS, San Francisco, CA, USA.
| | - Preeya Khanna
- Department of Neurology, Weill Institute for Neuroscience, University of California San Francisco, San Francisco, CA, USA; Neurology Service, SFVAHCS, San Francisco, CA, USA
| | - Robert J Morecraft
- Laboratory of Neurological Sciences, Division of Basic Biomedical Sciences, Sanford School of Medicine, The University of South Dakota, Vermillion, SD 57069, USA
| | - David J Lin
- Center for Neurotechnology and Neurorecovery, Division of Neurocritical Care and Emergency Neurology, Department of Neurology, Massachusetts General Hospital, Boston, MA, USA; Center for Neurorestoration and Neurotechnology, Rehabilitation R&D Service, Providence VA Medical Center, Providence, RI, USA
| |
Collapse
|
12
|
Liang Q, Li J, Zheng S, Liao J, Huang R. Dynamic Causal Modelling of Hierarchical Planning. Neuroimage 2022; 258:119384. [PMID: 35709949 DOI: 10.1016/j.neuroimage.2022.119384] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/02/2022] [Accepted: 06/12/2022] [Indexed: 11/16/2022] Open
Abstract
Hierarchical planning (HP) is a strategy that optimizes the planning by storing the steps towards the goal (lower-level planning) into subgoals (higher-level planning). In the framework of model-based reinforcement learning, HP requires the computation through the transition value between higher-level hierarchies. Previous study identified the dmPFC, PMC and SPL were involved in the computation process of HP respectively. However, it is still unclear about how these regions interaction with each other to support the computation in HP, which could deepen our understanding about the implementation of plan algorithm in hierarchical environment. To address this question, we conducted an fMRI experiment using a virtual subway navigation task. We identified the activity of the dmPFC, premotor cortex (PMC) and superior parietal lobe (SPL) with general linear model (GLM) in HP. Then, Dynamic Causal Modelling (DCM) was performed to quantify the influence of the higher- and lower-planning on the connectivity between the brain areas identified by the GLM. The strongest modulation effect of the higher-level planning was found on the dmPFC→right PMC connection. Furthermore, using Parametric Empirical Bayes (PEB), we found the modulation of higher-level planning on the dmPFC→right PMC and right PMC→SPL connections could explain the individual difference of the response time. We conclude that the dmPFC-related connectivity takes the response to the higher-level planning, while the PMC acts as the bridge between the higher-level planning to behavior outcome.
Collapse
Affiliation(s)
- Qunjun Liang
- School of Psychology, Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, Ministry of Education Key Laboratory of Brain Cognition and Educational Science, South China Normal University, Guangzhou, China
| | - Jinhui Li
- School of Psychology, Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, Ministry of Education Key Laboratory of Brain Cognition and Educational Science, South China Normal University, Guangzhou, China
| | - Senning Zheng
- School of Psychology, Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, Ministry of Education Key Laboratory of Brain Cognition and Educational Science, South China Normal University, Guangzhou, China
| | - Jiajun Liao
- School of Psychology, Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, Ministry of Education Key Laboratory of Brain Cognition and Educational Science, South China Normal University, Guangzhou, China
| | - Ruiwang Huang
- School of Psychology, Center for Studies of Psychological Application, Guangdong Key Laboratory of Mental Health and Cognitive Science, Ministry of Education Key Laboratory of Brain Cognition and Educational Science, South China Normal University, Guangzhou, China..
| |
Collapse
|
13
|
Yan Y, Sobinov AR, Bensmaia SJ. Prehension kinematics in humans and macaques. J Neurophysiol 2022; 127:1669-1678. [PMID: 35642848 DOI: 10.1152/jn.00522.2021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
Non-human primates, especially rhesus macaques, have been a dominant model to study sensorimotor control of the upper limbs. Indeed, human and macaques have similar hands and homologous neural circuits to mediate manual behavior. However, few studies have systematically and quantitatively compared the manual behaviors of the two species. Such comparison is critical for assessing the validity of using the macaque sensorimotor system as a model of its human counterpart. In this study, we systematically compared the prehensile behaviors of humans and rhesus macaques using an identical experimental setup. We found human and macaque prehension kinematics to be generally similar with a few subtle differences. While the structure of the pre-shaping hand postures is similar in humans and macaques, human postures are more object-specific and human joints are less intercorrelated. Conversely, monkeys demonstrate more stereotypical pre-shaping behaviors that are common across all objects and more variability in their postures across repeated presentations of the same object. Despite these subtle differences in manual behavior between humans and monkeys, our results bolster the use of the macaque model to understand the neural mechanisms of manual dexterity in humans.
Collapse
Affiliation(s)
- Yuke Yan
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, United States.,Neuroscience Institute, University of Chicago, Chicago, IL, United States
| | - Anton R Sobinov
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, United States.,Neuroscience Institute, University of Chicago, Chicago, IL, United States
| | - Sliman J Bensmaia
- Committee on Computational Neuroscience, University of Chicago, Chicago, IL, United States.,Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, United States.,Neuroscience Institute, University of Chicago, Chicago, IL, United States
| |
Collapse
|
14
|
Merchant SHI, Wu T, Hallett M. Diagnostic Neurophysiologic Biomarkers for
Task‐Specific
Dystonia. Mov Disord Clin Pract 2022; 9:468-472. [PMID: 35586528 PMCID: PMC9092748 DOI: 10.1002/mdc3.13448] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/21/2022] [Revised: 02/28/2022] [Accepted: 03/26/2022] [Indexed: 11/09/2022] Open
Abstract
Background Task-specific dystonia (TSD) is a challenging clinical diagnosis with no objective diagnostic biomarkers. Objective The objective of this study was to test 2 neurophysiologic variables using transcranial magnetic stimulation as potential diagnostic biomarkers for TSD. Methods We tested (1) cortical silent period (CSP) and (2) dorsal inferior parietal lobule-motor cortex (dIPL-M1) physiologic connectivity in 9 patients with the writer's cramp form of TSD and 12 healthy volunteers on 2 separate sessions. Results CSP was significantly prolonged (P < 0.0001) in TSD and could classify TSD with high sensitivity and specificity with areas under the receiver operating characteristic curve (AUCs) = 0.94 and 0.90, respectively, for 2 separate sessions with an intraclass correlation = 0.79. dIPL-M1 interaction was notable for significant motor cortical inhibition in TSD compared with facilitation in healthy subjects (P < 0.0001) and could classify TSD with high sensitivity and specificity with AUCs = 0.96 and 0.86, respectively. Conclusion CSP and dIPL-M1 physiologic connectivity can classify TSD with high sensitivity, specificity, reproducibility, and reliability.
Collapse
Affiliation(s)
| | - Tianxia Wu
- National Institute of Neurological Disorders and Stroke National Institute of Health Bethesda MD USA
| | - Mark Hallett
- National Institute of Neurological Disorders and Stroke National Institute of Health Bethesda MD USA
| |
Collapse
|
15
|
Pandarinath C, Bensmaia SJ. The science and engineering behind sensitized brain-controlled bionic hands. Physiol Rev 2022; 102:551-604. [PMID: 34541898 PMCID: PMC8742729 DOI: 10.1152/physrev.00034.2020] [Citation(s) in RCA: 31] [Impact Index Per Article: 15.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2020] [Revised: 09/07/2021] [Accepted: 09/13/2021] [Indexed: 12/13/2022] Open
Abstract
Advances in our understanding of brain function, along with the development of neural interfaces that allow for the monitoring and activation of neurons, have paved the way for brain-machine interfaces (BMIs), which harness neural signals to reanimate the limbs via electrical activation of the muscles or to control extracorporeal devices, thereby bypassing the muscles and senses altogether. BMIs consist of reading out motor intent from the neuronal responses monitored in motor regions of the brain and executing intended movements with bionic limbs, reanimated limbs, or exoskeletons. BMIs also allow for the restoration of the sense of touch by electrically activating neurons in somatosensory regions of the brain, thereby evoking vivid tactile sensations and conveying feedback about object interactions. In this review, we discuss the neural mechanisms of motor control and somatosensation in able-bodied individuals and describe approaches to use neuronal responses as control signals for movement restoration and to activate residual sensory pathways to restore touch. Although the focus of the review is on intracortical approaches, we also describe alternative signal sources for control and noninvasive strategies for sensory restoration.
Collapse
Affiliation(s)
- Chethan Pandarinath
- Department of Biomedical Engineering, Emory University and Georgia Institute of Technology, Atlanta, Georgia
- Department of Neurosurgery, Emory University, Atlanta, Georgia
| | - Sliman J Bensmaia
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, Illinois
- Committee on Computational Neuroscience, University of Chicago, Chicago, Illinois
- Grossman Institute for Neuroscience, Quantitative Biology, and Human Behavior, University of Chicago, Chicago, Illinois
| |
Collapse
|
16
|
Wandelt SK, Kellis S, Bjånes DA, Pejsa K, Lee B, Liu C, Andersen RA. Decoding grasp and speech signals from the cortical grasp circuit in a tetraplegic human. Neuron 2022; 110:1777-1787.e3. [PMID: 35364014 DOI: 10.1016/j.neuron.2022.03.009] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2021] [Revised: 02/01/2022] [Accepted: 03/08/2022] [Indexed: 02/04/2023]
Abstract
The cortical grasp network encodes planning and execution of grasps and processes spoken and written aspects of language. High-level cortical areas within this network are attractive implant sites for brain-machine interfaces (BMIs). While a tetraplegic patient performed grasp motor imagery and vocalized speech, neural activity was recorded from the supramarginal gyrus (SMG), ventral premotor cortex (PMv), and somatosensory cortex (S1). In SMG and PMv, five imagined grasps were well represented by firing rates of neuronal populations during visual cue presentation. During motor imagery, these grasps were significantly decodable from all brain areas. During speech production, SMG encoded both spoken grasp types and the names of five colors. Whereas PMv neurons significantly modulated their activity during grasping, SMG's neural population broadly encoded features of both motor imagery and speech. Together, these results indicate that brain signals from high-level areas of the human cortex could be used for grasping and speech BMI applications.
Collapse
Affiliation(s)
- Sarah K Wandelt
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA; T&C Chen Brain-Machine Interface Center, California Institute of Technology, Pasadena, CA 91125, USA.
| | - Spencer Kellis
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA; T&C Chen Brain-Machine Interface Center, California Institute of Technology, Pasadena, CA 91125, USA; Department of Neurological Surgery, Keck School of Medicine of USC, Los Angeles, CA 90033, USA; USC Neurorestoration Center, Keck School of Medicine of USC, Los Angeles, CA 90033, USA
| | - David A Bjånes
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA; T&C Chen Brain-Machine Interface Center, California Institute of Technology, Pasadena, CA 91125, USA
| | - Kelsie Pejsa
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA; T&C Chen Brain-Machine Interface Center, California Institute of Technology, Pasadena, CA 91125, USA
| | - Brian Lee
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA; Department of Neurological Surgery, Keck School of Medicine of USC, Los Angeles, CA 90033, USA; USC Neurorestoration Center, Keck School of Medicine of USC, Los Angeles, CA 90033, USA
| | - Charles Liu
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA; Department of Neurological Surgery, Keck School of Medicine of USC, Los Angeles, CA 90033, USA; USC Neurorestoration Center, Keck School of Medicine of USC, Los Angeles, CA 90033, USA; Rancho Los Amigos National Rehabilitation Center, Downey, CA 90242, USA
| | - Richard A Andersen
- Division of Biology and Biological Engineering, California Institute of Technology, Pasadena, CA 91125, USA; T&C Chen Brain-Machine Interface Center, California Institute of Technology, Pasadena, CA 91125, USA
| |
Collapse
|
17
|
Wang T, Chen Y, Cui H. From Parametric Representation to Dynamical System: Shifting Views of the Motor Cortex in Motor Control. Neurosci Bull 2022; 38:796-808. [PMID: 35298779 PMCID: PMC9276910 DOI: 10.1007/s12264-022-00832-x] [Citation(s) in RCA: 10] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/12/2021] [Accepted: 11/29/2021] [Indexed: 11/01/2022] Open
Abstract
In contrast to traditional representational perspectives in which the motor cortex is involved in motor control via neuronal preference for kinetics and kinematics, a dynamical system perspective emerging in the last decade views the motor cortex as a dynamical machine that generates motor commands by autonomous temporal evolution. In this review, we first look back at the history of the representational and dynamical perspectives and discuss their explanatory power and controversy from both empirical and computational points of view. Here, we aim to reconcile the above perspectives, and evaluate their theoretical impact, future direction, and potential applications in brain-machine interfaces.
Collapse
Affiliation(s)
- Tianwei Wang
- Center for Excellence in Brain Science and Intelligent Technology, Institute of Neuroscience, Chinese Academy of Sciences, Shanghai, 200031, China.,Shanghai Center for Brain and Brain-inspired Intelligence Technology, Shanghai, 200031, China.,University of Chinese Academy of Sciences, Beijing, 100049, China
| | - Yun Chen
- Center for Excellence in Brain Science and Intelligent Technology, Institute of Neuroscience, Chinese Academy of Sciences, Shanghai, 200031, China.,Shanghai Center for Brain and Brain-inspired Intelligence Technology, Shanghai, 200031, China.,University of Chinese Academy of Sciences, Beijing, 100049, China
| | - He Cui
- Center for Excellence in Brain Science and Intelligent Technology, Institute of Neuroscience, Chinese Academy of Sciences, Shanghai, 200031, China. .,Shanghai Center for Brain and Brain-inspired Intelligence Technology, Shanghai, 200031, China. .,University of Chinese Academy of Sciences, Beijing, 100049, China.
| |
Collapse
|
18
|
Compartmentalized dynamics within a common multi-area mesoscale manifold represent a repertoire of human hand movements. Neuron 2022; 110:154-174.e12. [PMID: 34678147 PMCID: PMC9701546 DOI: 10.1016/j.neuron.2021.10.002] [Citation(s) in RCA: 14] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/24/2021] [Revised: 07/11/2021] [Accepted: 10/01/2021] [Indexed: 01/07/2023]
Abstract
The human hand is unique in the animal kingdom for unparalleled dexterity, ranging from complex prehension to fine finger individuation. How does the brain represent such a diverse repertoire of movements? We evaluated mesoscale neural dynamics across the human "grasp network," using electrocorticography and dimensionality reduction methods, for a repertoire of hand movements. Strikingly, we found that the grasp network represented both finger and grasping movements alike. Specifically, the manifold characterizing the multi-areal neural covariance structure was preserved during all movements across this distributed network. In contrast, latent neural dynamics within this manifold were surprisingly specific to movement type. Aligning latent activity to kinematics further uncovered distinct submanifolds despite similarities in synergistic coupling of joints between movements. We thus find that despite preserved neural covariance at the distributed network level, mesoscale dynamics are compartmentalized into movement-specific submanifolds; this mesoscale organization may allow flexible switching between a repertoire of hand movements.
Collapse
|
19
|
Scherberger H. Distributed yet compartmentalized neural dynamics of hand actions. Neuron 2022; 110:10-11. [PMID: 34990575 DOI: 10.1016/j.neuron.2021.12.021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
Abstract
In this issue of Neuron,Natraj et al. (2021) demonstrate that finger and hand grasping movements are represented in the human fronto-parietal grasp network in a compartmentalized fashion. The movements are encoded in a distributed network that is preserved across various hand actions. The neural dynamics are specific to particular hand movements, leading to movement-specific submanifolds in the network.
Collapse
Affiliation(s)
- Hansjörg Scherberger
- German Primate Center, 37077 Göttingen, Germany; Department of Biology and Psychology, University of Göttingen, 37077 Göttingen, Germany.
| |
Collapse
|
20
|
Abstract
Traditional brain-machine interfaces decode cortical motor commands to control external devices. These commands are the product of higher-level cognitive processes, occurring across a network of brain areas, that integrate sensory information, plan upcoming motor actions, and monitor ongoing movements. We review cognitive signals recently discovered in the human posterior parietal cortex during neuroprosthetic clinical trials. These signals are consistent with small regions of cortex having a diverse role in cognitive aspects of movement control and body monitoring, including sensorimotor integration, planning, trajectory representation, somatosensation, action semantics, learning, and decision making. These variables are encoded within the same population of cells using structured representations that bind related sensory and motor variables, an architecture termed partially mixed selectivity. Diverse cognitive signals provide complementary information to traditional motor commands to enable more natural and intuitive control of external devices.
Collapse
Affiliation(s)
- Richard A Andersen
- Division of Biology and Biological Engineering and Tianqiao & Chrissy Chen Brain-Machine Interface Center, California Institute of Technology, Pasadena, California 91125, USA;
- USC Neurorestoration Center, Keck School of Medicine of USC, Los Angeles, California 90033, USA
| | - Tyson Aflalo
- Division of Biology and Biological Engineering and Tianqiao & Chrissy Chen Brain-Machine Interface Center, California Institute of Technology, Pasadena, California 91125, USA;
| | - Luke Bashford
- Division of Biology and Biological Engineering and Tianqiao & Chrissy Chen Brain-Machine Interface Center, California Institute of Technology, Pasadena, California 91125, USA;
| | - David Bjånes
- Division of Biology and Biological Engineering and Tianqiao & Chrissy Chen Brain-Machine Interface Center, California Institute of Technology, Pasadena, California 91125, USA;
| | - Spencer Kellis
- Division of Biology and Biological Engineering and Tianqiao & Chrissy Chen Brain-Machine Interface Center, California Institute of Technology, Pasadena, California 91125, USA;
- USC Neurorestoration Center, Keck School of Medicine of USC, Los Angeles, California 90033, USA
- Department of Neurological Surgery, Keck School of Medicine of USC, Los Angeles, California 90033, USA
| |
Collapse
|
21
|
Guo LL, Oghli YS, Frost A, Niemeier M. Multivariate Analysis of Electrophysiological Signals Reveals the Time Course of Precision Grasps Programs: Evidence for Nonhierarchical Evolution of Grasp Control. J Neurosci 2021; 41:9210-9222. [PMID: 34551938 PMCID: PMC8570828 DOI: 10.1523/jneurosci.0992-21.2021] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2021] [Revised: 09/13/2021] [Accepted: 09/16/2021] [Indexed: 11/21/2022] Open
Abstract
Current understanding of the neural processes underlying human grasping suggests that grasp computations involve gradients of higher to lower level representations and, relatedly, visual to motor processes. However, it is unclear whether these processes evolve in a strictly canonical manner from higher to intermediate and to lower levels given that this knowledge importantly relies on functional imaging, which lacks temporal resolution. To examine grasping in fine temporal detail here we used multivariate EEG analysis. We asked participants to grasp objects while controlling the time at which crucial elements of grasp programs were specified. We first specified the orientation with which participants should grasp objects, and only after a delay we instructed participants about which effector to use to grasp, either the right or the left hand. We also asked participants to grasp with both hands because bimanual and left-hand grasping share intermediate-level grasp representations. We observed that grasp programs evolved in a canonical manner from visual representations, which were independent of effectors to motor representations that distinguished between effectors. However, we found that intermediate representations of effectors that partially distinguished between effectors arose after representations that distinguished among all effector types. Our results show that grasp computations do not proceed in a strictly hierarchically canonical fashion, highlighting the importance of the fine temporal resolution of EEG for a comprehensive understanding of human grasp control.SIGNIFICANCE STATEMENT A long-standing assumption of the grasp computations is that grasp representations progress from higher to lower level control in a regular, or canonical, fashion. Here, we combined EEG and multivariate pattern analysis to characterize the temporal dynamics of grasp representations while participants viewed objects and were subsequently cued to execute an unimanual or bimanual grasp. Interrogation of the temporal dynamics revealed that lower level effector representations emerged before intermediate levels of grasp representations, thereby suggesting a partially noncanonical progression from higher to lower and then to intermediate level grasp control.
Collapse
Affiliation(s)
- Lin Lawrence Guo
- Department of Psychology, University of Toronto Scarborough, Toronto, Ontario M1C 1A4, Canada
| | - Yazan Shamli Oghli
- Department of Psychology, University of Toronto Scarborough, Toronto, Ontario M1C 1A4, Canada
| | - Adam Frost
- Department of Psychology, University of Toronto Scarborough, Toronto, Ontario M1C 1A4, Canada
| | - Matthias Niemeier
- Department of Psychology, University of Toronto Scarborough, Toronto, Ontario M1C 1A4, Canada
- Centre for Vision Research, York University, Toronto, Ontario M4N 3M6, Canada
- Vision: Science to Applications, York University, Toronto, Ontario M3J 1P3, Canada
| |
Collapse
|
22
|
Sobinov AR, Bensmaia SJ. The neural mechanisms of manual dexterity. Nat Rev Neurosci 2021; 22:741-757. [PMID: 34711956 DOI: 10.1038/s41583-021-00528-7] [Citation(s) in RCA: 54] [Impact Index Per Article: 18.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 09/21/2021] [Indexed: 01/22/2023]
Abstract
The hand endows us with unparalleled precision and versatility in our interactions with objects, from mundane activities such as grasping to extraordinary ones such as virtuoso pianism. The complex anatomy of the human hand combined with expansive and specialized neuronal control circuits allows a wide range of precise manual behaviours. To support these behaviours, an exquisite sensory apparatus, spanning the modalities of touch and proprioception, conveys detailed and timely information about our interactions with objects and about the objects themselves. The study of manual dexterity provides a unique lens into the sensorimotor mechanisms that endow the nervous system with the ability to flexibly generate complex behaviour.
Collapse
Affiliation(s)
- Anton R Sobinov
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA.,Neuroscience Institute, University of Chicago, Chicago, IL, USA
| | - Sliman J Bensmaia
- Department of Organismal Biology and Anatomy, University of Chicago, Chicago, IL, USA. .,Neuroscience Institute, University of Chicago, Chicago, IL, USA. .,Committee on Computational Neuroscience, University of Chicago, Chicago, IL, USA.
| |
Collapse
|
23
|
Orban GA, Sepe A, Bonini L. Parietal maps of visual signals for bodily action planning. Brain Struct Funct 2021; 226:2967-2988. [PMID: 34508272 PMCID: PMC8541987 DOI: 10.1007/s00429-021-02378-6] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2021] [Accepted: 09/01/2021] [Indexed: 12/24/2022]
Abstract
The posterior parietal cortex (PPC) has long been understood as a high-level integrative station for computing motor commands for the body based on sensory (i.e., mostly tactile and visual) input from the outside world. In the last decade, accumulating evidence has shown that the parietal areas not only extract the pragmatic features of manipulable objects, but also subserve sensorimotor processing of others’ actions. A paradigmatic case is that of the anterior intraparietal area (AIP), which encodes the identity of observed manipulative actions that afford potential motor actions the observer could perform in response to them. On these bases, we propose an AIP manipulative action-based template of the general planning functions of the PPC and review existing evidence supporting the extension of this model to other PPC regions and to a wider set of actions: defensive and locomotor actions. In our model, a hallmark of PPC functioning is the processing of information about the physical and social world to encode potential bodily actions appropriate for the current context. We further extend the model to actions performed with man-made objects (e.g., tools) and artifacts, because they become integral parts of the subject’s body schema and motor repertoire. Finally, we conclude that existing evidence supports a generally conserved neural circuitry that transforms integrated sensory signals into the variety of bodily actions that primates are capable of preparing and performing to interact with their physical and social world.
Collapse
Affiliation(s)
- Guy A Orban
- Department of Medicine and Surgery, University of Parma, via Volturno 39/E, 43125, Parma, Italy.
| | - Alessia Sepe
- Department of Medicine and Surgery, University of Parma, via Volturno 39/E, 43125, Parma, Italy
| | - Luca Bonini
- Department of Medicine and Surgery, University of Parma, via Volturno 39/E, 43125, Parma, Italy.
| |
Collapse
|
24
|
Lega C, Chelazzi L, Cattaneo L. Two Distinct Systems Represent Contralateral and Ipsilateral Sensorimotor Processes in the Human Premotor Cortex: A Dense TMS Mapping Study. Cereb Cortex 2021; 30:2250-2266. [PMID: 31828296 DOI: 10.1093/cercor/bhz237] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2019] [Revised: 08/19/2019] [Accepted: 09/13/2019] [Indexed: 11/12/2022] Open
Abstract
Animal brains contain behaviorally committed representations of the surrounding world, which integrate sensory and motor information. In primates, sensorimotor mechanisms reside in part in the premotor cortex (PM), where sensorimotor neurons are topographically clustered according to functional specialization. Detailed functional cartography of the human PM is still under investigation. We explored the topographic distribution of spatially dependent sensorimotor functions in healthy volunteers performing left or right, hand or foot, responses to visual cues presented in the left or right hemispace, thus combining independently stimulus side, effector side, and effector type. Event-related transcranial magnetic stimulation was applied to single spots of a dense grid of 10 points on the participants' left hemiscalp, covering the whole PM. Results showed: (1) spatially segregated hand and foot representations, (2) focal representations of contralateral cues and movements in the dorsal PM, and (3) distributed representations of ipsilateral cues and movements in the ventral and dorso-medial PM. The present novel causal information indicates that (1) the human PM is somatotopically organized and (2) the left PM contains sensory-motor representations of both hemispaces and of both hemibodies, but the hemispace and hemibody contralateral to the PM are mapped on a distinct, nonoverlapping cortical region compared to the ipsilateral ones.
Collapse
Affiliation(s)
- Carlotta Lega
- Department of Neuroscience, Biomedicine and Movement, University of Verona, Verona, Italy
| | - Leonardo Chelazzi
- Department of Neuroscience, Biomedicine and Movement, University of Verona, Verona, Italy.,Italian Institute of Neuroscience, Section of Verona, Verona, Italy
| | - Luigi Cattaneo
- Department of Neuroscience, Biomedicine and Movement, University of Verona, Verona, Italy.,Italian Institute of Neuroscience, Section of Verona, Verona, Italy
| |
Collapse
|
25
|
Giarrocco F, Averbeck B. Organization of Parieto-Prefrontal and Temporo-Prefrontal Networks in the Macaque. J Neurophysiol 2021; 126:1289-1309. [PMID: 34379536 DOI: 10.1152/jn.00092.2021] [Citation(s) in RCA: 9] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/22/2022] Open
Abstract
The connectivity among architectonically defined areas of the frontal, parietal, and temporal cortex of the macaque has been extensively mapped through tract tracing methods. To investigate the statistical organization underlying this connectivity, and identify its underlying architecture, we performed a hierarchical cluster analysis on 69 cortical areas based on their anatomically defined inputs. We identified 10 frontal, 4 parietal, and 5 temporal hierarchically related sets of areas (clusters), defined by unique sets of inputs and typically composed of anatomically contiguous areas. Across cortex, clusters that share functional properties were linked by dominant information processing circuits in a topographically organized manner that reflects the organization of the main fiber bundles in the cortex. This led to a dorsal-ventral subdivision of the frontal cortex, where dorsal and ventral clusters showed privileged connectivity with parietal and temporal areas, respectively. Ventrally, temporo-frontal circuits encode information to discriminate objects in the environment, their value, emotional properties, and functions such as memory and spatial navigation. Dorsal parieto-frontal circuits encode information for selecting, generating, and monitoring appropriate actions based on visual-spatial and somatosensory information. This organization may reflect evolutionary antecedents, in which the vertebrate pallium, which is the ancestral cortex, was defined by a ventral and lateral olfactory region and a medial hippocampal region.
Collapse
Affiliation(s)
- Franco Giarrocco
- Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland, United States
| | - Bruno Averbeck
- Laboratory of Neuropsychology, National Institute of Mental Health, National Institutes of Health, Bethesda, Maryland, United States
| |
Collapse
|
26
|
Buchwald D, Scherberger H. Visually and Tactually Guided Grasps Lead to Different Neuronal Activity in Non-human Primates. Front Neurosci 2021; 15:679910. [PMID: 34349616 PMCID: PMC8326571 DOI: 10.3389/fnins.2021.679910] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2021] [Accepted: 06/18/2021] [Indexed: 11/13/2022] Open
Abstract
Movements are defining characteristics of all behaviors. Animals walk around, move their eyes to explore the world or touch structures to learn more about them. So far we only have some basic understanding of how the brain generates movements, especially when we want to understand how different areas of the brain interact with each other. In this study we investigated the influence of sensory object information on grasp planning in four different brain areas involved in vision, touch, movement planning, and movement generation in the parietal, somatosensory, premotor and motor cortex. We trained one monkey to grasp objects that he either saw or touched beforehand while continuously recording neural spiking activity with chronically implanted floating multi-electrode arrays. The animal was instructed to sit in the dark and either look at a shortly illuminated object or reach out and explore the object with his hand in the dark before lifting it up. In a first analysis we confirmed that the animal not only memorizes the object in both tasks, but also applies an object-specific grip type, independent of the sensory modality. In the neuronal population, we found a significant difference in the number of tuned units for sensory modalities during grasp planning that persisted into grasp execution. These differences were sufficient to enable a classifier to decode the object and sensory modality in a single trial exclusively from neural population activity. These results give valuable insights in how different brain areas contribute to the preparation of grasp movement and how different sensory streams can lead to distinct neural activity while still resulting in the same action execution.
Collapse
Affiliation(s)
- Daniela Buchwald
- Neurobiology Laboratory, Deutsches Primatenzentrum GmbH, Göttingen, Germany
- Faculty of Biology and Psychology, University of Goettingen, Göttingen, Germany
| | - Hansjörg Scherberger
- Neurobiology Laboratory, Deutsches Primatenzentrum GmbH, Göttingen, Germany
- Faculty of Biology and Psychology, University of Goettingen, Göttingen, Germany
| |
Collapse
|
27
|
Buchwald D, Schaffelhofer S, Dörge M, Dann B, Scherberger H. A Turntable Setup for Testing Visual and Tactile Grasping Movements in Non-human Primates. Front Behav Neurosci 2021; 15:648483. [PMID: 34113241 PMCID: PMC8185519 DOI: 10.3389/fnbeh.2021.648483] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/31/2020] [Accepted: 04/19/2021] [Indexed: 11/13/2022] Open
Abstract
Grasping movements are some of the most common movements primates do every day. They are important for social interactions as well as picking up objects or food. Usually, these grasping movements are guided by vision but proprioceptive and haptic inputs contribute greatly. Since grasping behaviors are common and easy to motivate, they represent an ideal task for understanding the role of different brain areas during planning and execution of complex voluntary movements in primates. For experimental purposes, a stable and repeatable presentation of the same object as well as the variation of objects is important in order to understand the neural control of movement generation. This is even more the case when investigating the role of different senses for movement planning, where objects need to be presented in specific sensory modalities. We developed a turntable setup for non-human primates (macaque monkeys) to investigate visually and tactually guided grasping movements with an option to easily exchange objects. The setup consists of a turntable that can fit six different objects and can be exchanged easily during the experiment to increase the number of presented objects. The object turntable is connected to a stepper motor through a belt system to automate rotation and hence object presentation. By increasing the distance between the turntable and the stepper motor, metallic components of the stepper motor are kept at a distance to the actual recording setup, which allows using a magnetic-based data glove to track hand kinematics. During task execution, the animal sits in the dark and is instructed to grasp the object in front of it. Options to turn on a light above the object allow for visual presentation of the objects, while the object can also remain in the dark for exclusive tactile exploration. A red LED is projected onto the object by a one-way mirror that serves as a grasp cue instruction for the animal to start grasping the object. By comparing kinematic data from the magnetic-based data glove with simultaneously recorded neural signals, this setup enables the systematic investigation of neural population activity involved in the neural control of hand grasping movements.
Collapse
Affiliation(s)
- Daniela Buchwald
- Neuroscience Laboratory, Deutsches Primatenzentrum GmbH, Göttingen, Germany
- Faculty of Biology and Psychology, University of Goettingen, Göttingen, Germany
| | | | - Matthias Dörge
- Neuroscience Laboratory, Deutsches Primatenzentrum GmbH, Göttingen, Germany
| | - Benjamin Dann
- Neuroscience Laboratory, Deutsches Primatenzentrum GmbH, Göttingen, Germany
| | - Hansjörg Scherberger
- Neuroscience Laboratory, Deutsches Primatenzentrum GmbH, Göttingen, Germany
- Faculty of Biology and Psychology, University of Goettingen, Göttingen, Germany
| |
Collapse
|
28
|
Local and system mechanisms for action execution and observation in parietal and premotor cortices. Curr Biol 2021; 31:2819-2830.e4. [PMID: 33984266 PMCID: PMC8279740 DOI: 10.1016/j.cub.2021.04.034] [Citation(s) in RCA: 11] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2020] [Revised: 12/23/2020] [Accepted: 04/14/2021] [Indexed: 11/16/2022]
Abstract
The action observation network (AON) includes a system of brain areas largely shared with action execution in both human and nonhuman primates. Yet temporal and tuning specificities of distinct areas and of physiologically identified neuronal classes in the encoding of self and others’ action remain unknown. We recorded the activity of 355 single units from three crucial nodes of the AON, the anterior intraparietal area (AIP), and premotor areas F5 and F6, while monkeys performed a Go/No-Go grasping task and observed an experimenter performing it. At the system level, during task execution, F6 displays a prevalence of suppressed neurons and signals whether an action has to be performed, whereas AIP and F5 share a prevalence of facilitated neurons and remarkable target selectivity; during task observation, F5 stands out for its unique prevalence of facilitated neurons and its stronger and earlier modulation than AIP and F6. By applying unsupervised clustering of spike waveforms, we found distinct cell classes unevenly distributed across areas, with different firing properties and carrying specific visuomotor signals. Broadly spiking neurons exhibited a balanced amount of facilitated and suppressed activity during action execution and observation, whereas narrower spiking neurons showed more mutually facilitated responses during the execution of one’s own and others’ action, particularly in areas AIP and F5. Our findings elucidate the time course of activity and firing properties of neurons in the AON during one’s own and others’ action, from the system level of anatomically distinct areas to the local level of physiologically distinct cell classes. F6 neurons show a prevalence of suppressed activity, encoding whether to act Area F5 and AIP share a prevalence of facilitated neurons and target selectivity Across-areas, waveform-based clustering distinguished three neuronal classes Narrow-spiking neurons exhibit mutual modulation during self and others’ action
Collapse
|
29
|
Fan AWY, Guo LL, Frost A, Whitwell RL, Niemeier M, Cant JS. Grasping of Real-World Objects Is Not Biased by Ensemble Perception. Front Psychol 2021; 12:597691. [PMID: 33912099 PMCID: PMC8071954 DOI: 10.3389/fpsyg.2021.597691] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/21/2020] [Accepted: 03/15/2021] [Indexed: 11/13/2022] Open
Abstract
The visual system is known to extract summary representations of visually similar objects which bias the perception of individual objects toward the ensemble average. Although vision plays a large role in guiding action, less is known about whether ensemble representation is informative for action. Motor behavior is tuned to the veridical dimensions of objects and generally considered resistant to perceptual biases. However, when the relevant grasp dimension is not available or is unconstrained, ensemble perception may be informative to behavior by providing gist information about surrounding objects. In the present study, we examined if summary representations of a surrounding ensemble display influenced grip aperture and orientation when participants reached-to-grasp a central circular target which had an explicit size but importantly no explicit orientation that the visuomotor system could selectively attend to. Maximum grip aperture and grip orientation were not biased by ensemble statistics during grasping, although participants were able to perceive and provide manual estimations of the average size and orientation of the ensemble display. Support vector machine classification of ensemble statistics achieved above-chance classification accuracy when trained on kinematic and electromyography data of the perceptual but not grasping conditions, supporting our univariate findings. These results suggest that even along unconstrained grasping dimensions, visually-guided behaviors toward real-world objects are not biased by ensemble processing.
Collapse
Affiliation(s)
- Annabel Wing-Yan Fan
- Department of Psychology, University of Toronto Scarborough, Toronto, ON, Canada
| | - Lin Lawrence Guo
- Department of Psychology, University of Toronto Scarborough, Toronto, ON, Canada
| | - Adam Frost
- Department of Psychology, University of Toronto Scarborough, Toronto, ON, Canada
| | - Robert L. Whitwell
- The Department of Psychology, The University of British Columbia, Vancouver, BC, Canada
| | - Matthias Niemeier
- Department of Psychology, University of Toronto Scarborough, Toronto, ON, Canada
| | - Jonathan S. Cant
- Department of Psychology, University of Toronto Scarborough, Toronto, ON, Canada
| |
Collapse
|
30
|
Orban GA, Lanzilotto M, Bonini L. From Observed Action Identity to Social Affordances. Trends Cogn Sci 2021; 25:493-505. [PMID: 33745819 DOI: 10.1016/j.tics.2021.02.012] [Citation(s) in RCA: 23] [Impact Index Per Article: 7.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2021] [Revised: 02/24/2021] [Accepted: 02/27/2021] [Indexed: 01/08/2023]
Abstract
Others' observed actions cause continuously changing retinal images, making it challenging to build neural representations of action identity. The monkey anterior intraparietal area (AIP) and its putative human homologue (phAIP) host neurons selective for observed manipulative actions (OMAs). The neuronal activity of both AIP and phAIP allows a stable readout of OMA identity across visual formats, but human neurons exhibit greater invariance and generalize from observed actions to action verbs. These properties stem from the convergence in AIP of superior temporal signals concerning: (i) observed body movements; and (ii) the changes in the body-object relationship. We propose that evolutionarily preserved mechanisms underlie the specification of observed-actions identity and the selection of motor responses afforded by them, thereby promoting social behavior.
Collapse
Affiliation(s)
- G A Orban
- Department of Medicine and Surgery, University of Parma, Parma, Italy
| | - M Lanzilotto
- Department of Psychology, University of Turin, Turin, Italy
| | - L Bonini
- Department of Medicine and Surgery, University of Parma, Parma, Italy.
| |
Collapse
|
31
|
Transient deactivation of dorsal premotor cortex or parietal area 5 impairs feedback control of the limb in macaques. Curr Biol 2021; 31:1476-1487.e5. [PMID: 33592191 DOI: 10.1016/j.cub.2021.01.049] [Citation(s) in RCA: 31] [Impact Index Per Article: 10.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Revised: 01/13/2021] [Accepted: 01/13/2021] [Indexed: 12/20/2022]
Abstract
We can generate goal-directed motor corrections with surprising speed, but their neural basis is poorly understood. Here, we show that temporary cooling of dorsal premotor cortex (PMd) impaired both spatial accuracy and the speed of corrective responses, whereas cooling parietal area 5 (A5) impaired only spatial accuracy. Simulations based on optimal feedback control (OFC) models demonstrated that "deactivation" of the control policy (reduction in feedback gain) and state estimation (reduction in Kalman gain) caused impairments similar to that observed for PMd and A5 cooling, respectively. Furthermore, combined deactivation of both cortical regions led to additive impairments of individual deactivations, whereas reducing the amount of cooling to PMd led to impairments in response speed but not spatial accuracy, both also predicted by OFC models. These results provide causal support that frontoparietal circuits beyond primary somatosensory and motor cortices are involved in generating goal-directed motor corrections.
Collapse
|
32
|
Bencivenga F, Sulpizio V, Tullo MG, Galati G. Assessing the effective connectivity of premotor areas during real vs imagined grasping: a DCM-PEB approach. Neuroimage 2021; 230:117806. [PMID: 33524574 DOI: 10.1016/j.neuroimage.2021.117806] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Revised: 01/20/2021] [Accepted: 01/23/2021] [Indexed: 12/16/2022] Open
Abstract
The parieto-frontal circuit underlying grasping, which requires the serial involvement of the anterior intraparietal area (aIPs) and the ventral premotor cortex (PMv), has been recently extended enlightening the role of the dorsal premotor cortex (PMd). The supplementary motor area (SMA) has been also suggested to encode grip force for grasping actions; furthermore, both PMd and SMA are known to play a crucial role in motor imagery. Here, we aimed at assessing the dynamic couplings between left aIPs, PMv, PMd, SMA and primary motor cortex (M1) by comparing executed and imagined right-hand grasping, using Dynamic Causal Modelling (DCM) and Parametrical Empirical Bayes (PEB) analyses. 24 subjects underwent an fMRI exam (3T) during which they were asked to perform or imagine a grasping movement visually cued by photographs of commonly used objects. We tested whether the two conditions a) exert a modulatory effect on both forward and feedback couplings among our areas of interest, and b) differ in terms of strength and sign of these parameters. Results of the real condition confirmed the serial involvement of aIPs, PMv and M1. PMv also exerted a positive influence on PMd and SMA, but received an inhibitory feedback only from PMd. Our results suggest that a general motor program for grasping is planned by the aIPs-PMv circuit; then, PMd and SMA encode high-level features of the movement. During imagery, the connection strength from aIPs to PMv was weaker and the information flow stopped in PMv; thus, a less complex motor program was planned. Moreover, results suggest that SMA and PMd cooperate to prevent motor execution. In conclusion, the comparison between execution and imagery reveals that during grasping premotor areas dynamically interplay in different ways, depending on task demands.
Collapse
Affiliation(s)
- Federica Bencivenga
- Brain Imaging Laboratory, Department of Psychology, Sapienza University, Rome, Italy; PhD program in Behavioral Neuroscience, Sapienza University, Rome, Italy; Cognitive and Motor Rehabilitation and Neuroimaging Unit, Santa Lucia Foundation (IRCCS Fondazione Santa Lucia), Rome, Italy.
| | - Valentina Sulpizio
- Brain Imaging Laboratory, Department of Psychology, Sapienza University, Rome, Italy; Cognitive and Motor Rehabilitation and Neuroimaging Unit, Santa Lucia Foundation (IRCCS Fondazione Santa Lucia), Rome, Italy
| | - Maria Giulia Tullo
- Brain Imaging Laboratory, Department of Psychology, Sapienza University, Rome, Italy; PhD program in Behavioral Neuroscience, Sapienza University, Rome, Italy; Cognitive and Motor Rehabilitation and Neuroimaging Unit, Santa Lucia Foundation (IRCCS Fondazione Santa Lucia), Rome, Italy
| | - Gaspare Galati
- Brain Imaging Laboratory, Department of Psychology, Sapienza University, Rome, Italy; Cognitive and Motor Rehabilitation and Neuroimaging Unit, Santa Lucia Foundation (IRCCS Fondazione Santa Lucia), Rome, Italy
| |
Collapse
|
33
|
Merchant SHI, Frangos E, Parker J, Bradson M, Wu T, Vial-Undurraga F, Leodori G, Bushnell MC, Horovitz SG, Hallett M, Popa T. The role of the inferior parietal lobule in writer's cramp. Brain 2021; 143:1766-1779. [PMID: 32428227 DOI: 10.1093/brain/awaa138] [Citation(s) in RCA: 18] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/28/2019] [Revised: 03/01/2020] [Accepted: 03/09/2020] [Indexed: 12/28/2022] Open
Abstract
Humans have a distinguishing ability for fine motor control that is subserved by a highly evolved cortico-motor neuronal network. The acquisition of a particular motor skill involves a long series of practice movements, trial and error, adjustment and refinement. At the cortical level, this acquisition begins in the parieto-temporal sensory regions and is subsequently consolidated and stratified in the premotor-motor cortex. Task-specific dystonia can be viewed as a corruption or loss of motor control confined to a single motor skill. Using a multimodal experimental approach combining neuroimaging and non-invasive brain stimulation, we explored interactions between the principal nodes of the fine motor control network in patients with writer's cramp and healthy matched controls. Patients and healthy volunteers underwent clinical assessment, diffusion-weighted MRI for tractography, and functional MRI during a finger tapping task. Activation maps from the task-functional MRI scans were used for target selection and neuro-navigation of the transcranial magnetic stimulation. Single- and double-pulse TMS evaluation included measurement of the input-output recruitment curve, cortical silent period, and amplitude of the motor evoked potentials conditioned by cortico-cortical interactions between premotor ventral (PMv)-motor cortex (M1), anterior inferior parietal lobule (aIPL)-M1, and dorsal inferior parietal lobule (dIPL)-M1 before and after inducing a long term depression-like plastic change to dIPL node with continuous theta-burst transcranial magnetic stimulation in a randomized, sham-controlled design. Baseline dIPL-M1 and aIPL-M1 cortico-cortical interactions were facilitatory and inhibitory, respectively, in healthy volunteers, whereas the interactions were converse and significantly different in writer's cramp. Baseline PMv-M1 interactions were inhibitory and similar between the groups. The dIPL-PMv resting state functional connectivity was increased in patients compared to controls, but no differences in structural connectivity between the nodes were observed. Cortical silent period was significantly prolonged in writer's cramp. Making a long term depression-like plastic change to dIPL node transformed the aIPL-M1 interaction to inhibitory (similar to healthy volunteers) and cancelled the PMv-M1 inhibition only in the writer's cramp group. These findings suggest that the parietal multimodal sensory association region could have an aberrant downstream influence on the fine motor control network in writer's cramp, which could be artificially restored to its normal function.
Collapse
Affiliation(s)
- Shabbir Hussain I Merchant
- National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA.,Department of Neurology, Medical University of South Carolina, Charleston, SC, USA
| | - Eleni Frangos
- National Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, MD, USA
| | - Jacob Parker
- National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
| | - Megan Bradson
- National Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, MD, USA
| | - Tianxia Wu
- National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
| | - Felipe Vial-Undurraga
- National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA.,Facultad de Medicina, Clínica Alemana Universidad del Desarrollo, Santiago, Chile
| | - Giorgio Leodori
- National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA.,IRCCS Neuromed, Pozzilli, IS, Italy
| | - M C Bushnell
- National Center for Complementary and Integrative Health, National Institutes of Health, Bethesda, MD, USA
| | - Silvina G Horovitz
- National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
| | - Mark Hallett
- National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA
| | - Traian Popa
- National Institute of Neurological Disorders and Stroke, National Institutes of Health, Bethesda, MD, USA.,Defitech Chair of Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), Swiss Federal Institute of Technology (EPFL), 1202 Geneva, Switzerland.,Defitech Chair of Clinical Neuroengineering, Center for Neuroprosthetics (CNP) and Brain Mind Institute (BMI), Swiss Federal Institute of Technology Valais (EPFL Valais), Clinique Romande de Réadaptation, 1951 Sion, Switzerland
| |
Collapse
|
34
|
A goal-driven modular neural network predicts parietofrontal neural dynamics during grasping. Proc Natl Acad Sci U S A 2020; 117:32124-32135. [PMID: 33257539 DOI: 10.1073/pnas.2005087117] [Citation(s) in RCA: 39] [Impact Index Per Article: 9.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022] Open
Abstract
One of the primary ways we interact with the world is using our hands. In macaques, the circuit spanning the anterior intraparietal area, the hand area of the ventral premotor cortex, and the primary motor cortex is necessary for transforming visual information into grasping movements. However, no comprehensive model exists that links all steps of processing from vision to action. We hypothesized that a recurrent neural network mimicking the modular structure of the anatomical circuit and trained to use visual features of objects to generate the required muscle dynamics used by primates to grasp objects would give insight into the computations of the grasping circuit. Internal activity of modular networks trained with these constraints strongly resembled neural activity recorded from the grasping circuit during grasping and paralleled the similarities between brain regions. Network activity during the different phases of the task could be explained by linear dynamics for maintaining a distributed movement plan across the network in the absence of visual stimulus and then generating the required muscle kinematics based on these initial conditions in a module-specific way. These modular models also outperformed alternative models at explaining neural data, despite the absence of neural data during training, suggesting that the inputs, outputs, and architectural constraints imposed were sufficient for recapitulating processing in the grasping circuit. Finally, targeted lesioning of modules produced deficits similar to those observed in lesion studies of the grasping circuit, providing a potential model for how brain regions may coordinate during the visually guided grasping of objects.
Collapse
|
35
|
Abstract
Area V4-the focus of this review-is a mid-level processing stage along the ventral visual pathway of the macaque monkey. V4 is extensively interconnected with other visual cortical areas along the ventral and dorsal visual streams, with frontal cortical areas, and with several subcortical structures. Thus, it is well poised to play a broad and integrative role in visual perception and recognition-the functional domain of the ventral pathway. Neurophysiological studies in monkeys engaged in passive fixation and behavioral tasks suggest that V4 responses are dictated by tuning in a high-dimensional stimulus space defined by form, texture, color, depth, and other attributes of visual stimuli. This high-dimensional tuning may underlie the development of object-based representations in the visual cortex that are critical for tracking, recognizing, and interacting with objects. Neurophysiological and lesion studies also suggest that V4 responses are important for guiding perceptual decisions and higher-order behavior.
Collapse
Affiliation(s)
- Anitha Pasupathy
- Department of Biological Structure, University of Washington, Seattle, Washington 98195, USA; ,
- Washington National Primate Research Center, University of Washington, Seattle, Washington 98121, USA
| | - Dina V Popovkina
- Department of Psychology, University of Washington, Seattle, Washington 98105, USA;
| | - Taekjun Kim
- Department of Biological Structure, University of Washington, Seattle, Washington 98195, USA; ,
- Washington National Primate Research Center, University of Washington, Seattle, Washington 98121, USA
| |
Collapse
|
36
|
Wang M, Li G, Jiang S, Wei Z, Hu J, Chen L, Zhang D. Enhancing gesture decoding performance using signals from posterior parietal cortex: a stereo-electroencephalograhy (SEEG) study. J Neural Eng 2020; 17:046043. [DOI: 10.1088/1741-2552/ab9987] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/01/2023]
|
37
|
Jerjian SJ, Sahani M, Kraskov A. Movement initiation and grasp representation in premotor and primary motor cortex mirror neurons. eLife 2020; 9:e54139. [PMID: 32628107 PMCID: PMC7384858 DOI: 10.7554/elife.54139] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/03/2019] [Accepted: 07/06/2020] [Indexed: 11/13/2022] Open
Abstract
Pyramidal tract neurons (PTNs) within macaque rostral ventral premotor cortex (F5) and (M1) provide direct input to spinal circuitry and are critical for skilled movement control. Contrary to initial hypotheses, they can also be active during action observation, in the absence of any movement. A population-level understanding of this phenomenon is currently lacking. We recorded from single neurons, including identified PTNs, in (M1) (n = 187), and F5 (n = 115) as two adult male macaques executed, observed, or withheld (NoGo) reach-to-grasp actions. F5 maintained a similar representation of grasping actions during both execution and observation. In contrast, although many individual M1 neurons were active during observation, M1 population activity was distinct from execution, and more closely aligned to NoGo activity, suggesting this activity contributes to withholding of self-movement. M1 and its outputs may dissociate initiation of movement from representation of grasp in order to flexibly guide behaviour.
Collapse
Affiliation(s)
- Steven Jack Jerjian
- Department of Clinical and Movement Neurosciences, UCL Institute of NeurologyLondonUnited Kingdom
| | - Maneesh Sahani
- Gatsby Computational Neuroscience Unit, University College LondonLondonUnited Kingdom
| | - Alexander Kraskov
- Department of Clinical and Movement Neurosciences, UCL Institute of NeurologyLondonUnited Kingdom
| |
Collapse
|
38
|
Stable readout of observed actions from format-dependent activity of monkey's anterior intraparietal neurons. Proc Natl Acad Sci U S A 2020; 117:16596-16605. [PMID: 32581128 PMCID: PMC7369316 DOI: 10.1073/pnas.2007018117] [Citation(s) in RCA: 18] [Impact Index Per Article: 4.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/01/2022] Open
Abstract
The anterior intraparietal area (AIP) is a crucial hub in the observed manipulative action (OMA) network of primates. While macaques observe manipulative action videos, their AIP neuronal activity robustly encodes first the viewpoint from which the action is observed, then the actor’s body posture, and finally the observed-action identity. Despite the lack of fully invariant OMA-selective single neurons, OMA exemplars could be decoded accurately from the activity of a set of units that maintain stable OMA selectivity despite rescaling their firing rate across formats. We propose that by integrating signals multiplicatively about others’ action and their visual format, the AIP can provide a stable readout of OMA identity at the population level. Humans accurately identify observed actions despite large dynamic changes in their retinal images and a variety of visual presentation formats. A large network of brain regions in primates participates in the processing of others’ actions, with the anterior intraparietal area (AIP) playing a major role in routing information about observed manipulative actions (OMAs) to the other nodes of the network. This study investigated whether the AIP also contributes to invariant coding of OMAs across different visual formats. We recorded AIP neuronal activity from two macaques while they observed videos portraying seven manipulative actions (drag, drop, grasp, push, roll, rotate, squeeze) in four visual formats. Each format resulted from the combination of two actor’s body postures (standing, sitting) and two viewpoints (lateral, frontal). Out of 297 recorded units, 38% were OMA-selective in at least one format. Robust population code for viewpoint and actor’s body posture emerged shortly after stimulus presentation, followed by OMA selectivity. Although we found no fully invariant OMA-selective neuron, we discovered a population code that allowed us to classify action exemplars irrespective of the visual format. This code depends on a multiplicative mixing of signals about OMA identity and visual format, particularly evidenced by a set of units maintaining a relatively stable OMA selectivity across formats despite considerable rescaling of their firing rate depending on the visual specificities of each format. These findings suggest that the AIP integrates format-dependent information and the visual features of others’ actions, leading to a stable readout of observed manipulative action identity.
Collapse
|
39
|
Russo AA, Khajeh R, Bittner SR, Perkins SM, Cunningham JP, Abbott LF, Churchland MM. Neural Trajectories in the Supplementary Motor Area and Motor Cortex Exhibit Distinct Geometries, Compatible with Different Classes of Computation. Neuron 2020; 107:745-758.e6. [PMID: 32516573 DOI: 10.1016/j.neuron.2020.05.020] [Citation(s) in RCA: 77] [Impact Index Per Article: 19.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/28/2019] [Revised: 12/25/2019] [Accepted: 05/11/2020] [Indexed: 12/21/2022]
Abstract
The supplementary motor area (SMA) is believed to contribute to higher order aspects of motor control. We considered a key higher order role: tracking progress throughout an action. We propose that doing so requires population activity to display low "trajectory divergence": situations with different future motor outputs should be distinct, even when present motor output is identical. We examined neural activity in SMA and primary motor cortex (M1) as monkeys cycled various distances through a virtual environment. SMA exhibited multiple response features that were absent in M1. At the single-neuron level, these included ramping firing rates and cycle-specific responses. At the population level, they included a helical population-trajectory geometry with shifts in the occupied subspace as movement unfolded. These diverse features all served to reduce trajectory divergence, which was much lower in SMA versus M1. Analogous population-trajectory geometry, also with low divergence, naturally arose in networks trained to internally guide multi-cycle movement.
Collapse
Affiliation(s)
- Abigail A Russo
- Department of Neuroscience, Columbia University, New York, NY 10027, USA; Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA
| | - Ramin Khajeh
- Department of Neuroscience, Columbia University, New York, NY 10027, USA; Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA; Center for Theoretical Neuroscience, Columbia University, New York, NY 10027, USA
| | - Sean R Bittner
- Department of Neuroscience, Columbia University, New York, NY 10027, USA; Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA; Center for Theoretical Neuroscience, Columbia University, New York, NY 10027, USA
| | - Sean M Perkins
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA; Department of Biomedical Engineering, Columbia University, New York, NY 10027, USA
| | - John P Cunningham
- Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA; Grossman Center for the Statistics of Mind, Columbia University, New York, NY 10027, USA; Center for Theoretical Neuroscience, Columbia University, New York, NY 10027, USA; Department of Statistics, Columbia University, New York, NY 10027, USA
| | - L F Abbott
- Department of Neuroscience, Columbia University, New York, NY 10027, USA; Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA; Grossman Center for the Statistics of Mind, Columbia University, New York, NY 10027, USA; Center for Theoretical Neuroscience, Columbia University, New York, NY 10027, USA; Department of Physiology and Cellular Biophysics, Columbia University Medical Center, New York, NY 10032, USA; Kavli Institute for Brain Science, Columbia University, New York, NY 10027, USA
| | - Mark M Churchland
- Department of Neuroscience, Columbia University, New York, NY 10027, USA; Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY 10027, USA; Grossman Center for the Statistics of Mind, Columbia University, New York, NY 10027, USA; Kavli Institute for Brain Science, Columbia University, New York, NY 10027, USA.
| |
Collapse
|
40
|
Turella L, Rumiati R, Lingnau A. Hierarchical Action Encoding Within the Human Brain. Cereb Cortex 2020; 30:2924-2938. [DOI: 10.1093/cercor/bhz284] [Citation(s) in RCA: 15] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2019] [Revised: 10/22/2019] [Accepted: 10/25/2019] [Indexed: 11/14/2022] Open
Abstract
Abstract
Humans are able to interact with objects with extreme flexibility. To achieve this ability, the brain does not only control specific muscular patterns, but it also needs to represent the abstract goal of an action, irrespective of its implementation. It is debated, however, how abstract action goals are implemented in the brain. To address this question, we used multivariate pattern analysis of functional magnetic resonance imaging data. Human participants performed grasping actions (precision grip, whole hand grip) with two different wrist orientations (canonical, rotated), using either the left or right hand. This design permitted to investigate a hierarchical organization consisting of three levels of abstraction: 1) “concrete action” encoding; 2) “effector-dependent goal” encoding (invariant to wrist orientation); and 3) “effector-independent goal” encoding (invariant to effector and wrist orientation). We found that motor cortices hosted joint encoding of concrete actions and of effector-dependent goals, while the parietal lobe housed a convergence of all three representations, comprising action goals within and across effectors. The left lateral occipito-temporal cortex showed effector-independent goal encoding, but no convergence across the three levels of representation. Our results support a hierarchical organization of action encoding, shedding light on the neural substrates supporting the extraordinary flexibility of human hand behavior.
Collapse
Affiliation(s)
- Luca Turella
- Center for Mind/Brain Sciences—CIMeC, University of Trento, Rovereto 38068, Italy
| | - Raffaella Rumiati
- Scuola Internazionale Superiore di Studi Avanzati (SISSA), Trieste 34136, Italy
| | - Angelika Lingnau
- Center for Mind/Brain Sciences—CIMeC, University of Trento, Rovereto 38068, Italy
- Department of Cognitive Sciences, University of Trento, Rovereto 38068, Italy
- Institute of Psychology, University of Regensburg, Regensburg 93053, Germany
| |
Collapse
|
41
|
Albertini D, Gerbella M, Lanzilotto M, Livi A, Maranesi M, Ferroni CG, Bonini L. Connectional gradients underlie functional transitions in monkey pre-supplementary motor area. Prog Neurobiol 2020; 184:101699. [DOI: 10.1016/j.pneurobio.2019.101699] [Citation(s) in RCA: 13] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2019] [Revised: 09/06/2019] [Accepted: 09/18/2019] [Indexed: 12/15/2022]
|
42
|
Large scale networks for human hand-object interaction: Functionally distinct roles for two premotor regions identified intraoperatively. Neuroimage 2020; 204:116215. [DOI: 10.1016/j.neuroimage.2019.116215] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2019] [Revised: 08/29/2019] [Accepted: 09/19/2019] [Indexed: 11/27/2022] Open
|
43
|
Cortical pattern generation during dexterous movement is input-driven. Nature 2019; 577:386-391. [PMID: 31875851 PMCID: PMC6962553 DOI: 10.1038/s41586-019-1869-9] [Citation(s) in RCA: 140] [Impact Index Per Article: 28.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/15/2018] [Accepted: 10/29/2019] [Indexed: 11/09/2022]
Abstract
Motor cortex controls skilled arm movement by sending temporal patterns of activity to lower motor centers1. Local cortical dynamics are thought to shape these patterns throughout movement execution2–4. External inputs have been implicated in setting the initial state of motor cortex5,6, but they may also have a pattern-generating role. Here, we dissect the contribution of local dynamics and inputs to cortical pattern generation during a prehension task in mice. Perturbing cortex to an aberrant state prevented movement initiation, but after the perturbation was released, cortex either bypassed the normal initial state and immediately generated the pattern that controls reaching, or it failed to generate this pattern. The difference in these two outcomes was likely due to external inputs. We directly investigated the role of inputs by inactivating thalamus; this perturbed cortical activity and disrupted limb kinematics at any stage of the movement. Activation of thalamocortical axon terminals at different frequencies disrupted cortical activity and arm movement in a graded manner. Simultaneous recordings revealed that both thalamic activity and the current state of cortex predicted changes in cortical activity. Thus, the pattern generator for dexterous arm movement is distributed across multiple, strongly-interacting brain regions.
Collapse
|
44
|
Barra B, Badi M, Perich MG, Conti S, Mirrazavi Salehian SS, Moreillon F, Bogaard A, Wurth S, Kaeser M, Passeraub P, Milekovic T, Billard A, Micera S, Capogrosso M. A versatile robotic platform for the design of natural, three-dimensional reaching and grasping tasks in monkeys. J Neural Eng 2019; 17:016004. [PMID: 31597123 DOI: 10.1088/1741-2552/ab4c77] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022]
Abstract
OBJECTIVE Translational studies on motor control and neurological disorders require detailed monitoring of sensorimotor components of natural limb movements in relevant animal models. However, available experimental tools do not provide a sufficiently rich repertoire of behavioral signals. Here, we developed a robotic platform that enables the monitoring of kinematics, interaction forces, and neurophysiological signals during user-defined upper limb tasks for monkeys. APPROACH We configured the platform to position instrumented objects in a three-dimensional workspace and provide an interactive dynamic force-field. MAIN RESULTS We show the relevance of our platform for fundamental and translational studies with three example applications. First, we study the kinematics of natural grasp in response to variable interaction forces. We then show simultaneous and independent encoding of kinematic and forces in single unit intra-cortical recordings from sensorimotor cortical areas. Lastly, we demonstrate the relevance of our platform to develop clinically relevant brain computer interfaces in a kinematically unconstrained motor task. SIGNIFICANCE Our versatile control structure does not depend on the specific robotic arm used and allows for the design and implementation of a variety of tasks that can support both fundamental and translational studies of motor control.
Collapse
Affiliation(s)
- B Barra
- Department of Neuroscience and Movement Science, Platform of Translational Neurosciences, University of Fribourg, Fribourg, Switzerland. Co-first authors
| | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
45
|
Multivariate Analysis of Electrophysiological Signals Reveals the Temporal Properties of Visuomotor Computations for Precision Grips. J Neurosci 2019; 39:9585-9597. [PMID: 31628180 DOI: 10.1523/jneurosci.0914-19.2019] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2019] [Revised: 10/08/2019] [Accepted: 10/15/2019] [Indexed: 11/21/2022] Open
Abstract
The frontoparietal networks underlying grasping movements have been extensively studied, especially using fMRI. Accordingly, whereas much is known about their cortical locus much less is known about the temporal dynamics of visuomotor transformations. Here, we show that multivariate EEG analysis allows for detailed insights into the time course of visual and visuomotor computations of precision grasps. Male and female human participants first previewed one of several objects and, upon its reappearance, reached to grasp it with the thumb and index finger along one of its two symmetry axes. Object shape classifiers reached transient accuracies of 70% at ∼105 ms, especially based on scalp sites over visual cortex, dropping to lower levels thereafter. Grasp orientation classifiers relied on a system of occipital-to-frontal electrodes. Their accuracy rose concurrently with shape classification but ramped up more gradually, and the slope of the classification curve predicted individual reaction times. Further, cross-temporal generalization revealed that dynamic shape representation involved early and late neural generators that reactivated one another. In contrast, grasp computations involved a chain of generators attaining a sustained state about 100 ms before movement onset. Our results reveal the progression of visual and visuomotor representations over the course of planning and executing grasp movements.SIGNIFICANCE STATEMENT Grasping an object requires the brain to perform visual-to-motor transformations of the object's properties. Although much of the neuroanatomic basis of visuomotor transformations has been uncovered, little is known about its time course. Here, we orthogonally manipulated object visual characteristics and grasp orientation, and used multivariate EEG analysis to reveal that visual and visuomotor computations follow similar time courses but display different properties and dynamics.
Collapse
|
46
|
Maranesi M, Bruni S, Livi A, Donnarumma F, Pezzulo G, Bonini L. Differential neural dynamics underling pragmatic and semantic affordance processing in macaque ventral premotor cortex. Sci Rep 2019; 9:11700. [PMID: 31406219 PMCID: PMC6691108 DOI: 10.1038/s41598-019-48216-y] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/04/2019] [Accepted: 07/29/2019] [Indexed: 12/14/2022] Open
Abstract
Premotor neurons play a fundamental role in transforming physical properties of observed objects, such as size and shape, into motor plans for grasping them, hence contributing to “pragmatic” affordance processing. Premotor neurons can also contribute to “semantic” affordance processing, as they can discharge differently even to pragmatically identical objects depending on their behavioural relevance for the observer (i.e. edible or inedible objects). Here, we compared the response of monkey ventral premotor area F5 neurons tested during pragmatic (PT) or semantic (ST) visuomotor tasks. Object presentation responses in ST showed shorter latency and lower object selectivity than in PT. Furthermore, we found a difference between a transient representation of semantic affordances and a sustained representation of pragmatic affordances at both the single neuron and population level. Indeed, responses in ST returned to baseline within 0.5 s whereas in PT they showed the typical sustained visual-to-motor activity during Go trials. In contrast, during No-go trials, the time course of pragmatic and semantic information processing was similar. These findings suggest that premotor cortex generates different dynamics depending on pragmatic and semantic information provided by the context in which the to-be-grasped object is presented.
Collapse
Affiliation(s)
- Monica Maranesi
- Department of Medicine and Surgery, University of Parma, via Volturno 39, 43125, Parma, Italy.
| | - Stefania Bruni
- Department of Medicine and Surgery, University of Parma, via Volturno 39, 43125, Parma, Italy.,Center for Neural Science, New York University, New York, NY, United States of America
| | - Alessandro Livi
- Department of Medicine and Surgery, University of Parma, via Volturno 39, 43125, Parma, Italy.,Department of Neuroscience, Washington University, St. Louis, Missouri, USA
| | - Francesco Donnarumma
- Institute of Cognitive Sciences and Technologies, National Research Council, via S. Martino della Battaglia 44, 00185, Rome, Italy
| | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, via S. Martino della Battaglia 44, 00185, Rome, Italy
| | - Luca Bonini
- Department of Medicine and Surgery, University of Parma, via Volturno 39, 43125, Parma, Italy
| |
Collapse
|
47
|
Battaglia-Mayer A, Caminiti R. Corticocortical Systems Underlying High-Order Motor Control. J Neurosci 2019; 39:4404-4421. [PMID: 30886016 PMCID: PMC6554627 DOI: 10.1523/jneurosci.2094-18.2019] [Citation(s) in RCA: 35] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/15/2018] [Revised: 03/05/2019] [Accepted: 03/08/2019] [Indexed: 12/14/2022] Open
Abstract
Cortical networks are characterized by the origin, destination, and reciprocity of their connections, as well as by the diameter, conduction velocity, and synaptic efficacy of their axons. The network formed by parietal and frontal areas lies at the core of cognitive-motor control because the outflow of parietofrontal signaling is conveyed to the subcortical centers and spinal cord through different parallel pathways, whose orchestration determines, not only when and how movements will be generated, but also the nature of forthcoming actions. Despite intensive studies over the last 50 years, the role of corticocortical connections in motor control and the principles whereby selected cortical networks are recruited by different task demands remain elusive. Furthermore, the synaptic integration of different cortical signals, their modulation by transthalamic loops, and the effects of conduction delays remain challenging questions that must be tackled to understand the dynamical aspects of parietofrontal operations. In this article, we evaluate results from nonhuman primate and selected rodent experiments to offer a viewpoint on how corticocortical systems contribute to learning and producing skilled actions. Addressing this subject is not only of scientific interest but also essential for interpreting the devastating consequences for motor control of lesions at different nodes of this integrated circuit. In humans, the study of corticocortical motor networks is currently based on MRI-related methods, such as resting-state connectivity and diffusion tract-tracing, which both need to be contrasted with histological studies in nonhuman primates.
Collapse
Affiliation(s)
| | - Roberto Caminiti
- Department of Physiology and Pharmacology, University of Rome, Sapienza, 00185 Rome, Italy, and
- Neuroscience and Behavior Laboratory, Istituto Italiano di Tecnologia, 00161 Rome, Italy
| |
Collapse
|
48
|
Valyear KF, Mattos D, Philip BA, Kaufman C, Frey SH. Grasping with a new hand: Improved performance and normalized grasp-selective brain responses despite persistent functional changes in primary motor cortex and low-level sensory and motor impairments. Neuroimage 2019; 190:275-288. [PMID: 28964930 PMCID: PMC5874165 DOI: 10.1016/j.neuroimage.2017.09.052] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2017] [Revised: 09/02/2017] [Accepted: 09/24/2017] [Indexed: 01/26/2023] Open
Abstract
Hand loss can now be reversed through surgical transplantation years or decades after amputation. Remarkably, these patients come to use their new hand to skilfully grasp and manipulate objects. The brain mechanisms that make this possible are unknown. Here we test the hypothesis that the anterior intraparietal cortex (aIPC) - a multimodal region implicated in hand preshaping and error correction during grasping - plays a key role in this compensatory grasp control. Motion capture and fMRI are used to characterize hand kinematics and brain responses during visually guided grasping with a transplanted hand at 26 and 41 months post-transplant in patient DR, a former hand amputee of 13 years. Compared with matched controls, DR shows increasingly normal grasp kinematics paralleled by increasingly robust grasp-selective fMRI responses within the very same brain areas that show grasp-selectivity in controls, including the aIPC, premotor and cerebellar cortices. Paradoxically, over this same time DR exhibits significant limitations in basic sensory and motor functions, and persistent amputation-related functional reorganization of primary motor cortex. Movements of the non-transplanted hand positively activate the ipsilateral primary motor hand area - a functional marker of persistent interhemispheric amputation-related reorganization. Our data demonstrate for the first time that even after more than a decade of living as an amputee the normative functional brain organization governing the control of grasping can be restored. We propose that the aIPC and interconnected premotor and cerebellar cortices enable grasp normalization by compensating for the functional impact of reorganizational changes in primary sensorimotor cortex and targeting errors in regenerating peripheral nerves.
Collapse
Affiliation(s)
- Kenneth F Valyear
- School of Psychology, Bangor University, Bangor, UK; Department of Psychological Sciences, University of Missouri, Columbia, MO, USA.
| | - Daniela Mattos
- Department of Psychological Sciences, University of Missouri, Columbia, MO, USA
| | - Benjamin A Philip
- Department of Psychological Sciences, University of Missouri, Columbia, MO, USA
| | | | - Scott H Frey
- Department of Psychological Sciences, University of Missouri, Columbia, MO, USA.
| |
Collapse
|
49
|
Breveglieri R, Vaccari FE, Bosco A, Gamberini M, Fattori P, Galletti C. Neurons Modulated by Action Execution and Observation in the Macaque Medial Parietal Cortex. Curr Biol 2019; 29:1218-1225.e3. [DOI: 10.1016/j.cub.2019.02.027] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2018] [Revised: 12/21/2018] [Accepted: 02/07/2019] [Indexed: 10/27/2022]
|
50
|
Sharma S, Mantini D, Vanduffel W, Nelissen K. Functional specialization of macaque premotor F5 subfields with respect to hand and mouth movements: A comparison of task and resting-state fMRI. Neuroimage 2019; 191:441-456. [PMID: 30802514 DOI: 10.1016/j.neuroimage.2019.02.045] [Citation(s) in RCA: 16] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2018] [Revised: 02/05/2019] [Accepted: 02/18/2019] [Indexed: 10/27/2022] Open
Abstract
Based on architectonic, tract-tracing or functional criteria, the rostral portion of ventral premotor cortex in the macaque monkey, also termed area F5, has been divided into several subfields. Cytoarchitectonical investigations suggest the existence of three subfields, F5c (convexity), F5p (posterior) and F5a (anterior). Electrophysiological investigations have suggested a gradual dorso-ventral transition from hand- to mouth-dominated motor fields, with F5p and ventral F5c strictly related to hand movements and mouth movements, respectively. The involvement of F5a in this respect, however, has received much less attention. Recently, data-driven resting-state fMRI approaches have also been used to examine the presence of distinct functional fields in macaque ventral premotor cortex. Although these studies have suggested several functional clusters in/near macaque F5, so far the parcellation schemes derived from these clustering methods do not completely retrieve the same level of F5 specialization as suggested by aforementioned invasive techniques. Here, using seed-based resting-state fMRI analyses, we examined the functional connectivity of different F5 seeds with key regions of the hand and face/mouth parieto-frontal-insular motor networks. In addition, we trained monkeys to perform either hand grasping or ingestive mouth movements in the scanner in order to compare resting-state with task-derived functional hand and mouth motor networks. In line with previous single-cell investigations, task-fMRI suggests involvement of F5p, dorsal F5c and F5a in the execution of hand grasping movements, while non-communicative mouth movements yielded particularly pronounced responses in ventral F5c. Corroborating with anatomical tracing data of macaque F5 subfields, seed-based resting-state fMRI suggests a transition from predominant functional correlations with the hand-motor network in F5p to mostly mouth-motor network functional correlations in ventral F5c. Dorsal F5c yielded robust functional correlations with both hand- and mouth-motor networks. In addition, the deepest part of the fundus of the inferior arcuate, corresponding to area 44, displayed a strikingly different functional connectivity profile compared to neighboring F5a, suggesting a different functional specialization for these two neighboring regions.
Collapse
Affiliation(s)
- S Sharma
- Laboratory for Neuro- & Psychophysiology, Department of Neurosciences, KU Leuven, 3000, Leuven, Belgium; Leuven Brain Institute, KU Leuven, 3000, Leuven, Belgium
| | - D Mantini
- Movement Control & Neuroplasticity Research Group, KU Leuven, Leuven, Belgium; Functional Neuroimaging Laboratory, Fondazione Ospedale San Camillo - IRCCS, Venezia, Italy
| | - W Vanduffel
- Laboratory for Neuro- & Psychophysiology, Department of Neurosciences, KU Leuven, 3000, Leuven, Belgium; Leuven Brain Institute, KU Leuven, 3000, Leuven, Belgium; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Charlestown, MA, 02129, USA; Department of Radiology, Harvard Medical School, Boston, MA, 02115, USA
| | - K Nelissen
- Laboratory for Neuro- & Psychophysiology, Department of Neurosciences, KU Leuven, 3000, Leuven, Belgium; Leuven Brain Institute, KU Leuven, 3000, Leuven, Belgium.
| |
Collapse
|