1
|
Schimel M, Kao TC, Hennequin G. When and why does motor preparation arise in recurrent neural network models of motor control? eLife 2024; 12:RP89131. [PMID: 39316044 PMCID: PMC11421851 DOI: 10.7554/elife.89131] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/25/2024] Open
Abstract
During delayed ballistic reaches, motor areas consistently display movement-specific activity patterns prior to movement onset. It is unclear why these patterns arise: while they have been proposed to seed an initial neural state from which the movement unfolds, recent experiments have uncovered the presence and necessity of ongoing inputs during movement, which may lessen the need for careful initialization. Here, we modeled the motor cortex as an input-driven dynamical system, and we asked what the optimal way to control this system to perform fast delayed reaches is. We find that delay-period inputs consistently arise in an optimally controlled model of M1. By studying a variety of network architectures, we could dissect and predict the situations in which it is beneficial for a network to prepare. Finally, we show that optimal input-driven control of neural dynamics gives rise to multiple phases of preparation during reach sequences, providing a novel explanation for experimentally observed features of monkey M1 activity in double reaching.
Collapse
Affiliation(s)
- Marine Schimel
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, United Kingdom
| | - Ta-Chu Kao
- Meta Reality Labs, Burlingame, United States
| | - Guillaume Hennequin
- Computational and Biological Learning Lab, Department of Engineering, University of Cambridge, Cambridge, United Kingdom
| |
Collapse
|
2
|
Zur G, Larry N, Cain M, Lixenberg A, Yarkoni M, Behling S, Joshua M. High-dimensional encoding of movement by single neurons in basal ganglia output. iScience 2024; 27:110667. [PMID: 39290837 PMCID: PMC11406068 DOI: 10.1016/j.isci.2024.110667] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/26/2023] [Revised: 04/08/2024] [Accepted: 08/01/2024] [Indexed: 09/19/2024] Open
Abstract
The substantia nigra pars reticulata (SNpr), an output structure of the basal ganglia, is hypothesized to gate movement execution. Previous studies in the eye movement system focusing mostly on saccades have reported that SNpr neurons are tonically active and either pause or increase their firing during movements, consistent with the gating role. We recorded activity in the SNpr of two monkeys during smooth pursuit and saccadic eye movements. SNpr neurons exhibited highly diverse reaction patterns during pursuit, including frequent increases and decreases in firing rate, uncorrelated responses in different movement directions and in reward conditions that resulted in the high dimensional activity of single neurons. These diverse temporal patterns surpassed those in other oculomotor areas in the medial-temporal cortex, frontal cortex, basal ganglia, and cerebellum. These findings suggest that temporal properties of the responses enrich the coding capacity of the basal ganglia output beyond gating or permitting movement.
Collapse
Affiliation(s)
- Gil Zur
- Edmond and Lily Safra Center for Brain Sciences, the Hebrew University, Jerusalem, Israel
| | - Noga Larry
- Edmond and Lily Safra Center for Brain Sciences, the Hebrew University, Jerusalem, Israel
| | - Matan Cain
- Edmond and Lily Safra Center for Brain Sciences, the Hebrew University, Jerusalem, Israel
| | - Adi Lixenberg
- Edmond and Lily Safra Center for Brain Sciences, the Hebrew University, Jerusalem, Israel
| | - Merav Yarkoni
- Edmond and Lily Safra Center for Brain Sciences, the Hebrew University, Jerusalem, Israel
| | - Stuart Behling
- Department of Neurobiology, Duke University School of Medicine, Durham, NC, United States
| | - Mati Joshua
- Edmond and Lily Safra Center for Brain Sciences, the Hebrew University, Jerusalem, Israel
| |
Collapse
|
3
|
Khilkevich A, Lohse M, Low R, Orsolic I, Bozic T, Windmill P, Mrsic-Flogel TD. Brain-wide dynamics linking sensation to action during decision-making. Nature 2024:10.1038/s41586-024-07908-w. [PMID: 39261727 DOI: 10.1038/s41586-024-07908-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2023] [Accepted: 08/05/2024] [Indexed: 09/13/2024]
Abstract
Perceptual decisions rely on learned associations between sensory evidence and appropriate actions, involving the filtering and integration of relevant inputs to prepare and execute timely responses1,2. Despite the distributed nature of task-relevant representations3-10, it remains unclear how transformations between sensory input, evidence integration, motor planning and execution are orchestrated across brain areas and dimensions of neural activity. Here we addressed this question by recording brain-wide neural activity in mice learning to report changes in ambiguous visual input. After learning, evidence integration emerged across most brain areas in sparse neural populations that drive movement-preparatory activity. Visual responses evolved from transient activations in sensory areas to sustained representations in frontal-motor cortex, thalamus, basal ganglia, midbrain and cerebellum, enabling parallel evidence accumulation. In areas that accumulate evidence, shared population activity patterns encode visual evidence and movement preparation, distinct from movement-execution dynamics. Activity in movement-preparatory subspace is driven by neurons integrating evidence, which collapses at movement onset, allowing the integration process to reset. Across premotor regions, evidence-integration timescales were independent of intrinsic regional dynamics, and thus depended on task experience. In summary, learning aligns evidence accumulation to action preparation in activity dynamics across dozens of brain regions. This leads to highly distributed and parallelized sensorimotor transformations during decision-making. Our work unifies concepts from decision-making and motor control fields into a brain-wide framework for understanding how sensory evidence controls actions.
Collapse
Affiliation(s)
- Andrei Khilkevich
- Sainsbury Wellcome Centre for Neural Circuits and Behaviour, University College London, London, UK.
| | - Michael Lohse
- Sainsbury Wellcome Centre for Neural Circuits and Behaviour, University College London, London, UK.
| | - Ryan Low
- Sainsbury Wellcome Centre for Neural Circuits and Behaviour, University College London, London, UK
| | - Ivana Orsolic
- Sainsbury Wellcome Centre for Neural Circuits and Behaviour, University College London, London, UK
| | - Tadej Bozic
- Sainsbury Wellcome Centre for Neural Circuits and Behaviour, University College London, London, UK
| | - Paige Windmill
- Sainsbury Wellcome Centre for Neural Circuits and Behaviour, University College London, London, UK
| | - Thomas D Mrsic-Flogel
- Sainsbury Wellcome Centre for Neural Circuits and Behaviour, University College London, London, UK.
| |
Collapse
|
4
|
Dutta S, Skm V. Grasp context-dependent uncertainty alters the relative contribution of anticipatory and feedback-based mechanisms in object manipulation. Neuropsychologia 2024; 204:108996. [PMID: 39251108 DOI: 10.1016/j.neuropsychologia.2024.108996] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2024] [Revised: 08/01/2024] [Accepted: 09/05/2024] [Indexed: 09/11/2024]
Abstract
Predictive control within dexterous object manipulation while allowing for the choice of contact points has been shown to employ a predominantly feedback-based force modulation. The anticipation is thought to be facilitated through the internal representation of the object dynamics being integrated and updated on a trial-to-trial basis with the feedback of contact locations on the object. This is as opposed to the classically studied memory representation-based fingertip force control for grasping with pre-selected contact locations. We designed a study to examine this grasp context-dependent asymmetry in sensorimotor integration by introducing binary uncertainty about the grasp type before movement initiation within the framework of motor planning. An inverted T-shaped instrumented object was presented to 24 participants as the manipulandum, and they were asked to reach, grasp, and lift it while minimising the peak roll. We dissociated the planning and the execution phases by pseudo-randomly manipulating the availability of visual contact cues on the object after movement onset. We analysed both derived as well as direct kinetic and kinematic measures of the grasp during the loading phase to understand the anticipatory coordination. Our findings suggest that uncertainty about the grasp context during movement preparation resulted in a shift towards feedback-based mechanisms for grasp force modulation despite the persistence of visual cues.
Collapse
Affiliation(s)
- Swarnab Dutta
- Department of Applied Mechanics and Biomedical Engineering, Indian Institute of Technology Madras, Chennai, India.
| | - Varadhan Skm
- Department of Applied Mechanics and Biomedical Engineering, Indian Institute of Technology Madras, Chennai, India.
| |
Collapse
|
5
|
Quirmbach F, Limanowski J. Visuomotor prediction during action planning in the human frontoparietal cortex and cerebellum. Cereb Cortex 2024; 34:bhae382. [PMID: 39325000 DOI: 10.1093/cercor/bhae382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/11/2024] [Revised: 08/28/2024] [Accepted: 09/04/2024] [Indexed: 09/27/2024] Open
Abstract
The concept of forward models in the brain, classically applied to describing on-line motor control, can in principle be extended to action planning, i.e. assuming forward sensory predictions are issued during the mere preparation of movements. To test this idea, we combined a delayed movement task with a virtual reality based manipulation of visuomotor congruence during functional magnetic resonance imaging. Participants executed simple hand movements after a delay. During the delay, two aspects of the upcoming movement could be cued: the movement type and the visuomotor mapping (i.e. congruence of executed hand movements and visual movement feedback by a glove-controlled virtual hand). Frontoparietal areas showed increased delay period activity when preparing pre-specified movements (cued > uncued). The cerebellum showed increased activity during the preparation for incongruent > congruent visuomotor mappings. The left anterior intraparietal sulcus showed an interaction effect, responding most strongly when a pre-specified (cued) movement was prepared under expected visuomotor incongruence. These results suggest that motor planning entails a forward prediction of visual body movement feedback, which can be adjusted in anticipation of nonstandard visuomotor mappings, and which is likely computed by the cerebellum and integrated with state estimates for (planned) control in the anterior intraparietal sulcus.
Collapse
Affiliation(s)
- Felix Quirmbach
- Faculty of Psychology, Technical University of Dresden, Helmholtzstraße 10, 01069 Dresden, Germany
- Center for Tactile Internet with Human-in-the-Loop, Technical University of Dresden, Georg-Schumann-Str. 9, 01187 Dresden, Germany
| | - Jakub Limanowski
- Center for Tactile Internet with Human-in-the-Loop, Technical University of Dresden, Georg-Schumann-Str. 9, 01187 Dresden, Germany
- Institute of Psychology, University of Greifswald, Franz-Mehring-Straße 47, 17489 Greifswald, Germany
| |
Collapse
|
6
|
Chowdhury RH. Reaching into the future. eLife 2024; 13:e101739. [PMID: 39219508 PMCID: PMC11368399 DOI: 10.7554/elife.101739] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/04/2024] Open
Abstract
When carrying out a sequence of movements, humans can plan several steps in advance to make the movement smooth.
Collapse
Affiliation(s)
- Raeed H Chowdhury
- Department of Bioengineering, University of PittsburghPittsburghUnited States
| |
Collapse
|
7
|
O'Shea H, Bek J. The complex interplay between perception, cognition, and action: a commentary on Bach et al. 2022. PSYCHOLOGICAL RESEARCH 2024; 88:1814-1816. [PMID: 38294530 PMCID: PMC11315796 DOI: 10.1007/s00426-023-01921-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Accepted: 12/25/2023] [Indexed: 02/01/2024]
Abstract
Bach (Psychological Research 2022, https://doi.org/10.1007/s00426-022-01773-w ) offer a re-conceptualisation of motor imagery, influenced by older ideas of ideomotor action and formulated in terms of action effects rather than motor output. We share the view of an essential role of action effect in action planning and motor imagery processes, but we challenge the claim that motor imagery is non-motoric in nature. In the present article, we critically review some of Bach et al.'s proposed ideas and pose questions of whether effect and motor processes are functionally separable, and if not, what mechanisms underlie motor imagery and what terminology best captures its function.
Collapse
Affiliation(s)
- Helen O'Shea
- School of Psychology, University College Dublin, Belfield, Dublin 4, Ireland
| | - Judith Bek
- School of Psychology, University College Dublin, Belfield, Dublin 4, Ireland.
- Faculty of Kinesiology and Physical Education, University of Toronto, Toronto, Canada.
| |
Collapse
|
8
|
Colins Rodriguez A, Perich MG, Miller LE, Humphries MD. Motor Cortex Latent Dynamics Encode Spatial and Temporal Arm Movement Parameters Independently. J Neurosci 2024; 44:e1777232024. [PMID: 39060178 PMCID: PMC11358606 DOI: 10.1523/jneurosci.1777-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/19/2023] [Revised: 07/12/2024] [Accepted: 07/17/2024] [Indexed: 07/28/2024] Open
Abstract
The fluid movement of an arm requires multiple spatiotemporal parameters to be set independently. Recent studies have argued that arm movements are generated by the collective dynamics of neurons in motor cortex. An untested prediction of this hypothesis is that independent parameters of movement must map to independent components of the neural dynamics. Using a task where three male monkeys made a sequence of reaching movements to randomly placed targets, we show that the spatial and temporal parameters of arm movements are independently encoded in the low-dimensional trajectories of population activity in motor cortex: each movement's direction corresponds to a fixed neural trajectory through neural state space and its speed to how quickly that trajectory is traversed. Recurrent neural network models show that this coding allows independent control over the spatial and temporal parameters of movement by separate network parameters. Our results support a key prediction of the dynamical systems view of motor cortex, and also argue that not all parameters of movement are defined by different trajectories of population activity.
Collapse
Affiliation(s)
| | - Matt G Perich
- Département de neurosciences, Faculté de médecine, Université de Montréal, Montreal, Quebec H3T 1J4, Canada
- Québec Artificial Intelligence Institute (Mila), Montreal, Quebec H2S 3H1, Canada
| | - Lee E Miller
- Department of Biomedical Engineering, Northwestern University, Chicago, Illinois 60208
| | - Mark D Humphries
- School of Psychology, University of Nottingham, Nottingham NG7 2RD, United Kingdom
| |
Collapse
|
9
|
Wang J, Li Y, Qi L, Mamtilahun M, Liu C, Liu Z, Shi R, Wu S, Yang GY. Advanced rehabilitation in ischaemic stroke research. Stroke Vasc Neurol 2024; 9:328-343. [PMID: 37788912 PMCID: PMC11420926 DOI: 10.1136/svn-2022-002285] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Accepted: 03/20/2023] [Indexed: 10/05/2023] Open
Abstract
At present, due to the rapid progress of treatment technology in the acute phase of ischaemic stroke, the mortality of patients has been greatly reduced but the number of disabled survivors is increasing, and most of them are elderly patients. Physicians and rehabilitation therapists pay attention to develop all kinds of therapist techniques including physical therapy techniques, robot-assisted technology and artificial intelligence technology, and study the molecular, cellular or synergistic mechanisms of rehabilitation therapies to promote the effect of rehabilitation therapy. Here, we discussed different animal and in vitro models of ischaemic stroke for rehabilitation studies; the compound concept and technology of neurological rehabilitation; all kinds of biological mechanisms of physical therapy; the significance, assessment and efficacy of neurological rehabilitation; the application of brain-computer interface, rehabilitation robotic and non-invasive brain stimulation technology in stroke rehabilitation.
Collapse
Affiliation(s)
- Jixian Wang
- Department of Rehabilitation Medicine, Ruijin Hospital, Shanghai Jiao Tong University School of Medical, Shanghai, China
| | - Yongfang Li
- Department of Rehabilitation Medicine, Ruijin Hospital, Shanghai Jiao Tong University School of Medical, Shanghai, China
| | - Lin Qi
- Med-X Research Institute and School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Muyassar Mamtilahun
- Med-X Research Institute and School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Chang Liu
- Med-X Research Institute and School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Ze Liu
- Med-X Research Institute and School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Rubing Shi
- Med-X Research Institute and School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Shengju Wu
- Med-X Research Institute and School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Guo-Yuan Yang
- Med-X Research Institute and School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| |
Collapse
|
10
|
Joy MT, Carmichael ST. Activity-dependent transcriptional programs in memory regulate motor recovery after stroke. Commun Biol 2024; 7:1048. [PMID: 39183218 PMCID: PMC11345429 DOI: 10.1038/s42003-024-06723-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2023] [Accepted: 08/12/2024] [Indexed: 08/27/2024] Open
Abstract
Stroke causes death of brain tissue leading to long-term deficits. Behavioral evidence from neurorehabilitative therapies suggest learning-induced neuroplasticity can lead to beneficial outcomes. However, molecular and cellular mechanisms that link learning and stroke recovery are unknown. We show that in a mouse model of stroke, which exhibits enhanced recovery of function due to genetic perturbations of learning and memory genes, animals display activity-dependent transcriptional programs that are normally active during formation or storage of new memories. The expression of neuronal activity-dependent genes are predictive of recovery and occupy a molecular latent space unique to motor recovery. With motor recovery, networks of activity-dependent genes are co-expressed with their transcription factor targets forming gene regulatory networks that support activity-dependent transcription, that are normally diminished after stroke. Neuronal activity-dependent changes at the circuit level are influenced by interactions with microglia. At the molecular level, we show that enrichment of activity-dependent programs in neurons lead to transcriptional changes in microglia where they differentially interact to support intercellular signaling pathways for axon guidance, growth and synaptogenesis. Together, these studies identify activity-dependent transcriptional programs as a fundamental mechanism for neural repair post-stroke.
Collapse
Affiliation(s)
- Mary T Joy
- The Jackson Laboratory, Bar Harbor, ME, 04609, USA.
| | - S Thomas Carmichael
- Department of Neurology, David Geffen School of Medicine, University of California Los Angeles, Los Angeles, CA, 90095, USA
| |
Collapse
|
11
|
Koh N, Ma Z, Sarup A, Kristl AC, Agrios M, Young M, Miri A. Selective direct motor cortical influence during naturalistic climbing. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.06.18.545509. [PMID: 39229015 PMCID: PMC11370436 DOI: 10.1101/2023.06.18.545509] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/05/2024]
Abstract
It remains poorly resolved when and how motor cortical output directly influences limb muscle activity through descending projections, which impedes mechanistic understanding of cortical movement control. Here we addressed this in mice performing an ethologically inspired all-limb climbing behavior. We quantified the direct influence of forelimb primary motor cortex (caudal forelimb area, CFA) on muscle activity comprehensively across the muscle activity states that occur during climbing. We found that CFA informs muscle activity pattern, mainly by selectively activating certain muscles while exerting much smaller, bidirectional effects on their antagonists. From Neuropixel recordings, we identified linear combinations (components) of motor cortical activity that covary with these effects, finding that these components differ from those that covary with muscle activity or kinematics. Collectively, our results reveal an instructive direct motor cortical influence on limb muscles that is selective within a motor behavior and reliant on a new type of neural activity subspace.
Collapse
|
12
|
Sabatini DA, Kaufman MT. Reach-dependent reorientation of rotational dynamics in motor cortex. Nat Commun 2024; 15:7007. [PMID: 39143078 PMCID: PMC11325044 DOI: 10.1038/s41467-024-51308-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2023] [Accepted: 08/05/2024] [Indexed: 08/16/2024] Open
Abstract
During reaching, neurons in motor cortex exhibit complex, time-varying activity patterns. Though single-neuron activity correlates with movement parameters, movement correlations explain neural activity only partially. Neural responses also reflect population-level dynamics thought to generate outputs. These dynamics have previously been described as "rotational," such that activity orbits in neural state space. Here, we reanalyze reaching datasets from male Rhesus macaques and find two essential features that cannot be accounted for with standard dynamics models. First, the planes in which rotations occur differ for different reaches. Second, this variation in planes reflects the overall location of activity in neural state space. Our "location-dependent rotations" model fits nearly all motor cortex activity during reaching, and high-quality decoding of reach kinematics reveals a quasilinear relationship with spiking. Varying rotational planes allows motor cortex to produce richer outputs than possible under previous models. Finally, our model links representational and dynamical ideas: representation is present in the state space location, which dynamics then convert into time-varying command signals.
Collapse
Affiliation(s)
- David A Sabatini
- Department of Organismal Biology and Anatomy, The University of Chicago, Chicago, IL, 60637, USA
- Neuroscience Institute, The University of Chicago, Chicago, IL, 60637, USA
| | - Matthew T Kaufman
- Department of Organismal Biology and Anatomy, The University of Chicago, Chicago, IL, 60637, USA.
- Neuroscience Institute, The University of Chicago, Chicago, IL, 60637, USA.
| |
Collapse
|
13
|
Palenciano AF, González-García C, De Houwer J, Liefooghe B, Brass M. Concurrent response and action effect representations across the somatomotor cortices during novel task preparation. Cortex 2024; 177:150-169. [PMID: 38861776 DOI: 10.1016/j.cortex.2024.05.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2024] [Revised: 05/02/2024] [Accepted: 05/15/2024] [Indexed: 06/13/2024]
Abstract
Instructions allow us to fulfill novel and complex tasks on the first try. This skill has been linked to preparatory brain signals that encode upcoming demands in advance, facilitating novel performance. To deepen insight into these processes, we explored whether instructions pre-activated task-relevant motoric and perceptual neural states. Critically, we addressed whether these representations anticipated activity patterns guiding overt sensorimotor processing, which could reflect that internally simulating novel tasks facilitates the preparation. To do so, we collected functional magnetic resonance imaging data while female and male participants encoded and implemented novel stimulus-response associations. Participants also completed localizer tasks designed to isolate the neural representations of the mappings-relevant motor responses, perceptual consequences, and stimulus categories. Using canonical template tracking, we identified whether and where these sensorimotor representations were pre-activated. We found that response-related templates were encoded in advance in regions linked with action control, entailing not only the instructed responses but also their somatosensory consequences. This result was particularly robust in primary motor and somatosensory cortices. While, following our predictions, we found a systematic decrease in the irrelevant stimulus templates' representational strength compared to the relevant ones, this difference was due to below-zero estimates linked to the irrelevant category activity patterns. Overall, our findings reflect that instruction processing relies on the sensorimotor cortices to anticipate motoric and kinesthetic representations of prospective action plans, suggesting the engagement of motor imagery during novel task preparation. More generally, they stress that the somatomotor system could participate with higher-level frontoparietal regions during anticipatory task control.
Collapse
Affiliation(s)
- Ana F Palenciano
- Mind, Brain and Behavior Research Center, University of Granada, Granada, Spain.
| | | | - Jan De Houwer
- Department of Experimental Clinical and Health Psychology, Ghent University, Ghent, Belgium
| | - Baptist Liefooghe
- Department of Psychology, Utrecht University, Utrecht, the Netherlands
| | - Marcel Brass
- Berlin School of Mind and Brain, Department of Psychology, Humboldt University of Berlin, Berlin, Germany; Department of Experimental Psychology, Ghent University, Ghent, Belgium
| |
Collapse
|
14
|
Scott DN, Mukherjee A, Nassar MR, Halassa MM. Thalamocortical architectures for flexible cognition and efficient learning. Trends Cogn Sci 2024; 28:739-756. [PMID: 38886139 PMCID: PMC11305962 DOI: 10.1016/j.tics.2024.05.006] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/14/2023] [Revised: 05/12/2024] [Accepted: 05/13/2024] [Indexed: 06/20/2024]
Abstract
The brain exhibits a remarkable ability to learn and execute context-appropriate behaviors. How it achieves such flexibility, without sacrificing learning efficiency, is an important open question. Neuroscience, psychology, and engineering suggest that reusing and repurposing computations are part of the answer. Here, we review evidence that thalamocortical architectures may have evolved to facilitate these objectives of flexibility and efficiency by coordinating distributed computations. Recent work suggests that distributed prefrontal cortical networks compute with flexible codes, and that the mediodorsal thalamus provides regularization to promote efficient reuse. Thalamocortical interactions resemble hierarchical Bayesian computations, and their network implementation can be related to existing gating, synchronization, and hub theories of thalamic function. By reviewing recent findings and providing a novel synthesis, we highlight key research horizons integrating computation, cognition, and systems neuroscience.
Collapse
Affiliation(s)
- Daniel N Scott
- Department of Neuroscience, Brown University, Providence, RI, USA; Robert J. and Nancy D. Carney Institute for Brain Science, Brown University, Providence, RI, USA.
| | - Arghya Mukherjee
- Department of Neuroscience, Tufts University School of Medicine, Boston, MA, USA
| | - Matthew R Nassar
- Department of Neuroscience, Brown University, Providence, RI, USA; Robert J. and Nancy D. Carney Institute for Brain Science, Brown University, Providence, RI, USA
| | - Michael M Halassa
- Department of Neuroscience, Tufts University School of Medicine, Boston, MA, USA; Department of Psychiatry, Tufts University School of Medicine, Boston, MA, USA.
| |
Collapse
|
15
|
Fortier-Lebel N, Nakajima T. Exploring the Consistent Roles of Motor Areas Across Voluntary Movement and Locomotion. Neuroscientist 2024:10738584241263758. [PMID: 39041460 DOI: 10.1177/10738584241263758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/24/2024]
Abstract
Multiple cortical motor areas are critically involved in the voluntary control of discrete movement (e.g., reaching) and gait. Here, we outline experimental findings in nonhuman primates with clinical reports and research in humans that explain characteristic movement control mechanisms in the primary, supplementary, and presupplementary motor areas, as well as in the dorsal premotor area. We then focus on single-neuron activity recorded while monkeys performed motor sequences consisting of multiple discrete movements, and we consider how area-specific control mechanisms may contribute to the performance of complex movements. Following this, we explore the motor areas in cats that we have considered as analogs of those in primates based on similarities in their cortical surface topology, anatomic connections, microstimulation effects, and activity patterns. Emphasizing that discrete movement and gait modification entail similar control mechanisms, we argue that single-neuron activity in each area of the cat during gait modification is compatible with the function ascribed to the activity in the corresponding area in primates, recorded during the performance of discrete movements. The findings that demonstrate the premotor areas' contribution to locomotion, currently unique to the cat model, should offer highly valuable insights into the control mechanisms of locomotion in primates, including humans.
Collapse
Affiliation(s)
- Nicolas Fortier-Lebel
- Département de neurosciences, Département de médecine, Centre interdisciplinaire de recherche sur le cerveau et l'apprentissage, Groupe de recherche sur la signalisation neurale et la circuiterie, Université de Montréal, Montréal, Canada
| | - Toshi Nakajima
- Department of Physiology, Faculty of Medicine, Kindai University, Osaka-Sayama, Japan
| |
Collapse
|
16
|
Klapp ST, Maslovat D. Working memory involvement in action planning does not include timing initiation structure. PSYCHOLOGICAL RESEARCH 2024; 88:1413-1425. [PMID: 38874596 DOI: 10.1007/s00426-024-01986-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/11/2024] [Accepted: 06/03/2024] [Indexed: 06/15/2024]
Abstract
A fundamental limitation in the type of information that can be retained in working memory is identified in this theoretical / review article. The analysis is based on studies of skilled motor performance that were not initially conceived in terms of working memory. Findings from a long history of experimentation involving reaction time (RT) prior to making a brief motor response indicate that although the parameters representing the goal to be achieved by the response can be retained in working memory, the control code that implements timing of action components cannot. This lack of working memory requires that the "timing code" must be compiled immediately prior to the moment that it is to be utilized; it is not possible to be fully ready to respond earlier. This compiling process increases RT and may also underlie both the psychological refractory period effect and the difficulty of generating concurrent motor actions with independent timing. These conclusions extend, but do not conflict with, other models of working memory.
Collapse
Affiliation(s)
- Stuart T Klapp
- Department of Psychology, California State University, East Bay, Hayward, CA, USA
| | - Dana Maslovat
- School of Human Kinetics, University of Ottawa, 125 University Private, Ottawa, ON, K1N 1A2, Canada.
| |
Collapse
|
17
|
Chang YT, Finkel EA, Xu D, O'Connor DH. Rule-based modulation of a sensorimotor transformation across cortical areas. eLife 2024; 12:RP92620. [PMID: 38842277 PMCID: PMC11156468 DOI: 10.7554/elife.92620] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/07/2024] Open
Abstract
Flexible responses to sensory stimuli based on changing rules are critical for adapting to a dynamic environment. However, it remains unclear how the brain encodes and uses rule information to guide behavior. Here, we made single-unit recordings while head-fixed mice performed a cross-modal sensory selection task where they switched between two rules: licking in response to tactile stimuli while rejecting visual stimuli, or vice versa. Along a cortical sensorimotor processing stream including the primary (S1) and secondary (S2) somatosensory areas, and the medial (MM) and anterolateral (ALM) motor areas, single-neuron activity distinguished between the two rules both prior to and in response to the tactile stimulus. We hypothesized that neural populations in these areas would show rule-dependent preparatory states, which would shape the subsequent sensory processing and behavior. This hypothesis was supported for the motor cortical areas (MM and ALM) by findings that (1) the current task rule could be decoded from pre-stimulus population activity; (2) neural subspaces containing the population activity differed between the two rules; and (3) optogenetic disruption of pre-stimulus states impaired task performance. Our findings indicate that flexible action selection in response to sensory input can occur via configuration of preparatory states in the motor cortex.
Collapse
Affiliation(s)
- Yi-Ting Chang
- Solomon H. Snyder Department of Neuroscience, Kavli Neuroscience Discovery Institute, Brain Science Institute, Johns Hopkins University School of MedicineBaltimoreUnited States
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins UniversityBaltimoreUnited States
| | - Eric A Finkel
- Solomon H. Snyder Department of Neuroscience, Kavli Neuroscience Discovery Institute, Brain Science Institute, Johns Hopkins University School of MedicineBaltimoreUnited States
| | - Duo Xu
- Solomon H. Snyder Department of Neuroscience, Kavli Neuroscience Discovery Institute, Brain Science Institute, Johns Hopkins University School of MedicineBaltimoreUnited States
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins UniversityBaltimoreUnited States
| | - Daniel H O'Connor
- Solomon H. Snyder Department of Neuroscience, Kavli Neuroscience Discovery Institute, Brain Science Institute, Johns Hopkins University School of MedicineBaltimoreUnited States
- Zanvyl Krieger Mind/Brain Institute, Johns Hopkins UniversityBaltimoreUnited States
| |
Collapse
|
18
|
Bardella G, Franchini S, Pan L, Balzan R, Ramawat S, Brunamonti E, Pani P, Ferraina S. Neural Activity in Quarks Language: Lattice Field Theory for a Network of Real Neurons. ENTROPY (BASEL, SWITZERLAND) 2024; 26:495. [PMID: 38920504 PMCID: PMC11203154 DOI: 10.3390/e26060495] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Revised: 05/28/2024] [Accepted: 05/30/2024] [Indexed: 06/27/2024]
Abstract
Brain-computer interfaces have seen extraordinary surges in developments in recent years, and a significant discrepancy now exists between the abundance of available data and the limited headway made in achieving a unified theoretical framework. This discrepancy becomes particularly pronounced when examining the collective neural activity at the micro and meso scale, where a coherent formalization that adequately describes neural interactions is still lacking. Here, we introduce a mathematical framework to analyze systems of natural neurons and interpret the related empirical observations in terms of lattice field theory, an established paradigm from theoretical particle physics and statistical mechanics. Our methods are tailored to interpret data from chronic neural interfaces, especially spike rasters from measurements of single neuron activity, and generalize the maximum entropy model for neural networks so that the time evolution of the system is also taken into account. This is obtained by bridging particle physics and neuroscience, paving the way for particle physics-inspired models of the neocortex.
Collapse
Affiliation(s)
- Giampiero Bardella
- Department of Physiology and Pharmacology, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Roma, Italy (E.B.); (P.P.); (S.F.)
| | - Simone Franchini
- Department of Physiology and Pharmacology, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Roma, Italy (E.B.); (P.P.); (S.F.)
| | - Liming Pan
- School of Cyber Science and Technology, University of Science and Technology of China, Hefei 230026, China;
| | - Riccardo Balzan
- Laboratoire de Chimie et Biochimie Pharmacologiques et Toxicologiques, UMR 8601, UFR Biomédicale et des Sciences de Base, Université Paris Descartes-CNRS, PRES Paris Sorbonne Cité, 75006 Paris, France;
| | - Surabhi Ramawat
- Department of Physiology and Pharmacology, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Roma, Italy (E.B.); (P.P.); (S.F.)
| | - Emiliano Brunamonti
- Department of Physiology and Pharmacology, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Roma, Italy (E.B.); (P.P.); (S.F.)
| | - Pierpaolo Pani
- Department of Physiology and Pharmacology, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Roma, Italy (E.B.); (P.P.); (S.F.)
| | - Stefano Ferraina
- Department of Physiology and Pharmacology, Sapienza University of Rome, Piazzale Aldo Moro 5, 00185 Roma, Italy (E.B.); (P.P.); (S.F.)
| |
Collapse
|
19
|
Pellegrino A, Stein H, Cayco-Gajic NA. Dimensionality reduction beyond neural subspaces with slice tensor component analysis. Nat Neurosci 2024; 27:1199-1210. [PMID: 38710876 DOI: 10.1038/s41593-024-01626-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2022] [Accepted: 03/20/2024] [Indexed: 05/08/2024]
Abstract
Recent work has argued that large-scale neural recordings are often well described by patterns of coactivation across neurons. Yet the view that neural variability is constrained to a fixed, low-dimensional subspace may overlook higher-dimensional structure, including stereotyped neural sequences or slowly evolving latent spaces. Here we argue that task-relevant variability in neural data can also cofluctuate over trials or time, defining distinct 'covariability classes' that may co-occur within the same dataset. To demix these covariability classes, we develop sliceTCA (slice tensor component analysis), a new unsupervised dimensionality reduction method for neural data tensors. In three example datasets, including motor cortical activity during a classic reaching task in primates and recent multiregion recordings in mice, we show that sliceTCA can capture more task-relevant structure in neural data using fewer components than traditional methods. Overall, our theoretical framework extends the classic view of low-dimensional population activity by incorporating additional classes of latent variables capturing higher-dimensional structure.
Collapse
Affiliation(s)
- Arthur Pellegrino
- Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Département D'Etudes Cognitives, Ecole Normale Supérieure, PSL University, Paris, France.
- Institute for Adaptive and Neural Computation, School of Informatics, University of Edinburgh, Edinburgh, UK.
| | - Heike Stein
- Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Département D'Etudes Cognitives, Ecole Normale Supérieure, PSL University, Paris, France
| | - N Alex Cayco-Gajic
- Laboratoire de Neurosciences Cognitives et Computationnelles, INSERM U960, Département D'Etudes Cognitives, Ecole Normale Supérieure, PSL University, Paris, France.
| |
Collapse
|
20
|
Rodriguez AC, Perich MG, Miller L, Humphries MD. Motor cortex latent dynamics encode spatial and temporal arm movement parameters independently. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.05.26.542452. [PMID: 37292834 PMCID: PMC10246015 DOI: 10.1101/2023.05.26.542452] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
The fluid movement of an arm requires multiple spatiotemporal parameters to be set independently. Recent studies have argued that arm movements are generated by the collective dynamics of neurons in motor cortex. An untested prediction of this hypothesis is that independent parameters of movement must map to independent components of the neural dynamics. Using a task where monkeys made a sequence of reaching movements to randomly placed targets, we show that the spatial and temporal parameters of arm movements are independently encoded in the low-dimensional trajectories of population activity in motor cortex: Each movement's direction corresponds to a fixed neural trajectory through neural state space and its speed to how quickly that trajectory is traversed. Recurrent neural network models show this coding allows independent control over the spatial and temporal parameters of movement by separate network parameters. Our results support a key prediction of the dynamical systems view of motor cortex, but also argue that not all parameters of movement are defined by different trajectories of population activity.
Collapse
Affiliation(s)
| | - Matthew G. Perich
- Département de neurosciences, Faculté de médecine, Université de Montréal, Montréal, Canada
- Québec Artificial Intelligence Institute (Mila), Québec, Canada
| | - Lee Miller
- Northwestern University, Department of Biomedical Engineering, Chicago, USA
| | - Mark D. Humphries
- School of Psychology, University of Nottingham, Nottingham, United Kingdom
| |
Collapse
|
21
|
Chang JC, Perich MG, Miller LE, Gallego JA, Clopath C. De novo motor learning creates structure in neural activity that shapes adaptation. Nat Commun 2024; 15:4084. [PMID: 38744847 PMCID: PMC11094149 DOI: 10.1038/s41467-024-48008-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/26/2023] [Accepted: 04/18/2024] [Indexed: 05/16/2024] Open
Abstract
Animals can quickly adapt learned movements to external perturbations, and their existing motor repertoire likely influences their ease of adaptation. Long-term learning causes lasting changes in neural connectivity, which shapes the activity patterns that can be produced during adaptation. Here, we examined how a neural population's existing activity patterns, acquired through de novo learning, affect subsequent adaptation by modeling motor cortical neural population dynamics with recurrent neural networks. We trained networks on different motor repertoires comprising varying numbers of movements, which they acquired following various learning experiences. Networks with multiple movements had more constrained and robust dynamics, which were associated with more defined neural 'structure'-organization in the available population activity patterns. This structure facilitated adaptation, but only when the changes imposed by the perturbation were congruent with the organization of the inputs and the structure in neural activity acquired during de novo learning. These results highlight trade-offs in skill acquisition and demonstrate how different learning experiences can shape the geometrical properties of neural population activity and subsequent adaptation.
Collapse
Affiliation(s)
- Joanna C Chang
- Department of Bioengineering, Imperial College London, London, UK
| | - Matthew G Perich
- Département de Neurosciences, Faculté de Médecine, Université de Montréal, Montréal, QC, Canada
- Mila, Québec Artificial Intelligence Institute, Montréal, QC, Canada
| | - Lee E Miller
- Departments of Physiology, Biomedical Engineering and Physical Medicine and Rehabilitation, Northwestern University and Shirley Ryan Ability Lab, Chicago, IL, USA
| | - Juan A Gallego
- Department of Bioengineering, Imperial College London, London, UK.
| | - Claudia Clopath
- Department of Bioengineering, Imperial College London, London, UK.
| |
Collapse
|
22
|
Fortunato C, Bennasar-Vázquez J, Park J, Chang JC, Miller LE, Dudman JT, Perich MG, Gallego JA. Nonlinear manifolds underlie neural population activity during behaviour. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.07.18.549575. [PMID: 37503015 PMCID: PMC10370078 DOI: 10.1101/2023.07.18.549575] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 07/29/2023]
Abstract
There is rich variety in the activity of single neurons recorded during behaviour. Yet, these diverse single neuron responses can be well described by relatively few patterns of neural co-modulation. The study of such low-dimensional structure of neural population activity has provided important insights into how the brain generates behaviour. Virtually all of these studies have used linear dimensionality reduction techniques to estimate these population-wide co-modulation patterns, constraining them to a flat "neural manifold". Here, we hypothesised that since neurons have nonlinear responses and make thousands of distributed and recurrent connections that likely amplify such nonlinearities, neural manifolds should be intrinsically nonlinear. Combining neural population recordings from monkey, mouse, and human motor cortex, and mouse striatum, we show that: 1) neural manifolds are intrinsically nonlinear; 2) their nonlinearity becomes more evident during complex tasks that require more varied activity patterns; and 3) manifold nonlinearity varies across architecturally distinct brain regions. Simulations using recurrent neural network models confirmed the proposed relationship between circuit connectivity and manifold nonlinearity, including the differences across architecturally distinct regions. Thus, neural manifolds underlying the generation of behaviour are inherently nonlinear, and properly accounting for such nonlinearities will be critical as neuroscientists move towards studying numerous brain regions involved in increasingly complex and naturalistic behaviours.
Collapse
Affiliation(s)
- Cátia Fortunato
- Department of Bioengineering, Imperial College London, London UK
| | | | - Junchol Park
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn VA, USA
| | - Joanna C. Chang
- Department of Bioengineering, Imperial College London, London UK
| | - Lee E. Miller
- Department of Neurosciences, Northwestern University, Chicago IL, USA
- Department of Biomedical Engineering, Northwestern University, Chicago IL, USA
- Department of Physical Medicine and Rehabilitation, Northwestern University, Chicago IL, USA, and Shirley Ryan Ability Lab, Chicago, IL, USA
| | - Joshua T. Dudman
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn VA, USA
| | - Matthew G. Perich
- Department of Neurosciences, Faculté de médecine, Université de Montréal, Montréal, Québec, Canada
- Québec Artificial Intelligence Institute (MILA), Montréal, Québec, Canada
| | - Juan A. Gallego
- Department of Bioengineering, Imperial College London, London UK
| |
Collapse
|
23
|
Greene P, Bastian AJ, Schieber MH, Sarma SV. Optimal reaching subject to computational and physical constraints reveals structure of the sensorimotor control system. Proc Natl Acad Sci U S A 2024; 121:e2319313121. [PMID: 38551834 PMCID: PMC10998569 DOI: 10.1073/pnas.2319313121] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/03/2023] [Accepted: 02/13/2024] [Indexed: 04/02/2024] Open
Abstract
Optimal feedback control provides an abstract framework describing the architecture of the sensorimotor system without prescribing implementation details such as what coordinate system to use, how feedback is incorporated, or how to accommodate changing task complexity. We investigate how such details are determined by computational and physical constraints by creating a model of the upper limb sensorimotor system in which all connection weights between neurons, feedback, and muscles are unknown. By optimizing these parameters with respect to an objective function, we find that the model exhibits a preference for an intrinsic (joint angle) coordinate representation of inputs and feedback and learns to calculate a weighted feedforward and feedback error. We further show that complex reaches around obstacles can be achieved by augmenting our model with a path-planner based on via points. The path-planner revealed "avoidance" neurons that encode directions to reach around obstacles and "placement" neurons that make fine-tuned adjustments to via point placement. Our results demonstrate the surprising capability of computationally constrained systems and highlight interesting characteristics of the sensorimotor system.
Collapse
Affiliation(s)
- Patrick Greene
- Institute for Computational Medicine, The Johns Hopkins University, Baltimore, MD21218
| | - Amy J. Bastian
- Kennedy Krieger Institute, Department of Neurology, The Johns Hopkins University School of Medicine, Baltimore, MD21205
| | - Marc H. Schieber
- Department of Neurology, University of Rochester, Rochester, NY14642
| | - Sridevi V. Sarma
- Institute for Computational Medicine, The Johns Hopkins University, Baltimore, MD21218
- Department of Biomedical Engineering, The Johns Hopkins University School of Medicine & Whiting School of Engineering, Baltimore, MD21218
| |
Collapse
|
24
|
Meng R, Bouchard KE. Bayesian inference of structured latent spaces from neural population activity with the orthogonal stochastic linear mixing model. PLoS Comput Biol 2024; 20:e1011975. [PMID: 38669271 PMCID: PMC11078355 DOI: 10.1371/journal.pcbi.1011975] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2022] [Revised: 05/08/2024] [Accepted: 03/07/2024] [Indexed: 04/28/2024] Open
Abstract
The brain produces diverse functions, from perceiving sounds to producing arm reaches, through the collective activity of populations of many neurons. Determining if and how the features of these exogenous variables (e.g., sound frequency, reach angle) are reflected in population neural activity is important for understanding how the brain operates. Often, high-dimensional neural population activity is confined to low-dimensional latent spaces. However, many current methods fail to extract latent spaces that are clearly structured by exogenous variables. This has contributed to a debate about whether or not brains should be thought of as dynamical systems or representational systems. Here, we developed a new latent process Bayesian regression framework, the orthogonal stochastic linear mixing model (OSLMM) which introduces an orthogonality constraint amongst time-varying mixture coefficients, and provide Markov chain Monte Carlo inference procedures. We demonstrate superior performance of OSLMM on latent trajectory recovery in synthetic experiments and show superior computational efficiency and prediction performance on several real-world benchmark data sets. We primarily focus on demonstrating the utility of OSLMM in two neural data sets: μECoG recordings from rat auditory cortex during presentation of pure tones and multi-single unit recordings form monkey motor cortex during complex arm reaching. We show that OSLMM achieves superior or comparable predictive accuracy of neural data and decoding of external variables (e.g., reach velocity). Most importantly, in both experimental contexts, we demonstrate that OSLMM latent trajectories directly reflect features of the sounds and reaches, demonstrating that neural dynamics are structured by neural representations. Together, these results demonstrate that OSLMM will be useful for the analysis of diverse, large-scale biological time-series datasets.
Collapse
Affiliation(s)
- Rui Meng
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, United States of America
| | - Kristofer E. Bouchard
- Biological Systems and Engineering Division, Lawrence Berkeley National Laboratory, Berkeley, California, United States of America
- Scientific Data Division, Lawrence Berkeley National Laboratory, Berkeley, California, United States of America
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, California, United States of America
- Redwood Center for Theoretical Neuroscience, University of California Berkeley, Berkeley, California, United States of America
| |
Collapse
|
25
|
Haggie L, Besier T, McMorland A. Circuits in the motor cortex explain oscillatory responses to transcranial magnetic stimulation. Netw Neurosci 2024; 8:96-118. [PMID: 38562291 PMCID: PMC10861165 DOI: 10.1162/netn_a_00341] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/05/2023] [Accepted: 10/11/2023] [Indexed: 04/04/2024] Open
Abstract
Transcranial magnetic stimulation (TMS) is a popular method used to investigate brain function. Stimulation over the motor cortex evokes muscle contractions known as motor evoked potentials (MEPs) and also high-frequency volleys of electrical activity measured in the cervical spinal cord. The physiological mechanisms of these experimentally derived responses remain unclear, but it is thought that the connections between circuits of excitatory and inhibitory neurons play a vital role. Using a spiking neural network model of the motor cortex, we explained the generation of waves of activity, so called 'I-waves', following cortical stimulation. The model reproduces a number of experimentally known responses including direction of TMS, increased inhibition, and changes in strength. Using populations of thousands of neurons in a model of cortical circuitry we showed that the cortex generated transient oscillatory responses without any tuning, and that neuron parameters such as refractory period and delays influenced the pattern and timing of those oscillations. By comparing our network with simpler, previously proposed circuits, we explored the contributions of specific connections and found that recurrent inhibitory connections are vital in producing later waves that significantly impact the production of motor evoked potentials in downstream muscles (Thickbroom, 2011). This model builds on previous work to increase our understanding of how complex circuitry of the cortex is involved in the generation of I-waves.
Collapse
Affiliation(s)
- Lysea Haggie
- Auckland Bioengineering Institute, University of Auckland, Auckland, New Zealand
| | - Thor Besier
- Auckland Bioengineering Institute, University of Auckland, Auckland, New Zealand
| | - Angus McMorland
- Auckland Bioengineering Institute, University of Auckland, Auckland, New Zealand
- Department of Exercise Sciences, University of Auckland, Auckland, New Zealand
| |
Collapse
|
26
|
Dekleva BM, Chowdhury RH, Batista AP, Chase SM, Yu BM, Boninger ML, Collinger JL. Motor cortex retains and reorients neural dynamics during motor imagery. Nat Hum Behav 2024; 8:729-742. [PMID: 38287177 PMCID: PMC11089477 DOI: 10.1038/s41562-023-01804-5] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/24/2023] [Accepted: 12/13/2023] [Indexed: 01/31/2024]
Abstract
The most prominent characteristic of motor cortex is its activation during movement execution, but it is also active when we simply imagine movements in the absence of actual motor output. Despite decades of behavioural and imaging studies, it is unknown how the specific activity patterns and temporal dynamics in motor cortex during covert motor imagery relate to those during motor execution. Here we recorded intracortical activity from the motor cortex of two people who retain some residual wrist function following incomplete spinal cord injury as they performed both actual and imagined isometric wrist extensions. We found that we could decompose the population activity into three orthogonal subspaces, where one was similarly active during both action and imagery, and the others were active only during a single task type-action or imagery. Although they inhabited orthogonal neural dimensions, the action-unique and imagery-unique subspaces contained a strikingly similar set of dynamic features. Our results suggest that during motor imagery, motor cortex maintains the same overall population dynamics as during execution by reorienting the components related to motor output and/or feedback into a unique, output-null imagery subspace.
Collapse
Affiliation(s)
- Brian M Dekleva
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Physical Medicine & Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
| | - Raeed H Chowdhury
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Aaron P Batista
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Steven M Chase
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
- Neuroscience Institute, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Byron M Yu
- Center for the Neural Basis of Cognition, Pittsburgh, PA, USA
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
- Department of Electrical and Computer Engineering, Carnegie Mellon University, Pittsburgh, PA, USA
| | - Michael L Boninger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Physical Medicine & Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA
| | - Jennifer L Collinger
- Rehab Neural Engineering Labs, University of Pittsburgh, Pittsburgh, PA, USA.
- Department of Physical Medicine & Rehabilitation, University of Pittsburgh, Pittsburgh, PA, USA.
- Department of Bioengineering, University of Pittsburgh, Pittsburgh, PA, USA.
- Department of Biomedical Engineering, Carnegie Mellon University, Pittsburgh, PA, USA.
| |
Collapse
|
27
|
Churchland MM, Shenoy KV. Preparatory activity and the expansive null-space. Nat Rev Neurosci 2024; 25:213-236. [PMID: 38443626 DOI: 10.1038/s41583-024-00796-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 01/26/2024] [Indexed: 03/07/2024]
Abstract
The study of the cortical control of movement experienced a conceptual shift over recent decades, as the basic currency of understanding shifted from single-neuron tuning towards population-level factors and their dynamics. This transition was informed by a maturing understanding of recurrent networks, where mechanism is often characterized in terms of population-level factors. By estimating factors from data, experimenters could test network-inspired hypotheses. Central to such hypotheses are 'output-null' factors that do not directly drive motor outputs yet are essential to the overall computation. In this Review, we highlight how the hypothesis of output-null factors was motivated by the venerable observation that motor-cortex neurons are active during movement preparation, well before movement begins. We discuss how output-null factors then became similarly central to understanding neural activity during movement. We discuss how this conceptual framework provided key analysis tools, making it possible for experimenters to address long-standing questions regarding motor control. We highlight an intriguing trend: as experimental and theoretical discoveries accumulate, the range of computational roles hypothesized to be subserved by output-null factors continues to expand.
Collapse
Affiliation(s)
- Mark M Churchland
- Department of Neuroscience, Columbia University, New York, NY, USA.
- Grossman Center for the Statistics of Mind, Columbia University, New York, NY, USA.
- Kavli Institute for Brain Science, Columbia University, New York, NY, USA.
| | - Krishna V Shenoy
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
- Department of Bioengineering, Stanford University, Stanford, CA, USA
- Department of Neurobiology, Stanford University, Stanford, CA, USA
- Department of Neurosurgery, Stanford University, Stanford, CA, USA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA, USA
- Bio-X Institute, Stanford University, Stanford, CA, USA
- Howard Hughes Medical Institute at Stanford University, Stanford, CA, USA
| |
Collapse
|
28
|
Catto A, O’Connor R, Braunscheidel KM, Kenny PJ, Shen L. FABEL: Forecasting Animal Behavioral Events with Deep Learning-Based Computer Vision. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.03.15.584610. [PMID: 38559273 PMCID: PMC10980057 DOI: 10.1101/2024.03.15.584610] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/04/2024]
Abstract
Behavioral neuroscience aims to provide a connection between neural phenomena and emergent organism-level behaviors. This requires perturbing the nervous system and observing behavioral outcomes, and comparing observed post-perturbation behavior with predicted counterfactual behavior and therefore accurate behavioral forecasts. In this study we present FABEL, a deep learning method for forecasting future animal behaviors and locomotion trajectories from historical locomotion alone. We train an offline pose estimation network to predict animal body-part locations in behavioral video; then sequences of pose vectors are input to deep learning time-series forecasting models. Specifically, we train an LSTM network that predicts a future food interaction event in a specified time window, and a Temporal Fusion Transformer that predicts future trajectories of animal body-parts, which are then converted into probabilistic label forecasts. Importantly, accurate prediction of food interaction provides a basis for neurobehavioral intervention in the context of compulsive eating. We show promising results on forecasting tasks between 100 milliseconds and 5 seconds timescales. Because the model takes only behavioral video as input, it can be adapted to any behavioral task and does not require specific physiological readouts. Simultaneously, these deep learning models may serve as extensible modules that can accommodate diverse signals, such as in-vivo fluorescence imaging and electrophysiology, which may improve behavior forecasts and elucidate invervention targets for desired behavioral change.
Collapse
Affiliation(s)
- Adam Catto
- Nash Family Department of Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Richard O’Connor
- Nash Family Department of Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Kevin M. Braunscheidel
- Nash Family Department of Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Paul J. Kenny
- Nash Family Department of Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| | - Li Shen
- Nash Family Department of Neuroscience and Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
- Windreich Department of Artificial Intelligence and Human Health, Icahn School of Medicine at Mount Sinai, New York, NY 10029, United States
| |
Collapse
|
29
|
Chang YT, Finkel EA, Xu D, O'Connor DH. Rule-based modulation of a sensorimotor transformation across cortical areas. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.08.21.554194. [PMID: 37662301 PMCID: PMC10473613 DOI: 10.1101/2023.08.21.554194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/05/2023]
Abstract
Flexible responses to sensory stimuli based on changing rules are critical for adapting to a dynamic environment. However, it remains unclear how the brain encodes rule information and uses this information to guide behavioral responses to sensory stimuli. Here, we made single-unit recordings while head-fixed mice performed a cross-modal sensory selection task in which they switched between two rules in different blocks of trials: licking in response to tactile stimuli applied to a whisker while rejecting visual stimuli, or licking to visual stimuli while rejecting the tactile stimuli. Along a cortical sensorimotor processing stream including the primary (S1) and secondary (S2) somatosensory areas, and the medial (MM) and anterolateral (ALM) motor areas, the single-trial activity of individual neurons distinguished between the two rules both prior to and in response to the tactile stimulus. Variable rule-dependent responses to identical stimuli could in principle occur via appropriate configuration of pre-stimulus preparatory states of a neural population, which would shape the subsequent response. We hypothesized that neural populations in S1, S2, MM and ALM would show preparatory activity states that were set in a rule-dependent manner to cause processing of sensory information according to the current rule. This hypothesis was supported for the motor cortical areas by findings that (1) the current task rule could be decoded from pre-stimulus population activity in ALM and MM; (2) neural subspaces containing the population activity differed between the two rules; and (3) optogenetic disruption of pre-stimulus states within ALM and MM impaired task performance. Our findings indicate that flexible selection of an appropriate action in response to a sensory input can occur via configuration of preparatory states in the motor cortex.
Collapse
|
30
|
Chang YJ, Chen YI, Yeh HC, Santacruz SR. Neurobiologically realistic neural network enables cross-scale modeling of neural dynamics. Sci Rep 2024; 14:5145. [PMID: 38429297 PMCID: PMC10907713 DOI: 10.1038/s41598-024-54593-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/02/2023] [Accepted: 02/14/2024] [Indexed: 03/03/2024] Open
Abstract
Fundamental principles underlying computation in multi-scale brain networks illustrate how multiple brain areas and their coordinated activity give rise to complex cognitive functions. Whereas brain activity has been studied at the micro- to meso-scale to reveal the connections between the dynamical patterns and the behaviors, investigations of neural population dynamics are mainly limited to single-scale analysis. Our goal is to develop a cross-scale dynamical model for the collective activity of neuronal populations. Here we introduce a bio-inspired deep learning approach, termed NeuroBondGraph Network (NBGNet), to capture cross-scale dynamics that can infer and map the neural data from multiple scales. Our model not only exhibits more than an 11-fold improvement in reconstruction accuracy, but also predicts synchronous neural activity and preserves correlated low-dimensional latent dynamics. We also show that the NBGNet robustly predicts held-out data across a long time scale (2 weeks) without retraining. We further validate the effective connectivity defined from our model by demonstrating that neural connectivity during motor behaviour agrees with the established neuroanatomical hierarchy of motor control in the literature. The NBGNet approach opens the door to revealing a comprehensive understanding of brain computation, where network mechanisms of multi-scale activity are critical.
Collapse
Affiliation(s)
- Yin-Jui Chang
- Biomedical Engineering, The University of Texas at Austin, Austin, TX, USA
| | - Yuan-I Chen
- Biomedical Engineering, The University of Texas at Austin, Austin, TX, USA
| | - Hsin-Chih Yeh
- Biomedical Engineering, The University of Texas at Austin, Austin, TX, USA
- Texas Materials Institute, The University of Texas at Austin, Austin, TX, USA
| | - Samantha R Santacruz
- Biomedical Engineering, The University of Texas at Austin, Austin, TX, USA.
- Institute for Neuroscience, The University of Texas at Austin, Austin, TX, USA.
- Electrical and Computer Engineering, The University of Texas at Austin, Austin, TX, USA.
| |
Collapse
|
31
|
Ritz H, Shenhav A. Humans reconfigure target and distractor processing to address distinct task demands. Psychol Rev 2024; 131:349-372. [PMID: 37668574 PMCID: PMC11193598 DOI: 10.1037/rev0000442] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/06/2023]
Abstract
When faced with distraction, we can focus more on goal-relevant information (targets) or focus less on goal-conflicting information (distractors). How people use cognitive control to distribute attention across targets and distractors remains unclear. We address this question by developing a novel Parametric Attentional Control Task that can "tag" participants' sensitivity to target and distractor information. We use these precise measures of attention to develop a novel process model that can explain how participants control attention toward targets and distractors. Across three experiments, we find that participants met the demands of this task by independently controlling their processing of target and distractor information, exhibiting distinct adaptations to manipulations of incentives and conflict. Whereas incentives preferentially led to target enhancement, conflict in the previous trial preferentially led to distractor suppression. These distinct drivers of control altered sensitivity to targets and distractors early in the trial, promptly followed by reactive reconfiguration toward task-appropriate feature sensitivity. To provide a process-level account of these empirical findings, we develop a novel neural network model of evidence accumulation with attractor dynamics over feature weights that reconfigure target and distractor processing. These results provide a computational account of control reconfiguration that provides new insights into how multivariate attentional signals are optimized to achieve task goals. (PsycInfo Database Record (c) 2024 APA, all rights reserved).
Collapse
Affiliation(s)
- Harrison Ritz
- Cognitive, Linguistic & Psychological Science, Brown University, Providence, RI, USA
- Carney Institute for Brain Science, Brown University, Providence, RI, USA
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ, USA
| | - Amitai Shenhav
- Cognitive, Linguistic & Psychological Science, Brown University, Providence, RI, USA
- Carney Institute for Brain Science, Brown University, Providence, RI, USA
| |
Collapse
|
32
|
Chae S, Sohn JW, Kim SP. Differential Formation of Motor Cortical Dynamics during Movement Preparation According to the Predictability of Go Timing. J Neurosci 2024; 44:e1353232024. [PMID: 38233217 PMCID: PMC10883619 DOI: 10.1523/jneurosci.1353-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Revised: 12/10/2023] [Accepted: 01/08/2024] [Indexed: 01/19/2024] Open
Abstract
The motor cortex not only executes but also prepares movement, as motor cortical neurons exhibit preparatory activity that predicts upcoming movements. In movement preparation, animals adopt different strategies in response to uncertainties existing in nature such as the unknown timing of when a predator will attack-an environmental cue informing "go." However, how motor cortical neurons cope with such uncertainties is less understood. In this study, we aim to investigate whether and how preparatory activity is altered depending on the predictability of "go" timing. We analyze firing activities of the anterior lateral motor cortex in male mice during two auditory delayed-response tasks each with predictable or unpredictable go timing. When go timing is unpredictable, preparatory activities immediately reach and stay in a neural state capable of producing movement anytime to a sudden go cue. When go timing is predictable, preparation activity reaches the movement-producible state more gradually, to secure more accurate decisions. Surprisingly, this preparation process entails a longer reaction time. We find that as preparatory activity increases in accuracy, it takes longer for a neural state to transition from the end of preparation to the start of movement. Our results suggest that the motor cortex fine-tunes preparatory activity for more accurate movement using the predictability of go timing.
Collapse
Affiliation(s)
- Soyoung Chae
- Ulsan National Institute of Science and Technology, Ulsan 44929, South Korea
| | - Jeong-Woo Sohn
- Catholic Kwandong University, Gangwon-do 25601, South Korea
| | - Sung-Phil Kim
- Ulsan National Institute of Science and Technology, Ulsan 44929, South Korea
| |
Collapse
|
33
|
Almani MN, Lazzari J, Chacon A, Saxena S. μSim: A goal-driven framework for elucidating the neural control of movement through musculoskeletal modeling. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.02.578628. [PMID: 38405828 PMCID: PMC10888726 DOI: 10.1101/2024.02.02.578628] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/27/2024]
Abstract
How does the motor cortex (MC) produce purposeful and generalizable movements from the complex musculoskeletal system in a dynamic environment? To elucidate the underlying neural dynamics, we use a goal-driven approach to model MC by considering its goal as a controller driving the musculoskeletal system through desired states to achieve movement. Specifically, we formulate the MC as a recurrent neural network (RNN) controller producing muscle commands while receiving sensory feedback from biologically accurate musculoskeletal models. Given this real-time simulated feedback implemented in advanced physics simulation engines, we use deep reinforcement learning to train the RNN to achieve desired movements under specified neural and musculoskeletal constraints. Activity of the trained model can accurately decode experimentally recorded neural population dynamics and single-unit MC activity, while generalizing well to testing conditions significantly different from training. Simultaneous goal- and data- driven modeling in which we use the recorded neural activity as observed states of the MC further enhances direct and generalizable single-unit decoding. Finally, we show that this framework elucidates computational principles of how neural dynamics enable flexible control of movement and make this framework easy-to-use for future experiments.
Collapse
|
34
|
Zimnik AJ, Cora Ames K, An X, Driscoll L, Lara AH, Russo AA, Susoy V, Cunningham JP, Paninski L, Churchland MM, Glaser JI. Identifying Interpretable Latent Factors with Sparse Component Analysis. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.05.578988. [PMID: 38370650 PMCID: PMC10871230 DOI: 10.1101/2024.02.05.578988] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/20/2024]
Abstract
In many neural populations, the computationally relevant signals are posited to be a set of 'latent factors' - signals shared across many individual neurons. Understanding the relationship between neural activity and behavior requires the identification of factors that reflect distinct computational roles. Methods for identifying such factors typically require supervision, which can be suboptimal if one is unsure how (or whether) factors can be grouped into distinct, meaningful sets. Here, we introduce Sparse Component Analysis (SCA), an unsupervised method that identifies interpretable latent factors. SCA seeks factors that are sparse in time and occupy orthogonal dimensions. With these simple constraints, SCA facilitates surprisingly clear parcellations of neural activity across a range of behaviors. We applied SCA to motor cortex activity from reaching and cycling monkeys, single-trial imaging data from C. elegans, and activity from a multitask artificial network. SCA consistently identified sets of factors that were useful in describing network computations.
Collapse
Affiliation(s)
- Andrew J Zimnik
- Department of Neuroscience, Columbia University Medical Center, New York, NY, USA
- Zuckerman Institute, Columbia University, New York, NY, USA
| | - K Cora Ames
- Department of Neuroscience, Columbia University Medical Center, New York, NY, USA
- Zuckerman Institute, Columbia University, New York, NY, USA
- Grossman Center for the Statistics of Mind, Columbia University, New York, NY, USA
- Center for Theoretical Neuroscience, Columbia University, New York, NY, USA
| | - Xinyue An
- Department of Neurology, Northwestern University, Chicago, IL, USA
- Interdepartmental Neuroscience Program, Northwestern University, Chicago, IL, USA
| | - Laura Driscoll
- Department of Electrical Engineering, Stanford University, Stanford, CA, USA
- Allen Institute for Neural Dynamics, Allen Institute, Seattle, CA, USA
| | - Antonio H Lara
- Department of Neuroscience, Columbia University Medical Center, New York, NY, USA
- Zuckerman Institute, Columbia University, New York, NY, USA
| | - Abigail A Russo
- Department of Neuroscience, Columbia University Medical Center, New York, NY, USA
- Zuckerman Institute, Columbia University, New York, NY, USA
| | - Vladislav Susoy
- Department of Physics, Harvard University, Cambridge, MA, USA
- Center for Brain Science, Harvard University, Cambridge, MA, USA
| | - John P Cunningham
- Zuckerman Institute, Columbia University, New York, NY, USA
- Grossman Center for the Statistics of Mind, Columbia University, New York, NY, USA
- Center for Theoretical Neuroscience, Columbia University, New York, NY, USA
- Department of Statistics, Columbia University, New York, NY, USA
| | - Liam Paninski
- Zuckerman Institute, Columbia University, New York, NY, USA
- Grossman Center for the Statistics of Mind, Columbia University, New York, NY, USA
- Center for Theoretical Neuroscience, Columbia University, New York, NY, USA
- Department of Statistics, Columbia University, New York, NY, USA
| | - Mark M Churchland
- Department of Neuroscience, Columbia University Medical Center, New York, NY, USA
- Zuckerman Institute, Columbia University, New York, NY, USA
- Grossman Center for the Statistics of Mind, Columbia University, New York, NY, USA
- Kavli Institute for Brain Science, Columbia University Medical Center, New York, NY, USA
| | - Joshua I Glaser
- Department of Neurology, Northwestern University, Chicago, IL, USA
- Department of Computer Science, Northwestern University, Evanston, IL, USA
| |
Collapse
|
35
|
Denyer R, Greeley B, Greenhouse I, Boyd LA. Interhemispheric inhibition between dorsal premotor and primary motor cortices is released during preparation of unimanual but not bimanual movements. Eur J Neurosci 2024; 59:415-433. [PMID: 38145976 DOI: 10.1111/ejn.16224] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/20/2023] [Accepted: 11/27/2023] [Indexed: 12/27/2023]
Abstract
Previous research applying transcranial magnetic stimulation during unimanual reaction time tasks indicates a transient change in the inhibitory influence of the dorsal premotor cortex over the contralateral primary motor cortex shortly after the presentation of an imperative stimulus. The degree of interhemispheric inhibition from the dorsal premotor cortex to the contralateral primary motor cortex shifts depending on whether the targeted effector representation in the primary motor cortex is selected for movement. Further, the timing of changes in inhibition covaries with the selection demands of the reaction time task. Less is known about modulation of dorsal premotor to primary motor cortex interhemispheric inhibition during the preparation of bimanual movements. In this study, we used a dual coil transcranial magnetic stimulation to measure dorsal premotor to primary motor cortex interhemispheric inhibition between both hemispheres during unimanual and bimanual simple reaction time trials. Interhemispheric inhibition was measured early and late in the 'pre-movement period' (defined as the period immediately after the onset of the imperative stimulus and before the beginning of voluntary muscle activity). We discovered that interhemispheric inhibition was more facilitatory early in the pre-movement period compared with late in the pre-movement period during unimanual reaction time trials. In contrast, interhemispheric inhibition was unchanged throughout the pre-movement period during symmetrical bimanual reaction time trials. These results suggest that there is greater interaction between the dorsal premotor cortex and contralateral primary motor cortex during the preparation of unimanual actions compared to bimanual actions.
Collapse
Affiliation(s)
- Ronan Denyer
- Department of Physical Therapy, University of British Columbia, Vancouver, British Columbia, Canada
- Graduate Program in Neuroscience, University of British Columbia, Vancouver, British Columbia, Canada
| | - Brian Greeley
- Fraser Health Authority, Surrey, British Columbia, Canada
| | - Ian Greenhouse
- Department of Human Physiology, University of Oregon, Eugene, Oregon, USA
| | - Lara A Boyd
- Department of Physical Therapy, University of British Columbia, Vancouver, British Columbia, Canada
| |
Collapse
|
36
|
Chen S, Liu Y, Wang ZA, Colonell J, Liu LD, Hou H, Tien NW, Wang T, Harris T, Druckmann S, Li N, Svoboda K. Brain-wide neural activity underlying memory-guided movement. Cell 2024; 187:676-691.e16. [PMID: 38306983 DOI: 10.1016/j.cell.2023.12.035] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2023] [Revised: 09/19/2023] [Accepted: 12/27/2023] [Indexed: 02/04/2024]
Abstract
Behavior relies on activity in structured neural circuits that are distributed across the brain, but most experiments probe neurons in a single area at a time. Using multiple Neuropixels probes, we recorded from multi-regional loops connected to the anterior lateral motor cortex (ALM), a circuit node mediating memory-guided directional licking. Neurons encoding sensory stimuli, choices, and actions were distributed across the brain. However, choice coding was concentrated in the ALM and subcortical areas receiving input from the ALM in an ALM-dependent manner. Diverse orofacial movements were encoded in the hindbrain; midbrain; and, to a lesser extent, forebrain. Choice signals were first detected in the ALM and the midbrain, followed by the thalamus and other brain areas. At movement initiation, choice-selective activity collapsed across the brain, followed by new activity patterns driving specific actions. Our experiments provide the foundation for neural circuit models of decision-making and movement initiation.
Collapse
Affiliation(s)
- Susu Chen
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Yi Liu
- Stanford University, Palo Alto, CA, USA
| | | | - Jennifer Colonell
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Liu D Liu
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; Baylor College of Medicine, Houston, TX, USA
| | - Han Hou
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; Allen Institute for Neural Dynamics, Seattle, WA, USA
| | - Nai-Wen Tien
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA
| | - Tim Wang
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; Allen Institute for Neural Dynamics, Seattle, WA, USA
| | - Timothy Harris
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; Johns Hopkins University, Baltimore, MD, USA
| | - Shaul Druckmann
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; Stanford University, Palo Alto, CA, USA.
| | - Nuo Li
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; Baylor College of Medicine, Houston, TX, USA.
| | - Karel Svoboda
- Janelia Research Campus, Howard Hughes Medical Institute, Ashburn, VA, USA; Allen Institute for Neural Dynamics, Seattle, WA, USA.
| |
Collapse
|
37
|
Khanna AR, Muñoz W, Kim YJ, Kfir Y, Paulk AC, Jamali M, Cai J, Mustroph ML, Caprara I, Hardstone R, Mejdell M, Meszéna D, Zuckerman A, Schweitzer J, Cash S, Williams ZM. Single-neuronal elements of speech production in humans. Nature 2024; 626:603-610. [PMID: 38297120 PMCID: PMC10866697 DOI: 10.1038/s41586-023-06982-w] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2023] [Accepted: 12/14/2023] [Indexed: 02/02/2024]
Abstract
Humans are capable of generating extraordinarily diverse articulatory movement combinations to produce meaningful speech. This ability to orchestrate specific phonetic sequences, and their syllabification and inflection over subsecond timescales allows us to produce thousands of word sounds and is a core component of language1,2. The fundamental cellular units and constructs by which we plan and produce words during speech, however, remain largely unknown. Here, using acute ultrahigh-density Neuropixels recordings capable of sampling across the cortical column in humans, we discover neurons in the language-dominant prefrontal cortex that encoded detailed information about the phonetic arrangement and composition of planned words during the production of natural speech. These neurons represented the specific order and structure of articulatory events before utterance and reflected the segmentation of phonetic sequences into distinct syllables. They also accurately predicted the phonetic, syllabic and morphological components of upcoming words and showed a temporally ordered dynamic. Collectively, we show how these mixtures of cells are broadly organized along the cortical column and how their activity patterns transition from articulation planning to production. We also demonstrate how these cells reliably track the detailed composition of consonant and vowel sounds during perception and how they distinguish processes specifically related to speaking from those related to listening. Together, these findings reveal a remarkably structured organization and encoding cascade of phonetic representations by prefrontal neurons in humans and demonstrate a cellular process that can support the production of speech.
Collapse
Affiliation(s)
- Arjun R Khanna
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - William Muñoz
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | | | - Yoav Kfir
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Angelique C Paulk
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Mohsen Jamali
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Jing Cai
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Martina L Mustroph
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Irene Caprara
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Richard Hardstone
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Mackenna Mejdell
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Domokos Meszéna
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | | | - Jeffrey Schweitzer
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Sydney Cash
- Department of Neurology, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA
| | - Ziv M Williams
- Department of Neurosurgery, Massachusetts General Hospital, Harvard Medical School, Boston, MA, USA.
- Harvard-MIT Division of Health Sciences and Technology, Boston, MA, USA.
- Harvard Medical School, Program in Neuroscience, Boston, MA, USA.
| |
Collapse
|
38
|
Liu Z, Yan Y, Wang DH. Category representation in primary visual cortex after visual perceptual learning. Cogn Neurodyn 2024; 18:23-35. [PMID: 38406201 PMCID: PMC10881456 DOI: 10.1007/s11571-022-09926-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Revised: 11/15/2022] [Accepted: 12/19/2022] [Indexed: 01/31/2023] Open
Abstract
The visual perceptual learning (VPL) leads to long-term enhancement of visual task performance. The subjects are often trained to link different visual stimuli to several options, such as the widely used two-alternative forced choice (2AFC) task, which involves an implicit categorical decision. The enhancement of performance has been related to the specific changes of neural activities, but few studies investigate the effects of categorical responding on the changes of neural activities. Here we investigated whether the neural activities would exhibit the categorical characteristics if the subjects are requested to respond visual stimuli in a categorical manner during VPL. We analyzed the neural activities of two monkeys in a contour detection VPL. We found that the neural activities in primary visual cortex (V1) converge to one pattern if the contour can be detected by monkey and another pattern if the contour cannot be detected, exhibiting a kind of category learning that the neural representations of detectable contour become less selective for number of bars forming contour and diverge from the representations of undetectable contour. Supplementary Information The online version contains supplementary material available at 10.1007/s11571-022-09926-8.
Collapse
Affiliation(s)
- Zhaofan Liu
- School of Systems Science, Beijing Normal University, Beijing, 100875 China
| | - Yin Yan
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Xinjiekouwaidajie 19, Haidian, Beijing, 100875 China
- Chinese Institute for Brain Research, Beijing, China
| | - Da-Hui Wang
- School of Systems Science, Beijing Normal University, Beijing, 100875 China
- State Key Laboratory of Cognitive Neuroscience and Learning, Beijing Normal University, Xinjiekouwaidajie 19, Haidian, Beijing, 100875 China
- Beijing Key Laboratory of Brain Imaging and Connectomics, Beijing Normal University, Beijing, 100875 China
| |
Collapse
|
39
|
Weng G, Clark K, Akbarian A, Noudoost B, Nategh N. Time-varying generalized linear models: characterizing and decoding neuronal dynamics in higher visual areas. Front Comput Neurosci 2024; 18:1273053. [PMID: 38348287 PMCID: PMC10859875 DOI: 10.3389/fncom.2024.1273053] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/05/2023] [Accepted: 01/09/2024] [Indexed: 02/15/2024] Open
Abstract
To create a behaviorally relevant representation of the visual world, neurons in higher visual areas exhibit dynamic response changes to account for the time-varying interactions between external (e.g., visual input) and internal (e.g., reward value) factors. The resulting high-dimensional representational space poses challenges for precisely quantifying individual factors' contributions to the representation and readout of sensory information during a behavior. The widely used point process generalized linear model (GLM) approach provides a powerful framework for a quantitative description of neuronal processing as a function of various sensory and non-sensory inputs (encoding) as well as linking particular response components to particular behaviors (decoding), at the level of single trials and individual neurons. However, most existing variations of GLMs assume the neural systems to be time-invariant, making them inadequate for modeling nonstationary characteristics of neuronal sensitivity in higher visual areas. In this review, we summarize some of the existing GLM variations, with a focus on time-varying extensions. We highlight their applications to understanding neural representations in higher visual areas and decoding transient neuronal sensitivity as well as linking physiology to behavior through manipulation of model components. This time-varying class of statistical models provide valuable insights into the neural basis of various visual behaviors in higher visual areas and hold significant potential for uncovering the fundamental computational principles that govern neuronal processing underlying various behaviors in different regions of the brain.
Collapse
Affiliation(s)
- Geyu Weng
- Department of Biomedical Engineering, University of Utah, Salt Lake City, UT, United States
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, United States
| | - Kelsey Clark
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, United States
| | - Amir Akbarian
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, United States
| | - Behrad Noudoost
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, United States
| | - Neda Nategh
- Department of Ophthalmology and Visual Sciences, University of Utah, Salt Lake City, UT, United States
- Department of Electrical and Computer Engineering, University of Utah, Salt Lake City, UT, United States
| |
Collapse
|
40
|
Weber J, Solbakk AK, Blenkmann AO, Llorens A, Funderud I, Leske S, Larsson PG, Ivanovic J, Knight RT, Endestad T, Helfrich RF. Ramping dynamics and theta oscillations reflect dissociable signatures during rule-guided human behavior. Nat Commun 2024; 15:637. [PMID: 38245516 PMCID: PMC10799948 DOI: 10.1038/s41467-023-44571-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/12/2022] [Accepted: 12/19/2023] [Indexed: 01/22/2024] Open
Abstract
Contextual cues and prior evidence guide human goal-directed behavior. The neurophysiological mechanisms that implement contextual priors to guide subsequent actions in the human brain remain unclear. Using intracranial electroencephalography (iEEG), we demonstrate that increasing uncertainty introduces a shift from a purely oscillatory to a mixed processing regime with an additional ramping component. Oscillatory and ramping dynamics reflect dissociable signatures, which likely differentially contribute to the encoding and transfer of different cognitive variables in a cue-guided motor task. The results support the idea that prefrontal activity encodes rules and ensuing actions in distinct coding subspaces, while theta oscillations synchronize the prefrontal-motor network, possibly to guide action execution. Collectively, our results reveal how two key features of large-scale neural population activity, namely continuous ramping dynamics and oscillatory synchrony, jointly support rule-guided human behavior.
Collapse
Affiliation(s)
- Jan Weber
- Hertie Institute for Clinical Brain Research, Center for Neurology, University Medical Center Tübingen, Tübingen, Germany
- International Max Planck Research School for the Mechanisms of Mental Function and Dysfunction, University of Tübingen, Tübingen, Germany
| | - Anne-Kristin Solbakk
- Department of Psychology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
- Department of Neurosurgery, Oslo University Hospital, Oslo, Norway
- Department of Neuropsychology, Helgeland Hospital, Mosjøen, Norway
| | - Alejandro O Blenkmann
- Department of Psychology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
| | - Anais Llorens
- Department of Psychology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
- Helen Wills Neuroscience Institute, UC Berkeley, Berkeley, CA, USA
| | - Ingrid Funderud
- Department of Psychology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
- Department of Neuropsychology, Helgeland Hospital, Mosjøen, Norway
| | - Sabine Leske
- Department of Psychology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
- Department of Musicology, University of Oslo, Oslo, Norway
| | | | | | - Robert T Knight
- Helen Wills Neuroscience Institute, UC Berkeley, Berkeley, CA, USA
- Department of Psychology, UC Berkeley, Berkeley, CA, USA
| | - Tor Endestad
- Department of Psychology, University of Oslo, Oslo, Norway
- RITMO Centre for Interdisciplinary Studies in Rhythm, Time and Motion, University of Oslo, Oslo, Norway
| | - Randolph F Helfrich
- Hertie Institute for Clinical Brain Research, Center for Neurology, University Medical Center Tübingen, Tübingen, Germany.
| |
Collapse
|
41
|
Manley J, Demas J, Kim H, Traub FM, Vaziri A. Simultaneous, cortex-wide and cellular-resolution neuronal population dynamics reveal an unbounded scaling of dimensionality with neuron number. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.01.15.575721. [PMID: 38293036 PMCID: PMC10827059 DOI: 10.1101/2024.01.15.575721] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2024]
Abstract
The brain's remarkable properties arise from collective activity of millions of neurons. Widespread application of dimensionality reduction to multi-neuron recordings implies that neural dynamics can be approximated by low-dimensional "latent" signals reflecting neural computations. However, what would be the biological utility of such a redundant and metabolically costly encoding scheme and what is the appropriate resolution and scale of neural recording to understand brain function? Imaging the activity of one million neurons at cellular resolution and near-simultaneously across mouse cortex, we demonstrate an unbounded scaling of dimensionality with neuron number. While half of the neural variance lies within sixteen behavior-related dimensions, we find this unbounded scaling of dimensionality to correspond to an ever-increasing number of internal variables without immediate behavioral correlates. The activity patterns underlying these higher dimensions are fine-grained and cortex-wide, highlighting that large-scale recording is required to uncover the full neural substrates of internal and potentially cognitive processes.
Collapse
Affiliation(s)
- Jason Manley
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY 10065, USA
- The Kavli Neural Systems Institute, The Rockefeller University, New York, NY 10065, USA
| | - Jeffrey Demas
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY 10065, USA
- The Kavli Neural Systems Institute, The Rockefeller University, New York, NY 10065, USA
| | - Hyewon Kim
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY 10065, USA
| | - Francisca Martínez Traub
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY 10065, USA
| | - Alipasha Vaziri
- Laboratory of Neurotechnology and Biophysics, The Rockefeller University, New York, NY 10065, USA
- The Kavli Neural Systems Institute, The Rockefeller University, New York, NY 10065, USA
- Lead Contact
| |
Collapse
|
42
|
Margolles P, Elosegi P, Mei N, Soto D. Unconscious Manipulation of Conceptual Representations with Decoded Neurofeedback Impacts Search Behavior. J Neurosci 2024; 44:e1235232023. [PMID: 37985180 PMCID: PMC10866193 DOI: 10.1523/jneurosci.1235-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Revised: 10/04/2023] [Accepted: 10/26/2023] [Indexed: 11/22/2023] Open
Abstract
The necessity of conscious awareness in human learning has been a long-standing topic in psychology and neuroscience. Previous research on non-conscious associative learning is limited by the low signal-to-noise ratio of the subliminal stimulus, and the evidence remains controversial, including failures to replicate. Using functional MRI decoded neurofeedback, we guided participants from both sexes to generate neural patterns akin to those observed when visually perceiving real-world entities (e.g., dogs). Importantly, participants remained unaware of the actual content represented by these patterns. We utilized an associative DecNef approach to imbue perceptual meaning (e.g., dogs) into Japanese hiragana characters that held no inherent meaning for our participants, bypassing a conscious link between the characters and the dogs concept. Despite their lack of awareness regarding the neurofeedback objective, participants successfully learned to activate the target perceptual representations in the bilateral fusiform. The behavioral significance of our training was evaluated in a visual search task. DecNef and control participants searched for dogs or scissors targets that were pre-cued by the hiragana used during DecNef training or by a control hiragana. The DecNef hiragana did not prime search for its associated target but, strikingly, participants were impaired at searching for the targeted perceptual category. Hence, conscious awareness may function to support higher-order associative learning. Meanwhile, lower-level forms of re-learning, modification, or plasticity in existing neural representations can occur unconsciously, with behavioral consequences outside the original training context. The work also provides an account of DecNef effects in terms of neural representational drift.
Collapse
Affiliation(s)
- Pedro Margolles
- Basque Center on Cognition, Brain and Language (BCBL), Donostia - San Sebastián, Gipuzkoa 20009, Spain
- Universidad del País Vasco/Euskal Herriko Unibertsitatea (UPV/EHU), Leioa, Bizkaia 48940, Spain
| | - Patxi Elosegi
- Basque Center on Cognition, Brain and Language (BCBL), Donostia - San Sebastián, Gipuzkoa 20009, Spain
- Universidad del País Vasco/Euskal Herriko Unibertsitatea (UPV/EHU), Leioa, Bizkaia 48940, Spain
| | - Ning Mei
- Basque Center on Cognition, Brain and Language (BCBL), Donostia - San Sebastián, Gipuzkoa 20009, Spain
| | - David Soto
- Basque Center on Cognition, Brain and Language (BCBL), Donostia - San Sebastián, Gipuzkoa 20009, Spain
- Ikerbasque, Basque Foundation for Science, Bilbao, Bizkaia 48009, Spain
| |
Collapse
|
43
|
Taeckens EA, Shah S. A spiking neural network with continuous local learning for robust online brain machine interface. J Neural Eng 2024; 20:066042. [PMID: 38173230 DOI: 10.1088/1741-2552/ad1787] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2023] [Accepted: 12/20/2023] [Indexed: 01/05/2024]
Abstract
Objective.Spiking neural networks (SNNs) are powerful tools that are well suited for brain machine interfaces (BMI) due to their similarity to biological neural systems and computational efficiency. They have shown comparable accuracy to state-of-the-art methods, but current training methods require large amounts of memory, and they cannot be trained on a continuous input stream without pausing periodically to perform backpropagation. An ideal BMI should be capable training continuously without interruption to minimize disruption to the user and adapt to changing neural environments.Approach.We propose a continuous SNN weight update algorithm that can be trained to perform regression learning with no need for storing past spiking events in memory. As a result, the amount of memory needed for training is constant regardless of the input duration. We evaluate the accuracy of the network on recordings of neural data taken from the premotor cortex of a primate performing reaching tasks. Additionally, we evaluate the SNN in a simulated closed loop environment and observe its ability to adapt to sudden changes in the input neural structure.Main results.The continuous learning SNN achieves the same peak correlation (ρ=0.7) as existing SNN training methods when trained offline on real neural data while reducing the total memory usage by 92%. Additionally, it matches state-of-the-art accuracy in a closed loop environment, demonstrates adaptability when subjected to multiple types of neural input disruptions, and is capable of being trained online without any prior offline training.Significance.This work presents a neural decoding algorithm that can be trained rapidly in a closed loop setting. The algorithm increases the speed of acclimating a new user to the system and also can adapt to sudden changes in neural behavior with minimal disruption to the user.
Collapse
Affiliation(s)
- Elijah A Taeckens
- Department of Electrical and Computer Engineering, University of Maryland, College Park, United States of America
| | - Sahil Shah
- Department of Electrical and Computer Engineering, University of Maryland, College Park, United States of America
| |
Collapse
|
44
|
Herman AB, Smith EH, Schevon CA, Yates MJ, McKhann GM, Botvinick M, Hayden BY, Sheth SA. Pretrial predictors of conflict response efficacy in the human prefrontal cortex. iScience 2023; 26:108047. [PMID: 37867949 PMCID: PMC10589857 DOI: 10.1016/j.isci.2023.108047] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 07/14/2023] [Accepted: 09/21/2023] [Indexed: 10/24/2023] Open
Abstract
The ability to perform motor actions depends, in part, on the brain's initial state. We hypothesized that initial state dependence is a more general principle and applies to cognitive control. To test this idea, we examined human single units recorded from the dorsolateral prefrontal (dlPFC) cortex and dorsal anterior cingulate cortex (dACC) during a task that interleaves motor and perceptual conflict trials, the multisource interference task (MSIT). In both brain regions, variability in pre-trial firing rates predicted subsequent reaction time (RT) on conflict trials. In dlPFC, ensemble firing rate patterns suggested the existence of domain-specific initial states, while in dACC, firing patterns were more consistent with a domain-general initial state. The deployment of shared and independent factors that we observe for conflict resolution may allow for flexible and fast responses mediated by cognitive initial states. These results also support hypotheses that place dACC hierarchically earlier than dlPFC in proactive control.
Collapse
Affiliation(s)
- Alexander B. Herman
- Department of Psychiatry, University of Minnesota, Minneapolis, MN 55455, USA
| | - Elliot H. Smith
- Department of Neurosurgery, University of Utah, Salt Lake City, UT 84132, USA
- Department of Neurology, Columbia University, NYC, NY 10027, USA
| | | | - Mark J. Yates
- Department of Neurological surgery, Columbia University, NYC, NY 10027, USA
| | - Guy M. McKhann
- Department of Neurological surgery, Columbia University, NYC, NY 10027, USA
| | | | - Benjamin Y. Hayden
- Department of Neuroscience, Center for Magnetic Resonance Research, and Center for Neural Engineering, University of Minnesota, Minneapolis, MN 55455, USA
- McNair Medical Institute, Baylor College of Medicine, Houston, TX 77030, USA
| | - Sameer A. Sheth
- Department of Neurosurgery, Baylor College of Medicine, Houston, TX 77030, USA
- McNair Medical Institute, Baylor College of Medicine, Houston, TX 77030, USA
| |
Collapse
|
45
|
Torell F, Franklin S, Franklin DW, Dimitriou M. Goal-directed modulation of stretch reflex gains is reduced in the non-dominant upper limb. Eur J Neurosci 2023; 58:3981-4001. [PMID: 37727025 DOI: 10.1111/ejn.16148] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/07/2023] [Revised: 08/08/2023] [Accepted: 08/31/2023] [Indexed: 09/21/2023]
Abstract
Most individuals experience their dominant arm as being more dexterous than the non-dominant arm, but the neural mechanisms underlying this asymmetry in motor behaviour are unclear. Using a delayed-reach task, we have recently demonstrated strong goal-directed tuning of stretch reflex gains in the dominant upper limb of human participants. Here, we used an equivalent experimental paradigm to address the neural mechanisms that underlie the preparation for reaching movements with the non-dominant upper limb. There were consistent effects of load, preparatory delay duration and target direction on the long latency stretch reflex. However, by comparing stretch reflex responses in the non-dominant arm with those previously documented in the dominant arm, we demonstrate that goal-directed tuning of short and long latency stretch reflexes is markedly weaker in the non-dominant limb. The results indicate that the motor performance asymmetries across the two upper limbs are partly due to the more sophisticated control of reflexive stiffness in the dominant limb, likely facilitated by the superior goal-directed control of muscle spindle receptors. Our findings therefore suggest that fusimotor control may play a role in determining performance of complex motor behaviours and support existing proposals that the dominant arm is better supplied than the non-dominant arm for executing more complex tasks, such as trajectory control.
Collapse
Affiliation(s)
- Frida Torell
- Physiology Section, Department of Integrative Medical Biology, Umeå University, Umeå, Sweden
| | - Sae Franklin
- Neuromuscular Diagnostics, Department of Sport and Health Sciences, Technical University of Munich, Munich, Germany
| | - David W Franklin
- Neuromuscular Diagnostics, Department of Sport and Health Sciences, Technical University of Munich, Munich, Germany
- Munich Institute of Robotics and Machine Intelligence (MIRMI), Technical University of Munich, Munich, Germany
- Munich Data Science Institute (MDSI), Technical University of Munich, Munich, Germany
| | - Michael Dimitriou
- Physiology Section, Department of Integrative Medical Biology, Umeå University, Umeå, Sweden
| |
Collapse
|
46
|
Zhu J, Hasanbegović H, Liu LD, Gao Z, Li N. Activity map of a cortico-cerebellar loop underlying motor planning. Nat Neurosci 2023; 26:1916-1928. [PMID: 37814026 PMCID: PMC10620095 DOI: 10.1038/s41593-023-01453-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/29/2022] [Accepted: 09/06/2023] [Indexed: 10/11/2023]
Abstract
The neocortex and cerebellum interact to mediate cognitive functions. It remains unknown how the two structures organize into functional networks to mediate specific behaviors. Here we delineate activity supporting motor planning in relation to the mesoscale cortico-cerebellar connectome. In mice planning directional licking based on short-term memory, preparatory activity instructing future movement depends on the anterior lateral motor cortex (ALM) and the cerebellum. Transneuronal tracing revealed divergent and largely open-loop connectivity between the ALM and distributed regions of the cerebellum. A cerebellum-wide survey of neuronal activity revealed enriched preparatory activity in hotspot regions with conjunctive input-output connectivity to the ALM. Perturbation experiments show that the conjunction regions were required for maintaining preparatory activity and correct subsequent movement. Other cerebellar regions contributed little to motor planning despite input or output connectivity to the ALM. These results identify a functional cortico-cerebellar loop and suggest the cerebellar cortex selectively establishes reciprocal cortico-cerebellar communications to orchestrate motor planning.
Collapse
Affiliation(s)
- Jia Zhu
- Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA
| | | | - Liu D Liu
- Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA
| | - Zhenyu Gao
- Department of Neuroscience, Erasmus MC, Rotterdam, the Netherlands.
| | - Nuo Li
- Department of Neuroscience, Baylor College of Medicine, Houston, TX, USA.
| |
Collapse
|
47
|
Verhein JR, Vyas S, Shenoy KV. Methylphenidate modulates motor cortical dynamics and behavior. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.10.15.562405. [PMID: 37905157 PMCID: PMC10614820 DOI: 10.1101/2023.10.15.562405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/02/2023]
Abstract
Methylphenidate (MPH, brand: Ritalin) is a common stimulant used both medically and non-medically. Though typically prescribed for its cognitive effects, MPH also affects movement. While it is known that MPH noncompetitively blocks the reuptake of catecholamines through inhibition of dopamine and norepinephrine transporters, a critical step in exploring how it affects behavior is to understand how MPH directly affects neural activity. This would establish an electrophysiological mechanism of action for MPH. Since we now have biologically-grounded network-level hypotheses regarding how populations of motor cortical neurons plan and execute movements, there is a unique opportunity to make testable predictions regarding how systemic MPH administration - a pharmacological perturbation - might affect neural activity in motor cortex. To that end, we administered clinically-relevant doses of MPH to Rhesus monkeys as they performed an instructed-delay reaching task. Concomitantly, we measured neural activity from dorsal premotor and primary motor cortex. Consistent with our predictions, we found dose-dependent and significant effects on reaction time, trial-by-trial variability, and movement speed. We confirmed our hypotheses that changes in reaction time and variability were accompanied by previously established population-level changes in motor cortical preparatory activity and the condition-independent signal that precedes movements. We expected changes in speed to be a result of changes in the amplitude of motor cortical dynamics and/or a translation of those dynamics in activity space. Instead, our data are consistent with a mechanism whereby the neuromodulatory effect of MPH is to increase the gain and/or the signal-to-noise of motor cortical dynamics during reaching. Continued work in this domain to better understand the brain-wide electrophysiological mechanism of action of MPH and other psychoactive drugs could facilitate more targeted treatments for a host of cognitive-motor disorders.
Collapse
Affiliation(s)
- Jessica R Verhein
- Medical Scientist Training Program, Stanford School of Medicine, Stanford University, Stanford, CA
- Neurosciences Graduate Program, Stanford School of Medicine, Stanford University, Stanford, CA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA
- Current affiliations: Psychiatry Research Residency Training Program, University of California, San Francisco, San Francisco, CA
| | - Saurabh Vyas
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA
- Department of Bioengineering, Stanford University, Stanford, CA
- Mortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, New York, NY
| | - Krishna V Shenoy
- Neurosciences Graduate Program, Stanford School of Medicine, Stanford University, Stanford, CA
- Wu Tsai Neurosciences Institute, Stanford University, Stanford, CA
- Department of Bioengineering, Stanford University, Stanford, CA
- Department of Electrical Engineering, Stanford University, Stanford, CA
- Howard Hughes Medical Institute at Stanford University, Stanford, CA
- Department of Neurobiology, Stanford University, Stanford, CA
- Bio-X Program, Stanford University, Stanford, CA
| |
Collapse
|
48
|
Versteeg C, Sedler AR, McCart JD, Pandarinath C. Expressive dynamics models with nonlinear injective readouts enable reliable recovery of latent features from neural activity. ARXIV 2023:arXiv:2309.06402v1. [PMID: 37744459 PMCID: PMC10516113] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Subscribe] [Scholar Register] [Indexed: 09/26/2023]
Abstract
The advent of large-scale neural recordings has enabled new approaches that aim to discover the computational mechanisms of neural circuits by understanding the rules that govern how their state evolves over time. While these neural dynamics cannot be directly measured, they can typically be approximated by low-dimensional models in a latent space. How these models represent the mapping from latent space to neural space can affect the interpretability of the latent representation. We show that typical choices for this mapping (e.g., linear or MLP) often lack the property of injectivity, meaning that changes in latent state are not obligated to affect activity in the neural space. During training, non-injective readouts incentivize the invention of dynamics that misrepresent the underlying system and the computation it performs. Combining our injective Flow readout with prior work on interpretable latent dynamics models, we created the Ordinary Differential equations autoencoder with Injective Nonlinear readout (ODIN), which learns to capture latent dynamical systems that are nonlinearly embedded into observed neural activity via an approximately injective nonlinear mapping. We show that ODIN can recover nonlinearly embedded systems from simulated neural activity, even when the nature of the system and embedding are unknown. Additionally, we show that ODIN enables the unsupervised recovery of underlying dynamical features (e.g., fixed points) and embedding geometry. When applied to biological neural recordings, ODIN can reconstruct neural activity with comparable accuracy to previous state-of-the-art methods while using substantially fewer latent dimensions. Overall, ODIN's accuracy in recovering ground-truth latent features and ability to accurately reconstruct neural activity with low dimensionality make it a promising method for distilling interpretable dynamics that can help explain neural computation.
Collapse
Affiliation(s)
- Christopher Versteeg
- Wallace H. Coulter Department of Biomedical Engineering Emory University and Georgia Institute of Technology Atlanta, GA, USA
| | - Andrew R Sedler
- Wallace H. Coulter Department of Biomedical Engineering Emory University and Georgia Institute of Technology Atlanta, GA, USA
- Center for Machine Learning Georgia Institute of Technology Atlanta, GA, USA
| | - Jonathan D McCart
- Wallace H. Coulter Department of Biomedical Engineering Emory University and Georgia Institute of Technology Atlanta, GA, USA
- Center for Machine Learning Georgia Institute of Technology Atlanta, GA, USA
| | - Chethan Pandarinath
- Wallace H. Coulter Department of Biomedical Engineering Emory University and Georgia Institute of Technology Atlanta, GA, USA
- Center for Machine Learning Georgia Institute of Technology Atlanta, GA, USA
| |
Collapse
|
49
|
Mangin EN, Chen J, Lin J, Li N. Behavioral measurements of motor readiness in mice. Curr Biol 2023; 33:3610-3624.e4. [PMID: 37582373 PMCID: PMC10529875 DOI: 10.1016/j.cub.2023.07.029] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/26/2023] [Revised: 05/09/2023] [Accepted: 07/18/2023] [Indexed: 08/17/2023]
Abstract
Motor planning facilitates rapid and precise execution of volitional movements. Although motor planning has been classically studied in humans and monkeys, the mouse has become an increasingly popular model system to study neural mechanisms of motor planning. It remains yet untested whether mice and primates share common behavioral features of motor planning. We combined videography and a delayed response task paradigm in an autonomous behavioral system to measure motor planning in non-body-restrained mice. Motor planning resulted in both reaction time (RT) savings and increased movement accuracy, replicating classic effects in primates. We found that motor planning was reflected in task-relevant body features. Both the specific actions prepared and the degree of motor readiness could be read out online during motor planning. The online readout further revealed behavioral evidence of simultaneous preparation for multiple actions under uncertain conditions. These results validate the mouse as a model to study motor planning, demonstrate body feature movements as a powerful real-time readout of motor readiness, and offer behavioral evidence that motor planning can be a parallel process that permits rapid selection of multiple prepared actions.
Collapse
Affiliation(s)
- Elise N Mangin
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA
| | - Jian Chen
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA
| | - Jing Lin
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA
| | - Nuo Li
- Department of Neuroscience, Baylor College of Medicine, Houston, TX 77030, USA.
| |
Collapse
|
50
|
Denyer R, Greenhouse I, Boyd LA. PMd and action preparation: bridging insights between TMS and single neuron research. Trends Cogn Sci 2023; 27:759-772. [PMID: 37244800 DOI: 10.1016/j.tics.2023.05.001] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/08/2022] [Revised: 05/01/2023] [Accepted: 05/02/2023] [Indexed: 05/29/2023]
Abstract
Transcranial magnetic stimulation (TMS) research has furthered understanding of human dorsal premotor cortex (PMd) function due to its unrivalled ability to measure the inhibitory and facilitatory influences of PMd over the primary motor cortex (M1) in a temporally precise manner. TMS research indicates that PMd transiently modulates inhibitory output to effector representations within M1 during motor preparation, with the direction of modulation depending on which effectors are selected for response, and the timing of modulations co-varying with task selection demands. In this review, we critically assess this literature in the context of a dynamical systems approach used to model nonhuman primate (NHP) PMd/M1 single-neuron recordings during action preparation. Through this process, we identify gaps in the literature and propose future experiments.
Collapse
Affiliation(s)
- Ronan Denyer
- Department of Physical Therapy, University of British Columbia, Vancouver, BC, V6T1Z3, Canada; Graduate Program in Neuroscience, University of British Columbia, Vancouver, BC, V6T1Z3, Canada.
| | - Ian Greenhouse
- Department of Human Physiology, University of Oregon, Eugene, OR 97401, USA
| | - Lara A Boyd
- Department of Physical Therapy, University of British Columbia, Vancouver, BC, V6T1Z3, Canada
| |
Collapse
|