1
|
Fooken J, Baltaretu BR, Barany DA, Diaz G, Semrau JA, Singh T, Crawford JD. Perceptual-Cognitive Integration for Goal-Directed Action in Naturalistic Environments. J Neurosci 2023; 43:7511-7522. [PMID: 37940592 PMCID: PMC10634571 DOI: 10.1523/jneurosci.1373-23.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2023] [Revised: 08/15/2023] [Accepted: 08/18/2023] [Indexed: 11/10/2023] Open
Abstract
Real-world actions require one to simultaneously perceive, think, and act on the surrounding world, requiring the integration of (bottom-up) sensory information and (top-down) cognitive and motor signals. Studying these processes involves the intellectual challenge of cutting across traditional neuroscience silos, and the technical challenge of recording data in uncontrolled natural environments. However, recent advances in techniques, such as neuroimaging, virtual reality, and motion tracking, allow one to address these issues in naturalistic environments for both healthy participants and clinical populations. In this review, we survey six topics in which naturalistic approaches have advanced both our fundamental understanding of brain function and how neurologic deficits influence goal-directed, coordinated action in naturalistic environments. The first part conveys fundamental neuroscience mechanisms related to visuospatial coding for action, adaptive eye-hand coordination, and visuomotor integration for manual interception. The second part discusses applications of such knowledge to neurologic deficits, specifically, steering in the presence of cortical blindness, impact of stroke on visual-proprioceptive integration, and impact of visual search and working memory deficits. This translational approach-extending knowledge from lab to rehab-provides new insights into the complex interplay between perceptual, motor, and cognitive control in naturalistic tasks that are relevant for both basic and clinical research.
Collapse
Affiliation(s)
- Jolande Fooken
- Centre for Neuroscience, Queen's University, Kingston, Ontario K7L3N6, Canada
| | - Bianca R Baltaretu
- Department of Psychology, Justus Liebig University, Giessen, 35394, Germany
| | - Deborah A Barany
- Department of Kinesiology, University of Georgia, and Augusta University/University of Georgia Medical Partnership, Athens, Georgia 30602
| | - Gabriel Diaz
- Center for Imaging Science, Rochester Institute of Technology, Rochester, New York 14623
| | - Jennifer A Semrau
- Department of Kinesiology and Applied Physiology, University of Delaware, Newark, Delaware 19713
| | - Tarkeshwar Singh
- Department of Kinesiology, Pennsylvania State University, University Park, Pennsylvania 16802
| | - J Douglas Crawford
- Centre for Integrative and Applied Neuroscience, York University, Toronto, Ontario M3J 1P3, Canada
| |
Collapse
|
2
|
Alterations in Corticocortical Vestibular Network Functional Connectivity Are Associated with Decreased Balance Ability in Elderly Individuals with Mild Cognitive Impairment. Brain Sci 2022; 13:brainsci13010063. [PMID: 36672045 PMCID: PMC9856347 DOI: 10.3390/brainsci13010063] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2022] [Revised: 12/19/2022] [Accepted: 12/27/2022] [Indexed: 12/31/2022] Open
Abstract
The corticocortical vestibular network (CVN) plays an important role in maintaining balance and stability. In order to clarify the specific relationship between the CVN and the balance ability of patients with mild cognitive impairment (MCI), we recruited 30 MCI patients in the community. According to age and sex, they were 1:1 matched to 30 older adults with normal cognitive function. We evaluated balance ability and performed MRI scanning in the two groups of participants. We analyzed functional connectivity within the CVN based on the region of interest. Then, we performed a Pearson correlation analysis between the functional connection and the Berg Balance Scale scores. The research results show that compared with the control group, there were three pairs of functional connections (hMST_R−Premotor_R, PFcm_R−SMA_L, and hMST_L−VIP_R) that were significantly decreased in the CVNs of the MCI group (p < 0.05). Further correlation analysis showed that there was a significant positive correlation between hMST_R−Premotor_R functional connectivity and BBS score (r = 0.364, p = 0.004). The decline in balance ability and increase in fall risk in patients with MCI may be closely related to the change in the internal connection mode of the corticocortical vestibular network.
Collapse
|
3
|
Sulpizio V, Strappini F, Fattori P, Galati G, Galletti C, Pecchinenda A, Pitzalis S. The human middle temporal cortex responds to both active leg movements and egomotion-compatible visual motion. Brain Struct Funct 2022; 227:2573-2592. [PMID: 35963915 DOI: 10.1007/s00429-022-02549-z] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Accepted: 08/03/2022] [Indexed: 11/28/2022]
Abstract
The human middle-temporal region MT+ is highly specialized in processing visual motion. However, recent studies have shown that this region is modulated by extraretinal signals, suggesting a possible involvement in processing motion information also from non-visual modalities. Here, we used functional MRI data to investigate the influence of retinal and extraretinal signals on MT+ in a large sample of subjects. Moreover, we used resting-state functional MRI to assess how the subdivisions of MT+ (i.e., MST, FST, MT, and V4t) are functionally connected. We first compared responses in MST, FST, MT, and V4t to coherent vs. random visual motion. We found that only MST and FST were positively activated by coherent motion. Furthermore, regional analyses revealed that MST and FST were positively activated by leg, but not arm, movements, while MT and V4t were deactivated by arm, but not leg, movements. Taken together, regional analyses revealed a visuomotor role for the anterior areas MST and FST and a pure visual role for the anterior areas MT and V4t. These findings were mirrored by the pattern of functional connections between these areas and the rest of the brain. Visual and visuomotor regions showed distinct patterns of functional connectivity, with the latter preferentially connected with the somatosensory and motor areas representing leg and foot. Overall, these findings reveal a functional sensitivity for coherent visual motion and lower-limb movements in MST and FST, suggesting their possible involvement in integrating sensory and motor information to perform locomotion.
Collapse
Affiliation(s)
- Valentina Sulpizio
- Brain Imaging Laboratory, Department of Psychology, Sapienza University, Rome, Italy
- Department of Cognitive and Motor Rehabilitation and Neuroimaging, Santa Lucia Foundation (IRCCS Fondazione Santa Lucia), Rome, Italy
| | | | - Patrizia Fattori
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | - Gaspare Galati
- Brain Imaging Laboratory, Department of Psychology, Sapienza University, Rome, Italy
- Department of Cognitive and Motor Rehabilitation and Neuroimaging, Santa Lucia Foundation (IRCCS Fondazione Santa Lucia), Rome, Italy
| | - Claudio Galletti
- Department of Biomedical and Neuromotor Sciences, University of Bologna, Bologna, Italy
| | | | - Sabrina Pitzalis
- Department of Cognitive and Motor Rehabilitation and Neuroimaging, Santa Lucia Foundation (IRCCS Fondazione Santa Lucia), Rome, Italy.
- Department of Movement, Human and Health Sciences, University of Rome ''Foro Italico'', 00194, Rome, Italy.
| |
Collapse
|
4
|
Chen K, Beyeler M, Krichmar JL. Cortical Motion Perception Emerges from Dimensionality Reduction with Evolved Spike-Timing-Dependent Plasticity Rules. J Neurosci 2022; 42:5882-5898. [PMID: 35732492 PMCID: PMC9337611 DOI: 10.1523/jneurosci.0384-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/18/2022] [Revised: 05/16/2022] [Accepted: 06/08/2022] [Indexed: 01/29/2023] Open
Abstract
The nervous system is under tight energy constraints and must represent information efficiently. This is particularly relevant in the dorsal part of the medial superior temporal area (MSTd) in primates where neurons encode complex motion patterns to support a variety of behaviors. A sparse decomposition model based on a dimensionality reduction principle known as non-negative matrix factorization (NMF) was previously shown to account for a wide range of monkey MSTd visual response properties. This model resulted in sparse, parts-based representations that could be regarded as basis flow fields, a linear superposition of which accurately reconstructed the input stimuli. This model provided evidence that the seemingly complex response properties of MSTd may be a by-product of MSTd neurons performing dimensionality reduction on their input. However, an open question is how a neural circuit could carry out this function. In the current study, we propose a spiking neural network (SNN) model of MSTd based on evolved spike-timing-dependent plasticity and homeostatic synaptic scaling (STDP-H) learning rules. We demonstrate that the SNN model learns compressed and efficient representations of the input patterns similar to the patterns that emerge from NMF, resulting in MSTd-like receptive fields observed in monkeys. This SNN model suggests that STDP-H observed in the nervous system may be performing a similar function as NMF with sparsity constraints, which provides a test bed for mechanistic theories of how MSTd may efficiently encode complex patterns of visual motion to support robust self-motion perception.SIGNIFICANCE STATEMENT The brain may use dimensionality reduction and sparse coding to efficiently represent stimuli under metabolic constraints. Neurons in monkey area MSTd respond to complex optic flow patterns resulting from self-motion. We developed a spiking neural network model that showed MSTd-like response properties can emerge from evolving spike-timing-dependent plasticity with STDP-H parameters of the connections between then middle temporal area and MSTd. Simulated MSTd neurons formed a sparse, reduced population code capable of encoding perceptual variables important for self-motion perception. This model demonstrates that complex neuronal responses observed in MSTd may emerge from efficient coding and suggests that neurobiological plasticity, like STDP-H, may contribute to reducing the dimensions of input stimuli and allowing spiking neurons to learn sparse representations.
Collapse
Affiliation(s)
| | - Michael Beyeler
- Departments of Computer Science
- Psychological & Brain Sciences, University of California, Santa Barbara, California 93106
| | - Jeffrey L Krichmar
- Departments of Cognitive Sciences
- Computer Science, University of California, Irvine, California 92697
| |
Collapse
|
5
|
Smith AT. Cortical visual area CSv as a cingulate motor area: a sensorimotor interface for the control of locomotion. Brain Struct Funct 2021; 226:2931-2950. [PMID: 34240236 PMCID: PMC8541968 DOI: 10.1007/s00429-021-02325-5] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2021] [Accepted: 06/17/2021] [Indexed: 12/26/2022]
Abstract
The response properties, connectivity and function of the cingulate sulcus visual area (CSv) are reviewed. Cortical area CSv has been identified in both human and macaque brains. It has similar response properties and connectivity in the two species. It is situated bilaterally in the cingulate sulcus close to an established group of medial motor/premotor areas. It has strong connectivity with these areas, particularly the cingulate motor areas and the supplementary motor area, suggesting that it is involved in motor control. CSv is active during visual stimulation but only if that stimulation is indicative of self-motion. It is also active during vestibular stimulation and connectivity data suggest that it receives proprioceptive input. Connectivity with topographically organized somatosensory and motor regions strongly emphasizes the legs over the arms. Together these properties suggest that CSv provides a key interface between the sensory and motor systems in the control of locomotion. It is likely that its role involves online control and adjustment of ongoing locomotory movements, including obstacle avoidance and maintaining the intended trajectory. It is proposed that CSv is best seen as part of the cingulate motor complex. In the human case, a modification of the influential scheme of Picard and Strick (Picard and Strick, Cereb Cortex 6:342–353, 1996) is proposed to reflect this.
Collapse
Affiliation(s)
- Andrew T Smith
- Department of Psychology, Royal Holloway, University of London, Egham, TW20 0EX, UK.
| |
Collapse
|
6
|
Schmitt C, Schwenk JCB, Schütz A, Churan J, Kaminiarz A, Bremmer F. Preattentive processing of visually guided self-motion in humans and monkeys. Prog Neurobiol 2021; 205:102117. [PMID: 34224808 DOI: 10.1016/j.pneurobio.2021.102117] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2020] [Revised: 06/15/2021] [Accepted: 06/29/2021] [Indexed: 10/20/2022]
Abstract
The visually-based control of self-motion is a challenging task, requiring - if needed - immediate adjustments to keep on track. Accordingly, it would appear advantageous if the processing of self-motion direction (heading) was predictive, thereby accelerating the encoding of unexpected changes, and un-impaired by attentional load. We tested this hypothesis by recording EEG in humans and macaque monkeys with similar experimental protocols. Subjects viewed a random dot pattern simulating self-motion across a ground plane in an oddball EEG paradigm. Standard and deviant trials differed only in their simulated heading direction (forward-left vs. forward-right). Event-related potentials (ERPs) were compared in order to test for the occurrence of a visual mismatch negativity (vMMN), a component that reflects preattentive and likely also predictive processing of sensory stimuli. Analysis of the ERPs revealed signatures of a prediction mismatch for deviant stimuli in both humans and monkeys. In humans, a MMN was observed starting 110 ms after self-motion onset. In monkeys, peak response amplitudes following deviant stimuli were enhanced compared to the standard already 100 ms after self-motion onset. We consider our results strong evidence for a preattentive processing of visual self-motion information in humans and monkeys, allowing for ultrafast adjustments of their heading direction.
Collapse
Affiliation(s)
- Constanze Schmitt
- Dept. Neurophysics, Philipps-Universität Marburg, Marburg, Germany; Center for Mind, Brain and Behavior - CMBB, Philipps-Universität Marburg and Justus-Liebig Universität Giessen, Germany.
| | - Jakob C B Schwenk
- Dept. Neurophysics, Philipps-Universität Marburg, Marburg, Germany; Center for Mind, Brain and Behavior - CMBB, Philipps-Universität Marburg and Justus-Liebig Universität Giessen, Germany.
| | - Adrian Schütz
- Dept. Neurophysics, Philipps-Universität Marburg, Marburg, Germany; Center for Mind, Brain and Behavior - CMBB, Philipps-Universität Marburg and Justus-Liebig Universität Giessen, Germany.
| | - Jan Churan
- Dept. Neurophysics, Philipps-Universität Marburg, Marburg, Germany; Center for Mind, Brain and Behavior - CMBB, Philipps-Universität Marburg and Justus-Liebig Universität Giessen, Germany.
| | - André Kaminiarz
- Dept. Neurophysics, Philipps-Universität Marburg, Marburg, Germany; Center for Mind, Brain and Behavior - CMBB, Philipps-Universität Marburg and Justus-Liebig Universität Giessen, Germany.
| | - Frank Bremmer
- Dept. Neurophysics, Philipps-Universität Marburg, Marburg, Germany; Center for Mind, Brain and Behavior - CMBB, Philipps-Universität Marburg and Justus-Liebig Universität Giessen, Germany.
| |
Collapse
|