1
|
Rolls ET, Zhang C, Feng J. Hippocampal storage and recall of neocortical "What"-"Where" representations. Hippocampus 2024; 34:608-624. [PMID: 39221708 DOI: 10.1002/hipo.23636] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/08/2024] [Revised: 06/07/2024] [Accepted: 08/19/2024] [Indexed: 09/04/2024]
Abstract
A key question for understanding the function of the hippocampus in memory is how information is recalled from the hippocampus to the neocortex. This was investigated in a neuronal network model of the hippocampal system in which "What" and "Where" neuronal firing rate vectors were applied to separate neocortical modules, which then activated entorhinal cortex "What" and "Where" modules, then the dentate gyrus, then CA3, then CA1, then the entorhinal cortex, and then the backprojections to the neocortex. A rate model showed that the whole system could be trained to recall "Where" in the neocortex from "What" applied as a retrieval cue to the neocortex, and could in principle be trained up towards the theoretical capacity determined largely by the number of synapses onto any one neuron divided by the sparseness of the representation. The trained synaptic weights were then imported into an integrate-and-fire simulation of the same architecture, which showed that the time from presenting a retrieval cue to a neocortex module to recall the whole memory in the neocortex is approximately 100 ms. This is sufficiently fast for the backprojection synapses to be trained onto the still active neocortical neurons during storage of the episodic memory, and this is needed for recall to operate correctly to the neocortex. These simulations also showed that the long loop neocortex-hippocampus-neocortex that operates continuously in time may contribute to complete recall in the neocortex; but that this positive feedback long loop makes the whole dynamical system inherently liable to a pathological increase in neuronal activity. Important factors that contributed to stability included increased inhibition in CA3 and CA1 to keep the firing rates low; and temporal adaptation of the neuronal firing and of active synapses, which are proposed to make an important contribution to stabilizing runaway excitation in cortical circuits in the brain.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK
- Department of Computer Science, University of Warwick, Coventry, UK
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, China
| | - Chenfei Zhang
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, China
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry, UK
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, China
| |
Collapse
|
2
|
Thompson JAF, Sheahan H, Dumbalska T, Sandbrink JD, Piazza M, Summerfield C. Zero-shot counting with a dual-stream neural network model. Neuron 2024:S0896-6273(24)00729-3. [PMID: 39488209 DOI: 10.1016/j.neuron.2024.10.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2024] [Revised: 08/06/2024] [Accepted: 10/06/2024] [Indexed: 11/04/2024]
Abstract
To understand a visual scene, observers need to both recognize objects and encode relational structure. For example, a scene comprising three apples requires the observer to encode concepts of "apple" and "three." In the primate brain, these functions rely on dual (ventral and dorsal) processing streams. Object recognition in primates has been successfully modeled with deep neural networks, but how scene structure (including numerosity) is encoded remains poorly understood. Here, we built a deep learning model, based on the dual-stream architecture of the primate brain, which is able to count items "zero-shot"-even if the objects themselves are unfamiliar. Our dual-stream network forms spatial response fields and lognormal number codes that resemble those observed in the macaque posterior parietal cortex. The dual-stream network also makes successful predictions about human counting behavior. Our results provide evidence for an enactive theory of the role of the posterior parietal cortex in visual scene understanding.
Collapse
Affiliation(s)
- Jessica A F Thompson
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK.
| | - Hannah Sheahan
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK
| | | | - Julian D Sandbrink
- Department of Experimental Psychology, University of Oxford, Oxford OX2 6GG, UK
| | - Manuela Piazza
- University of Trento, Department of Psychology and Cognitive Science, Trento 38068, Italy
| | | |
Collapse
|
3
|
Rolls ET, Zhang R, Deco G, Vatansever D, Feng J. Selective Brain Activations and Connectivities Related to the Storage and Recall of Human Object-Location, Reward-Location, and Word-Pair Episodic Memories. Hum Brain Mapp 2024; 45:e70056. [PMID: 39436048 PMCID: PMC11494686 DOI: 10.1002/hbm.70056] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2024] [Revised: 09/06/2024] [Accepted: 10/04/2024] [Indexed: 10/23/2024] Open
Abstract
Different cortical systems to the hippocampus were activated using fMRI during different types of episodic memory task. For object with scene location episodic memory, the activations were high in cortical systems involved in spatial processing, including the ventromedial visual and medial parahippocampal system. These activations for the medial parahippocampal system were higher in the right hemisphere. The activations in the face and object processing ventrolateral visual cortical stream regions FFC, PIT, V8 and TE2p were higher in the object-location in scene task than the reward-location task, and were higher in the right hemisphere. For reward-location in scene episodic memory, activations were also high in the ventromedial visual cortical spatial stream to the hippocampus, but were also selectively high in storage in key reward cortical regions (ventromedial prefrontal 10r, 10v, 10d; pregenual anterior cingulate d32, p24, p32, s32; and medial orbitofrontal cortex reward-related pOFC, 11l, OFC). For word-pair episodic memory, activations were lower in the ventromedial visual and medial parahippocampal spatial cortical stream, and were higher in language-related regions in Broca's area (44, 45, 47l), and were higher in the left hemisphere for these regions and for the many highly connected inferior frontal gyrus regions in the left hemisphere. Further, effective connectivity analyses during the episodic memory tasks showed that the direction of connectivity for these systems was from early visual cortical regions V2-V4 to the ventromedial visual cortical regions VMV1-3 and VVC for spatial scene processing; was from the pregenual anterior cingulate and orbitofrontal cortex reward systems to the hippocampal system; and was from the FFC/V8/PIT system to TE2p in the visual inferior temporal visual cortex, which has connectivity to lateral parahippocampal TF, which in turn has forward effective connectivity to the hippocampus.
Collapse
Affiliation(s)
- Edmund T. Rolls
- Department of Computer ScienceUniversity of WarwickCoventryUK
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan UniversityShanghaiChina
- Oxford Centre for Computational NeuroscienceOxfordUK
| | - Ruohan Zhang
- Department of Computer ScienceUniversity of WarwickCoventryUK
| | - Gustavo Deco
- Center for Brain and Cognition, Computational Neuroscience Group, Department of Information and Communication TechnologiesUniversitat Pompeu FabraBarcelonaSpain
- Brain and Cognition, Pompeu Fabra UniversityBarcelonaSpain
- Institució Catalana de la Recerca i Estudis Avançats (ICREA), Universitat Pompeu FabraBarcelonaSpain
| | - Deniz Vatansever
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan UniversityShanghaiChina
| | - Jianfeng Feng
- Department of Computer ScienceUniversity of WarwickCoventryUK
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan UniversityShanghaiChina
| |
Collapse
|
4
|
Zbären GA, Kapur M, Meissner SN, Wenderoth N. Inferring occluded projectile motion changes connectivity within a visuo-fronto-parietal network. Brain Struct Funct 2024; 229:1605-1615. [PMID: 38914897 PMCID: PMC11374914 DOI: 10.1007/s00429-024-02815-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/16/2023] [Accepted: 06/03/2024] [Indexed: 06/26/2024]
Abstract
Anticipating the behaviour of moving objects in the physical environment is essential for a wide range of daily actions. This ability is thought to rely on mental simulations and has been shown to involve frontoparietal and early visual areas. Yet, the connectivity patterns between these regions during intuitive physical inference remain largely unknown. In this study, participants underwent fMRI while performing a task requiring them to infer the parabolic trajectory of an occluded ball falling under Newtonian physics, and a control task. Building on our previous research showing that when solving the physical inference task, early visual areas encode task-specific and perception-like information about the inferred trajectory, the present study aimed to (i) identify regions that are functionally coupled with early visual areas during the physical inference task, and (ii) investigate changes in effective connectivity within this network of regions. We found that early visual areas are functionally connected to a set of parietal and premotor regions when inferring occluded trajectories. Using dynamic causal modelling, we show that predicting occluded trajectories is associated with changes in effective connectivity within a parieto-premotor network, which may drive internally generated early visual activity in a top-down fashion. These findings offer new insights into the interaction between early visual and frontoparietal regions during physical inference, contributing to our understanding of the neural mechanisms underlying the ability to predict physical outcomes.
Collapse
Affiliation(s)
- Gabrielle Aude Zbären
- Neural Control of Movement Lab, Department of Health Science and technology, ETH Zurich, Zurich, Switzerland.
| | - Manu Kapur
- Professorship for Learning Sciences and Higher Education, ETH Zurich, Zurich, Switzerland
| | - Sarah Nadine Meissner
- Neural Control of Movement Lab, Department of Health Science and technology, ETH Zurich, Zurich, Switzerland
| | - Nicole Wenderoth
- Neural Control of Movement Lab, Department of Health Science and technology, ETH Zurich, Zurich, Switzerland
- Future Health Technologies, Singapore-ETH Centre, Campus for Research Excellence And Technological Enterprise (CREATE), Singapore, Singapore
| |
Collapse
|
5
|
Rolls ET, Yan X, Deco G, Zhang Y, Jousmaki V, Feng J. A ventromedial visual cortical 'Where' stream to the human hippocampus for spatial scenes revealed with magnetoencephalography. Commun Biol 2024; 7:1047. [PMID: 39183244 PMCID: PMC11345434 DOI: 10.1038/s42003-024-06719-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/20/2024] [Accepted: 08/12/2024] [Indexed: 08/27/2024] Open
Abstract
The primate including the human hippocampus implicated in episodic memory and navigation represents a spatial view, very different from the place representations in rodents. To understand this system in humans, and the computations performed, the pathway for this spatial view information to reach the hippocampus was analysed in humans. Whole-brain effective connectivity was measured with magnetoencephalography between 30 visual cortical regions and 150 other cortical regions using the HCP-MMP1 atlas in 21 participants while performing a 0-back scene memory task. In a ventromedial visual stream, V1-V4 connect to the ProStriate region where the retrosplenial scene area is located. The ProStriate region has connectivity to ventromedial visual regions VMV1-3 and VVC. These ventromedial regions connect to the medial parahippocampal region PHA1-3, which, with the VMV regions, include the parahippocampal scene area. The medial parahippocampal regions have effective connectivity to the entorhinal cortex, perirhinal cortex, and hippocampus. In contrast, when viewing faces, the effective connectivity was more through a ventrolateral visual cortical stream via the fusiform face cortex to the inferior temporal visual cortex regions TE2p and TE2a. A ventromedial visual cortical 'Where' stream to the hippocampus for spatial scenes was supported by diffusion topography in 171 HCP participants at 7 T.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK.
- Department of Computer Science, University of Warwick, Coventry, UK.
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, China.
| | - Xiaoqian Yan
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, China
| | - Gustavo Deco
- Department of Information and Communication Technologies, Center for Brain and Cognition, Computational Neuroscience Group, Universitat Pompeu Fabra, Barcelona, Spain
- Institució Catalana de la Recerca i Estudis Avançats (ICREA), Universitat Pompeu Fabra, Passeig Lluís Companys 23, Barcelona, Spain
| | - Yi Zhang
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, China
| | - Veikko Jousmaki
- Aalto NeuroImaging, Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry, UK
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, China
| |
Collapse
|
6
|
Mas-Cuesta L, Baltruschat S, Cándido A, Catena A. Brain signatures of catastrophic events: Emotion, salience, and cognitive control. Psychophysiology 2024:e14674. [PMID: 39169571 DOI: 10.1111/psyp.14674] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2023] [Revised: 06/10/2024] [Accepted: 08/08/2024] [Indexed: 08/23/2024]
Abstract
Anticipatory brain activity makes it possible to predict the occurrence of expected situations. However, events such as traffic accidents are statistically unpredictable and can generate catastrophic consequences. This study investigates the brain activity and effective connectivity associated with anticipating and processing such unexpected, unavoidable accidents. We asked 161 participants to ride a motorcycle simulator while recording their electroencephalographic activity. Of these, 90 participants experienced at least one accident while driving. We conducted both within-subjects and between-subjects comparisons. During the pre-accident period, the right inferior parietal lobe (IPL), left anterior cingulate cortex (ACC), and right insula showed higher activity in the accident condition. In the post-accident period, the bilateral orbitofrontal cortex, right IPL, bilateral ACC, and middle and superior frontal gyrus also showed increased activity in the accident condition. We observed greater effective connectivity within the nodes of the limbic network (LN) and between the nodes of the attentional networks in the pre-accident period. In the post-accident period, we also observed greater effective connectivity between networks, from the ventral attention network (VAN) to the somatomotor network and from nodes in the visual network, VAN, and default mode network to nodes in the frontoparietal network, LN, and attentional networks. This suggests that activating salience-related processes and emotional processing allows the anticipation of accidents. Once an accident has occurred, integration and valuation of the new information takes place, and control processes are initiated to adapt behavior to the new demands of the environment.
Collapse
Affiliation(s)
- Laura Mas-Cuesta
- Mind, Brain and Behavior Research Center, University of Granada, Campus de Cartuja s/n, Granada, Spain
| | - Sabina Baltruschat
- Mind, Brain and Behavior Research Center, University of Granada, Campus de Cartuja s/n, Granada, Spain
| | - Antonio Cándido
- Mind, Brain and Behavior Research Center, University of Granada, Campus de Cartuja s/n, Granada, Spain
| | - Andrés Catena
- School of Psychology, University of Granada, Campus de Cartuja s/n, Granada, Spain
| |
Collapse
|
7
|
Rolls ET, Treves A. A theory of hippocampal function: New developments. Prog Neurobiol 2024; 238:102636. [PMID: 38834132 DOI: 10.1016/j.pneurobio.2024.102636] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2024] [Revised: 04/15/2024] [Accepted: 05/30/2024] [Indexed: 06/06/2024]
Abstract
We develop further here the only quantitative theory of the storage of information in the hippocampal episodic memory system and its recall back to the neocortex. The theory is upgraded to account for a revolution in understanding of spatial representations in the primate, including human, hippocampus, that go beyond the place where the individual is located, to the location being viewed in a scene. This is fundamental to much primate episodic memory and navigation: functions supported in humans by pathways that build 'where' spatial view representations by feature combinations in a ventromedial visual cortical stream, separate from those for 'what' object and face information to the inferior temporal visual cortex, and for reward information from the orbitofrontal cortex. Key new computational developments include the capacity of the CA3 attractor network for storing whole charts of space; how the correlations inherent in self-organizing continuous spatial representations impact the storage capacity; how the CA3 network can combine continuous spatial and discrete object and reward representations; the roles of the rewards that reach the hippocampus in the later consolidation into long-term memory in part via cholinergic pathways from the orbitofrontal cortex; and new ways of analysing neocortical information storage using Potts networks.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK; Department of Computer Science, University of Warwick, Coventry CV4 7AL, UK.
| | | |
Collapse
|
8
|
Rolls ET, Feng J, Zhang R. Selective activations and functional connectivities to the sight of faces, scenes, body parts and tools in visual and non-visual cortical regions leading to the human hippocampus. Brain Struct Funct 2024; 229:1471-1493. [PMID: 38839620 PMCID: PMC11176242 DOI: 10.1007/s00429-024-02811-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Accepted: 05/22/2024] [Indexed: 06/07/2024]
Abstract
Connectivity maps are now available for the 360 cortical regions in the Human Connectome Project Multimodal Parcellation atlas. Here we add function to these maps by measuring selective fMRI activations and functional connectivity increases to stationary visual stimuli of faces, scenes, body parts and tools from 956 HCP participants. Faces activate regions in the ventrolateral visual cortical stream (FFC), in the superior temporal sulcus (STS) visual stream for face and head motion; and inferior parietal visual (PGi) and somatosensory (PF) regions. Scenes activate ventromedial visual stream VMV and PHA regions in the parahippocampal scene area; medial (7m) and lateral parietal (PGp) regions; and the reward-related medial orbitofrontal cortex. Body parts activate the inferior temporal cortex object regions (TE1p, TE2p); but also visual motion regions (MT, MST, FST); and the inferior parietal visual (PGi, PGs) and somatosensory (PF) regions; and the unpleasant-related lateral orbitofrontal cortex. Tools activate an intermediate ventral stream area (VMV3, VVC, PHA3); visual motion regions (FST); somatosensory (1, 2); and auditory (A4, A5) cortical regions. The findings add function to cortical connectivity maps; and show how stationary visual stimuli activate other cortical regions related to their associations, including visual motion, somatosensory, auditory, semantic, and orbitofrontal cortex value-related, regions.
Collapse
Affiliation(s)
- Edmund T Rolls
- Department of Computer Science, University of Warwick, Coventry, CV4 7AL, UK.
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, 200403, China.
- Oxford Centre for Computational Neuroscience, Oxford, UK.
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry, CV4 7AL, UK
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, 200403, China
| | - Ruohan Zhang
- Department of Computer Science, University of Warwick, Coventry, CV4 7AL, UK.
| |
Collapse
|
9
|
Cattarinussi G, Di Camillo F, Grimaldi DA, Sambataro F. Diagnostic value of regional homogeneity and fractional amplitude of low-frequency fluctuations in the classification of schizophrenia and bipolar disorders. Eur Arch Psychiatry Clin Neurosci 2024:10.1007/s00406-024-01838-4. [PMID: 38914853 DOI: 10.1007/s00406-024-01838-4] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/12/2024] [Accepted: 06/03/2024] [Indexed: 06/26/2024]
Abstract
Schizophrenia (SCZ) and bipolar disorders (BD) show significant neurobiological and clinical overlap. In this study, we wanted to identify indexes of intrinsic brain activity that could differentiate these disorders. We compared the diagnostic value of the fractional amplitude of low-frequency fluctuations (fALFF) and regional homogeneity (ReHo) estimated from resting-state functional magnetic resonance imaging in a support vector machine classification of 59 healthy controls (HC), 40 individuals with SCZ, and 43 individuals with BD type I. The best performance, measured by balanced accuracy (BAC) for binary classification relative to HC was achieved by a stacking model (87.4% and 90.6% for SCZ and BD, respectively), with ReHo performing better than fALFF, both in SCZ (86.2% vs. 79.4%) and BD (89.9% vs. 76.9%). BD were better differentiated from HC by fronto-temporal ReHo and striato-temporo-thalamic fALFF. SCZ were better classified from HC using fronto-temporal-cerebellar ReHo and insulo-tempo-parietal-cerebellar fALFF. In conclusion, we provided evidence of widespread aberrancies of spontaneous activity and local connectivity in SCZ and BD, demonstrating that ReHo features exhibited superior discriminatory power compared to fALFF and achieved higher classification accuracies. Our results support the complementarity of these measures in the classification of SCZ and BD and suggest the potential for multivariate integration to improve diagnostic precision.
Collapse
Affiliation(s)
- Giulia Cattarinussi
- Department of Neuroscience (DNS), Padova Neuroscience Center (PNC), University of Padova, Azienda Ospedaliera di Padova, Via Giustiniani, 2, Padua, I-35128, Italy
- Padova Neuroscience Center, University of Padova, Padua, Italy
- Department of Psychological Medicine, Institute of Psychiatry, Psychology and Neuroscience, King's College London, London, UK
| | - Fabio Di Camillo
- Department of Neuroscience (DNS), Padova Neuroscience Center (PNC), University of Padova, Azienda Ospedaliera di Padova, Via Giustiniani, 2, Padua, I-35128, Italy
| | - David Antonio Grimaldi
- Department of Neuroscience (DNS), Padova Neuroscience Center (PNC), University of Padova, Azienda Ospedaliera di Padova, Via Giustiniani, 2, Padua, I-35128, Italy
| | - Fabio Sambataro
- Department of Neuroscience (DNS), Padova Neuroscience Center (PNC), University of Padova, Azienda Ospedaliera di Padova, Via Giustiniani, 2, Padua, I-35128, Italy.
- Padova Neuroscience Center, University of Padova, Padua, Italy.
| |
Collapse
|
10
|
Sulpizio V, Teghil A, Pitzalis S, Boccia M. Common and specific activations supporting optic flow processing and navigation as revealed by a meta-analysis of neuroimaging studies. Brain Struct Funct 2024; 229:1021-1045. [PMID: 38592557 PMCID: PMC11147901 DOI: 10.1007/s00429-024-02790-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2023] [Accepted: 03/12/2024] [Indexed: 04/10/2024]
Abstract
Optic flow provides useful information in service of spatial navigation. However, whether brain networks supporting these two functions overlap is still unclear. Here we used Activation Likelihood Estimation (ALE) to assess the correspondence between brain correlates of optic flow processing and spatial navigation and their specific neural activations. Since computational and connectivity evidence suggests that visual input from optic flow provides information mainly during egocentric navigation, we further tested the correspondence between brain correlates of optic flow processing and that of both egocentric and allocentric navigation. Optic flow processing shared activation with egocentric (but not allocentric) navigation in the anterior precuneus, suggesting its role in providing information about self-motion, as derived from the analysis of optic flow, in service of egocentric navigation. We further documented that optic flow perception and navigation are partially segregated into two functional and anatomical networks, i.e., the dorsal and the ventromedial networks. Present results point to a dynamic interplay between the dorsal and ventral visual pathways aimed at coordinating visually guided navigation in the environment.
Collapse
Affiliation(s)
- Valentina Sulpizio
- Department of Psychology, Sapienza University, Rome, Italy
- Department of Humanities, Education and Social Sciences, University of Molise, Campobasso, Italy
| | - Alice Teghil
- Department of Psychology, Sapienza University, Rome, Italy
- Department of Cognitive and Motor Rehabilitation and Neuroimaging, Santa Lucia Foundation (IRCCS Fondazione Santa Lucia), Rome, Italy
| | - Sabrina Pitzalis
- Department of Cognitive and Motor Rehabilitation and Neuroimaging, Santa Lucia Foundation (IRCCS Fondazione Santa Lucia), Rome, Italy
- Department of Movement, Human and Health Sciences, University of Rome ''Foro Italico'', Rome, Italy
| | - Maddalena Boccia
- Department of Psychology, Sapienza University, Rome, Italy.
- Department of Cognitive and Motor Rehabilitation and Neuroimaging, Santa Lucia Foundation (IRCCS Fondazione Santa Lucia), Rome, Italy.
| |
Collapse
|
11
|
Bomyea J, Feng S, Moore RC, Simmons AN, Thomas ML. Change in Resting-State Functional Connectivity Following Working Memory Training in Individuals With Repetitive Negative Thinking. BIOLOGICAL PSYCHIATRY. COGNITIVE NEUROSCIENCE AND NEUROIMAGING 2024:S2451-9022(24)00119-8. [PMID: 38705463 DOI: 10.1016/j.bpsc.2024.04.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/26/2024] [Revised: 04/17/2024] [Accepted: 04/25/2024] [Indexed: 05/07/2024]
Abstract
BACKGROUND Repetitive negative thinking (RNT) symptoms, which are characterized by pervasive, uncontrollable negative thoughts, are common in individuals with mood, anxiety, and traumatic stress disorders. Inability to regulate the contents of working memory is a hypothesized etiological factor in RNT, which suggests that training to improve working memory may be beneficial. This study examined the effects of working memory training on resting-state functional connectivity (rsFC) in individuals with elevated RNT and whether such changes would be associated with clinical improvement. METHODS We conducted a secondary analysis of pre-post resting-state data collected as part of a randomized controlled trial (NCT04912089) of working memory training interventions (n = 42) compared with a waitlist control group (n = 23). We hypothesized that individuals who completed training would show increased rsFC between the 2 key intrinsic connectivity networks-the default mode network (posterior cingulate cortex) and the frontoparietal network (dorsolateral prefrontal cortex). We explored whether the magnitude of rsFC change was associated with change in RNT symptom severity. RESULTS rsFC increased between the posterior cingulate cortex and regions including the frontal and parietal cortex in the training group compared with the waitlist group. Increased connectivity between the posterior cingulate cortex and superior frontal cortex was associated with RNT symptom reduction. CONCLUSIONS These data provide evidence that working memory training can modulate neural circuitry at rest in individuals with RNT. Results are consistent with accounts of working memory training effects on large-scale neurocircuitry changes and suggest that these changes may contribute to clinical promise of this type of intervention on transdiagnostic RNT symptoms.
Collapse
Affiliation(s)
- Jessica Bomyea
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, California; Department of Psychiatry, University of California San Diego, San Diego, California.
| | - Shirley Feng
- Department of Psychiatry, University of California San Diego, San Diego, California; Massachusetts General Hospital, Athinoula A. Martinos Center for Biomedical Imaging, Boston, Massachusetts
| | - Raeanne C Moore
- Department of Psychiatry, University of California San Diego, San Diego, California
| | - Alan N Simmons
- Center of Excellence for Stress and Mental Health, VA San Diego Healthcare System, San Diego, California; Department of Psychiatry, University of California San Diego, San Diego, California
| | - Michael L Thomas
- Department of Psychology, Colorado State University, Fort Collins, Colorado
| |
Collapse
|
12
|
Rolls ET. Two what, two where, visual cortical streams in humans. Neurosci Biobehav Rev 2024; 160:105650. [PMID: 38574782 DOI: 10.1016/j.neubiorev.2024.105650] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/18/2023] [Revised: 03/25/2024] [Accepted: 03/31/2024] [Indexed: 04/06/2024]
Abstract
ROLLS, E. T. Two What, Two Where, Visual Cortical Streams in Humans. NEUROSCI BIOBEHAV REV 2024. Recent cortical connectivity investigations lead to new concepts about 'What' and 'Where' visual cortical streams in humans, and how they connect to other cortical systems. A ventrolateral 'What' visual stream leads to the inferior temporal visual cortex for object and face identity, and provides 'What' information to the hippocampal episodic memory system, the anterior temporal lobe semantic system, and the orbitofrontal cortex emotion system. A superior temporal sulcus (STS) 'What' visual stream utilising connectivity from the temporal and parietal visual cortex responds to moving objects and faces, and face expression, and connects to the orbitofrontal cortex for emotion and social behaviour. A ventromedial 'Where' visual stream builds feature combinations for scenes, and provides 'Where' inputs via the parahippocampal scene area to the hippocampal episodic memory system that are also useful for landmark-based navigation. The dorsal 'Where' visual pathway to the parietal cortex provides for actions in space, but also provides coordinate transforms to provide inputs to the parahippocampal scene area for self-motion update of locations in scenes in the dark or when the view is obscured.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK; Department of Computer Science, University of Warwick, Coventry CV4 7AL, UK; Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai 200403, China.
| |
Collapse
|
13
|
Rolls ET, Deco G, Huang CC, Feng J. The connectivity of the human frontal pole cortex, and a theory of its involvement in exploit versus explore. Cereb Cortex 2024; 34:bhad416. [PMID: 37991264 DOI: 10.1093/cercor/bhad416] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2023] [Revised: 10/16/2023] [Accepted: 10/17/2023] [Indexed: 11/23/2023] Open
Abstract
The frontal pole is implicated in humans in whether to exploit resources versus explore alternatives. Effective connectivity, functional connectivity, and tractography were measured between six human frontal pole regions and for comparison 13 dorsolateral and dorsal prefrontal cortex regions, and the 360 cortical regions in the Human Connectome Project Multi-modal-parcellation atlas in 171 HCP participants. The frontal pole regions have effective connectivity with Dorsolateral Prefrontal Cortex regions, the Dorsal Prefrontal Cortex, both implicated in working memory; and with the orbitofrontal and anterior cingulate cortex reward/non-reward system. There is also connectivity with temporal lobe, inferior parietal, and posterior cingulate regions. Given this new connectivity evidence, and evidence from activations and damage, it is proposed that the frontal pole cortex contains autoassociation attractor networks that are normally stable in a short-term memory state, and maintain stability in the other prefrontal networks during stable exploitation of goals and strategies. However, if an input from the orbitofrontal or anterior cingulate cortex that expected reward, non-reward, or punishment is received, this destabilizes the frontal pole and thereby other prefrontal networks to enable exploration of competing alternative goals and strategies. The frontal pole connectivity with reward systems may be key in exploit versus explore.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, United Kingdom
- Department of Computer Science, University of Warwick, Coventry CV4 7AL, United Kingdom
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai 200403, China
| | - Gustavo Deco
- Center for Brain and Cognition, Computational Neuroscience Group, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Roc Boronat 138, Barcelona 08018, Spain
- Brain and Cognition, Pompeu Fabra University, Barcelona 08018, Spain
- Institució Catalana de la Recerca i Estudis Avançats (ICREA), Universitat Pompeu Fabra, Passeig Lluís Companys 23, Barcelona 08010, Spain
| | - Chu-Chung Huang
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), Institute of Brain and Education Innovation, School of Psychology and Cognitive Science, East China Normal University, Shanghai 200602, China
- Shanghai Center for Brain Science and Brain-Inspired Technology, Shanghai 200602, China
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry CV4 7AL, United Kingdom
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai 200403, China
| |
Collapse
|
14
|
Zhang R, Rolls ET, Cheng W, Feng J. Different cortical connectivities in human females and males relate to differences in strength and body composition, reward and emotional systems, and memory. Brain Struct Funct 2024; 229:47-61. [PMID: 37861743 PMCID: PMC10827883 DOI: 10.1007/s00429-023-02720-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/24/2023] [Accepted: 10/02/2023] [Indexed: 10/21/2023]
Abstract
Sex differences in human brain structure and function are important, partly because they are likely to be relevant to the male-female differences in behavior and in mental health. To analyse sex differences in cortical function, functional connectivity was measured in 36,531 participants (53% female) in the UK Biobank (mean age 69) using the Human Connectome Project multimodal parcellation atlas with 360 well-specified cortical regions. Most of the functional connectivities were lower in females (Bonferroni corrected), with the mean Cohen's d = - 0.18. Removing these as covariates reduced the difference of functional connectivities for females-males from d = - 0.18 to - 0.06. The lower functional connectivities in females were especially of somatosensory/premotor regions including the insula, opercular cortex, paracentral lobule and mid-cingulate cortex, and were correlated with lower maximum workload (r = 0.17), and with higher whole body fat mass (r = - 0.17). But some functional connectivities were higher in females, involving especially the ventromedial prefrontal cortex and posterior cingulate cortex, and these were correlated with higher liking for some rewards such as sweet foods, higher happiness/subjective well-being, and with better memory-related functions. The main findings were replicated in 1000 individuals (532 females, mean age 29) from the Human Connectome Project. This investigation shows the cortical systems with different functional connectivity between females and males, and also provides for the first time a foundation for understanding the implications for behavior of these differences between females and males.
Collapse
Affiliation(s)
- Ruohan Zhang
- Department of Computer Science, University of Warwick, Coventry, CV4 7AL, UK
| | - Edmund T Rolls
- Department of Computer Science, University of Warwick, Coventry, CV4 7AL, UK.
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, 200403, China.
- Oxford Centre for Computational Neuroscience, Oxford, UK.
| | - Wei Cheng
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, 200403, China
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry, CV4 7AL, UK
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, 200403, China
| |
Collapse
|
15
|
Rolls ET, Deco G, Zhang Y, Feng J. Hierarchical organization of the human ventral visual streams revealed with magnetoencephalography. Cereb Cortex 2023; 33:10686-10701. [PMID: 37689834 DOI: 10.1093/cercor/bhad318] [Citation(s) in RCA: 6] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/08/2023] [Revised: 08/17/2023] [Accepted: 08/17/2023] [Indexed: 09/11/2023] Open
Abstract
The hierarchical organization between 25 ventral stream visual cortical regions and 180 cortical regions was measured with magnetoencephalography using the Human Connectome Project Multimodal Parcellation atlas in 83 Human Connectome Project participants performing a visual memory task. The aim was to reveal the hierarchical organization using a whole-brain model based on generative effective connectivity with this fast neuroimaging method. V1-V4 formed a first group of interconnected regions. Especially V4 had connectivity to a ventrolateral visual stream: V8, the fusiform face cortex, and posterior inferior temporal cortex PIT. These regions in turn had effectivity connectivity to inferior temporal cortex visual regions TE2p and TE1p. TE2p and TE1p then have connectivity to anterior temporal lobe regions TE1a, TE1m, TE2a, and TGv, which are multimodal. In a ventromedial visual stream, V1-V4 connect to ventromedial regions VMV1-3 and VVC. VMV1-3 and VVC connect to the medial parahippocampal gyrus PHA1-3, which, with the VMV regions, include the parahippocampal scene area. The medial parahippocampal PHA1-3 regions have connectivity to the hippocampal system regions the perirhinal cortex, entorhinal cortex, and hippocampus. These effective connectivities of two ventral visual cortical streams measured with magnetoencephalography provide support to the hierarchical organization of brain systems measured with fMRI, and new evidence on directionality.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, United Kingdom
- Department of Computer Science, University of Warwick, Coventry CV4 7AL, United Kingdom
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai 200403, China
| | - Gustavo Deco
- Center for Brain and Cognition, Computational Neuroscience Group, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Roc Boronat 138, Barcelona 08018, Spain
- Brain and Cognition, Pompeu Fabra University, Barcelona 08018, Spain
- Institució Catalana de la Recerca i Estudis Avançats (ICREA), Universitat Pompeu Fabra, Passeig Lluís Companys 23, Barcelona 08010, Spain
| | - Yi Zhang
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai 200403, China
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry CV4 7AL, United Kingdom
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai 200403, China
| |
Collapse
|
16
|
Rolls ET. Emotion, motivation, decision-making, the orbitofrontal cortex, anterior cingulate cortex, and the amygdala. Brain Struct Funct 2023; 228:1201-1257. [PMID: 37178232 PMCID: PMC10250292 DOI: 10.1007/s00429-023-02644-9] [Citation(s) in RCA: 45] [Impact Index Per Article: 45.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2023] [Accepted: 04/12/2023] [Indexed: 05/15/2023]
Abstract
The orbitofrontal cortex and amygdala are involved in emotion and in motivation, but the relationship between these functions performed by these brain structures is not clear. To address this, a unified theory of emotion and motivation is described in which motivational states are states in which instrumental goal-directed actions are performed to obtain rewards or avoid punishers, and emotional states are states that are elicited when the reward or punisher is or is not received. This greatly simplifies our understanding of emotion and motivation, for the same set of genes and associated brain systems can define the primary or unlearned rewards and punishers such as sweet taste or pain. Recent evidence on the connectivity of human brain systems involved in emotion and motivation indicates that the orbitofrontal cortex is involved in reward value and experienced emotion with outputs to cortical regions including those involved in language, and is a key brain region involved in depression and the associated changes in motivation. The amygdala has weak effective connectivity back to the cortex in humans, and is implicated in brainstem-mediated responses to stimuli such as freezing and autonomic activity, rather than in declarative emotion. The anterior cingulate cortex is involved in learning actions to obtain rewards, and with the orbitofrontal cortex and ventromedial prefrontal cortex in providing the goals for navigation and in reward-related effects on memory consolidation mediated partly via the cholinergic system.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK.
- Department of Computer Science, University of Warwick, Coventry, UK.
| |
Collapse
|
17
|
Guan C, Aflalo T, Kadlec K, Gámez de Leon J, Rosario ER, Bari A, Pouratian N, Andersen RA. Decoding and geometry of ten finger movements in human posterior parietal cortex and motor cortex. J Neural Eng 2023; 20:036020. [PMID: 37160127 PMCID: PMC10209510 DOI: 10.1088/1741-2552/acd3b1] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/02/2022] [Revised: 03/24/2023] [Accepted: 05/09/2023] [Indexed: 05/11/2023]
Abstract
Objective. Enable neural control of individual prosthetic fingers for participants with upper-limb paralysis.Approach. Two tetraplegic participants were each implanted with a 96-channel array in the left posterior parietal cortex (PPC). One of the participants was additionally implanted with a 96-channel array near the hand knob of the left motor cortex (MC). Across tens of sessions, we recorded neural activity while the participants attempted to move individual fingers of the right hand. Offline, we classified attempted finger movements from neural firing rates using linear discriminant analysis with cross-validation. The participants then used the neural classifier online to control individual fingers of a brain-machine interface (BMI). Finally, we characterized the neural representational geometry during individual finger movements of both hands.Main Results. The two participants achieved 86% and 92% online accuracy during BMI control of the contralateral fingers (chance = 17%). Offline, a linear decoder achieved ten-finger decoding accuracies of 70% and 66% using respective PPC recordings and 75% using MC recordings (chance = 10%). In MC and in one PPC array, a factorized code linked corresponding finger movements of the contralateral and ipsilateral hands.Significance. This is the first study to decode both contralateral and ipsilateral finger movements from PPC. Online BMI control of contralateral fingers exceeded that of previous finger BMIs. PPC and MC signals can be used to control individual prosthetic fingers, which may contribute to a hand restoration strategy for people with tetraplegia.
Collapse
Affiliation(s)
- Charles Guan
- California Institute of Technology, Pasadena, CA, United States of America
| | - Tyson Aflalo
- California Institute of Technology, Pasadena, CA, United States of America
- T&C Chen Brain-Machine Interface Center at Caltech, Pasadena, CA, United States of America
| | - Kelly Kadlec
- California Institute of Technology, Pasadena, CA, United States of America
| | | | - Emily R Rosario
- Casa Colina Hospital and Centers for Healthcare, Pomona, CA, United States of America
| | - Ausaf Bari
- David Geffen School of Medicine at UCLA, Los Angeles, CA, United States of America
| | - Nader Pouratian
- University of Texas Southwestern Medical Center, Dallas, TX, United States of America
| | - Richard A Andersen
- California Institute of Technology, Pasadena, CA, United States of America
- T&C Chen Brain-Machine Interface Center at Caltech, Pasadena, CA, United States of America
| |
Collapse
|
18
|
Rolls ET, Rauschecker JP, Deco G, Huang CC, Feng J. Auditory cortical connectivity in humans. Cereb Cortex 2023; 33:6207-6227. [PMID: 36573464 PMCID: PMC10422925 DOI: 10.1093/cercor/bhac496] [Citation(s) in RCA: 14] [Impact Index Per Article: 14.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/25/2022] [Revised: 11/27/2022] [Accepted: 11/29/2022] [Indexed: 12/28/2022] Open
Abstract
To understand auditory cortical processing, the effective connectivity between 15 auditory cortical regions and 360 cortical regions was measured in 171 Human Connectome Project participants, and complemented with functional connectivity and diffusion tractography. 1. A hierarchy of auditory cortical processing was identified from Core regions (including A1) to Belt regions LBelt, MBelt, and 52; then to PBelt; and then to HCP A4. 2. A4 has connectivity to anterior temporal lobe TA2, and to HCP A5, which connects to dorsal-bank superior temporal sulcus (STS) regions STGa, STSda, and STSdp. These STS regions also receive visual inputs about moving faces and objects, which are combined with auditory information to help implement multimodal object identification, such as who is speaking, and what is being said. Consistent with this being a "what" ventral auditory stream, these STS regions then have effective connectivity to TPOJ1, STV, PSL, TGv, TGd, and PGi, which are language-related semantic regions connecting to Broca's area, especially BA45. 3. A4 and A5 also have effective connectivity to MT and MST, which connect to superior parietal regions forming a dorsal auditory "where" stream involved in actions in space. Connections of PBelt, A4, and A5 with BA44 may form a language-related dorsal stream.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK
- Department of Computer Science, University of Warwick, Coventry CV4 7AL, UK
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai 200602, China
| | - Josef P Rauschecker
- Department of Neuroscience, Georgetown University Medical Center, Washington, DC 20057, USA
- Institute for Advanced Study, Technical University, Munich, Germany
| | - Gustavo Deco
- Center for Brain and Cognition, Computational Neuroscience Group, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Roc Boronat 138, Brain and Cognition, Pompeu Fabra University, Barcelona 08018, Spain
- Institució Catalana de la Recerca i Estudis Avançats (ICREA), Universitat Pompeu Fabra, Passeig Lluís Companys 23, Barcelona 08010, Spain
| | - Chu-Chung Huang
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai 200602, China
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry CV4 7AL, UK
- Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai 200403, China
| |
Collapse
|
19
|
Rolls ET. Hippocampal spatial view cells for memory and navigation, and their underlying connectivity in humans. Hippocampus 2023; 33:533-572. [PMID: 36070199 PMCID: PMC10946493 DOI: 10.1002/hipo.23467] [Citation(s) in RCA: 33] [Impact Index Per Article: 33.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2022] [Revised: 08/16/2022] [Accepted: 08/16/2022] [Indexed: 01/08/2023]
Abstract
Hippocampal and parahippocampal gyrus spatial view neurons in primates respond to the spatial location being looked at. The representation is allocentric, in that the responses are to locations "out there" in the world, and are relatively invariant with respect to retinal position, eye position, head direction, and the place where the individual is located. The underlying connectivity in humans is from ventromedial visual cortical regions to the parahippocampal scene area, leading to the theory that spatial view cells are formed by combinations of overlapping feature inputs self-organized based on their closeness in space. Thus, although spatial view cells represent "where" for episodic memory and navigation, they are formed by ventral visual stream feature inputs in the parahippocampal gyrus in what is the parahippocampal scene area. A second "where" driver of spatial view cells are parietal inputs, which it is proposed provide the idiothetic update for spatial view cells, used for memory recall and navigation when the spatial view details are obscured. Inferior temporal object "what" inputs and orbitofrontal cortex reward inputs connect to the human hippocampal system, and in macaques can be associated in the hippocampus with spatial view cell "where" representations to implement episodic memory. Hippocampal spatial view cells also provide a basis for navigation to a series of viewed landmarks, with the orbitofrontal cortex reward inputs to the hippocampus providing the goals for navigation, which can then be implemented by hippocampal connectivity in humans to parietal cortex regions involved in visuomotor actions in space. The presence of foveate vision and the highly developed temporal lobe for object and scene processing in primates including humans provide a basis for hippocampal spatial view cells to be key to understanding episodic memory in the primate and human hippocampus, and the roles of this system in primate including human navigation.
Collapse
Affiliation(s)
- Edmund T. Rolls
- Oxford Centre for Computational NeuroscienceOxfordUK
- Department of Computer ScienceUniversity of WarwickCoventryUK
| |
Collapse
|
20
|
Rolls ET, Feng R, Feng J. Lifestyle risks associated with brain functional connectivity and structure. Hum Brain Mapp 2023; 44:2479-2492. [PMID: 36799566 PMCID: PMC10028639 DOI: 10.1002/hbm.26225] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/05/2022] [Revised: 01/16/2023] [Accepted: 01/23/2023] [Indexed: 02/18/2023] Open
Abstract
Some lifestyle factors are related to health and brain function and structure, but the brain systems involved are incompletely understood. A general linear model was used to test the associations of the combined and separate lifestyle risk measures of alcohol use, smoking, diet, amounts of physical activity, leisure activity, and mobile phone use, with brain functional connectivity with the high resolution Human Connectome Project (HCP) atlas in 19,415 participants aged 45-78 from the UK Biobank, with replication with HCP data. Higher combined lifestyle risk scores were associated with lower functional connectivity across the whole brain, but especially of three brain systems. Low physical, and leisure and social, activity were associated with low connectivities of the somatosensory/motor cortical regions and of hippocampal memory-related regions. Low mobile phone use, perhaps indicative of poor social communication channels, was associated with low functional connectivity of brain regions in and related to the superior temporal sulcus that are involved in social behavior and face processing. Smoking was associated with lower functional connectivity of especially frontal regions involved in attention. Lower cortical thickness in some of these regions, and also lower subcortical volume of the hippocampus, amygdala, and globus pallidus, were also associated with the sum of the poor lifestyle scores. This very large scale analysis emphasizes how the lifestyle of humans relates to their brain structure and function, and provides a foundation for understanding the causalities that relate to the differences found here in the brains of different individuals.
Collapse
Affiliation(s)
- Edmund T Rolls
- Department of Computer Science, University of Warwick, Coventry, UK
- Institute of Science and Technology for Brain-inspired Intelligence, Fudan University, Shanghai, China
- Oxford Centre for Computational Neuroscience, Oxford, UK
| | - Ruiqing Feng
- Department of Computer Science, University of Warwick, Coventry, UK
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry, UK
- Institute of Science and Technology for Brain-inspired Intelligence, Fudan University, Shanghai, China
- Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence, Fudan University, Ministry of Education, Shanghai, China
| |
Collapse
|
21
|
Rolls ET, Wirth S, Deco G, Huang C, Feng J. The human posterior cingulate, retrosplenial, and medial parietal cortex effective connectome, and implications for memory and navigation. Hum Brain Mapp 2023; 44:629-655. [PMID: 36178249 PMCID: PMC9842927 DOI: 10.1002/hbm.26089] [Citation(s) in RCA: 17] [Impact Index Per Article: 17.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/30/2022] [Revised: 09/05/2022] [Accepted: 09/07/2022] [Indexed: 01/25/2023] Open
Abstract
The human posterior cingulate, retrosplenial, and medial parietal cortex are involved in memory and navigation. The functional anatomy underlying these cognitive functions was investigated by measuring the effective connectivity of these Posterior Cingulate Division (PCD) regions in the Human Connectome Project-MMP1 atlas in 171 HCP participants, and complemented with functional connectivity and diffusion tractography. First, the postero-ventral parts of the PCD (31pd, 31pv, 7m, d23ab, and v23ab) have effective connectivity with the temporal pole, inferior temporal visual cortex, cortex in the superior temporal sulcus implicated in auditory and semantic processing, with the reward-related vmPFC and pregenual anterior cingulate cortex, with the inferior parietal cortex, and with the hippocampal system. This connectivity implicates it in hippocampal episodic memory, providing routes for "what," reward and semantic schema-related information to access the hippocampus. Second, the antero-dorsal parts of the PCD (especially 31a and 23d, PCV, and also RSC) have connectivity with early visual cortical areas including those that represent spatial scenes, with the superior parietal cortex, with the pregenual anterior cingulate cortex, and with the hippocampal system. This connectivity implicates it in the "where" component for hippocampal episodic memory and for spatial navigation. The dorsal-transitional-visual (DVT) and ProStriate regions where the retrosplenial scene area is located have connectivity from early visual cortical areas to the parahippocampal scene area, providing a ventromedial route for spatial scene information to reach the hippocampus. These connectivities provide important routes for "what," reward, and "where" scene-related information for human hippocampal episodic memory and navigation. The midcingulate cortex provides a route from the anterior dorsal parts of the PCD and the supracallosal part of the anterior cingulate cortex to premotor regions.
Collapse
Affiliation(s)
- Edmund T. Rolls
- Oxford Centre for Computational NeuroscienceOxfordUK
- Department of Computer ScienceUniversity of WarwickCoventryUK
- Institute of Science and Technology for Brain Inspired IntelligenceFudan UniversityShanghaiChina
- Key Laboratory of Computational Neuroscience and Brain Inspired IntelligenceFudan University, Ministry of EducationShanghaiChina
- Fudan ISTBI—ZJNU Algorithm Centre for Brain‐Inspired IntelligenceZhejiang Normal UniversityJinhuaChina
| | - Sylvia Wirth
- Institut des Sciences Cognitives Marc Jeannerod, UMR 5229CNRS and University of LyonBronFrance
| | - Gustavo Deco
- Center for Brain and Cognition, Computational Neuroscience Group, Department of Information and Communication TechnologiesUniversitat Pompeu FabraBarcelonaSpain
- Brain and CognitionPompeu Fabra UniversityBarcelonaSpain
- Institució Catalana de la Recerca i Estudis Avançats (ICREA)Universitat Pompeu FabraBarcelonaSpain
| | - Chu‐Chung Huang
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive ScienceEast China Normal UniversityShanghaiChina
| | - Jianfeng Feng
- Department of Computer ScienceUniversity of WarwickCoventryUK
- Institute of Science and Technology for Brain Inspired IntelligenceFudan UniversityShanghaiChina
- Key Laboratory of Computational Neuroscience and Brain Inspired IntelligenceFudan University, Ministry of EducationShanghaiChina
- Fudan ISTBI—ZJNU Algorithm Centre for Brain‐Inspired IntelligenceZhejiang Normal UniversityJinhuaChina
| |
Collapse
|
22
|
Rolls ET, Deco G, Huang CC, Feng J. Human amygdala compared to orbitofrontal cortex connectivity, and emotion. Prog Neurobiol 2023; 220:102385. [PMID: 36442728 DOI: 10.1016/j.pneurobio.2022.102385] [Citation(s) in RCA: 9] [Impact Index Per Article: 9.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/10/2022] [Revised: 11/14/2022] [Accepted: 11/24/2022] [Indexed: 11/26/2022]
Abstract
The amygdala and orbitofrontal cortex have been implicated in emotion. To understand these regions better in humans, their effective connectivity with 360 cortical regions was measured in 171 humans from the Human Connectome Project, and complemented with functional connectivity and diffusion tractography. The human amygdala has effective connectivity from few cortical regions compared to the orbitofrontal cortex: primarily from auditory cortex A5 and the related superior temporal gyrus and temporal pole regions; the piriform (olfactory) cortex; the lateral orbitofrontal cortex 47m; somatosensory cortex; the hippocampus, entorhinal cortex, perirhinal cortex, and parahippocampal TF; and from the cholinergic nucleus basalis. The amygdala has effective connectivity to the hippocampus, entorhinal and perirhinal cortex; to the temporal pole; and to the lateral orbitofrontal cortex. The orbitofrontal cortex has effective connectivity from gustatory, olfactory, and temporal visual, auditory and pole cortex, and to the pregenual anterior and posterior cingulate cortex, hippocampal system, and prefrontal cortex, and provides for rewards and punishers to be used in reported emotions, and memory and navigation to goals. Given the paucity of amygdalo-neocortical connectivity in humans, it is proposed that the human amygdala is involved primarily in autonomic and conditioned responses via brainstem connectivity, rather than in reported (declarative) emotion.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK; Department of Computer Science, University of Warwick, Coventry, UK; Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, China.
| | - Gustavo Deco
- Center for Brain and Cognition, Computational Neuroscience Group, Department of Information and Communication Technologies, Universitat Pompeu Fabra, Roc Boronat 138, Barcelona, 08018, Spain Brain and Cognition, Pompeu Fabra University, Barcelona, Spain; Institució Catalana de la Recerca i Estudis Avançats (ICREA), Universitat Pompeu Fabra, Passeig Lluís Companys 23, Barcelona 08010, Spain
| | - Chu-Chung Huang
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai, China
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry, UK; Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai, China
| |
Collapse
|
23
|
Wang HF, Zhang W, Rolls ET, Li Y, Wang L, Ma YH, Kang J, Feng J, Yu JT, Cheng W. Hearing impairment is associated with cognitive decline, brain atrophy and tau pathology. EBioMedicine 2022; 86:104336. [PMID: 36356475 PMCID: PMC9649369 DOI: 10.1016/j.ebiom.2022.104336] [Citation(s) in RCA: 26] [Impact Index Per Article: 13.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Revised: 10/01/2022] [Accepted: 10/17/2022] [Indexed: 11/09/2022] Open
Abstract
BACKGROUND Hearing impairment was recently identified as the most prominent risk factor for dementia. However, the mechanisms underlying the link between hearing impairment and dementia are still unclear. METHODS We investigated the association of hearing performance with cognitive function, brain structure and cerebrospinal fluid (CSF) proteins in cross-sectional, longitudinal, mediation and genetic association analyses across the UK Biobank (N = 165,550), the Chinese Alzheimer's Biomarker and Lifestyle (CABLE, N = 863) study, and the Alzheimer's Disease Neuroimaging Initiative (ADNI, N = 1770) database. FINDINGS Poor hearing performance was associated with worse cognitive function in the UK Biobank and in the CABLE study. Hearing impairment was significantly related to lower volume of temporal cortex, hippocampus, inferior parietal lobe, precuneus, etc., and to lower integrity of white matter (WM) tracts. Furthermore, a higher polygenic risk score (PRS) for hearing impairment was strongly associated with lower cognitive function, lower volume of gray matter, and lower integrity of WM tracts. Moreover, hearing impairment was correlated with a high level of CSF tau protein in the CABLE study and in the ADNI database. Finally, mediation analyses showed that brain atrophy and tau pathology partly mediated the association between hearing impairment and cognitive decline. INTERPRETATION Hearing impairment is associated with cognitive decline, brain atrophy and tau pathology, and hearing impairment may reflect the risk for cognitive decline and dementia as it is related to bran atrophy and tau accumulation in brain. However, it is necessary to assess the mechanism in future animal studies. FUNDING A full list of funding bodies that supported this study can be found in the Acknowledgements section.
Collapse
Affiliation(s)
- Hui-Fu Wang
- Department of Neurology, Huashan Hospital, Institute of Science and Technology for Brain-Inspired Intelligence, State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China; Department of Neurology, Qingdao Municipal Hospital, Qingdao University, Qingdao, China
| | - Wei Zhang
- Department of Neurology, Huashan Hospital, Institute of Science and Technology for Brain-Inspired Intelligence, State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China
| | - Edmund T Rolls
- Department of Neurology, Huashan Hospital, Institute of Science and Technology for Brain-Inspired Intelligence, State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China; Department of Computer Science, University of Warwick, Coventry, CV4 7AL, UK; Oxford Centre for Computational Neuroscience, Oxford, UK
| | - Yuzhu Li
- Department of Neurology, Huashan Hospital, Institute of Science and Technology for Brain-Inspired Intelligence, State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China
| | - Linbo Wang
- Department of Neurology, Huashan Hospital, Institute of Science and Technology for Brain-Inspired Intelligence, State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China
| | - Ya-Hui Ma
- Department of Neurology, Qingdao Municipal Hospital, Qingdao University, Qingdao, China
| | - Jujiao Kang
- Department of Neurology, Huashan Hospital, Institute of Science and Technology for Brain-Inspired Intelligence, State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China
| | - Jianfeng Feng
- Department of Neurology, Huashan Hospital, Institute of Science and Technology for Brain-Inspired Intelligence, State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China; Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), Ministry of Education, China; Zhangjiang Fudan International Innovation Center, Shanghai, China; Fudan ISTBI-ZJNU Algorithm Centre for Brain-inspired Intelligence, Zhejiang Normal University, Zhejiang, China
| | - Jin-Tai Yu
- Department of Neurology, Huashan Hospital, Institute of Science and Technology for Brain-Inspired Intelligence, State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China.
| | - Wei Cheng
- Department of Neurology, Huashan Hospital, Institute of Science and Technology for Brain-Inspired Intelligence, State Key Laboratory of Medical Neurobiology and MOE Frontiers Center for Brain Science, Fudan University, Shanghai, China; Key Laboratory of Computational Neuroscience and Brain-Inspired Intelligence (Fudan University), Ministry of Education, China; Fudan ISTBI-ZJNU Algorithm Centre for Brain-inspired Intelligence, Zhejiang Normal University, Zhejiang, China.
| |
Collapse
|
24
|
Bretas R, Tia B, Yamazaki Y, Iriki A. Multisensory integration and belief in the self. Front Psychol 2022; 13:983592. [DOI: 10.3389/fpsyg.2022.983592] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2022] [Accepted: 09/30/2022] [Indexed: 11/13/2022] Open
|
25
|
Rolls ET, Deco G, Huang CC, Feng J. Prefrontal and somatosensory-motor cortex effective connectivity in humans. Cereb Cortex 2022; 33:4939-4963. [PMID: 36227217 DOI: 10.1093/cercor/bhac391] [Citation(s) in RCA: 11] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2022] [Revised: 09/07/2022] [Accepted: 09/08/2022] [Indexed: 11/12/2022] Open
Abstract
Effective connectivity, functional connectivity, and tractography were measured between 57 cortical frontal and somatosensory regions and the 360 cortical regions in the Human Connectome Project (HCP) multimodal parcellation atlas for 171 HCP participants. A ventral somatosensory stream connects from 3b and 3a via 1 and 2 and then via opercular and frontal opercular regions to the insula, which then connects to inferior parietal PF regions. This stream is implicated in "what"-related somatosensory processing of objects and of the body and in combining with visual inputs in PF. A dorsal "action" somatosensory stream connects from 3b and 3a via 1 and 2 to parietal area 5 and then 7. Inferior prefrontal regions have connectivity with the inferior temporal visual cortex and orbitofrontal cortex, are implicated in working memory for "what" processing streams, and provide connectivity to language systems, including 44, 45, 47l, TPOJ1, and superior temporal visual area. The dorsolateral prefrontal cortex regions that include area 46 have connectivity with parietal area 7 and somatosensory inferior parietal regions and are implicated in working memory for actions and planning. The dorsal prefrontal regions, including 8Ad and 8Av, have connectivity with visual regions of the inferior parietal cortex, including PGs and PGi, and are implicated in visual and auditory top-down attention.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK.,Department of Computer Science, University of Warwick, Coventry CV4 7AL, UK.,Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai 200403, China
| | - Gustavo Deco
- Computational Neuroscience Group, Department of Information and Communication Technologies, Center for Brain and Cognition, Universitat Pompeu Fabra, Roc Boronat 138, Barcelona 08018, Spain.,Brain and Cognition, Pompeu Fabra University, Barcelona 08018, Spain.,Institució Catalana de la Recerca i Estudis Avançats (ICREA), Universitat Pompeu Fabra, Passeig Lluís Companys 23, Barcelona 08010, Spain
| | - Chu-Chung Huang
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), Institute of Brain and Education Innovation, School of Psychology and Cognitive Science, East China Normal University, Shanghai 200602, China.,Shanghai Center for Brain Science and Brain-Inspired Technology, Shanghai 200602, China
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry CV4 7AL, UK.,Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai 200403, China
| |
Collapse
|
26
|
Rolls ET. The hippocampus, ventromedial prefrontal cortex, and episodic and semantic memory. Prog Neurobiol 2022; 217:102334. [PMID: 35870682 DOI: 10.1016/j.pneurobio.2022.102334] [Citation(s) in RCA: 39] [Impact Index Per Article: 19.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 06/07/2022] [Accepted: 07/19/2022] [Indexed: 11/24/2022]
Abstract
The human ventromedial prefrontal cortex (vmPFC)/anterior cingulate cortex is implicated in reward and emotion, but also in memory. It is shown how the human orbitofrontal cortex connecting with the vmPFC and anterior cingulate cortex provide a route to the hippocampus for reward and emotional value to be incorporated into episodic memory, enabling memory of where a reward was seen. It is proposed that this value component results in primarily episodic memories with some value component to be repeatedly recalled from the hippocampus so that they are more likely to become incorporated into neocortical semantic and autobiographical memories. The same orbitofrontal and anterior cingulate regions also connect in humans to the septal and basal forebrain cholinergic nuclei, thereby helping to consolidate memory, and helping to account for why damage to the vMPFC impairs memory. The human hippocampus and vmPFC thus contribute in complementary ways to forming episodic and semantic memories.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK; University of Warwick, Department of Computer Science, Coventry, UK.
| |
Collapse
|
27
|
Rolls ET, Deco G, Huang CC, Feng J. The human language effective connectome. Neuroimage 2022; 258:119352. [PMID: 35659999 DOI: 10.1016/j.neuroimage.2022.119352] [Citation(s) in RCA: 21] [Impact Index Per Article: 10.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/22/2022] [Accepted: 05/31/2022] [Indexed: 01/07/2023] Open
Abstract
To advance understanding of brain networks involved in language, the effective connectivity between 26 cortical regions implicated in language by a community analysis and 360 cortical regions was measured in 171 humans from the Human Connectome Project, and complemented with functional connectivity and diffusion tractography, all using the HCP multimodal parcellation atlas. A (semantic) network (Group 1) involving inferior cortical regions of the superior temporal sulcus cortex (STS) with the adjacent inferior temporal visual cortex TE1a and temporal pole TG, and the connected parietal PGi region, has effective connectivity with inferior temporal visual cortex (TE) regions; with parietal PFm which also has visual connectivity; with posterior cingulate cortex memory-related regions; with the frontal pole, orbitofrontal cortex, and medial prefrontal cortex; with the dorsolateral prefrontal cortex; and with 44 and 45 for output regions. It is proposed that this system can build in its temporal lobe (STS and TG) and parietal parts (PGi and PGs) semantic representations of objects incorporating especially their visual and reward properties. Another (semantic) network (Group 3) involving superior regions of the superior temporal sulcus cortex and more superior temporal lobe regions including STGa, auditory A5, TPOJ1, the STV and the Peri-Sylvian Language area (PSL) has effective connectivity with auditory areas (A1, A4, A5, Pbelt); with relatively early visual areas involved in motion, e.g., MT and MST, and faces/words (FFC); with somatosensory regions (frontal opercular FOP, insula and parietal PF); with other TPOJ regions; and with the inferior frontal gyrus regions (IFJa and IFSp). It is proposed that this system builds semantic representations specialising in auditory and related facial motion information useful in theory of mind and somatosensory / body image information, with outputs directed not only to regions 44 and 45, but also to premotor 55b and midcingulate premotor cortex. Both semantic networks (Groups 1 and 3) have access to the hippocampal episodic memory system via parahippocampal TF. A third largely frontal network (Group 2) (44, 45, 47l; 55b; the Superior Frontal Language region SFL; and including temporal pole TGv) receives effective connectivity from the two semantic systems, and is implicated in syntax and speech output.
Collapse
Affiliation(s)
- Edmund T Rolls
- Oxford Centre for Computational Neuroscience, Oxford, UK; Department of Computer Science, University of Warwick, Coventry CV4 7AL, UK; Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai 200403, China.
| | - Gustavo Deco
- Department of Information and Communication Technologies, Center for Brain and Cognition, Computational Neuroscience Group, Universitat Pompeu Fabra, Roc Boronat 138, Barcelona 08018, Spain; Brain and Cognition, Pompeu Fabra University, Barcelona 08018, Spain; Institució Catalana de la Recerca i Estudis Avançats (ICREA), Universitat Pompeu Fabra, Passeig Lluís Companys 23, Barcelona 08010, Spain
| | - Chu-Chung Huang
- Shanghai Key Laboratory of Brain Functional Genomics (Ministry of Education), School of Psychology and Cognitive Science, East China Normal University, Shanghai 200602, China
| | - Jianfeng Feng
- Department of Computer Science, University of Warwick, Coventry CV4 7AL, UK; Institute of Science and Technology for Brain Inspired Intelligence, Fudan University, Shanghai 200403, China
| |
Collapse
|