1
|
Mack ML, Love BC, Preston AR. Distinct hippocampal mechanisms support concept formation and updating. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2024.02.14.580181. [PMID: 38405893 PMCID: PMC10888746 DOI: 10.1101/2024.02.14.580181] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/27/2024]
Abstract
Learning systems must constantly decide whether to create new representations or update existing ones. For example, a child learning that a bat is a mammal and not a bird would be best served by creating a new representation, whereas updating may be best when encountering a second similar bat. Characterizing the neural dynamics that underlie these complementary memory operations requires identifying the exact moments when each operation occurs. We address this challenge by interrogating fMRI brain activation with a computational learning model that predicts trial-by-trial when memories are created versus updated. We found distinct neural engagement in anterior hippocampus and ventral striatum for model-predicted memory create and update events during early learning. Notably, the degree of this effect in hippocampus, but not ventral striatum, significantly related to learning outcome. Hippocampus additionally showed distinct patterns of functional coactivation with ventromedial prefrontal cortex and angular gyrus during memory creation and premotor cortex during memory updating. These findings suggest that complementary memory functions, as formalized in computational learning models, underlie the rapid formation of novel conceptual knowledge, with the hippocampus and its interactions with frontoparietal circuits playing a crucial role in successful learning. Significance statement How do we reconcile new experiences with existing knowledge? Prominent theories suggest that novel information is either captured by creating new memories or leveraged to update existing memories, yet empirical support of how these distinct memory operations unfold during learning is limited. Here, we combine computational modeling of human learning behaviour with functional neuroimaging to identify moments of memory formation and updating and characterize their neural signatures. We find that both hippocampus and ventral striatum are distinctly engaged when memories are created versus updated; however, it is only hippocampus activation that is associated with learning outcomes. Our findings motivate a key theoretical revision that positions hippocampus is a key player in building organized memories from the earliest moments of learning.
Collapse
|
2
|
Perović M, Heffernan EM, Einstein G, Mack ML. Learning exceptions to category rules varies across the menstrual cycle. Sci Rep 2023; 13:21999. [PMID: 38081874 PMCID: PMC10713535 DOI: 10.1038/s41598-023-48628-x] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2023] [Accepted: 11/28/2023] [Indexed: 12/18/2023] Open
Abstract
Ways in which ovarian hormones affect cognition have been long overlooked despite strong evidence of their effects on the brain. To address this gap, we study performance on a rule-plus-exception category learning task, a complex task that requires careful coordination of core cognitive mechanisms, across the menstrual cycle (N = 171). Results show that the menstrual cycle distinctly affects exception learning in a manner that parallels the typical rise and fall of estradiol across the cycle. Participants in their high estradiol phase outperform participants in their low estradiol phase and demonstrate more rapid learning of exceptions than a male comparison group. A likely mechanism underlying this effect is estradiol's impact on pattern separation and completion pathways in the hippocampus. These results provide novel evidence for the effects of the menstrual cycle on category learning, and underscore the importance of considering female sex-related variables in cognitive neuroscience research.
Collapse
Affiliation(s)
- Mateja Perović
- Department of Psychology, University of Toronto, 100 St. George St., Toronto, ON, M5S 3J3, Canada.
| | - Emily M Heffernan
- Department of Psychology, University of Toronto, 100 St. George St., Toronto, ON, M5S 3J3, Canada
| | - Gillian Einstein
- Department of Psychology, University of Toronto, 100 St. George St., Toronto, ON, M5S 3J3, Canada
- Dalla Lana School of Public Health, University of Toronto, Toronto, Canada
- Tema Genus, Linköping University, Linköping, Sweden
- Rotman Research Institute, Baycrest Hospital, Toronto, Canada
| | - Michael L Mack
- Department of Psychology, University of Toronto, 100 St. George St., Toronto, ON, M5S 3J3, Canada
| |
Collapse
|
3
|
Elder JJ, Davis TH, Hughes BL. A Fluid Self-Concept: How the Brain Maintains Coherence and Positivity across an Interconnected Self-Concept While Incorporating Social Feedback. J Neurosci 2023; 43:4110-4128. [PMID: 37156606 PMCID: PMC10255005 DOI: 10.1523/jneurosci.1951-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2022] [Revised: 02/16/2023] [Accepted: 04/04/2023] [Indexed: 05/10/2023] Open
Abstract
People experience instances of social feedback as interdependent with potential implications for their entire self-concept. How do people maintain positivity and coherence across the self-concept while updating self-views from feedback? We present a network model describing how the brain represents the semantic dependency relations among traits and uses this information to avoid an overall loss of positivity and coherence. Both male and female human participants received social feedback during a self-evaluation task while undergoing functional magnetic resonance imaging. We modeled self-belief updating by incorporating a reinforcement learning model within the network structure. Participants learned more rapidly from positive than negative feedback and were less likely to change self-views for traits with more dependencies in the network. Further, participants back propagated feedback across network relations while retrieving prior feedback on the basis of network similarity to inform ongoing self-views. Activation in ventromedial prefrontal cortex (vmPFC) reflected the constrained updating process such that positive feedback led to higher activation and negative feedback to less activation for traits with more dependencies. Additionally, vmPFC was associated with the novelty of a trait relative to previously self-evaluated traits in the network, and angular gyrus was associated with greater certainty for self-beliefs given the relevance of prior feedback. We propose that neural computations that selectively enhance or attenuate social feedback and retrieve past relevant experiences to guide ongoing self-evaluations may support an overall positive and coherent self-concept.SIGNIFICANCE STATEMENT We humans experience social feedback throughout our lives, but we do not dispassionately incorporate feedback into our self-concept. The implications of feedback for our entire self-concept plays a role in how we either change or retain our prior self-beliefs. In a neuroimaging study, we find that people are less likely to change their beliefs from feedback when the feedback has broader implications for the self-concept. This resistance to change is reflected in processing in the ventromedial prefrontal cortex, a region that is central to self-referential and social cognition. These results are broadly applicable given the role that maintaining a positive and coherent self-concept plays in promoting mental health and development throughout the lifespan.
Collapse
Affiliation(s)
- Jacob J Elder
- Department of Psychology, University of California, Riverside, Riverside, California 92521
| | | | - Brent L Hughes
- Department of Psychology, University of California, Riverside, Riverside, California 92521
| |
Collapse
|
4
|
Thorp JN, Gasser C, Blessing E, Davachi L. Data-Driven Clustering of Functional Signals Reveals Gradients in Processing Both within the Anterior Hippocampus and across Its Long Axis. J Neurosci 2022; 42:7431-7441. [PMID: 36002264 PMCID: PMC9525160 DOI: 10.1523/jneurosci.0269-22.2022] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/01/2022] [Revised: 08/09/2022] [Accepted: 08/12/2022] [Indexed: 11/21/2022] Open
Abstract
A particularly elusive puzzle concerning the hippocampus is how the structural differences along its long anteroposterior axis might beget meaningful functional differences, particularly in terms of the granularity of information processing. One measure posits to quantify this granularity by calculating the average statistical independence of the BOLD signal across neighboring voxels, or intervoxel similarity (IVS), and has shown the anterior hippocampus to process coarser-grained information than the posterior hippocampus. This measure, however, has yielded opposing results in studies of developmental and healthy aging samples, which also varied in fMRI acquisition parameters and hippocampal parcellation methods. To reconcile these findings, we measured IVS across two separate resting-state fMRI acquisitions and compared the results across many of the most widely used parcellation methods in a large young-adult sample of male and female humans (Acquisition 1, N = 233; Acquisition 2, N = 176). Finding conflicting results across acquisitions and parcellations, we reasoned that a data-driven approach to hippocampal parcellation is necessary. To this end, we implemented a group masked independent components analysis to identify functional subunits of the hippocampus, most notably separating the anterior hippocampus into separate anterior-medial, anterior-lateral, and posteroanterior-lateral components. Measuring IVS across these components revealed a decrease in IVS along the medial-lateral axis of the anterior hippocampus but an increase from anterior to posterior. We conclude that intervoxel similarity is deeply affected by parcellation and that grounding one's parcellation in a functionally informed approach might allow for a more complex and reliable characterization of the hippocampus.SIGNIFICANCE STATEMENT Processing information along hierarchical scales of granularity is critical for many of the feats of cognition considered most human. Recently, the changes in structure, cortical connectivity, and apparent functional properties across parcels of the hippocampal long axis have been hypothesized to underlie this hierarchical gradient in information processing. We show here, however, that the choice of parcellation method itself drastically affects one particular measure of granularity across the hippocampus and that a functionally informed approach to parcellation reveals gradients both within the anterior hippocampus and in nonlinear form across the long axis. These results point to the issue of parcellation as a critical one in the study of the hippocampus and reorient interpretation of existing results.
Collapse
Affiliation(s)
- John N Thorp
- Department of Psychology, Columbia University, New York, New York 10027
| | - Camille Gasser
- Department of Psychology, Columbia University, New York, New York 10027
| | - Esther Blessing
- Department of Psychiatry, New York University Langone Medical Center, New York University Grossman School of Medicine, New York, New York 10016
| | - Lila Davachi
- Department of Psychology, Columbia University, New York, New York 10027
- Nathan Kline Institute for Psychiatric Research, Orangeburg, New York 10962
| |
Collapse
|
5
|
Functional imaging analyses reveal prototype and exemplar representations in a perceptual single-category task. Commun Biol 2022; 5:896. [PMID: 36050393 PMCID: PMC9437087 DOI: 10.1038/s42003-022-03858-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Accepted: 08/16/2022] [Indexed: 11/16/2022] Open
Abstract
Similarity-based categorization can be performed by memorizing category members as exemplars or by abstracting the central tendency of the category – the prototype. In similarity-based categorization of stimuli with clearly identifiable dimensions from two categories, prototype representations were previously located in the hippocampus and the ventromedial prefrontal cortex (vmPFC) and exemplar representations in areas supporting visual memory. However, the neural implementation of exemplar and prototype representations in perceptual similarity-based categorization of single categories is unclear. To investigate these representations, we applied model-based univariate and multivariate analyses of functional imaging data from a dot-pattern paradigm-based task. Univariate prototype and exemplar representations occurred bilaterally in visual areas. Multivariate analyses additionally identified prototype representations in parietal areas and exemplar representations in the hippocampus. Bayesian analyses supported the non-presence of prototype representations in the hippocampus and the vmPFC. We additionally demonstrate that some individuals form both representation types simultaneously, probably granting flexibility in categorization strategies. Model-based univariate and multivariate analyses of fMRI data from 62 healthy participants in a dot-pattern paradigm-based task provide further insight into the neural basis of similarity-based categorization.
Collapse
|
6
|
Grigorenko EL, Love BC. Bidirectional influences of information sampling and concept learning. Psychol Rev 2022; 129:213-234. [PMID: 34279981 PMCID: PMC8766620 DOI: 10.1037/rev0000287] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Contemporary models of categorization typically tend to sidestep the problem of how information is initially encoded during decision making. Instead, a focus of this work has been to investigate how, through selective attention, stimulus representations are "contorted" such that behaviorally relevant dimensions are accentuated (or "stretched"), and the representations of irrelevant dimensions are ignored (or "compressed"). In high-dimensional real-world environments, it is computationally infeasible to sample all available information, and human decision makers selectively sample information from sources expected to provide relevant information. To address these and other shortcomings, we develop an active sampling model, Sampling Emergent Attention (SEA), which sequentially and strategically samples information sources until the expected cost of information exceeds the expected benefit. The model specifies the interplay of two components, one involved in determining the expected utility of different information sources and the other in representing knowledge and beliefs about the environment. These two components interact such that knowledge of the world guides information sampling, and what is sampled updates knowledge. Like human decision makers, the model displays strategic sampling behavior, such as terminating information search when sufficient information has been sampled and adaptively adjusting the search path in response to previously sampled information. The model also shows human-like failure modes. For example, when information exploitation is prioritized over exploration, the bidirectional influences between information sampling and learning can lead to the development of beliefs that systematically differ from reality. (PsycInfo Database Record (c) 2022 APA, all rights reserved).
Collapse
|
7
|
Learning exceptions to the rule in human and model via hippocampal encoding. Sci Rep 2021; 11:21429. [PMID: 34728698 PMCID: PMC8563716 DOI: 10.1038/s41598-021-00864-9] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/15/2021] [Accepted: 10/13/2021] [Indexed: 11/09/2022] Open
Abstract
Category learning helps us process the influx of information we experience daily. A common category structure is "rule-plus-exceptions," in which most items follow a general rule, but exceptions violate this rule. People are worse at learning to categorize exceptions than rule-following items, but improved exception categorization has been positively associated with hippocampal function. In light of model-based predictions that the nature of existing memories of related experiences impacts memory formation, here we use behavioural and computational modelling data to explore how learning sequence impacts performance in rule-plus-exception categorization. Our behavioural results indicate that exception categorization accuracy improves when exceptions are introduced later in learning, after exposure to rule-followers. To explore whether hippocampal learning systems also benefit from this manipulation, we simulate our task using a computational model of hippocampus. The model successful replicates our behavioural findings related to exception learning, and representational similarity analysis of the model's hidden layers suggests that model representations are impacted by trial sequence: delaying the introduction of an exception shifts its representation closer to its own category members. Our results provide novel computational evidence of how hippocampal learning systems can be targeted by learning sequence and bolster extant evidence of hippocampus's role in category learning.
Collapse
|
8
|
Learning and Representation of Hierarchical Concepts in Hippocampus and Prefrontal Cortex. J Neurosci 2021; 41:7675-7686. [PMID: 34330775 DOI: 10.1523/jneurosci.0657-21.2021] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/28/2021] [Revised: 07/02/2021] [Accepted: 07/08/2021] [Indexed: 11/21/2022] Open
Abstract
A key aspect of conceptual knowledge is that it can be flexibly applied at different levels of abstraction, implying a hierarchical organization. It is yet unclear how this hierarchical structure is acquired and represented in the brain. Here we investigate the computations underlying the acquisition and representation of the hierarchical structure of conceptual knowledge in the hippocampal-prefrontal system of 32 human participants (22 females). We assessed the hierarchical nature of learning during a novel tree-like categorization task via computational model comparisons. The winning model allowed to extract and quantify estimates for accumulation and updating of hierarchical compared with single-feature-based concepts from behavior. We find that mPFC tracks accumulation of hierarchical conceptual knowledge over time, and mPFC and hippocampus both support trial-to-trial updating. As a function of those learning parameters, mPFC and hippocampus further show connectivity changes to rostro-lateral PFC, which ultimately represented the hierarchical structure of the concept in the final stages of learning. Our results suggest that mPFC and hippocampus support the integration of accumulated evidence and instantaneous updates into hierarchical concept representations in rostro-lateral PFC.SIGNIFICANCE STATEMENT A hallmark of human cognition is the flexible use of conceptual knowledge at different levels of abstraction, ranging from a coarse category level to a fine-grained subcategory level. While previous work probed the representational geometry of long-term category knowledge, it is unclear how this hierarchical structure inherent to conceptual knowledge is acquired and represented. By combining a novel hierarchical concept learning task with computational modeling of categorization behavior and concurrent fMRI, we differentiate the roles of key concept learning regions in hippocampus and PFC in learning computations and the representation of a hierarchical category structure.
Collapse
|
9
|
Qu J, Hu L, Liu X, Dong J, Yang R, Mei L. The contributions of the left hippocampus and bilateral inferior parietal lobule to form-meaning associative learning. Psychophysiology 2021; 58:e13834. [PMID: 33949705 DOI: 10.1111/psyp.13834] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2020] [Revised: 04/13/2021] [Accepted: 04/13/2021] [Indexed: 11/26/2022]
Abstract
Existing studies have identified crucial roles for the hippocampus and a distributed set of cortical regions (e.g., the inferior parietal cortex) in learning novel words. Nevertheless, researchers have not clearly determined how the hippocampus and cortical regions dynamically interact during novel word learning, especially during form-meaning associative learning. As a method to address this question, we used an online learning paradigm and representational similarity analysis to explore the contributions of the hippocampus and neocortex to form-meaning associative learning. Twenty-nine native Chinese college students were recruited to learn 30 form-meaning pairs, which were repeated 7 times during fMRI scan. Form-meaning associative learning elicited activations in a wide neural network including regions required for word processing (i.e., the bilateral inferior frontal gyrus and the occipitotemporal cortex), regions required for encoding (i.e., the bilateral parahippocampus and hippocampus), and regions required for cognitive control (i.e., the anterior cingulate cortex and dorsolateral prefrontal cortex). More importantly, our study revealed the differential roles of the left hippocampus and bilateral inferior parietal lobule (IPL) in form-meaning associative learning. Specifically, higher pattern similarity in the bilateral IPL in the early learning phase (repetitions 1 to 3) was related to better learning performance, while higher pattern similarity in the left hippocampus in the late learning phase (repetitions 5 to 7) was associated with better learning performance. These findings indicate that the hippocampus and cortical regions (e.g., the IPL) contribute to form-meaning learning in different stages.
Collapse
Affiliation(s)
- Jing Qu
- Key Laboratory of Brain, Cognition and Education Sciences, Ministry of Education, Guangzhou, China.,School of Psychology, South China Normal University, Guangzhou, China.,Center for Studies of Psychological Application, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Liyuan Hu
- Key Laboratory of Brain, Cognition and Education Sciences, Ministry of Education, Guangzhou, China.,School of Psychology, South China Normal University, Guangzhou, China.,Center for Studies of Psychological Application, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Xiaoyu Liu
- Key Laboratory of Brain, Cognition and Education Sciences, Ministry of Education, Guangzhou, China.,School of Psychology, South China Normal University, Guangzhou, China.,Center for Studies of Psychological Application, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Jie Dong
- Key Laboratory of Brain, Cognition and Education Sciences, Ministry of Education, Guangzhou, China.,School of Psychology, South China Normal University, Guangzhou, China.,Center for Studies of Psychological Application, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Rui Yang
- Key Laboratory of Brain, Cognition and Education Sciences, Ministry of Education, Guangzhou, China.,School of Psychology, South China Normal University, Guangzhou, China.,Center for Studies of Psychological Application, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| | - Leilei Mei
- Key Laboratory of Brain, Cognition and Education Sciences, Ministry of Education, Guangzhou, China.,School of Psychology, South China Normal University, Guangzhou, China.,Center for Studies of Psychological Application, South China Normal University, Guangzhou, China.,Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, Guangzhou, China
| |
Collapse
|
10
|
Mok RM, Love BC. Abstract Neural Representations of Category Membership beyond Information Coding Stimulus or Response. J Cogn Neurosci 2020; 34:1719-1735. [PMID: 33226315 DOI: 10.1162/jocn_a_01651] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/04/2022]
Abstract
For decades, researchers have debated whether mental representations are symbolic or grounded in sensory inputs and motor programs. Certainly, aspects of mental representations are grounded. However, does the brain also contain abstract concept representations that mediate between perception and action in a flexible manner not tied to the details of sensory inputs and motor programs? Such conceptual pointers would be useful when concepts remain constant despite changes in appearance and associated actions. We evaluated whether human participants acquire such representations using fMRI. Participants completed a probabilistic concept learning task in which sensory, motor, and category variables were not perfectly coupled or entirely independent, making it possible to observe evidence for abstract representations or purely grounded representations. To assess how the learned concept structure is represented in the brain, we examined brain regions implicated in flexible cognition (e.g., pFC and parietal cortex) that are most likely to encode an abstract representation removed from sensory-motor details. We also examined sensory-motor regions that might encode grounded sensory-motor-based representations tuned for categorization. Using a cognitive model to estimate participants' category rule and multivariate pattern analysis of fMRI data, we found the left pFC and MT coded for category in the absence of information coding for stimulus or response. Because category was based on the stimulus, finding an abstract representation of category was not inevitable. Our results suggest that certain brain areas support categorization behavior by constructing concept representations in a format akin to a symbol that differs from stimulus-motor codes.
Collapse
Affiliation(s)
- Robert M Mok
- University College London.,University of Cambridge
| | - Bradley C Love
- University College London.,The Alan Turing Institute, London, UK
| |
Collapse
|
11
|
Abstract
Notions of mechanism, emergence, reduction and explanation are all tied to levels of analysis. I cover the relationship between lower and higher levels, suggest a level of mechanism approach for neuroscience in which the components of a mechanism can themselves be further decomposed and argue that scientists' goals are best realized by focusing on pragmatic concerns rather than on metaphysical claims about what is ‘real'. Inexplicably, neuroscientists are enchanted by both reduction and emergence. A fascination with reduction is misplaced given that theory is neither sufficiently developed nor formal to allow it, whereas metaphysical claims of emergence bring physicalism into question. Moreover, neuroscience's existence as a discipline is owed to higher-level concepts that prove useful in practice. Claims of biological plausibility are shown to be incoherent from a level of mechanism view and more generally are vacuous. Instead, the relevant findings to address should be specified so that model selection procedures can adjudicate between competing accounts. Model selection can help reduce theoretical confusions and direct empirical investigations. Although measures themselves, such as behaviour, blood-oxygen-level-dependent (BOLD) and single-unit recordings, are not levels of analysis, like levels, no measure is fundamental and understanding how measures relate can hasten scientific progress. This article is part of the theme issue ‘Key relationships between non-invasive functional neuroimaging and the underlying neuronal activity'.
Collapse
Affiliation(s)
- Bradley C Love
- University College London, Gower Street, London WC1E 6BT, UK
| |
Collapse
|
12
|
The Hippocampus Maps Concept Space, Not Feature Space. J Neurosci 2020; 40:7318-7325. [PMID: 32826311 DOI: 10.1523/jneurosci.0494-20.2020] [Citation(s) in RCA: 31] [Impact Index Per Article: 7.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2020] [Revised: 07/14/2020] [Accepted: 07/15/2020] [Indexed: 01/20/2023] Open
Abstract
The hippocampal formation encodes maps of space and a key question in neuroscience is whether its spatial coding principles also provide a universal metric for the organization of nonspatial, conceptual information. Previous work demonstrated directional coding during navigation through a continuous stimulus feature space as well as mapping of distances in a feature space that was relevant for concept learning. Here we provide the first unambiguous evidence for a hippocampal representation of the actual concept space, by showing that the hippocampal distance signal selectively reflects the mapping of specifically conceptually relevant rather than of all feature dimensions. During fMRI scanning of 32 human participants (21 females), we presented everyday objects, which had beforehand been associated with specific values on three continuous feature dimensions. Crucially, only two dimensions were relevant to prior concept learning. We find that hippocampal responses to the objects reflect their relative distances in a space defined along conceptually relevant dimensions compared with distances in a space defined along all feature dimensions. These findings suggest that the hippocampus supports knowledge acquisition by dynamically encoding information in a space spanned along dimensions that are relevant in relation to define concepts.SIGNIFICANCE STATEMENT How are neural representations of conceptual knowledge organized, such that humans are able to infer never experienced relations or categorize new exemplars? Map-like representations as supported by the hippocampal formation to encode physical space during navigation have been suggested as a suitable format. Here we provide the first evidence for a hippocampal representation of a conceptual space compared with a general feature-based space.
Collapse
|
13
|
|
14
|
Loued-Khenissi L, Preuschoff K. Information Theoretic Characterization of Uncertainty Distinguishes Surprise From Accuracy Signals in the Brain. Front Artif Intell 2020; 3:5. [PMID: 33733125 PMCID: PMC7861235 DOI: 10.3389/frai.2020.00005] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2019] [Accepted: 02/03/2020] [Indexed: 12/02/2022] Open
Abstract
Uncertainty presents a problem for both human and machine decision-making. While utility maximization has traditionally been viewed as the motive force behind choice behavior, it has been theorized that uncertainty minimization may supersede reward motivation. Beyond reward, decisions are guided by belief, i.e., confidence-weighted expectations. Evidence challenging a belief evokes surprise, which signals a deviation from expectation (stimulus-bound surprise) but also provides an information gain. To support the theory that uncertainty minimization is an essential drive for the brain, we probe the neural trace of uncertainty-related decision variables, namely confidence, surprise, and information gain, in a discrete decision with a deterministic outcome. Confidence and surprise were elicited with a gambling task administered in a functional magnetic resonance imaging experiment, where agents start with a uniform probability distribution, transition to a non-uniform probabilistic state, and end in a fully certain state. After controlling for reward expectation, we find confidence, taken as the negative entropy of a trial, correlates with a response in the hippocampus and temporal lobe. Stimulus-bound surprise, taken as Shannon information, correlates with responses in the insula and striatum. In addition, we also find a neural response to a measure of information gain captured by a confidence error, a quantity we dub accuracy. BOLD responses to accuracy were found in the cerebellum and precuneus, after controlling for reward prediction errors and stimulus-bound surprise at the same time point. Our results suggest that, even absent an overt need for learning, the human brain expends energy on information gain and uncertainty minimization.
Collapse
Affiliation(s)
- Leyla Loued-Khenissi
- Brain Mind Institute, École Polytechnique Fédérale de Lausanne, Lausanne, Switzerland
| | - Kerstin Preuschoff
- Swiss Center for Affective Sciences, University of Geneva, Geneva, Switzerland
- Geneva Finance Research Institute, University of Geneva, Geneva, Switzerland
| |
Collapse
|
15
|
Ventromedial prefrontal cortex compression during concept learning. Nat Commun 2020; 11:46. [PMID: 31911628 PMCID: PMC6946809 DOI: 10.1038/s41467-019-13930-8] [Citation(s) in RCA: 50] [Impact Index Per Article: 12.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/14/2018] [Accepted: 12/09/2019] [Indexed: 12/28/2022] Open
Abstract
Prefrontal cortex (PFC) is thought to support the ability to focus on goal-relevant information by filtering out irrelevant information, a process akin to dimensionality reduction. Here, we test this dimensionality reduction hypothesis by relating a data-driven approach to characterizing the complexity of neural representation with a theoretically-supported computational model of learning. We find evidence of goal-directed dimensionality reduction within human ventromedial PFC during learning. Importantly, by using computational predictions of each participant’s attentional strategies during learning, we find that that the degree of neural compression predicts an individual’s ability to selectively attend to concept-specific information. These findings suggest a domain-general mechanism of learning through compression in ventromedial PFC. Efficient learning is akin to goal-directed dimensionality reduction, in which relevant information is highlighted and irrelevant input is ignored. Here, the authors show that ventromedial prefrontal cortex uniquely supports such learning by compressing neural codes to represent goal-specific information.
Collapse
|
16
|
Zeithamova D, Mack ML, Braunlich K, Davis T, Seger CA, van Kesteren MTR, Wutz A. Brain Mechanisms of Concept Learning. J Neurosci 2019; 39:8259-8266. [PMID: 31619495 PMCID: PMC6794919 DOI: 10.1523/jneurosci.1166-19.2019] [Citation(s) in RCA: 31] [Impact Index Per Article: 6.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/21/2019] [Revised: 08/06/2019] [Accepted: 08/09/2019] [Indexed: 01/23/2023] Open
Abstract
Concept learning, the ability to extract commonalities and highlight distinctions across a set of related experiences to build organized knowledge, is a critical aspect of cognition. Previous reviews have focused on concept learning research as a means for dissociating multiple brain systems. The current review surveys recent work that uses novel analytical approaches, including the combination of computational modeling with neural measures, focused on testing theories of specific computations and representations that contribute to concept learning. We discuss in detail the roles of the hippocampus, ventromedial prefrontal, lateral prefrontal, and lateral parietal cortices, and how their engagement is modulated by the coherence of experiences and the current learning goals. We conclude that the interaction of multiple brain systems relating to learning, memory, attention, perception, and reward support a flexible concept-learning mechanism that adapts to a range of category structures and incorporates motivational states, making concept learning a fruitful research domain for understanding the neural dynamics underlying complex behaviors.
Collapse
Affiliation(s)
- Dagmar Zeithamova
- Department of Psychology and Institute of Neuroscience, University of Oregon, Eugene, Oregon 97403,
| | - Michael L Mack
- Department of Psychology, University of Toronto, Toronto, Ontario M5S 3G3, Canada,
| | - Kurt Braunlich
- Department of Psychology and Program in Molecular, Cellular, and Integrative Neurosciences, Colorado State University, Fort Collins, Colorado 80523
| | - Tyler Davis
- Department of Psychological Sciences, Texas Tech University, Lubbock, Texas 79403
| | - Carol A Seger
- Center for the Study of Applied Psychology, Key Laboratory of Mental Health and Cognitive Science of Guangdong Province, School of Psychology, South China Normal University, Guangzhou 510631, China
- Department of Psychology and Program in Molecular, Cellular, and Integrative Neurosciences, Colorado State University, Fort Collins, Colorado 80523
| | - Marlieke T R van Kesteren
- Section of Education Sciences and LEARN! Research Institute, Vrije Universiteit Amsterdam, Amsterdam 1081 BT, The Netherlands
- Institute for Brain and Behavior Amsterdam, Vrije Universiteit Amsterdam, Amsterdam 1081 BT, The Netherlands
| | - Andreas Wutz
- The Picower Institute for Learning & Memory and Department of Brain & Cognitive Sciences, Massachusetts Institute of Technology, Cambridge, Massachusetts 02139
- Center for Cognitive Neuroscience, University of Salzburg, Hellbrunnerstrasse 34, 5020 Salzburg, Austria, and
| |
Collapse
|
17
|
Wirebring LK, Stillesjö S, Eriksson J, Juslin P, Nyberg L. A Similarity-Based Process for Human Judgment in the Parietal Cortex. Front Hum Neurosci 2018; 12:481. [PMID: 30631267 PMCID: PMC6315133 DOI: 10.3389/fnhum.2018.00481] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/14/2018] [Accepted: 11/16/2018] [Indexed: 11/24/2022] Open
Abstract
One important distinction in psychology is between inferences based on associative memory and inferences based on analysis and rules. Much previous empirical work conceive of associative and analytical processes as two exclusive ways of addressing a judgment task, where only one process is selected and engaged at a time, in an either-or fashion. However, related work indicate that the processes are better understood as being in interplay and simultaneously engaged. Based on computational modeling and brain imaging of spontaneously adopted judgment strategies together with analyses of brain activity elicited in tasks where participants were explicitly instructed to perform similarity-based associative judgments or rule-based judgments (n = 74), we identified brain regions related to the two types of processes. We observed considerable overlap in activity patterns. The precuneus was activated for both types of judgments, and its activity predicted how well a similarity-based model fit the judgments. Activity in the superior frontal gyrus predicted the fit of a rule-based judgment model. The results suggest the precuneus as a key node for similarity-based judgments, engaged both when overt responses are guided by similarity-based and rule-based processes. These results are interpreted such that similarity-based processes are engaged in parallel to rule-based-processes, a finding with direct implications for cognitive theories of judgment.
Collapse
Affiliation(s)
- Linnea Karlsson Wirebring
- Department of Psychology, Umeå University, Umeå, Sweden
- Department of Integrative Medical Biology, Umeå University, Umeå, Sweden
- Umeå Center for Functional Brain Imaging, Umeå University, Umeå, Sweden
| | - Sara Stillesjö
- Department of Integrative Medical Biology, Umeå University, Umeå, Sweden
- Umeå Center for Functional Brain Imaging, Umeå University, Umeå, Sweden
| | - Johan Eriksson
- Department of Integrative Medical Biology, Umeå University, Umeå, Sweden
- Umeå Center for Functional Brain Imaging, Umeå University, Umeå, Sweden
| | - Peter Juslin
- Department of Psychology, Uppsala University, Uppsala, Sweden
| | - Lars Nyberg
- Department of Integrative Medical Biology, Umeå University, Umeå, Sweden
- Umeå Center for Functional Brain Imaging, Umeå University, Umeå, Sweden
- Department of Radiation Sciences, Umeå University, Umeå, Sweden
| |
Collapse
|
18
|
Inhoff MC, Libby LA, Noguchi T, Love BC, Ranganath C. Dynamic integration of conceptual information during learning. PLoS One 2018; 13:e0207357. [PMID: 30427917 PMCID: PMC6235360 DOI: 10.1371/journal.pone.0207357] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/12/2018] [Accepted: 10/30/2018] [Indexed: 01/20/2023] Open
Abstract
The development and application of concepts is a critical component of cognition. Although concepts can be formed on the basis of simple perceptual or semantic features, conceptual representations can also capitalize on similarities across feature relationships. By representing these types of higher-order relationships, concepts can simplify the learning problem and facilitate decisions. Despite this, little is known about the neural mechanisms that support the construction and deployment of these kinds of higher-order concepts during learning. To address this question, we combined a carefully designed associative learning task with computational model-based functional magnetic resonance imaging (fMRI). Participants were scanned as they learned and made decisions about sixteen pairs of cues and associated outcomes. Associations were structured such that individual cues shared feature relationships, operationalized as shared patterns of cue pair-outcome associations. In order to capture the large number of possible conceptual representational structures that participants might employ and to evaluate how conceptual representations are used during learning, we leveraged a well-specified Bayesian computational model of category learning [1]. Behavioral and model-based results revealed that participants who displayed a tendency to link experiences in memory benefitted from faster learning rates, suggesting that the use of the conceptual structure in the task facilitated decisions about cue pair-outcome associations. Model-based fMRI analyses revealed that trial-by-trial integration of cue information into higher-order conceptual representations was supported by an anterior temporal (AT) network of regions previously implicated in representing complex conjunctions of features and meaning-based information.
Collapse
Affiliation(s)
- Marika C. Inhoff
- Department of Psychology, University of California at Davis, Davis, CA, United States of America
| | - Laura A. Libby
- Center for Neuroscience, University of California at Davis, Davis, CA, United States of America
| | - Takao Noguchi
- Department of Experimental Psychology, University College London, London, United Kingdom
| | - Bradley C. Love
- Department of Experimental Psychology, University College London, London, United Kingdom
- Alan Turing Institute, Kings Cross, London, United Kingdom
| | - Charan Ranganath
- Department of Psychology, University of California at Davis, Davis, CA, United States of America
- Center for Neuroscience, University of California at Davis, Davis, CA, United States of America
- * E-mail:
| |
Collapse
|
19
|
O'Bryan SR, Worthy DA, Livesey EJ, Davis T. Model-based fMRI reveals dissimilarity processes underlying base rate neglect. eLife 2018; 7:36395. [PMID: 30074478 PMCID: PMC6108825 DOI: 10.7554/elife.36395] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/05/2018] [Accepted: 08/01/2018] [Indexed: 11/13/2022] Open
Abstract
Extensive evidence suggests that people use base rate information inconsistently in decision making. A classic example is the inverse base rate effect (IBRE), whereby participants classify ambiguous stimuli sharing features of both common and rare categories as members of the rare category. Computational models of the IBRE have posited that it arises either from associative similarity-based mechanisms or from dissimilarity-based processes that may depend on higher-level inference. Here we develop a hybrid model, which posits that similarity- and dissimilarity-based evidence both contribute to the IBRE, and test it using functional magnetic resonance imaging data collected from human subjects completing an IBRE task. Consistent with our model, multivoxel pattern analysis reveals that activation patterns on ambiguous test trials contain information consistent with dissimilarity-based processing. Further, trial-by-trial activation in left rostrolateral prefrontal cortex tracks model-based predictions for dissimilarity-based processing, consistent with theories positing a role for higher-level symbolic processing in the IBRE.
Collapse
Affiliation(s)
- Sean R O'Bryan
- Department of Psychological Sciences, Texas Tech University, Lubbock, United States
| | - Darrell A Worthy
- Department of Psychology, Texas A&M University, College Station, United States
| | - Evan J Livesey
- School of Psychology, University of Sydney, Sydney, Australia
| | - Tyler Davis
- Department of Psychological Sciences, Texas Tech University, Lubbock, United States
| |
Collapse
|
20
|
Neurocomputational Dynamics of Sequence Learning. Neuron 2018; 98:1282-1293.e4. [DOI: 10.1016/j.neuron.2018.05.013] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/12/2017] [Revised: 03/26/2018] [Accepted: 05/07/2018] [Indexed: 11/16/2022]
|
21
|
O'Bryan SR, Walden E, Serra MJ, Davis T. Rule activation and ventromedial prefrontal engagement support accurate stopping in self-paced learning. Neuroimage 2018; 172:415-426. [PMID: 29410293 DOI: 10.1016/j.neuroimage.2018.01.084] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/31/2017] [Revised: 01/26/2018] [Accepted: 01/30/2018] [Indexed: 10/18/2022] Open
Abstract
When weighing evidence for a decision, individuals are continually faced with the choice of whether to gather more information or act on what has already been learned. The present experiment employed a self-paced category learning task and fMRI to examine the neural mechanisms underlying stopping of information search and how they contribute to choice accuracy. Participants learned to classify triads of face, object, and scene cues into one of two categories using a rule based on one of the stimulus dimensions. After each trial, participants were given the option to explicitly solve the rule or continue learning. Representational similarity analysis (RSA) was used to examine activation of rule-relevant information on trials leading up to a decision to solve the rule. We found that activation of rule-relevant information increased leading up to participants' stopping decisions. Stopping was associated with widespread activation that included medial prefrontal cortex and visual association areas. Engagement of ventromedial prefrontal cortex (vmPFC) was associated with accurate stopping, and activation in this region was functionally coupled with signal in dorsolateral prefrontal cortex (dlPFC). Results suggest that activating rule information when deciding whether to stop an information search increases choice accuracy, and that the response profile of vmPFC during such decisions may provide an index of effective learning.
Collapse
Affiliation(s)
- Sean R O'Bryan
- Department of Psychological Sciences, Texas Tech University, Lubbock, TX 79409, USA.
| | - Eric Walden
- Rawls College of Business, Texas Tech University, Lubbock, TX 79409, USA
| | - Michael J Serra
- Department of Psychological Sciences, Texas Tech University, Lubbock, TX 79409, USA
| | - Tyler Davis
- Department of Psychological Sciences, Texas Tech University, Lubbock, TX 79409, USA
| |
Collapse
|
22
|
Paniukov D, Davis T. The evaluative role of rostrolateral prefrontal cortex in rule-based category learning. Neuroimage 2018; 166:19-31. [DOI: 10.1016/j.neuroimage.2017.10.057] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/11/2017] [Revised: 09/18/2017] [Accepted: 10/25/2017] [Indexed: 01/28/2023] Open
|
23
|
Morton NW, Sherrill KR, Preston AR. Memory integration constructs maps of space, time, and concepts. Curr Opin Behav Sci 2017; 17:161-168. [PMID: 28924579 DOI: 10.1016/j.cobeha.2017.08.007] [Citation(s) in RCA: 44] [Impact Index Per Article: 6.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/09/2023]
Abstract
Recent evidence demonstrates that new events are learned in the context of their relationships to existing memories. Within the hippocampus and medial prefrontal cortex, related memories are represented by integrated codes that connect events experienced at different times and places. Integrated codes form the basis of spatial, temporal, and conceptual maps of experience. These maps represent information that goes beyond direct experience and support generalization behaviors that require knowledge be used in new ways. The degree to which an individual memory is integrated into a coherent map is determined by its spatial, temporal, and conceptual proximity to existing knowledge. Integration is observed over a wide range of scales, suggesting that memories contain information about both broad and fine-grained contexts.
Collapse
Affiliation(s)
- Neal W Morton
- Center for Learning & Memory, The University of Texas at Austin
| | | | - Alison R Preston
- Center for Learning & Memory, The University of Texas at Austin.,Department of Psychology, The University of Texas at Austin.,Department of Neuroscience, The University of Texas at Austin
| |
Collapse
|
24
|
Braunlich K, Liu Z, Seger CA. Occipitotemporal Category Representations Are Sensitive to Abstract Category Boundaries Defined by Generalization Demands. J Neurosci 2017; 37:7631-7642. [PMID: 28674173 PMCID: PMC6596645 DOI: 10.1523/jneurosci.3825-16.2017] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2016] [Revised: 06/20/2017] [Accepted: 06/27/2017] [Indexed: 11/21/2022] Open
Abstract
Categorization involves organizing perceptual information so as to maximize differences along dimensions that predict class membership while minimizing differences along dimensions that do not. In the current experiment, we investigated how neural representations reflecting learned category structure vary according to generalization demands. We asked male and female human participants to switch between two rules when determining whether stimuli should be considered members of a single known category. When categorizing according to the "strict" rule, participants were required to limit generalization to make fine-grained distinctions between stimuli and the category prototype. When categorizing according to the "lax" rule, participants were required to generalize category knowledge to highly atypical category members. As expected, frontoparietal regions were primarily sensitive to decisional demands (i.e., the distance of each stimulus from the active category boundary), whereas occipitotemporal representations were primarily sensitive to stimulus typicality (i.e., the similarity between each exemplar and the category prototype). Interestingly, occipitotemporal representations of stimulus typicality differed between rules. While decoding models were able to predict unseen data when trained and tested on the same rule, they were unable to do so when trained and tested on different rules. We additionally found that the discriminability of the multivariate signal negatively covaried with distance from the active category boundary. Thus, whereas many accounts of occipitotemporal cortex emphasize its important role in transforming visual information to accentuate learned category structure, our results highlight the flexible nature of these representations with regards to transient decisional demands.SIGNIFICANCE STATEMENT Occipitotemporal representations are known to reflect category structure and are often assumed to be largely invariant with regards to transient decisional demands. We found that representations of equivalent stimuli differed between strict and lax generalization rules, and that the discriminability of these representations increased as distance from abstract category boundaries decreased. Our results therefore indicate that occipitotemporal representations are flexibly modulated by abstract decisional factors.
Collapse
Affiliation(s)
- Kurt Braunlich
- Department of Experimental Psychology, University College London, London WC1E 6BT, United Kingdom, and
- Department of Psychology and Program in Molecular, Cellular, and Integrative Neurosciences, Colorado State University, Fort Collins, Colorado 80523
| | - Zhiya Liu
- Center for the Study of Applied Psychology, Key Laboratory of Mental Health and Cognitive Science of Guangdong Province, School of Psychology, South China Normal University, Guangzhou 510631, PR China,
| | - Carol A Seger
- Center for the Study of Applied Psychology, Key Laboratory of Mental Health and Cognitive Science of Guangdong Province, School of Psychology, South China Normal University, Guangzhou 510631, PR China,
- Department of Psychology and Program in Molecular, Cellular, and Integrative Neurosciences, Colorado State University, Fort Collins, Colorado 80523
| |
Collapse
|
25
|
Mack ML, Love BC, Preston AR. Building concepts one episode at a time: The hippocampus and concept formation. Neurosci Lett 2017; 680:31-38. [PMID: 28801273 DOI: 10.1016/j.neulet.2017.07.061] [Citation(s) in RCA: 64] [Impact Index Per Article: 9.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/18/2017] [Revised: 07/12/2017] [Accepted: 07/31/2017] [Indexed: 11/17/2022]
Abstract
Concepts organize our experiences and allow for meaningful inferences in novel situations. Acquiring new concepts requires extracting regularities across multiple learning experiences, a process formalized in mathematical models of learning. These models posit a computational framework that has increasingly aligned with the expanding repertoire of functions associated with the hippocampus. Here, we propose the Episodes-to-Concepts (EpCon) theoretical model of hippocampal function in concept learning and review evidence for the hippocampal computations that support concept formation including memory integration, attentional biasing, and memory-based prediction error. We focus on recent studies that have directly assessed the hippocampal role in concept learning with an innovative approach that combines computational modeling and sophisticated neuroimaging measures. Collectively, this work suggests that the hippocampus does much more than encode individual episodes; rather, it adaptively transforms initially-encoded episodic memories into organized conceptual knowledge that drives novel behavior.
Collapse
Affiliation(s)
- Michael L Mack
- Department of Psychology, University of Toronto, Toronto, ON, Canada.
| | - Bradley C Love
- Experimental Psychology, University College London, London, UK; Alan Turing Institute, London, UK
| | - Alison R Preston
- Department of Psychology, The University of Texas at Austin, Austin, TX, USA; Center for Learning and Memory, The University of Texas at Austin, Austin, TX, USA; Department of Neuroscience, The University of Texas at Austin, Austin, TX, USA.
| |
Collapse
|
26
|
Davis T, Goldwater M, Giron J. From Concrete Examples to Abstract Relations: The Rostrolateral Prefrontal Cortex Integrates Novel Examples into Relational Categories. Cereb Cortex 2017; 27:2652-2670. [PMID: 27130661 DOI: 10.1093/cercor/bhw099] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/07/2023] Open
Abstract
The ability to form relational categories for objects that share few features in common is a hallmark of human cognition. For example, anything that can play a preventative role, from a boulder to poverty, can be a "barrier." However, neurobiological research has focused solely on how people acquire categories defined by features. The present functional magnetic resonance imaging study examines how relational and feature-based category learning compare in well-matched learning tasks. Using a computational model-based approach, we observed a cluster in left rostrolateral prefrontal cortex (rlPFC) that tracked quantitative predictions for the representational distance between test and training examples during relational categorization. Contrastingly, medial and dorsal PFC exhibited graded activation that tracked decision evidence during both feature-based and relational categorization. The results suggest that rlPFC computes an alignment signal that is critical for integrating novel examples during relational categorization whereas other PFC regions support more general decision functions.
Collapse
Affiliation(s)
- Tyler Davis
- Department of Psychological Sciences, Texas Tech University, Lubbock, TX 79403, USA
| | - Micah Goldwater
- School of Psychology, University of Sydney, Sydney, New South Wales 2006, Australia
| | - Josue Giron
- School of Psychology, University of Sydney, Sydney, New South Wales 2006, Australia
| |
Collapse
|
27
|
Palmeri TJ, Love BC, Turner BM. Model-based cognitive neuroscience. JOURNAL OF MATHEMATICAL PSYCHOLOGY 2017; 76:59-64. [PMID: 30147145 PMCID: PMC6103531 DOI: 10.1016/j.jmp.2016.10.010] [Citation(s) in RCA: 17] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
This special issue explores the growing intersection between mathematical psychology and cognitive neuroscience. Mathematical psychology, and cognitive modeling more generally, has a rich history of formalizing and testing hypotheses about cognitive mechanisms within a mathematical and computational language, making exquisite predictions of how people perceive, learn, remember, and decide. Cognitive neuroscience aims to identify neural mechanisms associated with key aspects of cognition using techniques like neurophysiology, electrophysiology, and structural and functional brain imaging. These two come together in a powerful new approach called model-based cognitive neuroscience, which can both inform cognitive modeling and help to interpret neural measures. Cognitive models decompose complex behavior into representations and processes and these latent model states can be used to explain the modulation of brain states under different experimental conditions. Reciprocally, neural measures provide data that help constrain cognitive models and adjudicate between competing cognitive models that make similar predictions about behavior. As examples, brain measures are related to cognitive model parameters fitted to individual participant data, measures of brain dynamics are related to measures of model dynamics, model parameters are constrained by neural measures, model parameters or model states are used in statistical analyses of neural data, or neural and behavioral data are analyzed jointly within a hierarchical modeling framework. We provide an introduction to the field of model-based cognitive neuroscience and to the articles contained within this special issue.
Collapse
|
28
|
Wijeakumar S, Ambrose JP, Spencer JP, Curtu R. Model-based functional neuroimaging using dynamic neural fields: An integrative cognitive neuroscience approach. JOURNAL OF MATHEMATICAL PSYCHOLOGY 2017; 76:212-235. [PMID: 29118459 PMCID: PMC5673285 DOI: 10.1016/j.jmp.2016.11.002] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
A fundamental challenge in cognitive neuroscience is to develop theoretical frameworks that effectively span the gap between brain and behavior, between neuroscience and psychology. Here, we attempt to bridge this divide by formalizing an integrative cognitive neuroscience approach using dynamic field theory (DFT). We begin by providing an overview of how DFT seeks to understand the neural population dynamics that underlie cognitive processes through previous applications and comparisons to other modeling approaches. We then use previously published behavioral and neural data from a response selection Go/Nogo task as a case study for model simulations. Results from this study served as the 'standard' for comparisons with a model-based fMRI approach using dynamic neural fields (DNF). The tutorial explains the rationale and hypotheses involved in the process of creating the DNF architecture and fitting model parameters. Two DNF models, with similar structure and parameter sets, are then compared. Both models effectively simulated reaction times from the task as we varied the number of stimulus-response mappings and the proportion of Go trials. Next, we directly simulated hemodynamic predictions from the neural activation patterns from each model. These predictions were tested using general linear models (GLMs). Results showed that the DNF model that was created by tuning parameters to capture simultaneously trends in neural activation and behavioral data quantitatively outperformed a Standard GLM analysis of the same dataset. Further, by using the GLM results to assign functional roles to particular clusters in the brain, we illustrate how DNF models shed new light on the neural populations' dynamics within particular brain regions. Thus, the present study illustrates how an interactive cognitive neuroscience model can be used in practice to bridge the gap between brain and behavior.
Collapse
Affiliation(s)
| | - Joseph P. Ambrose
- University of Iowa, Department of Psychology and Delta Center, Iowa City 52242, Iowa, U.S.A
| | - John P. Spencer
- University of East Anglia, School of Psychology, Norwich NR4 7TJ
| | - Rodica Curtu
- University of Iowa, Department of Mathematics and Delta Center, Iowa City 52242, Iowa, U.S.A
| |
Collapse
|
29
|
Turner BM, Forstmann BU, Love BC, Palmeri TJ, Van Maanen L. Approaches to Analysis in Model-based Cognitive Neuroscience. JOURNAL OF MATHEMATICAL PSYCHOLOGY 2017; 76:65-79. [PMID: 31745373 PMCID: PMC6863443 DOI: 10.1016/j.jmp.2016.01.001] [Citation(s) in RCA: 76] [Impact Index Per Article: 10.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/06/2023]
Abstract
Our understanding of cognition has been advanced by two traditionally nonoverlapping and non-interacting groups. Mathematical psychologists rely on behavioral data to evaluate formal models of cognition, whereas cognitive neuroscientists rely on statistical models to understand patterns of neural activity, often without any attempt to make a connection to the mechanism supporting the computation. Both approaches suffer from critical limitations as a direct result of their focus on data at one level of analysis (cf. Marr, 1982), and these limitations have inspired researchers to attempt to combine both neural and behavioral measures in a cross-level integrative fashion. The importance of solving this problem has spawned several entirely new theoretical and statistical frameworks developed by both mathematical psychologists and cognitive neuroscientists. However, with each new approach comes a particular set of limitations and benefits. In this article, we survey and characterize several approaches for linking brain and behavioral data. We organize these approaches on the basis of particular cognitive modeling goals: (1) using the neural data to constrain a behavioral model, (2) using the behavioral model to predict neural data, and (3) fitting both neural and behavioral data simultaneously. Within each goal, we highlight a few particularly successful approaches for accomplishing that goal, and discuss some applications. Finally, we provide a conceptual guide to choosing among various analytic approaches in performing model-based cognitive neuroscience.
Collapse
|
30
|
Dynamic updating of hippocampal object representations reflects new conceptual knowledge. Proc Natl Acad Sci U S A 2016; 113:13203-13208. [PMID: 27803320 DOI: 10.1073/pnas.1614048113] [Citation(s) in RCA: 109] [Impact Index Per Article: 13.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/08/2023] Open
Abstract
Concepts organize the relationship among individual stimuli or events by highlighting shared features. Often, new goals require updating conceptual knowledge to reflect relationships based on different goal-relevant features. Here, our aim is to determine how hippocampal (HPC) object representations are organized and updated to reflect changing conceptual knowledge. Participants learned two classification tasks in which successful learning required attention to different stimulus features, thus providing a means to index how representations of individual stimuli are reorganized according to changing task goals. We used a computational learning model to capture how people attended to goal-relevant features and organized object representations based on those features during learning. Using representational similarity analyses of functional magnetic resonance imaging data, we demonstrate that neural representations in left anterior HPC correspond with model predictions of concept organization. Moreover, we show that during early learning, when concept updating is most consequential, HPC is functionally coupled with prefrontal regions. Based on these findings, we propose that when task goals change, object representations in HPC can be organized in new ways, resulting in updated concepts that highlight the features most critical to the new goal.
Collapse
|
31
|
Zeithamova D, Manthuruthil C, Preston AR. Repetition suppression in the medial temporal lobe and midbrain is altered by event overlap. Hippocampus 2016; 26:1464-1477. [PMID: 27479864 DOI: 10.1002/hipo.22622] [Citation(s) in RCA: 16] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 07/29/2016] [Indexed: 11/10/2022]
Abstract
Repeated encounters with the same event typically lead to decreased activation in the medial temporal lobe (MTL) and dopaminergic midbrain, a phenomenon known as repetition suppression. In contrast, encountering an event that overlaps with prior experience leads to increased response in the same regions. Such increased responding is thought to reflect an associative novelty signal that promotes memory updating to resolve differences between current events and stored memories. Here, we married these ideas to test whether event overlap significantly modulates MTL and midbrain responses-even when events are repeated and expected-to promote memory updating through integration. While undergoing high-resolution functional MRI, participants were repeatedly presented with objects pairs, some of which overlapped with other, intervening pairs and some of which contained elements unique from other pairs. MTL and midbrain regions showed widespread repetition suppression for nonoverlapping pairs containing unique elements; however, the degree of repetition suppression was altered for overlapping pairs. Entorhinal cortex, perirhinal cortex (PRc), midbrain, and PRc-midbrain connectivity showed repetition-related increases across overlapping pairs. Notably, increased PRc activation for overlapping pairs tracked individual differences in the ability to reason about the relationships among pairs-our behavioral measure of memory integration. Within the hippocampus, activation increases across overlapping pairs were unique to CA1 , consistent with its hypothesized comparator function. These findings demonstrate that event overlap engages MTL and midbrain functions traditionally implicated in novelty processing, even when overlapping events themselves are repeated. Our findings further suggest that the MTL-midbrain response to event overlap may promote integration of new content into existing memories, leading to the formation of relational memory networks that span experiences. Moreover, the results inform theories about the division of labor within MTL, demonstrating that the role of PRc in episodic encoding extends beyond familiarity processing and item-level recognition. © 2016 Wiley Periodicals, Inc.
Collapse
Affiliation(s)
| | | | - Alison R Preston
- Department of Psychology, The University of Texas at Austin. .,Department of Psychology, Center for Learning and Memory. .,Department of Neuroscience, University of Texas at Austin.
| |
Collapse
|
32
|
Category learning in Alzheimer's disease and normal cognitive aging depends on initial experience of feature variability. Neuropsychologia 2016; 98:98-110. [PMID: 27394151 DOI: 10.1016/j.neuropsychologia.2016.07.003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/02/2015] [Revised: 06/29/2016] [Accepted: 07/03/2016] [Indexed: 11/23/2022]
Abstract
Semantic category learning is dependent upon several factors, including the nature of the learning task, as well as individual differences in the quality and heterogeneity of exemplars that an individual encounters during learning. We trained healthy older adults (n=39) and individuals with a diagnosis of Alzheimer's disease or Mild Cognitive Impairment (n=44) to recognize instances of a fictitious animal, a "crutter". Each stimulus item contained 10 visual features (e.g., color, tail shape) which took one of two values for each feature (e.g., yellow/red, curly/straight tails). Participants were presented with a series of items (learning phase) and were either told the items belonged to a semantic category (explicit condition) or were told to think about the appearance of the items (implicit condition). Half of participants saw learning items with higher similarity to an unseen prototype (high typicality learning set), and thus lower between-item variability in their constituent features; the other half learned from items with lower typicality (low typicality learning set) and higher between-item feature variability. After the learning phase, participants were presented with test items one at a time that varied in the number of typical features from 0 (antitype) to 10 (prototype). We examined between-subjects factors of learning set (lower or higher typicality), instruction type (explicit or implicit), and group (patients vs. elderly control). Learning in controls was aided by higher learning set typicality: while controls in both learning set groups demonstrated significant learning, those exposed to a high-typicality learning set appeared to develop a prototype that helped guide their category membership judgments. Overall, patients demonstrated more difficulty with category learning than elderly controls. Patients exposed to the higher-typicality learning set were sensitive to the typical features of the category and discriminated between the most and least typical test items, although less reliably than controls. In contrast, patients exposed to the low-typicality learning set showed no evidence of learning. Analysis of structural imaging data indicated a positive association between left hippocampal grey matter density in elderly controls but a negative association in the patient group, suggesting differential reliance on hippocampal-mediated learning. Contrary to hypotheses, learning did not differ between explicit and implicit conditions for either group. Results demonstrate that category learning is improved when learning materials are highly similar to the prototype.
Collapse
|
33
|
Lech RK, Güntürkün O, Suchan B. An interplay of fusiform gyrus and hippocampus enables prototype- and exemplar-based category learning. Behav Brain Res 2016; 311:239-246. [PMID: 27233826 DOI: 10.1016/j.bbr.2016.05.049] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/27/2016] [Revised: 05/19/2016] [Accepted: 05/23/2016] [Indexed: 11/16/2022]
Abstract
The aim of the present study was to examine the contributions of different brain structures to prototype- and exemplar-based category learning using functional magnetic resonance imaging (fMRI). Twenty-eight subjects performed a categorization task in which they had to assign prototypes and exceptions to two different families. This test procedure usually produces different learning curves for prototype and exception stimuli. Our behavioral data replicated these previous findings by showing an initially superior performance for prototypes and typical stimuli and a switch from a prototype-based to an exemplar-based categorization for exceptions in the later learning phases. Since performance varied, we divided participants into learners and non-learners. Analysis of the functional imaging data revealed that the interaction of group (learners vs. non-learners) and block (Block 5 vs. Block 1) yielded an activation of the left fusiform gyrus for the processing of prototypes, and an activation of the right hippocampus for exceptions after learning the categories. Thus, successful prototype- and exemplar-based category learning is associated with activations of complementary neural substrates that constitute object-based processes of the ventral visual stream and their interaction with unique-cue representations, possibly based on sparse coding within the hippocampus.
Collapse
Affiliation(s)
- Robert K Lech
- Institute of Cognitive Neuroscience, Department of Neuropsychology, Ruhr University Bochum, Germany; International Graduate School of Neuroscience, Ruhr University Bochum, Germany
| | - Onur Güntürkün
- Institute of Cognitive Neuroscience, Department of Biopsychology, Ruhr University Bochum, Germany; International Graduate School of Neuroscience, Ruhr University Bochum, Germany
| | - Boris Suchan
- Institute of Cognitive Neuroscience, Department of Neuropsychology, Ruhr University Bochum, Germany; International Graduate School of Neuroscience, Ruhr University Bochum, Germany.
| |
Collapse
|
34
|
Carpenter KL, Wills AJ, Benattayallah A, Milton F. A Comparison of the neural correlates that underlie rule-based and information-integration category learning. Hum Brain Mapp 2016; 37:3557-74. [PMID: 27199090 DOI: 10.1002/hbm.23259] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/17/2015] [Revised: 05/01/2016] [Accepted: 05/02/2016] [Indexed: 11/06/2022] Open
Abstract
The influential competition between verbal and implicit systems (COVIS) model proposes that category learning is driven by two competing neural systems-an explicit, verbal, system, and a procedural-based, implicit, system. In the current fMRI study, participants learned either a conjunctive, rule-based (RB), category structure that is believed to engage the explicit system, or an information-integration category structure that is thought to preferentially recruit the implicit system. The RB and information-integration category structures were matched for participant error rate, the number of relevant stimulus dimensions, and category separation. Under these conditions, considerable overlap in brain activation, including the prefrontal cortex, basal ganglia, and the hippocampus, was found between the RB and information-integration category structures. Contrary to the predictions of COVIS, the medial temporal lobes and in particular the hippocampus, key regions for explicit memory, were found to be more active in the information-integration condition than in the RB condition. No regions were more activated in RB than information-integration category learning. The implications of these results for theories of category learning are discussed. Hum Brain Mapp 37:3557-3574, 2016. © 2016 Wiley Periodicals, Inc.
Collapse
Affiliation(s)
- Kathryn L Carpenter
- School of Psychology, College of Life and Environmental Sciences, University of Exeter, Washington Singer Building, Perry Road, Exeter EX4 4QG, United Kingdom
| | - Andy J Wills
- School of Psychology, Portland Square, Plymouth University, Drake Circus, Plymouth, PL4 8AA, United Kingdom
| | - Abdelmalek Benattayallah
- Exeter Medical School, University of Exeter, St Luke's Campus Heavitree RoadExeter EX1 2LU, United Kingdom
| | - Fraser Milton
- School of Psychology, College of Life and Environmental Sciences, University of Exeter, Washington Singer Building, Perry Road, Exeter EX4 4QG, United Kingdom
| |
Collapse
|
35
|
Iordan MC, Greene MR, Beck DM, Fei-Fei L. Typicality sharpens category representations in object-selective cortex. Neuroimage 2016; 134:170-179. [PMID: 27079531 DOI: 10.1016/j.neuroimage.2016.04.012] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/20/2016] [Revised: 03/12/2016] [Accepted: 04/05/2016] [Indexed: 11/18/2022] Open
Abstract
The purpose of categorization is to identify generalizable classes of objects whose members can be treated equivalently. Within a category, however, some exemplars are more representative of that concept than others. Despite long-standing behavioral effects, little is known about how typicality influences the neural representation of real-world objects from the same category. Using fMRI, we showed participants 64 subordinate object categories (exemplars) grouped into 8 basic categories. Typicality for each exemplar was assessed behaviorally and we used several multi-voxel pattern analyses to characterize how typicality affects the pattern of responses elicited in early visual and object-selective areas: V1, V2, V3v, hV4, LOC. We found that in LOC, but not in early areas, typical exemplars elicited activity more similar to the central category tendency and created sharper category boundaries than less typical exemplars, suggesting that typicality enhances within-category similarity and between-category dissimilarity. Additionally, we uncovered a brain region (cIPL) where category boundaries favor less typical categories. Our results suggest that typicality may constitute a previously unexplored principle of organization for intra-category neural structure and, furthermore, that this representation is not directly reflected in image features describing natural input, but rather built by the visual system at an intermediate processing stage.
Collapse
Affiliation(s)
| | - Michelle R Greene
- Department of Computer Science, Stanford University, Stanford, CA 94305, USA.
| | - Diane M Beck
- Beckman Institute and Department of Psychology, University of Illinois at Urbana-Champaign, Urbana, IL 61801, USA.
| | - Li Fei-Fei
- Department of Computer Science, Stanford University, Stanford, CA 94305, USA.
| |
Collapse
|
36
|
Abstract
Effective generalization in a multiple-category situation involves both assessing potential membership in individual categories and resolving conflict between categories while implementing a decision bound. We separated generalization from decision bound implementation using an information integration task in which category exemplars varied over two incommensurable feature dimensions. Human subjects first learned to categorize stimuli within limited training regions, and then, during fMRI scanning, they also categorized transfer stimuli from new regions of perceptual space. Transfer stimuli differed both in distance from the training region prototype and distance from the decision bound, allowing us to independently assess neural systems sensitive to each. Across all stimulus regions, categorization was associated with activity in the extrastriate visual cortex, basal ganglia, and the bilateral intraparietal sulcus. Categorizing stimuli near the decision bound was associated with recruitment of the frontoinsular cortex and medial frontal cortex, regions often associated with conflict and which commonly coactivate within the salience network. Generalization was measured in terms of greater distance from the decision bound and greater distance from the category prototype (average training region stimulus). Distance from the decision bound was associated with activity in the superior parietal lobe, lingual gyri, and anterior hippocampus, whereas distance from the prototype was associated with left intraparietal sulcus activity. The results are interpreted as supporting the existence of different uncertainty resolution mechanisms for uncertainty about category membership (representational uncertainty) and uncertainty about decision bound (decisional uncertainty).
Collapse
|
37
|
Hammer R, Sloutsky V, Grill-Spector K. Feature saliency and feedback information interactively impact visual category learning. Front Psychol 2015; 6:74. [PMID: 25745404 PMCID: PMC4333777 DOI: 10.3389/fpsyg.2015.00074] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2014] [Accepted: 01/13/2015] [Indexed: 11/21/2022] Open
Abstract
Visual category learning (VCL) involves detecting which features are most relevant for categorization. VCL relies on attentional learning, which enables effectively redirecting attention to object’s features most relevant for categorization, while ‘filtering out’ irrelevant features. When features relevant for categorization are not salient, VCL relies also on perceptual learning, which enables becoming more sensitive to subtle yet important differences between objects. Little is known about how attentional learning and perceptual learning interact when VCL relies on both processes at the same time. Here we tested this interaction. Participants performed VCL tasks in which they learned to categorize novel stimuli by detecting the feature dimension relevant for categorization. Tasks varied both in feature saliency (low-saliency tasks that required perceptual learning vs. high-saliency tasks), and in feedback information (tasks with mid-information, moderately ambiguous feedback that increased attentional load, vs. tasks with high-information non-ambiguous feedback). We found that mid-information and high-information feedback were similarly effective for VCL in high-saliency tasks. This suggests that an increased attentional load, associated with the processing of moderately ambiguous feedback, has little effect on VCL when features are salient. In low-saliency tasks, VCL relied on slower perceptual learning; but when the feedback was highly informative participants were able to ultimately attain the same performance as during the high-saliency VCL tasks. However, VCL was significantly compromised in the low-saliency mid-information feedback task. We suggest that such low-saliency mid-information learning scenarios are characterized by a ‘cognitive loop paradox’ where two interdependent learning processes have to take place simultaneously.
Collapse
Affiliation(s)
- Rubi Hammer
- Department of Psychology, Stanford University Stanford, CA, USA ; Department of Communication Sciences and Disorders, Northwestern University Evanston, IL, USA ; Interdepartmental Neuroscience Program, Northwestern University Evanston, IL, USA
| | - Vladimir Sloutsky
- Department of Psychology and Center for Cognitive Science, The Ohio State University Columbus, OH, USA
| | - Kalanit Grill-Spector
- Department of Psychology, Stanford University Stanford, CA, USA ; Stanford Neuroscience Institute, Stanford University Stanford, CA, USA
| |
Collapse
|
38
|
Zhang J, Rowe JB. The neural signature of information regularity in temporally extended event sequences. Neuroimage 2015; 107:266-276. [PMID: 25524648 PMCID: PMC4306597 DOI: 10.1016/j.neuroimage.2014.12.021] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/20/2014] [Revised: 11/12/2014] [Accepted: 12/08/2014] [Indexed: 02/02/2023] Open
Abstract
Statistical regularities exist at different timescales in temporally unfolding event sequences. Recent studies have identified brain regions that are sensitive to the levels of regularity in sensory inputs, enabling the brain to construct a representation of environmental structure and adaptively generate actions or predictions. However, the temporal specificity of the statistical regularity to which the brain responds remains largely unknown. This uncertainty applies to the regularities of sensory inputs as well as instrumental actions. Here, we used fMRI to investigate the neural correlates of regularity in sequences of task events and action selections in a visuomotor choice task. We quantified timescale-dependent regularity measures by calculating Shannon's entropy and surprise from a sliding-window of consecutive task events and actions. Activity in the frontopolar cortex negatively correlated with the entropy in action selection, while activity in the temporoparietal junction, the striatum, and the cerebellum negatively correlated with the entropy in stimulus events at longer timescales. In contrast, activity in the supplementary motor area, the superior frontal gyrus, and the superior parietal lobule was positively correlated with the surprise of each stimulus across different timescales. The results suggest a spatial distribution of regions sensitive to various information regularities according to a temporal hierarchy, which may play a central role in concurrently monitoring the regularity in previous and current events over different timescales to optimize behavioral control in a dynamic environment.
Collapse
Affiliation(s)
- Jiaxiang Zhang
- Cognition and Brain Sciences Unit, Medical Research Council, Cambridge CB2 7EF, UK.
| | - James B. Rowe
- Cognition and Brain Sciences Unit, Medical Research Council, Cambridge CB2 7EF, UK,Department of Clinical Neurosciences, University of Cambridge, Cambridge CB2 2QQ, UK,Behavioural and Clinical Neuroscience Institute, Cambridge, CB2 3EB, UK
| |
Collapse
|
39
|
Vo K, Rutledge RB, Chatterjee A, Kable JW. Dorsal striatum is necessary for stimulus-value but not action-value learning in humans. ACTA ACUST UNITED AC 2014; 137:3129-35. [PMID: 25273995 DOI: 10.1093/brain/awu277] [Citation(s) in RCA: 23] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Several lines of evidence implicate the striatum in learning from experience on the basis of positive and negative feedback. However, the necessity of the striatum for such learning has been difficult to demonstrate in humans, because brain damage is rarely restricted to this structure. Here we test a rare individual with widespread bilateral damage restricted to the dorsal striatum. His performance was impaired and not significantly different from chance on several classic learning tasks, consistent with current theories regarding the role of the striatum. However, he also exhibited remarkably intact performance on a different subset of learning paradigms. The tasks he could perform can all be solved by learning the value of actions, while those he could not perform can only be solved by learning the value of stimuli. Although dorsal striatum is often thought to play a specific role in action-value learning, we find surprisingly that dorsal striatum is necessary for stimulus-value but not action-value learning in humans.
Collapse
Affiliation(s)
- Khoi Vo
- 1 Department of Psychology, University of Pennsylvania, 3720 Walnut St., Philadelphia, PA 19104, USA
| | - Robb B Rutledge
- 2 Wellcome Trust Centre for Neuroimaging, UCL, London WC1N 3BG, UK, and Max Planck UCL Centre for Computational Psychiatry and Ageing Research, London WC1B 5EH, UK
| | - Anjan Chatterjee
- 3 Department of Neurology, University of Pennsylvania, 3 West Gates, 3400 Spruce St., Philadelphia, PA 19104, USA
| | - Joseph W Kable
- 1 Department of Psychology, University of Pennsylvania, 3720 Walnut St., Philadelphia, PA 19104, USA
| |
Collapse
|
40
|
Global neural pattern similarity as a common basis for categorization and recognition memory. J Neurosci 2014; 34:7472-84. [PMID: 24872552 DOI: 10.1523/jneurosci.3376-13.2014] [Citation(s) in RCA: 57] [Impact Index Per Article: 5.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/21/2022] Open
Abstract
Familiarity, or memory strength, is a central construct in models of cognition. In previous categorization and long-term memory research, correlations have been found between psychological measures of memory strength and activation in the medial temporal lobes (MTLs), which suggests a common neural locus for memory strength. However, activation alone is insufficient for determining whether the same mechanisms underlie neural function across domains. Guided by mathematical models of categorization and long-term memory, we develop a theory and a method to test whether memory strength arises from the global similarity among neural representations. In human subjects, we find significant correlations between global similarity among activation patterns in the MTLs and both subsequent memory confidence in a recognition memory task and model-based measures of memory strength in a category learning task. Our work bridges formal cognitive theories and neuroscientific models by illustrating that the same global similarity computations underlie processing in multiple cognitive domains. Moreover, by establishing a link between neural similarity and psychological memory strength, our findings suggest that there may be an isomorphism between psychological and neural representational spaces that can be exploited to test cognitive theories at both the neural and behavioral levels.
Collapse
|
41
|
Johnson JS, Simmering VR, Buss AT. Beyond slots and resources: grounding cognitive concepts in neural dynamics. Atten Percept Psychophys 2014; 76:1630-54. [PMID: 24306983 PMCID: PMC4047207 DOI: 10.3758/s13414-013-0596-9] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Research over the past decade has suggested that the ability to hold information in visual working memory (VWM) may be limited to as few as three to four items. However, the precise nature and source of these capacity limits remains hotly debated. Most commonly, capacity limits have been inferred from studies of visual change detection, in which performance declines systematically as a function of the number of items that participants must remember. According to one view, such declines indicate that a limited number of fixed-resolution representations are held in independent memory "slots." Another view suggests that such capacity limits are more apparent than real, but emerge as limited memory resources are distributed across more to-be-remembered items. Here we argue that, although both perspectives have merit and have generated and explained impressive amounts of empirical data, their central focus on the representations--rather than processes--underlying VWM may ultimately limit continuing progress in this area. As an alternative, we describe a neurally grounded, process-based approach to VWM: the dynamic field theory. Simulations demonstrate that this model can account for key aspects of behavioral performance in change detection, in addition to generating novel behavioral predictions that have been confirmed experimentally. Furthermore, we describe extensions of the model to recall tasks, the integration of visual features, cognitive development, individual differences, and functional imaging studies of VWM. We conclude by discussing the importance of grounding psychological concepts in neural dynamics, as a first step toward understanding the link between brain and behavior.
Collapse
Affiliation(s)
- Jeffrey S Johnson
- Department of Psychology and Center for Visual and Cognitive Neuroscience, North Dakota State University, Dept. 2765, P.O. Box 6050, Fargo, North Dakota, 58108-6050, USA,
| | | | | |
Collapse
|
42
|
Richler JJ, Palmeri TJ. Visual category learning. WILEY INTERDISCIPLINARY REVIEWS. COGNITIVE SCIENCE 2013; 5:75-94. [PMID: 26304297 DOI: 10.1002/wcs.1268] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Received: 06/05/2013] [Revised: 09/11/2013] [Accepted: 10/23/2013] [Indexed: 11/11/2022]
Abstract
Visual categories group together different objects as the same kinds of thing. We review a selection of research on how visual categories are learned. We begin with a guide to visual category learning experiments, describing a space of common manipulations of objects, categories, and methods used in the category learning literature. We open with a guide to these details in part because throughout our review we highlight how methodological details can sometimes loom large in theoretical discussions of visual category learning, how variations in methodological details can significantly affect our understanding of visual category learning, and how manipulations of methodological details can affect how visual categories are learned. We review a number of core theories of visual category learning, specifically those theories instantiated as computational models, highlighting just some of the experimental results that help distinguish between competing models. We examine behavioral and neural evidence for single versus multiple representational systems for visual category learning. We briefly discuss how visual category learning influences visual perception, describing empirical and brain imaging results that show how learning to categorize objects can influence how those objects are represented and perceived. We close with work that can potentially impact translation, describing recent experiments that explicitly manipulate key methodological details of category learning procedures with the goal of optimizing visual category learning. WIREs Cogn Sci 2014, 5:75-94. doi: 10.1002/wcs.1268 CONFLICT OF INTEREST: The authors have declared no conflicts of interest for this article. For further resources related to this article, please visit the WIREs website.
Collapse
Affiliation(s)
| | - Thomas J Palmeri
- Department of Psychology, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
43
|
Seger CA, Peterson EJ. Categorization = decision making + generalization. Neurosci Biobehav Rev 2013; 37:1187-200. [PMID: 23548891 PMCID: PMC3739997 DOI: 10.1016/j.neubiorev.2013.03.015] [Citation(s) in RCA: 30] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/15/2012] [Revised: 03/21/2013] [Accepted: 03/22/2013] [Indexed: 11/22/2022]
Abstract
We rarely, if ever, repeatedly encounter exactly the same situation. This makes generalization crucial for real world decision making. We argue that categorization, the study of generalizable representations, is a type of decision making, and that categorization learning research would benefit from approaches developed to study the neuroscience of decision making. Similarly, methods developed to examine generalization and learning within the field of categorization may enhance decision making research. We first discuss perceptual information processing and integration, with an emphasis on accumulator models. We then examine learning the value of different decision making choices via experience, emphasizing reinforcement learning modeling approaches. Next we discuss how value is combined with other factors in decision making, emphasizing the effects of uncertainty. Finally, we describe how a final decision is selected via thresholding processes implemented by the basal ganglia and related regions. We also consider how memory related functions in the hippocampus may be integrated with decision making mechanisms and contribute to categorization.
Collapse
Affiliation(s)
- Carol A Seger
- Department of Psychology, Colorado State University Fort Collins, CO 80523, USA.
| | | |
Collapse
|
44
|
Davis T, Poldrack RA. Measuring neural representations with fMRI: practices and pitfalls. Ann N Y Acad Sci 2013; 1296:108-34. [PMID: 23738883 DOI: 10.1111/nyas.12156] [Citation(s) in RCA: 106] [Impact Index Per Article: 9.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/29/2022]
Abstract
Recently, there has been a dramatic increase in the number of functional magnetic resonance imaging studies seeking to answer questions about how the brain represents information. Representational questions are of particular importance in connecting neuroscientific and cognitive levels of analysis because it is at the representational level that many formal models of cognition make distinct predictions. This review discusses techniques for univariate, adaptation, and multivoxel analysis, and how they have been used to answer questions about content specificity in different regions of the brain, how this content is organized, and how representations are shaped by and contribute to cognitive processes. Each of the analysis techniques makes different assumptions about the underlying neural code and thus differ in how they can be applied to specific questions. We also discuss the many pitfalls of representational analysis, from the flexibility in data analysis pipelines to emergent nonrepresentational relationships that can arise between stimuli in a task.
Collapse
Affiliation(s)
- Tyler Davis
- Imaging Research Center, University of Texas at Austin, 1 University Station, Austin, TX 78712, USA.
| | | |
Collapse
|
45
|
Davis T, Poldrack RA. Quantifying the internal structure of categories using a neural typicality measure. ACTA ACUST UNITED AC 2013; 24:1720-37. [PMID: 23442348 DOI: 10.1093/cercor/bht014] [Citation(s) in RCA: 41] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
How categories are represented continues to be hotly debated across neuroscience and psychology. One topic that is central to cognitive research on category representation but underexplored in neurobiological research concerns the internal structure of categories. Internal structure refers to how the natural variability between-category members is coded so that we are able to determine which members are more typical or better examples of their category. Psychological categorization models offer tools for predicting internal structure and suggest that perceptions of typicality arise from similarities between the representations of category members in a psychological space. Inspired by these models, we develop a neural typicality measure that allows us to measure which category members elicit patterns of activation that are similar to other members of their category and are thus more central in a neural space. Using an artificial categorization task, we test how psychological and physical typicality contribute to neural typicality, and find that neural typicality in occipital and temporal regions is significantly correlated with subjects' perceptions of typicality. The results reveal a convergence between psychological and neural category representations and suggest that our neural typicality measure is a useful tool for connecting psychological and neural measures of internal category structure.
Collapse
Affiliation(s)
| | - Russell A Poldrack
- Imaging Research Center, Deparment of Psychology, Center for Learning and Memory and Section of Neurobiology, The University of Texas at Austin, Austin, TX 78712, USA
| |
Collapse
|
46
|
Davis T, Love BC, Maddox WT. Age-related declines in the fidelity of newly acquired category representations. Learn Mem 2012; 19:325-9. [PMID: 22815536 DOI: 10.1101/lm.024919.111] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
We present a theory suggesting that the ability to build category representations that reflect the nuances of category structures in the environment depends upon clustering mechanisms instantiated in an MTL-PFC-based circuit. Because function in this circuit declines with age, we predict that the ability to build category representations will be impaired in older adults. Consistent with this prediction, we find that older adults are impaired relative to younger adults at learning nuanced category structures that contain exceptions to the rule. Model-based analysis reveals that this deficit arises from older adults' failure to engage clustering mechanisms to separate exception and rule-following items in memory.
Collapse
Affiliation(s)
- Tyler Davis
- Imaging Research Center, University of Texas at Austin, Austin, Texas 78712, USA.
| | | | | |
Collapse
|
47
|
Schiffer AM, Ahlheim C, Wurm MF, Schubotz RI. Surprised at all the entropy: hippocampal, caudate and midbrain contributions to learning from prediction errors. PLoS One 2012; 7:e36445. [PMID: 22570715 PMCID: PMC3343024 DOI: 10.1371/journal.pone.0036445] [Citation(s) in RCA: 42] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2012] [Accepted: 04/04/2012] [Indexed: 11/19/2022] Open
Abstract
Influential concepts in neuroscientific research cast the brain a predictive machine that revises its predictions when they are violated by sensory input. This relates to the predictive coding account of perception, but also to learning. Learning from prediction errors has been suggested for take place in the hippocampal memory system as well as in the basal ganglia. The present fMRI study used an action-observation paradigm to investigate the contributions of the hippocampus, caudate nucleus and midbrain dopaminergic system to different types of learning: learning in the absence of prediction errors, learning from prediction errors, and responding to the accumulation of prediction errors in unpredictable stimulus configurations. We conducted analyses of the regions of interests' BOLD response towards these different types of learning, implementing a bootstrapping procedure to correct for false positives. We found both, caudate nucleus and the hippocampus to be activated by perceptual prediction errors. The hippocampal responses seemed to relate to the associative mismatch between a stored representation and current sensory input. Moreover, its response was significantly influenced by the average information, or Shannon entropy of the stimulus material. In accordance with earlier results, the habenula was activated by perceptual prediction errors. Lastly, we found that the substantia nigra was activated by the novelty of sensory input. In sum, we established that the midbrain dopaminergic system, the hippocampus, and the caudate nucleus were to different degrees significantly involved in the three different types of learning: acquisition of new information, learning from prediction errors and responding to unpredictable stimulus developments. We relate learning from perceptual prediction errors to the concept of predictive coding and related information theoretic accounts.
Collapse
Affiliation(s)
- Anne-Marike Schiffer
- Department of Experimental Psychology, University of Oxford, Oxford, United Kingdom.
| | | | | | | |
Collapse
|