1
|
Lippl S, Kay K, Jensen G, Ferrera VP, Abbott L. A mathematical theory of relational generalization in transitive inference. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2024:2023.08.22.554287. [PMID: 37662223 PMCID: PMC10473627 DOI: 10.1101/2023.08.22.554287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/05/2023]
Abstract
Humans and animals routinely infer relations between different items or events and generalize these relations to novel combinations of items. This allows them to respond appropriately to radically novel circumstances and is fundamental to advanced cognition. However, how learning systems (including the brain) can implement the necessary inductive biases has been unclear. Here we investigated transitive inference (TI), a classic relational task paradigm in which subjects must learn a relation (A > B and B > C) and generalize it to new combinations of items (A > C). Through mathematical analysis, we found that a broad range of biologically relevant learning models (e.g. gradient flow or ridge regression) perform TI successfully and recapitulate signature behavioral patterns long observed in living subjects. First, we found that models with item-wise additive representations automatically encode transitive relations. Second, for more general representations, a single scalar "conjunctivity factor" determines model behavior on TI and, further, the principle of norm minimization (a standard statistical inductive bias) enables models with fixed, partly conjunctive representations to generalize transitively. Finally, neural networks in the "rich regime," which enables representation learning and has been found to improve generalization, unexpectedly show poor generalization and anomalous behavior. We find that such networks implement a form of norm minimization (over hidden weights) that yields a local encoding mechanism lacking transitivity. Our findings show how minimal statistical learning principles give rise to a classical relational inductive bias (transitivity), explain empirically observed behaviors, and establish a formal approach to understanding the neural basis of relational abstraction.
Collapse
Affiliation(s)
- Samuel Lippl
- Mortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, NY
- Center for Theoretical Neuroscience, Columbia University, NY
- Department of Neuroscience, Columbia University Medical Center, NY
| | - Kenneth Kay
- Mortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, NY
- Center for Theoretical Neuroscience, Columbia University, NY
- Grossman Center for the Statistics of Mind, Columbia University, NY
| | - Greg Jensen
- Mortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, NY
- Department of Neuroscience, Columbia University Medical Center, NY
- Department of Psychology at Reed College, OR
| | - Vincent P. Ferrera
- Mortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, NY
- Department of Neuroscience, Columbia University Medical Center, NY
- Department of Psychiatry, Columbia University Medical Center, NY
| | - L.F. Abbott
- Mortimer B. Zuckerman Mind Brain Behavior Institute, Columbia University, NY
- Center for Theoretical Neuroscience, Columbia University, NY
- Department of Neuroscience, Columbia University Medical Center, NY
| |
Collapse
|
2
|
Ramawat S, Marc IB, Ceccarelli F, Ferrucci L, Bardella G, Ferraina S, Pani P, Brunamonti E. The transitive inference task to study the neuronal correlates of memory-driven decision making: A monkey neurophysiology perspective. Neurosci Biobehav Rev 2023; 152:105258. [PMID: 37268179 DOI: 10.1016/j.neubiorev.2023.105258] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/09/2023] [Revised: 05/15/2023] [Accepted: 05/30/2023] [Indexed: 06/04/2023]
Abstract
A vast amount of literature agrees that rank-ordered information as A>B>C>D>E>F is mentally represented in spatially organized schemas after learning. This organization significantly influences the process of decision-making, using the acquired premises, i.e. deciding if B is higher than D is equivalent to comparing their position in this space. The implementation of non-verbal versions of the transitive inference task has provided the basis for ascertaining that different animal species explore a mental space when deciding among hierarchically organized memories. In the present work, we reviewed several studies of transitive inference that highlighted this ability in animals and, consequently, the animal models developed to study the underlying cognitive processes and the main neural structures supporting this ability. Further, we present the literature investigating which are the underlying neuronal mechanisms. Then we discuss how non-human primates represent an excellent model for future studies, providing ideal resources for better understanding the neuronal correlates of decision-making through transitive inference tasks.
Collapse
Affiliation(s)
- Surabhi Ramawat
- Department of Physiology and Pharmacology, Sapienza University, Rome, Italy
| | - Isabel Beatrice Marc
- Department of Physiology and Pharmacology, Sapienza University, Rome, Italy; Behavioral Neuroscience PhD Program, Sapienza University, Rome, Italy
| | | | - Lorenzo Ferrucci
- Department of Physiology and Pharmacology, Sapienza University, Rome, Italy
| | - Giampiero Bardella
- Department of Physiology and Pharmacology, Sapienza University, Rome, Italy
| | - Stefano Ferraina
- Department of Physiology and Pharmacology, Sapienza University, Rome, Italy
| | - Pierpaolo Pani
- Department of Physiology and Pharmacology, Sapienza University, Rome, Italy
| | - Emiliano Brunamonti
- Department of Physiology and Pharmacology, Sapienza University, Rome, Italy.
| |
Collapse
|
3
|
Foldes T, Santamaria L, Lewis P. Sleep-related benefits to transitive inference are modulated by encoding strength and joint rank. Learn Mem 2023; 30:201-211. [PMID: 37726142 PMCID: PMC10547378 DOI: 10.1101/lm.053787.123] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/30/2023] [Accepted: 07/11/2023] [Indexed: 09/21/2023]
Abstract
Transitive inference is a measure of relational learning that has been shown to improve across sleep. Here, we examine this phenomenon further by studying the impact of encoding strength and joint rank. In experiment 1, participants learned adjacent premise pairs and were then tested on inferential problems derived from those pairs. In line with prior work, we found improved transitive inference performance after retention across a night of sleep compared with wake alone. Experiment 2 extended these findings using a within-subject design and found superior transitive inference performance on a hierarchy, consolidated across 27 h including sleep compared with just 3 h of wake. In both experiments, consolidation-related improvement was enhanced when presleep learning (i.e., encoding strength) was stronger. We also explored the interaction of these effects with the joint rank effect, in which items were scored according to their rank in the hierarchy, with more dominant item pairs having the lowest scores. Interestingly, the consolidation-related benefit was greatest for more dominant inference pairs (i.e., those with low joint rank scores). Overall, our findings provide further support for the improvement of transitive inference across a consolidation period that includes sleep. We additionally show that encoding strength and joint rank strongly modulate this effect.
Collapse
Affiliation(s)
- Tamas Foldes
- Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff University, Cardiff, Wales CF24 4HQ, United Kingdom
| | - Lorena Santamaria
- Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff University, Cardiff, Wales CF24 4HQ, United Kingdom
| | - Penny Lewis
- Cardiff University Brain Research Imaging Centre (CUBRIC), Cardiff University, Cardiff, Wales CF24 4HQ, United Kingdom
| |
Collapse
|
4
|
Scholz V, Waltmann M, Herzog N, Reiter A, Horstmann A, Deserno L. Cortical Grey Matter Mediates Increases in Model-Based Control and Learning from Positive Feedback from Adolescence to Adulthood. J Neurosci 2023; 43:2178-2189. [PMID: 36823039 PMCID: PMC10039741 DOI: 10.1523/jneurosci.1418-22.2023] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/21/2022] [Revised: 12/20/2022] [Accepted: 01/13/2023] [Indexed: 02/25/2023] Open
Abstract
Cognition and brain structure undergo significant maturation from adolescence into adulthood. Model-based (MB) control is known to increase across development, which is mediated by cognitive abilities. Here, we asked two questions unaddressed in previous developmental studies. First, what are the brain structural correlates of age-related increases in MB control? Second, how are age-related increases in MB control from adolescence to adulthood influenced by motivational context? A human developmental sample (n = 103; age, 12-50, male/female, 55:48) completed structural MRI and an established task to capture MB control. The task was modified with respect to outcome valence by including (1) reward and punishment blocks to manipulate the motivational context and (2) an additional choice test to assess learning from positive versus negative feedback. After replicating that an age-dependent increase in MB control is mediated by cognitive abilities, we demonstrate first-time evidence that gray matter density (GMD) in the parietal cortex mediates the increase of MB control with age. Although motivational context did not relate to age-related changes in MB control, learning from positive feedback improved with age. Meanwhile, negative feedback learning showed no age effects. We present a first report that an age-related increase in positive feedback learning was mediated by reduced GMD in the parietal, medial, and dorsolateral prefrontal cortex. Our findings indicate that brain maturation, putatively reflected in lower GMD, in distinct and partially overlapping brain regions could lead to a more efficient brain organization and might thus be a key developmental step toward age-related increases in planning and value-based choice.SIGNIFICANCE STATEMENT Changes in model-based decision-making are paralleled by extensive maturation in cognition and brain structure across development. Still, to date the neuroanatomical underpinnings of these changes remain unclear. Here, we demonstrate for the first time that parietal GMD mediates age-dependent increases in model-based control. Age-related increases in positive feedback learning were mediated by reduced GMD in the parietal, medial, and dorsolateral prefrontal cortex. A manipulation of motivational context did not have an impact on age-related changes in model-based control. These findings highlight that brain maturation in distinct and overlapping cortical regions constitutes a key developmental step toward improved value-based choices.
Collapse
Affiliation(s)
- Vanessa Scholz
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Centre of Mental Health, University of Würzburg, 97080 Würzburg, Germany
- Donders Institute for Brain, Cognition and Behaviour, Radboud University, 6525 GD Nijmegen, The Netherlands
| | - Maria Waltmann
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Centre of Mental Health, University of Würzburg, 97080 Würzburg, Germany
- Max Planck Institute for Cognition and Neuroscience, D-04103 Leipzig, Germany
| | - Nadine Herzog
- Max Planck Institute for Cognition and Neuroscience, D-04103 Leipzig, Germany
- Integrated Research and Treatment Center AdiposityDiseases, Leipzig University Medical Center, 04103 Leipzig, Germany
| | - Andrea Reiter
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Centre of Mental Health, University of Würzburg, 97080 Würzburg, Germany
- Collaborative Research Center-940 Volition and Cognitive Control, Faculty of Psychology, Technical University Dresden, 01069 Dresden, Germany
| | - Annette Horstmann
- Max Planck Institute for Cognition and Neuroscience, D-04103 Leipzig, Germany
- Integrated Research and Treatment Center AdiposityDiseases, Leipzig University Medical Center, 04103 Leipzig, Germany
- Department of Psychology and Logopedics, Faculty of Medicine, University of Helsinki, 00014 Helsinki, Finland
| | - Lorenz Deserno
- Department of Child and Adolescent Psychiatry, Psychosomatics and Psychotherapy, Centre of Mental Health, University of Würzburg, 97080 Würzburg, Germany
- Max Planck Institute for Cognition and Neuroscience, D-04103 Leipzig, Germany
- Integrated Research and Treatment Center AdiposityDiseases, Leipzig University Medical Center, 04103 Leipzig, Germany
- Department of Psychiatry and Psychotherapy, University Hospital Carl Gustav Carus, Technical University Dresden, 01069 Dresden, Germany
| |
Collapse
|
5
|
Zhang X, Qiu Y, Li J, Jia C, Liao J, Chen K, Qiu L, Yuan Z, Huang R. Neural correlates of transitive inference: An SDM meta-analysis on 32 fMRI studies. Neuroimage 2022; 258:119354. [PMID: 35659997 DOI: 10.1016/j.neuroimage.2022.119354] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/17/2022] [Revised: 05/02/2022] [Accepted: 05/31/2022] [Indexed: 11/28/2022] Open
Abstract
Transitive inference (TI) is a critical capacity involving the integration of relevant information into prior knowledge structure for drawing novel inferences on unobserved relationships. To date, the neural correlates of TI remain unclear due to the small sample size and heterogeneity of various experimental tasks from individual studies. Here, the meta-analysis on 32 fMRI studies was performed to detect brain activation patterns of TI and its three paradigms (spatial inference, hierarchical inference, and associative inference). We found the hippocampus, prefrontal cortex (PFC), putamen, posterior parietal cortex (PPC), retrosplenial cortex (RSC), supplementary motor area (SMA), precentral gyrus (PreCG), and median cingulate cortex (MCC) were engaged in TI. Specifically, the RSC was implicated in the associative inference, whereas PPC, SMA, PreCG, and MCC were implicated in the hierarchical inference. In addition, the hierarchical inference and associative inference both evoked activation in the hippocampus, medial PFC, and PCC. Although the meta-analysis on spatial inference did not generate a reliable result due to insufficient amount of investigations, the present work still offers a new insight for better understanding the neural basis underlying TI.
Collapse
Affiliation(s)
- Xiaoying Zhang
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education; School of Psychology; Center for Studies of Psychological Application; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631 Guangzhou, China
| | - Yidan Qiu
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education; School of Psychology; Center for Studies of Psychological Application; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631 Guangzhou, China
| | - Jinhui Li
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education; School of Psychology; Center for Studies of Psychological Application; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631 Guangzhou, China
| | - Chuchu Jia
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education; School of Psychology; Center for Studies of Psychological Application; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631 Guangzhou, China
| | - Jiajun Liao
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education; School of Psychology; Center for Studies of Psychological Application; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631 Guangzhou, China
| | - Kemeng Chen
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education; School of Psychology; Center for Studies of Psychological Application; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631 Guangzhou, China
| | - Lixin Qiu
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education; School of Psychology; Center for Studies of Psychological Application; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631 Guangzhou, China
| | - Zhen Yuan
- Centre for Cognitive and Brain Sciences, University of Macau, Macau SAR, China.
| | - Ruiwang Huang
- Key Laboratory of Brain, Cognition and Education Sciences (South China Normal University), Ministry of Education; School of Psychology; Center for Studies of Psychological Application; Guangdong Key Laboratory of Mental Health and Cognitive Science, South China Normal University, 510631 Guangzhou, China.
| |
Collapse
|
6
|
Ramawat S, Mione V, Di Bello F, Bardella G, Genovesio A, Pani P, Ferraina S, Brunamonti E. Different Contribution of the Monkey Prefrontal and Premotor Dorsal Cortex in Decision Making During a Transitive Inference Task. Neuroscience 2022; 485:147-162. [DOI: 10.1016/j.neuroscience.2022.01.013] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/26/2021] [Revised: 01/17/2022] [Accepted: 01/18/2022] [Indexed: 12/20/2022]
|
7
|
Jensen G, Kao T, Michaelcheck C, Borge SS, Ferrera VP, Terrace HS. Category learning in a transitive inference paradigm. Mem Cognit 2021; 49:1020-1035. [PMID: 33565006 PMCID: PMC8243812 DOI: 10.3758/s13421-020-01136-z] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 12/27/2020] [Indexed: 11/08/2022]
Abstract
The implied order of a ranked set of visual images can be learned without reliance on information that explicitly signals their order. Such learning is difficult to explain by associative mechanisms, but can be accounted for by cognitive representations and processes such as transitive inference. Our study sought to determine if those processes also apply to learning categories of images. We asked whether participants can (a) infer that stimulus images belonged to familiar categories, even when the images for each trial were unique, and (b) sort those categories into an ordering that obeys transitivity. Participants received minimal verbal instruction and a single session of training. Despite this, they learned the implied order of lists of fixed stimuli and lists of ordered categories, using trial-unique exemplars. We trained two groups, one for which stimuli were constant throughout training and testing (n = 60), and one for which exemplars of each category were trial-unique (n = 50). Our findings suggest that differing cognitive processes may underpin serial learning when learning about specific stimuli as opposed to stimulus categories.
Collapse
Affiliation(s)
- Greg Jensen
- Department of Neuroscience, Columbia University, New York, NY, USA.
- Zuckerman Mind Brain Behavior Institute, Columbia University, 3227 Broadway, New York, NY, 10027, USA.
| | - Tina Kao
- Department of Psychology, Columbia University, New York, NY, USA
- Department of Psychology, Barnard College, New York, NY, USA
- Department of Psychology, New York City College of Technology, CUNY, New York, NY, USA
| | - Charlotte Michaelcheck
- Department of Psychology, Columbia University, New York, NY, USA
- Department of Psychology, Barnard College, New York, NY, USA
| | - Saani Simms Borge
- Department of Psychology, Columbia University, New York, NY, USA
- Department of Psychology, Barnard College, New York, NY, USA
- Department of Psychology, New York City College of Technology, CUNY, New York, NY, USA
| | - Vincent P Ferrera
- Department of Neuroscience, Columbia University, New York, NY, USA
- Zuckerman Mind Brain Behavior Institute, Columbia University, 3227 Broadway, New York, NY, 10027, USA
- Department of Psychiatry, Columbia University, New York, NY, USA
| | - Herbert S Terrace
- Department of Psychology, Columbia University, New York, NY, USA
- Department of Psychology, Barnard College, New York, NY, USA
- Department of Psychiatry, Columbia University, New York, NY, USA
| |
Collapse
|