1
|
Abstract
Neuroscience has convinced people that much of their behavior is determined by causes unknown to them and beyond their control. However, are advances in neuroscience truly a prerequisite for such beliefs? Robert Kane's theory of ultimate responsibility is libertarian theory. Its innovative nature makes it possible to discuss the neurophysiological basis of its postulates. Using the functions of the midbrain dopaminergic system as an example, this article provides an overview of this neurophysiological basis. According to Kane, if we are to be ultimately responsible for our wills as well as for our actions, some actions in our lives must lack sufficient motives and causes. These are self-forming actions. Dopamine is hypothesized to mediate self-forming action execution. Dopamine not only mediates action but also ensures synaptic plasticity in the brain, that is, learning from action; hence, dopamine changes the acting individual and provides the formation of our own wills. The basal ganglia, which are the main target of dopamine in the brain, act through parallel pathways and are involved in decision-making processes. Dopamine is also involved in the regulation of the neurodynamical properties of prefrontal cortex networks with random spiking noise. It can be assumed that the activity of the dopaminergic system is closely related to the physiological basis of free will.
Collapse
Affiliation(s)
- Natalia Ivlieva
- Institute of Higher Nervous Activity and Neurophysiology, Russian Academy of Sciences, Butlerova Str., 5a, Moscow, 117485, Russia.
| |
Collapse
|
2
|
Goudar V, Kim JW, Liu Y, Dede AJO, Jutras MJ, Skelin I, Ruvalcaba M, Chang W, Ram B, Fairhall AL, Lin JJ, Knight RT, Buffalo EA, Wang XJ. A Comparison of Rapid Rule-Learning Strategies in Humans and Monkeys. J Neurosci 2024; 44:e0231232024. [PMID: 38871463 PMCID: PMC11236592 DOI: 10.1523/jneurosci.0231-23.2024] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2023] [Revised: 05/28/2024] [Accepted: 05/31/2024] [Indexed: 06/15/2024] Open
Abstract
Interspecies comparisons are key to deriving an understanding of the behavioral and neural correlates of human cognition from animal models. We perform a detailed comparison of the strategies of female macaque monkeys to male and female humans on a variant of the Wisconsin Card Sorting Test (WCST), a widely studied and applied task that provides a multiattribute measure of cognitive function and depends on the frontal lobe. WCST performance requires the inference of a rule change given ambiguous feedback. We found that well-trained monkeys infer new rules three times more slowly than minimally instructed humans. Input-dependent hidden Markov model-generalized linear models were fit to their choices, revealing hidden states akin to feature-based attention in both species. Decision processes resembled a win-stay, lose-shift strategy with interspecies similarities as well as key differences. Monkeys and humans both test multiple rule hypotheses over a series of rule-search trials and perform inference-like computations to exclude candidate choice options. We quantitatively show that perseveration, random exploration, and poor sensitivity to negative feedback account for the slower task-switching performance in monkeys.
Collapse
Affiliation(s)
- Vishwa Goudar
- Center for Neural Science, New York University, New York 10003
| | - Jeong-Woo Kim
- Center for Neural Science, New York University, New York 10003
| | - Yue Liu
- Center for Neural Science, New York University, New York 10003
| | - Adam J O Dede
- Department of Physiology and Biophysics, University of Washington, Seattle, Washington 98195
| | - Michael J Jutras
- Department of Physiology and Biophysics, University of Washington, Seattle, Washington 98195
| | - Ivan Skelin
- Department of Neurology, University of California, Davis, California 95616
- The Center for Mind and Brain, University of California, Davis, California 95616
| | - Michael Ruvalcaba
- Helen Wills Neuroscience Institute, University of California, Berkeley, California 94720
| | - William Chang
- Helen Wills Neuroscience Institute, University of California, Berkeley, California 94720
| | - Bhargavi Ram
- Department of Neurology, University of California, Davis, California 95616
- The Center for Mind and Brain, University of California, Davis, California 95616
| | - Adrienne L Fairhall
- Department of Physiology and Biophysics, University of Washington, Seattle, Washington 98195
| | - Jack J Lin
- Department of Neurology, University of California, Davis, California 95616
- The Center for Mind and Brain, University of California, Davis, California 95616
| | - Robert T Knight
- Helen Wills Neuroscience Institute, University of California, Berkeley, California 94720
- Department of Psychology, University of California, Berkeley, California 94720
| | - Elizabeth A Buffalo
- Department of Physiology and Biophysics, University of Washington, Seattle, Washington 98195
- Washington Primate Research Center, University of Washington, Seattle, Washington 98195
| | - Xiao-Jing Wang
- Center for Neural Science, New York University, New York 10003
| |
Collapse
|
3
|
Tsypes A, Hallquist MN, Ianni A, Kaurin A, Wright AGC, Dombrovski AY. Exploration-Exploitation and Suicidal Behavior in Borderline Personality Disorder and Depression. JAMA Psychiatry 2024:2821075. [PMID: 38985462 PMCID: PMC11238070 DOI: 10.1001/jamapsychiatry.2024.1796] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/21/2023] [Accepted: 04/25/2024] [Indexed: 07/11/2024]
Abstract
Importance Clinical theory and behavioral studies suggest that people experiencing suicidal crisis are often unable to find constructive solutions or incorporate useful information into their decisions, resulting in premature convergence on suicide and neglect of better alternatives. However, prior studies of suicidal behavior have not formally examined how individuals resolve the tradeoffs between exploiting familiar options and exploring potentially superior alternatives. Objective To investigate exploration and exploitation in suicidal behavior from the formal perspective of reinforcement learning. Design, Setting, and Participants Two case-control behavioral studies of exploration-exploitation of a large 1-dimensional continuous space and a 21-day prospective ambulatory study of suicidal ideation were conducted between April 2016 and March 2022. Participants were recruited from inpatient psychiatric units, outpatient clinics, and the community in Pittsburgh, Pennsylvania, and underwent laboratory and ambulatory assessments. Adults diagnosed with borderline personality disorder (BPD) and midlife and late-life major depressive disorder (MDD) were included, with each sample including demographically equated groups with a history of high-lethality suicide attempts, low-lethality suicide attempts, individuals with BPD or MDD but no suicide attempts, and control individuals without psychiatric disorders. The MDD sample also included a subgroup with serious suicidal ideation. Main Outcomes and Measures Behavioral (model-free and model-derived) indices of exploration and exploitation, suicide attempt lethality (Beck Lethality Scale), and prospectively assessed suicidal ideation. Results The BPD group included 171 adults (mean [SD] age, 30.55 [9.13] years; 135 [79%] female). The MDD group included 143 adults (mean [SD] age, 62.03 [6.82] years; 81 [57%] female). Across the BPD (χ23 = 50.68; P < .001) and MDD (χ24 = 36.34; P < .001) samples, individuals with high-lethality suicide attempts discovered fewer options than other groups as they were unable to shift away from unrewarded options. In contrast, those with low-lethality attempts were prone to excessive behavioral shifts after rewarded and unrewarded actions. No differences were seen in strategic early exploration or in exploitation. Among 84 participants with BPD in the ambulatory study, 56 reported suicidal ideation. Underexploration also predicted incident suicidal ideation (χ21 = 30.16; P < .001), validating the case-control results prospectively. The findings were robust to confounds, including medication exposure, affective state, and behavioral heterogeneity. Conclusions and Relevance The findings suggest that narrow exploration and inability to abandon inferior options are associated with serious suicidal behavior and chronic suicidal thoughts. By contrast, individuals in this study who engaged in low-lethality suicidal behavior displayed a low threshold for taking potentially disadvantageous actions.
Collapse
Affiliation(s)
- Aliona Tsypes
- Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania
| | - Michael N. Hallquist
- Department of Psychology and Neuroscience, University of North Carolina, Chapel Hill
| | - Angela Ianni
- Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania
| | - Aleksandra Kaurin
- Department of Psychology, University of Wuppertal, Wuppertal, Germany
| | - Aidan G. C. Wright
- Department of Psychology, University of Michigan, Ann Arbor
- Eisenberg Family Depression Center, University of Michigan, Ann Arbor
| | - Alexandre Y. Dombrovski
- Department of Psychiatry, University of Pittsburgh School of Medicine, Pittsburgh, Pennsylvania
| |
Collapse
|
4
|
Sloman SJ, Cavagnaro DR, Broomell SB. Knowing what to know: Implications of the choice of prior distribution on the behavior of adaptive design optimization. Behav Res Methods 2024:10.3758/s13428-024-02410-7. [PMID: 38977609 DOI: 10.3758/s13428-024-02410-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Accepted: 03/12/2024] [Indexed: 07/10/2024]
Abstract
Adaptive design optimization (ADO) is a state-of-the-art technique for experimental design (Cavagnaro et al., 2010). ADO dynamically identifies stimuli that, in expectation, yield the most information about a hypothetical construct of interest (e.g., parameters of a cognitive model). To calculate this expectation, ADO leverages the modeler's existing knowledge, specified in the form of a prior distribution. Informative priors align with the distribution of the focal construct in the participant population. This alignment is assumed by ADO's internal assessment of expected information gain. If the prior is instead misinformative, i.e., does not align with the participant population, ADO's estimates of expected information gain could be inaccurate. In many cases, the true distribution that characterizes the participant population is unknown, and experimenters rely on heuristics in their choice of prior and without an understanding of how this choice affects ADO's behavior. Our work introduces a mathematical framework that facilitates investigation of the consequences of the choice of prior distribution on the efficiency of experiments designed using ADO. Through theoretical and empirical results, we show that, in the context of prior misinformation, measures of expected information gain are distinct from the correctness of the corresponding inference. Through a series of simulation experiments, we show that, in the case of parameter estimation, ADO nevertheless outperforms other design methods. Conversely, in the case of model selection, misinformative priors can lead inference to favor the wrong model, and rather than mitigating this pitfall, ADO exacerbates it.
Collapse
Affiliation(s)
- Sabina J Sloman
- Department of Computer Science, The University of Manchester, Oxford Rd, M13 9PL, Manchester, UK.
| | - Daniel R Cavagnaro
- College of Business and Economics, California State University, Fullerton, CA, USA
| | - Stephen B Broomell
- Department of Psychological Sciences, Purdue University, West Lafayette, IN, USA
| |
Collapse
|
5
|
Blanco NJ, Sloutsky VM. Exploration, exploitation, and development: Developmental shifts in decision-making. Child Dev 2024; 95:1287-1298. [PMID: 38314828 PMCID: PMC11223977 DOI: 10.1111/cdev.14070] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2024]
Abstract
Decision-making requires balancing exploration with exploitation, yet children are highly exploratory, with exploration decreasing with development. Less is known about what drives these changes. We examined the development of decision-making in 188 three- to eight-year-old children (M = 64 months; 98 girls) and 26 adults (M = 19 years; 13 women). Children were recruited from ethnically diverse suburban middle-class neighborhoods of Columbus, Ohio, USA. Results indicate that mature reward-based choices emerge relatively late in development, with children tending to over-explore. Computational modeling suggests that this exploration is systematic rather than random, as children tend to avoid repeating choices made on the previous trial. This pattern of exploration (reminiscent of novelty preference) decreased with development, whereas the tendency to exploit increased.
Collapse
Affiliation(s)
- Nathaniel J Blanco
- Department of Psychology, The Ohio State University, Columbus, Ohio, USA
| | | |
Collapse
|
6
|
Ueshima A, Jones MI, Christakis NA. Simple autonomous agents can enhance creative semantic discovery by human groups. Nat Commun 2024; 15:5212. [PMID: 38890368 PMCID: PMC11189566 DOI: 10.1038/s41467-024-49528-y] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2023] [Accepted: 06/07/2024] [Indexed: 06/20/2024] Open
Abstract
Innovation is challenging, and theory and experiments indicate that groups may be better able to identify and preserve innovations than individuals. But innovation within groups faces its own challenges, including groupthink and truncated diffusion. We performed experiments involving a game in which people search for ideas in various conditions: alone, in networked social groups, or in networked groups featuring autonomous agents (bots). The objective was to search a semantic space of 20,000 nouns with defined similarities for an arbitrary noun with the highest point value. Participants (N = 1875) were embedded in networks (n = 125) of 15 nodes to which we sometimes added 2 bots. The bots had 3 possible strategies: they shared a random noun generated by their immediate neighbors, or a noun most similar from among those identified, or a noun least similar. We first confirm that groups are better able to explore a semantic space than isolated individuals. Then we show that when bots that share the most similar noun operate in groups facing a semantic space that is relatively easy to navigate, group performance is superior. Simple autonomous agents with interpretable behavior can affect the capacity for creative discovery of human groups.
Collapse
Affiliation(s)
- Atsushi Ueshima
- Yale Institute for Network Science, Yale University, New Haven, CT, USA
- Department of Sociology, Yale University, New Haven, CT, USA
- Japan Society for the Promotion of Science, Tokyo, Japan
- Department of Human Sciences, Faculty of Letters, Keio University, Tokyo, Japan
| | - Matthew I Jones
- Yale Institute for Network Science, Yale University, New Haven, CT, USA
- Department of Sociology, Yale University, New Haven, CT, USA
- Sunwater Institute, North Bethesda, MD, USA
| | - Nicholas A Christakis
- Yale Institute for Network Science, Yale University, New Haven, CT, USA.
- Department of Sociology, Yale University, New Haven, CT, USA.
- Department of Statistics and Data Science, Yale University, New Haven, CT, USA.
| |
Collapse
|
7
|
Valzolgher C. Motor Strategies: The Role of Active Behavior in Spatial Hearing Research. Psychol Rep 2024:332941241260246. [PMID: 38857521 DOI: 10.1177/00332941241260246] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/12/2024]
Abstract
When completing a task, the ability to implement behavioral strategies to solve it in an effective and cognitively less-demanding way is extremely adaptive for humans. This behavior makes it possible to accumulate evidence and test one's own predictions about the external world. In this work, starting from examples in the field of spatial hearing research, I analyze the importance of considering motor strategies in perceptual tasks, and I stress the urgent need to create ecological experimental settings, which are essential in allowing the implementation of such behaviors and in measuring them. In particular, I will consider head movements as an example of strategic behavior implemented to solve acoustic space-perception tasks.
Collapse
Affiliation(s)
- Chiara Valzolgher
- Center for Mind/Brain Sciences, University of Trento, Rovereto, Italy
| |
Collapse
|
8
|
Kobayashi K, Kable JW. Neural mechanisms of information seeking. Neuron 2024; 112:1741-1756. [PMID: 38703774 DOI: 10.1016/j.neuron.2024.04.008] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2023] [Revised: 01/30/2024] [Accepted: 04/08/2024] [Indexed: 05/06/2024]
Abstract
We ubiquitously seek information to make better decisions. Particularly in the modern age, when more information is available at our fingertips than ever, the information we choose to collect determines the quality of our decisions. Decision neuroscience has long adopted empirical approaches where the information available to decision-makers is fully controlled by the researchers, leaving neural mechanisms of information seeking less understood. Although information seeking has long been studied in the context of the exploration-exploitation trade-off, recent studies have widened the scope to investigate more overt information seeking in a way distinct from other decision processes. Insights gained from these studies, accumulated over the last few years, raise the possibility that information seeking is driven by the reward system signaling the subjective value of information. In this piece, we review findings from the recent studies, highlighting the conceptual and empirical relationships between distinct literatures, and discuss future research directions necessary to establish a more comprehensive understanding of how individuals seek information as a part of value-based decision-making.
Collapse
Affiliation(s)
- Kenji Kobayashi
- Department of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA.
| | - Joseph W Kable
- Department of Psychology, University of Pennsylvania, Philadelphia, PA 19104, USA.
| |
Collapse
|
9
|
Jin S, Ahn Y, Park J, Park M, Lee SC, Lee WJ, Seo D. Temporal Patterns of Angular Displacement of Endosomes: Insights into Motor Protein Exchange Dynamics. ADVANCED SCIENCE (WEINHEIM, BADEN-WURTTEMBERG, GERMANY) 2024:e2306849. [PMID: 38828676 DOI: 10.1002/advs.202306849] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 09/21/2023] [Revised: 03/24/2024] [Indexed: 06/05/2024]
Abstract
The material transport system, facilitated by motor proteins, plays a vital role in maintaining a non-equilibrium cellular state. However, understanding the temporal coordination of motor protein activity requires an advanced imaging technique capable of measuring 3D angular displacement in real-time. In this study, a Fourier transform-based plasmonic dark-field microscope has been developed using anisotropic nanoparticles, enabling the prolonged and simultaneous observation of endosomal lateral and rotational motion. A sequence of discontinuous 3D angular displacements has been observed during the pause and run phases of transport. Notably, a serially correlated temporal pattern in the intermittent rotational events has been demonstrated during the tug-of-war mechanism, indicating Markovian switching between the exploitational and explorational modes of motor protein exchange prior to resuming movement. Alterations in transition frequency and the exploitation-to-exploration ratio upon dynein inhibitor treatment highlight the relationship between disrupted motor coordination and reduced endosomal transport efficiency. Collectively, these results suggest the importance of orchestrated temporal motor protein patterns for efficient cellular transport.
Collapse
Affiliation(s)
- Siwoo Jin
- Department of Physics and Chemistry, DGIST, Daegu, 42988, Republic of Korea
| | - Yongdeok Ahn
- Department of Physics and Chemistry, DGIST, Daegu, 42988, Republic of Korea
| | - Jiseong Park
- Department of Physics and Chemistry, DGIST, Daegu, 42988, Republic of Korea
| | - Minsoo Park
- Department of Physics and Chemistry, DGIST, Daegu, 42988, Republic of Korea
| | - Sang-Chul Lee
- Division of Nanotechnology, and Department of DGIST, Daegu, 42988, Republic of Korea
| | - Wonhee J Lee
- Department of Physics and Chemistry, DGIST, Daegu, 42988, Republic of Korea
| | - Daeha Seo
- Department of Physics and Chemistry, DGIST, Daegu, 42988, Republic of Korea
| |
Collapse
|
10
|
Zhu Z, Kuchibhotla KV. Performance errors during rodent learning reflect a dynamic choice strategy. Curr Biol 2024; 34:2107-2117.e5. [PMID: 38677279 DOI: 10.1016/j.cub.2024.04.017] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/12/2023] [Revised: 02/10/2024] [Accepted: 04/08/2024] [Indexed: 04/29/2024]
Abstract
Humans, even as infants, use cognitive strategies, such as exploration and hypothesis testing, to learn about causal interactions in the environment. In animal learning studies, however, it is challenging to disentangle higher-order behavioral strategies from errors arising from imperfect task knowledge or inherent biases. Here, we trained head-fixed mice on a wheel-based auditory two-choice task and exploited the intra- and inter-animal variability to understand the drivers of errors during learning. During learning, performance errors are dominated by a choice bias, which, despite appearing maladaptive, reflects a dynamic strategy. Early in learning, mice develop an internal model of the task contingencies such that violating their expectation of reward on correct trials (by using short blocks of non-rewarded "probe" trials) leads to an abrupt shift in strategy. During the probe block, mice behave more accurately with less bias, thereby using their learned stimulus-action knowledge to test whether the outcome contingencies have changed. Despite having this knowledge, mice continued to exhibit a strong choice bias during reinforced trials. This choice bias operates on a timescale of tens to hundreds of trials with a dynamic structure, shifting between left, right, and unbiased epochs. Biased epochs also coincided with faster motor kinematics. Although bias decreased across learning, expert mice continued to exhibit short bouts of biased choices interspersed with longer bouts of unbiased choices and higher performance. These findings collectively suggest that during learning, rodents actively probe their environment in a structured manner to refine their decision-making and maintain long-term flexibility.
Collapse
Affiliation(s)
- Ziyi Zhu
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD 21218, USA; Johns Hopkins Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, MD 21218, USA; The Solomon Snyder Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA
| | - Kishore V Kuchibhotla
- Department of Psychological and Brain Sciences, Johns Hopkins University, Baltimore, MD 21218, USA; Johns Hopkins Kavli Neuroscience Discovery Institute, Johns Hopkins University, Baltimore, MD 21218, USA; The Solomon Snyder Department of Neuroscience, Johns Hopkins University School of Medicine, Baltimore, MD 21205, USA; Department of Biomedical Engineering, Johns Hopkins University, Baltimore, MD 21218, USA.
| |
Collapse
|
11
|
Kurth-Nelson Z, Sullivan S, Leibo JZ, Guitart-Masip M. Dynamic diversity is the answer to proxy failure. Behav Brain Sci 2024; 47:e77. [PMID: 38738350 DOI: 10.1017/s0140525x23002923] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/14/2024]
Abstract
We argue that a diverse and dynamic pool of agents mitigates proxy failure. Proxy modularity plays a key role in the ongoing production of diversity. We review examples from a range of scales.
Collapse
Affiliation(s)
- Zeb Kurth-Nelson
- Google DeepMind, London, UK
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, UK
| | - Steve Sullivan
- Department of Anesthesiology and Perioperative Medicine, Oregon Health and Science University, Portland, OR, USA
| | | | - Marc Guitart-Masip
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, University College London, London, UK
- Aging Research Center, Department of Neurobiology, Care Sciences and Society, Karolinska Institutet, Stockholm, Sweden
- Center for Psychiatry Research, Region Stockholm, Stockholm, Sweden. Center for Cognitive
- Computational Neuropsychiatry (CCNP), Karolinska Institutet, Stockholm, Sweden
| |
Collapse
|
12
|
Barbier-Chebbah A, Vestergaard CL, Masson JB. Approximate information for efficient exploration-exploitation strategies. Phys Rev E 2024; 109:L052105. [PMID: 38907409 DOI: 10.1103/physreve.109.l052105] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2023] [Accepted: 01/29/2024] [Indexed: 06/24/2024]
Abstract
This paper addresses the exploration-exploitation dilemma inherent in decision-making, focusing on multiarmed bandit problems. These involve an agent deciding whether to exploit current knowledge for immediate gains or explore new avenues for potential long-term rewards. We here introduce a class of algorithms, approximate information maximization (AIM), which employs a carefully chosen analytical approximation to the gradient of the entropy to choose which arm to pull at each point in time. AIM matches the performance of Thompson sampling, which is known to be asymptotically optimal, as well as that of Infomax from which it derives. AIM thus retains the advantages of Infomax while also offering enhanced computational speed, tractability, and ease of implementation. In particular, we demonstrate how to apply it to a 50-armed bandit game. Its expression is tunable, which allows for specific optimization in various settings, making it possible to surpass the performance of Thompson sampling at short and intermediary times.
Collapse
Affiliation(s)
- Alex Barbier-Chebbah
- Institut Pasteur, Université Paris Cité, CNRS UMR 3571, Decision and Bayesian Computation, 75015 Paris, France
- Épimethée, Inria, 75012 Paris, France
| | - Christian L Vestergaard
- Institut Pasteur, Université Paris Cité, CNRS UMR 3571, Decision and Bayesian Computation, 75015 Paris, France
- Épimethée, Inria, 75012 Paris, France
| | - Jean-Baptiste Masson
- Institut Pasteur, Université Paris Cité, CNRS UMR 3571, Decision and Bayesian Computation, 75015 Paris, France
- Épimethée, Inria, 75012 Paris, France
| |
Collapse
|
13
|
Harms MB, Xu Y, Green CS, Woodard K, Wilson R, Pollak SD. The structure and development of explore-exploit decision making. Cogn Psychol 2024; 150:101650. [PMID: 38461609 PMCID: PMC11275514 DOI: 10.1016/j.cogpsych.2024.101650] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2023] [Revised: 03/05/2024] [Accepted: 03/06/2024] [Indexed: 03/12/2024]
Abstract
A critical component of human learning reflects the balance people must achieve between focusing on the utility of what they know versus openness to what they have yet to experience. How individuals decide whether to explore new options versus exploit known options has garnered growing interest in recent years. Yet, the component processes underlying decisions to explore and whether these processes change across development remain poorly understood. By contrasting a variety of tasks that measure exploration in slightly different ways, we found that decisions about whether to explore reflect (a) random exploration that is not explicitly goal-directed and (b) directed exploration to purposefully reduce uncertainty. While these components similarly characterized the decision-making of both youth and adults, younger participants made decisions that were less strategic, but more exploratory and flexible, than those of adults. These findings are discussed in terms of how people adapt to and learn from changing environments over time.Data has been made available in the Open Science Foundation platform (osf.io).
Collapse
Affiliation(s)
- Madeline B Harms
- Department of Psychology, University of Wisconsin - Madison, 1202 West Johnson Street, Madison, WI 53706, United States.
| | - Yuyan Xu
- Department of Psychology, University of Wisconsin - Madison, 1202 West Johnson Street, Madison, WI 53706, United States
| | - C Shawn Green
- Department of Psychology, University of Wisconsin - Madison, 1202 West Johnson Street, Madison, WI 53706, United States
| | - Kristina Woodard
- Department of Psychology, University of Wisconsin - Madison, 1202 West Johnson Street, Madison, WI 53706, United States
| | - Robert Wilson
- Department of Psychology, University of Arizona, 1503 E. University Blvd. (Building 68), Tucson, AZ 85721, United States
| | - Seth D Pollak
- Department of Psychology, University of Wisconsin - Madison, 1202 West Johnson Street, Madison, WI 53706, United States
| |
Collapse
|
14
|
McNamee DC. The generative neural microdynamics of cognitive processing. Curr Opin Neurobiol 2024; 85:102855. [PMID: 38428170 DOI: 10.1016/j.conb.2024.102855] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Revised: 02/06/2024] [Accepted: 02/07/2024] [Indexed: 03/03/2024]
Abstract
The entorhinal cortex and hippocampus form a recurrent network that informs many cognitive processes, including memory, planning, navigation, and imagination. Neural recordings from these regions reveal spatially organized population codes corresponding to external environments and abstract spaces. Aligning the former cognitive functionalities with the latter neural phenomena is a central challenge in understanding the entorhinal-hippocampal circuit (EHC). Disparate experiments demonstrate a surprising level of complexity and apparent disorder in the intricate spatiotemporal dynamics of sequential non-local hippocampal reactivations, which occur particularly, though not exclusively, during immobile pauses and rest. We review these phenomena with a particular focus on their apparent lack of physical simulative realism. These observations are then integrated within a theoretical framework and proposed neural circuit mechanisms that normatively characterize this neural complexity by conceiving different regimes of hippocampal microdynamics as neuromarkers of diverse cognitive computations.
Collapse
|
15
|
Kabrel M, Tulver K, Aru J. The journey within: mental navigation as a novel framework for understanding psychotherapeutic transformation. BMC Psychiatry 2024; 24:91. [PMID: 38302927 PMCID: PMC10835954 DOI: 10.1186/s12888-024-05522-8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 09/01/2023] [Accepted: 01/15/2024] [Indexed: 02/03/2024] Open
Abstract
BACKGROUND Despite the demonstrated efficacy of psychotherapy, the precise mechanisms that drive therapeutic transformations have posed a challenge and still remain unresolved. Here, we suggest a potential solution to this problem by introducing a framework based on the concept of mental navigation. It refers to our ability to navigate our cognitive space of thoughts, ideas, concepts, and memories, similar to how we navigate physical space. We start by analyzing the neural, cognitive, and experiential constituents intrinsic to mental navigation. Subsequently, we posit that the metaphoric spatial language we employ to articulate introspective experiences (e.g., "unexplored territory" or "going in circles") serves as a robust marker of mental navigation. METHODS Using large text corpora, we compared the utilization of spatial language between transcripts of psychotherapy sessions (≈ 12 M. words), casual everyday conversations (≈ 12 M. words), and fictional dialogues in movies (≈ 14 M. words). We also examined 110 psychotherapy transcripts qualitatively to discern patterns and dynamics associated with mental navigation. RESULTS We found a notable increase in the utilization of spatial metaphors during psychotherapy compared to casual everyday dialogues (U = 192.0, p = .001, d = 0.549) and fictional conversations (U = 211, p < .001, d = 0.792). In turn, analyzing the usage of non-spatial metaphors, we did not find significant differences between the three datasets (H = 0.682, p = 0.710). The qualitative analysis highlighted specific examples of mental navigation at play. CONCLUSION Mental navigation might underlie the psychotherapy process and serve as a robust framework for understanding the transformative changes it brings about.
Collapse
Affiliation(s)
- Mykyta Kabrel
- Institute of Philosophy and Semiotics, University of Tartu, Tartu, Estonia.
| | - Kadi Tulver
- Institute of Computer Science, University of Tartu, Tartu, Estonia
| | - Jaan Aru
- Institute of Computer Science, University of Tartu, Tartu, Estonia
| |
Collapse
|
16
|
Wyatt LE, Hewan PA, Hogeveen J, Spreng RN, Turner GR. Exploration versus exploitation decisions in the human brain: A systematic review of functional neuroimaging and neuropsychological studies. Neuropsychologia 2024; 192:108740. [PMID: 38036246 DOI: 10.1016/j.neuropsychologia.2023.108740] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/28/2023] [Revised: 10/15/2023] [Accepted: 11/21/2023] [Indexed: 12/02/2023]
Abstract
Thoughts and actions are often driven by a decision to either explore new avenues with unknown outcomes, or to exploit known options with predictable outcomes. Yet, the neural mechanisms underlying this exploration-exploitation trade-off in humans remain poorly understood. This is attributable to variability in the operationalization of exploration and exploitation as psychological constructs, as well as the heterogeneity of experimental protocols and paradigms used to study these choice behaviours. To address this gap, here we present a comprehensive review of the literature to investigate the neural basis of explore-exploit decision-making in humans. We first conducted a systematic review of functional magnetic resonance imaging (fMRI) studies of exploration-versus exploitation-based decision-making in healthy adult humans during foraging, reinforcement learning, and information search. Eleven fMRI studies met inclusion criterion for this review. Adopting a network neuroscience framework, synthesis of the findings across these studies revealed that exploration-based choice was associated with the engagement of attentional, control, and salience networks. In contrast, exploitation-based choice was associated with engagement of default network brain regions. We interpret these results in the context of a network architecture that supports the flexible switching between externally and internally directed cognitive processes, necessary for adaptive, goal-directed behaviour. To further investigate potential neural mechanisms underlying the exploration-exploitation trade-off we next surveyed studies involving neurodevelopmental, neuropsychological, and neuropsychiatric disorders, as well as lifespan development, and neurodegenerative diseases. We observed striking differences in patterns of explore-exploit decision-making across these populations, again suggesting that these two decision-making modes are supported by independent neural circuits. Taken together, our review highlights the need for precision-mapping of the neural circuitry and behavioural correlates associated with exploration and exploitation in humans. Characterizing exploration versus exploitation decision-making biases may offer a novel, trans-diagnostic approach to assessment, surveillance, and intervention for cognitive decline and dysfunction in normal development and clinical populations.
Collapse
Affiliation(s)
- Lindsay E Wyatt
- Department of Psychology, York University, Toronto, ON, Canada
| | - Patrick A Hewan
- Department of Psychology, York University, Toronto, ON, Canada
| | - Jeremy Hogeveen
- Department of Psychology, The University of New Mexico, Albuquerque, NM, USA
| | - R Nathan Spreng
- Montréal Neurological Institute, Department of Neurology and Neurosurgery, McGill University, Montréal, QC, H3A 2B4, Canada; Department of Psychology, McGill University, Montréal, QC, Canada; Department of Psychiatry, McGill University, Montréal, QC, Canada; McConnell Brain Imaging Centre, Montréal Neurological Institute, McGill University, Montréal, QC, Canada.
| | - Gary R Turner
- Department of Psychology, York University, Toronto, ON, Canada.
| |
Collapse
|
17
|
Gordon J, Chierichetti F, Panconesi A, Pezzulo G. Information foraging with an oracle. PLoS One 2023; 18:e0295005. [PMID: 38153955 PMCID: PMC10754449 DOI: 10.1371/journal.pone.0295005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2023] [Accepted: 11/13/2023] [Indexed: 12/30/2023] Open
Abstract
During ecological decisions, such as when foraging for food or selecting a weekend activity, we often have to balance the costs and benefits of exploiting known options versus exploring novel ones. Here, we ask how individuals address such cost-benefit tradeoffs during tasks in which we can either explore by ourselves or seek external advice from an oracle (e.g., a domain expert or recommendation system). To answer this question, we designed two studies in which participants chose between inquiring (at a cost) for expert advice from an oracle, or to search for options without guidance, under manipulations affecting the optimal choice. We found that participants showed a greater propensity to seek expert advice when it was instrumental to increase payoff (study A), and when it reduced choice uncertainty, above and beyond payoff maximization (study B). This latter result was especially apparent in participants with greater trait-level intolerance of uncertainty. Taken together, these results suggest that we seek expert advice for both economic goals (i.e., payoff maximization) and epistemic goals (i.e., uncertainty minimization) and that our decisions to ask or not ask for advice are sensitive to cost-benefit tradeoffs.
Collapse
Affiliation(s)
- Jeremy Gordon
- University of California, Berkeley, Berkeley, CA, United States of America
| | | | | | - Giovanni Pezzulo
- Institute of Cognitive Sciences and Technologies, National Research Council, Rome, Italy
| |
Collapse
|
18
|
Zemla JC, Gooding DC, Austerweil JL. Evidence for optimal semantic search throughout adulthood. Sci Rep 2023; 13:22528. [PMID: 38110643 PMCID: PMC10728182 DOI: 10.1038/s41598-023-49858-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2023] [Accepted: 12/12/2023] [Indexed: 12/20/2023] Open
Abstract
As people age, they learn and store new knowledge in their semantic memory. Despite learning a tremendous amount of information, people can still recall information relevant to the current situation with ease. To accomplish this, the mind must efficiently organize and search a vast store of information. It also must continue to retrieve information effectively despite changes in cognitive mechanisms due to healthy aging, including a general slowing in information processing and a decline in executive functioning. How effectively does the mind of an individual adjust its search to account for changes due to aging? We tested 746 people ages 25 through 69 on a semantic fluency task (free listing animals) and found that, on average, retrieval follows an optimal path through semantic memory. Participants tended to list a sequence of semantically related animals (e.g., lion, tiger, puma) before switching to a semantically unrelated animal (e.g., whale). We found that the timing of these transitions to semantically unrelated animals was remarkably consistent with an optimal strategy for maximizing the overall rate of retrieval (i.e., the number of animals listed per unit time). Age did not affect an individual's deviation from the optimal strategy given their general performance, suggesting that people adapt and continue to search memory optimally throughout their lives. We argue that this result is more likely due to compensating for a general slowing than a decline in executive functioning.
Collapse
Affiliation(s)
- Jeffrey C Zemla
- Department of Psychology, Syracuse University, Syracuse, NY, USA.
| | - Diane C Gooding
- Department of Psychology, College of Letters and Science, University of Wisconsin-Madison, Madison, WI, USA
- Department of Psychiatry, SMPH, University of Wisconsin-Madison, Madison, WI, USA
- Department of Medicine, Division of Gerontology and Geriatrics, SMPH, University of Wisconsin-Madison, Madison, WI, USA
| | - Joseph L Austerweil
- Department of Psychology, College of Letters and Science, University of Wisconsin-Madison, Madison, WI, USA
| |
Collapse
|
19
|
Bustamante LA, Oshinowo T, Lee JR, Tong E, Burton AR, Shenhav A, Cohen JD, Daw ND. Effort Foraging Task reveals positive correlation between individual differences in the cost of cognitive and physical effort in humans. Proc Natl Acad Sci U S A 2023; 120:e2221510120. [PMID: 38064507 PMCID: PMC10723129 DOI: 10.1073/pnas.2221510120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2023] [Accepted: 10/26/2023] [Indexed: 12/17/2023] Open
Abstract
Effort-based decisions, in which people weigh potential future rewards against effort costs required to achieve those rewards involve both cognitive and physical effort, though the mechanistic relationship between them is not yet understood. Here, we use an individual differences approach to isolate and measure the computational processes underlying effort-based decisions and test the association between cognitive and physical domains. Patch foraging is an ecologically valid reward rate maximization problem with well-developed theoretical tools. We developed the Effort Foraging Task, which embedded cognitive or physical effort into patch foraging, to quantify the cost of both cognitive and physical effort indirectly, by their effects on foraging choices. Participants chose between harvesting a depleting patch, or traveling to a new patch that was costly in time and effort. Participants' exit thresholds (reflecting the reward they expected to receive by harvesting when they chose to travel to a new patch) were sensitive to cognitive and physical effort demands, allowing us to quantify the perceived effort cost in monetary terms. The indirect sequential choice style revealed effort-seeking behavior in a minority of participants (preferring high over low effort) that has apparently been missed by many previous approaches. Individual differences in cognitive and physical effort costs were positively correlated, suggesting that these are perceived and processed in common. We used canonical correlation analysis to probe the relationship of task measures to self-reported affect and motivation, and found correlations of cognitive effort with anxiety, cognitive function, behavioral activation, and self-efficacy, but no similar correlations with physical effort.
Collapse
Affiliation(s)
- Laura A. Bustamante
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
- Department of Psychological and Brain Sciences, Washington University in Saint Louis, Saint Louis, MO63130
| | - Temitope Oshinowo
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| | - Jeremy R. Lee
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| | - Elizabeth Tong
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| | - Allison R. Burton
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| | - Amitai Shenhav
- Department of Cognitive, Linguistic, and Psychological Sciences, Brown University, Providence, RI02912
- Carney Institute for Brain Science, Brown University, Providence, RI02906
| | - Jonathan D. Cohen
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| | - Nathaniel D. Daw
- Princeton Neuroscience Institute, Princeton University, Princeton, NJ08544
| |
Collapse
|
20
|
Jenkinson PM, Koukoutsakis A, Panagiotopoulou E, Vagnoni E, Demartini B, Nistico V, Gambini O, Christakou A, Fotopoulou A. Body appearance values modulate risk aversion in eating restriction. J Exp Psychol Gen 2023; 152:3418-3432. [PMID: 37768577 PMCID: PMC7615344 DOI: 10.1037/xge0001445] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 09/29/2023]
Abstract
The understanding of eating disorders is hindered by the lack of integration between existing psychosocial and neurobiological approaches. We address this problem by developing a novel transdiagnostic and computational approach to eating restriction decisions. We first validated a novel paradigm which extends an established monetary risk task to involve body stimuli with psychosocial values. We used advanced behavioral data analysis of a large (total N = 539) sample of women from across the eating restraint spectrum, including those with anorexia nervosa (AN; n = 31), recovered from AN (n = 23), and subclinical women with varying levels of eating restraint (n = 485), obtained from an online experiment, public event, and laboratory-based study. We found that social and motivational values regarding body appearance have a significant effect on value-based, decision making in eating restriction. Subsequently, validated descriptive and predictive advanced computational modeling indicated that these behaviors are driven by an aversion to risk rather than loss, with desirable body outcomes being associated with less risk aversion, and undesirable body outcomes linked to greater risk aversion. These findings indicate that cognitive and social factors influence eating decisions by distinct mechanisms. (PsycInfo Database Record (c) 2023 APA, all rights reserved).
Collapse
Affiliation(s)
- Paul Mark Jenkinson
- ISN Psychology, Institute for Social Neuroscience, Melbourne, Australia
- Research Department of Clinical, Educational and Health Psychology, University College London, UK
| | - Athanasios Koukoutsakis
- Research Department of Clinical, Educational and Health Psychology, University College London, UK
| | - Elena Panagiotopoulou
- Research Department of Clinical, Educational and Health Psychology, University College London, UK
- Postgraduate Studies, Anna Freud National Centre for Children and Families, London, UK
| | | | - Benedetta Demartini
- Department of Health Sciences, University of Milan, Italy
- “Aldo Ravelli” Centre for neurotechnology and experimental brain therapeutics, University of Milan, Italy
| | - Veronica Nistico
- Department of Health Sciences, University of Milan, Italy
- “Aldo Ravelli” Centre for neurotechnology and experimental brain therapeutics, University of Milan, Italy
| | - Orsola Gambini
- Department of Health Sciences, University of Milan, Italy
- “Aldo Ravelli” Centre for neurotechnology and experimental brain therapeutics, University of Milan, Italy
| | | | - Aikaterini Fotopoulou
- Research Department of Clinical, Educational and Health Psychology, University College London, UK
| |
Collapse
|
21
|
Segovia-Martin J, Creutzig F, Winters J. Efficiency traps beyond the climate crisis: exploration-exploitation trade-offs and rebound effects. Philos Trans R Soc Lond B Biol Sci 2023; 378:20220405. [PMID: 37718604 PMCID: PMC10505854 DOI: 10.1098/rstb.2022.0405] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2023] [Accepted: 06/16/2023] [Indexed: 09/19/2023] Open
Abstract
Higher levels of economic activity are often accompanied by higher energy use and consumption of natural resources. As fossil fuels still account for 80% of the global energy mix, energy consumption remains closely linked to greenhouse gas (GHG) emissions and thus to climate change. Under the assumption of sufficiently elastic demand, this reality of global economic development based on permanent growth of economic activity, brings into play the Jevons Paradox, which hypothesises that increases in the efficiency of resource use leads to increases in resource consumption. Previous research on the rebound effects has limitations, including a lack of studies on the connection between reinforcement learning and environmental consequences. This paper develops a mathematical model and computer simulator to study the effects of micro-level exploration-exploitation strategies on efficiency, consumption and sustainability, considering different levels of direct and indirect rebound effects. Our model shows how optimal exploration-exploitation strategies for increasing efficiency can lead to unsustainable development patterns if they are not accompanied by demand reduction measures, which are essential for mitigating climate change. Moreover, our paper speaks to the broader issue of efficiency traps by highlighting how indirect rebound effects not only affect primary energy (PE) consumption and GHG emissions, but also resource consumption in other domains. By linking these issues together, our study sheds light on the complexities and interdependencies involved in achieving sustainable development goals. This article is part of the theme issue 'Climate change adaptation needs a science of culture'.
Collapse
Affiliation(s)
- Jose Segovia-Martin
- School of Collective Intelligence, M6 Polytechnic University (SCI-UM6P), Rabat, 11103 Morocco
- Complex Systems Institute of Paris Île-de-France (ISCPIF-CNRS), 75013 Paris, France
| | - Felix Creutzig
- Mercator Research Institute on Global Commons and Climate Change, 10829 Berlin, Germany
- Technische Universität Berlin, 10623 Berlin, Germany
| | - James Winters
- School of Collective Intelligence, M6 Polytechnic University (SCI-UM6P), Rabat, 11103 Morocco
- Centre for Culture and Evolution, Department of Psychology, Brunel University London, London, Uxbridge UB8 3PH, UK
| |
Collapse
|
22
|
Bruner E. Cognitive Archeology and the Attentional System: An Evolutionary Mismatch for the Genus Homo. J Intell 2023; 11:183. [PMID: 37754912 PMCID: PMC10532831 DOI: 10.3390/jintelligence11090183] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/29/2023] [Revised: 09/04/2023] [Accepted: 09/11/2023] [Indexed: 09/28/2023] Open
Abstract
Brain evolution is a key topic in evolutionary anthropology. Unfortunately, in this sense the fossil record can usually support limited anatomical and behavioral inferences. Nonetheless, information from fossil species is, in any case, particularly valuable, because it represents the only direct proof of cerebral and behavioral changes throughout the human phylogeny. Recently, archeology and psychology have been integrated in the field of cognitive archeology, which aims to interpret current cognitive models according to the evidence we have on extinct human species. In this article, such evidence is reviewed in order to consider whether and to what extent the archeological record can supply information regarding changes of the attentional system in different taxa of the human genus. In particular, behavioral correlates associated with the fronto-parietal system and working memory are employed to consider recent changes in our species, Homo sapiens, and a mismatch between attentional and visuospatial ability is hypothesized. These two functional systems support present-moment awareness and mind-wandering, respectively, and their evolutionary unbalance can explain a structural sensitivity to psychological distress in our species.
Collapse
Affiliation(s)
- Emiliano Bruner
- Centro Nacional de Investigación sobre la Evolución Humana, Paseo Sierra de Atapuerca 3, 09002 Burgos, Spain
| |
Collapse
|
23
|
Mahr JB, van Bergen P, Sutton J, Schacter DL, Heyes C. Mnemicity: A Cognitive Gadget? PERSPECTIVES ON PSYCHOLOGICAL SCIENCE 2023; 18:1160-1177. [PMID: 36649218 DOI: 10.1177/17456916221141352] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/18/2023]
Abstract
Episodic representations can be entertained either as "remembered" or "imagined"-as outcomes of experience or as simulations of such experience. Here, we argue that this feature is the product of a dedicated cognitive function: the metacognitive capacity to determine the mnemicity of mental event simulations. We argue that mnemicity attribution should be distinguished from other metacognitive operations (such as reality monitoring) and propose that this attribution is a "cognitive gadget"-a distinctively human ability made possible by cultural learning. Cultural learning is a type of social learning in which traits are inherited through social interaction. In the case of mnemicity, one culturally learns to discriminate metacognitive "feelings of remembering" from other perceptual, emotional, action-related, and metacognitive feelings; to interpret feelings of remembering as indicators of memory rather than imagination; and to broadcast the interpreted feelings in culture- and context-specific ways, such as "I was there" or "I witnessed it myself." We review evidence from the literature on memory development and scaffolding, metacognitive learning and teaching, as well as cross-cultural psychology in support of this view before pointing out various open questions about the nature and development of mnemicity highlighted by our account.
Collapse
Affiliation(s)
| | | | - John Sutton
- Department of Philosophy, Macquarie University
| | | | - Cecilia Heyes
- All Souls College, University of Oxford
- Department of Experimental Psychology, University of Oxford
| |
Collapse
|
24
|
Ivancovsky T, Baror S, Bar M. A shared novelty-seeking basis for creativity and curiosity. Behav Brain Sci 2023; 47:e89. [PMID: 37547934 DOI: 10.1017/s0140525x23002807] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/08/2023]
Abstract
Curiosity and creativity are central pillars of human growth and invention. Although they have been studied extensively in isolation, the relationship between them has not yet been established. We propose that both curiosity and creativity emanate from the same mechanism of novelty seeking. We first present a synthesis showing that curiosity and creativity are affected similarly by a number of key cognitive faculties such as memory, cognitive control, attention, and reward. We then review empirical evidence from neuroscience research, indicating that the same brain regions are involved in both curiosity and creativity, focusing on the interplay between three major brain networks: the default mode network, the salience network, and the executive control network. After substantiating the link between curiosity and creativity, we propose a novelty-seeking model (NSM) that underlies them and suggests that the manifestation of the NSM is governed by one's state of mind.
Collapse
Affiliation(s)
- Tal Ivancovsky
- The Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, Ramat Gan,
- Department of Clinical and Health Psychology, Universitat Autònoma de Barcelona, Catalunya, Spain
| | - Shira Baror
- The Edmond and Lily Safra Center for Brain Sciences, The Hebrew University, Jerusalem, Israel.
| | - Moshe Bar
- The Gonda Multidisciplinary Brain Research Center, Bar-Ilan University, Ramat Gan,
| |
Collapse
|
25
|
Casillas-Pérez B, Boďová K, Grasse AV, Tkačik G, Cremer S. Dynamic pathogen detection and social feedback shape collective hygiene in ants. Nat Commun 2023; 14:3232. [PMID: 37270641 DOI: 10.1038/s41467-023-38947-y] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/23/2022] [Accepted: 05/23/2023] [Indexed: 06/05/2023] Open
Abstract
Cooperative disease defense emerges as group-level collective behavior, yet how group members make the underlying individual decisions is poorly understood. Using garden ants and fungal pathogens as an experimental model, we derive the rules governing individual ant grooming choices and show how they produce colony-level hygiene. Time-resolved behavioral analysis, pathogen quantification, and probabilistic modeling reveal that ants increase grooming and preferentially target highly-infectious individuals when perceiving high pathogen load, but transiently suppress grooming after having been groomed by nestmates. Ants thus react to both, the infectivity of others and the social feedback they receive on their own contagiousness. While inferred solely from momentary ant decisions, these behavioral rules quantitatively predict hour-long experimental dynamics, and synergistically combine into efficient colony-wide pathogen removal. Our analyses show that noisy individual decisions based on only local, incomplete, yet dynamically-updated information on pathogen threat and social feedback can lead to potent collective disease defense.
Collapse
Affiliation(s)
- Barbara Casillas-Pérez
- ISTA (Institute of Science and Technology Austria), Am Campus 1, AT-3400, Klosterneuburg, Austria
| | - Katarína Boďová
- Department of Mathematical Analysis and Numerics, Faculty of Mathematics, Physics, and Informatics, Comenius University, Mlynska Dolina, SK-84248, Bratislava, Slovakia
| | - Anna V Grasse
- ISTA (Institute of Science and Technology Austria), Am Campus 1, AT-3400, Klosterneuburg, Austria
| | - Gašper Tkačik
- ISTA (Institute of Science and Technology Austria), Am Campus 1, AT-3400, Klosterneuburg, Austria.
| | - Sylvia Cremer
- ISTA (Institute of Science and Technology Austria), Am Campus 1, AT-3400, Klosterneuburg, Austria.
| |
Collapse
|
26
|
Caldwell-Harris CL, MacWhinney B. Age effects in second language acquisition: Expanding the emergentist account. BRAIN AND LANGUAGE 2023; 241:105269. [PMID: 37150139 DOI: 10.1016/j.bandl.2023.105269] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/23/2022] [Revised: 04/05/2023] [Accepted: 04/17/2023] [Indexed: 05/09/2023]
Abstract
In 2005, Science magazine designated the problem of accounting for difficulties in L2 (second language) learning as one of the 125 outstanding challenges facing scientific research. A maturationally-based sensitive period has long been the favorite explanation for why ultimate foreign language attainment declines with age-of-acquisition. However, no genetic or neurobiological mechanisms for limiting language learning have yet been identified. At the same time, we know that cognitive, social, and motivational factors change in complex ways across the human lifespan. Emergentist theory provides a framework for relating these changes to variation in the success of L2 learning. The great variability in patterns of learning, attainment, and loss across ages, social groups, and linguistic levels provides the core motivation for the emergentist approach. Our synthesis incorporates three groups of factors which change systematically with age: environmental supports, cognitive abilities, and motivation for language learning. This extended emergentist account explains why and when second language succeeds for some children and adults and fails for others.
Collapse
|
27
|
Samuel G, Stella M, Beaty RE, Kenett YN. Predicting openness to experience via a multiplex cognitive network approach. JOURNAL OF RESEARCH IN PERSONALITY 2023. [DOI: 10.1016/j.jrp.2023.104369] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/29/2023]
|
28
|
Dubourg E, Thouzeau V, de Dampierre C, Mogoutov A, Baumard N. Exploratory preferences explain the human fascination for imaginary worlds in fictional stories. Sci Rep 2023; 13:8657. [PMID: 37246187 DOI: 10.1038/s41598-023-35151-2] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2022] [Accepted: 05/13/2023] [Indexed: 05/30/2023] Open
Abstract
Imaginary worlds are present and often central in many of the most culturally successful modern narrative fictions, be it in novels (e.g., Harry Potter), movies (e.g., Star Wars), video games (e.g., The Legend of Zelda), graphic novels (e.g., One Piece) and TV series (e.g., Game of Thrones). We propose that imaginary worlds are popular because they activate exploratory preferences that evolved to help us navigate the real world and find new fitness-relevant information. Therefore, we hypothesize that the attraction to imaginary worlds is intrinsically linked to the desire to explore novel environments and that both are influenced by the same underlying factors. Notably, the inter-individual and cross-cultural variability of the preference for imaginary worlds should follow the inter-individual and cross-cultural variability of exploratory preferences (with the personality trait Openness-to-experience, age, sex, and ecological conditions). We test these predictions with both experimental and computational methods. For experimental tests, we run a pre-registered online experiment about movie preferences (N = 230). For computational tests, we leverage two large cultural datasets, namely the Internet Movie Database (N = 9424 movies) and the Movie Personality Dataset (N = 3.5 million participants), and use machine-learning algorithms (i.e., random forest and topic modeling). In all, consistent with how the human preference for spatial exploration adaptively varies, we provide empirical evidence that imaginary worlds appeal more to more explorative people, people higher in Openness-to-experience, younger individuals, males, and individuals living in more affluent environments. We discuss the implications of these findings for our understanding of the cultural evolution of narrative fiction and, more broadly, the evolution of human exploratory preferences.
Collapse
Affiliation(s)
- Edgar Dubourg
- Institut Jean Nicod, Département d'études cognitives, Ecole normale supérieure, Université PSL, EHESS, CNRS, Paris, France.
| | - Valentin Thouzeau
- Institut Jean Nicod, Département d'études cognitives, Ecole normale supérieure, Université PSL, EHESS, CNRS, Paris, France
| | - Charles de Dampierre
- Institut Jean Nicod, Département d'études cognitives, Ecole normale supérieure, Université PSL, EHESS, CNRS, Paris, France
| | - Andrei Mogoutov
- Institut Jean Nicod, Département d'études cognitives, Ecole normale supérieure, Université PSL, EHESS, CNRS, Paris, France
| | - Nicolas Baumard
- Institut Jean Nicod, Département d'études cognitives, Ecole normale supérieure, Université PSL, EHESS, CNRS, Paris, France
| |
Collapse
|
29
|
Frankenhuis WE, Gopnik A. Early adversity and the development of explore-exploit tradeoffs. Trends Cogn Sci 2023:S1364-6613(23)00091-8. [PMID: 37142526 DOI: 10.1016/j.tics.2023.04.001] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2023] [Revised: 03/28/2023] [Accepted: 04/05/2023] [Indexed: 05/06/2023]
Abstract
Childhood adversity can have wide-ranging and long-lasting effects on later life. But what are the mechanisms that are responsible for these effects? This article brings together the cognitive science literature on explore-exploit tradeoffs, the empirical literature on early adversity, and the literature in evolutionary biology on 'life history' to explain how early experience influences later life. We propose one potential mechanism: early experiences influence 'hyperparameters' that determine the balance between exploration and exploitation. Adversity might accelerate a shift from exploration to exploitation, with broad and enduring effects on the adult brain and mind. These effects may be produced by life-history adaptations that use early experience to tailor development and learning to the likely future states of an organism and its environment.
Collapse
Affiliation(s)
- Willem E Frankenhuis
- Department of Psychology, Utrecht University, Utrecht, The Netherlands; Max Planck Institute for the Study of Crime, Security and Law, Freiburg, Germany.
| | - Alison Gopnik
- Department of Psychology and Berkeley Artificial Intelligence Research, University of California at Berkeley, CA, USA
| |
Collapse
|
30
|
Speers LJ, Bilkey DK. Maladaptive explore/exploit trade-offs in schizophrenia. Trends Neurosci 2023; 46:341-354. [PMID: 36878821 DOI: 10.1016/j.tins.2023.02.001] [Citation(s) in RCA: 3] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/09/2022] [Revised: 01/30/2023] [Accepted: 02/08/2023] [Indexed: 03/07/2023]
Abstract
Schizophrenia is a complex disorder that remains poorly understood, particularly at the systems level. In this opinion article we argue that the explore/exploit trade-off concept provides a holistic and ecologically valid framework to resolve some of the apparent paradoxes that have emerged within schizophrenia research. We review recent evidence suggesting that fundamental explore/exploit behaviors may be maladaptive in schizophrenia during physical, visual, and cognitive foraging. We also describe how theories from the broader optimal foraging literature, such as the marginal value theorem (MVT), could provide valuable insight into how aberrant processing of reward, context, and cost/effort evaluations interact to produce maladaptive responses.
Collapse
Affiliation(s)
- Lucinda J Speers
- Department of Psychology, University of Otago, Dunedin 9016, New Zealand
| | - David K Bilkey
- Department of Psychology, University of Otago, Dunedin 9016, New Zealand.
| |
Collapse
|
31
|
Galesic M, Barkoczi D, Berdahl AM, Biro D, Carbone G, Giannoccaro I, Goldstone RL, Gonzalez C, Kandler A, Kao AB, Kendal R, Kline M, Lee E, Massari GF, Mesoudi A, Olsson H, Pescetelli N, Sloman SJ, Smaldino PE, Stein DL. Beyond collective intelligence: Collective adaptation. J R Soc Interface 2023; 20:20220736. [PMID: 36946092 PMCID: PMC10031425 DOI: 10.1098/rsif.2022.0736] [Citation(s) in RCA: 8] [Impact Index Per Article: 8.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/08/2022] [Accepted: 02/27/2023] [Indexed: 03/23/2023] Open
Abstract
We develop a conceptual framework for studying collective adaptation in complex socio-cognitive systems, driven by dynamic interactions of social integration strategies, social environments and problem structures. Going beyond searching for 'intelligent' collectives, we integrate research from different disciplines and outline modelling approaches that can be used to begin answering questions such as why collectives sometimes fail to reach seemingly obvious solutions, how they change their strategies and network structures in response to different problems and how we can anticipate and perhaps change future harmful societal trajectories. We discuss the importance of considering path dependence, lack of optimization and collective myopia to understand the sometimes counterintuitive outcomes of collective adaptation. We call for a transdisciplinary, quantitative and societally useful social science that can help us to understand our rapidly changing and ever more complex societies, avoid collective disasters and reach the full potential of our ability to organize in adaptive collectives.
Collapse
Affiliation(s)
- Mirta Galesic
- Santa Fe Institute, Santa Fe, NM 87501, USA
- Complexity Science Hub Vienna, 1080 Vienna, Austria
- Vermont Complex Systems Center, University of Vermont, Burlington, VM 05405, USA
| | | | - Andrew M. Berdahl
- School of Aquatic and Fishery Sciences, University of Washington, Seattle, WA 98195, USA
| | - Dora Biro
- Department of Zoology, University of Oxford, Oxford OX1 3PS, UK
| | - Giuseppe Carbone
- Department of Mechanics, Mathematics and Management, Politecnico di Bari, Bari 70125, Italy
| | - Ilaria Giannoccaro
- Department of Mechanics, Mathematics and Management, Politecnico di Bari, Bari 70125, Italy
| | - Robert L. Goldstone
- Psychological and Brain Sciences, Indiana University, Bloomington, IN 47405, USA
| | - Cleotilde Gonzalez
- Department of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA 15213, USA
| | - Anne Kandler
- Department of Mathematics, Max-Planck-Institute for Evolutionary Anthropology, Leipzig 04103, Germany
| | - Albert B. Kao
- Santa Fe Institute, Santa Fe, NM 87501, USA
- Biology Department, University of Massachusetts Boston, Boston, MA 02125, USA
| | - Rachel Kendal
- Centre for Coevolution of Biology and Culture, Durham University, Anthropology Department, Durham, DH1 3LE, UK
| | - Michelle Kline
- Centre for Culture and Evolution, Division of Psychology, Brunel University London, Uxbridge, UB8 3PH, UK
| | - Eun Lee
- Department of Scientific Computing, Pukyong National University, 45 Yongso-ro, Nam-gu, Busan, 48513, Republic of Korea
| | | | - Alex Mesoudi
- Department of Ecology and Conservation, University of Exeter, Penryn TR10 9FE, UK
| | | | | | - Sabina J. Sloman
- Department of Social and Decision Sciences, Carnegie Mellon University, Pittsburgh, PA 15213, USA
- Department of Computer Science, University of Manchester, Manchester, M13 9PL, UK
| | - Paul E. Smaldino
- Santa Fe Institute, Santa Fe, NM 87501, USA
- Department of Cognitive and Information Sciences, University of California, Merced, CA 95343, USA
| | - Daniel L. Stein
- Santa Fe Institute, Santa Fe, NM 87501, USA
- Department of Physics and Courant Institute of Mathematical Sciences, New York University, New York, NY 10012, USA
| |
Collapse
|
32
|
Drew T, Konold CE, Lavelle M, Brunyé TT, Kerr KF, Shucard H, Weaver DL, Elmore JG. Pathologist pupil dilation reflects experience level and difficulty in diagnosing medical images. J Med Imaging (Bellingham) 2023; 10:025503. [PMID: 37096053 PMCID: PMC10122150 DOI: 10.1117/1.jmi.10.2.025503] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/27/2022] [Revised: 03/26/2023] [Accepted: 04/10/2023] [Indexed: 04/26/2023] Open
Abstract
Purpose: Digital whole slide imaging allows pathologists to view slides on a computer screen instead of under a microscope. Digital viewing allows for real-time monitoring of pathologists' search behavior and neurophysiological responses during the diagnostic process. One particular neurophysiological measure, pupil diameter, could provide a basis for evaluating clinical competence during training or developing tools that support the diagnostic process. Prior research shows that pupil diameter is sensitive to cognitive load and arousal, and it switches between exploration and exploitation of a visual image. Different categories of lesions in pathology pose different levels of challenge, as indicated by diagnostic disagreement among pathologists. If pupil diameter is sensitive to the perceived difficulty in diagnosing biopsies, eye-tracking could potentially be used to identify biopsies that may benefit from a second opinion. Approach: We measured case onset baseline-corrected (phasic) and uncorrected (tonic) pupil diameter in 90 pathologists who each viewed and diagnosed 14 digital breast biopsy cases that cover the diagnostic spectrum from benign to invasive breast cancer. Pupil data were extracted from the beginning of viewing and interpreting of each individual case. After removing 122 trials ( < 10 % ) with poor eye-tracking quality, 1138 trials remained. We used multiple linear regression with robust standard error estimates to account for dependent observations within pathologists. Results: We found a positive association between the magnitude of phasic dilation and subject-centered difficulty ratings and between the magnitude of tonic dilation and untransformed difficulty ratings. When controlling for case diagnostic category, only the tonic-difficulty relationship persisted. Conclusions: Results suggest that tonic pupil dilation may indicate overall arousal differences between pathologists as they interpret biopsy cases and could signal a need for additional training, experience, or automated decision aids. Phasic dilation is sensitive to characteristics of biopsies that tend to elicit higher difficulty ratings and could indicate a need for a second opinion.
Collapse
Affiliation(s)
- Trafton Drew
- University of Utah, Department of Psychology, Salt Lake City, Utah, United States
| | - Catherine E. Konold
- University of Utah, Department of Psychology, Salt Lake City, Utah, United States
| | - Mark Lavelle
- University of New Mexico, Department of Psychology, Albuquerque, New Mexico, United States
| | - Tad T. Brunyé
- Tufts University, Center for Applied Brain and Cognitive Sciences, Medford, Massachusetts, United States
| | - Kathleen F. Kerr
- University of Washington, Department of Biostatistics, Seattle, Washington, United States
| | - Hannah Shucard
- University of Washington, Department of Biostatistics, Seattle, Washington, United States
| | - Donald L. Weaver
- University of Vermont, Department of Pathology & Laboratory Medicine, Burlington, Vermont, United States
| | - Joann G. Elmore
- David Geffen School of Medicine UCLA, Department of Medicine, Los Angeles, California, United States
| |
Collapse
|
33
|
Kurth-Nelson Z, Behrens T, Wayne G, Miller K, Luettgau L, Dolan R, Liu Y, Schwartenbeck P. Replay and compositional computation. Neuron 2023; 111:454-469. [PMID: 36640765 DOI: 10.1016/j.neuron.2022.12.028] [Citation(s) in RCA: 7] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/29/2022] [Revised: 08/11/2022] [Accepted: 12/18/2022] [Indexed: 01/15/2023]
Abstract
Replay in the brain has been viewed as rehearsal or, more recently, as sampling from a transition model. Here, we propose a new hypothesis: that replay is able to implement a form of compositional computation where entities are assembled into relationally bound structures to derive qualitatively new knowledge. This idea builds on recent advances in neuroscience, which indicate that the hippocampus flexibly binds objects to generalizable roles and that replay strings these role-bound objects into compound statements. We suggest experiments to test our hypothesis, and we end by noting the implications for AI systems which lack the human ability to radically generalize past experience to solve new problems.
Collapse
Affiliation(s)
- Zeb Kurth-Nelson
- DeepMind, London, UK; Max Planck UCL Centre for Computational Psychiatry and Ageing Research, London, UK.
| | - Timothy Behrens
- Wellcome Centre for Human Neuroimaging, University College London, London, UK; Wellcome Centre for Integrative Neuroimaging, University of Oxford, Oxford, UK
| | | | - Kevin Miller
- DeepMind, London, UK; Institute of Ophthalmology, University College London, London, UK
| | - Lennart Luettgau
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, London, UK
| | - Ray Dolan
- Max Planck UCL Centre for Computational Psychiatry and Ageing Research, London, UK; Wellcome Centre for Human Neuroimaging, University College London, London, UK
| | - Yunzhe Liu
- State Key Laboratory of Cognitive Neuroscience and Learning, IDG/McGovern Institute for Brain Research, Beijing Normal University, Beijing, China; Chinese Institute for Brain Research, Beijing, China
| | - Philipp Schwartenbeck
- Max Planck Institute for Biological Cybernetics, Tubingen, Germany; University of Tubingen, Tubingen, Germany
| |
Collapse
|
34
|
Olsen K, Tylén K. On the social nature of abstraction: cognitive implications of interaction and diversity. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210361. [PMID: 36571125 PMCID: PMC9791485 DOI: 10.1098/rstb.2021.0361] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Accepted: 05/28/2022] [Indexed: 12/27/2022] Open
Abstract
The human capacity for abstraction is remarkable. We effortlessly form abstract representations from varied experiences, generalizing and flexibly transferring experiences and knowledge between contexts, which can facilitate reasoning, problem solving and learning across many domains. The cognitive process of abstraction, however, is often portrayed and investigated as an individual process. This paper addresses how cognitive processes of abstraction-together with other aspects of human reasoning and problem solving-are fundamentally shaped and modulated by online social interaction. Starting from a general distinction between convergent thinking, divergent thinking and processes of abstraction, we address how social interaction shapes information processing differently depending on cognitive demands, social coordination and task ecologies. In particular, we suggest that processes of abstraction are facilitated by the interactive sharing and integration of varied individual experiences. To this end, we also discuss how the dynamics of group interactions vary as a function of group composition; that is, in terms of the similarity and diversity between the group members. We conclude by outlining the role of cognitive diversity in interactive processes and consider the importance of group diversity in processes of abstraction. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.
Collapse
Affiliation(s)
- Karsten Olsen
- The Interacting Minds Centre, Aarhus University, 8000 Aarhus, Denmark
- Department for Linguistics, Cognitive Science, and Semiotics, Aarhus University, 8000 Aarhus, Denmark
| | - Kristian Tylén
- The Interacting Minds Centre, Aarhus University, 8000 Aarhus, Denmark
- Department for Linguistics, Cognitive Science, and Semiotics, Aarhus University, 8000 Aarhus, Denmark
| |
Collapse
|
35
|
Karmazyn-Raz H, Smith LB. Sampling statistics are like story creation: a network analysis of parent-toddler exploratory play. Philos Trans R Soc Lond B Biol Sci 2023; 378:20210358. [PMID: 36571129 PMCID: PMC9791483 DOI: 10.1098/rstb.2021.0358] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/14/2022] [Accepted: 09/04/2022] [Indexed: 12/27/2022] Open
Abstract
Actions in the world elicit data for learning and do so in a stream of interconnected events. Here, we provide evidence on how toddlers with their parent sample information by acting on toys during exploratory play. We observed 10 min of free-flowing and unconstrained object exploration of by toddlers (mean age 21 months) and parents in a room with many available objects (n = 32). Borrowing concepts and measures from the study of narratives, we found that the toy selections are not a string of unrelated events but exhibit a suite of what we call coherence statistics: Zipfian distributions, burstiness and a network structure. We discuss the transient memory processes that underlie the moment-to-moment toy selections that create this coherence and the role of these statistics in the development of abstract and generalizable systems of knowledge. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.
Collapse
Affiliation(s)
- Hadar Karmazyn-Raz
- Psychological and Brain Sciences, Indiana University, Bloomington, IN 47401, USA
| | - Linda B. Smith
- Psychological and Brain Sciences, Indiana University, Bloomington, IN 47401, USA
| |
Collapse
|
36
|
Narrowing the coordination solution space during motor learning standardizes individual patterns of search strategy but diversifies learning rates. Sci Rep 2023; 13:2009. [PMID: 36737655 PMCID: PMC9898268 DOI: 10.1038/s41598-023-29238-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Accepted: 02/01/2023] [Indexed: 02/05/2023] Open
Abstract
Constraints on practice can benefit motor learning by guiding the learner towards efficient coordination patterns, but can also narrow the potential solution space of coordination and control. The aim of this paper was to investigate whether narrowing the solution space through more restrictive task constraints limits the expression of potential exploratory behaviours during the learning process, identified using Drifting Markov Models. In a breaststroke swimming task, the change in interlimb coordination of 7 learners practicing for 16 lessons over 2 months was analysed to quantify motor exploration and identify periods of metastable regimes of coordination. Results showed that the observed exploratory dynamics were highly individual both in terms of range of exploration and in the patterns of search. The more restrictive task constraints did not impair the amount of exploration but rather channelled the exploration around a few selected patterns. In addition, restraining the nature of the exploratory process increased the inter-individual differences of the learning rate. Although manipulating the task constraints during learning can help learners to escape from the behavioural consequences of their intrinsic dynamics, maintaining a broad solution space for a diversity of coordination patterns to emerge was key to fostering effective exploration of individual coordination solutions.
Collapse
|
37
|
Subach A, Avidov B, Dorfman A, Bega D, Gilad T, Kvetny M, Reshef MH, Foitzik S, Scharf I. The value of spatial experience and group size for ant colonies in direct competition. INSECT SCIENCE 2023; 30:241-250. [PMID: 35696548 PMCID: PMC10084317 DOI: 10.1111/1744-7917.13090] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 03/14/2022] [Revised: 05/30/2022] [Accepted: 05/31/2022] [Indexed: 06/15/2023]
Abstract
Animals often search for food more efficiently with experience. However, the contribution of experience to foraging success under direct competition has rarely been examined. Here we used colonies of an individually foraging desert ant to investigate the value of spatial experience. First, we trained worker groups of equal numbers to solve either a complex or a simple maze. We then tested pairs of both groups against one another in reaching a food reward. This task required solving the same complex maze that one of the groups had been trained in, to determine which group would exploit better the food reward. The worker groups previously trained in the complex mazes reached the food reward faster and more of these workers fed on the food than those trained in simple mazes, but only in the intermediate size group. To determine the relative importance of group size versus spatial experience in exploiting food patches, we then tested smaller trained worker groups against larger untrained ones. The larger groups outcompeted the smaller ones, despite the latter's advantage of spatial experience. The contribution of spatial experience, as found here, appears to be small, and depends on group size: an advantage of a few workers of the untrained group over the trained group negates its benefits.
Collapse
Affiliation(s)
- Aziz Subach
- School of ZoologyGeorge S. Wise Faculty of Life SciencesTel Aviv UniversityTel AvivIsrael
| | - Bar Avidov
- School of ZoologyGeorge S. Wise Faculty of Life SciencesTel Aviv UniversityTel AvivIsrael
| | - Arik Dorfman
- School of ZoologyGeorge S. Wise Faculty of Life SciencesTel Aviv UniversityTel AvivIsrael
| | - Darar Bega
- School of ZoologyGeorge S. Wise Faculty of Life SciencesTel Aviv UniversityTel AvivIsrael
| | - Tomer Gilad
- School of ZoologyGeorge S. Wise Faculty of Life SciencesTel Aviv UniversityTel AvivIsrael
| | - Mark Kvetny
- Department of GeophysicsFaculty of Exact SciencesTel Aviv UniversityTel AvivIsrael
| | - May Hershkovitz Reshef
- School of ZoologyGeorge S. Wise Faculty of Life SciencesTel Aviv UniversityTel AvivIsrael
| | - Susanne Foitzik
- Institute of Organismic and Molecular EvolutionJohannes Gutenberg University MainzMainzGermany
| | - Inon Scharf
- School of ZoologyGeorge S. Wise Faculty of Life SciencesTel Aviv UniversityTel AvivIsrael
| |
Collapse
|
38
|
A Single-Pheromone Model Accounts for Empirical Patterns of Ant Colony Foraging Previously Modeled Using Two Pheromones. COGN SYST RES 2023. [DOI: 10.1016/j.cogsys.2023.02.005] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/18/2023]
|
39
|
Bergenholtz C, Vuculescu O, Amidi A. Microfoundations of Adaptive Search in Complex Tasks: The Role of Cognitive Abilities and Styles. ORGANIZATION SCIENCE 2023. [DOI: 10.1287/orsc.2023.1654] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/29/2023]
Abstract
Problem-solving in complex environments requires a cognitively demanding search for task solutions. Managing this search process presents a major challenge in organizations. We contribute to the literature on this topic by providing new evidence on the cognitive antecedents that shape how individuals search when engaged in complex problem-solving tasks. We present results from three laboratory studies, wherein 335 individuals solved a complex task. In doing so, they generated behavioral data coupled with survey-based measurements of the individuals’ cognitive styles and performance-based tests of their cognitive abilities. Our data analysis contributes to the current literature by documenting systematic heterogeneity in the persistence and distance of search that can be explained by the participants’ level of creativity, attention to detail, and executive functions. We extend the research on the microfoundations of adaptive search by linking cognitive antecedents with a complex search task, widening our insight into what search behavior certain cognitive microfoundations lead to, and showing how managers can more effectively shape organizational search. History: This paper has been accepted for the Organization Science Special Issue on Experiments in Organizational Theory. Supplemental Material: The online appendix is available at https://doi.org/10.1287/orsc.2023.1654 .
Collapse
Affiliation(s)
| | - Oana Vuculescu
- Department of Management, Aarhus University, Aarhus, Denmark
| | - Ali Amidi
- Department of Psychology and Behavioural Sciences, Aarhus University, Aarhus, Denmark
| |
Collapse
|
40
|
Kenett YN, Humphries S, Chatterjee A. A Thirst for Knowledge: Grounding Curiosity, Creativity, and Aesthetics in Memory and Reward Neural Systems. CREATIVITY RESEARCH JOURNAL 2023. [DOI: 10.1080/10400419.2023.2165748] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 01/28/2023]
Affiliation(s)
- Yoed N. Kenett
- Technion - Faculty of Data and Decision Sciences, Israel Institute of Technology, Haifa, Israel
| | | | | |
Collapse
|
41
|
Goudar V, Kim JW, Liu Y, Dede AJO, Jutras MJ, Skelin I, Ruvalcaba M, Chang W, Fairhall AL, Lin JJ, Knight RT, Buffalo EA, Wang XJ. Comparing rapid rule-learning strategies in humans and monkeys. BIORXIV : THE PREPRINT SERVER FOR BIOLOGY 2023:2023.01.10.523416. [PMID: 36711889 PMCID: PMC9882042 DOI: 10.1101/2023.01.10.523416] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Indexed: 06/18/2023]
Abstract
Inter-species comparisons are key to deriving an understanding of the behavioral and neural correlates of human cognition from animal models. We perform a detailed comparison of macaque monkey and human strategies on an analogue of the Wisconsin Card Sort Test, a widely studied and applied multi-attribute measure of cognitive function, wherein performance requires the inference of a changing rule given ambiguous feedback. We found that well-trained monkeys rapidly infer rules but are three times slower than humans. Model fits to their choices revealed hidden states akin to feature-based attention in both species, and decision processes that resembled a Win-stay lose-shift strategy with key differences. Monkeys and humans test multiple rule hypotheses over a series of rule-search trials and perform inference-like computations to exclude candidates. An attention-set based learning stage categorization revealed that perseveration, random exploration and poor sensitivity to negative feedback explain the under-performance in monkeys.
Collapse
Affiliation(s)
- Vishwa Goudar
- Center for Neural Science, New York University, NY, USA
| | - Jeong-Woo Kim
- Center for Neural Science, New York University, NY, USA
| | - Yue Liu
- Center for Neural Science, New York University, NY, USA
| | - Adam J. O. Dede
- Department of Physiology and Biophysics, University of Washington, Seattle, WA, USA
| | - Michael J. Jutras
- Department of Physiology and Biophysics, University of Washington, Seattle, WA, USA
| | - Ivan Skelin
- Department of Neurology, University of California, Davis, Davis, CA, USA
- The Center for Mind and Brain, University of California, Davis, Davis, CA, USA
| | - Michael Ruvalcaba
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA, USA
| | - William Chang
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA, USA
| | - Adrienne L. Fairhall
- Department of Physiology and Biophysics, University of Washington, Seattle, WA, USA
| | - Jack J. Lin
- Department of Neurology, University of California, Davis, Davis, CA, USA
- The Center for Mind and Brain, University of California, Davis, Davis, CA, USA
| | - Robert T. Knight
- Department of Psychology, University of California Berkeley, Berkeley, CA, USA
- Helen Wills Neuroscience Institute, University of California Berkeley, Berkeley, CA, USA
| | - Elizabeth A. Buffalo
- Department of Physiology and Biophysics, University of Washington, Seattle, WA, USA
- Washington Primate Research Center, University of Washington, Seattle, WA, USA
| | | |
Collapse
|
42
|
Luthra M, Todd PM. Social Search and Resource Clustering as Emergent Stable States. ARTIFICIAL LIFE 2023; 29:118-140. [PMID: 36264224 DOI: 10.1162/artl_a_00391] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/16/2023]
Abstract
Social search has stably evolved across various species and is often used by humans to search for resources (such as food, information, social partners). In turn, these resources frequently come distributed in patches or clusters. In the current work, we use an ecologically inspired agent-based model to investigate whether social search and clustering are stable outcomes of the dynamical mutual interactions between the two. While previous research has studied unidirectional influences of social search on resource clustering and vice versa, the current work investigates the consequential patterns emerging from their two-way interactions over time. In our model, consumers evolved search strategies (ranging from competitive to social) as adaptations to their environmental resource structures, and resources varied in distributions (ranging from random to clustered) that were shaped by agents' consumption patterns. Across four experiments, we systematically analyzed the patterns of influence that search strategies and environment structure have on each other to identify stable attractor states of both. In Experiment 1, we fixed resource clustering at various levels and observed its influence on social search, and in Experiment 2, we observed the influence of social search on resource distribution. In both these experiments we found that increasing levels of one variable produced increases in the other; however, at very high levels of the manipulated variable, the dependent variable tended to fall. Finally in Experiments 3 and 4, we studied the dynamics that arose when resource clustering and social search could both change and mutually influence each other, finding that low levels of social search and clustering were stable attractor states. Our simple 2D model yielded results that qualitatively resemble those across a wide range of search domains (from physical search for food to abstract search for information), highlighting some stable outcomes of mutually interacting consumer/resource systems.
Collapse
Affiliation(s)
- Mahi Luthra
- Indiana University Bloomington, Cognitive Science Program, Department of Psychological and Brain Sciences.
| | - Peter M Todd
- Indiana University Bloomington, Cognitive Science Program, Department of Psychological and Brain Sciences
| |
Collapse
|
43
|
Stella M, Swanson TJ, Li Y, Hills TT, Teixeira AS. Cognitive networks detect structural patterns and emotional complexity in suicide notes. Front Psychol 2022; 13:917630. [PMID: 36570999 PMCID: PMC9773561 DOI: 10.3389/fpsyg.2022.917630] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/11/2022] [Accepted: 11/17/2022] [Indexed: 12/13/2022] Open
Abstract
Communicating one's mindset means transmitting complex relationships between concepts and emotions. Using network science and word co-occurrences, we reconstruct conceptual associations as communicated in 139 genuine suicide notes, i.e., notes left by individuals who took their lives. We find that, despite their negative context, suicide notes are surprisingly positively valenced. Through emotional profiling, their ending statements are found to be markedly more emotional than their main body: The ending sentences in suicide notes elicit deeper fear/sadness but also stronger joy/trust and anticipation than the main body. Furthermore, by using data from the Emotional Recall Task, we model emotional transitions within these notes as co-occurrence networks and compare their structure against emotional recalls from mentally healthy individuals. Supported by psychological literature, we introduce emotional complexity as an affective analog of structural balance theory, measuring how elementary cycles (closed triads) of emotion co-occurrences mix positive, negative and neutral states in narratives and recollections. At the group level, authors of suicide narratives display a higher complexity than healthy individuals, i.e., lower levels of coherently valenced emotional states in triads. An entropy measure identified a similar tendency for suicide notes to shift more frequently between contrasting emotional states. Both the groups of authors of suicide notes and healthy individuals exhibit less complexity than random expectation. Our results demonstrate that suicide notes possess highly structured and contrastive narratives of emotions, more complex than expected by null models and healthy populations.
Collapse
Affiliation(s)
- Massimo Stella
- CogNosco Lab, Department of Computer Science, University of Exeter, Exeter, United Kingdom,*Correspondence: Massimo Stella
| | - Trevor J. Swanson
- Department of Psychology, University of Kansas, Lawrence, KS, United States
| | - Ying Li
- Max Planck Institute for Human Development, Berlin, Germany,Institute of Psychology, Chinese Academy of Sciences, Beijing, China,Ying Li
| | - Thomas T. Hills
- Department of Psychology, University of Warwick, Coventry, United Kingdom
| | - Andreia S. Teixeira
- LASIGE, Departamento de Informática, Faculdade de Ciências, Universidade de Lisboa, Lisbon, Portugal,INESC-ID, Lisbon, Portugal
| |
Collapse
|
44
|
McNamee DC, Stachenfeld KL, Botvinick MM, Gershman SJ. Compositional Sequence Generation in the Entorhinal-Hippocampal System. ENTROPY (BASEL, SWITZERLAND) 2022; 24:1791. [PMID: 36554196 PMCID: PMC9778317 DOI: 10.3390/e24121791] [Citation(s) in RCA: 2] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 06/08/2022] [Revised: 11/01/2022] [Accepted: 11/29/2022] [Indexed: 06/17/2023]
Abstract
Neurons in the medial entorhinal cortex exhibit multiple, periodically organized, firing fields which collectively appear to form an internal representation of space. Neuroimaging data suggest that this grid coding is also present in other cortical areas such as the prefrontal cortex, indicating that it may be a general principle of neural functionality in the brain. In a recent analysis through the lens of dynamical systems theory, we showed how grid coding can lead to the generation of a diversity of empirically observed sequential reactivations of hippocampal place cells corresponding to traversals of cognitive maps. Here, we extend this sequence generation model by describing how the synthesis of multiple dynamical systems can support compositional cognitive computations. To empirically validate the model, we simulate two experiments demonstrating compositionality in space or in time during sequence generation. Finally, we describe several neural network architectures supporting various types of compositionality based on grid coding and highlight connections to recent work in machine learning leveraging analogous techniques.
Collapse
Affiliation(s)
- Daniel C. McNamee
- Neuroscience Programme, Champalimaud Research, 1400-038 Lisbon, Portugal
| | | | - Matthew M. Botvinick
- Google DeepMind, London N1C 4DN, UK
- Gatsby Computational Neuroscience Unit, University College London, London W1T 4JG, UK
| | - Samuel J. Gershman
- Department of Psychology and Center for Brain Science, Harvard University, Cambridge, MA 02138, USA
- Center for Brains, Minds and Machines, MIT, Cambridge, MA 02139, USA
| |
Collapse
|
45
|
Rastelli C, Greco A, De Pisapia N, Finocchiaro C. Balancing novelty and appropriateness leads to creative associations in children. PNAS NEXUS 2022; 1:pgac273. [PMID: 36712330 PMCID: PMC9802071 DOI: 10.1093/pnasnexus/pgac273] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 05/18/2022] [Accepted: 12/01/2022] [Indexed: 12/05/2022]
Abstract
Creative problem solving is a fundamental skill of human cognition and is conceived as a search process whereby a novel and appropriate solution is generated. However, it is unclear whether children are able to balance novelty and appropriateness to generate creative solutions and what are the underlying computational mechanisms. Here, we asked children, ranging from 10 to 11 years old, to perform a word association task according to three instructions, which triggered a more appropriate (ordinary), novel (random), or balanced (creative) response. Results revealed that children exhibited greater cognitive flexibility in the creative condition compared to the control conditions, as revealed by the structure and resiliency of the semantic networks. Moreover, responses' word embeddings extracted from pretrained deep neural networks showed that semantic distance and category switching index increased in the creative condition with respect to the ordinary condition and decreased compared to the random condition. Critically, we showed how children efficiently solved the exploration/exploitation trade-off to generate creative associations by fitting a computational reinforcement learning (RL) model that simulates semantic search strategies. Our findings provide compelling evidence that children balance novelty and appropriateness to generate creative associations by optimally regulating the level of exploration in the semantic search. This corroborates previous findings on the adult population and highlights the crucial contribution of both components to the overall creative process. In conclusion, these results shed light on the connections between theoretical concepts such as bottom-up/top-down modes of thinking in creativity research and the exploration/exploitation trade-off in human RL research.
Collapse
Affiliation(s)
| | - Antonino Greco
- MEG Center, University of Tübingen, 72076 Tübingen, Germany,Department of Neural Dynamics and Magnetoencephalography, Hertie Institute for Clinical Brain Research, University of Tübingen, 72076 Tübingen, Germany,Werner Reichardt Center for Integrative Neuroscience, University of Tübingen, 72076 Tübingen, Germany
| | - Nicola De Pisapia
- Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto, Italy
| | - Chiara Finocchiaro
- Department of Psychology and Cognitive Science, University of Trento, 38068 Rovereto, Italy
| |
Collapse
|
46
|
Ibáñez de Aldecoa P, Burdett E, Gustafsson E. Riding the elephant in the room: Towards a revival of the optimal level of stimulation model. DEVELOPMENTAL REVIEW 2022. [DOI: 10.1016/j.dr.2022.101051] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
|
47
|
Nordli SA, Todd PM. Embodied and embedded ecological rationality: A common vertebrate mechanism for action selection underlies cognition and heuristic decision-making in humans. Front Psychol 2022; 13:841972. [DOI: 10.3389/fpsyg.2022.841972] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/23/2021] [Accepted: 10/24/2022] [Indexed: 11/18/2022] Open
Abstract
The last common ancestor shared by humans and other vertebrates lived over half a billion years ago. In the time since that ancestral line diverged, evolution by natural selection has produced an impressive diversity—from fish to birds to elephants—of vertebrate morphology; yet despite the great species-level differences that otherwise exist across the brains of many animals, the neural circuitry that underlies motor control features a functional architecture that is virtually unchanged in every living species of vertebrate. In this article, we review how that circuitry facilitates motor control, trial-and-error-based procedural learning, and habit formation; we then develop a model that describes how this circuitry (embodied in an agent) works to build and refine sequences of goal-directed actions that are molded to fit the structure of the environment (in which the agent is embedded). We subsequently review evidence suggesting that this same functional circuitry became further adapted to regulate cognitive control in humans as well as motor control; then, using examples of heuristic decision-making from the ecological rationality tradition, we show how the model can be used to understand how that circuitry operates analogously in both cognitive and motor domains. We conclude with a discussion of how the model encourages a shift in perspective regarding ecological rationality’s “adaptive toolbox”—namely, to one that views heuristic processes and other forms of goal-directed cognition as likely being implemented by the same neural circuitry (and in the same fashion) as goal-directed action in the motor domain—and how this change of perspective can be useful.
Collapse
|
48
|
Cao A, Raz G, Saxe R, Frank MC. Habituation Reflects Optimal Exploration Over Noisy Perceptual Samples. Top Cogn Sci 2022; 15:290-302. [PMID: 36322897 DOI: 10.1111/tops.12631] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/15/2022] [Revised: 10/14/2022] [Accepted: 10/14/2022] [Indexed: 11/06/2022]
Abstract
From birth, humans constantly make decisions about what to look at and for how long. Yet, the mechanism behind such decision-making remains poorly understood. Here, we present the rational action, noisy choice for habituation (RANCH) model. RANCH is a rational learning model that takes noisy perceptual samples from stimuli and makes sampling decisions based on expected information gain (EIG). The model captures key patterns of looking time documented in developmental research: habituation and dishabituation. We evaluated the model with adult looking time collected from a paradigm analogous to the infant habituation paradigm. We compared RANCH with baseline models (no learning model, no perceptual noise model) and models with alternative linking hypotheses (Surprisal, KL divergence). We showed that (1) learning and perceptual noise are critical assumptions of the model, and (2) Surprisal and KL are good proxies for EIG under the current learning context.
Collapse
Affiliation(s)
- Anjie Cao
- Department of Psychology Stanford University
| | - Gal Raz
- Department of Brain and Cognitive Sciences Massachussetts Institute of Technology
| | - Rebecca Saxe
- Department of Brain and Cognitive Sciences Massachussetts Institute of Technology
| | | |
Collapse
|
49
|
Centola D. The network science of collective intelligence. Trends Cogn Sci 2022; 26:923-941. [PMID: 36180361 DOI: 10.1016/j.tics.2022.08.009] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/11/2022] [Revised: 07/30/2022] [Accepted: 08/18/2022] [Indexed: 01/12/2023]
Abstract
In the last few years, breakthroughs in computational and experimental techniques have produced several key discoveries in the science of networks and human collective intelligence. This review presents the latest scientific findings from two key fields of research: collective problem-solving and the wisdom of the crowd. I demonstrate the core theoretical tensions separating these research traditions and show how recent findings offer a new synthesis for understanding how network dynamics alter collective intelligence, both positively and negatively. I conclude by highlighting current theoretical problems at the forefront of research on networked collective intelligence, as well as vital public policy challenges that require new research efforts.
Collapse
Affiliation(s)
- Damon Centola
- Annenberg School for Communication, University of Pennsylvania, Philadelphia, PA 19104, USA; School of Engineering and Applied Sciences, University of Pennsylvania, Philadelphia, PA 19104, USA; Department of Sociology, University of Pennsylvania, Philadelphia, PA 19104, USA; Network Dynamics Group, University of Pennsylvania, Philadelphia, PA 19104, USA.
| |
Collapse
|
50
|
Huang S, Lu W, Bu Y, Huang Y. Revisiting the exploration-exploitation behavior of scholars' research topic selection: Evidence from a large-scale bibliographic database. Inf Process Manag 2022. [DOI: 10.1016/j.ipm.2022.103110] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/17/2022]
|