Childhood as a solution to explore-exploit tensions

Balancing exploration and exploitation? The impact of cost and inhibitory control on information gathering in early childhood

The information-seeking behaviour of adults focuses on optimizing the gathering and utilizing information to minimize search costs. In contrast, children tend to engage in information search during decision-making with less consideration for costs. This difference in behaviour is believed to be linked to the development of executive functions. Therefore, the present study aimed to investigate the relationship between executive function and cost-related information-gathering behaviour. We assessed 56 children aged 4-6 years, involving three tasks: an information-gathering task, an inhibitory control and a working memory task. In the information-gathering task, children participated in both non-cost and cost conditions, where they were given the opportunity to freely gather information or incur a cost to acquire information. The findings revealed that children with higher inhibitory control tended to gather less information when a cost was involved. This highlights the important role of inhibitory control in shaping information-seeking behaviour in early childhood.

Preschoolers use probabilistic evidence to flexibly change or maintain expectations on an active search task

This study investigated 3- to 5-year-olds' (N = 64, 37 girls, 62.5% White, data collected between 2021-2022) ability to use probabilistic information gleaned through active search to appropriately change or maintain expectations. In an online fishing game, children first learned that one of two ponds was good for catching fish. During a subsequent testing phase, children searched the ponds for fish. Half saw outcomes that were probabilistically consistent with training, and the other half saw outcomes that were probabilistically inconsistent. Children in the Inconsistent condition adapted their search strategies, showing evidence of changing their expectations. Those in the Consistent condition maintained their initial search strategy. Trial-by-trial analyses suggested that children used a combination of heuristic and information integration strategies to guide their search behavior.

Architectural styles of curiosity in global Wikipedia mobile app readership

Intrinsically motivated information seeking is an expression of curiosity believed to be central to human nature. However, most curiosity research relies on small, Western convenience samples. Here, we analyze a naturalistic population of 482,760 readers using Wikipedia's mobile app in 14 languages from 50 countries or territories. By measuring the structure of knowledge networks constructed by readers weaving a thread through articles in Wikipedia, we replicate two styles of curiosity previously identified in laboratory studies: the nomadic "busybody" and the targeted "hunter." Further, we find evidence for another style-the "dancer"-which was previously predicted by a historico-philosophical examination of texts over two millennia and is characterized by creative modes of knowledge production. We identify associations, globally, between the structure of knowledge networks and population-level indicators of spatial navigation, education, mood, well-being, and inequality. These results advance our understanding of Wikipedia's global readership and demonstrate how cultural and geographical properties of the digital environment relate to different styles of curiosity.

How adolescents learn to build social bonds: A developmental computational account of social explore-exploit decision-making

Building social bonds is a critical task of adolescence that affords opportunities for learning, identity formation, and social support. Failing to develop close relationships in adolescence hinders adult interpersonal functioning and contributes to problems such as loneliness and depression. During adolescence, increased reward sensitivity and greater social flexibility both contribute to healthy social development, yet we lack a clear theory of how these processes interact to support social functioning. Here, we propose synthesizing these two literatures using a computational reinforcement learning framework that recasts how adolescents pursue and learn from social rewards as a social explore-exploit problem. To become socially skilled, adolescents must balance both their efforts to form individual bonds within specific groups and manage memberships across multiple groups to maximize access to social resources. We draw on insights from sociological studies on social capital in collective networks and neurocognitive research on foraging and cooperation to describe the social explore-exploit dilemma faced by adolescents navigating a modern world with increasing access to diverse resources and group memberships. Our account provides important new directions for examining the dynamics of adolescent behavior in social groups and understanding how social value computations can support positive relationships into adulthood.

Exploration, Distributed Attention, and Development of Category Learning

Category learning is a crucial aspect of cognition that involves organizing entities into equivalence classes. Whereas adults tend to focus on category-relevant features, young children often distribute attention between relevant and irrelevant ones. The reasons for children's distributed attention are not fully understood. In two category-learning experiments with adults and with children aged 4, 5, and 6 (N = 201), we examined potential drivers of distributed attention, including (a) immature filtering of distractors and (b) the general tendency for exploration or broad information sampling. By eliminating distractor competition, we reduced filtering demands. Despite identifying the features critical for accurate categorization, children, regardless of their categorization performance, continued sampling more information than was necessary. These results indicate that the tendency to sample information extensively contributes to distributed attention in young children. We identify candidate drivers of this tendency that need to be examined in future research.

Prenatal environment is associated with the pace of cortical network development over the first three years of life

Environmental influences on brain structure and function during early development have been well-characterized, but whether early environments are associated with the pace of brain development is not clear. In pre-registered analyses, we use flexible non-linear models to test the theory that prenatal disadvantage is associated with differences in trajectories of intrinsic brain network development from birth to three years (n = 261). Prenatal disadvantage was assessed using a latent factor of socioeconomic disadvantage that included measures of mother's income-to-needs ratio, educational attainment, area deprivation index, insurance status, and nutrition. We find that prenatal disadvantage is associated with developmental increases in cortical network segregation, with neonates and toddlers with greater exposure to prenatal disadvantage showing a steeper increase in cortical network segregation with age, consistent with accelerated network development. Associations between prenatal disadvantage and cortical network segregation occur at the local scale and conform to a sensorimotor-association hierarchy of cortical organization. Disadvantage-associated differences in cortical network segregation are associated with language abilities at two years, such that lower segregation is associated with improved language abilities. These results shed light on associations between the early environment and trajectories of cortical development.

Developmental differences in children and adults' enforcement of explore versus exploit search strategies in the United States and Turkey

Across development, as children acquire a deeper understanding of their environment, they explore less and take advantage, or "exploit," what they already know. Here, we test whether children also enforce exploration-oriented search behaviors onto others. Specifically, we ask whether children are more likely to encourage a search agent to explore versus exploit their environment, and whether this pattern varies across childhood (between 3 and 6 years). We also ask whether this pattern differs between children and adults, and generalizes across two different sociocultural contexts-Turkey and the United States-that differ on dimensions that might relate to children's decisions about exploration (e.g., curiosity-focused educational practices, attitudes toward uncertainty avoidance). Participants (N = 358) watched an agent search for rewards and were asked at various points whether the agent should "stay" (exploit) in their current location, or "go" (explore) to a new location. At all points in the experiment, children enforced exploration significantly more often than adults. Early in the agent's search, children in the US enforced exploration more often than children in Turkey; later in the search, younger children (from both sociocultural contexts) were more likely to continue enforcing exploration compared to older children. These findings highlight that children are not only highly exploratory themselves, but also enforce exploration onto others-underscoring the central role that exploration plays in driving early cognitive development across diverse sociocultural contexts. RESEARCH HIGHLIGHTS: The current study examined developmental and cross-cultural differences in children and adults' enforcement of explore-exploit search strategies. Children in the US and Turkey enforced exploration more than adults, who enforced exploitation more often; results were generally consistent across cultures with small differences. Mirroring developmental changes in children's own search behavior; the tendency to enforce exploration decreased between 3- to 6-years of age. Findings underscore the central role of an "exploration mindset" in children's early decision-making-even when exploration has no direct benefits to the child themselves.

Play in Cognitive Development: From Rational Constructivism to Predictive Processing

It is widely believed that play and curiosity are key ingredients as children develop models of the world. There is also an emerging consensus that children are Bayesian learners who combine their structured prior beliefs with estimations of the likelihood of new evidence to infer the most probable model of the world. An influential school of thought within developmental psychology, rational constructivism, combines these two ideas to propose that children learn intuitive theories of how the world works in part by engaging in play activities that allow them to gather new information for testing their theories. There are still, however, at least two pieces missing from rational constructivist theories of development. First, rational constructivism has so far devoted little attention to explaining why children's preferred form of learning, play, feels so fun, enjoyable, and rewarding. Rational constructivism may suggest that children are curious and like to play because reducing uncertainty and learning better theories of the causal workings of the world is enjoyable. What remains unclear, however, is why reducing uncertainty in play is interesting, fun, and joyful, while doing so in other forms of learning can be frustrating or boring. Second, rational constructivism may have overlooked how children, during play, will take control of and manipulate their environment, sometimes in an effort to create ideal niches for surprise-extraction, sometimes for developing strategies for making the world fit with their predictions. These missing elements from rational constructivism can be provided by understanding the contribution of play to development in terms of predictive processing, an influential framework in cognitive neuroscience that models many of the brain's cognitive functions as processes of model-based, probabilistic prediction.

Symbolic metaprogram search improves learning efficiency and explains rule learning in humans

Throughout their lives, humans seem to learn a variety of rules for things like applying category labels, following procedures, and explaining causal relationships. These rules are often algorithmically rich but are nonetheless acquired with minimal data and computation. Symbolic models based on program learning successfully explain rule-learning in many domains, but performance degrades quickly as program complexity increases. It remains unclear how to scale symbolic rule-learning methods to model human performance in challenging domains. Here we show that symbolic search over the space of metaprograms-programs that revise programs-dramatically improves learning efficiency. On a behavioral benchmark of 100 algorithmically rich rules, this approach fits human learning more accurately than alternative models while also using orders of magnitude less search. The computation required to match median human performance is consistent with conservative estimates of human thinking time. Our results suggest that metaprogram-like representations may help human learners to efficiently acquire rules.

Adolescent-to-adult gains in cognitive flexibility are adaptively supported by reward sensitivity, exploration, and neural variability

Cognitive flexibility exhibits dynamic changes throughout development, with different forms of flexibility showing dissociable developmental trajectories. In this review, we propose that an adolescent-specific mode of flexibility in the face of changing environmental contingencies supports the emergence of adolescent-to-adult gains in cognitive shifting efficiency. We first describe how cognitive shifting abilities monotonically improve from childhood to adulthood, accompanied by increases in brain state flexibility, neural variability, and excitatory/inhibitory balance. We next summarize evidence supporting the existence of a dopamine-driven, adolescent peak in flexible behavior that results in reward seeking, undirected exploration, and environmental sampling. We propose a neurodevelopmental framework that relates these adolescent behaviors to the refinement of neural phenotypes relevant to mature cognitive flexibility, and thus highlight the importance of the adolescent period in fostering healthy neurocognitive trajectories.

Exploration, exploitation, and development: Developmental shifts in decision-making

Decision-making requires balancing exploration with exploitation, yet children are highly exploratory, with exploration decreasing with development. Less is known about what drives these changes. We examined the development of decision-making in 188 three- to eight-year-old children (M = 64 months; 98 girls) and 26 adults (M = 19 years; 13 women). Children were recruited from ethnically diverse suburban middle-class neighborhoods of Columbus, Ohio, USA. Results indicate that mature reward-based choices emerge relatively late in development, with children tending to over-explore. Computational modeling suggests that this exploration is systematic rather than random, as children tend to avoid repeating choices made on the previous trial. This pattern of exploration (reminiscent of novelty preference) decreased with development, whereas the tendency to exploit increased.

Early environments and exploration in the preschool years

A great deal of research has demonstrated how children's exploration is driven by opportunities for learning. However, less work has investigated how individual differences across children and their environmental contexts relate to patterns in playful exploration. We performed a "mega-analysis" in which we pooled preschool-aged children's play data from four past experiments in our lab (N = 278; M(age) = 56 months) and correlated play behaviors with age and socioeconomic status (median income, modal education in children's home zip codes). We found that, with age, children performed more unique actions during play. Additionally, children from lower SES areas explored more variably; the link between this play and tendencies to focus on pedagogically demonstrated features traded off differently than it did for higher SES children. This work lays critical groundwork for understanding exploration across developmental contexts.

Lifelong learning of cognitive styles for physical problem-solving: The effect of embodied experience

'Embodied cognition' suggests that our bodily experiences broadly shape our cognitive capabilities. We study how embodied experience affects the abstract physical problem-solving styles people use in a virtual task where embodiment does not affect action capabilities. We compare how groups with different embodied experience - 25 children and 35 adults with congenital limb differences versus 45 children and 40 adults born with two hands - perform this task, and find that while there is no difference in overall competence, the groups use different cognitive styles to find solutions. People born with limb differences think more before acting but take fewer attempts to reach solutions. Conversely, development affects the particular actions children use, as well as their persistence with their current strategy. Our findings suggest that while development alters action choices and persistence, differences in embodied experience drive changes in the acquisition of cognitive styles for balancing acting with thinking.

Unraveling the complex interplay between statistical learning and working memory in Chinese children with and without dyslexia across different ages

The relation between statistical learning and working memory in children with developmental dyslexia (DD) remains unclear. This study employed a distributional and a conditional statistical learning experiment and a working memory task to examine this relation in 651 Chinese 6- to 12-year-olds with and without DD (NDD = 199, 101 females; NwoDD = 452, 227 females; participated 2014-2019). Results showed working memory positively associated with recognizing high-predictable and familiar items in both groups, but negatively associated with recognizing unfamiliar items in the DD group only. These findings uncovered the complex interplay between statistical learning and working memory, demonstrating how different working memory abilities in children with and without DD relate to various statistical learning mechanisms at the item level.

A shared novelty-seeking basis for creativity and curiosity: Response to the commentators

In our target article, we proposed that curiosity and creativity are both manifestations of the same novelty-seeking process. We received 29 commentaries from diverse disciplines that add insights to our initial proposal. These commentaries ultimately expanded and supplemented our model. Here we draw attention to five central practical and theoretical issues that were raised by the commentators: (1) The complex construct of novelty and associated concepts; (2) the underlying subsystems and possible mechanisms; (3) the different pathways and subtypes of curiosity and creativity; (4) creativity and curiosity "in the wild"; (5) the possible link(s) between creativity and curiosity.

The explore/exploit trade-off: An ecologically valid and translational framework that can advance mechanistic understanding of eating disorders

The explore/exploit trade-off is a decision-making process that is conserved across species and balances exploring unfamiliar choices of unknown value with choosing familiar options of known value to maximize reward. This framework is rooted in behavioral ecology and has traditionally been used to study maladaptive versus adaptive non-human animal foraging behavior. Researchers have begun to recognize the potential utility of understanding human decision-making and psychopathology through the explore/exploit trade-off. In this article, we propose that explore/exploit trade-off holds promise for advancing our mechanistic understanding of decision-making processes that confer vulnerability for and maintain eating pathology due to its neurodevelopmental bases, conservation across species, and ability to be mathematically modeled. We present a model for how suboptimal explore/exploit decision-making can promote disordered eating and present recommendations for future research applying this framework to eating pathology. Taken together, the explore/exploit trade-off provides a translational framework for expanding etiologic and maintenance models of eating pathology, given developmental changes in explore/exploit decision-making that coincide in time with the emergence of eating pathology and evidence of biased explore/exploit decision-making in psychopathology. Additionally, understanding explore/exploit decision-making in eating disorders may improve knowledge of their underlying pathophysiology, informing targeted clinical interventions such as neuromodulation and pharmacotherapy. PUBLIC SIGNIFICANCE STATEMENT: The explore/exploit trade-off is a cross-species decision-making process whereby organisms choose between a known option with a known reward or sampling unfamiliar options. We hypothesize that imbalanced explore/exploit decision-making can promote disordered eating and present preliminary data. We propose that explore/exploit trade-off has significant potential to advance understanding of the neurocognitive and neurodevelopmental mechanisms of eating pathology, which could ultimately guide revisions of etiologic models and inform novel interventions.

The structure and development of explore-exploit decision making

A critical component of human learning reflects the balance people must achieve between focusing on the utility of what they know versus openness to what they have yet to experience. How individuals decide whether to explore new options versus exploit known options has garnered growing interest in recent years. Yet, the component processes underlying decisions to explore and whether these processes change across development remain poorly understood. By contrasting a variety of tasks that measure exploration in slightly different ways, we found that decisions about whether to explore reflect (a) random exploration that is not explicitly goal-directed and (b) directed exploration to purposefully reduce uncertainty. While these components similarly characterized the decision-making of both youth and adults, younger participants made decisions that were less strategic, but more exploratory and flexible, than those of adults. These findings are discussed in terms of how people adapt to and learn from changing environments over time.Data has been made available in the Open Science Foundation platform (osf.io).

Child and adolescent foraging: New directions in evolutionary research

Young children and adolescents in subsistence societies forage for a wide range of resources. They often target child-specific foods, they can be very successful foragers, and they share their produce widely within and outside of their nuclear family. At the same time, while foraging, they face risky situations and are exposed to diseases that can influence their immune development. However, children's foraging has largely been explained in light of their future (adult) behavior. Here, we reinterpret findings from human behavioral ecology, evolutionary medicine and cultural evolution to center foraging children's contributions to life history evolution, community resilience and immune development. We highlight the need to foreground immediate alongside delayed benefits and costs of foraging, including inclusive fitness benefits, when discussing children's food production from an evolutionary perspective. We conclude by recommending that researchers carefully consider children's social and ecological context, develop cross-cultural perspectives, and incorporate children's foraging into Indigenous sovereignty discourse.

Observational reinforcement learning in children and young adults

Observational learning is essential for the acquisition of new behavior in educational practices and daily life and serves as an important mechanism for human cognitive and social-emotional development. However, we know little about its underlying neurocomputational mechanisms from a developmental perspective. In this study we used model-based fMRI to investigate differences in observational learning and individual learning between children and younger adults. Prediction errors (PE), the difference between experienced and predicted outcomes, related positively to striatal and ventral medial prefrontal cortex activation during individual learning and showed no age-related differences. PE-related activation during observational learning was more pronounced when outcomes were worse than predicted. Particularly, negative PE-coding in the dorsal medial prefrontal cortex was stronger in adults compared to children and was associated with improved observational learning in children and adults. The current findings pave the way to better understand observational learning challenges across development and educational settings.

Curiosity: primate neural circuits for novelty and information seeking

For many years, neuroscientists have investigated the behavioural, computational and neurobiological mechanisms that support value-based decisions, revealing how humans and animals make choices to obtain rewards. However, many decisions are influenced by factors other than the value of physical rewards or second-order reinforcers (such as money). For instance, animals (including humans) frequently explore novel objects that have no intrinsic value solely because they are novel and they exhibit the desire to gain information to reduce their uncertainties about the future, even if this information cannot lead to reward or assist them in accomplishing upcoming tasks. In this Review, I discuss how circuits in the primate brain responsible for detecting, predicting and assessing novelty and uncertainty regulate behaviour and give rise to these behavioural components of curiosity. I also briefly discuss how curiosity-related behaviours arise during postnatal development and point out some important reasons for the persistence of curiosity across generations.

Environmental statistics and experience shape risk-taking across adolescence

Adolescents are often portrayed as reckless risk-takers because of their immature brains. Recent research has cast doubt on this portrayal, identifying the environment as a moderator of risk-taking. However, the key features of environments that drive risk-taking behaviors are often underspecified. We call for greater attention to the environment by drawing on research showing that its statistical structure impacts future risk-taking as people learn from outcomes they experience after taking a risk. This opinion shows that adolescents are unlikely to experience harm from many risks because environmental statistics are skewed and favor safe experiences. Environmental statistics and experience suggest entry points for policy interventions by carefully timing risk warnings and leveraging peers' potential to shape the statistics of rewarding experiences.

Emotion Regulation in Couples Across Adulthood

Intimate relationships are hotbeds of emotion. This article presents key findings and current directions in research on couples' emotion regulation across adulthood as a critical context in which older adults not only maintain functioning but may also outshine younger adults. First, I introduce key concepts, defining qualities (i.e., dynamic, coregulatory, bidirectional, bivalent), and measures (i.e., self-report versus performance-based) of couples' emotion regulation. Second, I highlight a socioemotional turn in our understanding of adult development with the advent of socioemotional selectivity theory. Third, I offer a life-span developmental perspective on emotion regulation in couples (i.e., across infancy, adolescence and young adulthood, midlife, and late life). Finally, I present the idea that emotion regulation may shift from "me to us" across adulthood and discuss how emotion regulation in couples may become more important, better, and increasingly consequential (e.g., for relationship outcomes, well-being, and health) with age. Ideas for future research are then discussed.

A goal-centric outlook on learning

Goals play a central role in human cognition. However, computational theories of learning and decision-making often take goals as given. Here, we review key empirical findings showing that goals shape the representations of inputs, responses, and outcomes, such that setting a goal crucially influences the central aspects of any learning process: states, actions, and rewards. We thus argue that studying goal selection is essential to advance our understanding of learning. By following existing literature in framing goal selection within a hierarchy of decision-making problems, we synthesize important findings on the principles underlying goal value attribution and exploration strategies. Ultimately, we propose that a goal-centric perspective will help develop more complete accounts of learning in both biological and artificial agents.

Children Use Teachers' Beliefs About Their Abilities to Calibrate Explore-Exploit Decisions

Models of the explore-exploit problem have explained how children's decision making is weighed by a bias for information (directed exploration), randomness, and generalization. These behaviors are often tested in domains where a choice to explore (or exploit) is guaranteed to reveal an outcome. An often overlooked but critical component of the assessment of explore-exploit decisions lies in the expected success of taking actions in the first place-and, crucially, how such decisions might be carried out when learning from others. Here, we examine how children consider an informal teacher's beliefs about the child's competence when deciding how difficult a task they want to pursue. We present a simple model of this problem that predicts that while learners should follow the recommendation of an accurate teacher, they should exploit easier games when a teacher overestimates their abilities, and explore harder games when she underestimates them. We tested these predictions in two experiments with adults (Experiment 1) and 6- to 8-year-old children (Experiment 2). In our task, participants' performance on a picture-matching game was either overestimated, underestimated, or accurately represented by a confederate (the "Teacher"), who then presented three new matching games of varying assessed difficulty (too easy, too hard, just right) at varying potential reward (low, medium, high). In line with our model's predictions, we found that both adults and children calibrated their choices to the teacher's representation of their competence. That is, to maximize expected reward, when she underestimated them, participants chose games the teacher evaluated as being too hard for them; when she overestimated them, they chose games she evaluated as being too easy; and when she was accurate, they chose games she assessed as being just right. This work provides insight into the early-emerging ability to calibrate explore-exploit decisions to others' knowledge when learning in informal pedagogical contexts.

Special Issue: Experiencing Well-BeingPlayfulness and the meaningful life: an active inference perspective

Our paper takes as its starting point the recent proposal, at the core of this special issue, to use the active inference framework (AIF) to computationally model what it is for a person to live a meaningful life. In broad brushstrokes, the AIF takes experiences of human flourishing to be the result of predictions and uncertainty estimations along many dimensions at multiple levels of neurobiological organization. Our aim in this paper is to explain how AIF models predict that uncertainty can sometimes, under the right conditions, be conducive to the experiences of flourishing. Our focus is on playfulness, because playful individuals have learned a high-level prior that in certain safe contexts, uncertainty and error should be tolerated and explored. They have expanded the phenotypic bound on the amount of surprise they are prepared to tolerate in their lives. The positive embracing of uncertainty has a number of positive knock-on effects for the kind of lives playful individuals are able to lead. First, a playful individual attends to the world in a way that is open and expansive, a mode of attending that is effortless and therefore conducive to being in the present. This openness to the present moment allows for deep engagement and participation in experience that can furnish a renewed appreciation for life. Second, playful individuals will actively seek out spaces at the edge of their own abilities and will therefore be more likely to grow and develop in their skills and relationships in ways that contribute to their living a good life. Finally, playful agents seek out situations in which they can monitor, observe, and learn from their own affective responses to uncertainty. Thus, uncertainty becomes something familiar to them that they not only learn to tolerate but also enjoy positively exploring, in ways that provide them opportunities to grow. For these three reasons, we will argue that playfulness and openness to experiences of uncertainty and the unknown may be important ingredients in human flourishing.

Staying and Returning dynamics of young children's attention

In this paper, we decompose selective sustained attending behavior into components of continuous attention maintenance and attentional transitions and study how each of these components develops in young children. Our results in two experiments suggest that changes in children's ability to return attention to a target locus after distraction ("Returning") play a crucial role in the development of selective sustained attention between the ages of 3.5-6 years, perhaps to a greater extent than changes in the ability to continuously maintain attention on the target ("Staying"). We further distinguish Returning from the behavior of transitioning attention away from task (i.e., becoming distracted) and investigate the relative contributions of bottom-up and top-down factors on these different types of attentional transitions. Overall, these results (a) suggest the importance of understanding the cognitive process of transitioning attention for understanding selective sustained attention and its development, (b) provide an empirical paradigm within which to study this process, and (c) begin to characterize basic features of this process, namely its development and its relative dependence on top-down and bottom-up influences on attention. RESEARCH HIGHLIGHTS: Young children exhibited an endogenously ability, Returning, to preferentially transition attention to task-relevant information over task-irrelevant information. Selective sustained attention and its development were decomposed into Returning and Staying, or task-selective attention maintenance, using novel eye-tracking-based measures. Returning improved between the ages of 3.5-6 years, to a greater extent than Staying. Improvements in Returning supported improvements in selective sustained attention between these ages.

Developmental changes in exploration resemble stochastic optimization

Human development is often described as a 'cooling off' process, analogous to stochastic optimization algorithms that implement a gradual reduction in randomness over time. Yet there is ambiguity in how to interpret this analogy, due to a lack of concrete empirical comparisons. Using data from n = 281 participants ages 5 to 55, we show that cooling off does not only apply to the single dimension of randomness. Rather, human development resembles an optimization process of multiple learning parameters, for example, reward generalization, uncertainty-directed exploration and random temperature. Rapid changes in parameters occur during childhood, but these changes plateau and converge to efficient values in adulthood. We show that while the developmental trajectory of human parameters is strikingly similar to several stochastic optimization algorithms, there are important differences in convergence. None of the optimization algorithms tested were able to discover reliably better regions of the strategy space than adult participants on this task.

Understanding patch foraging strategies across development

Patch foraging is a near-ubiquitous behaviour across the animal kingdom and characterises many decision-making domains encountered by humans. We review how a disposition to explore in adolescence may reflect the evolutionary conditions under which hunter-gatherers foraged for resources. We propose that neurocomputational mechanisms responsible for reward processing, learning, and cognitive control facilitate the transition from exploratory strategies in adolescence to exploitative strategies in adulthood - where individuals capitalise on known resources. This developmental transition may be disrupted by psychopathology, as there is emerging evidence of biases in explore/exploit choices in mental health problems. Explore/exploit choices may be an informative marker for mental health across development and future research should consider this feature of decision-making as a target for clinical intervention.

What's in the Box? Preschoolers Consider Ambiguity, Expected Value, and Information for Future Decisions in Explore-Exploit Tasks

Self-directed exploration in childhood appears driven by a desire to resolve uncertainties in order to learn more about the world. However, in adult decision-making, the choice to explore new information rather than exploit what is already known takes many factors beyond uncertainty (such as expected utilities and costs) into account. The evidence for whether young children are sensitive to complex, contextual factors in making exploration decisions is limited and mixed. Here, we investigate whether modifying uncertain options influences explore-exploit behavior in preschool-aged children (48-68 months). Over the course of three experiments, we manipulate uncertain options' ambiguity, expected value, and potential to improve epistemic state for future exploration in a novel forced-choice design. We find evidence that young children are influenced by each of these factors, suggesting that early, self-directed exploration involves sophisticated, context-sensitive decision-making under uncertainty.

Developmental Correlates of Accelerated Molar Eruption in Early Childhood

Background

Adversity has been linked to accelerated maturation. Molar eruption is a simple and scalable way to identify early maturation, but its developmental correlates remain unexplored. Thus, we examined whether accelerated maturation as indexed by molar eruption is associated with children's mental health or cognitive skills.

Methods

Molar eruption was evaluated from T2-weighted magnetic resonance imaging in 117 children (63 female; ages 4-7 years). Parents reported on child mental health with the Child Behavior Checklist. Children completed standardized assessments of fluid reasoning, working memory, processing speed, crystallized knowledge, and math performance. Relationships between molar eruption and developmental outcomes were examined using linear models, with age, gender, and stress risk as covariates.

Results

Earlier molar eruption was positively associated with children's externalizing symptoms (false discovery rate-corrected p [pFDR] = .027) but not internalizing symptoms, and the relationship with externalizing symptoms did not hold when controlling for stress risk. Earlier molar eruption was negatively associated with fluid reasoning (pFDR < .001), working memory (pFDR = .033), and crystallized knowledge (pFDR = .001). The association between molar eruption and both reasoning and crystallized knowledge held when controlling for stress risk. Molar eruption also partially mediated associations between stress risk and both reasoning (proportion mediated = 0.273, p = .004) and crystallized knowledge (proportion mediated = 0.126, p = .016).

Conclusions

Accelerated maturation, as reflected in early molar eruption, may have consequences for cognitive development, perhaps because it constrains brain plasticity. Knowing the pace of a child's maturation may provide insight into the impact of a child's stress history on their cognitive development.

Active inductive inference in children and adults: A constructivist perspective

A defining aspect of being human is an ability to reason about the world by generating and adapting ideas and hypotheses. Here we explore how this ability develops by comparing children's and adults' active search and explicit hypothesis generation patterns in a task that mimics the open-ended process of scientific induction. In our experiment, 54 children (aged 8.97±1.11) and 50 adults performed inductive inferences about a series of causal rules through active testing. Children were more elaborate in their testing behavior and generated substantially more complex guesses about the hidden rules. We take a 'computational constructivist' perspective to explaining these patterns, arguing that these inferences are driven by a combination of thinking (generating and modifying symbolic concepts) and exploring (discovering and investigating patterns in the physical world). We show how this framework and rich new dataset speak to questions about developmental differences in hypothesis generation, active learning and inductive generalization. In particular, we find children's learning is driven by less fine-tuned construction mechanisms than adults', resulting in a greater diversity of ideas but less reliable discovery of simple explanations.

Boredom as the originator of a desideratum - reflections on the creative and suppressive consequences of boredom in the school context

Bored children begin to draw, do crafts, to fidget - or they do something bad. Others fall silent, withdraw, or become lethargic. Research on school-related boredom has focused primarily on the negative consequences of boredom, such as decreased cognitive performance, motivation or attentativeness, or disruptiveness. These negative aspects of boredom can be contrasted by the notion that boredom can promote creative performance. This paper reflects on boredom's creative and suppressive consequences as an interplay of personality traits and behavioral possibilities in school situations, on the one hand, and as an interplay of situational experiences with constituent developmental processes on the other. It is proposed that boredom is a gauge of the learner's resonance with school content, learning and/or developmental relationships. Boredom indicates a psychological need and its desideratum. Thus, both creative and suppressive potentials are inherent in boredom.

Novelty and uncertainty differentially drive exploration across development

Across the lifespan, individuals frequently choose between exploiting known rewarding options or exploring unknown alternatives. A large body of work has suggested that children may explore more than adults. However, because novelty and reward uncertainty are often correlated, it is unclear how they differentially influence decision-making across development. Here, children, adolescents, and adults (ages 8-27 years, N = 122) completed an adapted version of a recently developed value-guided decision-making task that decouples novelty and uncertainty. In line with prior studies, we found that exploration decreased with increasing age. Critically, participants of all ages demonstrated a similar bias to select choice options with greater novelty, whereas aversion to reward uncertainty increased into adulthood. Computational modeling of participant choices revealed that whereas adolescents and adults demonstrated attenuated uncertainty aversion for more novel choice options, children's choices were not influenced by reward uncertainty.

Individual differences in T1w/T2w ratio development during childhood

Myelination is a key developmental process that promotes rapid and efficient information transfer. Myelin also stabilizes existing brain networks and thus may constrain neuroplasticity, defined here as the brain's potential to change in response to experiences rather than the canonical definition as the process of change. Characterizing individual differences in neuroplasticity may shed light on mechanisms by which early experiences shape learning, brain and body development, and response to interventions. The T1-weighted/T2-weighted (T1w/T2w) MRI signal ratio is a proxy measure of cortical microstructure and thus neuroplasticity. Here, in pre-registered analyses, we investigated individual differences in T1w/T2w ratios in children (ages 4-10, n = 157). T1w/T2w ratios were positively associated with age within early-developing sensorimotor and attention regions. We also tested whether socioeconomic status, cognition (crystallized knowledge or fluid reasoning), and biological age (as measured with molar eruption) were related to T1w/T2w signal but found no significant effects. Associations among T1w/T2w ratios, early experiences, and cognition may emerge later in adolescence and may not be strong enough to detect in moderate sample sizes.

Pattern breaking: a complex systems approach to psychedelic medicine

Recent research has demonstrated the potential of psychedelic therapy for mental health care. However, the psychological experience underlying its therapeutic effects remains poorly understood. This paper proposes a framework that suggests psychedelics act as destabilizers, both psychologically and neurophysiologically. Drawing on the 'entropic brain' hypothesis and the 'RElaxed Beliefs Under pSychedelics' model, this paper focuses on the richness of psychological experience. Through a complex systems theory perspective, we suggest that psychedelics destabilize fixed points or attractors, breaking reinforced patterns of thinking and behaving. Our approach explains how psychedelic-induced increases in brain entropy destabilize neurophysiological set points and lead to new conceptualizations of psychedelic psychotherapy. These insights have important implications for risk mitigation and treatment optimization in psychedelic medicine, both during the peak psychedelic experience and during the subacute period of potential recovery.

Comparative curiosity: How do great apes and children deal with uncertainty?

Humans are perhaps the most curious animals on earth, but to what extent our innate motivations for discovering new information are shared with our closest relatives remain poorly understood. To shed light on this question, we presented great apes with two experimental paradigms in which they had to initially choose between an empty opaque cup and a baited opaque cup with rewards invisible to the ape in study 1, or to choose between a transparent cup with rewards or a baited opaque cup with rewards invisible to the ape in studies 2 and 3. We also presented young children with scenarios comparable to the second paradigm (studies 4 and 5). Notably, after the initial choice phase, we presented participants with potential alternatives providing better rewards than the previously secured options. Importantly, those alternatives shared some features with the uncertain options, giving subjects the possibility to relate both options through analogical reasoning. We found that most great apes were not curious about the uncertain options. They only explored those options after they were presented with the alternatives. Children, instead, explored the uncertain options before the alternatives were presented, showing a higher degree of curiosity than the great apes. We argue that differences between children and apes mostly lay in motivational dispositions to explore the unknown.

Sensitivity and specificity in affective and social learning in adolescence

Adolescence is a period of heightened affective and social sensitivity. In this review we address how this increased sensitivity influences associative learning. Based on recent evidence from human and rodent studies, as well as advances in computational biology, we suggest that, compared to other age groups, adolescents show features of heightened Pavlovian learning but tend to perform worse than adults at instrumental learning. Because Pavlovian learning does not involve decision-making, whereas instrumental learning does, we propose that these developmental differences might be due to heightened sensitivity to rewards and threats in adolescence, coupled with a lower specificity of responding. We discuss the implications of these findings for adolescent mental health and education.

A shift in the mechanisms controlling hippocampal engram formation during brain maturation

The ability to form precise, episodic memories develops with age, with young children only able to form gist-like memories that lack precision. The cellular and molecular events in the developing hippocampus that underlie the emergence of precise, episodic-like memory are unclear. In mice, the absence of a competitive neuronal engram allocation process in the immature hippocampus precluded the formation of sparse engrams and precise memories until the fourth postnatal week, when inhibitory circuits in the hippocampus mature. This age-dependent shift in precision of episodic-like memories involved the functional maturation of parvalbumin-expressing interneurons in subfield CA1 through assembly of extracellular perineuronal nets, which is necessary and sufficient for the onset of competitive neuronal allocation, sparse engram formation, and memory precision.

Early adversity and the development of explore-exploit tradeoffs

Childhood adversity can have wide-ranging and long-lasting effects on later life. But what are the mechanisms that are responsible for these effects? This article brings together the cognitive science literature on explore-exploit tradeoffs, the empirical literature on early adversity, and the literature in evolutionary biology on 'life history' to explain how early experience influences later life. We propose one potential mechanism: early experiences influence 'hyperparameters' that determine the balance between exploration and exploitation. Adversity might accelerate a shift from exploration to exploitation, with broad and enduring effects on the adult brain and mind. These effects may be produced by life-history adaptations that use early experience to tailor development and learning to the likely future states of an organism and its environment.

Confirmatory reinforcement learning changes with age during adolescence

Understanding how learning changes during human development has been one of the long-standing objectives of developmental science. Recently, advances in computational biology have demonstrated that humans display a bias when learning to navigate novel environments through rewards and punishments: they learn more from outcomes that confirm their expectations than from outcomes that disconfirm them. Here, we ask whether confirmatory learning is stable across development, or whether it might be attenuated in developmental stages in which exploration is beneficial, such as in adolescence. In a reinforcement learning (RL) task, 77 participants aged 11-32 years (four men, mean age = 16.26) attempted to maximize monetary rewards by repeatedly sampling different pairs of novel options, which varied in their reward/punishment probabilities. Mixed-effect models showed an age-related increase in accuracy as long as learning contingencies remained stable across trials, but less so when they reversed halfway through the trials. Age was also associated with a greater tendency to stay with an option that had just delivered a reward, more than to switch away from an option that had just delivered a punishment. At the computational level, a confirmation model provided increasingly better fit with age. This model showed that age differences are captured by decreases in noise or exploration, rather than in the magnitude of the confirmation bias. These findings provide new insights into how learning changes during development and could help better tailor learning environments to people of different ages. RESEARCH HIGHLIGHTS: Reinforcement learning shows age-related improvement during adolescence, but more in stable learning environments compared with volatile learning environments. People tend to stay with an option after a win more than they shift from an option after a loss, and this asymmetry increases with age during adolescence. Computationally, these changes are captured by a developing confirmatory learning style, in which people learn more from outcomes that confirm rather than disconfirm their choices. Age-related differences in confirmatory learning are explained by decreases in stochasticity, rather than changes in the magnitude of the confirmation bias.

Auditory and visual category learning in children and adults

Categories are fundamental to everyday life and the ability to learn new categories is relevant across the lifespan. Categories are ubiquitous across modalities, supporting complex processes such as object recognition and speech perception. Prior work has proposed that different categories may engage learning systems with unique developmental trajectories. There is a limited understanding of how perceptual and cognitive development influences learning as prior studies have examined separate participants in a single modality. The current study presents a comprehensive assessment of category learning in 8-12-year-old children (12 female; 34 white, 1 Asian, 1 more than one race; M household income $85-$100 K) and 18-61-year-old adults (13 female; 32 white, 10 Black or African American, 4 Asian, 2 more than one race, 1 other; M household income $40-55 K) in a broad sample collected online from the United States. Across multiple sessions, participants learned categories across modalities (auditory, visual) that engage different learning systems (explicit, procedural). Unsurprisingly, adults outperformed children across all tasks. However, this enhanced performance was asymmetrical across categories and modalities. Adults far outperformed children in learning visual explicit categories and auditory procedural categories, with fewer differences across development for other types of categories. Adults' general benefit over children was due to enhanced information processing, while their superior performance for visual explicit and auditory procedural categories was associated with less cautious correct responses. These results demonstrate an interaction between perceptual and cognitive development that influences learning of categories that may correspond to the development of real-world skills such as speech perception and reading. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Enriched environment exposure during development positively impacts the structure and function of the visual cortex in mice

Optimal conditions of development have been of interest for decades, since genetics alone cannot fully explain how an individual matures. In the present study, we used optical brain imaging to investigate whether a relatively simple enrichment can positively influence the development of the visual cortex of mice. The enrichment paradigm was composed of larger cages housing multiple mice that contained several toys, hiding places, nesting material and a spinning wheel that were moved or replaced at regular intervals. We compared C57BL/6N adult mice (> P60) that had been raised either in an enriched environment (EE; n = 16) or a standard (ST; n = 12) environment from 1 week before birth to adulthood, encompassing all cortical developmental stages. Here, we report significant beneficial changes on the structure and function of the visual cortex following environmental enrichment throughout the lifespan. More specifically, retinotopic mapping through intrinsic signal optical imaging revealed that the size of the primary visual cortex was greater in mice reared in an EE compared to controls. In addition, the visual field coverage of EE mice was wider. Finally, the organization of the cortical representation of the visual field (as determined by cortical magnification) versus its eccentricity also differed between the two groups. We did not observe any significant differences between females and males within each group. Taken together, these data demonstrate specific benefits of an EE throughout development on the visual cortex, which suggests adaptation to their environmental realities.

Canalization and plasticity in psychopathology

This theoretical article revives a classical bridging construct, canalization, to describe a new model of a general factor of psychopathology. To achieve this, we have distinguished between two types of plasticity, an early one that we call 'TEMP' for 'Temperature or Entropy Mediated Plasticity', and another, we call 'canalization', which is close to Hebbian plasticity. These two forms of plasticity can be most easily distinguished by their relationship to 'precision' or inverse variance; TEMP relates to increased model variance or decreased precision, whereas the opposite is true for canalization. TEMP also subsumes increased learning rate, (Ising) temperature and entropy. Dictionary definitions of 'plasticity' describe it as the property of being easily shaped or molded; TEMP is the better match for this. Importantly, we propose that 'pathological' phenotypes develop via mechanisms of canalization or increased model precision, as a defensive response to adversity and associated distress or dysphoria. Our model states that canalization entrenches in psychopathology, narrowing the phenotypic state-space as the agent develops expertise in their pathology. We suggest that TEMP - combined with gently guiding psychological support - can counter canalization. We address questions of whether and when canalization is adaptive versus maladaptive, furnish our model with references to basic and human neuroscience, and offer concrete experiments and measures to test its main hypotheses and implications. This article is part of the Special Issue on "National Institutes of Health Psilocybin Research Speaker Series".

Creativity of Creativity Researchers: Invention of Problems and Experimental Objects to Study Thinking

Invention of problem situations and experimental objects to study others' thinking is a special kind of creativity worthy of scientific interest. The objects are considered in terms of Latour's actor network theory (as nonhuman actants), cultural psychology (as cultural tools), and Gibson's theory of affordances (as meta-affordances). A fundamental problem of validity in studies of curiosity and exploration is discussed. The author's experience of inventions of exploratory objects to be experimented with is analyzed. An inter(trans)-disciplinary insight penetrating and integrating all levels of the work on an exploratory object is described. An example of participants' revealing of an object's unexpected faculties ("serendipities") undesirable from the experimenter's point of view is given. It is shown that an object designed to study thinking in one sample can be used in another sample with unexpected results. It is argued that automatic generation of problem posing-and-solving situations and exploratory objects, beginning from some levels of their novelty and complexity, is hardly possible because of fundamental limitations of "standard means to generate or score non-standard ends".

Holistic Functioning from a Developmental Perspective: A New Synthesis with a Focus on a Multi-tiered System Support Structure

While research in specific academic disciplines has individually advanced knowledge and practice for promoting multiple aspects of health and well-being in children and adolescents, still missing is an understanding of the interconnectedness of many critical aspects of development and how to intentionally weave these factors to advance a more holistic approach. The need for a more holistic and inclusive approach to child and adolescent development is increasingly evident to promote long-term health and well-being as the overall percentage of children, adolescents, and adults who suffer from mental health disorders is increasing. To address this issue, our authorship team consists of researchers in the areas of developmental psychology, neuroscience, motor development, exercise science, and mental health. The collective ideas outlined in this paper are aligned to address the need to remove disciplinary-specific boundaries and elucidate synergistic linkages across multiple research domains that support holistic development and lifespan health and wellness. We propose a conceptual framework that comprehensively addresses the integration of physical, cognitive, psychological, social, and emotional domains of child and adolescent development. In addition, we also provide a holistic preventative approach that is aligned with a contemporary intervention structure (i.e., Multi-tiered Systems of Support) to promote, from a developmental perspective, positive trajectories of health and well-being across childhood and adolescence.

Sampling statistics are like story creation: a network analysis of parent-toddler exploratory play

Actions in the world elicit data for learning and do so in a stream of interconnected events. Here, we provide evidence on how toddlers with their parent sample information by acting on toys during exploratory play. We observed 10 min of free-flowing and unconstrained object exploration of by toddlers (mean age 21 months) and parents in a room with many available objects (n = 32). Borrowing concepts and measures from the study of narratives, we found that the toy selections are not a string of unrelated events but exhibit a suite of what we call coherence statistics: Zipfian distributions, burstiness and a network structure. We discuss the transient memory processes that underlie the moment-to-moment toy selections that create this coherence and the role of these statistics in the development of abstract and generalizable systems of knowledge. This article is part of the theme issue 'Concepts in interaction: social engagement and inner experiences'.

What made us "hunter-gatherers of words"

This paper makes three interconnected claims: (i) the "human condition" cannot be captured by evolutionary narratives that reduce it to a recent 'cognitive modernity', nor by narratives that eliminates all cognitive differences between us and out closest extinct relatives, (ii) signals from paleogenomics, especially coming from deserts of introgression but also from signatures of positive selection, point to the importance of mutations that impact neurodevelopment, plausibly leading to temperamental differences, which may impact cultural evolutionary trajectories in specific ways, and (iii) these trajectories are expected to affect the language phenotypes, modifying what is being learned and how it is put to use. In particular, I hypothesize that these different trajectories influence the development of symbolic systems, the flexible ways in which symbols combine, and the size and configurations of the communities in which these systems are put to use.

Is Difficulty Mostly About Impossibility? What Difficulty Implies May Be Culturally Variant

Difficulty can signal low odds (impossibility) and high value (importance). We build on culture-as-situated cognition theory's description of culture-based fluency and disfluency to predict that the culturally fluent meaning of difficulty is culture-bound. For Americans, the culturally fluent understanding of ability is success-with-ease-not-effort, hence difficulty implies low odds of ability. This may disadvantage American institutions and practices-learning requires gaining competence and proficiency through effortful engagement. Indeed, Americans (Studies 1, 3-8; N = 4,141; Study 2, the corpus of English language) associate difficulty with impossibility more than importance. This tendency is not universal. Indian and Chinese cultures imply that difficulty can equally signal low odds and value. Indeed, people from India and China (Studies 9-11, N = 762) are as likely to understand difficulty as being about both. Effects are culture-based; how much people endorse difficulty-as-importance and difficulty-as-impossibility in their own lives did not affect results.