Contributions of expected learning progress and perceptual novelty to curiosity-driven exploration

Exploration in 4-year-old children is guided by learning progress and novelty

Humans are driven by an intrinsic motivation to learn, but the developmental origins of curiosity-driven exploration remain unclear. We investigated the computational principles guiding 4-year-old children's exploration during a touchscreen game (N = 102, F = 49, M = 53, primarily white and middle-class, data collected in the Netherlands from 2021-2023). Children guessed the location of characters that were hiding following predictable (yet noisy) patterns. Children could freely switch characters, which allowed us to quantify when they decided to explore something different and what they chose to explore. Bayesian modeling of their responses revealed that children selected activities that were more novel and offered greater learning progress (LP). Moreover, children's interest in making LP correlated with better learning performance. These findings highlight the importance of novelty and LP in guiding children's exploration.

Play in Cognitive Development: From Rational Constructivism to Predictive Processing

It is widely believed that play and curiosity are key ingredients as children develop models of the world. There is also an emerging consensus that children are Bayesian learners who combine their structured prior beliefs with estimations of the likelihood of new evidence to infer the most probable model of the world. An influential school of thought within developmental psychology, rational constructivism, combines these two ideas to propose that children learn intuitive theories of how the world works in part by engaging in play activities that allow them to gather new information for testing their theories. There are still, however, at least two pieces missing from rational constructivist theories of development. First, rational constructivism has so far devoted little attention to explaining why children's preferred form of learning, play, feels so fun, enjoyable, and rewarding. Rational constructivism may suggest that children are curious and like to play because reducing uncertainty and learning better theories of the causal workings of the world is enjoyable. What remains unclear, however, is why reducing uncertainty in play is interesting, fun, and joyful, while doing so in other forms of learning can be frustrating or boring. Second, rational constructivism may have overlooked how children, during play, will take control of and manipulate their environment, sometimes in an effort to create ideal niches for surprise-extraction, sometimes for developing strategies for making the world fit with their predictions. These missing elements from rational constructivism can be provided by understanding the contribution of play to development in terms of predictive processing, an influential framework in cognitive neuroscience that models many of the brain's cognitive functions as processes of model-based, probabilistic prediction.

Infants evaluate informativeness of evidence and predict causal events as revealed in theta oscillations and predictive looking

This study investigates 16-month-old infants' sensitivity to the informativeness of evidence and its potential link to infants' ability to draw accurate causal inferences and predict unfolding events. Employing concurrent EEG and eye tracking, data from 66 infants revealed significantly increased theta oscillatory activity when infants expected to see causally unconfounded evidence compared to confounded evidence, suggesting heightened cognitive engagement in anticipation of informative evidence. Crucially, this difference was more pronounced in the subset of infants who later made correct predictions, suggesting that they had correctly inferred the causal structure based on the evidence presented. This research sheds light on infants' motivation to seek explanatory causal information, suggesting that even at 16 months, infants can strategically direct attention to situations conducive to acquiring informative evidence, potentially laying the groundwork for the impressive abilities of humans to rapidly acquire knowledge and develop causal theories of the world.

Breaking down (and moving beyond) novelty as a trigger of curiosity

The Novelty Seeking Model (NSM) places "novelty" at center stage in characterizing the mechanisms behind curiosity. We argue that the NSM's conception of novelty is too broad, obscuring distinct constructs. More critically, the NSM underemphasizes triggers of curiosity that better unify these constructs and that have received stronger empirical support: those that signal the potential for useful learning.

Beyond novelty: Learnability in the interplay between creativity, curiosity and artistic endeavours

Using art and aesthetics as context, we explore the notion that curiosity and creativity emanate from a single novelty-seeking mechanism and outline support for the idea. However, we also highlight the importance of learning progress tracking in exploratory action and advocate for a nuanced understanding that aligns novelty-seeking with learnability. This, we argue, offers a more comprehensive framework of how curiosity and creativity are related.

Curiosity and the dynamics of optimal exploration

What drives our curiosity remains an elusive and hotly debated issue, with multiple hypotheses proposed but a cohesive account yet to be established. This review discusses traditional and emergent theories that frame curiosity as a desire to know and a drive to learn, respectively. We adopt a model-based approach that maps the temporal dynamics of various factors underlying curiosity-based exploration, such as uncertainty, information gain, and learning progress. In so doing, we identify the limitations of past theories and posit an integrated account that harnesses their strengths in describing curiosity as a tool for optimal environmental exploration. In our unified account, curiosity serves as a 'common currency' for exploration, which must be balanced with other drives such as safety and hunger to achieve efficient action.

Individual differences in processing speed and curiosity explain infant habituation and dishabituation performance

Habituation and dishabituation are the most prevalent measures of infant cognitive functioning, and they have reliably been shown to predict later cognitive outcomes. Yet, the exact mechanisms underlying infant habituation and dishabituation are still unclear. To investigate them, we tested 106 8-month-old infants on a classic habituation task and a novel visual learning task. We used a hierarchical Bayesian model to identify individual differences in sustained attention, learning performance, processing speed and curiosity from the visual learning task. These factors were then related to habituation and dishabituation. We found that habituation time was related to individual differences in processing speed, while dishabituation was related to curiosity, but only for infants who did not habituate. These results offer novel insights in the mechanisms underlying habituation and serve as proof of concept for hierarchical models as an effective tool to measure individual differences in infant cognitive functioning. RESEARCH HIGHLIGHTS: We used a hierarchical Bayesian model to measure individual differences in infants' processing speed, learning performance, sustained attention, and curiosity. Faster processing speed was related to shorter habituation time. High curiosity was related to stronger dishabituation responses, but only for infants who did not habituate.

The aesthetic valve: how aesthetic appreciation may switch emotional states from anxiety to curiosity

Pursuing new knowledge in the entropic environment is pivotal for survival. However, dealing with uncertainty is a costly challenge for the agent surrounded by the stochastic sensory world, giving rise to different epistemic emotions, such as curiosity and anxiety. We recently proposed that aesthetic appreciation may have the role of associating pleasant feedback with the update of predictive representations. According to this idea, aesthetic appreciation and its associated rewarding feeling could drive people to seek new knowledge over anxiety. However, the relationship between aesthetic appreciation, curiosity, and anxiety has been still under-examined in the literature. Here, we explore the relationship between these epistemic emotions in a series of three experiments. In study 1, we examined whether music-induced aesthetic appreciation would influence curiosity in a gambling task. In studies 2a and 2b, we explore the relationship between music-induced aesthetic appreciation and anxiety state. Overall, aesthetic appreciation promoted curiosity-driven behaviour while it was negatively associated with anxiety. These results were consistent with the idea that aesthetic appreciation could act as a 'valve', prompting the individual to perceive curiosity (i.e. to consider novelty as a valuable opportunity to acquire new knowledge) rather than anxiety (i.e. to consider novelty as a risk to be avoided). This article is part of the theme issue 'Art, aesthetics and predictive processing: theoretical and empirical perspectives'.

Curiosity-driven exploration: foundations in neuroscience and computational modeling

Curiosity refers to the intrinsic desire of humans and animals to explore the unknown, even when there is no apparent reason to do so. Thus far, no single, widely accepted definition or framework for curiosity has emerged, but there is growing consensus that curious behavior is not goal-directed but related to seeking or reacting to information. In this review, we take a phenomenological approach and group behavioral and neurophysiological studies which meet these criteria into three categories according to the type of information seeking observed. We then review recent computational models of curiosity from the field of machine learning and discuss how they enable integrating different types of information seeking into one theoretical framework. Combinations of behavioral and neurophysiological studies along with computational modeling will be instrumental in demystifying the notion of curiosity.

A goal-centric outlook on learning

Goals play a central role in human cognition. However, computational theories of learning and decision-making often take goals as given. Here, we review key empirical findings showing that goals shape the representations of inputs, responses, and outcomes, such that setting a goal crucially influences the central aspects of any learning process: states, actions, and rewards. We thus argue that studying goal selection is essential to advance our understanding of learning. By following existing literature in framing goal selection within a hierarchy of decision-making problems, we synthesize important findings on the principles underlying goal value attribution and exploration strategies. Ultimately, we propose that a goal-centric perspective will help develop more complete accounts of learning in both biological and artificial agents.

Multifaceted information-seeking motives in children

From an early age, children need to gather information to learn about their environment. Deciding which knowledge to pursue can be difficult because information can serve several, sometimes competing, purposes. Here, we examine the developmental trajectories of such diverse information-seeking motives. Over five experiments involving 521 children (aged 4-12), we find that school-age children integrate three key factors into their information-seeking choices: whether information reduces uncertainty, is useful in directing action, and is likely to be positive. Choices that likely reveal positive information and are useful for action emerge as early as age 4, followed by choices that reduce uncertainty (at ~age 5). Our results suggest that motives related to usefulness and uncertainty reduction become stronger with age, while the tendency to seek positive news does not show a statistically significant change throughout development. This study reveals how the relative importance of diverging, sometimes conflicting, information-seeking motives emerges throughout development.

Eight-Month-Old Infants Meta-Learn by Downweighting Irrelevant Evidence

Infants learn to navigate the complexity of the physical and social world at an outstanding pace, but how they accomplish this learning is still largely unknown. Recent advances in human and artificial intelligence research propose that a key feature to achieving quick and efficient learning is meta-learning, the ability to make use of prior experiences to learn how to learn better in the future. Here we show that 8-month-old infants successfully engage in meta-learning within very short timespans after being exposed to a new learning environment. We developed a Bayesian model that captures how infants attribute informativity to incoming events, and how this process is optimized by the meta-parameters of their hierarchical models over the task structure. We fitted the model with infants' gaze behavior during a learning task. Our results reveal how infants actively use past experiences to generate new inductive biases that allow future learning to proceed faster.

Exploratory preferences explain the human fascination for imaginary worlds in fictional stories

Imaginary worlds are present and often central in many of the most culturally successful modern narrative fictions, be it in novels (e.g., Harry Potter), movies (e.g., Star Wars), video games (e.g., The Legend of Zelda), graphic novels (e.g., One Piece) and TV series (e.g., Game of Thrones). We propose that imaginary worlds are popular because they activate exploratory preferences that evolved to help us navigate the real world and find new fitness-relevant information. Therefore, we hypothesize that the attraction to imaginary worlds is intrinsically linked to the desire to explore novel environments and that both are influenced by the same underlying factors. Notably, the inter-individual and cross-cultural variability of the preference for imaginary worlds should follow the inter-individual and cross-cultural variability of exploratory preferences (with the personality trait Openness-to-experience, age, sex, and ecological conditions). We test these predictions with both experimental and computational methods. For experimental tests, we run a pre-registered online experiment about movie preferences (N = 230). For computational tests, we leverage two large cultural datasets, namely the Internet Movie Database (N = 9424 movies) and the Movie Personality Dataset (N = 3.5 million participants), and use machine-learning algorithms (i.e., random forest and topic modeling). In all, consistent with how the human preference for spatial exploration adaptively varies, we provide empirical evidence that imaginary worlds appeal more to more explorative people, people higher in Openness-to-experience, younger individuals, males, and individuals living in more affluent environments. We discuss the implications of these findings for our understanding of the cultural evolution of narrative fiction and, more broadly, the evolution of human exploratory preferences.

Curiosity as a metacognitive feeling

Curious information-seeking is known to be a key driver for learning, but characterizing this important psychological phenomenon remains a challenge. In this article, we argue that solving this challenge requires qualifying the relationships between metacognition and curiosity. The idea that curiosity is a metacognitive competence has been resisted: researchers have assumed both that young children and non-human animals can be genuinely curious, and that metacognition requires conceptual and culturally situated resources that are unavailable to young children and non-human animals. Here, we argue that this resistance is unwarranted given accumulating evidence that metacognition can be deployed procedurally, and we defend the view that curiosity is a metacognitive feeling. Our metacognitive view singles out two monitoring steps as a triggering condition for curiosity: evaluating one's own informational needs, and predicting the likelihood that explorations of the proximate environment afford significant information gains. We review empirical evidence and computational models of curiosity, and show that they fit well with this metacognitive account, while on the contrary, they remain difficult to explain by a competing account according to which curiosity is a basic attitude of questioning. Finally, we propose a new way to construe the relationships between curiosity and the human-specific communicative practice of questioning, discuss the issue of how children may learn to express their curiosity through interactions with others, and conclude by briefly exploring the implications of our proposal for educational practices.