Increased Ventromedial Prefrontal Cortex Activity in Adolescence Benefits Prosocial Reinforcement Learning

Social Risk Coding by Amygdala Activity and Connectivity with the Dorsal Anterior Cingulate Cortex

Risk is a fundamental factor affecting individual and social economic decisions, but its neural correlates are largely unexplored in the social domain. The amygdala, together with the dorsal anterior cingulate cortex (dACC), is thought to play a central role in risk-taking. Here, we investigated in human volunteers (n = 20; 11 females) how risk (defined as the variance of reward probability distributions) in a social situation affects decisions and concomitant neural activity as measured with fMRI. We found separate variance-risk signals for social and nonsocial outcomes in the amygdala. Specifically, amygdala activity increased parametrically with social reward variance of presented choice options and on separate trials with nonsocial reward variance. Behaviorally, 75% of participants were averse to social risk as estimated in a Becker-DeGroot-Marschak auction-like procedure. The stronger this aversion, the more negative the coupling between risk-related amygdala regions and dACC. This negative relation was significant for social risk attitude but not for the attitude toward variance-risk in juice outcomes. Our results indicate that the amygdala and its coupling with dACC process objective and subjectively evaluated social risk. Moreover, while social risk can be captured with a framework originally established by finance theory for nonsocial risk, the amygdala appears to process social risk largely separately from nonsocial risk.

Moral Learning and Decision-Making Across the Lifespan

Moral learning and decision-making are crucial throughout our lives, from infancy to old age. Emerging evidence suggests that there are important differences in learning and decision-making in moral situations across the lifespan, and these are underpinned by co-occurring changes in the use of model-based values and theory of mind. Here, we review the decision neuroscience literature on moral choices and moral learning considering four key concepts. We show how in the earliest years, a sense of self/other distinction is foundational. Sensitivity to intention versus outcome is crucial for several moral concepts and is most similar in our earliest and oldest years. Across all ages, basic shifts in the influence of theory of mind and model-free and model-based learning support moral decision-making. Moving forward, a computational approach to key concepts of morality can help provide a mechanistic account and generate new hypotheses to test across the whole lifespan.

Revisiting the musical reminiscence bump: insights from neurocognitive and social brain development in adolescence

Music listening is enjoyed across the lifespan and around the world. This has spurred many theories on the evolutionary purpose of music. The Music for Social Bonding hypothesis posits that the human capacity to make music evolved for the purpose of creating and preserving relationships between one another. Considering different time periods of music use across the lifespan, adolescence is especially a period of social reorientation away from family towards peers, characterized by new social bonds and increased prosocial behavior. This shift is accompanied by notable structural and functional changes in brain networks supporting reward processing and prosocial behavior. Reviewing the extant literature on developmental cognitive neuroscience and adolescent music use, we propose that neurocognitive changes in the reward system make adolescence an ideal developmental time window for investigating interactions between prosocial behavior and reward processing, as adolescence constitutes a time of relative increase in music reward valuation. Testing this hypothesis may clarify our understanding of developmental trajectories in music reward valuation, and offer insights into why music from adults' adolescence holds a great deal of personal significance.

Human ventromedial prefrontal cortex is necessary for prosocial motivation

Ventromedial prefrontal cortex (vmPFC) is vital for decision-making. Functional neuroimaging links vmPFC to processing rewards and effort, while parallel work suggests vmPFC involvement in prosocial behaviour. However, the necessity of vmPFC for these functions is unknown. Patients with rare focal vmPFC lesions (n = 25), patients with lesions elsewhere (n = 15) and healthy controls (n = 40) chose between rest and exerting effort to earn rewards for themselves or another person. vmPFC damage decreased prosociality across behavioural and computational measures. vmPFC patients earned less, discounted rewards by effort more, and exerted less force when another person benefited, compared to both control groups. Voxel-based lesion mapping revealed dissociations between vmPFC subregions. While medial damage led to antisocial behaviour, lateral damage increased prosocial behaviour relative to patients with damage elsewhere. vmPFC patients also showed reduced effort sensitivity overall, but reward sensitivity was limited to specific subregions. These results reveal multiple causal contributions of vmPFC to prosocial behaviour, effort and reward.

The influence of social feedback on reward learning in the Iowa gambling task

Learning, an important activity for both human and animals, has long been a focal point of research. During the learning process, subjects assimilate not only their own information but also information from others, a phenomenon known as social learning. While numerous studies have explored the impact of social feedback as a reward/punishment during learning, few studies have investigated whether social feedback facilitates or inhibits the learning of environmental rewards/punishments. This study aims to test the effects of social feedback on economic feedback and its cognitive processes by using the Iowa Gambling Task (IGT). One hundred ninety-two participants were recruited and categorized into one non-social feedback group and four social feedback groups. Participants in the social feedback groups were informed that after the outcome of each choice, they would also receive feedback from an online peer. This peer was a fictitious entity, with variations in identity (novice or expert) and feedback type (random or effective). The Outcome-Representation Learning model (ORL model) was used to quantify the cognitive components of learning. Behavioral results showed that both the identity of the peer and the type of feedback provided significantly influenced the deck selection, with effective social feedback increasing the ratio of chosen good decks. Results in the ORL model showed that the four social feedback groups exhibited lower learning rates for gain and loss compared to the nonsocial feedback group, which suggested, in the social feedback groups, the impact of the recent outcome on the update of value decreased. Parameters such as forgetfulness, win frequency, and deck perseverance in the expert-effective feedback group were significantly higher than those in the non-social feedback and expert-random feedback groups. These findings suggest that individuals proactively evaluate feedback providers and selectively adopt effective feedback to enhance learning.

Annual Research Review: Early intervention viewed through the lens of developmental neuroscience

The overarching goal of this paper is to examine the efficacy of early intervention when viewed through the lens of developmental neuroscience. We begin by briefly summarizing neural development from conception through the first few postnatal years. We emphasize the role of experience during the postnatal period, and consistent with decades of research on critical periods, we argue that experience can represent both a period of opportunity and a period of vulnerability. Because plasticity is at the heart of early intervention, we next turn our attention to the efficacy of early intervention drawing from two distinct literatures: early intervention services for children growing up in disadvantaged environments, and children at elevated likelihood of developing a neurodevelopmental delay or disorder. In the case of the former, we single out interventions that target caregiving and in the case of the latter, we highlight recent work on autism. A consistent theme throughout our review is a discussion of how early intervention is embedded in the developing brain. We conclude our article by discussing the implications our review has for policy, and we then offer recommendations for future research.

Observational reinforcement learning in children and young adults

Observational learning is essential for the acquisition of new behavior in educational practices and daily life and serves as an important mechanism for human cognitive and social-emotional development. However, we know little about its underlying neurocomputational mechanisms from a developmental perspective. In this study we used model-based fMRI to investigate differences in observational learning and individual learning between children and younger adults. Prediction errors (PE), the difference between experienced and predicted outcomes, related positively to striatal and ventral medial prefrontal cortex activation during individual learning and showed no age-related differences. PE-related activation during observational learning was more pronounced when outcomes were worse than predicted. Particularly, negative PE-coding in the dorsal medial prefrontal cortex was stronger in adults compared to children and was associated with improved observational learning in children and adults. The current findings pave the way to better understand observational learning challenges across development and educational settings.

Understanding patch foraging strategies across development

Patch foraging is a near-ubiquitous behaviour across the animal kingdom and characterises many decision-making domains encountered by humans. We review how a disposition to explore in adolescence may reflect the evolutionary conditions under which hunter-gatherers foraged for resources. We propose that neurocomputational mechanisms responsible for reward processing, learning, and cognitive control facilitate the transition from exploratory strategies in adolescence to exploitative strategies in adulthood - where individuals capitalise on known resources. This developmental transition may be disrupted by psychopathology, as there is emerging evidence of biases in explore/exploit choices in mental health problems. Explore/exploit choices may be an informative marker for mental health across development and future research should consider this feature of decision-making as a target for clinical intervention.

A neurocognitive model of early onset persistent and desistant antisocial behavior in early adulthood

It remains unclear which functional and neurobiological mechanisms are associated with persistent and desistant antisocial behavior in early adulthood. We reviewed the empirical literature and propose a neurocognitive social information processing model for early onset persistent and desistant antisocial behavior in early adulthood, focusing on how young adults evaluate, act upon, monitor, and learn about their goals and self traits. Based on the reviewed literature, we propose that persistent antisocial behavior is characterized by domain-general impairments in self-relevant and goal-related information processing, regulation, and learning, which is accompanied by altered activity in fronto-limbic brain areas. We propose that desistant antisocial development is associated with more effortful information processing, regulation and learning, that possibly balances self-relevant goals and specific situational characteristics. The proposed framework advances insights by considering individual differences such as psychopathic personality traits, and specific emotional characteristics (e.g., valence of social cues), to further illuminate functional and neural mechanisms underlying heterogenous developmental pathways. Finally, we address important open questions and offer suggestions for future research to improve scientific knowledge on general and context-specific expression and development of antisocial behavior in early adulthood.

Expecting the unexpected: a review of learning under uncertainty across development

Many of our decisions take place under uncertainty. To successfully navigate the environment, individuals need to estimate the degree of uncertainty and adapt their behaviors accordingly by learning from experiences. However, uncertainty is a broad construct and distinct types of uncertainty may differentially influence our learning. We provide a semi-systematic review to illustrate cognitive and neurobiological processes involved in learning under two types of uncertainty: learning in environments with stochastic outcomes, and with volatile outcomes. We specifically reviewed studies (N = 26 studies) that included an adolescent population, because adolescence is a period in life characterized by heightened exploration and learning, as well as heightened uncertainty due to experiencing many new, often social, environments. Until now, reviews have not comprehensively compared learning under distinct types of uncertainties in this age range. Our main findings show that although the overall developmental patterns were mixed, most studies indicate that learning from stochastic outcomes, as indicated by increased accuracy in performance, improved with age. We also found that adolescents tended to have an advantage compared with adults and children when learning from volatile outcomes. We discuss potential mechanisms explaining these age-related differences and conclude by outlining future research directions.

Sensitivity and specificity in affective and social learning in adolescence

Adolescence is a period of heightened affective and social sensitivity. In this review we address how this increased sensitivity influences associative learning. Based on recent evidence from human and rodent studies, as well as advances in computational biology, we suggest that, compared to other age groups, adolescents show features of heightened Pavlovian learning but tend to perform worse than adults at instrumental learning. Because Pavlovian learning does not involve decision-making, whereas instrumental learning does, we propose that these developmental differences might be due to heightened sensitivity to rewards and threats in adolescence, coupled with a lower specificity of responding. We discuss the implications of these findings for adolescent mental health and education.

l-DOPA and oxytocin influence the neurocomputational mechanisms of self-benefitting and prosocial reinforcement learning

Humans learn through reinforcement, particularly when outcomes are unexpected. Recent research suggests similar mechanisms drive how we learn to benefit other people, that is, how we learn to be prosocial. Yet the neurochemical mechanisms underlying such prosocial computations remain poorly understood. Here, we investigated whether pharmacological manipulation of oxytocin and dopamine influence the neurocomputational mechanisms underlying self-benefitting and prosocial reinforcement learning. Using a double-blind placebo-controlled cross-over design, we administered intranasal oxytocin (24 IU), dopamine precursor l-DOPA (100 mg + 25 mg carbidopa), or placebo over three sessions. Participants performed a probabilistic reinforcement learning task with potential rewards for themselves, another participant, or no one, during functional magnetic resonance imaging. Computational models of reinforcement learning were used to calculate prediction errors (PEs) and learning rates. Participants behavior was best explained by a model with different learning rates for each recipient, but these were unaffected by either drug. On the neural level, however, both drugs blunted PE signaling in the ventral striatum and led to negative signaling of PEs in the anterior mid-cingulate cortex, dorsolateral prefrontal cortex, inferior parietal gyrus, and precentral gyrus, compared to placebo, and regardless of recipient. Oxytocin (versus placebo) administration was additionally associated with opposing tracking of self-benefitting versus prosocial PEs in dorsal anterior cingulate cortex, insula and superior temporal gyrus. These findings suggest that both l-DOPA and oxytocin induce a context-independent shift from positive towards negative tracking of PEs during learning. Moreover, oxytocin may have opposing effects on PE signaling when learning to benefit oneself versus another.

Puberty initiates a unique stage of social learning and development prior to adulthood: Insights from studies of adolescence in wild chimpanzees

In humans, puberty initiates a period of rapid growth, change, and formative neurobehavioral development. Brain and behavior changes during this maturational window contribute to opportunities for social learning. Here we provide new insights into adolescence as a unique period of social learning and development by describing field studies of our closest living relatives, chimpanzees. Like humans, chimpanzees have a multiyear juvenile life stage between weaning and puberty onset followed by a multiyear adolescent life stage after pubertal onset but prior to socially-recognized adulthood. As they develop increasing autonomy from caregivers, adolescent chimpanzees explore and develop many different types of social relationships with a wide range of individuals in a highly flexible social environment. We describe how adolescent social motivations and experiences differ from those of juveniles and adults and expose adolescents to high levels of uncertainty, risk, and vulnerability, as well as opportunities for adaptive social learning. We discuss how these adolescent learning experiences may be shaped by early life and in turn shape varied adult social outcomes. We outline how future chimpanzee field research can contribute in new ways to a more integrative interdisciplinary understanding of adolescence as a developmental window of adaptive social learning and resilience.

Social learning across adolescence: A Bayesian neurocognitive perspective

Adolescence is a period of social re-orientation in which we are generally more prone to peer influence and the updating of our beliefs based on social information, also called social learning, than in any other stage of our life. However, how do we know when to use social information and whose information to use and how does this ability develop across adolescence? Here, we review the social learning literature from a behavioral, neural and computational viewpoint, focusing on the development of brain systems related to executive functioning, value-based decision-making and social cognition. We put forward a Bayesian reinforcement learning framework that incorporates social learning about value associated with particular behavior and uncertainty in our environment and experiences. We discuss how this framework can inform us about developmental changes in social learning, including how the assessment of uncertainty and the ability to adaptively discriminate between information from different social sources change across adolescence. By combining reward-based decision-making in the domains of both informational and normative influence, this framework explains both negative and positive social peer influence in adolescence.

A methodological perspective on learning in the developing brain

The brain undergoes profound development across childhood and adolescence, including continuous changes in brain morphology, connectivity, and functioning that are, in part, dependent on one's experiences. These neurobiological changes are accompanied by significant changes in children's and adolescents' cognitive learning. By drawing from studies in the domains of reading, reinforcement learning, and learning difficulties, we present a brief overview of methodological approaches and research designs that bridge brain- and behavioral research on learning. We argue that ultimately these methods and designs may help to unravel questions such as why learning interventions work, what learning computations change across development, and how learning difficulties are distinct between individuals.