Value-Related Neuronal Responses in the Human Amygdala during Observational Learning

Association between subcortical nuclei volume changes and cognition in preschool-aged children with tetralogy of Fallot after corrective surgery: a cross-sectional study

BACKGROUND

Neurocognitive disorders frequently occur in patients with cyanotic congenital heart disease (CCHD) because of the hemodynamic abnormalities induced by preoperative cardiac structural changes. We aimed to evaluate subcortical nuclei volume changes and cognition in postoperative tetralogy of Fallot (TOF) children, and analyze their relationship with preoperative cardiac structural changes.

METHODS

This case-control study involved thirty-six children with repaired TOF and twenty-nine healthy controls (HCs). We utilized three-dimensional (3D) T1-weighted high-resolution structural images alongside the Wechsler Preschool and Primary Scale of Intelligence-Fourth Edition (WPPSI-IV) to evaluate the cognitive differences between the TOF and HC group.

RESULTS

We observed notable differences in subcortical nuclei volume between the TOF and HC group, specifically in the left amygdala nucleus (LAM, TOF: 1292.60 ± 155.57; HC: 1436.27 ± 140.62, p < 0.001), left thalamus proper nucleus (LTHA, TOF: 6771.54 ± 666.03; HC: 7435.36 ± 532.84, p < 0.001), and right thalamus proper nucleus (RTHA, TOF: 6514.61 ± 715.23; HC: 7162.94 ± 554.60, p < 0.001). Furthermore, a diminished integrity of LAM ( β:-19.828, 95% CI: -36.462, -3.193), which showed an inverse relationship with the size of the preoperative ventricular septal defect (VSD), correlated with lower working memory indices in children with TOF.

CONCLUSIONS

Our findings indicate that subcortical nuclei structural injuries possibly potentially stemming from cardiac anatomical abnormalities, are associated with impaired working memory in preschool-aged children with TOF. The LAM in particular may serve as a potential biomarker for neurocognitive deficits in TOF, offering predictive value for future neurodevelopmental outcomes, and shedding light on the neurophysiological mechanisms of these cognitive impairments.

Encoding of Predictive Associations in Human Prefrontal and Medial Temporal Neurons During Pavlovian Appetitive Conditioning

Pavlovian conditioning is thought to involve the formation of learned associations between stimuli and values, and between stimuli and specific features of outcomes. Here, we leveraged human single neuron recordings in ventromedial prefrontal, dorsomedial frontal, hippocampus, and amygdala while patients of both sexes performed an appetitive Pavlovian conditioning task probing both stimulus-value and stimulus-stimulus associations. Ventromedial prefrontal cortex encoded predictive value along with the amygdala, and also encoded predictions about the identity of stimuli that would subsequently be presented, suggesting a role for neurons in this region in encoding predictive information beyond value. Unsigned error signals were found in dorsomedial frontal areas and hippocampus, potentially supporting learning of non-value related outcome features. Our findings implicate distinct human prefrontal and medial temporal neuronal populations in mediating predictive associations which could partially support model-based mechanisms during Pavlovian conditioning.

Observational reinforcement learning in children and young adults

Observational learning is essential for the acquisition of new behavior in educational practices and daily life and serves as an important mechanism for human cognitive and social-emotional development. However, we know little about its underlying neurocomputational mechanisms from a developmental perspective. In this study we used model-based fMRI to investigate differences in observational learning and individual learning between children and younger adults. Prediction errors (PE), the difference between experienced and predicted outcomes, related positively to striatal and ventral medial prefrontal cortex activation during individual learning and showed no age-related differences. PE-related activation during observational learning was more pronounced when outcomes were worse than predicted. Particularly, negative PE-coding in the dorsal medial prefrontal cortex was stronger in adults compared to children and was associated with improved observational learning in children and adults. The current findings pave the way to better understand observational learning challenges across development and educational settings.

Temporally organized representations of reward and risk in the human brain

The value and uncertainty associated with choice alternatives constitute critical features relevant for decisions. However, the manner in which reward and risk representations are temporally organized in the brain remains elusive. Here we leverage the spatiotemporal precision of intracranial electroencephalography, along with a simple card game designed to elicit the unfolding computation of a set of reward and risk variables, to uncover this temporal organization. Reward outcome representations across wide-spread regions follow a sequential order along the anteroposterior axis of the brain. In contrast, expected value can be decoded from multiple regions at the same time, and error signals in both reward and risk domains reflect a mixture of sequential and parallel encoding. We further highlight the role of the anterior insula in generalizing between reward prediction error and risk prediction error codes. Together our results emphasize the importance of neural dynamics for understanding value-based decisions under uncertainty.

Visuo-frontal interactions during social learning in freely moving macaques

Social interactions represent a ubiquitous aspect of our everyday life that we acquire by interpreting and responding to visual cues from conspecifics1. However, despite the general acceptance of this view, how visual information is used to guide the decision to cooperate is unknown. Here, we wirelessly recorded the spiking activity of populations of neurons in the visual and prefrontal cortex in conjunction with wireless recordings of oculomotor events while freely moving macaques engaged in social cooperation. As animals learned to cooperate, visual and executive areas refined the representation of social variables, such as the conspecific or reward, by distributing socially relevant information among neurons in each area. Decoding population activity showed that viewing social cues influences the decision to cooperate. Learning social events increased coordinated spiking between visual and prefrontal cortical neurons, which was associated with improved accuracy of neural populations to encode social cues and the decision to cooperate. These results indicate that the visual-frontal cortical network prioritizes relevant sensory information to facilitate learning social interactions while freely moving macaques interact in a naturalistic environment.

Local field potentials, spiking activity, and receptive fields in human visual cortex

The concept of receptive field (RF) is central to sensory neuroscience. Neuronal RF properties have been substantially studied in animals, while those in humans remain nearly unexplored. Here, we measured neuronal RFs with intracranial local field potentials (LFPs) and spiking activity in human visual cortex (V1/V2/V3). We recorded LFPs via macro-contacts and discovered that RF sizes estimated from low-frequency activity (LFA, 0.5-30 Hz) were larger than those estimated from low-gamma activity (LGA, 30-60 Hz) and high-gamma activity (HGA, 60-150 Hz). We then took a rare opportunity to record LFPs and spiking activity via microwires in V1 simultaneously. We found that RF sizes and temporal profiles measured from LGA and HGA closely matched those from spiking activity. In sum, this study reveals that spiking activity of neurons in human visual cortex could be well approximated by LGA and HGA in RF estimation and temporal profile measurement, implying the pivotal functions of LGA and HGA in early visual information processing.

"Switching" between fast and slow processes is just reward-based branching

Shortcuts to goals are rewarded by faster attainment and punished by more frequent failure, so selection of the various kinds - heuristics, cached sequences (habits or macros), gut instincts - depends on reward history just like other kinds of choice. The speeds of shortcuts lie on continua along with speeds of deliberation, and these continua have no obvious separation points.

Temporally organized representations of reward and risk in the human brain

The value and uncertainty associated with choice alternatives constitute critical features along which decisions are made. While the neural substrates supporting reward and risk processing have been investigated, the temporal organization by which these computations are encoded remains elusive. Here we leverage the high spatiotemporal precision of intracranial electroencephalography (iEEG) to uncover how representations of decision-related computations unfold in time. We present evidence of locally distributed representations of reward and risk variables that are temporally organized across multiple regions of interest. Reward outcome representations across wide-spread regions follow a temporally cascading order along the anteroposterior axis of the brain. In contrast, expected value can be decoded from multiple regions at the same time, and error signals in both reward and risk domains reflect a mixture of sequential and parallel encoding. We highlight the role of the anterior insula in generalizing between reward prediction error (RePE) and risk prediction error (RiPE), within which the encoding of RePE in the distributed iEEG signal predicts RiPE. Together our results emphasize the utility of uncovering temporal dynamics in the human brain for understanding how computational processes critical for value-based decisions under uncertainty unfold.

Unselfish traits and social decision-making patterns characterize six populations of real-world extraordinary altruists

Acts of extraordinary, costly altruism, in which significant risks or costs are assumed to benefit strangers, have long represented a motivational puzzle. But the features that consistently distinguish individuals who engage in such acts have not been identified. We assess six groups of real-world extraordinary altruists who had performed costly or risky and normatively rare (<0.00005% per capita) altruistic acts: heroic rescues, non-directed and directed kidney donations, liver donations, marrow or hematopoietic stem cell donations, and humanitarian aid work. Here, we show that the features that best distinguish altruists from controls are traits and decision-making patterns indicating unusually high valuation of others' outcomes: high Honesty-Humility, reduced Social Discounting, and reduced Personal Distress. Two independent samples of adults who were asked what traits would characterize altruists failed to predict this pattern. These findings suggest that theories regarding self-focused motivations for altruism (e.g., self-enhancing reciprocity, reputation enhancement) alone are insufficient explanations for acts of real-world self-sacrifice.

Urbach-Wiethe disease in a young patient without apparent amygdala calcification

Urbach-Wiethe disease is an extremely rare genetically-based syndrome which usually leads to dermatological and neurological changes. Neurologically, the amygdaloid region is primarily bilaterally affected. Therefore, several functions modulated by the amygdala are changed in patients with Urbach-Wiethe disease. As the neurological alterations evolve only gradually, it is particularly important to determine the cognitive and brain status of a juvenile. The patient described here was seen briefly at age 9 and tested neuropsychologically at age 19; furthermore, computer tomography and magnetic resonance imaging of his head was done. There were no important abnormalities in the brain, which is unusual in the light of previous data from other patients. On the cognitive level, the patient was generally within normal limits. However, he had mild problems in attention and concentration, and more prominent problems in emotional processing domain, and in personality dimensions. It is concluded that amygdala calcifications in Urbach-Wiethe disease take place progressively-possibly underpinned by genetic and gender variables; this can subsequently allow psychosocial-social factors (such a proper education and socialization) and biological factors (compensatory neuroplasticity) to retard and diminish the development of socio-emotional and cognitive deteriorations, though the outcome of questionnaires indicates that such patients may develop substantial concerns as to their future life and well-being.

Reinforcement learning with associative or discriminative generalization across states and actions: fMRI at 3 T and 7 T

The model-free algorithms of "reinforcement learning" (RL) have gained clout across disciplines, but so too have model-based alternatives. The present study emphasizes other dimensions of this model space in consideration of associative or discriminative generalization across states and actions. This "generalized reinforcement learning" (GRL) model, a frugal extension of RL, parsimoniously retains the single reward-prediction error (RPE), but the scope of learning goes beyond the experienced state and action. Instead, the generalized RPE is efficiently relayed for bidirectional counterfactual updating of value estimates for other representations. Aided by structural information but as an implicit rather than explicit cognitive map, GRL provided the most precise account of human behavior and individual differences in a reversal-learning task with hierarchical structure that encouraged inverse generalization across both states and actions. Reflecting inference that could be true, false (i.e., overgeneralization), or absent (i.e., undergeneralization), state generalization distinguished those who learned well more so than action generalization. With high-resolution high-field fMRI targeting the dopaminergic midbrain, the GRL model's RPE signals (alongside value and decision signals) were localized within not only the striatum but also the substantia nigra and the ventral tegmental area, including specific effects of generalization that also extend to the hippocampus. Factoring in generalization as a multidimensional process in value-based learning, these findings shed light on complexities that, while challenging classic RL, can still be resolved within the bounds of its core computations.

Learning whom to cooperate with: neurocomputational mechanisms for choosing cooperative partners

Cooperation is fundamental for survival and a functioning society. With substantial individual variability in cooperativeness, we must learn whom to cooperate with, and often make these decisions on behalf of others. Understanding how people learn about the cooperativeness of others, and the neurocomputational mechanisms supporting this learning, is therefore essential. During functional magnetic resonance imaging scanning, participants completed a novel cooperation-partner-choice task where they learned to choose between cooperative and uncooperative partners through trial-and-error both for themselves and vicariously for another person. Interestingly, when choosing for themselves, participants made faster and more exploitative choices than when choosing for another person. Activity in the ventral striatum preferentially responded to prediction errors (PEs) during self-learning, whereas activity in the perigenual anterior cingulate cortex (ACC) signaled both personal and vicarious PEs. Multivariate pattern analyses showed distinct coding of personal and vicarious choice-making and outcome processing in the temporoparietal junction (TPJ), dorsal ACC, and striatum. Moreover, in right TPJ the activity pattern that differentiated self and other outcomes was associated with individual differences in exploitation tendency. We reveal neurocomputational mechanisms supporting cooperative learning and show that this learning is reflected in trial-by-trial univariate signals and multivariate patterns that can distinguish personal and vicarious choices.

Selective Prefrontal-Amygdala Circuit Interactions Underlie Social and Nonsocial Valuation in Rhesus Macaques

Lesion studies in macaques suggest dissociable functions of the orbitofrontal cortex (OFC) and medial frontal cortex (MFC), with OFC being essential for goal-directed decision-making and MFC supporting social cognition. Bilateral amygdala damage results in impairments in both of these domains. There are extensive reciprocal connections between these prefrontal areas and the amygdala; however, it is not known whether the dissociable roles of OFC and MFC depend on functional interactions with the amygdala. To test this possibility, we compared the performance of male rhesus macaques (Macaca mulatta) with crossed surgical disconnection of the amygdala and either MFC (MFC × AMY, n = 4) or OFC (OFC × AMY, n = 4) to a group of unoperated controls (CON, n = 5). All monkeys were assessed for their performance on two tasks to measure the following: (1) food-retrieval latencies while viewing videos of social and nonsocial stimuli in a test of social interest and (2) object choices based on current food value using reinforcer devaluation in a test of goal-directed decision-making. Compared with the CON group, the MFC × AMY group, but not the OFC × AMY group, showed significantly reduced food-retrieval latencies while viewing videos of conspecifics, indicating reduced social valuation and/or interest. By contrast, on the devaluation task, group OFC × AMY, but not group MFC × AMY, displayed deficits on object choices following changes in food value. These data indicate that the MFC and OFC must functionally interact with the amygdala to support normative social and nonsocial valuation, respectively.SIGNIFICANCE STATEMENT Ascribing value to conspecifics (social) versus objects (nonsocial) may be supported by distinct but overlapping brain networks. Here, we test whether two nonoverlapping regions of the prefrontal cortex, the medial frontal cortex and the orbitofrontal cortex, must causally interact with the amygdala to sustain social valuation and goal-directed decision-making, respectively. We found that these prefrontal-amygdala circuits are functionally dissociable, lending support for the idea that medial frontal and orbital frontal cortex make independent contributions to cognitive appraisals of the environment. These data provide a neural framework for distinct value assignment processes and may enhance our understanding of the cognitive deficits observed following brain injury or in the development of mental health disorders.

Correlation Between Amygdala Nuclei Volumes and Memory in Cognitively Normal Adults Carrying the ApoE ε3/ε3 Allele

The amygdala is known to be related to cognitive function. In this study, we used an automated approach to segment the amygdala into nine nuclei and evaluated amygdala and nuclei volumetric changes across the adult lifespan in subjects carrying the apolipoprotein E (ApoE) ε3/ε3 allele, and we related those changes to memory function alteration. We found that except the left medial nucleus (Me), whose volume decreased in the old group compared with the middle-early group, all other nuclei volumes presented a significant decline in the old group compared with the young group. Left accessory basal nucleus (AB) and left cortico-amygdaloid transition area (CAT) volumes were also diminished in the middle-late group. In addition, immediate memory recall is impaired by the process of aging, whereas delayed recall and delayed recognition memory functions were not significantly changed. We found significant positive correlations between immediate recall scores and volumes of the bilateral basal nucleus (Ba), AB, anterior amygdaloid area (AAA), CAT, whole amygdala, left lateral nucleus (La), left paralaminar nucleus (PL), and right cortical nucleus (Co). The results suggest that immediate recall memory decline might be associated with volumetric reduction of the amygdala and its nuclei, and the left AB and left CAT might be considered as potential imaging biomarkers of memory decline in aging.

Amygdala function in emotion, cognition, and behavior

The amygdala is a core structure in the anterior medial temporal lobe, with an important role in several brain functions involving memory, emotion, perception, social cognition, and even awareness. As a key brain structure for saliency detection, it triggers and controls widespread modulatory signals onto multiple areas of the brain, with a great impact on numerous aspects of adaptive behavior. Here we discuss the neural mechanisms underlying these functions, as established by animal and human research, including insights provided in both healthy and pathological conditions.

The Interpersonal Neuroscience of Social Learning

The study of the brain mechanisms underpinning social behavior is currently undergoing a paradigm shift, moving its focus from single individuals to the real-time interaction among groups of individuals. Although this development opens unprecedented opportunities to study how interpersonal brain activity shapes behaviors through learning, there have been few direct connections to the rich field of learning science. Our article examines how the rapidly developing field of interpersonal neuroscience is (and could be) contributing to our understanding of social learning. To this end, we first review recent research extracting indices of brain-to-brain coupling (BtBC) in the context of social behaviors and, in particular, social learning. We then discuss how studying communicative behaviors during learning can aid the interpretation of BtBC and how studying BtBC can inform our understanding of such behaviors. We then discuss how BtBC and communicative behaviors collectively can predict learning outcomes, and we suggest several causative and mechanistic models. Finally, we highlight key methodological and interpretational challenges as well as exciting opportunities for integrating research in interpersonal neuroscience with social learning, and we propose a multiperson framework for understanding how interpersonal transmission of information between individual brains shapes social learning.

The hierarchical construction of value

Here we argue that the assignment of subjective value to potential outcomes at the time of decision-making is an active process, in which individual features of a potential outcome of varying degrees of abstraction are represented hierarchically and integrated in a weighted fashion to produce an overall value judgment. We implicate the lateral orbital and medial prefrontal cortex in this function, situating these areas more broadly within a hierarchical integration process that takes place throughout the cortex for the ultimate purpose of valuing options to guide decisions.

Differences in resting-state functional connectivity according to the level of impulsiveness in patients with internet gaming disorder

BACKGROUND AND AIMS

Impulsiveness is an important factor in the pathophysiology of Internet gaming disorder (IGD), and regional brain functions can be different depending on the level of impulsiveness. This study aimed to demonstrate that different brain mechanisms are involved depending on the level of impulsiveness among patients with IGD.

METHODS

Resting-state functional MRI data were obtained from 23 IGD patients with high impulsivity, 27 IGD patients with low impulsivity, and 22 healthy controls, and seed-based functional connectivity was compared among the three groups. The seed regions were the ventromedial prefrontal cortex (vmPFC), dorsolateral prefrontal cortex, nucleus accumbens (NAcc), and amygdala.

RESULTS

Connectivity of the vmPFC with the left temporo-parietal junction (TPJ) and NAcc-left insula connectivity were significantly decreased in the patients with high impulsivity, compared with the patients with low impulsivity and healthy controls. On the other hand, amygdala-based connectivity with the left inferior frontal gyrus showed decreases in both patient groups, compared with the healthy controls.

CONCLUSION

These findings may suggest a potential relationship between impulsivity and deficits in reward-related social cognition processes in patients with IGD. In particular, certain interventions targeted at vmPFC-TPJ connectivity, found to be impulsivity-specific brain connectivity, are likely to help with addiction recovery among impulsive patients with IGD.

Watch and Learn: The Cognitive Neuroscience of Learning from Others' Actions

The mirror neuron system has dominated understanding of observational learning from a cognitive neuroscience perspective. Our review highlights the value of observational learning frameworks that integrate a more diverse and distributed set of cognitive and brain systems, including those implicated in sensorimotor transformations, as well as in more general processes such as executive control, reward, and social cognition. We argue that understanding how observational learning occurs in the real world will require neuroscientific frameworks that consider how visuomotor processes interface with more general aspects of cognition, as well as how learning context and action complexity shape mechanisms supporting learning from watching others.

Growing evidence for separate neural mechanisms for attention and consciousness

Our conscious experience of the world seems to go in lockstep with our attentional focus: We tend to see, hear, taste, and feel what we attend to, and vice versa. This tight coupling between attention and consciousness has given rise to the idea that these two phenomena are indivisible. In the late 1950s, the honoree of this special issue, Charles Eriksen, was among a small group of early pioneers that sought to investigate whether a transient increase in overall level of attention (alertness) in response to a noxious stimulus can be decoupled from conscious perception using experimental techniques. Recent years saw a similar debate regarding whether attention and consciousness are two dissociable processes. Initial evidence that attention and consciousness are two separate processes primarily rested on behavioral data. However, the past couple of years witnessed an explosion of studies aimed at testing this conjecture using neuroscientific techniques. Here we provide an overview of these and related empirical studies on the distinction between the neuronal correlates of attention and consciousness, and detail how advancements in theory and technology can bring about a more detailed understanding of the two. We argue that the most promising approach will combine ever-evolving neurophysiological and interventionist tools with quantitative, empirically testable theories of consciousness that are grounded in a mathematically formalized understanding of phenomenology.