Neurophysiology of Motivated Learning: Adaptive Mechanisms Underlying Cognitive Bias in Depression

Motive control of unconscious inference: The limbic base of adaptive Bayes

Current computational models of neocortical processing, described as predictive coding theory, are providing new ways of understanding Helmholtz's classical insight that perception cannot proceed in a data-driven fashion, but instead requires unconscious inference based on prior experience. Predictive coding is a Bayesian process, in which the operations at each lower level of the cortical hierarchy are predicted by prior projections of expectancies from a higher level, and are then updated by error-correction with lower level evidence. To generalize the predictive coding model to the human neocortex as a whole requires aligning the Bayesian negotiation of prior expectancies with sensory and motor evidence not only within the connectional architecture of the neocortex (primary sensory/motor, unimodal association areas, and heteromodal association areas) but also with the limbic cortex that forms the base for the adaptive control of the heteromodal areas and thereby the cerebral hemisphere as a whole. By reviewing the current evidence on the anatomy of the human corticolimbic connectivity (now formalized as the Structural Model) we address the problem of how limbic cortex resonates to the homeostatic, personal significance of events to provide Bayesian priors to organize the operations of predictive coding across the multiple levels of the neocortex. By reviewing both classical evidence and current models of control exerted between limbic and neocortical networks, we suggest a neuropsychological theory of human cognition, the adaptive Bayes process model, in which prior expectancies are not simply rationalized propositions, but rather affectively-charged expectancies that bias the interpretation of sensory data and action affordances to support allostasis, the motive control of expectancies for future events.

Effects of early life and current housing on sensitivity to reward loss in a successive negative contrast test in pigs

Animals in a negative affective state seem to be more sensitive to reward loss, i.e. an unexpected decrease in reward size. The aim of this study was to investigate whether early-life and current enriched vs. barren housing conditions affect the sensitivity to reward loss in pigs using a successive negative contrast test. Pigs (n = 64 from 32 pens) were housed in barren or enriched conditions from birth onwards, and at 7 weeks of age experienced either a switch in housing conditions (from barren to enriched or vice versa) or not. Allotting pigs to the different treatments was balanced for coping style (proactive vs. reactive). One pig per pen was trained to run for a large reward and one for a small reward. Reward loss was introduced for pigs receiving the large reward after 11 days (reward downshift), i.e. from then onwards, they received the small reward. Pigs housed in barren conditions throughout life generally had a lower probability and higher latency to get the reward than other pigs. Proactive pigs ran overall slower than reactive pigs. After the reward downshift, all pigs ran slower. Nevertheless, reward downshift increased the latency and reduced the probability to get to the reward, but only in pigs exposed to barren conditions in early life, which thus were more sensitive to reward loss than pigs from enriched early life housing. In conclusion, barren housed pigs seemed overall less motivated for the reward, and early life housing conditions had long-term effects on the sensitivity to reward loss.

Brain-Based Biomarkers for the Treatment of Depression: Evolution of an Idea

An ambition of depression biomarker research is to augment psychometric and cognitive assessment of clinically relevant phenomena with neural measures. Although such applications have been slow to arrive, we observe a steady evolution of the idea and anticipate emerging technologies with some optimism. To highlight critical themes and innovations in depression biomarker research, we take as our point of reference a specific research narrative. We begin with an early model of frontal-limbic dysfunction, which represents a conceptual shift from localized pathology to understanding symptoms as an emergent property of distributed networks. Over the decades, this model accommodates perspectives from neurology, psychiatry, clinical, and cognitive neuroscience, and preserves past insight as more complex methods become available. We also track the expanding mission of brain biomarker research: from the development of diagnostic tools to treatment selection algorithms, measures of neurocognitive functioning and novel targets for neuromodulation. To conclude, we draw from this particular research narrative future directions for biomarker research. We emphasize integration of measurement modalities to describe dynamic change in domain-general networks, and we speculate that a brain-based framework for psychiatric problems may dissolve classical diagnostic and disciplinary boundaries. (JINS, 2017, 23, 870-880).

Critical periods for the neurodevelopmental processes of externalizing and internalizing

Research on neurobiological development is providing insight into the nature and mechanisms of human neural plasticity. These mechanisms appear to support two different forms of developmental learning. One form of learning could be described as externalizing, in which neural representations are highly responsive to environmental influences, as the child typically operates under a mode of hedonic approach. A second form of learning supports internalizing, in which motive control separates attention and self-regulation from the immediate influences of the context, particularly when the child faces conditions of avoidance and threat. The dorsal cortical networks of externalizing are organized around dorsal limbic (cingulate, septal, lateral hypothalamic, hippocampal, and ventral striatal) circuits. In contrast, the ventral cortical networks of internalizing are organized around ventral limbic (anterior temporal and orbital cortex, extended amygdala, dorsal striatal, and mediodorsal thalamic) circuits. These dual divisions of the limbic system in turn self-regulate their arousal levels through different brain stem and forebrain neuromodulator projection systems, with dorsal corticolimbic networks regulated strongly by locus coeruleus norepinephrine and brain stem raphe nucleus serotonin projection systems, and ventral corticolimbic networks regulated by ventral tegmental dopamine and forebrain acetylcholine projections. Because the arousal control systems appear to regulate specific properties of neural plasticity in development, an analysis of these systems explains differences between externalizing and internalizing at multiple levels of neural and psychological self-regulation. In neuroscience, the concept of critical periods has been applied to times when experience is essential for the maturation of sensory systems. In a more general neuropsychological analysis, certain periods of the child's development require successful self-regulation through the differential capacities for externalizing and internalizing.

Internally directed cognition and mindfulness: an integrative perspective derived from predictive and reactive control systems theory

In the present paper, we will apply the predictive and reactive control systems (PARCS) theory as a framework that integrates competing theories of neural substrates of awareness by describing the "default mode network" (DMN) and anterior insula (AI) as parts of two different behavioral and homeostatic control systems. The DMN, a network that becomes active at rest when there is no external stimulation or task to perform, has been implicated in self-reflective awareness and prospection. By contrast, the AI is associated with awareness and task-related attention. This has led to competing theories stressing the role of the DMN in self-awareness vs. the role of interoceptive and emotional information integration in the AI in awareness of the emotional moment. In PARCS, the respective functions of the DMN and AI in a specific control system explains their association with different qualities of awareness, and how mental states can shift from one state (e.g., prospective self-reflection) to the other (e.g., awareness of the emotional moment) depending on the relative dominance of control systems. These shifts between reactive and predictive control are part of processes that enable the intake of novel information, integration of this novel information within existing knowledge structures, and the creation of a continuous personal context in which novel information can be integrated and understood. As such, PARCS can explain key characteristics of mental states, such as their temporal and spatial focus (e.g., a focus on the here and now vs. the future; a first person vs. a third person perspective). PARCS further relates mental states to brain states and functions, such as activation of the DMN or hemispheric asymmetry in frontal cortical functions. Together, PARCS deepens the understanding of a broad range of mental states, including mindfulness, mind wandering, rumination, autobiographical memory, imagery, and the experience of self.

Why social attachment and oxytocin protect against addiction and stress: Insights from the dynamics between ventral and dorsal corticostriatal systems

The present article advances a neurobiological model of the reciprocal associations between social attachment and drug abuse, and social attachment and chronic stress, as overlapping systems are involved in stress coping and social attachment. In terms of coping, responding to a novel stressor or challenge involves initial novelty processing and activation of learning mechanisms that allow habituation to the stressor through familiarization. Similarly, social attachments are initially formed by being attracted by rewarding properties of an as-yet novel individual, and subsequently developing feelings of attachment towards the familiarized individual. Attachment and familiarization increase the availability of "internal working models" for the control of behavior and emotion, which may explain why secure attachments are associated with increased resilience in the face of stress, accompanied by less reactive reward responding (i.e., increased resilience against drug addiction). The present article seeks to illuminate the role of the neuropeptide oxytocin, which may be involved in the overlapping mechanisms of stable attachment formation and stress coping by shifting processing from novelty and reward seeking to appreciation of familiarity. Oxytocin may accomplish this by facilitating a ventral-to-dorsal shift in activation in corticostriatal loops, which produces a shift from a reactive reward drive (wanting) to stable appreciation of familiar social aspects ("liking" or "loving"). The authors suggest that through dopaminergic, serotonergic and endogenous opioid mechanisms, oxytocin is involved in shifting the balance between wanting and liking in corticostriatal loops by facilitating consolidation of social information from ventral reactive reward systems to dorsal internal working models that aid in prospectively selecting optimal actions in the future, increasing resilience in the face of stress and addiction.

Fronto-striato-cerebellar dysregulation in adolescents with depression during motivated attention

BACKGROUND

Pediatric major depressive disorder (MDD) is associated with deficits in sustained attention, thought to be related to underlying motivation deficits. This hypothesis, however, has never directly been tested using functional magnetic resonance imaging. In this study, we investigated the neurofunctional correlates of the interplay between attention and motivation in medication-naive pediatric MDD using a rewarded sustained attention task.

METHODS

Functional magnetic resonance imaging was used to compare brain activation between 20 medication-naïve, noncomorbid, first-episode adolescents with MDD aged 13 to 18 years and 21 gender-, age-, and IQ-matched healthy adolescents. Participants performed a sustained attention task with and without a monetary reward to assess the impact of reward on sustained attention networks.

RESULTS

During nonrewarded sustained attention, adolescents with MDD showed reduced activation compared with healthy control subjects in occipital cortex. When sustained attention was rewarded, however, the underactivation in adolescents with MDD was in an extensive right hemispheric network of inferior fronto-striato-thalamic attention and limbic hippocampus-anterior cingulate reward processing areas. Major depressive disorder patients showed increased activation in cerebellum, which correlated with reduced frontal activation and depressive symptoms, suggesting compensatory response. Further analysis showed that reward upregulated fronto-striatal and hippocampal/temporal activation in control subjects but deactivated these regions in MDD, with opposite effects in the cerebellum.

CONCLUSIONS

Medication-naïve MDD adolescents show abnormalities in the regulation in fronto-striato-cerebellar brain regions involved in attention and reward during motivated but not unmotivated attention. This suggests a dysfunctional interplay between motivation and cognition in pediatric MDD, where motivation appears less capable of upregulating attention networks relative to healthy youths.

Frontolimbic activity in a frustrating task: Covariation between patterns of coping and individual differences in externalizing and internalizing symptoms

Many problem behaviors in youth have been attributed to maladaptive self-regulation in response to frustration. Frontolimbic networks that promote flexible as well as over- and undercontrolled regulation could provide evidence linking cortical mechanisms of self-regulation to the development of internalizing or externalizing symptomology. Specifically, ineffective dorsally mediated inhibitory control may be associated with rule-breaking and substance use behaviors, whereas overengagement of ventral limbic systems responsible for self-monitoring of errors may increase risk of developing anxious and depressed symptomology. In this study, a sample of 9- to 13-year-old children were presented with an emotional go/no-go task. Event-related potentials were used to identify differences in cortical mechanisms related to inhibitory control (indexed with the stimulus-locked medial frontal negativity) and self-monitoring (indexed with the error-related negativity). These measurements were then related to externalizing and internalizing behaviors. As predicted, externalizing problems were associated with smaller medial frontal negativity amplitudes, which indicate undercontrolled self-regulation and poor dorsal mediation of actions. Internalizing symptoms were related to larger error-related negativity amplitudes, demonstrating overregulation and overengagement of ventral limbic systems. These findings suggest that the use of event-related potential methodology with paradigms that elicit cognition–emotion can provide insight into the neural mechanisms of regulatory deficits that result in problem behaviors in youth.

Serotonin: modulator of a drive to withdraw

Serotonin is a fundamental neuromodulator in both vertebrate and invertebrate nervous systems, with a suspected role in many human mental disorders. Yet, because of the complexity of serotonergic function, researchers have been unable to agree on a general theory. One function suggested for serotonin systems is the avoidance of threat. We propose and review evidence for an alternative hypothesis, that a phylogenetically primitive of function of serotonin is to oppose the activating neuromodulators (particularly noradrenalin and dopamine). The functional effect of this opposition can be seen as applying a drive to withdraw from dangerous, aversive or high stimulation environments. Proposing that serotonin is involved in a drive to withdraw and seek contentment, instead of a drive to avoid, may be compatible with several lines of evidence on serotonin function and may facilitate a better understanding of serotonergic neuromodulation in human psychopathology.

Corticolimbic mechanisms in the control of trial and error learning

As learning progresses, human and animal studies suggest that a frontal executive system is strongly involved early in learning, whereas a posterior monitoring and control system comes online as learning progresses. In a previous study, we employed dense array EEG methodology to delineate the involvement of these two systems as human participants learn, through trial and error, to associate manual responses with arbitrary digit codes. The results were generally consistent with the dual-system learning model, pointing to the importance of both systems as learning progressed. In the present study, we replicate and extend the previous findings by examining the brain responses to error trials as well as examine the activity of these two systems' response to feedback processing. The results confirmed the role of these two systems in learning but they also provide a more complex view of their makeup and function. The frontal system includes ventral (inferior frontal gyrus, ventral anterior cingulate cortex, anterior temporal lobe) corticolimbic structures that are involved early in learning whereas the posterior system includes dorsal (anterior and posterior cingulate and medial temporal lobe) corticolimbic circuits that are engaged later in learning. Importantly, the engagement of each system during the course of learning is dependent on the nature of the events within the learning task.

Sensitivity to reward loss as an indicator of animal emotion and welfare

The scientific study of animal emotion is an important emerging discipline in subjects ranging from neuroscience to animal welfare research. In the absence of direct measures of conscious emotion, indirect behavioural and physiological measures are used. However, these may have significant limitations (e.g. indicating emotional arousal but not valence (positivity versus negativity)). A new approach, taking its impetus from human studies, proposes that biases in information processing, and underlying mechanisms relating to the evaluation of reward gains and losses, may reliably reflect emotional valence in animals. In general, people are more sensitive to reward losses than gains, but people in a negative affective state (e.g. depression) are particularly sensitive to losses. This may underlie broader findings such as an enhanced attention to, and memory of, negative events in depressed individuals. Here we show that rats in unenriched housing, who typically exhibit indicators of poorer welfare and a more negative affective state than those in enriched housing, display a prolonged response to a decrease in anticipated food reward, indicating enhanced sensitivity to reward loss. Sensitivity to reward reduction may thus be a valuable new indicator of animal emotion and welfare.