The lesser evil: Pavlovian-instrumental transfer & aversive motivation

Food Restriction in Anorexia Nervosa in the Light of Modern Learning Theory: A Narrative Review

Improvements in the clinical management of anorexia nervosa (AN) are urgently needed. To do so, the search for innovative approaches continues at laboratory and clinical levels to translate new findings into more effective treatments. In this sense, modern learning theory provides a unifying framework that connects concepts, methodologies and data from preclinical and clinical research to inspire novel interventions in the field of psychopathology in general, and of disordered eating in particular. Indeed, learning is thought to be a crucial factor in the development/regulation of normal and pathological eating behaviour. Thus, the present review not only tries to provide a comprehensive overview of modern learning research in the field of AN, but also follows a transdiagnostic perspective to offer testable explanations for the origin and maintenance of pathological food rejection. This narrative review was informed by a systematic search of research papers in the electronic databases PsycInfo, Scopus and Web of Science following PRISMA methodology. By considering the number and type of associations (Pavlovian, goal-directed or habitual) and the affective nature of conditioning processes (appetitive versus aversive), this approach can explain many features of AN, including why some patients restrict food intake to the point of life-threatening starvation and others restrict calorie intake to lose weight and binge on a regular basis. Nonetheless, it is striking how little impact modern learning theory has had on the current AN research agenda and practice.

Amygdala-cortical collaboration in reward learning and decision making

Adaptive reward-related decision making requires accurate prospective consideration of the specific outcome of each option and its current desirability. These mental simulations are informed by stored memories of the associative relationships that exist within an environment. In this review, I discuss recent investigations of the function of circuitry between the basolateral amygdala (BLA) and lateral (lOFC) and medial (mOFC) orbitofrontal cortex in the learning and use of associative reward memories. I draw conclusions from data collected using sophisticated behavioral approaches to diagnose the content of appetitive memory in combination with modern circuit dissection tools. I propose that, via their direct bidirectional connections, the BLA and OFC collaborate to help us encode detailed, outcome-specific, state-dependent reward memories and to use those memories to enable the predictions and inferences that support adaptive decision making. Whereas lOFC→BLA projections mediate the encoding of outcome-specific reward memories, mOFC→BLA projections regulate the ability to use these memories to inform reward pursuit decisions. BLA projections to lOFC and mOFC both contribute to using reward memories to guide decision making. The BLA→lOFC pathway mediates the ability to represent the identity of a specific predicted reward and the BLA→mOFC pathway facilitates understanding of the value of predicted events. Thus, I outline a neuronal circuit architecture for reward learning and decision making and provide new testable hypotheses as well as implications for both adaptive and maladaptive decision making.

Aversive motivation and cognitive control

Aversive motivation plays a prominent role in driving individuals to exert cognitive control. However, the complexity of behavioral responses attributed to aversive incentives creates significant challenges for developing a clear understanding of the neural mechanisms of this motivation-control interaction. We review the animal learning, systems neuroscience, and computational literatures to highlight the importance of experimental paradigms that incorporate both motivational context manipulations and mixed motivational components (e.g., bundling of appetitive and aversive incentives). Specifically, we postulate that to understand aversive incentive effects on cognitive control allocation, a critical contextual factor is whether such incentives are associated with negative reinforcement or punishment. We further illustrate how the inclusion of mixed motivational components in experimental paradigms enables increased precision in the measurement of aversive influences on cognitive control. A sharpened experimental and theoretical focus regarding the manipulation and assessment of distinct motivational dimensions promises to advance understanding of the neural, monoaminergic, and computational mechanisms that underlie the interaction of motivation and cognitive control.

Conditional Control of Instrumental Avoidance by Context Following Extinction

Using rodents, three training arrangements (i.e., ABB vs. ABA, AAA vs. AAB and ABB vs. ABC) explored whether extinction influences the expression of avoidance in a manner controlled by context. Retention testing following extinction showed that more avoidance responding (i.e., renewal) was observed when extinguished cues were tested outside of the context where they had undergone extinction. In contrast, response rates were significantly lower when stimuli were tested within the context where extinction learning had occurred. These findings add to the emerging literature assessing the role of Pavlovian extinction processes in the development of instrumental avoidance responding by demonstrating conditional control over extinguished responding by context. This study was conducted using a within-subjects approach that minimized the potential for context-outcome associations to bias responding, and thus, reflects hierarchical control over behavior based on the specific associative status of each tested cue in each training context.