Endogenous opioids facilitate intrinsically-rewarded birdsong

Conditioned preferences: Gated by experience, context, and endocrine systems

Central to the navigation of an ever-changing environment is the ability to form positive associations with places and conspecifics. The functions of location and social conditioned preferences are often studied independently, limiting our understanding of their interplay. Furthermore, a de-emphasis on natural functions of conditioned preferences has led to neurobiological interpretations separated from ecological context. By adopting a naturalistic and ethological perspective, we uncover complexities underlying the expression of conditioned preferences. Development of conditioned preferences is a combination of motivation, reward, associative learning, and context, including for social and spatial environments. Both social- and location-dependent reward-responsive behaviors and their conditioning rely on internal state-gating mechanisms that include neuroendocrine and hormone systems such as opioids, dopamine, testosterone, estradiol, and oxytocin. Such reinforced behavior emerges from mechanisms integrating past experience and current social and environmental conditions. Moreover, social context, environmental stimuli, and internal state gate and modulate motivation and learning via associative reward, shaping the conditioning process. We highlight research incorporating these concepts, focusing on the integration of social neuroendocrine mechanisms and behavioral conditioning. We explore three paradigms: 1) conditioned place preference, 2) conditioned social preference, and 3) social conditioned place preference. We highlight nonclassical species to emphasize the naturalistic applications of these conditioned preferences. To fully appreciate the complex integration of spatial and social information, future research must identify neural networks where endocrine systems exert influence on such behaviors. Such research promises to provide valuable insights into conditioned preferences within a broader naturalistic context.

From grouping and cooperation to menstruation: Spiny mice (Acomys cahirinus) are an emerging mammalian model for sociality and beyond

While spiny mice are primarily used as a model for Type II diabetes and for studying complex tissue regeneration, they are also an emerging model for a variety of studies examining hormones, behavior, and the brain. We began studying the spiny mouse to take advantage of their highly gregarious phenotype to examine how the brain facilitates large group-living. However, this unique rodent can be readily bred and maintained in the lab and can be used to ask a wide variety of scientific questions. In this brief communication we provide an overview of studies that have used spiny mice for exploring physiology and behavior. Additionally, we describe how the spiny mouse can serve as a useful model for researchers interested in studying precocial development, menstruation, cooperation, and various grouping behaviors. With increasingly available technological advancements for non-traditional organisms, spiny mice are well-positioned to become a valuable organism in the behavioral neuroscience community.

Distinct patterns of activity within columns of the periaqueductal gray are associated with functionally distinct birdsongs

Male songbirds produce female-directed songs in spring that convey a state of sexual motivation. Many songbirds also sing in fall flocks in affiliative/gregarious contexts in which song is linked to an intrinsic positive affective state. The periaqueductal gray (PAG) in mammals, which is organized into functional columns, integrates information from multiple brain regions and relays this information to vocal motor areas so that an animal emits a vocal signal reflective of its affective state. Here, we test the hypothesis that distinct columns in the songbird PAG play roles in the distinct affective states communicated by sexually motivated and gregarious song. We quantified the numbers of immediate early gene ZENK-positive cells in 16 PAG subregions in male European starlings (Sturnus vulgaris) after singing gregarious or sexually motivated song. Results suggest that distinct PAG columns in songbirds context-specifically regulate song, agonistic, and courtship behaviors. A second exploratory, functional tract-tracing study also demonstrated that inputs to the PAG from specific subregions of the medial preoptic nucleus may contribute to gregarious song and behaviors indicative of social dominance. Together, findings suggest that conserved PAG columns and inputs from the preoptic nucleus may play a role in context-specific vocal and other social behaviors.

Varied impacts of social relationships on neuroendocrine state

Social relationships, affiliative social attachments, are important for many species. The best studied types of relationships are monogamous pair bonds. However, it remains unclear how generalizable models of pair bonding are across types of social attachments. Zebra finches are a fascinating system to explore the neurobiology of social relationships because they form various adult bonds with both same- and opposite-sex partners. To test whether different bonds are supported by a single brain network, we quantified individuals' neuroendocrine state after either 24 h or 2 weeks of co-housing with a novel same- or opposite-sex partner. We defined neuroendocrine state by the expression of 22 genes related to 4 major signaling pathways (dopamine, steroid, nonapeptide, and opioid) in six brain regions associated with affiliation or communication [nucleus accumbens (NAc), nucleus taeniae of the amygdala (TnA), medial preoptic area (POM), and periaqueductal gray (PAG), ventral tegmental area, and auditory cortex]. Overall, we found dissociable effects of social contexts (same- or opposite-sex partnerships) and duration of co-housing. Social bonding impacted the neuroendocrine state of four regions in males (NAc, TnA, POM, and PAG) and three regions in females (NAc, TnA, and POM). Monogamous pair bonding specifically appeared to impact male NAc. However, the patterns of gene expression in zebra finches were different than has previously been reported in mammals. Together, our results support the view that there are numerous mechanisms regulating social relationships and highlight the need to further our understanding of how social interactions shape social bonds.

Distinct patterns of gene expression in the medial preoptic area are related to gregarious singing behavior in European starlings (Sturnus vulgaris)

BACKGROUND

Song performed in flocks by European starlings (Sturnus vulgaris), referred to here as gregarious song, is a non-sexual, social behavior performed by adult birds. Gregarious song is thought to be an intrinsically reinforced behavior facilitated by a low-stress, positive affective state that increases social cohesion within a flock. The medial preoptic area (mPOA) is a region known to have a role in the production of gregarious song. However, the neurochemical systems that potentially act within this region to regulate song remain largely unexplored. In this study, we used RNA sequencing to characterize patterns of gene expression in the mPOA of male and female starlings singing gregarious song to identify possibly novel neurotransmitter, neuromodulator, and hormonal pathways that may be involved in the production of gregarious song.

RESULTS

Differential gene expression analysis and rank rank hypergeometric analysis indicated that dopaminergic, cholinergic, and GABAergic systems were associated with the production of gregarious song, with multiple receptor genes (e.g., DRD2, DRD5, CHRM4, GABRD) upregulated in the mPOA of starlings who sang at high rates. Additionally, co-expression network analyses identified co-expressing gene clusters of glutamate signaling-related genes associated with song. One of these clusters contained five glutamate receptor genes and two glutamate scaffolding genes and was significantly enriched for genetic pathways involved in neurodevelopmental disorders associated with social deficits in humans. Two of these genes, GRIN1 and SHANK2, were positively correlated with performance of gregarious song.

CONCLUSIONS

This work provides new insights into the role of the mPOA in non-sexual, gregarious song in starlings and highlights candidate genes that may play a role in gregarious social interactions across vertebrates. The provided data will also allow other researchers to compare across species to identify conserved systems that regulate social behavior.

The motivation to flock correlates with vocal-social behaviors and dopamine-related gene expression in male European starlings

It is proposed that songbird flocks are partly reinforced by positive social interactions, however not all flock mate interactions are positive. The combination of both positive and negative social interactions with flock mates may play a role in the motivation for birds to flock. The nucleus accumbens (NAc), medial preoptic area (POM), and ventral tegmental area (VTA) are implicated in vocal-social behaviors in flocks, including singing. Dopamine (DA) within these regions modifies motivated, reward-directed behaviors. Here, we begin to test the hypothesis that individual social interactions and DA within these regions are involved in the motivation to flock. Vocal-social behaviors were recorded in eighteen male European starlings in mixed-sex flocks in fall, when starlings are highly social and form large flocks. Males were then singly removed from their flock and the motivation to flock was quantified as the amount of time spent attempting to join a flock following separation. We used quantitative real-time polymerase chain reaction to measure expression of DA-related genes in the NAc, POM, and VTA. Birds producing high levels of vocal behaviors were more highly motivated to flock and had higher tyrosine hydroxylase (the rate-limiting enzyme in DA synthesis) expression in the NAc and VTA. Birds that received high levels of agonistic behaviors were less motivated to flock and had higher DA receptor subtype 1 expression in the POM. Overall, our findings suggest that interplay between social experience and DA activity in NAc, POM, and VTA plays a key role in social motivation in flocking songbirds.

Positive Wild Animal Welfare

With increasing attention given to wild animal welfare and ethics, it has become common to depict animals in the wild as existing in a state dominated by suffering. This assumption is now taken on board by many and frames much of the current discussion; but needs a more critical assessment, both theoretically and empirically. In this paper, we challenge the primary lines of evidence employed in support of wild animal suffering, to provide an alternative picture in which wild animals may often have lives that are far more positive than is commonly assumed. Nevertheless, while it is useful to have an alternative model to challenge unexamined assumptions, our real emphasis in this paper is the need for the development of effective methods for applying animal welfare science in the wild, including new means of data collection, the ability to determine the extent and scope of welfare challenges and opportunities, and their effects on welfare. Until such methods are developed, discussions of wild animal welfare cannot go beyond trading of intuitions, which as we show here can just as easily go in either direction.

Mu opioid receptor stimulation in the medial preoptic area or nucleus accumbens facilitates song and reward in flocking European starlings

It has been proposed that social cohesion in gregarious animals is reinforced both by a positive affective state induced by social interactions and by the prevention of a negative state that would be caused by social separation. Opioids that bind to mu opioid receptors (MORs) act in numerous brain regions to induce positive and to reduce negative affective states. Here we explored a potential role for MORs in affective states that may impact flocking behavior in mixed-sex flocks of nonbreeding European starlings, Sturnus vulgaris. Singing behavior, which is considered central to flock cohesion, and other social behaviors were quantified after infusions of the MOR agonist D-Ala2, N-Me-Phe4, glycinol5-ENK (DAMGO) into either the medial preoptic area (POM) or the nucleus accumbens (NAC), regions previously implicated in affective state and flock cohesion. We focused on beak wiping, a potential sign of stress or redirected aggression in this species, to provide insight into a presumed negative state. We also used conditioned place preference (CPP) tests to provide insight into the extent to which infusions of DAMGO into POM or NAC that stimulated song might be rewarding. We found that MOR stimulation in either POM or NAC dose-dependently promoted singing behavior, reduced beak wiping, and induced a CPP. Subtle differences in responses to MOR stimulation between NAC and POM also suggest potential functional differences in the roles of these two regions. Finally, because the location of NAC has only recently been identified in songbirds, we additionally performed a tract tracing study that confirmed the presence of dopaminergic projections from the ventral tegmental area to NAC, suggesting homology with mammalian NAC. These findings support the possibility that MORs in POM and NAC play a dual role in reinforcing social cohesion in flocks by facilitating positive and reducing negative affective states.

Birdsong and the Neural Regulation of Positive Emotion

Birds are not commonly admired for emotional expression, and when they are, the focus is typically on negative states; yet vocal behavior is considered a direct reflection of an individual's emotional state. Given that over 4000 species of songbird produce learned, complex, context-specific vocalizations, we make the case that songbirds are conspicuously broadcasting distinct positive emotional states and that hearing songs can also induce positive states in other birds. Studies are reviewed that demonstrate that that the production of sexually motivated song reflects an emotional state of anticipatory reward-seeking (i.e., mate-seeking), while outside the mating context song in gregarious flocks reflects a state of intrinsic reward. Studies are also reviewed that demonstrate that hearing song induces states of positive anticipation and reward. This review brings together numerous studies that highlight a potentially important role for the songbird nucleus accumbens, a region nearly synonymous with reward in mammals, in positive emotional states that underlie singing behavior and responses to song. It is proposed that the nucleus accumbens is part of an evolutionarily conserved circuitry that contributes context-dependently to positive emotional states that motivate and reward singing behavior and responses to song. Neural mechanisms that underlie basic emotions appear to be conserved and similar across vertebrates. Thus, these findings in songbirds have the potential to provide insights into interventions that can restore positive social interactions disrupted by mental health disorders in humans.

Using seasonality and birdsong to understand mechanisms underlying context-appropriate shifts in social motivation and reward

Social motivation and reward are dynamic and flexible, shifting adaptively across contexts to meet changing social demands. This is exceptionally apparent when seasonal contexts are considered in seasonally breeding songbirds as they cycle from periods of sexual motivation and reward during the breeding season to periods of extreme gregariousness outside the breeding season when non-sexual social interactions gain reward value, motivating birds to form flocks. Here we review evidence demonstrating a key integrative role for the medial preoptic area (mPOA) in the seasonally-appropriate adjustment of behaviors, with seasonal changes in dopamine activity in mPOA adjusting social motivation and changes in opioid activity modifying social reward. Experiments demonstrate that dramatic seasonal fluctuations in steroid hormone concentrations alter patterns of opioid- and dopamine-related protein and gene expression in mPOA to modify social motivation and reward to meet seasonal changes in social demands. These studies of birdsong and seasonality provide new insights into neural and endocrine mechanisms underlying adaptive changes in social motivation and reward and highlight an underappreciated, evolutionarily conserved role for the mPOA in important social behaviors in non-reproductive contexts.

Endogenous opiates and behavior: 2020

This paper is the forty-third consecutive installment of the annual anthological review of research concerning the endogenous opioid system, summarizing articles published during 2020 that studied the behavioral effects of molecular, pharmacological and genetic manipulation of opioid peptides and receptors as well as effects of opioid/opiate agonists and antagonists. The review is subdivided into the following specific topics: molecular-biochemical effects and neurochemical localization studies of endogenous opioids and their receptors (1), the roles of these opioid peptides and receptors in pain and analgesia in animals (2) and humans (3), opioid-sensitive and opioid-insensitive effects of nonopioid analgesics (4), opioid peptide and receptor involvement in tolerance and dependence (5), stress and social status (6), learning and memory (7), eating and drinking (8), drug abuse and alcohol (9), sexual activity and hormones, pregnancy, development and endocrinology (10), mental illness and mood (11), seizures and neurologic disorders (12), electrical-related activity and neurophysiology (13), general activity and locomotion (14), gastrointestinal, renal and hepatic functions (15), cardiovascular responses (16), respiration and thermoregulation (17), and immunological responses (18).

Immunolabeling Provides Evidence for Subregions in the Songbird Nucleus Accumbens and Suggests a Context-Dependent Role in Song in Male European Starlings (Sturnus vulgaris)

Birdsong is well known for its role in mate attraction during the breeding season. However, many birds, including European starlings (Sturnus vulgaris), also sing outside the breeding season as part of large flocks. Song in a breeding context can be extrinsically rewarded by mate attraction; however, song in nonbreeding flocks, referred to here as gregarious song, results in no obvious extrinsic reward and is proposed to be intrinsically rewarded. The nucleus accumbens (NAC) is a brain region well known to mediate reward and motivation, which suggests it is an ideal candidate to regulate reward associated with gregarious song. The goal of this study was to provide new histochemical information on the songbird NAC and its subregions (rostral pole, core, and shell) and to begin to determine subregion-specific contributions to gregarious song in male starlings. We examined immunolabeling for tyrosine hydroxylase (TH), neurotensin, and enkephalin (ENK) in the NAC. We then examined the extent to which gregarious and sexually motivated song differentially correlated with immunolabeling for the immediate early genes FOS and ZENK in each subdivision of the NAC. We found that TH and ENK labeling within subregions of the starling NAC was generally similar to patterns seen in the core and shell of NACs in mammals and birds. Additionally, we found that gregarious song, but not sexually motivated song, positively correlated with FOS in all NAC subregions. Our observations provide further evidence for distinct subregions within the songbird NAC and suggest the NAC may play an important role in regulating gregarious song in songbirds.

The Role of the Endogenous Opioid System in the Vocal Behavior of Songbirds and Its Possible Role in Vocal Learning

The opioid system in the brain is responsible for processing affective states such as pain, pleasure, and reward. It consists of three main receptors, mu- (μ-ORs), delta- (δ-ORs), and kappa- (κ-ORs), and their ligands – the endogenous opioid peptides. Despite their involvement in the reward pathway, and a signaling mechanism operating in synergy with the dopaminergic system, fewer reports focus on the role of these receptors in higher cognitive processes. Whereas research on opioids is predominated by studies on their addictive properties and role in pain pathways, recent studies suggest that these receptors may be involved in learning. Rodents deficient in δ-ORs were poor at recognizing the location of novel objects in their surroundings. Furthermore, in chicken, learning to avoid beads coated with a bitter chemical from those without the coating was modulated by δ-ORs. Similarly, μ-ORs facilitate long term potentiation in hippocampal CA3 neurons in mammals, thereby having a positive impact on spatial learning. Whereas these studies have explored the role of opioid receptors on learning using reward/punishment-based paradigms, the role of these receptors in natural learning processes, such as vocal learning, are yet unexplored. In this review, we explore studies that have established the expression pattern of these receptors in different brain regions of birds, with an emphasis on songbirds which are model systems for vocal learning. We also review the role of opioid receptors in modulating the cognitive processes associated with vocalizations in birds. Finally, we discuss the role of these receptors in regulating the motivation to vocalize, and a possible role in modulating vocal learning.

Intrinsic motivation for singing in songbirds is enhanced by temporary singing suppression and regulated by dopamine

Behaviors driven by intrinsic motivation are critical for development and optimization of physical and brain functions, but their underlying mechanisms are not well studied due to the complexity and autonomy of the behavior. Songbirds, such as zebra finches, offer a unique opportunity to study neural substrates of intrinsic motivation because they spontaneously produce many renditions of songs with highly-quantifiable structure for vocal practice, even in the absence of apparent recipients (“undirected singing”). Neural substrates underlying intrinsic motivation for undirected singing are still poorly understood partly because singing motivation cannot be easily manipulated due to its autonomy. Also, undirected singing itself acts as an internal reward, which could increase singing motivation, leading to difficulty in measuring singing motivation independent of singing-associated reward. Here, we report a simple procedure to easily manipulate and quantify intrinsic motivation for undirected singing independent of singing-associated reward. We demonstrate that intrinsic motivation for undirected singing is dramatically enhanced by temporary suppression of singing behavior and the degree of enhancement depends on the duration of suppression. Moreover, by examining latencies to the first song following singing suppression as a measure of singing motivation independent of singing-associated reward, we demonstrate that intrinsic singing motivation is critically regulated by dopamine through D2 receptors. These results provide a simple experimental tool to manipulate and measure the intrinsic motivation for undirected singing and illustrate the importance of zebra finches as a model system to study the neural basis of intrinsically-motivated behaviors.

μ-Opioid Receptor Stimulation in the Nucleus Accumbens Increases Vocal-Social Interactions in Flocking European Starlings, Sturnus Vulgaris

Social connections in gregarious species are vital for safety and survival. For these reasons, many bird species form large flocks outside the breeding season. It has been proposed that such large social groups may be maintained via reward induced by positive interactions with conspecifics and via the reduction of a negative affective state caused by social separation. Moreover, within a flock optimal social spacing between conspecifics is important, indicating that individuals may optimize spacing to be close but not too close to conspecifics. The μ-opioid receptors (MORs) in the nucleus accumbens (NAc) are well known for their role in both reward and the reduction of negative affective states, suggesting that MOR stimulation in NAc may play a critical role in flock cohesion. To begin to test this hypothesis, social and nonsocial behaviors were examined in male and female European starlings (Sturnus vulgaris) in nonbreeding flocks after intra-NAc infusion of saline and three doses of the selective MOR agonist d-Ala²-N-Me-Phe⁴-Glycol⁵-enkephalin (DAMGO). DAMGO in NAc dose-dependently increased singing behavior and facilitated social approaches while at the same time promoting displacements potentially used to maintain social spacing. These findings support the hypothesis that MORs in NAc promote social interactions important for group cohesion in nonsexual contexts and suggest the possibility that MORs in the NAc play a role in optimizing the pull of joining a flock with the push of potential agonistic encounters.

The Role of Mu-Opioids for Reward and Threat Processing in Humans: Bridging the Gap from Preclinical to Clinical Opioid Drug Studies

PURPOSE OF REVIEW

Opioid receptors are widely expressed in the human brain. A number of features commonly associated with drug use disorder, such as difficulties in emotional learning, emotion regulation and anhedonia, have been linked to endogenous opioid signalling. Whereas chronic substance use and misuse are thought to alter the function of the mu-opioid system, the specific mechanisms are not well understood. We argue that understanding exogenous and endogenous opioid effects in the healthy human brain is an essential foundation for bridging preclinical and clinical findings related to opioid misuse. Here, we will examine psychopharmacological evidence to outline the role of the mu-opioid receptor (MOR) system in the processing of threat and reward, and discuss how disruption of these processes by chronic opioid use might alter emotional learning and reward responsiveness.

RECENT FINDINGS

In healthy people, studies using opioid antagonist drugs indicate that the brain's endogenous opioids downregulate fear reactivity and upregulate learning from safety. At the same time, endogenous opioids increase the liking of and motivation to engage with high reward value cues. Studies of acute opioid agonist effects indicate that with non-sedative doses, drugs such as morphine and buprenorphine can mimic endogenous opioid effects on liking and wanting. Disruption of endogenous opioid signalling due to prolonged opioid exposure is associated with some degree of anhedonia to non-drug rewards; however, new results leave open the possibility that this is not directly opioid-mediated.

SUMMARY

The available human psychopharmacological evidence indicates that the healthy mu-opioid system contributes to the regulation of reward and threat processing. Overall, endogenous opioids can subtly increase liking and wanting responses to a wide variety of rewards, from sweet tastes to feelings of being connected to close others. For threat-related processing, human evidence suggests that endogenous opioids inhibit fear conditioning and reduce the sensitivity to aversive stimuli, although inconsistencies remain. The size of effects reported in healthy humans are however modest, clearly indicating that MORs play out their role in close concert with other neurotransmitter systems. Relevant candidate systems for future research include dopamine, serotonin and endocannabinoid signalling. Nevertheless, it is possible that endogenous opioid fine-tuning of reward and threat processing, when unbalanced by e.g. opioid misuse, could over time develop into symptoms associated with opioid use disorder, such as anhedonia and depression/anxiety.

The neurochemistry of social reward during development: What have we learned from rodent models?

Social rewards are fundamental to survival and overall health. Several studies suggest that adequate social stimuli during early life are critical for developing appropriate socioemotional and cognitive skills, whereas adverse social experiences negatively affect the proper development of brain and behavior, by increasing the susceptibility to develop neuropsychiatric conditions. Therefore, a better understanding of the neural mechanisms underlying social interactions, and their rewarding components in particular, is an important challenge of current neuroscience research. In this context, preclinical research has a crucial role: Animal models allow to investigate the neurobiological aspects of social reward in order to shed light on possible neurochemical alterations causing aberrant social reward processing in neuropsychiatric diseases, and they allow to test the validity and safety of innovative therapeutic strategies. Here, we discuss preclinical research that has investigated the rewarding properties of two forms of social interaction that occur in different phases of the lifespan of mammals, that is, mother-infant interaction and social interactions with peers, by focusing on the main neurotransmitter systems mediating their rewarding components. Together, the research performed so far helped to elucidate the mechanisms of social reward and its psychobiological components throughout development, thus increasing our understanding of the neurobiological substrates sustaining social functioning in health conditions and social dysfunction in major psychiatric disorders.

"Hearken to the Hermit-Thrush": A Case Study in Interdisciplinary Listening

Birdsong is widely analysed and discussed by people coming from both musical and scientific backgrounds. Both approaches provide valuable insight, but I argue that it is only through combining musical and scientific points of view, as well as perspectives from more tangentially related fields, that we can obtain the best possible understanding of birdsong. In this paper, I discuss how my own training as a musician, and in particular as a composer, affects how I listen to and parse birdsong. I identify nine areas of overlap between human music and birdsong, which may serve as starting points both for musical and scientific analysis, as well as for interdisciplinary analysis as practiced in the developing field of "zoomusicology." Using the hermit thrush (Catharus guttatus) as an example, I discuss how the song of a single species has been described by writers from a variety of disciplines, including music, literature, and the sciences, as well as how we can contextualise these varied perspectives in terms of broader cultural thought trends. I end with discussion of how combining approaches from multiple fields can help us to figure out new questions to ask, can help us identify how our own cultural biases may affect how we hear birdsong, and ultimately can help us develop richer and more nuanced understandings of the songs themselves.