Song in an Affiliative Context Relates to the Neural Expression of Dopamine- and Neurotensin-Related Genes in Male European Starlings

Conditioned preferences: Gated by experience, context, and endocrine systems

Central to the navigation of an ever-changing environment is the ability to form positive associations with places and conspecifics. The functions of location and social conditioned preferences are often studied independently, limiting our understanding of their interplay. Furthermore, a de-emphasis on natural functions of conditioned preferences has led to neurobiological interpretations separated from ecological context. By adopting a naturalistic and ethological perspective, we uncover complexities underlying the expression of conditioned preferences. Development of conditioned preferences is a combination of motivation, reward, associative learning, and context, including for social and spatial environments. Both social- and location-dependent reward-responsive behaviors and their conditioning rely on internal state-gating mechanisms that include neuroendocrine and hormone systems such as opioids, dopamine, testosterone, estradiol, and oxytocin. Such reinforced behavior emerges from mechanisms integrating past experience and current social and environmental conditions. Moreover, social context, environmental stimuli, and internal state gate and modulate motivation and learning via associative reward, shaping the conditioning process. We highlight research incorporating these concepts, focusing on the integration of social neuroendocrine mechanisms and behavioral conditioning. We explore three paradigms: 1) conditioned place preference, 2) conditioned social preference, and 3) social conditioned place preference. We highlight nonclassical species to emphasize the naturalistic applications of these conditioned preferences. To fully appreciate the complex integration of spatial and social information, future research must identify neural networks where endocrine systems exert influence on such behaviors. Such research promises to provide valuable insights into conditioned preferences within a broader naturalistic context.

The motivation to flock correlates with vocal-social behaviors and dopamine-related gene expression in male European starlings

It is proposed that songbird flocks are partly reinforced by positive social interactions, however not all flock mate interactions are positive. The combination of both positive and negative social interactions with flock mates may play a role in the motivation for birds to flock. The nucleus accumbens (NAc), medial preoptic area (POM), and ventral tegmental area (VTA) are implicated in vocal-social behaviors in flocks, including singing. Dopamine (DA) within these regions modifies motivated, reward-directed behaviors. Here, we begin to test the hypothesis that individual social interactions and DA within these regions are involved in the motivation to flock. Vocal-social behaviors were recorded in eighteen male European starlings in mixed-sex flocks in fall, when starlings are highly social and form large flocks. Males were then singly removed from their flock and the motivation to flock was quantified as the amount of time spent attempting to join a flock following separation. We used quantitative real-time polymerase chain reaction to measure expression of DA-related genes in the NAc, POM, and VTA. Birds producing high levels of vocal behaviors were more highly motivated to flock and had higher tyrosine hydroxylase (the rate-limiting enzyme in DA synthesis) expression in the NAc and VTA. Birds that received high levels of agonistic behaviors were less motivated to flock and had higher DA receptor subtype 1 expression in the POM. Overall, our findings suggest that interplay between social experience and DA activity in NAc, POM, and VTA plays a key role in social motivation in flocking songbirds.

Dehydroepiandrosterone (DHEA) increases undirected singing behavior and alters dopaminergic regulation of undirected song in non-breeding male European starlings (Sturnus vulgaris)

Introduction

It has been proposed that in species that defend territories across multiple life history stages, brain metabolism of adrenal dehydroepiandrosterone (DHEA) regulates aggressive behavior at times when gonadal androgen synthesis is low (i.e. the non-breeding season). To date, a role for DHEA in the regulation of other forms of social behavior that are expressed outside of the context of breeding remains unknown.

Methods

In this experiment, we used the European starling (Sturnus vulgaris) model system to investigate a role for DHEA in the neuroendocrine regulation of singing behavior by males in non-breeding condition. Starling song in a non-breeding context is spontaneous, not directed towards conspecifics, and functions to maintain cohesion of overwintering flocks.

Results

Using within-subjects design, we found that DHEA implants significantly increase undirected singing behavior by non-breeding condition male starlings. Given that DHEA is known to modulate multiple neurotransmitter systems including dopamine (DA) and DA regulates undirected song, we subsequently used immunohistochemistry for phosphorylated tyrosine hydroxylase (pTH, the active form of the rate-limiting enzyme in DA synthesis) to investigate the effect of DHEA on dopaminergic regulation of singing behavior in a non-breeding context. Pearson correlation analysis revealed a positive linear association between undirected singing behavior and pTH immunoreactivity in the ventral tegmental area and midbrain central gray of DHEA-implanted, but not control-implanted, males.

Discussion

Taken together, these data suggest that undirected singing behavior by non-breeding starlings is modulated by effects of DHEA on dopaminergic neurotransmission. More broadly, these data expand the social behavior functions of DHEA beyond territorial aggression to include undirected, affiliative social communication.

Contribution of Endocannabinoids to Intrinsic Motivation for Undirected Singing in Adult Zebra Finches

Songbirds, such as zebra finches, spontaneously produce many song renditions for vocal practice even in the absence of apparent recipients throughout their lives. Such “undirected singing” is driven by intrinsic motivation, which arises within individuals for internal satisfaction without immediate external rewards. Intrinsic motivation for undirected singing in adult zebra finches was previously demonstrated to be critically regulated by dopamine through D2 receptors. Here, we further investigate the mechanisms of intrinsic motivation for undirected singing by focusing on endocannabinoids, which modulate dopamine signaling and contribute to motivation and reward in mammals. In songbirds, endocannabinoids have been shown to be involved in the production of undirected songs, but whether they are involved in the intrinsic motivation for undirected singing remains unknown. Using latencies of the first song production following temporary singing suppression as a measure of intrinsic motivation for undirected singing, we demonstrate that systemic administration of the direct cannabinoid agonist WIN55212-2 decreases intrinsic motivation for singing and that those effects are largely reversed by the cannabinoid antagonist SR141716A co-administered with WIN55212-2. Administration of SR141716A alone or that of two indirect cannabinoid agonists did not significantly affect intrinsic singing motivation. These results suggest that endocannabinoids are critically involved in regulating intrinsic motivation for undirected singing and provide new insights into the neural mechanisms of intrinsically motivated motor behaviors.

Activation of noradrenergic locus coeruleus and social behavior network nuclei varies with duration of male midshipman advertisement calls

Vocal courtship is vital to the reproductive success of many vertebrates and is therefore a highly-motivated behavioral state. Catecholamines have been shown to play an essential role in the expression and maintenance of motivated vocal behavior, such as the coordination of vocal-motor output in songbirds. However, it is not well-understood if this relationship applies to anamniote vocal species. Using the plainfin midshipman fish model, we tested whether specific catecholaminergic (i.e., dopaminergic and noradrenergic) nuclei and nodes of the social behavior network (SBN) are differentially activated in vocally courting (humming) versus non-humming males. Herein, we demonstrate that tyrosine hydroxylase immunoreactive (TH-ir) neuron number in the noradrenergic locus coeruleus (LC) and induction of cFos (an immediate early gene product and proxy for neural activation) in the preoptic area differentiated humming from non-humming males. Furthermore, we found relationships between activation of the LC and SBN nuclei with the total amount of time that males spent humming, further reinforcing a role for these specific brain regions in the production of motivated reproductive-related vocalizations. Finally, we found that patterns of functional connectivity between catecholaminergic nuclei and nodes of the SBN differed between humming and non-humming males, supporting the notion that adaptive behaviors (such as the expression of advertisement hums) emerge from the interactions between various catecholaminergic nuclei and the SBN.

Intrinsic motivation for singing in songbirds is enhanced by temporary singing suppression and regulated by dopamine

Behaviors driven by intrinsic motivation are critical for development and optimization of physical and brain functions, but their underlying mechanisms are not well studied due to the complexity and autonomy of the behavior. Songbirds, such as zebra finches, offer a unique opportunity to study neural substrates of intrinsic motivation because they spontaneously produce many renditions of songs with highly-quantifiable structure for vocal practice, even in the absence of apparent recipients (“undirected singing”). Neural substrates underlying intrinsic motivation for undirected singing are still poorly understood partly because singing motivation cannot be easily manipulated due to its autonomy. Also, undirected singing itself acts as an internal reward, which could increase singing motivation, leading to difficulty in measuring singing motivation independent of singing-associated reward. Here, we report a simple procedure to easily manipulate and quantify intrinsic motivation for undirected singing independent of singing-associated reward. We demonstrate that intrinsic motivation for undirected singing is dramatically enhanced by temporary suppression of singing behavior and the degree of enhancement depends on the duration of suppression. Moreover, by examining latencies to the first song following singing suppression as a measure of singing motivation independent of singing-associated reward, we demonstrate that intrinsic singing motivation is critically regulated by dopamine through D2 receptors. These results provide a simple experimental tool to manipulate and measure the intrinsic motivation for undirected singing and illustrate the importance of zebra finches as a model system to study the neural basis of intrinsically-motivated behaviors.

Endogenous opioids facilitate intrinsically-rewarded birdsong

Many songbirds sing in non-reproductive contexts while in flocks. Singing in such gregarious contexts is critical for maintaining and learning songs; however, song is not directed towards other individuals and has no obvious, immediate social consequences. Studies using conditioned place preference (CPP) tests of reward indicate that song production in gregarious contexts correlates positively with a bird’s intrinsic reward state and with opioid markers in the medial preoptic nucleus (mPOA). However, the causal involvement of opioids in gregarious song is unknown. Here we report that the selective mu opioid receptor (MOR) agonist fentanyl dose-dependently facilitates gregarious song and reduces stress/anxiety-related behavior in male and female European starlings. Furthermore, infusion of siRNA targeting MORs specifically in mPOA both suppresses gregarious song and disrupts the positive association between affective state and singing behavior, as revealed using CPP tests of song-associated reward. Results strongly implicate opioids in gregarious song and suggest that endogenous opioids in the mPOA may facilitate song by influencing an individual’s intrinsic reward state.

Why Do Birds Flock? A Role for Opioids in the Reinforcement of Gregarious Social Interactions

The formation of social groups provides safety and opportunities for individuals to develop and practice important social skills. However, joining a social group does not result in any form of obvious, immediate reinforcement (e.g., it does not result in immediate copulation or a food reward), and individuals often remain in social groups despite agonistic responses from conspecifics. Much is known about neural and endocrine mechanisms underlying the motivation to perform mate- or offspring-directed behaviors. In contrast, relatively little is known about mechanisms underlying affiliative behaviors outside of these primary reproductive contexts. Studies on flocking behavior in songbirds are beginning to fill this knowledge gap. Here we review behavioral evidence that supports the hypothesis that non-sexual affiliative, flocking behaviors are both (1) rewarded by positive social interactions with conspecifics, and (2) reinforced because affiliative contact reduces a negative affective state caused by social isolation. We provide evidence from studies in European starlings, Sturnus vulgaris, that mu opioid receptors in the medial preoptic nucleus (mPOA) play a central role in both reward and the reduction of a negative affective state induced by social interactions in flocks, and discuss potential roles for nonapeptide/opioid interactions and steroid hormones. Finally, we develop the case that non-sexual affiliative social behaviors may be modified by two complementary output pathways from mPOA, with a projection from mPOA to the periaqueductal gray integrating information during social interactions that reduces negative affect and a projection from mPOA to the ventral tegmental area integrating information leading to social approach and reward.

Neurotensin and neurotensin receptor 1 mRNA expression in song-control regions changes during development in male zebra finches

Learned vocalizations are important for communication in some vertebrate taxa. The neural circuitry for the learning and production of vocalizations is well known in songbirds, many of which learn songs initially during a critical period early in life. Dopamine is essential for motor learning, including song learning, and dopamine-related measures change throughout development in song-control regions such as HVC, the lateral magnocellular nucleus of the anterior nidopallium (LMAN), Area X, and the robust nucleus of the arcopallium (RA). In mammals, the neuropeptide neurotensin strongly interacts with dopamine signaling. This study investigated a potential role for the neurotensin system in song learning by examining how neurotensin (Nts) and neurotensin receptor 1 (Ntsr1) expression change throughout development. Nts and Ntsr1 mRNA expression was analyzed in song-control regions of male zebra finches in four stages of the song learning process: pre-subsong (25 days posthatch; dph), subsong (45 dph), plastic song (60 dph), and crystallized song (130 dph). Nts expression in LMAN during the subsong stage was lower compared to other time points. Ntsr1 expression was highest in HVC, Area X, and RA during the pre-subsong stage. Opposite and complementary expression patterns for the two genes in song nuclei and across the whole brain suggest distinct roles for regions that produce and receive Nts. The expression changes at crucial time points for song development are similar to changes observed in dopamine studies and suggest Nts may be involved in the process of vocal learning. © 2018 Wiley Periodicals, Inc. Develop Neurobiol 78: 671-686, 2018.

Co-localization patterns of neurotensin receptor 1 and tyrosine hydroxylase in brain regions involved in motivation and social behavior in male European starlings

Animals communicate in distinct social contexts to convey information specific to those contexts, such as sexual or agonistic motivation. In seasonally-breeding male songbirds, seasonal changes in day length and increases in testosterone stimulate sexually-motivated song directed at females for courtship and reproduction. Dopamine and testosterone may act in the same brain regions to stimulate sexually-motivated singing. The neuropeptide neurotensin, acting at the neurotensin receptor 1 (NTR1), can strongly influence dopamine transmission. The goal of this study was to gain insight into the degree to which seasonal changes in physiology modify interactions between neurotensin and dopamine to adjust context-appropriate communication. Male European starlings were examined in physiological conditions that stimulate season-typical forms of communication: late summer/early fall non-breeding condition (low testosterone; birds sing infrequently), late fall non-breeding condition (low testosterone; birds produce non-sexually motivated song), and spring breeding condition (high testosterone; males produce sexually-motivated song). Double fluorescent immunolabeling was performed to detect co-localization patterns between tyrosine hydroxylase (TH; the rate-limiting enzyme in dopamine synthesis) and NTR1 in brain regions implicated in motivation and song production (the ventral tegmental area, medial preoptic nucleus, periaqueductal gray, and lateral septum). Co-localization between TH and NTR1 was present in the ventral tegmental area for all physiological conditions, and the number of co-localized cells did not differ across conditions. Immunolabeling for TH and NTR1 was also present in the other examined regions, although no co-localization was seen. These results support the hypothesis that interactions between NTR1 and dopamine in the ventral tegmental area may modulate vocalizations, but suggest that testosterone- or photoperiod-induced changes in NTR1/TH co-localization do not underlie seasonally-appropriate adjustment of communication.

Song practice as a rewarding form of play in songbirds

In adult songbirds, the primary functions of song are mate attraction and territory defense; yet, many songbirds sing at high rates as juveniles and outside these primary contexts as adults. Singing outside primary contexts is critical for song learning and maintenance, and ultimately necessary for breeding success. However, this type of singing (i.e., song "practice") occurs even in the absence of immediate or obvious extrinsic reinforcement; that is, it does not attract mates or repel competitors. Here we review studies that support the hypothesis that song practice is stimulated and maintained by intrinsic reward mechanisms (i.e., that it is associated with a positive affective state). Additionally, we propose that song practice can be considered a rewarding form of play behavior similar to forms of play observed in multiple young animals as they practice sequences of motor events that are used later in primary adult reproductive contexts. This review highlights research suggesting at least partially overlapping roles for neural reward systems in birdsong and mammalian play and evidence that steroid hormones modify these systems to shift animals from periods of intrinsically rewarded motor exploration (i.e., singing in birds and play in mammals) to the use of similar motor patterns in primary reproductive contexts.

Song-associated reward correlates with endocannabinoid-related gene expression in male European starlings (Sturnus vulgaris)

Vocal communication is required for successful social interactions in numerous species. During the breeding season, songbirds produce songs that are reinforced by behavioral consequences (e.g., copulation). However, some songbirds also produce songs not obviously directed at other individuals. The consequences maintaining or reinforcing these songs are less obvious and the neural mechanisms associated with undirected communication are not well-understood. Previous studies indicate that undirected singing is intrinsically rewarding and mediated by opioid or dopaminergic systems; however, endocannabinoids are also involved in regulating reward and singing behavior. We used a conditioned place preference paradigm to examine song-associated reward in European starlings and quantitative real-time PCR to measure expression of endocannabinoid-related neural markers (CB₁, FABP7, FABP5, FAAH, DAGLα), in brain regions involved in social behavior, reward and motivation (ventral tegmental area [VTA], periaqueductal gray [PAG], and medial preoptic nucleus [POM]), and a song control region (Area X). Our results indicate that starlings producing high rates of song developed a conditioned place preference, suggesting that undirected song is associated with a positive affective state. We found a significant positive relationship between song-associated reward and CB₁ receptors in VTA and a significant negative relationship between song-associated reward and CB₁ in PAG. There was a significant positive relationship between reward and the cannabinoid transporter FABP7 in POM and a significant negative relationship between reward and FABP7 in PAG. In Area X, FABP5 and DAGLα correlated positively with singing. These results suggest a role for endocannabinoid signaling in vocal production and reward associated with undirected communication.