Behavioral effects of social challenges and genomic mechanisms of social priming: What's testosterone got to do with it?

Neuroendocrine mechanisms contributing to the coevolution of sociality and communication

Communication is inherently social, so signaling systems should evolve with social systems. The 'social complexity hypothesis' posits that social complexity necessitates communicative complexity and is generally supported in vocalizing mammals. This hypothesis, however, has seldom been tested outside the acoustic modality, and comparisons across studies are confounded by varying definitions of complexity. Moreover, proximate mechanisms underlying coevolution of sociality and communication remain largely unexamined. In this review, we argue that to uncover how sociality and communication coevolve, we need to examine variation in the neuroendocrine mechanisms that coregulate social behavior and signal production and perception. Specifically, we focus on steroid hormones, monoamines, and nonapeptides, which modulate both social behavior and sensorimotor circuits and are likely targets of selection during social evolution. Lastly, we highlight weakly electric fishes as an ideal system in which to comparatively address the proximate mechanisms underlying relationships between social and signal diversity in a novel modality.

Testing hormonal responses to real and simulated social challenges in a competitive female bird

Competitive interactions often occur in series; therefore animals may respond to social challenges in ways that prepare them for success in future conflict. Changes in the production of the steroid hormone testosterone (T) are thought to mediate phenotypic responses to competition, but research over the past few decades has yielded mixed results, leading to several potential explanations as to why T does not always elevate following a social challenge. Here, we measured T levels in tree swallows (Tachycineta bicolor), a system in which females compete for limited nesting cavities and female aggression is at least partially mediated by T. We experimentally induced social challenges in two ways: (1) using decoys to simulate territorial intrusions and (2) removing subsets of nesting cavities to increase competition among displaced and territory-holding females. Critically, these experiments occurred pre-laying, when females are physiologically capable of rapidly increasing circulating T levels. However, despite marked aggression in both experiments, T did not elevate following real or simulated social challenges, and in some cases, socially challenged females had lower T levels than controls. Likewise, the degree of aggression was negatively correlated with T levels following a simulated territorial intrusion. Though not in line with the idea that social challenges prompt T elevation in preparation for future challenges, these patterns nevertheless connect T to territorial aggression in females. Coupled with past work showing that T promotes aggression, these results suggest that T may act rapidly to allow animals to adaptively respond to the urgent demands of a competitive event.

Seasonal patterns of melatonin alter aggressive phenotypes of female Siberian hamsters

Many animal species exhibit year-round aggression, a behaviour that allows individuals to compete for limited resources in their environment (eg, food and mates). Interestingly, this high degree of territoriality persists during the non-breeding season, despite low levels of circulating gonadal steroids (ie, testosterone [T] and oestradiol [E₂ ]). Our previous work suggests that the pineal hormone melatonin mediates a 'seasonal switch' from gonadal to adrenal regulation of aggression in Siberian hamsters (Phodopus sungorus); solitary, seasonally breeding mammals that display increased aggression during the short, 'winter-like' days (SDs) of the non-breeding season. To test the hypothesis that melatonin elevates non-breeding aggression by increasing circulating and neural steroid metabolism, we housed female hamsters in long days (LDs) or SDs, administered them timed or mis-timed melatonin injections (mimic or do not mimic a SD-like signal, respectively), and measured aggression, circulating hormone profiles and aromatase (ARO) immunoreactivity in brain regions associated with aggressive or reproductive behaviours (paraventricular hypothalamic nucleus [PVN], periaqueductal gray [PAG] and ventral tegmental area [VTA]). Females that were responsive to SD photoperiods (SD-R) and LD females given timed melatonin injections (Mel-T) exhibited gonadal regression and reduced circulating E₂ , but increased aggression and circulating dehydroepiandrosterone (DHEA). Furthermore, aggressive challenges differentially altered circulating hormone profiles across seasonal phenotypes; reproductively inactive females (ie, SD-R and Mel-T females) reduced circulating DHEA and T, but increased E₂ after an aggressive interaction, whereas reproductively active females (ie, LD females, SD non-responder females and LD females given mis-timed melatonin injections) solely increased circulating E₂ . Although no differences in neural ARO abundance were observed, LD and SD-R females showed distinct associations between ARO cell density and aggressive behaviour in the PVN, PAG and VTA. Taken together, these results suggest that melatonin increases non-breeding aggression by elevating circulating steroid metabolism after an aggressive encounter and by regulating behaviourally relevant neural circuits in a region-specific manner.

Aggression: Perspectives from social and systems neuroscience

Exhibiting behavioral plasticity in order to mount appropriate responses to dynamic and novel social environments is crucial to the survival of all animals. Thus, how animals regulate flexibility in the timing, duration, and intensity of specific behaviors is of great interest to biologists. In this review, we discuss how animals rapidly respond to social challenges, with a particular focus on aggression. We utilize a conceptual framework to understand the neural mechanisms of aggression that is grounded in Wingfield and colleagues' Challenge Hypothesis, which has profoundly influenced how scientists think about aggression and the mechanisms that allow animals to exhibit flexible responses to social instability. Because aggressive behavior is rooted in social interactions, we propose that mechanisms modulating prosocial behavior may be intricately tied to mechanisms of aggression. Therefore, in order to better understand how aggressive behavior is mediated, we draw on perspectives from social neuroscience and discuss how social context, species-typical behavioral phenotype, and neural systems commonly studied in relation to prosocial behavior (i.e., neuropeptides) contribute to organizing rapid responses to social challenges. Because complex behaviors are not the result of one mechanism or a single neural system, we consider how multiple neural systems important for prosocial and aggressive behavior (i.e., neuropeptides and neurosteroids) interact in the brain to produce behavior in a rapid, context-appropriate manner. Applying a systems neuroscience perspective and seeking to understand how multiple systems functionally integrate to rapidly modulate behavior holds great promise for expanding our knowledge of the mechanisms underlying social behavioral plasticity.

Whither the challenge hypothesis?

Almost fifty years ago the advent of assay methods to measure circulating levels of hormones revolutionized endocrinology in relation to investigations of free-living and captive animals. This new field "environmental endocrinology" revealed that endocrine profiles in animals in their natural habitat were not only different from captive animals, but often deviated from predictions. It quickly became apparent that the organization and analysis of data from the field should be sorted by life history stages such as for reproductive processes, migration, molt etc. and spaced in time according to natural duration of those processes. Presentation of data by calendar date alone gives much simpler, even misleading, patterns. Stage-organized analyses revealed species-specific patterns of hormone secretion and dramatic inter-individual differences. The "Challenge Hypothesis" sparked exploration of these results, which diverged from expectations of hormone-behavior interactions. The hypothesis led to specific predictions about how the hypothalamo-pituitary-gonad axis, and particularly circulating patterns of testosterone, might respond to social challenges such as simulated territorial intrusions. Initially, a group of studies on free-living and captive birds played a key role in the formulation of the hypothesis. Over the decades since, the effects of social challenge and environmental context on hormonal responses have been tested in all vertebrate taxa, including humans, as well as in insects. Although it is now clear that the Challenge Hypothesis in its original form is simplistic, field and laboratory tests of the hypothesis have led to other concepts that have become seminal to the development of environmental endocrinology as a field. In this special issue these developments are addressed and examples from many different taxa enrich the emerging concepts, paving the way for investigations using recent technologies for genetic and transcriptome analyses.

Testosterone as a mediator of the tradeoff between cooperation and competition in the context of cooperative reproductive behaviors

Behavioral tradeoffs occur when the expression of one behavior detracts from the expression of another. Understanding the proximate mediators of behavioral tradeoffs is important as these tradeoffs can act as potential constraints on evolutionary responses to selection. Here, we describe the tradeoff between cooperation and competition faced by species that exhibit cooperative reproductive behaviors and propose that testosterone is a key hormonal mediator of the tradeoff. Cooperative reproductive behaviors occur when multiple individuals coordinate their efforts to gain a reproductive advantage over other individuals and/or those individuals attempting to reproduce in absence of cooperation. We propose that testosterone, a sex steroid known to mediate a number of physiological and behavioral actions associated with reproductive competition, is involved in mediating the tradeoff between cooperation and competition. To support this proposition, we first describe the importance of individual variation in behavior to the evolution of cooperative behaviors. We then describe how proximate mechanisms represent a prominent source of individual variation in social behaviors and highlight evidence suggesting testosterone mediates variation in cooperative behaviors. Two case studies in which the relationship between testosterone and cooperative behaviors have been investigated in detail are then summarized. Throughout we highlight the importance of studying individual variation to understand the mechanistic basis of behaviors, behavioral tradeoffs, and the evolution of cooperative reproductive behaviors more broadly.

Testosterone dependent territorial aggression is modulated by cohabitation with a female in male Mongolian gerbils (Meriones unguiculatus)

Most mammal studies on the neuroendocrine mechanisms of territorial aggression have demonstrated that testosterone (T) is required for the display of territorial aggression. However, the relationship between T and aggression is more complex and may be modulated by social factor. The aim of this study was to determine the role of T in territorial aggression in the Mongolian gerbil (Meriones unguiculatus), and the effect of social factors on the modulation of this behavior. The relationship between T and territorial aggression was analyzed using castration and T replacement in two social contexts: male-male and male-female cohabitation. Plasma T concentrations in males of all groups were quantified by radioimmunoassay (RIA). T concentrations were compared using two-way ANOVA. Only sham-castrated and castrated males with T replacement in male-female cohabitation showed aggression, whereas castrated gerbils in the same condition were not aggressive. This indicates that T is the hormone that maintains territorial aggression, but mating is a modulator stimulus. The modulator effect of mating in territorial aggression was associated with an increase in T, but it seems that other mechanisms are involved in the regulation of this behavior, since castrated males with T replacement in the male-male cohabitation did not exhibit aggression, although they had T concentrations as high as these males that received the same treatment, but that cohabited with a female. These results suggest that T is involved in the mechanisms that regulate territorial aggression in the male Mongolian gerbil, and that the cohabitation with a female modulates this behavior.

Neurogenomic insights into paternal care and its relation to territorial aggression

Motherhood is characterized by dramatic changes in brain and behavior, but less is known about fatherhood. Here we report that male sticklebacks—a small fish in which fathers provide care—experience dramatic changes in neurogenomic state as they become fathers. Some genes are unique to different stages of paternal care, some genes are shared across stages, and some genes are added to the previously acquired neurogenomic state. Comparative genomic analysis suggests that some of these neurogenomic dynamics resemble changes associated with pregnancy and reproduction in mammalian mothers. Moreover, gene regulatory analysis identifies transcription factors that are regulated in opposite directions in response to a territorial challenge versus during paternal care. Altogether these results show that some of the molecular mechanisms of parental care might be deeply conserved and might not be sex-specific, and suggest that tradeoffs between opposing social behaviors are managed at the gene regulatory level.

Compared to motherhood, the molecular changes associated with fatherhood are less understood. Here, the authors investigate gene expression changes associated with paternal care in male stickleback fish, and compare them with patterns in territorial aggression.

Androgen represses opioid growth factor receptor (OGFR) in human prostate cancer LNCaP cells and OGFR expression in human prostate cancer tissue

Opioid receptors are G protein-coupled receptors that bind opioid ligands including endorphins and enkephalins. The existence of a number of opioid receptors, including the mu-opioid receptor (OPRM1), delta-opioid receptor (OPRD1), kappa-opioid receptor (OPRK1) and zeta-opioid receptor (OGFR) have been reported. However, the potential expression and role of these receptors on human prostate carcinogenesis is unknown. In the present study, we examined opioid receptor expression in human prostate cancer cell lines and in prostate cancer tissue. We observed using quantitative real-time PCR analysis that OGFR and OGFRL1 mRNA is expressed in all examined prostate cancer cell lines as well as in an immortalized, non-tumorigenic prostate epithelial cell line (RWPE-1). Conversely, OPRK1 mRNA expression was detected in a more limited number of cell lines (LNCaP and VCaP), while OPRD1 and OPRM1 mRNA expression was undetectable in all examined prostate cell lines. Interestingly, androgen sensitive LNCaP cells expressed high amounts of OPRK1, OGFR and OGFRL1 compared to other cell lines. Therefore, we investigated the effect of androgen on the mRNA expression of OPRK1, OGFR, OGFRL1 in the LNCaP cell line. Our results demonstrated that the synthetic androgen (R1881) represses mRNA of OPRK1, OGFR and OGFRL1 in a time-dependent manner. Furthermore, immunohistochemistry demonstrated OGFR is expressed at high levels in prostate cancer tissue compared to benign tissue, and that OGFR expression is high in undifferentiated and aggressive prostate cancer tissue. This is the first study showing OGFR and OGFRL1 are androgen repressed genes, and these results suggest a role for the opioid signaling axis in prostate cancer.

Dynamic modulation of sociality and aggression: an examination of plasticity within endocrine and neuroendocrine systems

Endocrine and neuroendocrine systems are key mediators of behavioural plasticity and allow for the ability to shift social behaviour across dynamic contexts. These systems operate across timescales, modulating both rapid responses to environmental changes and developmental plasticity in behavioural phenotypes. Thus, not only do endocrine systems mediate behavioural plasticity, but also the systems themselves exhibit plasticity in functional capabilities. This flexibility at both the mechanistic and behavioural levels can be crucial for reproduction and survival. Here, we discuss how plasticity in nonapeptide and steroid actions may influence the expression of, and allow rapid shifts between, sociality and aggression-behavioural shifts that can be particularly important for social interactions. Recent findings of overlap in the mechanisms that modulate social and aggressive behaviour suggest the potential for a mechanistic continuum between these behaviours. We briefly discuss the potential for a sociality-aggression continuum and novel techniques that will enable probing of the functional connectivity of social behaviours. From an evolutionary perspective, we suggest that plasticity in endocrine and neuroendocrine mechanisms of behaviour may be important targets of selection, and discuss the conditions under which we would predict selection to have resulted in differences in endocrine plasticity across species that differ in social organization.This article is part of the themed issue 'Physiological determinants of social behaviour in animals'.