Decoding ants' olfactory system sheds light on the evolution of social communication

Evolution of the neuronal substrate for kin recognition in social Hymenoptera

In evolutionary terms, life is about reproduction. Yet, in some species, individuals forgo their own reproduction to support the reproductive efforts of others. Social insect colonies for example, can contain up to a million workers that actively cooperate in tasks such as foraging, brood care and nest defence, but do not produce offspring. In such societies the division of labour is pronounced, and reproduction is restricted to just one or a few individuals, most notably the queen(s). This extreme eusocial organisation exists in only a few mammals, crustaceans and insects, but strikingly, it evolved independently up to nine times in the order Hymenoptera (including ants, bees and wasps). Transitions from a solitary lifestyle to an organised society can occur through natural selection when helpers obtain a fitness benefit from cooperating with kin, owing to the indirect transmission of genes through siblings. However, this process, called kin selection, is vulnerable to parasitism and opportunistic behaviours from unrelated individuals. An ability to distinguish kin from non-kin, and to respond accordingly, could therefore critically facilitate the evolution of eusociality and the maintenance of non-reproductive workers. The question of how the hymenopteran brain has adapted to support this function is therefore a fundamental issue in evolutionary neuroethology. Early neuroanatomical investigations proposed that social Hymenoptera have expanded integrative brain areas due to selection for increased cognitive capabilities in the context of processing social information. Later studies challenged this assumption and instead pointed to an intimate link between higher social organisation and the existence of developed sensory structures involved in recognition and communication. In particular, chemical signalling of social identity, known to be mediated through cuticular hydrocarbons (CHCs), may have evolved hand in hand with a specialised chemosensory system in Hymenoptera. Here, we compile the current knowledge on this recognition system, from emitted identity signals, to the molecular and neuronal basis of chemical detection, with particular emphasis on its evolutionary history. Finally, we ask whether the evolution of social behaviour in Hymenoptera could have driven the expansion of their complex olfactory system, or whether the early origin and conservation of an olfactory subsystem dedicated to social recognition could explain the abundance of eusocial species in this insect order. Answering this question will require further comparative studies to provide a comprehensive view on lineage-specific adaptations in the olfactory pathway of Hymenoptera.

Discrimination of conspecifics from heterospecifics in a hybrid zone: Behavioral and chemical cues in ants

Species and nestmate recognition in social insects occurs mostly through cuticular hydrocarbons acting as chemical cues. These compounds generate a colony-specific odor profile depending on genetic and environmental factors. Species and nestmate recognition results in specific behavioral responses, regulating the level of aggression toward other individuals during an interaction. Although species discrimination and recognition cues have been poorly studied in the context of interspecific hybridization, such systems offer an opportunity to further investigate the influence of heritable and environmental factors on recognition. We explored the strength of discrimination in a hybrid zone between two ant species-Tetramorium immigrans and T. caespitum-by comparing cuticular hydrocarbon profiles and measuring intra- and interspecific worker aggression in both areas of sympatry and areas of allopatry among species. Species cuticular hydrocarbon profiles were well-differentiated and interspecific aggression was high, revealing highly discriminating species recognition cues. Hybrids' cuticular hydrocarbon profiles consisted of a mixture of the parental bouquets, but also exhibited hybrid-specific patterns. Behavioral assays showed that T. immigrans is as aggressive toward hybrids as toward heterospecifics. Finally, aggression between heterospecific workers was lower when interacting individuals came from areas of sympatry among species than from areas of allopatry. Taken as a whole, these findings paint a particularly complex picture of the recognition system in T. immigrans, T. caespitum, and their hybrids, and highlight that hybrid zones afford a still underexplored opportunity for investigating recognition mechanisms and discrimination between species.

Rescue specialists in Cataglyphis piliscapa ants: The nature and development of ant first responders

Previous research in our laboratories has demonstrated that, within each colony of Cataglyphis piliscapa (formerly C. cursor) ants, only some individuals are capable of performing a complex sequence of behavioral patterns to free trapped nestmates-a sequence that not only is memory-dependent but also is responsive to the particular circumstances of that entrapment and how the rescue operation unfolds. Additionally, this rescue behavior is inherited patrilineally from but a few of the many males that fertilize the eggs of the colony's single queen. Here, we describe three experiments to explore rescue behavior further-namely, whether rescuers are in any way selective about which nestmates they help, how the age of rescuers and the victims that they help affect the quantity and quality of the rescue operation, and when this complex behavior first emerges in an ant's development. Taken together with the previous heritability analysis, these behavioral experiments provide clear evidence that the ability to rescue nestmates in distress should be recognized as a specialization, which together with other specialized tasks in C. piliscapa, contributes to a division of labor that increases the efficiency of the colony as a whole and, thus increases its reproductive success.

Olfactory System Morphology Suggests Colony Size Drives Trait Evolution in Odorous Ants (Formicidae: Dolichoderinae)

In social insects colony fitness is determined in part by individual worker phenotypes. Across ant species, colony size varies greatly and is thought to affect worker trait variation in both proximate and ultimate ways. Little is known about the relationship between colony size and worker trait evolution, but hypotheses addressing the role of social structure in brain evolution suggest workers of small-colony species may have larger brains or larger brain regions necessary for complex behaviors. In previous work on odorous ants (Formicidae: Dolichoderinae) we found no correlation between colony size and these brain properties, but found that relative antennal lobe size scaled negatively with colony size. Therefore, we now test whether sensory systems scale with colony size, with particular attention to olfactory components thought to be involved in nestmate recognition. Across three species of odorous ants, Forelius mccooki, Dorymyrmex insanus, and D. bicolor, which overlap in habitat and foraging ecology but vary in colony size, we compare olfactory sensory structures, comparing those thought to be involved in nestmate recognition. We use the visual system, a sensory modality not as important in social communication in ants, as a control comparison. We find that body size scaling largely explains differences in eye size, antennal length, antennal sensilla density, and total number of olfactory glomeruli across these species. However, sensilla basiconica and olfactory glomeruli in the T6 cluster of the antennal lobe, structures known to be involved in nestmate recognition, do not follow body size scaling observed for other structures. Instead, we find evidence from the closely related Dorymyrmex species that the larger colony species, D. bicolor, invests more in structures implicated in nestmate recognition. To test for functional consequences, we compare nestmate and non-nestmate interactions between these two species and find D. bicolor pairs of either type engage in more interactions than D. insaus pairs. Thus, we do not find evidence supporting a universal pattern of sensory system scaling associated with changes in colony size, but hypothesize that observed differences in the olfactory components in two closely related Dorymyrmex species are evidence of a link between colony size and sensory trait evolution.

Lizards as models to explore the ecological and neuroanatomical correlates of miniaturization

Extreme body size reductions bring about unorthodox anatomical arrangements and novel ways in which animals interact with the environment. Drawing from studies of vertebrates and invertebrates, we provide a theoretical framework for miniaturization to inform hypotheses using lizards as a study system. Through this approach, we demonstrate the repeated evolution of miniaturization across 11 families and a tendency for miniaturized species to occupy terrestrial microhabitats, possibly driven by physiological constraints. Differences in gross brain morphology between two gecko species demonstrate a proportionally larger telencephalon and smaller olfactory bulbs in the miniaturized species, though more data are needed to generalize this trend. Our study brings into light the potential contributions of miniaturized lizards to explain patterns of body size evolution and its impact on ecology and neuroanatomy. In addition, our findings reveal the need to study the natural history of miniaturized species, particularly in relation to their sensory and physiological ecology.

Beyond cognitive templates: re-examining template metaphors used for animal recognition and navigation

The term 'cognitive template' originated from work in human-based cognitive science to describe a literal, stored, neural representation used in recognition tasks. As the study of cognition has expanded to non-human animals, the term has diffused to describe a wider range of animal cognitive tools and strategies that guide action through the recognition of and discrimination between external states. One potential reason for this non-standardized meaning and variable employment is that researchers interested in the broad range of animal recognition tasks enjoy the simplicity of the cognitive template concept and have allowed it to become shorthand for many dissimilar or unknown neural processes without deep scrutiny of how this metaphor might comport with underlying neurophysiology. We review the functional evidence for cognitive templates in fields such as perception, navigation, communication, and learning, highlighting any neural correlates identified by these studies. We find that the concept of cognitive templates has facilitated valuable exploration at the interface between animal behavior and cognition, but the quest for a literal template has failed to attain mechanistic support at the level of neurophysiology. This may be the result of a misled search for a single physical locus for the 'template' itself. We argue that recognition and discrimination processes are best treated as emergent and, as such, may not be physically localized within single structures of the brain. Rather, current evidence suggests that such tasks are accomplished through synergies between multiple distributed processes in animal nervous systems. We thus advocate for researchers to move towards a more ecological, process-oriented conception, especially when discussing the neural underpinnings of recognition-based cognitive tasks.

Experience, but not age, is associated with volumetric mushroom body expansion in solitary alkali bees

In social insects, changes in behavior are often accompanied by structural changes in the brain. This neuroplasticity may come with experience (experience-dependent) or age (experience-expectant). Yet, the evolutionary relationship between neuroplasticity and sociality is unclear, because we know little about neuroplasticity in the solitary relatives of social species. We used confocal microscopy to measure brain changes in response to age and experience in a solitary halictid bee (Nomia melanderi). First, we compared the volume of individual brain regions among newly emerged females, laboratory females deprived of reproductive and foraging experience, and free-flying, nesting females. Experience, but not age, led to significant expansion of the mushroom bodies – higher-order processing centers associated with learning and memory. Next, we investigated how social experience influences neuroplasticity by comparing the brains of females kept in the laboratory either alone or paired with another female. Paired females had significantly larger olfactory regions of the mushroom bodies. Together, these experimental results indicate that experience-dependent neuroplasticity is common to both solitary and social taxa, whereas experience-expectant neuroplasticity may be an adaptation to life in a social colony. Further, neuroplasticity in response to social chemical signals may have facilitated the evolution of sociality.

Advances in the Study of Olfaction in Eusocial Ants

Over the past decade, spurred in part by the sequencing of the first ant genomes, there have been major advances in the field of olfactory myrmecology. With the discovery of a significant expansion of the odorant receptor gene family, considerable efforts have been directed toward understanding the olfactory basis of complex social behaviors in ant colonies. Here, we review recent pivotal studies that have begun to reveal insights into the development of the olfactory system as well as how olfactory stimuli are peripherally and centrally encoded. Despite significant biological and technical impediments, substantial progress has been achieved in the application of gene editing and other molecular techniques that notably distinguish the complex olfactory system of ants from other well-studied insect model systems, such as the fruit fly. In doing so, we hope to draw attention not only to these studies but also to critical knowledge gaps that will serve as a compass for future research endeavors.

Mechanisms of recognition in birds and social Hymenoptera: from detection to information processing

In this opinion piece, we briefly review our knowledge of the mechanisms underlying auditory individual recognition in birds and chemical nest-mate recognition in social Hymenoptera. We argue that even though detection and perception of recognition cues are well studied in social Hymenoptera, the neural mechanisms remain a black box. We compare our knowledge of these insect systems with that of the well-studied avian 'song control system'. We suggest that future studies on recognition should focus on the hypothesis of a distributed template instead of trying to locate the seat of the template as recent results do not seem to point in that direction. This article is part of the theme issue 'Signal detection theory in recognition systems: from evolving models to experimental tests'.

Social Complexity and Brain Evolution: Comparative Analysis of Modularity and Integration in Ant Brain Organization

The behavioral demands of living in social groups have been linked to the evolution of brain size and structure, but how social organization shapes investment and connectivity within and among functionally specialized brain regions remains unclear. To understand the influence of sociality on brain evolution in ants, a premier clade of eusocial insects, we statistically analyzed patterns of brain region size covariation as a proxy for brain region connectivity. We investigated brain structure covariance in young and old workers of two formicine ants, the Australasian weaver ant Oecophylla smaragdina, a pinnacle of social complexity in insects, and its socially basic sister clade Formica subsericea. As previously identified in other ant species, we predicted that our analysis would recognize in both species an olfaction-related brain module underpinning social information processing in the brain, and a second neuroanatomical cluster involved in nonolfactory sensorimotor processes, thus reflecting conservation of compartmental connectivity. Furthermore, we hypothesized that covariance patterns would reflect divergence in social organization and life histories either within this species pair or compared to other ant species. Contrary to our predictions, our covariance analyses revealed a weakly defined visual, rather than olfactory, sensory processing cluster in both species. This pattern may be linked to the reliance on vision for worker behavioral performance outside of the nest and the correlated expansion of the optic lobes to meet navigational demands in both species. Additionally, we found that colony size and social organization, key measures of social complexity, were only weakly correlated with brain modularity in these formicine ants. Worker age also contributed to variance in brain organization, though in different ways in each species. These findings suggest that brain organization may be shaped by the divergent life histories of the two study species. We compare our findings with patterns of brain organization of other eusocial insects.

Recent Advances in Behavioral (Epi)Genetics in Eusocial Insects

Eusocial insects live in societies in which distinct family members serve specific roles in maintaining the colony and advancing the reproductive ability of a few select individuals. Given the genetic similarity of all colony members, the diversity of morphologies and behaviors is surprising. Social communication relies on pheromones and olfaction, as shown by mutants of orco, the universal odorant receptor coreceptor, and through electrophysiological analysis of neuronal responses to pheromones. Additionally, neurohormonal factors and epigenetic regulators play a key role in caste-specific behavior, such as foraging and caste switching. These studies start to allow an understanding of the molecular mechanisms underlying social behavior and provide a technological foundation for future studies of eusocial insects. In this review, we highlight recent findings in eusocial insects that advance our understanding of genetic and epigenetic regulations of social behavior and provide perspectives on future studies using cutting-edge technologies.