Categorical perception of sound frequency by crickets

Multisensory perception constrains the formation of object categories: a review of evidence from sensory-driven and predictive processes on categorical decisions

Although object categorization is a fundamental cognitive ability, it is also a complex process going beyond the perception and organization of sensory stimulation. Here we review existing evidence about how the human brain acquires and organizes multisensory inputs into object representations that may lead to conceptual knowledge in memory. We first focus on evidence for two processes on object perception, multisensory integration of redundant information (e.g. seeing and feeling a shape) and crossmodal, statistical learning of complementary information (e.g. the 'moo' sound of a cow and its visual shape). For both processes, the importance attributed to each sensory input in constructing a multisensory representation of an object depends on the working range of the specific sensory modality, the relative reliability or distinctiveness of the encoded information and top-down predictions. Moreover, apart from sensory-driven influences on perception, the acquisition of featural information across modalities can affect semantic memory and, in turn, influence category decisions. In sum, we argue that both multisensory processes independently constrain the formation of object categories across the lifespan, possibly through early and late integration mechanisms, respectively, to allow us to efficiently achieve the everyday, but remarkable, ability of recognizing objects. This article is part of the theme issue 'Decision and control processes in multisensory perception'.

Spatially clustered neurons encode vocalization categories in the bat midbrain

Rapid categorization of vocalizations enables adaptive behavior across species. While categorical perception is thought to arise in the neocortex, humans and other animals could benefit from functional organization of ethologically-relevant sounds at earlier stages in the auditory hierarchy. Here, we developed two-photon calcium imaging in the awake echolocating bat (Eptesicus fuscus) to study encoding of sound meaning in the Inferior Colliculus, which is as few as two synapses from the inner ear. Echolocating bats produce and interpret frequency sweep-based vocalizations for social communication and navigation. Auditory playback experiments demonstrated that individual neurons responded selectively to social or navigation calls, enabling robust population-level decoding across categories. Strikingly, category-selective neurons formed spatial clusters, independent of tonotopy within the IC. These findings support a revised view of categorical processing in which specified channels for ethologically-relevant sounds are spatially segregated early in the auditory hierarchy, enabling rapid subcortical organization of call meaning.

Perceptual specializations for processing species-specific vocalizations in the common marmoset (Callithrix jacchus)

How humans and animals segregate sensory information into discrete, behaviorally meaningful categories is one of the hallmark questions in neuroscience. Much of the research around this topic in the auditory system has centered around human speech perception, in which categorical processes result in an enhanced sensitivity for acoustically meaningful differences and a reduced sensitivity for nonmeaningful distinctions. Much less is known about whether nonhuman primates process their species-specific vocalizations in a similar manner. We address this question in the common marmoset, a small arboreal New World primate with a rich vocal repertoire produced across a range of behavioral contexts. We first show that marmosets perceptually categorize their vocalizations in ways that correspond to previously defined call types for this species. Next, we show that marmosets are differentially sensitive to changes in particular acoustic features of their most common call types and that these sensitivity differences are matched to the population statistics of their vocalizations in ways that likely maximize category formation. Finally, we show that marmosets are less sensitive to changes in these acoustic features when within the natural range of variability of their calls, which possibly reflects perceptual specializations which maintain existing call categories. These findings suggest specializations for categorical vocal perception in a New World primate species and pave the way for future studies examining their underlying neural mechanisms.

Categorical representation of abstract spatial magnitudes in the executive telencephalon of crows

The ability to group abstract continuous magnitudes into meaningful categories is cognitively demanding but key to intelligent behavior. To explore its neuronal mechanisms, we trained carrion crows to categorize lines of variable lengths into arbitrary "short" and "long" categories. Single-neuron activity in the nidopallium caudolaterale (NCL) of behaving crows reflected the learned length categories of visual stimuli. The length categories could be reliably decoded from neuronal population activity to predict the crows' conceptual decisions. NCL activity changed with learning when a crow was retrained with the same stimuli assigned to more categories with new boundaries ("short", "medium," and "long"). Categorical neuronal representations emerged dynamically so that sensory length information at the beginning of the trial was transformed into behaviorally relevant categorical representations shortly before the crows' decision making. Our data show malleable categorization capabilities for abstract spatial magnitudes mediated by the flexible networks of the crow NCL.

Proportional processing of a visual mate choice signal in the green swordtail, Xiphophorus hellerii

During mate choice, receivers often assess the magnitude (duration, size, etc.) of signals that vary along a continuum and reflect variation in signaller quality. It is generally assumed that receivers assess this variation linearly, meaning each difference in signalling trait between signallers results in a commensurate change in receiver response. However, increasing evidence shows receivers can respond to signals non-linearly, for example through Weber's Law of proportional processing, where discrimination between stimuli is based on proportional, rather than absolute, differences in magnitude. We quantified mate preferences of female green swordtail fish, Xiphophorus hellerii, for pairs of males differing in body size. Preferences for larger males were better predicted by the proportional difference between males (proportional processing) than the absolute difference (linear processing). This demonstration of proportional processing of a visual signal implies that receiver perception may be an important mechanism selecting against the evolution of ever-larger signalling traits.

Local prothoracic auditory neurons in Ensifera

A new method for individually staining insect neurons with metal ions was described in the late 60s, closely followed by the introduction of the first bright fluorescent dye, Lucifer Yellow, for the same purpose. These milestones enabled an unprecedented level of detail regarding the neuronal basis of sensory processes such as hearing. Due to their conspicuous auditory behavior, orthopterans rapidly established themselves as a popular model for studies on hearing (first identified auditory neuron: 1974; first local auditory interneuron: 1977). Although crickets (Ensifera, Gryllidae) surpassed grasshoppers (Caelifera) as the main model taxon, surprisingly few neuronal elements have been described in crickets. More auditory neurons are described for bush crickets (Ensifera, Tettigoniidae), but due to their great biodiversity, the described auditory neurons in bush crickets are scattered over distantly related groups, hence being confounded by potential differences in the neuronal pathways themselves. Our review will outline all local auditory elements described in ensiferans so far. We will focus on one bush cricket species, Ancistrura nigrovittata (Phaneropterinae), which has the so-far highest diversity of identified auditory interneurons within Ensifera. We will present one novel and three previously described local prothoracic auditory neuron classes, comparing their morphology and aspects of sensory processing. Finally, we will hypothesize about their functions and evolutionary connections between ensiferan insects.

The myth of categorical perception

Categorical perception (CP) is likely the single finding from speech perception with the biggest impact on cognitive science. However, within speech perception, it is widely known to be an artifact of task demands. CP is empirically defined as a relationship between phoneme identification and discrimination. As discrimination tasks do not appear to require categorization, this was thought to support the claim that listeners perceive speech solely in terms of linguistic categories. However, 50 years of work using discrimination tasks, priming, the visual world paradigm, and event related potentials has rejected the strongest forms of CP and provided little strong evidence for any form of it. This paper reviews the origins and impact of this scientific meme and the work challenging it. It discusses work showing that the encoding of auditory input is largely continuous, not categorical, and describes the modern theoretical synthesis in which listeners preserve fine-grained detail to enable more flexible processing. This synthesis is fundamentally inconsistent with CP. This leads to a different understanding of how to use and interpret the most basic paradigms in speech perception-phoneme identification along a continuum-and has implications for understanding language and hearing disorders, development, and multilingualism.

Neural network organization for courtship-song feature detection in Drosophila

Animals communicate using sounds in a wide range of contexts, and auditory systems must encode behaviorally relevant acoustic features to drive appropriate reactions. How feature detection emerges along auditory pathways has been difficult to solve due to challenges in mapping the underlying circuits and characterizing responses to behaviorally relevant features. Here, we study auditory activity in the Drosophila melanogaster brain and investigate feature selectivity for the two main modes of fly courtship song, sinusoids and pulse trains. We identify 24 new cell types of the intermediate layers of the auditory pathway, and using a new connectomic resource, FlyWire, we map all synaptic connections between these cell types, in addition to connections to known early and higher-order auditory neurons-this represents the first circuit-level map of the auditory pathway. We additionally determine the sign (excitatory or inhibitory) of most synapses in this auditory connectome. We find that auditory neurons display a continuum of preferences for courtship song modes and that neurons with different song-mode preferences and response timescales are highly interconnected in a network that lacks hierarchical structure. Nonetheless, we find that the response properties of individual cell types within the connectome are predictable from their inputs. Our study thus provides new insights into the organization of auditory coding within the Drosophila brain.

Auditory mechanics in the grig (Cyphoderris monstrosa): tympanal travelling waves and frequency discrimination as a precursor to inner ear tonotopy

Ensiferan orthopterans offer a key study system for acoustic communication and the process of insect hearing. Cyphoderris monstrosa (Hagloidea) belongs to a relict ensiferan family and is often used for evolutionary comparisons between bushcrickets (Tettigoniidae) and their ancestors. Understanding how this species processes sound is therefore vital to reconstructing the evolutionary history of ensiferan hearing. Previous investigations have found a mismatch in the ear of this species, whereby neurophysiological and tympanal tuning does not match the conspecific communication frequency. However, the role of the whole tympanum in signal reception remains unknown. Using laser Doppler vibrometry, we show that the tympana are tonotopic, with higher frequencies being received more distally. The tympana use two key modalities to mechanically separate sounds into two auditory receptor populations. Frequencies below approximately 8 kHz generate a basic resonant mode in the proximal end of the tympanum, whereas frequencies above approximately 8 kHz generate travelling waves in the distal region. Micro-CT imaging of the ear and the presented data suggest that this tonotopy of the tympana drive the tonotopic mechanotransduction of the crista acustica (CA). This mechanism represents a functional intermediate between simple tuned tympana and the complex tonotopy of the bushcricket CA.

An auditory-responsive interneuron descending from the cricket brain: a new element in the auditory pathway

Crickets receive auditory information from their environment via ears located on the front legs. Ascending interneurons forward auditory activity to the brain, which houses a pattern recognition network for phonotaxis to conspecific calling songs and which controls negative phonotaxis to high-frequency sound pulses. Descending brain neurons, however, which are clearly involved in controlling these behaviors, have not yet been identified. We describe a descending auditory-responsive brain neuron with an arborization pattern that coincides with the ring-like auditory neuropil in the brain formed by the axonal arborizations of ascending and local interneurons, indicating its close link to auditory processing. Spiking activity of this interneuron occurs with a short latency to calling song patterns and the neuron copies the sound pulse pattern. The neuron preferentially responds to short sound pulses, but its activity appears to be independent of the calling song pattern recognition process. It also receives a weaker synaptic input in response to high-frequency pulses, which may contribute to its short latency spiking responses. This interneuron could be a crucial part in the auditory-to-motor transformation of the nervous system and contribute to the motor control of cricket auditory behavior.

RUBubbles as a novel tool to study categorization learning

Grouping objects into discrete categories affects how we perceive the world and represents a crucial element of cognition. Categorization is a widespread phenomenon that has been thoroughly studied. However, investigating categorization learning poses several requirements on the stimulus set in order to control which stimulus feature is used and to prevent mere stimulus-response associations or rote learning. Previous studies have used a wide variety of both naturalistic and artificial categories, the latter having several advantages such as better control and more direct manipulation of stimulus features. We developed a novel stimulus type to study categorization learning, which allows a high degree of customization at low computational costs and can thus be used to generate large stimulus sets very quickly. 'RUBubbles' are designed as visual artificial category stimuli that consist of an arbitrary number of colored spheres arranged in 3D space. They are generated using custom MATLAB code in which several stimulus parameters can be adjusted and controlled separately, such as number of spheres, position in 3D-space, sphere size, and color. Various algorithms for RUBubble generation can be combined with distinct behavioral training protocols to investigate different characteristics and strategies of categorization learning, such as prototype- vs. exemplar-based learning, different abstraction levels, or the categorization of a sensory continuum and category exceptions. All necessary MATLAB code is freely available as open-source code and can be customized or expanded depending on individual needs. RUBubble stimuli can be controlled purely programmatically or via a graphical user interface without MATLAB license or programming experience.

Neurophysiology goes wild: from exploring sensory coding in sound proof rooms to natural environments

To perform adaptive behaviours, animals have to establish a representation of the physical "outside" world. How these representations are created by sensory systems is a central issue in sensory physiology. This review addresses the history of experimental approaches toward ideas about sensory coding, using the relatively simple auditory system of acoustic insects. I will discuss the empirical evidence in support of Barlow's "efficient coding hypothesis", which argues that the coding properties of neurons undergo specific adaptations that allow insects to detect biologically important acoustic stimuli. This hypothesis opposes the view that the sensory systems of receivers are biased as a result of their phylogeny, which finally determine whether a sound stimulus elicits a behavioural response. Acoustic signals are often transmitted over considerable distances in complex physical environments with high noise levels, resulting in degradation of the temporal pattern of stimuli, unpredictable attenuation, reduced signal-to-noise levels, and degradation of cues used for sound localisation. Thus, a more naturalistic view of sensory coding must be taken, since the signals as broadcast by signallers are rarely equivalent to the effective stimuli encoded by the sensory system of receivers. The consequences of the environmental conditions for sensory coding are discussed.

The Ander's organ: a mechanism for anti-predator ultrasound in a relict orthopteran

The use of acoustics in predator evasion is a widely reported phenomenon amongst invertebrate taxa, but the study of ultrasonic anti-predator acoustics is often limited to the prey of bats. Here, we describe the acoustic function and morphology of a unique stridulatory structure - the Ander's organ - in the relict orthopteran Cyphoderris monstrosa (Ensifera, Hagloidea). This species is one of just eight remaining members of the family Prophalangopsidae, a group with a fossil record of over 90 extinct species widespread during the Jurassic period. We reveal that the sound produced by this organ has the characteristics of a broadband ultrasonic anti-predator defence, with a peak frequency of 58±15.5 kHz and a bandwidth of 50 kHz (at 10 dB below peak). Evidence from sexual dimorphism, knowledge on hearing capabilities and assessment of local predators, suggests that the signal likely targets ground-dwelling predators. Additionally, we reveal a previously undescribed series of cavities underneath the organ that probably function as a mechanism for ultrasound amplification. Morphological structures homologous in both appearance and anatomical location to the Ander's organ are observed to varying degrees in 4 of the 7 other extant members of this family, with the remaining 3 yet to be assessed. Therefore, we suggest that such structures may either be more widely present in this ancient family than previously assumed, or have evolved to serve a key function in the long-term survival of these few species, allowing them to outlive their extinct counterparts.

Categorical face perception in fish: How a fish brain warps reality to dissociate "same" from "different"

Categorical perception (CP) is the phenomenon by which a smoothly varying stimulus property undergoes a nonlinear transformation during processing in the brain. Consequently, the stimuli are perceived as belonging to distinct categories separated by a sharp boundary. Originally thought to be largely innate, the discovery of CP in tasks such as novel image discrimination has piqued the interest of cognitive scientists because it provides compelling evidence that learning can shape a category's perceptual boundaries. CP has been particularly closely studied in human face perception. In nonprimates, there is evidence for CP for sound and color discrimination, but not for image or face discrimination. Here, we investigate the potential for learned CP in a lower vertebrate, the damselfish Pomacentrus amboinensis. Specifically, we tested whether the ability of these fish to discriminate complex facial patterns tracked categorical rather than metric differences in the stimuli. We first trained the fish to discriminate sets of two facial patterns. Next, we morphed between these patterns and determined the just noticeable difference (JND) between a morph and original image. Finally, we tested for CP by analyzing the discrimination ability of the fish for pairs of JND stimuli along the spectrum of morphs between two original images. Discrimination performance was significant for the image pair straddling the boundary between categories, and chance for equivalent stimulus pairs on either side, thus producing the classic "category boundary" effect. Our results reveal how perception can be influenced in a top-down manner even in the absence of a visual cortex.

Neuroethology of acoustic communication in field crickets - from signal generation to song recognition in an insect brain

Field crickets are best known for the loud calling songs produced by males to attract conspecific females. This review aims to summarize the current knowledge of the neurobiological basis underlying the acoustic communication for mate finding in field crickets with emphasis on the recent research progress to understand the neuronal networks for motor pattern generation and auditory pattern recognition of the calling song in Gryllus bimaculatus. Strong scientific interest into the neural mechanisms underlying intraspecific communication has driven persistently advancing research efforts to study the male singing behaviour and female phonotaxis for mate finding in these insects. The growing neurobiological understanding also inspired many studies testing verifiable hypotheses in sensory ecology, bioacoustics and on the genetics and evolution of behaviour. Over last decades, acoustic communication in field crickets served as a very successful neuroethological model system. It has contributed significantly to the scientific process of establishing, reconsidering and refining fundamental concepts in behavioural neurosciences such as command neurons, central motor pattern generation, corollary discharge processing and pattern recognition by sensory feature detection, which are basic building blocks of our modern understanding on how nervous systems control and generate behaviour in all animals.

Decision making in the face of a deadly predator: high-amplitude behavioural thresholds can be adaptive for rainforest crickets under high background noise levels

Many insect families have evolved ears that are adapted to detect ultrasonic calls of bats. The acoustic sensory cues indicating the presence of a bat are then used to initiate bat avoidance behaviours. Background noise, in particular at ultrasonic frequencies, complicates these decisions, since a response to the background may result in costly false alarms. Here, we quantify bat avoidance responses of small rainforest crickets (Gryllidae, Trigoniinae), which live under conditions of high levels of ultrasonic background noise. Their bat avoidance behaviour exhibits markedly higher thresholds than most other studied eared insects. Their responses do not qualitatively differ at suprathreshold amplitudes up to sound pressure levels of 105 dB. Moreover, they also exhibit evasive responses to single, high-frequency events and do not require the repetitive sequence of ultrasonic calls typical for the search phase of bat echolocation calls. Analysis of bat and katydid sound amplitudes and peak frequencies in the crickets' rainforest habitat revealed that the cricket's behavioural threshold would successfully reject the katydid background noise. Using measurements of the crickets' echo target strength for bat predators, we calculated the detection distances for both predators and prey. Despite their high behavioural threshold, the cricket prey still has a significant detection advantage at frequencies between 20 and 40 kHz. The low-amplitude bat calls they ignore are no predation threat because even much louder calls would be detected before the bat would hear the cricket echo. This leaves ample time for evasive actions. Thus, a simple decision criterion based on a high-amplitude behavioural threshold can be adaptive under the high background noise levels in nocturnal rainforests, in avoiding false alarms and only missing detection for bat calls too far away to pose a risk. This article is part of the theme issue 'Signal detection theory in recognition systems: from evolving models to experimental tests'.

Von Uexküll Revisited: Addressing Human Biases in the Study of Animal Perception

More than 100 years ago, the biologist Jakob von Uexküll suggested that, because sensory systems are diverse, animals likely inhabit different sensory worlds (umwelten) than we do. Since von Uexküll, work across sensory modalities has confirmed that animals sometimes perceive sensory information that humans cannot, and it is now well-established that one must account for this fact when studying an animal's behavior. We are less adept, however, at recognizing cases in which non-human animals may not detect or perceive stimuli the same way we do, which is our focus here. In particular, we discuss three ways in which our own perception can result in misinformed hypotheses about the function of various stimuli. In particular, we may (1) make untested assumptions about how sensory information is perceived, based on how we perceive or measure it, (2) attribute undue significance to stimuli that we perceive as complex or striking, and (3) assume that animals divide the sensory world in the same way that we as scientists do. We discuss each of these biases and provide examples of cases where animals cannot perceive or are not attending to stimuli in the same way that we do, and how this may lead us to mistaken assumptions. Because what an animal perceives affects its behavior, we argue that these biases are especially important for researchers in sensory ecology, cognition, and animal behavior and communication to consider. We suggest that studying animal umwelten requires integrative approaches that combine knowledge of sensory physiology with behavioral assays.

Wiring patterns from auditory sensory neurons to the escape and song-relay pathways in fruit flies

Many animals rely on acoustic cues to decide what action to take next. Unraveling the wiring patterns of the auditory neural pathways is prerequisite for understanding such information processing. Here, we reconstructed the first step of the auditory neural pathway in the fruit fly brain, from primary to secondary auditory neurons, at the resolution of transmission electron microscopy. By tracing axons of two major subgroups of auditory sensory neurons in fruit flies, low-frequency tuned Johnston's organ (JO)-B neurons and high-frequency tuned JO-A neurons, we observed extensive connections from JO-B neurons to the main second-order neurons in both the song-relay and escape pathways. In contrast, JO-A neurons connected strongly to a neuron in the escape pathway. Our findings suggest that heterogeneous JO neuronal populations could be recruited to modify escape behavior whereas only specific JO neurons contribute to courtship behavior. We also found that all JO neurons have postsynaptic sites at their axons. Presynaptic modulation at the output sites of JO neurons could affect information processing of the auditory neural pathway in flies.

Categorical perception in animal communication and decision-making

The information an animal gathers from its environment, including that associated with signals, often varies continuously. Animals may respond to this continuous variation in a physical stimulus as lying in discrete categories rather than along a continuum, a phenomenon known as categorical perception. Categorical perception was first described in the context of speech and thought to be uniquely associated with human language. Subsequent work has since discovered that categorical perception functions in communication and decision-making across animal taxa, behavioral contexts, and sensory modalities. We begin with an overview of how categorical perception functions in speech perception and, then, describe subsequent work illustrating its role in nonhuman animal communication and decision-making. We synthesize this work to suggest that categorical perception may be favored where there is a benefit to 1) setting consistent behavioral response rules in the face of variation and potential overlap in the physical structure of signals, 2) especially rapid decision-making, or 3) reducing the costs associated with processing and/or comparing signals. We conclude by suggesting other systems in which categorical perception may play a role as a next step toward understanding how this phenomenon may influence our thinking about the function and evolution of animal communication and decision-making.

Novel system of communication in crickets originated at the same time as bat echolocation and includes male-male multimodal communication

Understanding the evolutionary origins of communication signals requires careful study of multiple species within a known phylogenetic framework. Most cricket species produce low-frequency calls for mate attraction, whereas they startle to high-frequency sounds similar to bat echolocation. Male crickets in the tribe Lebinthini produce high-frequency calls, to which females reply with vibrational signals. This novel communication system likely evolved by male sensory exploitation of acoustic startle to high-frequency sounds in females. This behavior was previously described for the Lebinthini from Asia. Here we demonstrate that this novel communication system is found in a Neotropical species, Ponca hebardi, and is therefore likely shared by the whole tribe Lebinthini, dating the origin of this behavior to coincide with the origin of echolocation in bats. Furthermore, we document male duets involving both acoustic and vibratory signals not previously described in crickets, and we tentatively interpret it as competitive masking between males.

Online Detection of Multiple Stimulus Changes Based on Single Neuron Interspike Intervals

Nervous systems need to detect stimulus changes based on their neuronal responses without using any additional information on the number, times, and types of stimulus changes. Here, two relatively simple, biologically realistic change point detection methods are compared with two common analysis methods. The four methods are applied to intra- and extracellularly recorded responses of a single cricket interneuron (AN2) to acoustic simulation. Solely based on these recorded responses, the methods should detect an unknown number of different types of sound intensity in- and decreases shortly after their occurrences. For this task, the methods rely on calculating an adjusting interspike interval (ISI). Both simple methods try to separate responses to intensity in- or decreases from activity during constant stimulation. The Pure-ISI method performs this task based on the distribution of the ISI, while the ISI-Ratio method uses the ratio of actual and previous ISI. These methods are compared to the frequently used Moving-Average method, which calculates mean and standard deviation of the instantaneous spike rate in a moving interval. Additionally, a classification method provides the upper limit of the change point detection performance that can be expected for the cricket interneuron responses. The classification learns the statistical properties of the actual and previous ISI during stimulus changes and constant stimulation from a training data set. The main results are: (1) The Moving-Average method requires a stable activity in a long interval to estimate the previous activity, which was not always given in our data set. (2) The Pure-ISI method can reliably detect stimulus intensity increases when the neuron bursts, but it fails to identify intensity decreases. (3) The ISI-Ratio method detects stimulus in- and decreases well, if the spike train is not too noisy. (4) The classification method shows good performance for the detection of stimulus in- and decreases. But due to the statistical learning, this method tends to confuse responses to constant stimulation with responses triggered by a stimulus change. Our results suggest that stimulus change detection does not require computationally costly mechanisms. Simple nervous systems like the cricket's could effectively apply ISI-Ratios to solve this fundamental task.

Sensory-to-Category Transformation via Dynamic Reorganization of Ensemble Structures in Mouse Auditory Cortex

The ability to group physical stimuli into behaviorally relevant categories is fundamental to perception and cognition. Despite a large body of work on stimulus categorization at the behavioral and cognitive levels, little is known about the underlying mechanisms at the neuronal level. Here, combining mouse auditory psychophysical behavior and in vivo two-photon imaging from the auditory cortex, we investigate how sensory-to-category transformation is implemented by cortical neurons during a stimulus categorization task. Distinct from responses during passive listening, many neurons exhibited emergent selectivity to stimuli near the category boundary during task performance, reshaping local tuning maps; other neurons became more selective to category membership of stimuli. At the population level, local cortical ensembles robustly encode category information and predict trial-by-trial decisions during task performance. Our data uncover a task-dependent dynamic reorganization of cortical response patterns serving as a neural mechanism for sensory-to-category transformation during perceptual decision-making.

Categorical colour perception occurs in both signalling and non-signalling colour ranges in a songbird

Although perception begins when a stimulus is transduced by a sensory neuron, numerous perceptual mechanisms can modify sensory information as it is processed by an animal's nervous system. One such mechanism is categorical perception, in which (1) continuously varying stimuli are labelled as belonging to a discrete number of categories and (2) there is enhanced discrimination between stimuli from different categories as compared with equally different stimuli from within the same category. We have shown previously that female zebra finches ( Taeniopygia guttata) categorically perceive colours along an orange-red continuum that aligns with the carotenoid-based coloration of male beaks, a trait that serves as an assessment signal in female mate choice. Here, we demonstrate that categorical perception occurs along a blue-green continuum as well, suggesting that categorical colour perception may be a general feature of zebra finch vision. Although we identified two categories in both the blue-green and the orange-red ranges, we also found that individuals could better differentiate colours from within the same category in the blue-green as compared with the orange-red range, indicative of less clear categorization in the blue-green range. We discuss reasons why categorical perception may vary across the visible spectrum, including the possibility that such differences are linked to the behavioural or ecological function of different colour ranges.

Acoustic Pattern Recognition and Courtship Songs: Insights from Insects

Across the animal kingdom, social interactions rely on sound production and perception. From simple cricket chirps to more elaborate bird songs, animals go to great lengths to communicate information critical for reproduction and survival via acoustic signals. Insects produce a wide array of songs to attract a mate, and the intended receivers must differentiate these calls from competing sounds, analyze the quality of the sender from spectrotemporal signal properties, and then determine how to react. Insects use numerically simple nervous systems to analyze and respond to courtship songs, making them ideal model systems for uncovering the neural mechanisms underlying acoustic pattern recognition. We highlight here how the combination of behavioral studies and neural recordings in three groups of insects-crickets, grasshoppers, and fruit flies-reveals common strategies for extracting ethologically relevant information from acoustic patterns and how these findings might translate to other systems.

Vocal tract constancy in birds and humans

Humans perceive speech as being relatively stable despite acoustic variation caused by vocal tract (VT) differences between speakers. Humans use perceptual 'vocal tract normalisation' (VTN) and other processes to achieve this stability. Similarity in vocal apparatus/acoustics between birds and humans means that birds might also experience VT variation. This has the potential to impede bird communication. No known studies have explicitly examined this, but a number of studies show perceptual stability or 'perceptual constancy' in birds similar to that seen in humans when dealing with VT variation. This review explores similarities between birds and humans and concludes that birds show sufficient evidence of perceptual constancy to warrant further research in this area. Future work should 1) quantify the multiple sources of variation in bird vocalisations, including, but not limited to VT variations, 2) determine whether vocalisations are perniciously disrupted by any of these and 3) investigate how birds reduce variation to maintain perceptual constancy and perceptual efficiency.

Egg discrimination along a gradient of natural variation in eggshell coloration

Accurate recognition of salient cues is critical for adaptive responses, but the underlying sensory and cognitive processes are often poorly understood. For example, hosts of avian brood parasites have long been assumed to reject foreign eggs from their nests based on the total degree of dissimilarity in colour to their own eggs, regardless of the foreign eggs' colours. We tested hosts' responses to gradients of natural (blue-green to brown) and artificial (green to purple) egg colours, and demonstrate that hosts base rejection decisions on both the direction and degree of colour dissimilarity along the natural, but not artificial, gradient of egg colours. Hosts rejected brown eggs and accepted blue-green eggs along the natural egg colour gradient, irrespective of the total perceived dissimilarity from their own egg's colour. By contrast, their responses did not vary along the artificial colour gradient. Our results demonstrate that egg recognition is specifically tuned to the natural gradient of avian eggshell colour and suggest a novel decision rule. These results highlight the importance of considering sensory reception and decision rules when studying perception, and illustrate that our understanding of recognition processes benefits from examining natural variation in phenotypes.

Comparative Aspects of Hearing in Vertebrates and Insects with Antennal Ears

The evolution of hearing in terrestrial animals has resulted in remarkable adaptations enabling exquisitely sensitive sound detection by the ear and sophisticated sound analysis by the brain. In this review, we examine several such characteristics, using examples from insects and vertebrates. We focus on two strong and interdependent forces that have been shaping the auditory systems across taxa: the physical environment of auditory transducers on the small, subcellular scale, and the sensory-ecological environment within which hearing happens, on a larger, evolutionary scale. We briefly discuss acoustical feature selectivity and invariance in the central auditory system, highlighting a major difference between insects and vertebrates as well as a major similarity. Through such comparisons within a sensory ecological framework, we aim to emphasize general principles underlying acute sensitivity to airborne sounds.

Hearing with exceptionally thin tympana: Ear morphology and tympanal membrane vibrations in eneopterine crickets

The receiver sensory system plays a crucial role in the evolution of new communication signals in insects. Among acoustic communicating crickets, the tribe Lebinthini (Eneopterinae) has evolved a unique communication system in that males produce exceptionally high-frequency calls and females respond with vibratory signals to guide males towards them. In this study, we describe nine species of Eneopterinae in which the sound receiving structures have undergone considerable morphological changes. We revealed that the anterior tympanal membrane (ATM) of the ear was extremely thin, as little as 0.35 µm thick, and to the best of our knowledge, this is the thinnest tympanal membrane found in crickets thus far. Measurements of tympanum vibrations obtained from Lebinthus bitaeniatus demonstrated a strong sensitivity towards higher frequencies. The finding also coincides with the neuronal tuning of ascending neurons and the behavioural response of the Lebinthini. The morphologically specialized ATM and its mechanical sensitivity for high frequencies, therefore, may have driven the sensory exploitation of an anti-predator behaviour that led to the evolution of a new communication system known for this group of crickets. The hypothetical phylogenetic origin of the investigated tympanal ears is discussed.

Crickets alter wind-elicited escape strategies depending on acoustic context

Acoustic signals trigger various behaviours in insects such as courtship or escape from predators. However, it remains unknown whether insects utilize acoustic signals to recognize environmental contexts. The cricket is a prominent model insect for neuroethological studies on acoustic behaviour because female crickets exhibit positive phonotaxis in response to male calling songs, and flying crickets display avoidance behaviour for high-frequency sounds such as echolocation call of bats. The carrier frequency of these sounds is a major factor in determining whether they initiate these acoustic behaviours. Here, we examined the impacts of different frequencies of tone sounds on cercal-mediated escape behaviour, using a 5-kHz tone corresponding to the calling song and a 15-kHz tone serving as a trigger of avoidance behaviours. Neither frequency elicited a response in the standing cricket by itself, but they had different impacts on walking responses to airflow stimuli. While the 15-kHz tone reduced response probability, extended moving distance, and enhanced turn-angle variability, the 5-kHz tone had no effect. Although both frequencies of tones facilitated walking backward, the 15-kHz tone had a larger effect than the 5-kHz tone. These frequency dependencies of behavioural modulation suggest that crickets can recognize acoustic contexts and alter their escape strategy accordingly.

The Theory of Localist Representation and of a Purely Abstract Cognitive System: The Evidence from Cortical Columns, Category Cells, and Multisensory Neurons

The debate about representation in the brain and the nature of the cognitive system has been going on for decades now. This paper examines the neurophysiological evidence, primarily from single cell recordings, to get a better perspective on both the issues. After an initial review of some basic concepts, the paper reviews the data from single cell recordings - in cortical columns and of category-selective and multisensory neurons. In neuroscience, columns in the neocortex (cortical columns) are understood to be a basic functional/computational unit. The paper reviews the fundamental discoveries about the columnar organization and finds that it reveals a massively parallel search mechanism. This columnar organization could be the most extensive neurophysiological evidence for the widespread use of localist representation in the brain. The paper also reviews studies of category-selective cells. The evidence for category-selective cells reveals that localist representation is also used to encode complex abstract concepts at the highest levels of processing in the brain. A third major issue is the nature of the cognitive system in the brain and whether there is a form that is purely abstract and encoded by single cells. To provide evidence for a single-cell based purely abstract cognitive system, the paper reviews some of the findings related to multisensory cells. It appears that there is widespread usage of multisensory cells in the brain in the same areas where sensory processing takes place. Plus there is evidence for abstract modality invariant cells at higher levels of cortical processing. Overall, that reveals the existence of a purely abstract cognitive system in the brain. The paper also argues that since there is no evidence for dense distributed representation and since sparse representation is actually used to encode memories, there is actually no evidence for distributed representation in the brain. Overall, it appears that, at an abstract level, the brain is a massively parallel, distributed computing system that is symbolic. The paper also explains how grounded cognition and other theories of the brain are fully compatible with localist representation and a purely abstract cognitive system.

Is it one call or two? Perception of inter-pulse and inter-call intervals in the grey treefrog, Hyla versicolor

Female grey treefrogs, Hyla versicolor, treat a call with an anomalously large gap between call pulses as relatively unattractive. However, whether such a ‘call’ is treated (or perhaps perceived) as a single call or two separate calls, an issue relevant to the problem of perceptual segregation of calls of different males, was unclear. We tested whether there could be gaps shorter than a typical inter-call interval that would be sufficient to elicit the latter percept by offering females a choice between a 5-pulse call and 13-pulse call separated by a 1575-ms gap and these pulse strings separated by shorter gaps. Preliminary results suggested that perception of inter-call gaps was categorical, and the distributions of such gaps between males in choruses were compatible with this finding. However, when we also offered females call alternatives designed to specifically test the hypothesis of categorical perception, predictions were only sometimes met.

Revisiting adaptations of neotropical katydids (Orthoptera: Tettigoniidae) to gleaning bat predation

All animals have defenses against predators, but assessing the effectiveness of such traits is challenging. Neotropical katydids (Orthoptera: Tettigoniidae) are an abundant, ubiquitous, and diverse group of large insects eaten by a variety of predators, including substrate-gleaning bats. Gleaning bats capture food from surfaces and usually use prey-generated sounds to detect and locate prey. A number of Neotropical katydid signaling traits, such as the emission of ultrasonic frequencies, substrate vibration communication, infrequent calling, and ultrasound-evoked song cessation are thought to have evolved as defenses against substrate-gleaning bats. We collected insect remains from hairy big-eared bat (Micronycteris hirsuta) roosts in Panama. We identified insect remains to order, species, or genus and quantified the proportion of prey with defenses against predatory bats based on defenses described in the literature. Most remains were from katydids and half of those were from species with documented defenses against substrate-gleaning bats. Many culled remains were from insects that do not emit mate-calling songs (e.g. beetles, dragonflies, cockroaches, and female katydids), indicating that eavesdropping on prey signals is not the only prey-finding strategy used by this bat. Our results show that substrate-gleaning bats can occasionally overcome katydid defenses.

Sequential Filtering Processes Shape Feature Detection in Crickets: A Framework for Song Pattern Recognition

Intraspecific acoustic communication requires filtering processes and feature detectors in the auditory pathway of the receiver for the recognition of species-specific signals. Insects like acoustically communicating crickets allow describing and analysing the mechanisms underlying auditory processing at the behavioral and neural level. Female crickets approach male calling song, their phonotactic behavior is tuned to the characteristic features of the song, such as the carrier frequency and the temporal pattern of sound pulses. Data from behavioral experiments and from neural recordings at different stages of processing in the auditory pathway lead to a concept of serially arranged filtering mechanisms. These encompass a filter for the carrier frequency at the level of the hearing organ, and the pulse duration through phasic onset responses of afferents and reciprocal inhibition of thoracic interneurons. Further, processing by a delay line and coincidence detector circuit in the brain leads to feature detecting neurons that specifically respond to the species-specific pulse rate, and match the characteristics of the phonotactic response. This same circuit may also control the response to the species-specific chirp pattern. Based on these serial filters and the feature detecting mechanism, female phonotactic behavior is shaped and tuned to the characteristic properties of male calling song.

Acoustic sequences in non-human animals: a tutorial review and prospectus

Animal acoustic communication often takes the form of complex sequences, made up of multiple distinct acoustic units. Apart from the well-known example of birdsong, other animals such as insects, amphibians, and mammals (including bats, rodents, primates, and cetaceans) also generate complex acoustic sequences. Occasionally, such as with birdsong, the adaptive role of these sequences seems clear (e.g. mate attraction and territorial defence). More often however, researchers have only begun to characterise - let alone understand - the significance and meaning of acoustic sequences. Hypotheses abound, but there is little agreement as to how sequences should be defined and analysed. Our review aims to outline suitable methods for testing these hypotheses, and to describe the major limitations to our current and near-future knowledge on questions of acoustic sequences. This review and prospectus is the result of a collaborative effort between 43 scientists from the fields of animal behaviour, ecology and evolution, signal processing, machine learning, quantitative linguistics, and information theory, who gathered for a 2013 workshop entitled, 'Analysing vocal sequences in animals'. Our goal is to present not just a review of the state of the art, but to propose a methodological framework that summarises what we suggest are the best practices for research in this field, across taxa and across disciplines. We also provide a tutorial-style introduction to some of the most promising algorithmic approaches for analysing sequences. We divide our review into three sections: identifying the distinct units of an acoustic sequence, describing the different ways that information can be contained within a sequence, and analysing the structure of that sequence. Each of these sections is further subdivided to address the key questions and approaches in that area. We propose a uniform, systematic, and comprehensive approach to studying sequences, with the goal of clarifying research terms used in different fields, and facilitating collaboration and comparative studies. Allowing greater interdisciplinary collaboration will facilitate the investigation of many important questions in the evolution of communication and sociality.

Hearing in Insects

Insect hearing has independently evolved multiple times in the context of intraspecific communication and predator detection by transforming proprioceptive organs into ears. Research over the past decade, ranging from the biophysics of sound reception to molecular aspects of auditory transduction to the neuronal mechanisms of auditory signal processing, has greatly advanced our understanding of how insects hear. Apart from evolutionary innovations that seem unique to insect hearing, parallels between insect and vertebrate auditory systems have been uncovered, and the auditory sensory cells of insects and vertebrates turned out to be evolutionarily related. This review summarizes our current understanding of insect hearing. It also discusses recent advances in insect auditory research, which have put forward insect auditory systems for studying biological aspects that extend beyond hearing, such as cilium function, neuronal signal computation, and sensory system evolution.

Evolution of a Communication System by Sensory Exploitation of Startle Behavior

New communication signals can evolve by sensory exploitation if signaling taps into preexisting sensory biases in receivers [1, 2]. For mate attraction, signals are typically similar to attractive environmental cues like food [3-6], which amplifies their attractiveness to mates, as opposed to aversive stimuli like predator cues. Female field crickets approach the low-frequency calling song of males, whereas they avoid high-frequency sounds like predatory bat calls [7]. In one group of crickets (Eneopterinae: Lebinthini), however, males produce exceptionally high-frequency calling songs in the range of bat calls [8], a surprising signal in the context of mate attraction. We found that female lebinthines, instead of approaching singing males, produce vibrational responses after male calls, and males track the source of vibrations to find females. We also demonstrate that field cricket species closely related to the Lebinthini show an acoustic startle response to high-frequency sounds that generates substrate vibrations similar to those produced by female lebinthine crickets. Therefore, the startle response is the most likely evolutionary origin of the female lebinthine vibrational signal. In field crickets, the brain receives activity from two auditory interneurons; AN1 tuned to male calling song controls positive phonotaxis, and AN2 tuned to high-frequency bat calls triggers negative phonotaxis [9, 10]. In lebinthine crickets, however, we found that auditory ascending neurons are only tuned to high-frequency sounds, and their tuning matches the thresholds for female vibrational signals. Our results demonstrate how sensory exploitation of anti-predator behavior can evolve into a communication system that benefits both senders and receivers.

Auditory modulation of wind-elicited walking behavior in the cricket Gryllus bimaculatus

Animals flexibly change their locomotion triggered by an identical stimulus depending on the environmental context and behavioral state. This indicates that additional sensory inputs in different modality from the stimulus triggering the escape response affect the neuronal circuit governing that behavior. However, how the spatio-temporal relationships between these two stimuli effect a behavioral change remains unknown. We studied this question, using crickets, which respond to a short air-puff by oriented walking activity mediated by the cercal sensory system. In addition, an acoustic stimulus, such as conspecific 'song' received by the tympanal organ, elicits a distinct oriented locomotion termed phonotaxis. In this study, we examined the cross-modal effects on wind-elicited walking when an acoustic stimulus was preceded by an air-puff and tested whether the auditory modulation depends on the coincidence of the direction of both stimuli. A preceding 10 kHz pure tone biased the wind-elicited walking in a backward direction and elevated a threshold of the wind-elicited response, whereas other movement parameters, including turn angle, reaction time, walking speed and distance were unaffected. The auditory modulations, however, did not depend on the coincidence of the stimulus directions. A preceding sound consistently altered the wind-elicited walking direction and response probability throughout the experimental sessions, meaning that the auditory modulation did not result from previous experience or associative learning. These results suggest that the cricket nervous system is able to integrate auditory and air-puff stimuli, and modulate the wind-elicited escape behavior depending on the acoustic context.