Motor planning for vocal production in common marmosets

Stimulation of caudal inferior and middle frontal gyri disrupts planning during spoken interaction

Turn-taking is a central feature of conversation across languages and cultures.1,2,3,4 This key social behavior requires numerous sensorimotor and cognitive operations1,5,6 that can be organized into three general phases: comprehension of a partner's turn, preparation of a speaker's own turn, and execution of that turn. Using intracranial electrocorticography, we recently demonstrated that neural activity related to these phases is functionally distinct during turn-taking.7 In particular, networks active during the perceptual and articulatory stages of turn-taking consisted of structures known to be important for speech-related sensory and motor processing,8,9,10,11,12,13,14,15,16,17 while putative planning dynamics were most regularly observed in the caudal inferior frontal gyrus (cIFG) and the middle frontal gyrus (cMFG). To test if these structures are necessary for planning during spoken interaction, we used direct electrical stimulation (DES) to transiently perturb cortical function in neurosurgical patient-volunteers performing a question-answer task.7,18,19 We found that stimulating the cIFG and cMFG led to various response errors9,13,20,21 but not gross articulatory deficits, which instead resulted from DES of structures involved in motor control8,13,20,22 (e.g., the precentral gyrus). Furthermore, perturbation of the cIFG and cMFG delayed inter-speaker timing-consistent with slowed planning-while faster responses could result from stimulation of sites located in other areas. Taken together, our findings suggest that the cIFG and cMFG contain critical preparatory circuits that are relevant for interactive language use.

Distributed representations of prediction error signals across the cortical hierarchy are synergistic

A relevant question concerning inter-areal communication in the cortex is whether these interactions are synergistic. Synergy refers to the complementary effect of multiple brain signals conveying more information than the sum of each isolated signal. Redundancy, on the other hand, refers to the common information shared between brain signals. Here, we dissociated cortical interactions encoding complementary information (synergy) from those sharing common information (redundancy) during prediction error (PE) processing. We analyzed auditory and frontal electrocorticography (ECoG) signals in five common awake marmosets performing two distinct auditory oddball tasks and investigated to what extent event-related potentials (ERP) and broadband (BB) dynamics encoded synergistic and redundant information about PE processing. The information conveyed by ERPs and BB signals was synergistic even at lower stages of the hierarchy in the auditory cortex and between auditory and frontal regions. Using a brain-constrained neural network, we simulated the synergy and redundancy observed in the experimental results and demonstrated that the emergence of synergy between auditory and frontal regions requires the presence of strong, long-distance, feedback, and feedforward connections. These results indicate that distributed representations of PE signals across the cortical hierarchy can be highly synergistic.

Multiple processes of vocal sensory-motor interaction in primate auditory cortex

Sensory-motor interactions in the auditory system play an important role in vocal self-monitoring and control. These result from top-down corollary discharges, relaying predictions about vocal timing and acoustics. Recent evidence suggests such signals may be two distinct processes, one suppressing neural activity during vocalization and another enhancing sensitivity to sensory feedback, rather than a single mechanism. Single-neuron recordings have been unable to disambiguate due to overlap of motor signals with sensory inputs. Here, we sought to disentangle these processes in marmoset auditory cortex during production of multi-phrased 'twitter' vocalizations. Temporal responses revealed two timescales of vocal suppression: temporally-precise phasic suppression during phrases and sustained tonic suppression. Both components were present within individual neurons, however, phasic suppression presented broadly regardless of frequency tuning (gating), while tonic was selective for vocal frequencies and feedback (prediction). This suggests that auditory cortex is modulated by concurrent corollary discharges during vocalization, with different computational mechanisms.

Frontal cortex activity during the production of diverse social communication calls in marmoset monkeys

Vocal communication is essential for social behaviors in humans and non-human primates. While the frontal cortex is crucial to human speech production, its role in vocal production in non-human primates has long been questioned. It is unclear whether activities in the frontal cortex represent diverse vocal signals used in non-human primate communication. Here we studied single neuron activities and local field potentials (LFP) in the frontal cortex of male marmoset monkeys while the animal engaged in vocal exchanges with conspecifics in a social environment. We found that both single neuron activities and LFP were modulated by the production of each of the four major call types. Moreover, neural activities showed distinct patterns for different call types and theta-band LFP oscillations showed phase-locking to the phrases of twitter calls, suggesting a neural representation of vocalization features. Our results suggest important functions of the marmoset frontal cortex in supporting the production of diverse vocalizations in communication.

The neurobiology of vocal communication in marmosets

An increasingly popular animal model for studying the neural basis of social behavior, cognition, and communication is the common marmoset (Callithrix jacchus). Interest in this New World primate across neuroscience is now being driven by their proclivity for prosociality across their repertoire, high volubility, and rapid development, as well as their amenability to naturalistic testing paradigms and freely moving neural recording and imaging technologies. The complement of these characteristics set marmosets up to be a powerful model of the primate social brain in the years to come. Here, we focus on vocal communication because it is the area that has both made the most progress and illustrates the prodigious potential of this species. We review the current state of the field with a focus on the various brain areas and networks involved in vocal perception and production, comparing the findings from marmosets to other animals, including humans.

A Theoretical Framework for Human and Nonhuman Vocal Interaction

Vocal communication is a critical feature of social interaction across species; however, the relation between such behavior in humans and nonhumans remains unclear. To enable comparative investigation of this topic, we review the literature pertinent to interactive language use and identify the superset of cognitive operations involved in generating communicative action. We posit these functions comprise three intersecting multistep pathways: (a) the Content Pathway, which selects the movements constituting a response; (b) the Timing Pathway, which temporally structures responses; and (c) the Affect Pathway, which modulates response parameters according to internal state. These processing streams form the basis of the Convergent Pathways for Interaction framework, which provides a conceptual model for investigating the cognitive and neural computations underlying vocal communication across species.

Compensatory mechanisms affect sensorimotor integration during ongoing vocal motor acts in marmoset monkeys

Any transmission of vocal signals faces the challenge of acoustic interferences such as heavy rain, wind, animal or urban sounds. Consequently, several mechanisms and strategies have evolved to optimize signal-to-noise ratio. Examples to increase detectability are the Lombard effect, an involuntary rise in call amplitude in response to masking ambient noise, which is often associated with other vocal changes such as call frequency and duration, as well as the animals' capability of limiting calling to periods where noise perturbation is absent. Previous studies revealed vocal flexibility and various audio-vocal integration mechanisms in marmoset monkeys. Using acoustic perturbation triggered by vocal behaviour, we investigated whether marmosets are capable of exhibiting changes in call structure when perturbing noise starts after call onset or whether such effects only occur if noise perturbation starts prior to call onset. We show that marmosets are capable of rapidly modulating call amplitude and frequency in response to such noise perturbation. Vocalizations swiftly increased call frequency after noise onset indicating a rapid effect of perturbing noise on vocal motor production. Call amplitudes were also affected. Interestingly, however, the marmosets did not exhibit the Lombard effect as previously reported but decreased call intensity in response to noise. Our findings indicate that marmosets possess a general avoidance strategy to call in the presence of ambient noise and suggest that these animals are capable of counteracting a previously thought involuntary audio-vocal mechanism, the Lombard effect. These findings will pave the way to investigate the underlying audio-vocal integration mechanisms explaining these behaviours.

Marmosets: A Neuroscientific Model of Human Social Behavior

The common marmoset (Callithrix jacchus) has garnered interest recently as a powerful model for the future of neuroscience research. Much of this excitement has centered on the species' reproductive biology and compatibility with gene editing techniques, which together have provided a path for transgenic marmosets to contribute to the study of disease as well as basic brain mechanisms. In step with technical advances is the need to establish experimental paradigms that optimally tap into the marmosets' behavioral and cognitive capacities. While conditioned task performance of a marmoset can compare unfavorably with rhesus monkey performance on conventional testing paradigms, marmosets' social behavior and cognition are more similar to that of humans. For example, marmosets are among only a handful of primates that, like humans, routinely pair bond and care cooperatively for their young. They are also notably pro-social and exhibit social cognitive abilities, such as imitation, that are rare outside of the Apes. In this Primer, we describe key facets of marmoset natural social behavior and demonstrate that emerging behavioral paradigms are well suited to isolate components of marmoset cognition that are highly relevant to humans. These approaches generally embrace natural behavior, which has been rare in conventional primate testing, and thus allow for a new consideration of neural mechanisms underlying primate social cognition and signaling. We anticipate that through parallel technical and paradigmatic advances, marmosets will become an essential model of human social behavior, including its dysfunction in neuropsychiatric disorders.

Responses of primate frontal cortex neurons during natural vocal communication

The role of primate frontal cortex in vocal communication and its significance in language evolution have a controversial history. While evidence indicates that vocalization processing occurs in ventrolateral prefrontal cortex neurons, vocal-motor activity has been conjectured to be primarily subcortical and suggestive of a distinctly different neural architecture from humans. Direct evidence of neural activity during natural vocal communication is limited, as previous studies were performed in chair-restrained animals. Here we recorded the activity of single neurons across multiple regions of prefrontal and premotor cortex while freely moving marmosets engaged in a natural vocal behavior known as antiphonal calling. Our aim was to test whether neurons in marmoset frontal cortex exhibited responses during vocal-signal processing and/or vocal-motor production in the context of active, natural communication. We observed motor-related changes in single neuron activity during vocal production, but relatively weak sensory responses for vocalization processing during this natural behavior. Vocal-motor responses occurred both prior to and during call production and were typically coupled to the timing of each vocalization pulse. Despite the relatively weak sensory responses a population classifier was able to distinguish between neural activity that occurred during presentations of vocalization stimuli that elicited an antiphonal response and those that did not. These findings are suggestive of the role that nonhuman primate frontal cortex neurons play in natural communication and provide an important foundation for more explicit tests of the functional contributions of these neocortical areas during vocal behaviors.

Brain mechanisms of acoustic communication in humans and nonhuman primates: An evolutionary perspective

Any account of “what is special about the human brain” (Passingham 2008) must specify the neural basis of our unique ability to produce speech and delineate how these remarkable motor capabilities could have emerged in our hominin ancestors. Clinical data suggest that the basal ganglia provide a platform for the integration of primate-general mechanisms of acoustic communication with the faculty of articulate speech in humans. Furthermore, neurobiological and paleoanthropological data point at a two-stage model of the phylogenetic evolution of this crucial prerequisite of spoken language: (i) monosynaptic refinement of the projections of motor cortex to the brainstem nuclei that steer laryngeal muscles, presumably, as part of a “phylogenetic trend” associated with increasing brain size during hominin evolution; (ii) subsequent vocal-laryngeal elaboration of cortico-basal ganglia circuitries, driven by human-specificFOXP2mutations.;>This concept implies vocal continuity of spoken language evolution at the motor level, elucidating the deep entrenchment of articulate speech into a “nonverbal matrix” (Ingold 1994), which is not accounted for by gestural-origin theories. Moreover, it provides a solution to the question for the adaptive value of the “first word” (Bickerton 2009) since even the earliest and most simple verbal utterances must have increased the versatility of vocal displays afforded by the preceding elaboration of monosynaptic corticobulbar tracts, giving rise to enhanced social cooperation and prestige. At the ontogenetic level, the proposed model assumes age-dependent interactions between the basal ganglia and their cortical targets, similar to vocal learning in some songbirds. In this view, the emergence of articulate speech builds on the “renaissance” of an ancient organizational principle and, hence, may represent an example of “evolutionary tinkering” (Jacob 1977).

The effect of habitat acoustics on common marmoset vocal signal transmission

Noisy acoustic environments present several challenges for the evolution of acoustic communication systems. Among the most significant is the need to limit degradation of spectro-temporal signal structure in order to maintain communicative efficacy. This can be achieved by selecting for several potentially complementary processes. Selection can act on behavioral mechanisms permitting signalers to control the timing and occurrence of signal production to avoid acoustic interference. Likewise, the signal itself may be the target of selection, biasing the evolution of its structure to comprise acoustic features that avoid interference from ambient noise or degrade minimally in the habitat. Here, we address the latter topic for common marmoset (Callithrix jacchus) long-distance contact vocalizations, known as phee calls. Our aim was to test whether this vocalization is specifically adapted for transmission in a species-typical forest habitat, the Atlantic forests of northeastern Brazil. We combined seasonal analyses of ambient habitat acoustics with experiments in which pure tones, clicks, and vocalizations were broadcast and rerecorded at different distances to characterize signal degradation in the habitat. Ambient sound was analyzed from intervals throughout the day and over rainy and dry seasons, showing temporal regularities across varied timescales. Broadcast experiment results indicated that the tone and click stimuli showed the typically inverse relationship between frequency and signaling efficacy. Although marmoset phee calls degraded over distance with marked predictability compared with artificial sounds, they did not otherwise appear to be specially designed for increased transmission efficacy or minimal interference in this habitat. We discuss these data in the context of other similar studies and evidence of potential behavioral mechanisms for avoiding acoustic interference in order to maintain effective vocal communication in common marmosets.

Individual recognition during bouts of antiphonal calling in common marmosets

Many vocalizations are encoded with a diversity of acoustic information about the signal producer. Amongst this information content are social categories related to the identity of the caller that are important for determining if and how a signal receiver may interact with that individual. Here, we employed a novel playback method in common marmosets (Callithrix jacchus) to test individual recognition during bouts of antiphonal calling. These experiments utilized custom, interactive playback software that effectively engaged subjects in antiphonal calling using vocalizations produced by a single individual and presented 'probe' vocalization stimuli representing a different individual at specific points within bouts of calling. The aim here was to test whether marmosets would recognize that the probe stimulus was a phee call produced by a different individual. Data indicated that marmosets were able to detect the change in caller identity; subjects produced significantly fewer antiphonal call responses to probe than control stimuli and, in some conditions, exhibited a shorter latency to produce the vocal response. These data suggest that marmosets recognize the identity of the individual during bouts of antiphonal calling. Furthermore, these results provide a methodological foundation for implementing the probe playback procedure to examine a broader range of social categorization during vocal interactions.

Receiver psychology turns 20: is it time for a broader approach?

Twenty years ago, a new conceptual paradigm known as 'receiver psychology' was introduced to explain the evolution of animal communication systems. This paradigm advanced the idea that psychological processes in the receiver's nervous system influence a signal's detectability, discriminability and memorability, and thereby serve as powerful sources of selection shaping signal design. While advancing our understanding of signal diversity, more recent studies make clear that receiver psychology, as a paradigm, has been structured too narrowly and does not incorporate many of the perceptual and cognitive processes of signal reception that operate between sensory transduction and a receiver's response. Consequently, the past two decades of research on receiver psychology have emphasized considerations of signal evolution but failed to ask key questions about the mechanisms of signal reception and their evolution. The primary aim of this essay is to advocate for a broader receiver psychology paradigm that more explicitly includes a research focus on receivers' psychological landscapes. We review recent experimental studies of hearing and sound communication to illustrate how considerations of several general perceptual and cognitive processes will facilitate future research on animal signalling systems. We also emphasize how a rigorous comparative approach to receiver psychology is critical to explicating the full range of perceptual and cognitive processes involved in receiving and responding to signals.

Vocal control by the common marmoset in the presence of interfering noise

The natural environment is inherently noisy with acoustic interferences. It is, therefore, beneficial for a species to modify its vocal production to effectively communicate in the presence of interfering noises. Non-human primates have been traditionally considered to possess limited voluntary vocal control, but little is known about their ability to modify vocal behavior when encountering interfering noises. Here we tested the ability of the common marmoset (Callithrix jacchus) to control the initiation of vocalizations and maintain vocal interactions between pairs in an acoustic environment in which the length and predictability (periodic or random aperiodic occurrences) of interfering noise bursts were varied. Despite the presence of interfering noise, the marmosets continued to engage in antiphonal calling behavior. Results showed that the overwhelming majority of calls were initiated during silence gaps even when the length of the silence gap following each noise burst was unpredictable. During the periodic noise conditions, as the length of the silence gap decreased, the latency between the end of noise burst and call onset decreased significantly. In contrast, when presented with aperiodic noise bursts, the marmosets chose to call predominantly during long (4 and 8 s) over short (2 s) silence gaps. In the 8 s periodic noise conditions, a marmoset pair either initiated both calls of an antiphonal exchange within the same silence gap or exchanged calls in two consecutive silence gaps. Our findings provide compelling evidence that common marmosets are capable of modifying their vocal production according to the dynamics of their acoustic environment during vocal communication.

Wireless multi-channel single unit recording in freely moving and vocalizing primates

The ability to record well-isolated action potentials from individual neurons in naturally behaving animals is crucial for understanding neural mechanisms underlying natural behaviors. Traditional neurophysiology techniques, however, require the animal to be restrained which often restricts natural behavior. An example is the common marmoset (Callithrix jacchus), a highly vocal New World primate species, used in our laboratory to study the neural correlates of vocal production and sensory feedback. When restrained by traditional neurophysiological techniques marmoset vocal behavior is severely inhibited. Tethered recording systems, while proven effective in rodents pose limitations in arboreal animals such as the marmoset that typically roam in a three-dimensional environment. To overcome these obstacles, we have developed a wireless neural recording technique that is capable of collecting single-unit data from chronically implanted multi-electrodes in freely moving marmosets. A lightweight, low power and low noise wireless transmitter (headstage) is attached to a multi-electrode array placed in the premotor cortex of the marmoset. The wireless headstage is capable of transmitting 15 channels of neural data with signal-to-noise ratio (SNR) comparable to a tethered system. To minimize radio-frequency (RF) and electro-magnetic interference (EMI), the experiments were conducted within a custom designed RF/EMI and acoustically shielded chamber. The individual electrodes of the multi-electrode array were periodically advanced to densely sample the cortical layers. We recorded single-unit data over a period of several months from the frontal cortex of two marmosets. These recordings demonstrate the feasibility of using our wireless recording method to study single neuron activity in freely roaming primates.

Measurement of absolute auditory thresholds in the common marmoset (Callithrix jacchus)

The common marmoset is a small, arboreal, New World primate that has emerged as a promising non-human model system in auditory neuroscience. A complete understanding of the neuroethology of auditory processing in marmosets will include behavioral work examining how sounds are perceived by these animals. However, there have been few studies of the marmoset's hearing and perceptual abilities and the audiogram of this species has not been measured using modern psychophysical methods. The present experiment pairs psychophysics with an operant conditioning technique to examine perception of pure tone stimuli by marmosets using an active behavioral paradigm. Subjects were trained to lick at a feeding tube when they detected a sound. Correct responses provided access to a food reward. Pure tones of varying intensities were presented to subjects using the method of constant stimuli. Behavioral thresholds were calculated for each animal based on hit rate--threshold was defined by the tone intensity that the animal correctly identified 50% of the time. Results show that marmoset hearing is comparable to that of other New World monkeys, with a hearing range extending from about 125 Hz up to 36 kHz and a sensitivity peak around 7 kHz.

Vocalization Induced CFos Expression in Marmoset Cortex

All non-human primates communicate with conspecifics using vocalizations, a system involving both the production and perception of species-specific vocal signals. Much of the work on the neural basis of primate vocal communication in cortex has focused on the sensory processing of vocalizations, while relatively little data are available for vocal production. Earlier physiological studies in squirrel monkeys had shed doubts on the involvement of primate cortex in vocal behaviors. The aim of the present study was to identify areas of common marmoset (Callithrix jacchus) cortex that are potentially involved in vocal communication. In this study, we quantified cFos expression in three areas of marmoset cortex - frontal, temporal (auditory), and medial temporal - under various vocal conditions. Specifically, we examined cFos expression in these cortical areas during the sensory, motor (vocal production), and sensory-motor components of vocal communication. Our results showed an increase in cFos expression in ventrolateral prefrontal cortex as well as the medial and lateral belt areas of auditory cortex in the vocal perception condition. In contrast, subjects in the vocal production condition resulted in increased cFos expression only in dorsal premotor cortex. During the sensory-motor condition (antiphonal calling), subjects exhibited cFos expression in each of the above areas, as well as increased expression in perirhinal cortex. Overall, these results suggest that various cortical areas outside primary auditory cortex are involved in primate vocal communication. These findings pave the way for further physiological studies of the neural basis of primate vocal communication.

The communicative content of the common marmoset phee call during antiphonal calling

Vocalizations are a dominant means of communication for numerous species, including nonhuman primates. These acoustic signals are encoded with a rich array of information available to signal receivers that can be used to guide species-typical behaviors. In this study, we examined the communicative content of common marmoset phee calls, the species-typical long distance contact call, during antiphonal calling. This call type has a relatively stereotyped acoustic structure, consisting of a series of long tonal pulses. Analyses revealed that calls could be reliably classified based on the individual identity and social group of the caller. Our analyses did not, however, correctly classify phee calls recorded under different social contexts, although differences were evident along individual acoustic parameters. Further tests of antiphonal calling interactions showed that spontaneously produced phee calls differ from antiphonal phee calls in their peak and end frequency, which may be functionally significant. Overall, this study shows that the marmoset phee call has a rich communicative content encoded in its acoustic structure available to conspecifics during antiphonal calling exchanges.