Top-down regulation of plasticity in the birdsong system: "premotor" activity in the nucleus HVC predicts song variability better than it predicts song features

A Microclip Peripheral Nerve Interface (μcPNI) for Bioelectronic Interfacing with Small Nerves

Peripheral nerves carry sensory (afferent) and motor (efferent) signals between the central nervous system and other parts of the body. The peripheral nervous system (PNS) is therefore rich in targets for therapeutic neuromodulation, bioelectronic medicine, and neuroprosthetics. Peripheral nerve interfaces (PNIs) generally suffer from a tradeoff between selectivity and invasiveness. This work describes the fabrication, evaluation, and chronic implantation in zebra finches of a novel PNI that breaks this tradeoff by interfacing with small nerves. This PNI integrates a soft, stretchable microelectrode array with a 2-photon 3D printed microclip (μcPNI). The advantages of this μcPNI compared to other designs are: a) increased spatial resolution due to bi-layer wiring of the electrode leads, b) reduced mismatch in biomechanical properties with the nerve, c) reduced disturbance to the host tissue due to the small size, d) elimination of sutures or adhesives, e) high circumferential contact with small nerves, f) functionality under considerable strain, and g) graded neuromodulation in a low-threshold stimulation regime. Results demonstrate that the μcPNIs are electromechanically robust, and are capable of reliably recording and stimulating neural activity in vivo in small nerves. The μcPNI may also inform the development of new optical, thermal, ultrasonic, or chemical PNIs as well.

Manipulations of inhibition in cortical circuitry differentially affect spectral and temporal features of Bengalese finch song

The interplay between inhibition and excitation can regulate behavioral expression and control, including the expression of communicative behaviors like birdsong. Computational models postulate varying degrees to which inhibition within vocal motor circuitry influences birdsong, but few studies have tested these models by manipulating inhibition. Here we enhanced and attenuated inhibition in the cortical nucleus HVC (used as proper name) of Bengalese finches (Lonchura striata var. domestica). Enhancement of inhibition (with muscimol) in HVC dose-dependently reduced the amount of song produced. Infusions of higher concentrations of muscimol caused some birds to produce spectrally degraded songs, whereas infusions of lower doses of muscimol led to the production of relatively normal (nondegraded) songs. However, the spectral and temporal structures of these nondegraded songs were significantly different from songs produced under control conditions. In particular, muscimol infusions decreased the frequency and amplitude of syllables, increased various measures of acoustic entropy, and increased the variability of syllable structure. Muscimol also increased sequence durations and the variability of syllable timing and syllable sequencing. Attenuation of inhibition (with bicuculline) in HVC led to changes to song distinct from and often opposite to enhancing inhibition. For example, in contrast to muscimol, bicuculline infusions increased syllable amplitude, frequency, and duration and decreased the variability of acoustic features. However, like muscimol, bicuculline increased the variability of syllable sequencing. These data highlight the importance of inhibition to the production of stereotyped vocalizations and demonstrate that changes to neural dynamics within cortical circuitry can differentially affect spectral and temporal features of song.NEW & NOTEWORTHY We reveal that manipulations of inhibition in the cortical nucleus HVC affect the structure, timing, and sequencing of syllables in Bengalese finch song. Enhancing and blocking inhibition led to opposite changes to the acoustic structure and timing of vocalizations, but both caused similar changes to vocal sequencing. These data provide support for computational models of song control but also motivate refinement of existing models to account for differential effects on syllable structure, timing, and sequencing.

Models of vocal learning in the songbird: Historical frameworks and the stabilizing critic

Birdsong is a form of sensorimotor learning that involves a mirror-like system that activates with both song hearing and production. Early models of song learning, based on behavioral measures, identified key features of vocal plasticity, such as the requirements for memorization of a tutor song and auditory feedback during song practice. The concept of a comparator, which compares the memory of the tutor song to auditory feedback, featured prominently. Later models focused on linking anatomically-defined neural modules to behavioral concepts, such as the comparator. Exploiting the anatomical modularity of the songbird brain, localized lesions illuminated mechanisms of the neural song system. More recent models have integrated neuronal mechanisms identified in other systems with observations in songbirds. While these models explain multiple aspects of song learning, they must incorporate computational elements based on unknown biological mechanisms to bridge the motor-to-sensory delay and/or transform motor signals into the sensory domain. Here, I introduce the stabilizing critic hypothesis, which enables sensorimotor learning by (1) placing a purely sensory comparator afferent of the song system and (2) endowing song system disinhibitory interneuron networks with the capacity both to bridge the motor-sensory delay through prolonged bursting and to stabilize song segments selectively based on the comparator signal. These proposed networks stabilize an otherwise variable signal generated by both putative mirror neurons and a cortical-basal ganglia-thalamic loop. This stabilized signal then temporally converges with a matched premotor signal in the efferent song motor cortex, promoting spike-timing-dependent plasticity in the premotor circuitry and behavioral song learning.

Evidence for a causal inverse model in an avian cortico-basal ganglia circuit

Learning by imitation is fundamental to both communication and social behavior and requires the conversion of complex, nonlinear sensory codes for perception into similarly complex motor codes for generating action. To understand the neural substrates underlying this conversion, we study sensorimotor transformations in songbird cortical output neurons of a basal-ganglia pathway involved in song learning. Despite the complexity of sensory and motor codes, we find a simple, temporally specific, causal correspondence between them. Sensory neural responses to song playback mirror motor-related activity recorded during singing, with a temporal offset of roughly 40 ms, in agreement with short feedback loop delays estimated using electrical and auditory stimulation. Such matching of mirroring offsets and loop delays is consistent with a recent Hebbian theory of motor learning and suggests that cortico-basal ganglia pathways could support motor control via causal inverse models that can invert the rich correspondence between motor exploration and sensory feedback.

Rhythmic cortical neurons increase their oscillations and sculpt basal ganglia signaling during motor learning

The function and modulation of neural circuits underlying motor skill may involve rhythmic oscillations (Feller, 1999; Marder and Goaillard, 2006; Churchland et al., 2012). In the proposed pattern generator for birdsong, the cortical nucleus HVC, the frequency and power of oscillatory bursting during singing increases with development (Crandall et al., 2007; Day et al., 2009). We examined the maturation of cellular activity patterns that underlie these changes. Single unit ensemble recording combined with antidromic identification (Day et al., 2011) was used to study network development in anesthetized zebra finches. Autocovariance quantified oscillations within single units. A subset of neurons oscillated in the theta/alpha/mu/beta range (8-20 Hz), with greater power in adults compared to juveniles. Across the network, the normalized oscillatory power in the 8-20 Hz range was greater in adults than juveniles. In addition, the correlated activity between rhythmic neuron pairs increased with development. We next examined the functional impact of the oscillators on the output neurons of HVC. We found that the firing of oscillatory neurons negatively correlated with the activity of cortico-basal ganglia neurons (HVC(X)s), which project to Area X (the song basal ganglia). If groups of oscillators work together to tonically inhibit and precisely control the spike timing of adult HVC(X)s with coordinated release from inhibition, then the activity of HVC(X)s in juveniles should be decreased relative to adults due to uncorrelated, tonic inhibition. Consistent with this hypothesis, HVC(X)s had lower activity in juveniles. These data reveal network changes that shape cortical-to-basal ganglia signaling during motor learning.

Vocal exploration is locally regulated during song learning

Exploratory variability is essential for sensorimotor learning, but it is not known how and at what timescales it is regulated. We manipulated song learning in zebra finches to experimentally control the requirements for vocal exploration in different parts of their song. We first trained birds to perform a one-syllable song, and once they mastered it, we added a new syllable to the song model. Remarkably, when practicing the modified song, birds rapidly alternated between high and low acoustic variability to confine vocal exploration to the newly added syllable. Furthermore, even within syllables, acoustic variability changed independently across song elements that were only milliseconds apart. Analysis of the entire vocal output during learning revealed that the variability of each song element decreased as it approached the target, correlating with momentary local distance from the target and less so with the overall distance within a syllable. We conclude that vocal error is computed locally in subsyllabic timescales and that song elements can be learned and crystallized independently. Songbirds have dedicated brain circuitry for vocal babbling in the anterior forebrain pathway (AFP), which generates exploratory song patterns that drive premotor neurons at the song nucleus RA. We hypothesize that either AFP adjusts the gain of vocal exploration in fine timescales or that the sensitivity of RA premotor neurons to AFP/HVC inputs varies across song elements.

Changes in the neural control of a complex motor sequence during learning

The acquisition of complex motor sequences often proceeds through trial-and-error learning, requiring the deliberate exploration of motor actions and the concomitant evaluation of the resulting performance. Songbirds learn their song in this manner, producing highly variable vocalizations as juveniles. As the song improves, vocal variability is gradually reduced until it is all but eliminated in adult birds. In the present study we examine how the motor program underlying such a complex motor behavior evolves during learning by recording from the robust nucleus of the arcopallium (RA), a motor cortex analog brain region. In young birds, neurons in RA exhibited highly variable firing patterns that throughout development became more precise, sparse, and bursty. We further explored how the developing motor program in RA is shaped by its two main inputs: LMAN, the output nucleus of a basal ganglia-forebrain circuit, and HVC, a premotor nucleus. Pharmacological inactivation of LMAN during singing made the song-aligned firing patterns of RA neurons adultlike in their stereotypy without dramatically affecting the spike statistics or the overall firing patterns. Removing the input from HVC, on the other hand, resulted in a complete loss of stereotypy of both the song and the underlying motor program. Thus our results show that a basal ganglia-forebrain circuit drives motor exploration required for trial-and-error learning by adding variability to the developing motor program. As learning proceeds and the motor circuits mature, the relative contribution of LMAN is reduced, allowing the premotor input from HVC to drive an increasingly stereotyped song.

The origins of vocal learning: New sounds, new circuits, new cells

We do not know how vocal learning came to be, but it is such a salient trait in human evolution that many have tried to imagine it. In primates this is difficult because we are the only species known to possess this skill. Songbirds provide a richer and independent set of data. I use comparative data and ask broad questions: How does vocal learning emerge during ontogeny? In what contexts? What are its benefits? How did it evolve from unlearned vocal signals? How was brain anatomy altered to enable vocal learning? What is the relation of vocal learning to adult neurogenesis? No one has described yet a circuit or set of circuits that can master vocal learning, but this knowledge may soon be within reach. Moreover, as we uncover how birds encode their learned song, we may also come closer to understanding how we encode our thoughts.

Deafening-induced vocal deterioration in adult songbirds is reversed by disrupting a basal ganglia-forebrain circuit

Motor exploration can be an adaptive strategy when behavior fails to achieve an expected outcome. For example, like humans, adult songbirds change their vocal output when auditory feedback is altered or absent. Here, we show that the output of an anterior forebrain pathway (AFP) through the avian basal ganglia directly contributes to the expression of deafening-induced vocal changes in adulthood. Lesioning the output nucleus of this circuit in adult male zebra finches reverses moderate changes in song structure and variability caused by deafening. Furthermore, the results indicate that more severe deafening-induced changes in vocal behavior likely reflect altered function outside the AFP (e.g., within the vocal motor pathway). AFP lesions do not promote recovery if songs are severely deteriorated at the time of lesion even though previous work shows that the AFP is required for such deterioration to emerge. Thus, in birds, as in mammals, the contribution of basal ganglia-thalamic-cortical circuits to motor control may change when feedback is absent or unexpected and includes both "active" and "permissive" roles.

Song practice promotes acute vocal variability at a key stage of sensorimotor learning

Background

Trial by trial variability during motor learning is a feature encoded by the basal ganglia of both humans and songbirds, and is important for reinforcement of optimal motor patterns, including those that produce speech and birdsong. Given the many parallels between these behaviors, songbirds provide a useful model to investigate neural mechanisms underlying vocal learning. In juvenile and adult male zebra finches, endogenous levels of FoxP2, a molecule critical for language, decrease two hours after morning song onset within area X, part of the basal ganglia-forebrain pathway dedicated to song. In juveniles, experimental ‘knockdown’ of area X FoxP2 results in abnormally variable song in adulthood. These findings motivated our hypothesis that low FoxP2 levels increase vocal variability, enabling vocal motor exploration in normal birds.

Methodology/Principal Findings

After two hours in either singing or non-singing conditions (previously shown to produce differential area X FoxP2 levels), phonological and sequential features of the subsequent songs were compared across conditions in the same bird. In line with our prediction, analysis of songs sung by 75 day (75d) birds revealed that syllable structure was more variable and sequence stereotypy was reduced following two hours of continuous practice compared to these features following two hours of non-singing. Similar trends in song were observed in these birds at 65d, despite higher overall within-condition variability at this age.

Conclusions/Significance

Together with previous work, these findings point to the importance of behaviorally-driven acute periods during song learning that allow for both refinement and reinforcement of motor patterns. Future work is aimed at testing the observation that not only does vocal practice influence expression of molecular networks, but that these networks then influence subsequent variability in these skills.

Daily and developmental modulation of "premotor" activity in the birdsong system

Human speech and birdsong are shaped during a sensorimotor sensitive period in which auditory feedback guides vocal learning. To study brain activity as song learning occurred, we recorded longitudinally from developing zebra finches during the sensorimotor phase. Learned sequences of vocalizations (motifs) were examined along with contemporaneous neural population activity in the song nucleus HVC, which is necessary for the production of learned song (Nottebohm et al. 1976: J Comp Neurol 165:457-486; Simpson and Vicario 1990: J Neurosci 10:1541-1556). During singing, HVC activity levels increased as the day progressed and decreased after a night of sleep in juveniles and adults. In contrast, the pattern of HVC activity changed on a daily basis only in juveniles: activity bursts became more pronounced during the day. The HVC of adults was significantly burstier than that of juveniles. HVC bursting was relevant to song behavior because the degree of burstiness inversely correlated with the variance of song features in juveniles. The song of juveniles degrades overnight (Deregnaucourt et al. 2005: Nature 433:710-716). Consistent with a relationship between HVC activity and song plasticity (Day et al. 2008: J Neurophys 100:2956-2965), HVC burstiness degraded overnight in young juveniles and the amount of overnight degradation declined with developmental song learning. Nocturnal changes in HVC activity strongly and inversely correlated with the next day's change, suggesting that sleep-dependent degradation of HVC activity may facilitate or enable subsequent diurnal changes. Collectively, these data show that HVC activity levels exhibit daily cycles in adults and juveniles, whereas HVC burstiness and song stereotypy change daily in juveniles only. In addition, the data indicate that HVC burstiness increases with development and inversely correlates with song variability, which is necessary for trial and error vocal learning.

Modulation of perineuronal nets and parvalbumin with developmental song learning

Neural circuits and behavior are shaped during developmental phases of maximal plasticity known as sensitive or critical periods. Neural correlates of sensory critical periods have been identified, but their roles remain unclear. Factors that define critical periods in sensorimotor circuits and behavior are not known. Birdsong learning in the zebra finch occurs during a sensitive period similar to that for human speech. We now show that perineuronal nets, which correlate with sensory critical periods, surround parvalbumin-positive neurons in brain areas that are dedicated to singing. The percentage of both total and parvalbumin-positive neurons with perineuronal nets increased with development. In HVC (this acronym is the proper name), a song area important for sensorimotor integration, the percentage of parvalbumin neurons with perineuronal nets correlated with song maturity. Shifting the vocal critical period with tutor song deprivation decreased the percentage of neurons that were parvalbumin positive and the relative staining intensity of both parvalbumin and a component of perineuronal nets. Developmental song learning shares key characteristics with sensory critical periods, suggesting shared underlying mechanisms.