The Avian Basal Ganglia Are a Source of Rapid Behavioral Variation That Enables Vocal Motor Exploration

Expansion of learning capacity elicited by interspecific hybridization

Learned behavior, a fundamental adaptive trait in fluctuating environments, is shaped by species-specific constraints. This phenomenon is evident in songbirds, which acquire their species-specific songs through vocal learning. To explore the neurogenetic mechanisms underlying species-specific song learning, we generated F1 hybrid songbirds by crossing Taeniopygia guttata with Aidemosyne modesta. These F1 hybrids demonstrate expanded learning capacities, adeptly mimicking songs from both parental species and other heterospecific songs more extensively than their parental counterparts. Despite the conserved size of brain regions and neuron numbers in the neural circuits for song learning and production, single-cell transcriptomics reveals distinctive transcriptional characteristics in the F1 hybrids, especially in vocal-motor projection neurons. These neurons exhibit enrichment for nonadditively expressed genes, particularly those related to ion channel activity and cell adhesion, which are associated with the degree of song learning among F1 individuals. Our findings provide insights into the emergence of altered learning capabilities through hybridization, linked to cell type-specific transcriptional changes.

Kaempferol Alleviates Hepatic Injury in Nonalcoholic Steatohepatitis (NASH) by Suppressing Neutrophil-Mediated NLRP3-ASC/TMS1-Caspase 3 Signaling

BACKGROUND

Non-alcoholic fatty liver disease (NAFLD) is a significant hepatic condition that has gained worldwide attention. Kaempferol (Kae), renowned for its diverse biological activities, including anti-inflammatory, antioxidant, anti-aging, and cardio-protective properties, has emerged as a potential therapeutic candidate for non-alcoholic steatohepatitis (NASH). Despite its promising therapeutic potential, the precise underlying mechanism of Kae's beneficial effects in NASH remains unclear. Therefore, this study aims to clarify the mechanism by conducting comprehensive in vivo and in vitro experiments.

RESULTS

In this study, a murine model of non-alcoholic steatohepatitis (NASH) was established by feeding C57BL/6 female mice a high-fat diet for 12 weeks. Kaempferol (Kae) was investigated for its ability to modulate systemic inflammatory responses and lipid metabolism in this model (20 mg/kg per day). Notably, Kae significantly reduced the expression of NLRP3-ASC/TMS1-Caspase 3, a crucial mediator of liver tissue inflammation. Additionally, in a HepG2 cell model induced with palmitic acid/oleic acid (PA/OA) to mimic NASH conditions, Kae demonstrated the capacity to decrease lipid droplet accumulation and downregulate the expression of NLRP3-ASC/TMS1-Caspase 3 (20 µM and the final concentration to 20 nM). These findings suggest that Kae may hold therapeutic potential in the treatment of NASH by targeting inflammatory and metabolic pathways.

CONCLUSIONS

These findings suggest that kaempferol holds potential as a promising therapeutic intervention for ameliorating non-alcoholic fatty liver disease (NAFLD).

Daily singing of adult songbirds functions to maintain song performance independently of auditory feedback and age

Many songbirds learn to produce songs through vocal practice in early life and continue to sing daily throughout their lifetime. While it is well-known that adult songbirds sing as part of their mating rituals, the functions of singing behavior outside of reproductive contexts remain unclear. Here, we investigated this issue in adult male zebra finches by suppressing their daily singing for two weeks and examining the effects on song performance. We found that singing suppression decreased the pitch, amplitude, and duration of songs, and that those song features substantially recovered through subsequent free singing. These reversible song changes were not dependent on auditory feedback or the age of the birds, contrasting with the adult song plasticity that has been reported previously. These results demonstrate that adult song structure is not stable without daily singing, and suggest that adult songbirds maintain song performance by preventing song changes through physical act of daily singing throughout their life. Such daily singing likely functions as vocal training to maintain the song production system in optimal conditions for song performance in reproductive contexts, similar to how human singers and athletes practice daily to maintain their performance.

Lesions in a songbird vocal circuit increase variability in song syntax

Complex skills like speech and dance are composed of ordered sequences of simpler elements, but the neuronal basis for the syntactic ordering of actions is poorly understood. Birdsong is a learned vocal behavior composed of syntactically ordered syllables, controlled in part by the songbird premotor nucleus HVC (proper name). Here, we test whether one of HVC's recurrent inputs, mMAN (medial magnocellular nucleus of the anterior nidopallium), contributes to sequencing in adult male Bengalese finches (Lonchura striata domestica). Bengalese finch song includes several patterns: (1) chunks, comprising stereotyped syllable sequences; (2) branch points, where a given syllable can be followed probabilistically by multiple syllables; and (3) repeat phrases, where individual syllables are repeated variable numbers of times. We found that following bilateral lesions of mMAN, acoustic structure of syllables remained largely intact, but sequencing became more variable, as evidenced by 'breaks' in previously stereotyped chunks, increased uncertainty at branch points, and increased variability in repeat numbers. Our results show that mMAN contributes to the variable sequencing of vocal elements in Bengalese finch song and demonstrate the influence of recurrent projections to HVC. Furthermore, they highlight the utility of species with complex syntax in investigating neuronal control of ordered sequences.

The role of cerebellum in learned vocal communication in adult songbirds

Injury, tumors, ischemia, and lesions in the cerebellum show the involvement of this region in human speech. The association of the cerebellum with learned birdsong has only been identified recently. Cerebellar dysfunction in young songbirds causes learning disabilities, but its role in adult songbirds has not been established. The aim of this study was to investigate the role of the deep cerebellar nuclei (DCN) in adult birdsong. We created bilateral excitotoxic lesions in the DCN of adult male zebra finches (Taeniopygia guttata) and recorded their songs for up to 4 months. Using magnetic resonance imaging (MRI) and immunohistochemistry, we validated the lesion efficacy. We found that the song duration significantly increased from 14 weeks post-op; the increase in duration was caused by a greater number of introductory notes as well as a greater number of syllables sung after the introductory notes. On the other hand, the motif duration decreased from 8 weeks after DCN lesions were induced, which was due to faster singing of syllables, not changes in inter-syllable interval length. DCN lesions also caused a decrease in the fundamental frequency of syllables. In summary, we showed that DCN lesions influence the temporal and acoustic features of birdsong. These results suggest that the cerebellum influences singing in adult songbirds.

Anterior forebrain pathway in parrots is necessary for producing learned vocalizations with individual signatures

Parrots have enormous vocal imitation capacities and produce individually unique vocal signatures. Like songbirds, parrots have a nucleated neural song system with distinct anterior (AFP) and posterior forebrain pathways (PFP). To test if song systems of parrots and songbirds, which diverged over 50 million years ago, have a similar functional organization, we first established a neuroscience-compatible call-and-response behavioral paradigm to elicit learned contact calls in budgerigars (Melopsittacus undulatus). Using variational autoencoder-based machine learning methods, we show that contact calls within affiliated groups converge but that individuals maintain unique acoustic features, or vocal signatures, even after call convergence. Next, we transiently inactivated the outputs of AFP to test if learned vocalizations can be produced by the PFP alone. As in songbirds, AFP inactivation had an immediate effect on vocalizations, consistent with a premotor role. But in contrast to songbirds, where the isolated PFP is sufficient to produce stereotyped and acoustically normal vocalizations, isolation of the budgerigar PFP caused a degradation of call acoustic structure, stereotypy, and individual uniqueness. Thus, the contribution of AFP and the capacity of isolated PFP to produce learned vocalizations have diverged substantially between songbirds and parrots, likely driven by their distinct behavioral ecology and neural connectivity.

Dynamic top-down biasing implements rapid adaptive changes to individual movements

Complex behaviors depend on the coordinated activity of neural ensembles in interconnected brain areas. The behavioral function of such coordination, often measured as co-fluctuations in neural activity across areas, is poorly understood. One hypothesis is that rapidly varying co-fluctuations may be a signature of moment-by-moment task-relevant influences of one area on another. We tested this possibility for error-corrective adaptation of birdsong, a form of motor learning which has been hypothesized to depend on the top-down influence of a higher-order area, LMAN (lateral magnocellular nucleus of the anterior nidopallium), in shaping moment-by-moment output from a primary motor area, RA (robust nucleus of the arcopallium). In paired recordings of LMAN and RA in singing birds, we discovered a neural signature of a top-down influence of LMAN on RA, quantified as an LMAN-leading co-fluctuation in activity between these areas. During learning, this co-fluctuation strengthened in a premotor temporal window linked to the specific movement, sequential context, and acoustic modification associated with learning. Moreover, transient perturbation of LMAN activity specifically within this premotor window caused rapid occlusion of pitch modifications, consistent with LMAN conveying a temporally localized motor-biasing signal. Combined, our results reveal a dynamic top-down influence of LMAN on RA that varies on the rapid timescale of individual movements and is flexibly linked to contexts associated with learning. This finding indicates that inter-area co-fluctuations can be a signature of dynamic top-down influences that support complex behavior and its adaptation.

Divergent projections from locus coeruleus to the corticobasal ganglia system and ventral tegmental area of the adult male zebra finch

The locus coeruleus (LC) is a small noradrenergic brainstem nucleus that plays a central role in regulating arousal, attention, and performance. In the mammalian brain, individual LC neurons make divergent axonal projections to different brain regions, which are distinguished in part by which noradrenaline (NA) receptor subtypes they express. Here, we sought to determine whether similar organizational features characterize LC projections to corticobasal ganglia (CBG) circuitry in the zebra finch song system, with a focus on the basal ganglia nucleus Area X, the thalamic nucleus DLM, as well as the cortical nuclei HVC, LMAN, and RA. Single and dual retrograde tracer injections reveal that single LC-NA neurons make divergent projections to LMAN and Area X, as well as to the dopaminergic VTA/SNc complex that innervates this CBG circuit. Moreover, in situ hybridization revealed that differential expression of mRNA encoding α2A and α2C adrenoreceptors distinguishes LC-recipient CBG song nuclei. Therefore, LC-NA signaling in the zebra finch CBG circuit employs a similar strategy as in mammals, which could allow a relatively small number of LC neurons to exert widespread yet distinct effects across multiple brain regions.

Transition from predictable to variable motor cortex and striatal ensemble patterning during behavioral exploration

Animals can capitalize on invariance in the environment by learning and automating highly consistent actions; however, they must also remain flexible and adapt to environmental changes. It remains unclear how primary motor cortex (M1) can drive precise movements, yet also support behavioral exploration when faced with consistent errors. Using a reach-to-grasp task in rats, along with simultaneous electrophysiological monitoring in M1 and dorsolateral striatum (DLS), we find that behavioral exploration to overcome consistent task errors is closely associated with tandem increases in M1 and DLS neural variability; subsequently, consistent ensemble patterning returns with convergence to a new successful strategy. We also show that compared to reliably patterned intracranial microstimulation in M1, variable stimulation patterns result in significantly greater movement variability. Our results thus indicate that motor and striatal areas can flexibly transition between two modes, reliable neural pattern generation for automatic and precise movements versus variable neural patterning for behavioral exploration.

It is not fully understood how behavioral flexibility is established in the context of automatic performance of a complex motor skill. Here the authors show that corticostriatal activity can flexibly transition between two modes during a reach to-grasp task in rats: reliable neural pattern generation for precise, automatic movements versus variable neural patterning for behavioral exploration.

Responses to Song Playback Differ in Sleeping versus Anesthetized Songbirds

Vocal learning in songbirds is mediated by a highly localized system of interconnected forebrain regions, including recurrent loops that traverse the cortex, basal ganglia, and thalamus. This brain-behavior system provides a powerful model for elucidating mechanisms of vocal learning, with implications for learning speech in human infants, as well as for advancing our understanding of skill learning in general. A long history of experiments in this area has tested neural responses to playback of different song stimuli in anesthetized birds at different stages of vocal development. These studies have demonstrated selectivity for different song types that provide neural signatures of learning. In contrast to the ease of obtaining responses to song playback in anesthetized birds, song-evoked responses in awake birds are greatly reduced or absent, indicating that behavioral state is an important determinant of neural responsivity. Song-evoked responses can be elicited during sleep as well as anesthesia, and the selectivity of responses to song playback in adult birds is highly similar between anesthetized and sleeping states, encouraging the idea that anesthesia and sleep are similar. In contrast to that idea, we report evidence that cortical responses to song playback in juvenile zebra finches (Taeniopygia guttata) differ greatly between sleep and urethane anesthesia. This finding indicates that behavioral states differ in sleep versus anesthesia and raises questions about relationships between developmental changes in sleep activity, selectivity for different song types, and the neural substrate for vocal learning.

Neural correlates of vocal initiation in the VTA/SNc of juvenile male zebra finches

Initiation and execution of complex learned vocalizations such as human speech and birdsong depend on multiple brain circuits. In songbirds, neurons in the motor cortices and basal ganglia circuitry exhibit preparatory activity before initiation of song, and that activity is thought to play an important role in successful song performance. However, it remains unknown where a start signal for song is represented in the brain and how such a signal would lead to appropriate vocal initiation. To test whether neurons in the midbrain ventral tegmental area (VTA) and substantia nigra pars compacta (SNc) show activity related to song initiation, we carried out extracellular recordings of VTA/SNc single units in singing juvenile male zebra finches. We found that a subset of VTA/SNc units exhibit phasic activity precisely time-locked to the onset of the song bout, and that the activity occurred specifically at the beginning of song. These findings suggest that phasic activity in the VTA/SNc represents a start signal that triggers song vocalization.

Neural dynamics underlying birdsong practice and performance

Musical and athletic skills are learned and maintained through intensive practice to enable precise and reliable performance for an audience. Consequently, understanding such complex behaviours requires insight into how the brain functions during both practice and performance. Male zebra finches learn to produce courtship songs that are more varied when alone and more stereotyped in the presence of females1. These differences are thought to reflect song practice and performance, respectively2,3, providing a useful system in which to explore how neurons encode and regulate motor variability in these two states. Here we show that calcium signals in ensembles of spiny neurons (SNs) in the basal ganglia are highly variable relative to their cortical afferents during song practice. By contrast, SN calcium signals are strongly suppressed during female-directed performance, and optogenetically suppressing SNs during practice strongly reduces vocal variability. Unsupervised learning methods4,5 show that specific SN activity patterns map onto distinct song practice variants. Finally, we establish that noradrenergic signalling reduces vocal variability by directly suppressing SN activity. Thus, SN ensembles encode and drive vocal exploration during practice, and the noradrenergic suppression of SN activity promotes stereotyped and precise song performance for an audience.

Intrinsic motivation for singing in songbirds is enhanced by temporary singing suppression and regulated by dopamine

Behaviors driven by intrinsic motivation are critical for development and optimization of physical and brain functions, but their underlying mechanisms are not well studied due to the complexity and autonomy of the behavior. Songbirds, such as zebra finches, offer a unique opportunity to study neural substrates of intrinsic motivation because they spontaneously produce many renditions of songs with highly-quantifiable structure for vocal practice, even in the absence of apparent recipients (“undirected singing”). Neural substrates underlying intrinsic motivation for undirected singing are still poorly understood partly because singing motivation cannot be easily manipulated due to its autonomy. Also, undirected singing itself acts as an internal reward, which could increase singing motivation, leading to difficulty in measuring singing motivation independent of singing-associated reward. Here, we report a simple procedure to easily manipulate and quantify intrinsic motivation for undirected singing independent of singing-associated reward. We demonstrate that intrinsic motivation for undirected singing is dramatically enhanced by temporary suppression of singing behavior and the degree of enhancement depends on the duration of suppression. Moreover, by examining latencies to the first song following singing suppression as a measure of singing motivation independent of singing-associated reward, we demonstrate that intrinsic singing motivation is critically regulated by dopamine through D2 receptors. These results provide a simple experimental tool to manipulate and measure the intrinsic motivation for undirected singing and illustrate the importance of zebra finches as a model system to study the neural basis of intrinsically-motivated behaviors.

Unilateral vocal nerve resection alters neurogenesis in the avian song system in a region-specific manner

New neurons born in the adult brain undergo a critical period soon after migration to their site of incorporation. During this time, the behavior of the animal may influence the survival or culling of these cells. In the songbird song system, earlier work suggested that adult-born neurons may be retained in the song motor pathway nucleus HVC with respect to motor progression toward a target song during juvenile song learning, seasonal song restructuring, and experimentally manipulated song variability. However, it is not known whether the quality of song per se, without progressive improvement, may also influence new neuron survival. To test this idea, we experimentally altered song acoustic structure by unilateral denervation of the syrinx, causing a poor quality song. We found no effect of aberrant song on numbers of new neurons in HVC, suggesting that song quality does not influence new neuron culling in this region. However, aberrant song resulted in the loss of left-side dominance in new neurons in the auditory region caudomedial nidopallium (NCM), and a bilateral decrease in new neurons in the basal ganglia nucleus Area X. Thus new neuron culling may be influenced by behavioral feedback in accordance with the function of new neurons within that region. We propose that studying the effects of singing behaviors on new neurons across multiple brain regions that differentially subserve singing may give rise to general rules underlying the regulation of new neuron survival across taxa and brain regions more broadly.

Plasticity of stereotyped birdsong driven by chronic manipulation of cortical-basal ganglia activity

Cortical-basal ganglia (CBG) circuits are critical for motor learning and performance, and are a major site of pathology. In songbirds, a CBG circuit regulates moment-by-moment variability in song and also enables song plasticity. Studies have shown that variable burst firing in LMAN, the output nucleus of this CBG circuit, actively drives acute song variability, but whether and how LMAN drives long-lasting changes in song remains unclear. Here, we ask whether chronic pharmacological augmentation of LMAN bursting is sufficient to drive plasticity in birds singing stereotyped songs. We show that altered LMAN activity drives cumulative changes in acoustic structure, timing, and sequencing over multiple days, and induces repetitions and silent pauses reminiscent of human stuttering. Changes persisted when LMAN was subsequently inactivated, indicating plasticity in song motor regions. Following cessation of pharmacological treatment, acoustic features and song sequence gradually recovered to their baseline values over a period of days to weeks. Together, our findings show that augmented bursting in CBG circuitry drives plasticity in well-learned motor skills, and may inform treatments for basal ganglia movement disorders.

Basal ganglia: Bursting with song

The songs of mature zebra finches are notoriously repetitious, or 'crystallized'. Despite this stability, new work reveals that chronic pharmacologically driven bursting of cortical inputs to the basal ganglia can drive cumulative and lasting changes to multiple vocal features, including phenomena reminiscent of human stuttering.

Expression of FoxP2 in the basal ganglia regulates vocal motor sequences in the adult songbird

Disruption of the transcription factor FoxP2, which is enriched in the basal ganglia, impairs vocal development in humans and songbirds. The basal ganglia are important for the selection and sequencing of motor actions, but the circuit mechanisms governing accurate sequencing of learned vocalizations are unknown. Here, we show that expression of FoxP2 in the basal ganglia is vital for the fluent initiation and termination of birdsong, as well as the maintenance of song syllable sequencing in adulthood. Knockdown of FoxP2 imbalances dopamine receptor expression across striatal direct-like and indirect-like pathways, suggesting a role of dopaminergic signaling in regulating vocal motor sequencing. Confirming this prediction, we show that phasic dopamine activation, and not inhibition, during singing drives repetition of song syllables, thus also impairing fluent initiation and termination of birdsong. These findings demonstrate discrete circuit origins for the dysfluent repetition of vocal elements in songbirds, with implications for speech disorders.

Behavioral discrimination and time-series phenotyping of birdsong performance

Variation in the acoustic structure of vocal signals is important to communicate social information. However, relatively little is known about the features that receivers extract to decipher relevant social information. Here, we took an expansive, bottom-up approach to delineate the feature space that could be important for processing social information in zebra finch song. Using operant techniques, we discovered that female zebra finches can consistently discriminate brief song phrases ("motifs") from different social contexts. We then applied machine learning algorithms to classify motifs based on thousands of time-series features and to uncover acoustic features for motif discrimination. In addition to highlighting classic acoustic features, the resulting algorithm revealed novel features for song discrimination, for example, measures of time irreversibility (i.e., the degree to which the statistical properties of the actual and time-reversed signal differ). Moreover, the algorithm accurately predicted female performance on individual motif exemplars. These data underscore and expand the promise of broad time-series phenotyping to acoustic analyses and social decision-making.

Balancing exploration and exploitation with information and randomization

Explore-exploit decisions require us to trade off the benefits of exploring unknown options to learn more about them, with exploiting known options, for immediate reward. Such decisions are ubiquitous in nature, but from a computational perspective, they are notoriously hard. There is therefore much interest in how humans and animals make these decisions and recently there has been an explosion of research in this area. Here we provide a biased and incomplete snapshot of this field focusing on the major finding that many organisms use two distinct strategies to solve the explore-exploit dilemma: a bias for information ('directed exploration') and the randomization of choice ('random exploration'). We review evidence for the existence of these strategies, their computational properties, their neural implementations, as well as how directed and random exploration vary over the lifespan. We conclude by highlighting open questions in this field that are ripe to both explore and exploit.

A histological study of the song system of the carrion crow (Corvus corone)

The song system of songbirds (oscines) is one of the best studied neuroethological model systems. So far, it has been treated as a relatively constrained sensorimotor system. Songbirds such as crows, however, are also known for their capability to cognitively control their audio-vocal system. Yet, the neuroanatomy of the corvid song system has never been explored systematically. We aim to close this scientific gap by presenting a stereotactic investigation of the extended song system of the carrion crow (Corvus corone), an oscine songbird of the corvid family that has become an interesting model system for cognitive neuroscience. In order to identify and delineate the song nuclei, the ascending auditory nuclei, and the descending vocal-motor nuclei, four stains were applied. In addition to the classical Nissl-, myelin-, and a combination of Nissl-and-myelin staining, staining for tyrosine hydroxylase was used to reveal the distribution of catecholaminergic neurons (dopaminergic, noradrenergic, and adrenergic) in the song system. We show that the crow brain contains the important song-related nuclei, including auditory input and motor output structures, and map them throughout the brain. Fiber-stained sections reveal putative connection patterns between the crow's song nuclei comparable to other songbirds.

The brain as a dynamically active organ

Nervous systems are typically described as static networks passively responding to external stimuli (i.e., the 'sensorimotor hypothesis'). However, for more than a century now, evidence has been accumulating that this passive-static perspective is wrong. Instead, evidence suggests that nervous systems dynamically change their connectivity and actively generate behavior so their owners can achieve goals in the world, some of which involve controlling their sensory feedback. This review provides a brief overview of the different historical perspectives on general brain function and details some select modern examples falsifying the sensorimotor hypothesis.

The thalamus integrates the macrosystems of the brain to facilitate complex, adaptive brain network dynamics

The human brain is a complex, adaptive system comprised of billions of cells with trillions of connections. The interactions between the elements of the system oppose this seemingly limitless capacity by constraining the system's dynamic repertoire, enforcing distributed neural states that balance integration and differentiation. How this trade-off is mediated by the brain, and how the emergent, distributed neural patterns give rise to cognition and awareness, remains poorly understood. Here, I argue that the thalamus is well-placed to arbitrate the interactions between distributed neural assemblies in the cerebral cortex. Different classes of thalamocortical connections are hypothesized to promote either feed-forward or feedback processing modes in the cerebral cortex. This activity can be conceptualized as emerging dynamically from an evolving attractor landscape, with the relative engagement of distinct distributed circuits providing differing constraints over the manner in which brain state trajectories change over time. In addition, inputs to the distinct thalamic populations from the cerebellum and basal ganglia, respectively, are proposed to differentially shape the attractor landscape, and hence, the temporal evolution of cortical assemblies. The coordinated engagement of these neural macrosystems is then shown to share key characteristics with prominent models of cognition, attention and conscious awareness. In this way, the crucial role of the thalamus in mediating the distributed, multi-scale network organization of the central nervous system can be related to higher brain function.

Blocking Opioid Receptors in a Songbird Cortical Region Modulates the Acoustic Features and Levels of Female-Directed Singing

The organization of the anterior forebrain pathway (AFP) of songbirds important for context-dependent singing is similar to that of cortical basal ganglia loops (CBG) in mammals, which underlie motor behaviors including vocalization. Since different components of the AFP express high levels of μ-opioid receptors (μ-ORs) as do CBG loops, songbirds act as model systems to study the role of opioid modulation on vocalization and the motivation to sing. The AFP in songbirds includes the cortical/pallial region LMAN (lateral magnocellular nucleus of the anterior nidopallium) which projects to Area X, a nucleus of the avian basal ganglia. In the present study, microdialysis was used to infuse different doses of the opioid antagonist naloxone in LMAN of adult male zebra finches. Whereas all doses of naloxone led to significant decreases in the number of FD (female-directed) songs, only 100 and 200 ng/ml of naloxone affected their acoustic properties. The decrease in FD song was not accompanied by changes in levels of attention toward females or those of neurotransmitters (dopamine, glutamate, and GABA) in LMAN. An earlier study had shown that similar manipulations in Area X did not lead to alterations in the number of FD songs but had significantly greater effects on their acoustic properties. Taken together, our results suggest that there are reciprocal effects of OR modulation on cortical and basal ganglia components of the AFP in songbirds.

How Outcome Uncertainty Mediates Attention, Learning, and Decision-Making

Animals and humans evolved sophisticated nervous systems that endowed them with the ability to form internal-models or beliefs and make predictions about the future to survive and flourish in a world in which future outcomes are often uncertain. Crucial to this capacity is the ability to adjust behavioral and learning policies in response to the level of uncertainty. Until recently, the neuronal mechanisms that could underlie such uncertainty-guided control have been largely unknown. In this review, I discuss newly discovered neuronal circuits in primates that represent uncertainty about future rewards and propose how they guide information-seeking, attention, decision-making, and learning to help us survive in an uncertain world. Lastly, I discuss the possible relevance of these findings to learning in artificial systems.

Neural activity during a simple reaching task in macaques is counter to gating and rebound in basal ganglia-thalamic communication

Task-related activity in the ventral thalamus, a major target of basal ganglia output, is often assumed to be permitted or triggered by changes in basal ganglia activity through gating- or rebound-like mechanisms. To test those hypotheses, we sampled single-unit activity from connected basal ganglia output and thalamic nuclei (globus pallidus-internus [GPi] and ventrolateral anterior nucleus [VLa]) in monkeys performing a reaching task. Rate increases were the most common peri-movement change in both nuclei. Moreover, peri-movement changes generally began earlier in VLa than in GPi. Simultaneously recorded GPi-VLa pairs rarely showed short-time-scale spike-to-spike correlations or slow across-trials covariations, and both were equally positive and negative. Finally, spontaneous GPi bursts and pauses were both followed by small, slow reductions in VLa rate. These results appear incompatible with standard gating and rebound models. Still, gating or rebound may be possible in other physiological situations: simulations show how GPi-VLa communication can scale with GPi synchrony and GPi-to-VLa convergence, illuminating how synchrony of basal ganglia output during motor learning or in pathological conditions may render this pathway effective. Thus, in the healthy state, basal ganglia-thalamic communication during learned movement is more subtle than expected, with changes in firing rates possibly being dominated by a common external source.

Long-term Devocalization of Zebra Finches

Songbirds, such as the zebra finch, are a popular animal model for studying the neural basis of vocal and complex skill learning. Adult male zebra finches produce courtship song toward females (referred to as 'directed song') and recording and analyzing sounds of directed song along with underlying neural activity is important for investigating behavioral and neural mechanisms of song production and learning. However, recording of directed song is easily contaminated by calls that are often as loud as directed songs and frequently produced by a female bird is presented in the same sound-recording chamber to elicit directed song. We developed a new surgical procedure to relatively easily and almost completely devocalize female zebra finches semi-permanently, without affecting other behaviors. This procedure enables researchers to record directed songs with almost no contamination by female calls. The procedure can also be used to devocalize male birds as well and, thus, has great potential for a variety of experimental purposes, such as long-term elimination of auditory feedback during singing in male birds.

Serotonin Expression in the Song Circuitry of Adult Male Zebra Finches

Serotonin is an important neurotransmitter of the brain, but its role in song control remains to be fully demonstrated. Using male zebra finches (Taeniopygia guttata) that have song learning and production capabilities, we analysed the serotonin expression levels in the song nuclei and adjacent areas (peri-song nuclei) using immunohistochemistry. Key song nuclei were identified using combinations of Hoechst, choline acetyltransferase, and a neurofilament (NN18) marker in reference to the ZEBrA atlas. Mean serotonin expression was highest in interfacial nucleus (Nif) and lower in the other song nuclei in the following order (in order of highest first): interfacial nucleus (Nif) > Area X > dorsomedial part of the intercollicular nucelus (DM) > robust nucleus of the archistriatum (RA) > lateral magnocellular nucleus of the anterior neostriatum (LMAN) > ventral respiratory group (VRG) > dorsolateral nucleus of the medial thalamus (DLM) > the nucleus HVC (proper name) > tracheosyringeal motor nucleus (nXIIts). However, the mean serotonin expression (in order of highest first) in the peri-song nuclei regions was: peri-DM > peri-nXIIts > supra-peri-HVC > peri-RA > peri-DLM > peri-Area X > infra-peri-HVC > peri-VRG > peri-LMAN > peri-Nif. Interestingly, serotoninergic fibers immunostained for serotonin or the serotonin transporter can be found as a basket-like peri-neuronal structure surrounding cholinergic cell bodies, and appear to form contacts onto dopaminergic neurones. In summary, serotonin fibers are present at discrete song nuclei, and peri-song nuclei regions, which suggest serotonin may have a direct and/or modulatory role in song control.

Cell-Type-Specific Outcome Representation in the Primary Motor Cortex

Adaptive movements are critical for animal survival. To guide future actions, the brain monitors various outcomes, including achievement of movement and appetitive goals. The nature of these outcome signals and their neuronal and network realization in the motor cortex (M1), which directs skilled movements, is largely unknown. Using a dexterity task, calcium imaging, optogenetic perturbations, and behavioral manipulations, we studied outcome signals in the murine forelimb M1. We found two populations of layer 2-3 neurons, termed success- and failure-related neurons, that develop with training, and report end results of trials. In these neurons, prolonged responses were recorded after success or failure trials independent of reward and kinematics. In addition, the initial state of layer 5 pyramidal tract neurons contained a memory trace of the previous trial's outcome. Intertrial cortical activity was needed to learn new task requirements. These M1 layer-specific performance outcome signals may support reinforcement motor learning of skilled behavior.

Network dynamics underlie learning and performance of birdsong

Understanding the sensorimotor control of the endless variety of human speech patterns stands as one of the apex problems in neuroscience. The capacity to learn - through imitation - to rapidly sequence vocal sounds in meaningful patterns is clearly one of the most derived of human behavioral traits. Selection pressure produced an analogous capacity in numerous species of vocal-learning birds, and due to an increasing appreciation for the cognitive and computational flexibility of avian cortex and basal ganglia, a general understanding of the forebrain network that supports the learning and production of birdsong is beginning to emerge. Here, we review recent advances in experimental studies of the zebra finch (Taeniopygia guttata), which offer new insights into the network dynamics that support this surprising analogue of human speech learning and production.

Acetylcholine acts on songbird premotor circuitry to invigorate vocal output

Acetylcholine is well-understood to enhance cortical sensory responses and perceptual sensitivity in aroused or attentive states. Yet little is known about cholinergic influences on motor cortical regions. Here we use the quantifiable nature of birdsong to investigate how acetylcholine modulates the cortical (pallial) premotor nucleus HVC and shapes vocal output. We found that dialyzing the cholinergic agonist carbachol into HVC increased the pitch, amplitude, tempo and stereotypy of song, similar to the natural invigoration of song that occurs when males direct their songs to females. These carbachol-induced effects were associated with increased neural activity in HVC and occurred independently of basal ganglia circuitry. Moreover, we discovered that the normal invigoration of female-directed song was also accompanied by increased HVC activity and was attenuated by blocking muscarinic acetylcholine receptors. These results indicate that, analogous to its influence on sensory systems, acetylcholine can act directly on cortical premotor circuitry to adaptively shape behavior.

Testosterone stimulates perineuronal nets development around parvalbumin cells in the adult canary brain in parallel with song crystallization

Perineuronal nets (PNN) of the extracellular matrix are dense aggregations of chondroitin-sulfate proteoglycans that usually surround fast-spiking parvalbumin-expressing inhibitory interneurons (PV). The development of PNN around PV appears specifically at the end of sensitive periods of visual learning and limits the synaptic plasticity in the visual cortex of mammals. Seasonal songbirds display a high level of adult neuroplasticity associated with vocal learning, which is regulated by fluctuations of circulating testosterone concentrations. Seasonal changes in testosterone concentrations and in neuroplasticity are associated with vocal changes between the non-breeding and breeding seasons. Increases in blood testosterone concentrations in the spring lead to the annual crystallization of song so that song becomes more stereotyped. Here we explore whether testosterone also regulates PNN expression in the song control system of male and female canaries. We show that, in both males and females, testosterone increases the number of PNN and of PV neurons in the three main telencephalic song control nuclei HVC, RA (nucleus robustus arcopallialis) and Area X and increases the PNN localization around PV interneurons. Singing activity was recorded in males and quantitative analyses demonstrated that testosterone also increased male singing rate, song duration and song energy while decreasing song entropy. Together, these data suggest that the development of PNN could provide the synaptic stability required to maintain the stability of the testosterone-induced crystallized song. This provides the new evidence for a role of PNN in the regulation of adult seasonal plasticity in seasonal songbirds.

Involvement of the Cortico-Basal Ganglia-Thalamocortical Loop in Developmental Stuttering

Stuttering is a complex neurodevelopmental disorder that has to date eluded a clear explication of its pathophysiological bases. In this review, we utilize the Directions Into Velocities of Articulators (DIVA) neurocomputational modeling framework to mechanistically interpret relevant findings from the behavioral and neurological literatures on stuttering. Within this theoretical framework, we propose that the primary impairment underlying stuttering behavior is malfunction in the cortico-basal ganglia-thalamocortical (hereafter, cortico-BG) loop that is responsible for initiating speech motor programs. This theoretical perspective predicts three possible loci of impaired neural processing within the cortico-BG loop that could lead to stuttering behaviors: impairment within the basal ganglia proper; impairment of axonal projections between cerebral cortex, basal ganglia, and thalamus; and impairment in cortical processing. These theoretical perspectives are presented in detail, followed by a review of empirical data that make reference to these three possibilities. We also highlight any differences that are present in the literature based on examining adults versus children, which give important insights into potential core deficits associated with stuttering versus compensatory changes that occur in the brain as a result of having stuttered for many years in the case of adults who stutter. We conclude with outstanding questions in the field and promising areas for future studies that have the potential to further advance mechanistic understanding of neural deficits underlying persistent developmental stuttering.

Manipulations of inhibition in cortical circuitry differentially affect spectral and temporal features of Bengalese finch song

The interplay between inhibition and excitation can regulate behavioral expression and control, including the expression of communicative behaviors like birdsong. Computational models postulate varying degrees to which inhibition within vocal motor circuitry influences birdsong, but few studies have tested these models by manipulating inhibition. Here we enhanced and attenuated inhibition in the cortical nucleus HVC (used as proper name) of Bengalese finches (Lonchura striata var. domestica). Enhancement of inhibition (with muscimol) in HVC dose-dependently reduced the amount of song produced. Infusions of higher concentrations of muscimol caused some birds to produce spectrally degraded songs, whereas infusions of lower doses of muscimol led to the production of relatively normal (nondegraded) songs. However, the spectral and temporal structures of these nondegraded songs were significantly different from songs produced under control conditions. In particular, muscimol infusions decreased the frequency and amplitude of syllables, increased various measures of acoustic entropy, and increased the variability of syllable structure. Muscimol also increased sequence durations and the variability of syllable timing and syllable sequencing. Attenuation of inhibition (with bicuculline) in HVC led to changes to song distinct from and often opposite to enhancing inhibition. For example, in contrast to muscimol, bicuculline infusions increased syllable amplitude, frequency, and duration and decreased the variability of acoustic features. However, like muscimol, bicuculline increased the variability of syllable sequencing. These data highlight the importance of inhibition to the production of stereotyped vocalizations and demonstrate that changes to neural dynamics within cortical circuitry can differentially affect spectral and temporal features of song.NEW & NOTEWORTHY We reveal that manipulations of inhibition in the cortical nucleus HVC affect the structure, timing, and sequencing of syllables in Bengalese finch song. Enhancing and blocking inhibition led to opposite changes to the acoustic structure and timing of vocalizations, but both caused similar changes to vocal sequencing. These data provide support for computational models of song control but also motivate refinement of existing models to account for differential effects on syllable structure, timing, and sequencing.

Corticobasal ganglia projecting neurons are required for juvenile vocal learning but not for adult vocal plasticity in songbirds

Birdsong, like human speech, consists of a sequence of temporally precise movements acquired through vocal learning. The learning of such sequential vocalizations depends on the neural function of the motor cortex and basal ganglia. However, it is unknown how the connections between cortical and basal ganglia components contribute to vocal motor skill learning, as mammalian motor cortices serve multiple types of motor action and most experimentally tractable animals do not exhibit vocal learning. Here, we leveraged the zebra finch, a songbird, as an animal model to explore the function of the connectivity between cortex-like (HVC) and basal ganglia (area X), connected by HVC_(X) projection neurons with temporally precise firing during singing. By specifically ablating HVC_(X) neurons, juvenile zebra finches failed to copy tutored syllable acoustics and developed temporally unstable songs with less sequence consistency. In contrast, HVC_(X)-ablated adults did not alter their learned song structure, but generated acoustic fluctuations and responded to auditory feedback disruption by the introduction of song deterioration, as did normal adults. These results indicate that the corticobasal ganglia input is important for learning the acoustic and temporal aspects of song structure, but not for generating vocal fluctuations that contribute to the maintenance of an already learned vocal pattern.

Developmental modulation and predictability of age-dependent vocal plasticity in adult zebra finches

Predicting the nature of behavioral plasticity can provide insight into mechanisms of behavioral expression and control. Songbirds like the zebra finch rely on vocal signals for communication, and the performance of these signals demonstrate considerable plasticity over development. Traditionally, these signals were thought to be fixed in adulthood, but recent studies have revealed significant age-dependent changes to spectral and temporal features of song in adult songbirds. A number of age-dependent changes to song resemble acute changes to adult song performance across social contexts (e.g., when an adult male sings to a female relative to when he sings in isolation). The ability of variation in social context-dependent changes to predict variation in age-dependent plasticity would suggest shared mechanisms, but little is known about this predictability. In addition, although developmental experiences can shape adult plasticity, little is known about the extent to which social interactions during development affect age-dependent change to adult song. To this end, we systematically analyzed age- and context-dependent changes to adult zebra finch song, and then examined the degree to which age-dependent changes varied across birds that were social or non-socially tutored birds and to which social context-dependent changes predicted age-dependent changes. Non-socially tutored birds showed more dramatic changes to the broad structure of their motif over time than socially tutored birds, but non-socially and socially tutored birds did not differ in the extent of changes to various spectral and temporal features of song. Overall, we found that adult zebra finches produced longer and more spectrally stereotyped songs when they were older than when they were younger. Moreover, regardless of developmental tutoring, individual variation in age-dependent changes to song bout duration and syllable repetition were predicted by variation in social context-dependent changes to these features. These data indicate that social experiences during development can shape some aspects of adult plasticity and that acute context-dependent and long-term age-dependent changes to some song features could be mediated by modifications within similar neural substrates.