How Movement Modulates Hearing

Sensation and expectation are embedded in mouse motor cortical activity

During behavior, the motor cortex sends copies of motor-related signals to sensory cortices. Here, we combine closed-loop behavior with large-scale physiology, projection-pattern-specific recordings, and circuit perturbations to show that neurons in mouse secondary motor cortex (M2) encode sensation and are influenced by expectation. When a movement unexpectedly produces a sound, M2 becomes dominated by sound-evoked activity. Sound responses in M2 are inherited partially from the auditory cortex and are routed back to the auditory cortex, providing a path for the reciprocal exchange of sensory-motor information during behavior. When the acoustic consequences of a movement become predictable, M2 responses to self-generated sounds are selectively gated off. These changes in single-cell responses are reflected in population dynamics, which are influenced by both sensation and expectation. Together, these findings reveal the embedding of sensory and expectation signals in motor cortical activity.

Speech-induced suppression and vocal feedback sensitivity in human cortex

Across the animal kingdom, neural responses in the auditory cortex are suppressed during vocalization, and humans are no exception. A common hypothesis is that suppression increases sensitivity to auditory feedback, enabling the detection of vocalization errors. This hypothesis has been previously confirmed in non-human primates, however a direct link between auditory suppression and sensitivity in human speech monitoring remains elusive. To address this issue, we obtained intracranial electroencephalography (iEEG) recordings from 35 neurosurgical participants during speech production. We first characterized the detailed topography of auditory suppression, which varied across superior temporal gyrus (STG). Next, we performed a delayed auditory feedback (DAF) task to determine whether the suppressed sites were also sensitive to auditory feedback alterations. Indeed, overlapping sites showed enhanced responses to feedback, indicating sensitivity. Importantly, there was a strong correlation between the degree of auditory suppression and feedback sensitivity, suggesting suppression might be a key mechanism that underlies speech monitoring. Further, we found that when participants produced speech with simultaneous auditory feedback, posterior STG was selectively activated if participants were engaged in a DAF paradigm, suggesting that increased attentional load can modulate auditory feedback sensitivity.

Dynamic changes in somatosensory and cerebellar activity mediate temporal recalibration of self-touch

An organism's ability to accurately anticipate the sensations caused by its own actions is crucial for a wide range of behavioral, perceptual, and cognitive functions. Notably, the sensorimotor expectations produced when touching one's own body attenuate such sensations, making them feel weaker and less ticklish and rendering them easily distinguishable from potentially harmful touches of external origin. How the brain learns and keeps these action-related sensory expectations updated is unclear. Here we employ psychophysics and functional magnetic resonance imaging to pinpoint the behavioral and neural substrates of dynamic recalibration of expected temporal delays in self-touch. Our psychophysical results reveal that self-touches are less attenuated after systematic exposure to delayed self-generated touches, while responses in the contralateral somatosensory cortex that normally distinguish between delayed and nondelayed self-generated touches become indistinguishable. During the exposure, the ipsilateral anterior cerebellum shows increased activity, supporting its proposed role in recalibrating sensorimotor predictions. Moreover, responses in the cingulate areas gradually increase, suggesting that as delay adaptation progresses, the nondelayed self-touches trigger activity related to cognitive conflict. Together, our results show that sensorimotor predictions in the simplest act of touching one's own body are upheld by a sophisticated and flexible neural mechanism that maintains them accurate in time.

Characterization of Ultrasonic Vocalization-Modulated Neurons in Rat Motor Cortex Based on Their Activity Modulation and Axonal Projection to the Periaqueductal Gray

Vocalization, a means of social communication, is prevalent among many species, including humans. Both rats and mice use ultrasonic vocalizations (USVs) in various social contexts and affective states. The motor cortex is hypothesized to be involved in precisely controlling USVs through connections with critical regions of the brain for vocalization, such as the periaqueductal gray matter (PAG). However, it is unclear how neurons in the motor cortex are modulated during USVs. Moreover, the relationship between USV modulation of neurons and anatomical connections from the motor cortex to PAG is also not clearly understood. In this study, we first characterized the activity patterns of neurons in the primary and secondary motor cortices during emission of USVs in rats using large-scale electrophysiological recordings. We also examined the axonal projection of the motor cortex to PAG using retrograde labeling and identified two clusters of PAG-projecting neurons in the anterior and posterior parts of the motor cortex. The neural activity patterns around the emission of USVs differed between the anterior and posterior regions, which were divided based on the distribution of PAG-projecting neurons in the motor cortex. Furthermore, using optogenetic tagging, we recorded the USV modulation of PAG-projecting neurons in the posterior part of the motor cortex and found that they showed predominantly sustained excitatory responses during USVs. These results contribute to our understanding of the involvement of the motor cortex in the generation of USV at the neuronal and circuit levels.

Triple dissociation of visual, auditory and motor processing in mouse primary visual cortex

Primary sensory cortices respond to crossmodal stimuli-for example, auditory responses are found in primary visual cortex (V1). However, it remains unclear whether these responses reflect sensory inputs or behavioral modulation through sound-evoked body movement. We address this controversy by showing that sound-evoked activity in V1 of awake mice can be dissociated into auditory and behavioral components with distinct spatiotemporal profiles. The auditory component began at approximately 27 ms, was found in superficial and deep layers and originated from auditory cortex. Sound-evoked orofacial movements correlated with V1 neural activity starting at approximately 80-100 ms and explained auditory frequency tuning. Visual, auditory and motor activity were expressed by different laminar profiles and largely segregated subsets of neuronal populations. During simultaneous audiovisual stimulation, visual representations remained dissociable from auditory-related and motor-related activity. This three-fold dissociability of auditory, motor and visual processing is central to understanding how distinct inputs to visual cortex interact to support vision.

Concurrent Supra-Postural Auditory-Hand Coordination Task Affects Postural Control: Using Sonification to Explore Environmental Unpredictability in Factors Affecting Fall Risk

Clinical screening tests for balance and mobility often fall short of predicting fall risk. Cognitive distractors and unpredictable external stimuli, common in busy natural environments, contribute to this risk, especially in older adults. Less is known about the effects of upper sensory-motor coordination, such as coordinating one's hand with an external stimulus. We combined movement sonification and affordable inertial motion sensors to develop a task for the precise measurement and manipulation of full-body interaction with stimuli in the environment. In a double-task design, we studied how a supra-postural activity affected quiet stance. The supra-postural task consisted of rhythmic synchronization with a repetitive auditory stimulus. The stimulus was attentionally demanding because it was being modulated continuously. The participant's hand movement was sonified in real time, and their goal was to synchronize their hand movement with the stimulus. In the unpredictable condition, the tempo changed at random points in the trial. A separate sensor recorded postural fluctuations. Young healthy adults were compared to older adult (OA) participants without known risk of falling. The results supported the hypothesis that supra-postural coordination would entrain postural control. The effect was stronger in OAs, supporting the idea that diminished reserve capacities reduce the ability to isolate postural control from sensory-motor and cognitive activity.

Somatosensory omissions reveal action-related predictive processing

The intricate relation between action and somatosensory perception has been studied extensively in the past decades. Generally, a forward model is thought to predict the somatosensory consequences of an action. These models propose that when an action is reliably coupled to a tactile stimulus, unexpected absence of the stimulus should elicit prediction error. Although such omission responses have been demonstrated in the auditory modality, it remains unknown whether this mechanism generalizes across modalities. This study therefore aimed to record action-induced somatosensory omission responses using EEG in humans. Self-paced button presses were coupled to somatosensory stimuli in 88% of trials, allowing a prediction, or in 50% of trials, not allowing a prediction. In the 88% condition, stimulus omission resulted in a neural response consisting of multiple components, as revealed by temporal principal component analysis. The oN1 response suggests similar sensory sources as stimulus-evoked activity, but an origin outside primary cortex. Subsequent oN2 and oP3 responses, as previously observed in the auditory domain, likely reflect modality-unspecific higher order processes. Together, findings straightforwardly demonstrate somatosensory predictions during action and provide evidence for a partially amodal mechanism of prediction error generation.

Learning within a sensory-motor circuit links action to expected outcome

The cortex integrates sound- and movement-related signals to predict the acoustic consequences of behavior and detect violations from expectations. Although expectation- and prediction-related activity has been observed in the auditory cortex of humans, monkeys, and mice during vocal and non-vocal acoustic behaviors, the specific cortical circuitry required for forming memories, recalling expectations, and making predictions remains unknown. By combining closed-loop behavior, electrophysiological recordings, longitudinal pharmacology, and targeted optogenetic circuit activation, we identify a cortical locus for the emergence of expectation and error signals. Movement-related expectation signals and sound-related error signals emerge in parallel in the auditory cortex and are concentrated in largely distinct neurons, consistent with a compartmentalization of different prediction-related computations. On a trial-by-trial basis, expectation and error signals are correlated in auditory cortex, consistent with a local circuit implementation of an internal model. Silencing the auditory cortex during motor-sensory learning prevents the emergence of expectation signals and error signals, revealing the auditory cortex as a necessary node for learning to make predictions. Prediction-like signals can be experimentally induced in the auditory cortex, even in the absence of behavioral experience, by pairing optogenetic motor cortical activation with sound playback, indicating that cortical circuits are sufficient for movement-like predictive processing. Finally, motor-sensory experience realigns the manifold dimensions in which auditory cortical populations encode movement and sound, consistent with predictive processing. These findings show that prediction-related signals reshape auditory cortex dynamics during behavior and reveal a cortical locus for the emergence of expectation and error.

Action does not enhance but attenuates predicted touch

Dominant motor control theories propose that the brain predicts and attenuates the somatosensory consequences of actions, referred to as somatosensory attenuation. Support comes from psychophysical and neuroimaging studies showing that touch applied on a passive hand elicits attenuated perceptual and neural responses if it is actively generated by one's other hand, compared to an identical touch from an external origin. However, recent experimental findings have challenged this view by providing psychophysical evidence that the perceived intensity of touch on the passive hand is enhanced if the active hand does not receive touch simultaneously with the passive hand (somatosensory enhancement) and by further attributing attenuation to the double tactile stimulation of the hands upon contact. Here, we directly contrasted the hypotheses of the attenuation and enhancement models regarding how action influences somatosensory perception by manipulating whether the active hand contacts the passive hand. We further assessed somatosensory perception in the absence of any predictive cues in a condition that turned out to be essential for interpreting the experimental findings. In three pre-registered experiments, we demonstrate that action does not enhance the predicted touch (Experiment 1), that the previously reported 'enhancement' effects are driven by the reference condition used (Experiment 2), and that self-generated touch is robustly attenuated regardless of whether the two hands make contact (Experiment 3). Our results provide conclusive evidence that action does not enhance but attenuates predicted touch and prompt a reappraisal of recent experimental findings upon which theoretical frameworks proposing a perceptual enhancement by action prediction are based.

Altered corollary discharge signaling in the auditory cortex of a mouse model of schizophrenia predisposition

The ability to distinguish sensations that are self-generated from those caused by external events is disrupted in schizophrenia patients. However, the neural circuit abnormalities underlying this sensory impairment and its relationship to the risk factors for the disease is not well understood. To address this, we examined the processing of self-generated sounds in male Df(16)A+/- mice, which model one of the largest genetic risk factors for schizophrenia, the 22q11.2 microdeletion. We find that auditory cortical neurons in Df(16)A+/- mice fail to attenuate their responses to self-generated sounds, recapitulating deficits seen in schizophrenia patients. Notably, the auditory cortex of Df(16)A+/- mice displayed weaker motor-related signals and received fewer inputs from the motor cortex, suggesting an anatomical basis underlying the sensory deficit. These results provide insights into the mechanisms by which a major genetic risk factor for schizophrenia disrupts the top-down processing of sensory information.

Stimulus-Specific Prediction Error Neurons in Mouse Auditory Cortex

Comparing expectation with experience is an important neural computation performed throughout the brain and is a hallmark of predictive processing. Experiments that alter the sensory outcome of an animal's behavior reveal enhanced neural responses to unexpected self-generated stimuli, indicating that populations of neurons in sensory cortex may reflect prediction errors (PEs), mismatches between expectation and experience. However, enhanced neural responses to self-generated stimuli could also arise through nonpredictive mechanisms, such as the movement-based facilitation of a neuron's inherent sound responses. If sensory prediction error neurons exist in sensory cortex, it is unknown whether they manifest as general error responses, or respond with specificity to errors in distinct stimulus dimensions. To answer these questions, we trained mice of either sex to expect the outcome of a simple sound-generating behavior and recorded auditory cortex activity as mice heard either the expected sound or sounds that deviated from expectation in one of multiple distinct dimensions. Our data reveal that the auditory cortex learns to suppress responses to self-generated sounds along multiple acoustic dimensions simultaneously. We identify a distinct population of auditory cortex neurons that are not responsive to passive sounds or to the expected sound but that encode prediction errors. These prediction error neurons are abundant only in animals with a learned motor-sensory expectation, and encode one or two specific violations rather than a generic error signal. Together, these findings reveal that cortical predictions about self-generated sounds have specificity in multiple simultaneous dimensions and that cortical prediction error neurons encode specific violations from expectation.SIGNIFICANCE STATEMENT Audette et. al record neural activity in the auditory cortex while mice perform a sound-generating forelimb movement and measure neural responses to sounds that violate an animal's expectation in different ways. They find that predictions about self-generated sounds are highly specific across multiple stimulus dimensions and that a population of typically nonsound-responsive neurons respond to sounds that violate an animal's expectation in a specific way. These results identify specific prediction error (PE) signals in the mouse auditory cortex and suggest that errors may be calculated early in sensory processing.

Smartphone-based ear-electroencephalography to study sound processing in everyday life

In everyday life, people differ in their sound perception and thus sound processing. Some people may be distracted by construction noise, while others do not even notice. With smartphone-based mobile ear-electroencephalography (ear-EEG), we can measure and quantify sound processing in everyday life by analysing presented sounds and also naturally occurring ones. Twenty-four participants completed four controlled conditions in the lab (1 h) and one condition in the office (3 h). All conditions used the same paired-click stimuli. In the lab, participants listened to click tones under four different instructions: no task towards the sounds, reading a newspaper article, listening to an audio article or counting a rare deviant sound. In the office recording, participants followed daily activities while they were sporadically presented with clicks, without any further instruction. In the beyond-the-lab condition, in addition to the presented sounds, environmental sounds were recorded as acoustic features (i.e., loudness, power spectral density and sounds onsets). We found task-dependent differences in the auditory event-related potentials (ERPs) to the presented click sounds in all lab conditions, which underline that neural processes related to auditory attention can be differentiated with ear-EEG. In the beyond-the-lab condition, we found ERPs comparable to some of the lab conditions. The N1 amplitude to the click sounds beyond the lab was dependent on the background noise, probably due to energetic masking. Contrary to our expectation, we did not find a clear ERP in response to the environmental sounds. Overall, we showed that smartphone-based ear-EEG can be used to study sound processing of well defined-stimuli in everyday life.

Sensation and expectation are embedded in mouse motor cortical activity

During behavior, the motor cortex sends copies of motor-related signals to sensory cortices. It remains unclear whether these corollary discharge signals strictly encode movement or whether they also encode sensory experience and expectation. Here, we combine closed-loop behavior with large-scale physiology, projection-pattern specific recordings, and circuit perturbations to show that neurons in mouse secondary motor cortex (M2) encode sensation and are influenced by expectation. When a movement unexpectedly produces a sound, M2 becomes dominated by sound-evoked activity. Sound responses in M2 are inherited partially from the auditory cortex and are routed back to the auditory cortex, providing a path for the dynamic exchange of sensory-motor information during behavior. When the acoustic consequences of a movement become predictable, M2 responses to self-generated sounds are selectively gated off. These changes in single-cell responses are reflected in population dynamics, which are influenced by both sensation and expectation. Together, these findings reveal the rich embedding of sensory and expectation signals in motor cortical activity.

Motor state changes escape behavior of crickets

Animals change their behavior depending on external circumstances, internal factors, and their interactions. Locomotion state is a crucial internal factor that profoundly affects sensory perception and behavior. However, studying the behavioral impacts of locomotion state in free-moving animals has been challenging due to difficulty in reproducing quantitatively identical stimuli in freely moving animals. We utilized a closed-loop controlled servosphere treadmill system, enabling unrestricted confinement and orientation of small animals, and investigated wind-induced escape behavior in freely moving crickets. When stimulated during locomotion, the crickets quickly stopped before initiating escape behavior. Moving crickets exhibited a higher probability of escape response compared to stationary crickets. The threshold for pausing response in moving crickets was also much lower than the escape response threshold. Moving crickets had delayed reaction times for escape and greater variance in movement direction compared to stationary crickets. The locomotion-related response delay may be compensated by an elevated sensitivity to airflow.

Eye Movements Decrease during Effortful Speech Listening

Hearing impairment affects many older adults but is often diagnosed decades after speech comprehension in noisy situations has become effortful. Accurate assessment of listening effort may thus help diagnose hearing impairment earlier. However, pupillometry-the most used approach to assess listening effort-has limitations that hinder its use in practice. The current study explores a novel way to assess listening effort through eye movements. Building on cognitive and neurophysiological work, we examine the hypothesis that eye movements decrease when speech listening becomes challenging. In three experiments with human participants from both sexes, we demonstrate, consistent with this hypothesis, that fixation duration increases and spatial gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (simple sentences, naturalistic stories). In contrast, pupillometry was less sensitive to speech masking during story listening, suggesting pupillometric measures may not be as effective for the assessments of listening effort in naturalistic speech-listening paradigms. Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in the brain regions that support the regulation of eye movements, such as frontal eye field and superior colliculus, are modulated when listening is effortful.SIGNIFICANCE STATEMENT Assessment of listening effort is critical for early diagnosis of age-related hearing loss. Pupillometry is most used but has several disadvantages. The current study explores a novel way to assess listening effort through eye movements. We examine the hypothesis that eye movements decrease when speech listening becomes effortful. We demonstrate, consistent with this hypothesis, that fixation duration increases and gaze dispersion decreases with increasing speech masking. Eye movements decreased during effortful speech listening for different visual scenes (free viewing, object tracking) and speech materials (sentences, naturalistic stories). Our results reveal a critical link between eye movements and cognitive load, suggesting that neural activity in brain regions that support the regulation of eye movements are modulated when listening is effortful.

Bio-Inspired Design of Superconducting Spiking Neuron and Synapse

The imitative modelling of processes in the brain of living beings is an ambitious task. However, advances in the complexity of existing hardware brain models are limited by their low speed and high energy consumption. A superconducting circuit with Josephson junctions closely mimics the neuronal membrane with channels involved in the operation of the sodium-potassium pump. The dynamic processes in such a system are characterised by a duration of picoseconds and an energy level of attojoules. In this work, two superconducting models of a biological neuron are studied. New modes of their operation are identified, including the so-called bursting mode, which plays an important role in biological neural networks. The possibility of switching between different modes in situ is shown, providing the possibility of dynamic control of the system. A synaptic connection that mimics the short-term potentiation of a biological synapse is developed and demonstrated. Finally, the simplest two-neuron chain comprising the proposed bio-inspired components is simulated, and the prospects of superconducting hardware biosimilars are briefly discussed.

Crossmodal plasticity in hearing loss

Crossmodal plasticity is a textbook example of the ability of the brain to reorganize based on use. We review evidence from the auditory system showing that such reorganization has significant limits, is dependent on pre-existing circuitry and top-down interactions, and that extensive reorganization is often absent. We argue that the evidence does not support the hypothesis that crossmodal reorganization is responsible for closing critical periods in deafness, and crossmodal plasticity instead represents a neuronal process that is dynamically adaptable. We evaluate the evidence for crossmodal changes in both developmental and adult-onset deafness, which start as early as mild-moderate hearing loss and show reversibility when hearing is restored. Finally, crossmodal plasticity does not appear to affect the neuronal preconditions for successful hearing restoration. Given its dynamic and versatile nature, we describe how this plasticity can be exploited for improving clinical outcomes after neurosensory restoration.

Sound Improves Neuronal Encoding of Visual Stimuli in Mouse Primary Visual Cortex

In everyday life, we integrate visual and auditory information in routine tasks such as navigation and communication. While concurrent sound can improve visual perception, the neuronal correlates of audiovisual integration are not fully understood. Specifically, it remains unclear whether neuronal firing patters in the primary visual cortex (V1) of awake animals demonstrate similar sound-induced improvement in visual discriminability. Furthermore, presentation of sound is associated with movement in the subjects, but little is understood about whether and how sound-associated movement affects audiovisual integration in V1. Here, we investigated how sound and movement interact to modulate V1 visual responses in awake, head-fixed mice and whether this interaction improves neuronal encoding of the visual stimulus. We presented visual drifting gratings with and without simultaneous auditory white noise to awake mice while recording mouse movement and V1 neuronal activity. Sound modulated activity of 80% of light-responsive neurons, with 95% of neurons increasing activity when the auditory stimulus was present. A generalized linear model (GLM) revealed that sound and movement had distinct and complementary effects of the neuronal visual responses. Furthermore, decoding of the visual stimulus from the neuronal activity was improved with sound, an effect that persisted even when controlling for movement. These results demonstrate that sound and movement modulate visual responses in complementary ways, improving neuronal representation of the visual stimulus. This study clarifies the role of movement as a potential confound in neuronal audiovisual responses and expands our knowledge of how multimodal processing is mediated at a neuronal level in the awake brain.SIGNIFICANCE STATEMENT Sound and movement are both known to modulate visual responses in the primary visual cortex; however, sound-induced movement has largely remained unaccounted for as a potential confound in audiovisual studies in awake animals. Here, authors found that sound and movement both modulate visual responses in an important visual brain area, the primary visual cortex, in distinct, yet complementary ways. Furthermore, sound improved encoding of the visual stimulus even when accounting for movement. This study reconciles contrasting theories on the mechanism underlying audiovisual integration and asserts the primary visual cortex as a key brain region participating in tripartite sensory interactions.

Reshaping sensory representations by task-specific brain states: Toward cortical circuit mechanisms

Perception is internally constructed by integrating brain states with external sensory inputs, a process depending on the topdown modulation of sensory representations. A wealth of earlier studies described task-dependent modulations of sensory cortex corroborating perceptual and behavioral phenomena. But only with recent technological advancements, the underlying circuit-level mechanisms began to be unveiled. We review recent progress along this line of research. It begins to be appreciated that topdown signals can encode various types of task-related information, ranging from task engagement, and category knowledge to decision execution; these signals are transferred via feedback pathways originating from distinct association cortices and interact with sensory cortical circuits. These plausible mechanisms support a broad range of computations from predictive coding to inference making, ultimately form dynamic percepts and endow behavioral flexibility.

Precise movement-based predictions in the mouse auditory cortex

Many of the sensations experienced by an organism are caused by their own actions, and accurately anticipating both the sensory features and timing of self-generated stimuli is crucial to a variety of behaviors. In the auditory cortex, neural responses to self-generated sounds exhibit frequency-specific suppression, suggesting that movement-based predictions may be implemented early in sensory processing. However, it remains unknown whether this modulation results from a behaviorally specific and temporally precise prediction, nor is it known whether corresponding expectation signals are present locally in the auditory cortex. To address these questions, we trained mice to expect the precise acoustic outcome of a forelimb movement using a closed-loop sound-generating lever. Dense neuronal recordings in the auditory cortex revealed suppression of responses to self-generated sounds that was specific to the expected acoustic features, to a precise position within the movement, and to the movement that was coupled to sound during training. Prediction-based suppression was concentrated in L2/3 and L5, where deviations from expectation also recruited a population of prediction-error neurons that was otherwise unresponsive. Recording in the absence of sound revealed abundant movement signals in deep layers that were biased toward neurons tuned to the expected sound, as well as expectation signals that were present throughout the cortex and peaked at the time of expected auditory feedback. Together, these findings identify distinct populations of auditory cortical neurons with movement, expectation, and error signals consistent with a learned internal model linking an action to its specific acoustic outcome.

Naturalistic neuroscience and virtual reality

Virtual reality (VR) is one of the techniques that became particularly popular in neuroscience over the past few decades. VR experiments feature a closed-loop between sensory stimulation and behavior. Participants interact with the stimuli and not just passively perceive them. Several senses can be stimulated at once, large-scale environments can be simulated as well as social interactions. All of this makes VR experiences more natural than those in traditional lab paradigms. Compared to the situation in field research, a VR simulation is highly controllable and reproducible, as required of a laboratory technique used in the search for neural correlates of perception and behavior. VR is therefore considered a middle ground between ecological validity and experimental control. In this review, I explore the potential of VR in eliciting naturalistic perception and behavior in humans and non-human animals. In this context, I give an overview of recent virtual reality approaches used in neuroscientific research.

Wide-Field Calcium Imaging of Neuronal Network Dynamics In Vivo

A central tenet of neuroscience is that sensory, motor, and cognitive behaviors are generated by the communications and interactions among neurons, distributed within and across anatomically and functionally distinct brain regions. Therefore, to decipher how the brain plans, learns, and executes behaviors requires characterizing neuronal activity at multiple spatial and temporal scales. This includes simultaneously recording neuronal dynamics at the mesoscale level to understand the interactions among brain regions during different behavioral and brain states. Wide-field Ca²⁺ imaging, which uses single photon excitation and improved genetically encoded Ca²⁺ indicators, allows for simultaneous recordings of large brain areas and is proving to be a powerful tool to study neuronal activity at the mesoscopic scale in behaving animals. This review details the techniques used for wide-field Ca²⁺ imaging and the various approaches employed for the analyses of the rich neuronal-behavioral data sets obtained. Also discussed is how wide-field Ca²⁺ imaging is providing novel insights into both normal and altered neural processing in disease. Finally, we examine the limitations of the approach and new developments in wide-field Ca²⁺ imaging that are bringing new capabilities to this important technique for investigating large-scale neuronal dynamics.

Perceptual hearing sensitivity during vocal production

Vocalization, such as speaking, inevitably generates sensory feedback that can cause self-generated masking. However, perceptual hearing sensitivity during vocal production is poorly understood. Using an adaptive psychophysical method, we measured the perceptual hearing sensitivity of an echolocating bat, Hipposideros pratti, in a passive listening (PL) task to detect pure tones, an active listening (AL) task to detect pure tones triggered by its vocalization, and a phantom echo task. We found that hanging H. pratti had the best hearing sensitivity of approximately 0 dB sound pressure level (SPL) in the PL task but much lower hearing sensitivity (nearly 40 dB worse) in the echo task. In the AL task, all bats gradually increased call frequency by 0.8–1.1 kHz, which improved their hearing sensitivity by 25–29 dB. This study underscores the need for studying the sensory capability of subjects engaged in active behaviors.

•

Vocal production strongly affects the perceptual hearing sensitivity of bats

•

Forward masking explains the reduced hearing sensitivity during vocalization

•

Long-term vocal plasticity enables bats to overcome self-generated auditory masking

A juvenile locomotor program promotes vocal learning in zebra finches

The evolution and development of complex, learned motor skills are thought to be closely associated with other locomotor movement and cognitive functions. However, it remains largely unknown how different neuromuscular programs may interconnect during the protracted developmental process. Here we use a songbird to examine the behavioral and neural substrates between the development of locomotor movement and vocal-motor learning. Juvenile songbirds escalate their locomotor activity during the sensitive period for vocal learning, followed by a surge of vocal practice. Individual variability of locomotor production is positively correlated with precision of tutor imitation and duration of multi-syllable sequences. Manipulation of juvenile locomotion significantly impacts the precision of vocal imitation and neural plasticity. The locomotor program developed during the sensitive period of vocal learning may enrich the neural substrates that promote the subsequent development of vocal learning.

Increased movement is associated with improved vocal activity in young zebra finches, while reducing locomotion leads to poor vocal learning. These results suggest that exercise in juvenile birds may actually promote their ability to learn and produce songs.

Beyond language: The unspoken sensory-motor representation of the tongue in non-primates, non-human and human primates

The English idiom "on the tip of my tongue" commonly acknowledges that something is known, but it cannot be immediately brought to mind. This phrase accurately describes sensorimotor functions of the tongue, which are fundamental for many tongue-related behaviors (e.g., speech), but often neglected by scientific research. Here, we review a wide range of studies conducted on non-primates, non-human and human primates with the aim of providing a comprehensive description of the cortical representation of the tongue's somatosensory inputs and motor outputs across different phylogenetic domains. First, we summarize how the properties of passive non-noxious mechanical stimuli are encoded in the putative somatosensory tongue area, which has a conserved location in the ventral portion of the somatosensory cortex across mammals. Second, we review how complex self-generated actions involving the tongue are represented in more anterior regions of the putative somato-motor tongue area. Finally, we describe multisensory response properties of the primate and non-primate tongue area by also defining how the cytoarchitecture of this area is affected by experience and deafferentation.

The promise of low-tech intervention in a high-tech era: Remodeling pathological brain circuits using behavioral reverse engineering

As an academic pursuit, neuroscience is enjoying a golden age. From a clinical perspective, our field is failing. Conventional 20th century drugs and devices are not well-matched to the heterogeneity, scale, and connectivity of neural circuits that produce aberrant mental states and behavior. Laboratory-based methods for editing neural genomes and sculpting activity patterns are exciting, but their applications for hundreds of millions of people with mental health disorders is uncertain. We argue that mechanisms for regulating adult brain plasticity and remodeling pathological activity are substantially pre-wired, and we suggest new minimally invasive strategies to harness and direct these endogenous systems. Drawing from studies across the neuroscience literature, we describe approaches that identify neural biomarkers more closely linked to upstream causes-rather than downstream consequences-of disordered behavioral states. We highlight the potential for innovation and discovery in reverse engineering approaches that refine bespoke behavioral "agonists" to drive upstream neural biomarkers in normative directions and reduce clinical symptoms for select classes of neuropsychiatric disorders.

Multisensory task demands temporally extend the causal requirement for visual cortex in perception

Primary sensory areas constitute crucial nodes during perceptual decision making. However, it remains unclear to what extent they mainly constitute a feedforward processing step, or rather are continuously involved in a recurrent network together with higher-order areas. We found that the temporal window in which primary visual cortex is required for the detection of identical visual stimuli was extended when task demands were increased via an additional sensory modality that had to be monitored. Late-onset optogenetic inactivation preserved bottom-up, early-onset responses which faithfully encoded stimulus features, and was effective in impairing detection only if it preceded a late, report-related phase of the cortical response. Increasing task demands were marked by longer reaction times and the effect of late optogenetic inactivation scaled with reaction time. Thus, independently of visual stimulus complexity, multisensory task demands determine the temporal requirement for ongoing sensory-related activity in V1, which overlaps with report-related activity.

How primary sensory cortices contribute to decision making remains poorly understood. Here the authors report that increasing task demands extend the temporal window in which the primary visual cortex is required for detecting identical stimuli.

Visual modulation of firing and spectrotemporal receptive fields in mouse auditory cortex

Recent studies have established significant anatomical and functional connections between visual areas and primary auditory cortex (A1), which may be important for cognitive processes such as communication and spatial perception. These studies have raised two important questions: First, which cell populations in A1 respond to visual input and/or are influenced by visual context? Second, which aspects of sound encoding are affected by visual context? To address these questions, we recorded single-unit activity across cortical layers in awake mice during exposure to auditory and visual stimuli. Neurons responsive to visual stimuli were most prevalent in the deep cortical layers and included both excitatory and inhibitory cells. The overwhelming majority of these neurons also responded to sound, indicating unimodal visual neurons are rare in A1. Other neurons for which sound-evoked responses were modulated by visual context were similarly excitatory or inhibitory but more evenly distributed across cortical layers. These modulatory influences almost exclusively affected sustained sound-evoked firing rate (FR) responses or spectrotemporal receptive fields (STRFs); transient FR changes at stimulus onset were rarely modified by visual context. Neuron populations with visually modulated STRFs and sustained FR responses were mostly non-overlapping, suggesting spectrotemporal feature selectivity and overall excitability may be differentially sensitive to visual context. The effects of visual modulation were heterogeneous, increasing and decreasing STRF gain in roughly equal proportions of neurons. Our results indicate visual influences are surprisingly common and diversely expressed throughout layers and cell types in A1, affecting nearly one in five neurons overall.

Predictive attenuation of touch and tactile gating are distinct perceptual phenomena

In recent decades, research on somatosensory perception has led to two important observations. First, self-generated touches that are predicted by voluntary movements become attenuated compared with externally generated touches of the same intensity (attenuation). Second, externally generated touches feel weaker and are more difficult to detect during movement than at rest (gating). At present, researchers often consider gating and attenuation the same suppression process; however, this assumption is unwarranted because, despite more than 40 years of research, no study has combined them in a single paradigm. We quantified how people perceive self-generated and externally generated touches during movement and rest. We show that whereas voluntary movement gates the precision of both self-generated and externally generated touch, the amplitude of self-generated touch is robustly attenuated compared with externally generated touch. Furthermore, attenuation and gating do not interact and are not correlated, and we conclude that they represent distinct perceptual phenomena.

•

We tested the perception of self-generated and external touch during movement and rest

•

The intensity of self-generated touch is reduced during movement and rest (attenuation)

•

The precision of self-generated and external touch is reduced during movement (gating)

•

Attenuation and gating neither interact nor correlate, and are distinct phenomena

Sound omission related brain responses in children

Action is an important way for children to learn about the world. Recent theories suggest that action is inherently accompanied by the sensory prediction of its effects. Such predictions can be revealed by rarely omitting the expected sensory consequence of the action, resulting in an omission response that is observable in the EEG. Although prediction errors play an important role in models of learning and development, little is known about omission-related brain responses in children. This study used a motor-auditory omission paradigm, testing a group of 6-8-year-old children and an adult group (N = 31 each). In an identity-specific condition, the sound coupled to the motor action was predictable, while in an identity unspecific condition the sound was unpredictable. Results of a temporal principal component analysis revealed that sound-related brain responses underlying the N1-complex differed considerably between age groups. Despite these developmental differences, omission responses (oN1) were similar between age groups. Two subcomponents of the oN1 were differently affected by specific and unspecific predictions. Results demonstrate that children, independent from the maturation of sound processing mechanisms, can implement specific and unspecific predictions as flexibly as adults. This supports theories that regard action and prediction error as important drivers of cognitive development.

Task-induced modulations of neuronal activity along the auditory pathway

Sensory processing varies depending on behavioral context. Here, we ask how task engagement modulates neurons in the auditory system. We train mice in a simple tone-detection task and compare their neuronal activity during passive hearing and active listening. Electrophysiological extracellular recordings in the inferior colliculus, medial geniculate body, primary auditory cortex, and anterior auditory field reveal widespread modulations across all regions and cortical layers and in both putative regular- and fast-spiking cortical neurons. Clustering analysis unveils ten distinct modulation patterns that can either enhance or suppress neuronal activity. Task engagement changes the tone-onset response in most neurons. Such modulations first emerge in subcortical areas, ruling out cortical feedback as the only mechanism underlying subcortical modulations. Half the neurons additionally display late modulations associated with licking, arousal, or reward. Our results reveal the presence of functionally distinct subclasses of neurons, differentially sensitive to specific task-related variables but anatomically distributed along the auditory pathway.

Movement Planning Determines Sensory Suppression: An Event-related Potential Study

Sensory suppression refers to the phenomenon that sensory input generated by our own actions, such as moving a finger to press a button to hear a tone, elicits smaller neural responses than sensory input generated by external agents. This observation is usually explained via the internal forward model in which an efference copy of the motor command is used to compute a corollary discharge, which acts to suppress sensory input. However, because moving a finger to press a button is accompanied by neural processes involved in preparing and performing the action, it is unclear whether sensory suppression is the result of movement planning, movement execution, or both. To investigate this, in two experiments, we compared ERPs to self-generated tones that were produced by voluntary, semivoluntary, or involuntary button-presses, with externally generated tones that were produced by a computer. In Experiment 1, the semivoluntary and involuntary button-presses were initiated by the participant or experimenter, respectively, by electrically stimulating the median nerve in the participant's forearm, and in Experiment 2, by applying manual force to the participant's finger. We found that tones produced by voluntary button-presses elicited a smaller N1 component of the ERP than externally generated tones. This is known as N1-suppression. However, tones produced by semivoluntary and involuntary button-presses did not yield significant N1-suppression. We also found that the magnitude of N1-suppression linearly decreased across the voluntary, semivoluntary, and involuntary conditions. These results suggest that movement planning is a necessary condition for producing sensory suppression. We conclude that the most parsimonious account of sensory suppression is the internal forward model.

Wide-Field Calcium Imaging of Dynamic Cortical Networks during Locomotion

Motor behavior results in complex exchanges of motor and sensory information across cortical regions. Therefore, fully understanding the cerebral cortex’s role in motor behavior requires a mesoscopic-level description of the cortical regions engaged, their functional interactions, and how these functional interactions change with behavioral state. Mesoscopic Ca²⁺ imaging through transparent polymer skulls in mice reveals elevated activation of the dorsal cerebral cortex during locomotion_. Using the correlations between the time series of Ca²⁺ fluorescence from 28 regions (nodes) obtained using spatial independent component analysis (sICA), we examined the changes in functional connectivity of the cortex from rest to locomotion with a goal of understanding the changes to the cortical functional state that facilitate locomotion. Both the transitions from rest to locomotion and from locomotion to rest show marked increases in correlation among most nodes. However, once a steady state of continued locomotion is reached, many nodes, including primary motor and somatosensory nodes, show decreases in correlations, while retrosplenial and the most anterior nodes of the secondary motor cortex show increases. These results highlight the changes in functional connectivity in the cerebral cortex, representing a series of changes in the cortical state from rest to locomotion and on return to rest.

Self-generation and sound intensity interactively modulate perceptual bias, but not perceptual sensitivity

The ability to distinguish self-generated stimuli from those caused by external sources is critical for all behaving organisms. Although many studies point to a sensory attenuation of self-generated stimuli, recent evidence suggests that motor actions can result in either attenuated or enhanced perceptual processing depending on the environmental context (i.e., stimulus intensity). The present study employed 2-AFC sound detection and loudness discrimination tasks to test whether sound source (self- or externally-generated) and stimulus intensity (supra- or near-threshold) interactively modulate detection ability and loudness perception. Self-generation did not affect detection and discrimination sensitivity (i.e., detection thresholds and Just Noticeable Difference, respectively). However, in the discrimination task, we observed a significant interaction between self-generation and intensity on perceptual bias (i.e. Point of Subjective Equality). Supra-threshold self-generated sounds were perceived softer than externally-generated ones, while at near-threshold intensities self-generated sounds were perceived louder than externally-generated ones. Our findings provide empirical support to recent theories on how predictions and signal intensity modulate perceptual processing, pointing to interactive effects of intensity and self-generation that seem to be driven by a biased estimate of perceived loudness, rather by changes in detection and discrimination sensitivity.

Human Somatosensory Cortex Is Modulated during Motor Planning

Recent data and motor control theory argues that movement planning involves preparing the neural state of primary motor cortex (M1) for forthcoming action execution. Theories related to internal models, feedback control, and predictive coding also emphasize the importance of sensory prediction (and processing) before (and during) the movement itself, explaining why motor-related deficits can arise from damage to primary somatosensory cortex (S1). Motivated by this work, here we examined whether motor planning, in addition to changing the neural state of M1, changes the neural state of S1, preparing it for the sensory feedback that arises during action. We tested this idea in two human functional MRI studies (N = 31, 16 females) involving delayed object manipulation tasks, focusing our analysis on premovement activity patterns in M1 and S1. We found that the motor effector to be used in the upcoming action could be decoded, well before movement, from neural activity in M1 in both studies. Critically, we found that this effector information was also present, well before movement, in S1. In particular, we found that the encoding of effector information in area 3b (S1 proper) was linked to the contralateral hand, similarly to that found in M1, whereas in areas 1 and 2 this encoding was present in both the contralateral and ipsilateral hemispheres. Together, these findings suggest that motor planning not only prepares the motor system for movement but also changes the neural state of the somatosensory system, presumably allowing it to anticipate the sensory information received during movement.SIGNIFICANCE STATEMENT Whereas recent work on motor cortex has emphasized the critical role of movement planning in preparing neural activity for movement generation, it has not investigated the extent to which planning also modulates the activity in the adjacent primary somatosensory cortex. This reflects a key gap in knowledge, given that recent motor control theories emphasize the importance of sensory feedback processing in effective movement generation. Here, we find through a convergence of experiments and analyses, that the planning of object manipulation tasks, in addition to modulating the activity in the motor cortex, changes the state of neural activity in different subfields of the human S1. We suggest that this modulation prepares the S1 for the sensory information it will receive during action execution.

Motor Planning Modulates Neural Activity Patterns in Early Human Auditory Cortex

It is well established that movement planning recruits motor-related cortical brain areas in preparation for the forthcoming action. Given that an integral component to the control of action is the processing of sensory information throughout movement, we predicted that movement planning might also modulate early sensory cortical areas, readying them for sensory processing during the unfolding action. To test this hypothesis, we performed 2 human functional magnetic resonance imaging studies involving separate delayed movement tasks and focused on premovement neural activity in early auditory cortex, given the area's direct connections to the motor system and evidence that it is modulated by motor cortex during movement in rodents. We show that effector-specific information (i.e., movements of the left vs. right hand in Experiment 1 and movements of the hand vs. eye in Experiment 2) can be decoded, well before movement, from neural activity in early auditory cortex. We find that this motor-related information is encoded in a separate subregion of auditory cortex than sensory-related information and is present even when movements are cued visually instead of auditorily. These findings suggest that action planning, in addition to preparing the motor system for movement, involves selectively modulating primary sensory areas based on the intended action.

Movement and Performance Explain Widespread Cortical Activity in a Visual Detection Task

Recent studies in mice reveal widespread cortical signals during task performance; however, the various task-related and task-independent processes underlying this activity are incompletely understood. Here, we recorded wide-field neural activity, as revealed by GCaMP6s, from dorsal cortex while simultaneously monitoring orofacial movements, walking, and arousal (pupil diameter) of head-fixed mice performing a Go/NoGo visual detection task and examined the ability of task performance and spontaneous or task-related movements to predict cortical activity. A linear model was able to explain a significant fraction (33-55% of variance) of widefield dorsal cortical activity, with the largest factors being movements (facial, walk, eye), response choice (hit, miss, false alarm), and arousal and indicate that a significant fraction of trial-to-trial variability arises from both spontaneous and task-related changes in state (e.g., movements, arousal). Importantly, secondary motor cortex was highly correlated with lick rate, critical for optimal task performance (high d'), and was the first region to significantly predict the lick response on target trials. These findings suggest that secondary motor cortex is critically involved in the decision and performance of learned movements and indicate that a significant fraction of trial-to-trial variation in cortical activity results from spontaneous and task-related movements and variations in behavioral/arousal state.

Enhanced modulation of cell-type specific neuronal responses in mouse dorsal auditory field during locomotion

As we move through the environment we experience constantly changing sensory input that must be merged with our ongoing motor behaviors - creating dynamic interactions between our sensory and motor systems. Active behaviors such as locomotion generally increase the sensory-evoked neuronal activity in visual and somatosensory cortices, but evidence suggests that locomotion largely suppresses neuronal responses in the auditory cortex. However, whether this effect is ubiquitous across different anatomical regions of the auditory cortex is largely unknown. In mice, auditory association fields such as the dorsal auditory cortex (AuD), have been shown to have different physiological response properties, protein expression patterns, and cortical as well as subcortical connections, in comparison to primary auditory regions (A1) - suggesting there may be important functional differences. Here we examined locomotion-related modulation of neuronal activity in cortical layers ⅔ of AuD and A1 using two-photon Ca²⁺ imaging in head-fixed behaving mice that are able to freely run on a spherical treadmill. We determined the proportion of neurons in these two auditory regions that show enhanced and suppressed sensory-evoked responses during locomotion and quantified the depth of modulation. We found that A1 shows more suppression and AuD more enhanced responses during locomotion periods. We further revealed differences in the circuitry between these auditory regions and motor cortex, and found that AuD is more highly connected to motor cortical regions. Finally, we compared the cell-type specific locomotion-evoked modulation of responses in AuD and found that, while subpopulations of PV-expressing interneurons showed heterogeneous responses, the population in general was largely suppressed during locomotion, while excitatory population responses were generally enhanced in AuD. Therefore, neurons in primary and dorsal auditory fields have distinct response properties, with dorsal regions exhibiting enhanced activity in response to movement. This functional distinction may be important for auditory processing during navigation and acoustically guided behavior.

Neocortical Layer 1: An Elegant Solution to Top-Down and Bottom-Up Integration

Many of our daily activities, such as riding a bike to work or reading a book in a noisy cafe, and highly skilled activities, such as a professional playing a tennis match or a violin concerto, depend upon the ability of the brain to quickly make moment-to-moment adjustments to our behavior in response to the results of our actions. Particularly, they depend upon the ability of the neocortex to integrate the information provided by the sensory organs (bottom-up information) with internally generated signals such as expectations or attentional signals (top-down information). This integration occurs in pyramidal cells (PCs) and their long apical dendrite, which branches extensively into a dendritic tuft in layer 1 (L1). The outermost layer of the neocortex, L1 is highly conserved across cortical areas and species. Importantly, L1 is the predominant input layer for top-down information, relayed by a rich, dense mesh of long-range projections that provide signals to the tuft branches of the PCs. Here, we discuss recent progress in our understanding of the composition of L1 and review evidence that L1 processing contributes to functions such as sensory perception, cross-modal integration, controlling states of consciousness, attention, and learning.

Reaching for known unknowns: Rapid reach decisions accurately reflect the future state of dynamic probabilistic information

Everyday tasks such as catching a ball appear effortless, but in fact require complex interactions and tight temporal coordination between the brain's visual and motor systems. What makes such interceptive actions particularly impressive is the capacity of the brain to account for temporal delays in the central nervous system-a limitation that can be mitigated by making predictions about the environment as well as one's own actions. Here, we wanted to assess how well human participants can plan an upcoming movement based on a dynamic, predictable stimulus that is not the target of action. A central stationary or rotating stimulus determined the probability that each of two potential targets would be the eventual target of a rapid reach-to-touch movement. We examined the extent to which reach movement trajectories convey internal predictions about the future state of dynamic probabilistic information conveyed by the rotating stimulus. We show that movement trajectories reflect the target probabilities determined at movement onset, suggesting that humans rapidly and accurately integrate visuospatial predictions and estimates of their own reaction times to effectively guide action.

Vocalizing and singing reveal complex patterns of corollary discharge function in schizophrenia

INTRODUCTION

As we vocalize, our brains generate predictions of the sounds we produce to enable suppression of neural responses when intentions match vocalizations and to make adjustments when they do not. This may be instantiated by efference copy and corollary discharge mechanisms, which are impaired in people with schizophrenia (SZ). Although innate, these mechanisms can be affected by intentions. We asked if attending to pitch during vocalizations would take these mechanisms "off-line" and reduce suppression.

METHODS

Event-related potentials (ERP) were recorded from 96 SZ and 92 healthy controls (HC) as they vocalized triplets in monotone (Phrase) or sang triplets in ascending thirds (Pitch). Pre-vocalization activity (Bereitschaftspotential, BP), N1, and P2 ERP components to sounds were compared during vocalization and playback.

RESULTS

N1 was not as suppressed during Pitch as during Phrase. N1 suppression was not affected by SZ in either task when all data were collapsed across pitches (Pitch) and positions (Phrase). However, when binned according to vocalization performance, SZ showed less N1 suppression than HC at longer (>2 s) inter-stimulus intervals (Phrase) and inconsistent suppression across pitches (Pitch). Unlike N1, P2 was more suppressed during Pitch than Phrase and not affected by SZ. BP was greater during vocalization than playback but did not contribute to N1 or P2 effects. Pitch variability was inversely related to negative symptoms.

CONCLUSIONS

Neural processing is not suppressed when patients and controls sing, and corollary discharge abnormalities in schizophrenia are only seen at long vocalization intervals.

Learning to silence saccadic suppression

Sensory systems often suppress self-generated sensations in order to discriminate them from those arising in the environment. The suppression of visual sensitivity during rapid eye movements is well established, and although functionally beneficial most of the time, it can limit the performance of certain tasks. Here, we show that with repeated practice, mechanisms that suppress visual signals during eye movements can be modified. People trained to detect brief visual patterns learn to turn off suppression around the expected time of the target. These findings demonstrate an elegant form of plasticity, capable of improving the visibility of behaviorally relevant stimuli without compromising the wider functional benefits of suppression.

Perceptual stability is facilitated by a decrease in visual sensitivity during rapid eye movements, called saccadic suppression. While a large body of evidence demonstrates that saccadic programming is plastic, little is known about whether the perceptual consequences of saccades can be modified. Here, we demonstrate that saccadic suppression is attenuated during learning on a standard visual detection-in-noise task, to the point that it is effectively silenced. Across a period of 7 days, 44 participants were trained to detect brief, low-contrast stimuli embedded within dynamic noise, while eye position was tracked. Although instructed to fixate, participants regularly made small fixational saccades. Data were accumulated over a large number of trials, allowing us to assess changes in performance as a function of the temporal proximity of stimuli and saccades. This analysis revealed that improvements in sensitivity over the training period were accompanied by a systematic change in the impact of saccades on performance—robust saccadic suppression on day 1 declined gradually over subsequent days until its magnitude became indistinguishable from zero. This silencing of suppression was not explained by learning-related changes in saccade characteristics and generalized to an untrained retinal location and stimulus orientation. Suppression was restored when learned stimulus timing was perturbed, consistent with the operation of a mechanism that temporarily reduces or eliminates saccadic suppression, but only when it is behaviorally advantageous to do so. Our results indicate that learning can circumvent saccadic suppression to improve performance, without compromising its functional benefits in other viewing contexts.

Reconciling competing mechanisms posited to underlie auditory verbal hallucinations

Perception is not the passive registration of incoming sensory data. Rather, it involves some analysis by synthesis, based on past experiences and context. One adaptive consequence of this arrangement is imagination-the ability to richly simulate sensory experiences, interrogate and manipulate those simulations, in service of action and decision making. In this paper, we will discuss one possible cost of this adaptation, namely hallucinations-perceptions without sensory stimulation, which characterize serious mental illnesses like schizophrenia, but which also occur in neurological illnesses, and-crucially for the present piece-are common also in the non-treatment-seeking population. We will draw upon a framework for imagination that distinguishes voluntary from non-voluntary experiences and explore the extent to which the varieties and features of hallucinations map onto this distinction, with a focus on auditory-verbal hallucinations (AVHs)-colloquially, hearing voices. We will propose that sense of agency for the act of imagining is key to meaningfully dissecting different forms and features of AVHs, and we will outline the neural, cognitive and phenomenological sequelae of this sense. We will conclude that a compelling unifying framework for action, perception and belief-predictive processing-can incorporate observations regarding sense of agency, imagination and hallucination. This article is part of the theme issue 'Offline perception: voluntary and spontaneous perceptual experiences without matching external stimulation'.

Auditory Corticothalamic Neurons Are Recruited by Motor Preparatory Inputs

Corticothalamic (CT) neurons comprise the largest component of the descending sensory corticofugal pathway, but their contributions to brain function and behavior remain an unsolved mystery. To address the hypothesis that layer 6 (L6) CTs may be activated by extra-sensory inputs prior to anticipated sounds, we performed optogenetically targeted single-unit recordings and two-photon imaging of Ntsr1-Cre+ L6 CT neurons in the primary auditory cortex (A1) while mice were engaged in an active listening task. We found that L6 CTs and other L6 units began spiking hundreds of milliseconds prior to orofacial movements linked to sound presentation and reward, but not to other movements such as locomotion, which were not linked to an explicit behavioral task. Rabies tracing of monosynaptic inputs to A1 L6 CT neurons revealed a narrow strip of cholinergic and non-cholinergic projection neurons in the external globus pallidus, suggesting a potential source of motor-related input. These findings identify new pathways and local circuits for motor modulation of sound processing and suggest a new role for CT neurons in active sensing.

Age- and movement-related modulation of cortical oscillations in a mouse model of presbycusis

Brain oscillations are associated with specific cognitive and sensory processes. How age-related hearing loss (presbycusis) alters cortical oscillations is unclear. Altered inhibitory neurotransmission and temporal processing deficits contribute to speech recognition impairments in presbycusis. Specifically, age-related reduction in parvalbumin positive interneurons and perineuronal nets in the auditory cortex predicts a reduction in gamma oscillations that may lead to a decline in temporal precision and attention. To test the hypothesis that resting and evoked gamma oscillations decline with presbycusis, EEGs were recorded from the auditory and frontal cortex of awake, freely moving C57BL/6 J mice at three ages (3, 14 and 24 months). Resting EEG data were analyzed according to movement state (move versus still). Evoked responses were recorded following presentation of noise bursts or amplitude modulated noise with time varying modulation frequencies. We report an age-related decrease in resting gamma power, a decline in gamma-range synchrony to time varying stimuli, and an increase in noise evoked and induced gamma power. A decline in temporal processing is seen in aged mice that exhibit robust auditory-evoked potentials, dissociating hearing loss from temporal processing deficits. We also report an increase in gamma power when mice moved compared to the still state. However, the movement-related modulation of gamma oscillations did not change with age. Together, these data identify a number of novel markers of presbycusis-related changes in auditory and frontal cortex. Because EEGs are commonly recorded in humans, the mouse data may serve as translation relevant preclinical biomarkers to facilitate the development of therapeutics to delay or reverse central auditory processing deficits in presbycusis.

Sensory Island Task (SIT): A New Behavioral Paradigm to Study Sensory Perception and Neural Processing in Freely Moving Animals

A central function of sensory systems is the gathering of information about dynamic interactions with the environment during self-motion. To determine whether modulation of a sensory cue was externally caused or a result of self-motion is fundamental to perceptual invariance and requires the continuous update of sensory processing about recent movements. This process is highly context-dependent and crucial for perceptual performances such as decision-making and sensory object formation. Yet despite its fundamental ecological role, voluntary self-motion is rarely incorporated in perceptual or neurophysiological investigations of sensory processing in animals. Here, we present the Sensory Island Task (SIT), a new freely moving search paradigm to study sensory processing and perception. In SIT, animals explore an open-field arena to find a sensory target relying solely on changes in the presented stimulus, which is controlled by closed-loop position tracking in real-time. Within a few sessions, animals are trained via positive reinforcement to search for a particular area in the arena (“target island”), which triggers the presentation of the target stimulus. The location of the target island is randomized across trials, making the modulated stimulus feature the only informative cue for task completion. Animals report detection of the target stimulus by remaining within the island for a defined time (“sit-time”). Multiple “non-target” islands can be incorporated to test psychometric discrimination and identification performance. We exemplify the suitability of SIT for rodents (Mongolian gerbil, Meriones unguiculatus) and small primates (mouse lemur, Microcebus murinus) and for studying various sensory perceptual performances (auditory frequency discrimination, sound source localization, visual orientation discrimination). Furthermore, we show that pairing SIT with chronic electrophysiological recordings allows revealing neuronal signatures of sensory processing under ecologically relevant conditions during goal-oriented behavior. In conclusion, SIT represents a flexible and easily implementable behavioral paradigm for mammals that combines self-motion and natural exploratory behavior to study sensory sensitivity and decision-making and their underlying neuronal processing.

Disrupted Functional Network Connectivity Predicts Cognitive Impairment in Presbycusis Patients

Purpose: Individuals with presbycusis often show deficits in cognitive function, however, the exact neurophysiological mechanisms are not well understood. This study explored the alterations in intra- and inter-network functional connectivity (FC) of multiple networks in presbycusis patients, and further correlated FC with cognitive assessment scores to assess their ability to predict cognitive impairment.

Methods: Resting-state functional magnetic resonance imaging (rs-fMRI) was performed in 40 presbycusis patients and 40 matched controls, and 12 resting-state networks (RSNs) were identified by independent component analysis (ICA) approach. A two-sample t-test was carried out to detect the intra-network FC differences, and functional network connectivity (FNC) was calculated to compare the inter-network FC differences. Pearson or Spearman correlation analysis was subsequently used to explore the correlation between altered FC and cognitive assessment scores.

Results: Our study demonstrated that patients with presbycusis showed significantly decreased FC in the subcortical limbic network (scLN), default mode network (DMN), executive control network (ECN), and attention network (AN) compared with the control group. Moreover, the connectivity for scLN-AUN (auditory network) and VN (visual network)-DMN were found significantly increased while AN-DMN was found significantly decreased in presbycusis patients. Ultimately, this study revealed the intra- and inter-network alterations associated with some cognitive assessment scores.

Conclusion: This study observed intra- and inter-network FC alterations in presbycusis patients, and investigated that presbycusis can lead to abnormal connectivity of RSNs and plasticity compensation mechanism, which may be the basis of cognitive impairment, suggesting that FNC can be used to predict potential cognitive impairment in their early stage.

The Orofacial Somatosensory System Is Modulated During Speech Planning and Production

Purpose In our previous studies, we showed that the brain modulates the auditory system, and the modulation starts during speech planning. However, it remained unknown whether the brain uses similar mechanisms to modulate the orofacial somatosensory system. Here, we developed a novel behavioral paradigm to (a) examine whether the somatosensory system is modulated during speech planning and (b) determine the somatosensory modulation's time course during planning and production. Method Participants (N = 20) completed two experiments in which we applied electrical current stimulation to the lower lip to induce somatosensory sensation. In the first experiment, we used a staircase method (one-up, four-down) to determine each participant's perceptual threshold at rest (i.e., the stimulus that the participant detected on 85% of trials). In the second experiment, we estimated each participant's detection ratio of electrical stimuli (with a magnitude equivalent of their perceptual threshold) delivered at various time points before speaking and during a control condition (silent reading). Results We found that the overall detection ratio in the silent reading condition remained unchanged relative to the detection ratio at rest. Approximately 536 ms before speech onset, the detection ratio in the speaking condition was similar to that in the silent reading condition; however, the detection ratio in the speaking condition gradually started to decrease and reached its lowest level at 58 ms before speech onset. Conclusions Overall, we provided compelling behavioral evidence that, as the speech motor system prepares speech movements, it also modulates the orofacial somatosensory system in a temporally specific manner.

A New Unifying Account of the Roles of Neuronal Entrainment

Rhythms are a fundamental and defining feature of neuronal activity in animals including humans. This rhythmic brain activity interacts in complex ways with rhythms in the internal and external environment through the phenomenon of 'neuronal entrainment', which is attracting increasing attention due to its suggested role in a multitude of sensory and cognitive processes. Some senses, such as touch and vision, sample the environment rhythmically, while others, like audition, are faced with mostly rhythmic inputs. Entrainment couples rhythmic brain activity to external and internal rhythmic events, serving fine-grained routing and modulation of external and internal signals across multiple spatial and temporal hierarchies. This interaction between a brain and its environment can be experimentally investigated and even modified by rhythmic sensory stimuli or invasive and non-invasive neuromodulation techniques. We provide a comprehensive overview of the topic and propose a theoretical framework of how neuronal entrainment dynamically structures information from incoming neuronal, bodily and environmental sources. We discuss the different types of neuronal entrainment, the conceptual advances in the field, and converging evidence for general principles.