Patterned tone sequences reveal non-linear interactions in auditory spectrotemporal receptive fields in the inferior colliculus

The significance of structural rich club hubs for the processing of hierarchical stimuli

The brain's structural network follows a hierarchy that is described as rich club (RC) organization, with RC hubs forming the well-interconnected top of this hierarchy. In this study, we tested whether RC hubs are involved in the processing of hierarchically higher structures in stimulus sequences. Moreover, we explored the role of previously suggested cortical gradients along anterior-posterior and medial-lateral axes throughout the frontal cortex. To this end, we conducted a functional magnetic resonance imaging (fMRI) experiment and presented participants with blocks of digit sequences that were structured on different hierarchically nested levels. We additionally collected diffusion weighted imaging data of the same subjects to identify RC hubs. This classification then served as the basis for a region of interest analysis of the fMRI data. Moreover, we determined structural network centrality measures in areas that were found as activation clusters in the whole-brain fMRI analysis. Our findings support the previously found anterior and medial shift for processing hierarchically higher structures of stimuli. Additionally, we found that the processing of hierarchically higher structures of the stimulus structure engages RC hubs more than for lower levels. Areas involved in the functional processing of hierarchically higher structures were also more likely to be part of the structural RC and were furthermore more central to the structural network. In summary, our results highlight the potential role of the structural RC organization in shaping the cortical processing hierarchy.

Modality-specific sensory and decisional carryover effects in duration perception

BACKGROUND

The brain uses recent history when forming perceptual decisions. This results in carryover effects in perception. Although separate sensory and decisional carryover effects have been shown in many perceptual tasks, their existence and nature in temporal processing are unclear. Here, we investigated whether and how previous stimuli and previous choices affect subsequent duration perception, in vision and audition.

RESULTS

In a series of three experiments, participants were asked to classify visual or auditory stimuli into "shorter" or "longer" duration categories. In experiment 1, visual and auditory stimuli were presented in separate blocks. Results showed that current duration estimates were repelled away from the previous trial's stimulus duration, but attracted towards the previous choice, in both vision and audition. In experiment 2, visual and auditory stimuli were pseudorandomly presented in one block. We found that sensory and decisional carryover effects occurred only when previous and current stimuli were from the same modality. Experiment 3 further investigated the stimulus dependence of carryover effects within each modality. In this experiment, visual stimuli with different shape topologies (or auditory stimuli with different audio frequencies) were pseudorandomly presented in one visual (or auditory) block. Results demonstrated sensory carryover (within each modality) despite task-irrelevant differences in visual shape topology or audio frequency. By contrast, decisional carryover was reduced (but still present) across different visual topologies and completely absent across different audio frequencies.

CONCLUSIONS

These results suggest that serial dependence in duration perception is modality-specific. Moreover, repulsive sensory carryover effects generalize within each modality, whereas attractive decisional carryover effects are contingent on contextual details.

Strong energy component is more important than spectral selectivity in modeling responses of midbrain auditory neurons to wide-band environmental sounds

Modeling central auditory neurons in response to complex sounds not only helps understanding neural processing of speech signals but can also provide insights for biomimetics in neuro-engineering. While modeling responses of midbrain auditory neurons to synthetic tones is rather good, modeling those to environmental sounds is less satisfactory. Environmental sounds typically contain a wide range of frequency components, often with strong and transient energy. These stimulus features have not been examined in the conventional approach of auditory modeling centered on spectral selectivity. To this end, we firstly compared responses to an environmental sound of auditory midbrain neurons across 3 subpopulations of neurons with frequency selectivity in the low, middle and high ranges; secondly, we manipulated the sound energy, both in power and in spectrum, and compared across these subpopulations how their modeled responses were affected. The environmental sound was recorded when a rat was drinking from a feeding bottle (called the 'drinking sound'). The sound spectrum was divided into 20 non-overlapping frequency bands (from 0 to 20 kHz, at 1 kHz width) and presented to an artificial neural model built on a committee machine with parallel spectral inputs to simulate the known tonotopic organization of the auditory system. The model was trained to predict empirical response probability profiles of neurons to the repeated sounds. Results showed that model performance depended more on the strong energy components than on the spectral selectivity. Findings were interpreted to reflect general sensitivity to rapidly changing sound intensities at the auditory midbrain and in the cortex.

Natural Statistics as Inference Principles of Auditory Tuning in Biological and Artificial Midbrain Networks

Bats provide a powerful mammalian model to explore the neural representation of complex sounds, as they rely on hearing to survive in their environment. The inferior colliculus (IC) is a central hub of the auditory system that receives converging projections from the ascending pathway and descending inputs from auditory cortex. In this work, we build an artificial neural network to replicate auditory characteristics in IC neurons of the big brown bat. We first test the hypothesis that spectro-temporal tuning of IC neurons is optimized to represent the natural statistics of conspecific vocalizations. We estimate spectro-temporal receptive fields (STRFs) of IC neurons and compare tuning characteristics to statistics of bat calls. The results indicate that the FM tuning of IC neurons is matched with the statistics. Then, we investigate this hypothesis on the network optimized to represent natural sound statistics and to compare its output with biological responses. We also estimate biomimetic STRFs from the artificial network and correlate their characteristics to those of biological neurons. Tuning properties of both biological and artificial neurons reveal strong agreement along both spectral and temporal dimensions, and suggest the presence of nonlinearity, sparsity, and complexity constraints that underlie the neural representation in the auditory midbrain. Additionally, the artificial neurons replicate IC neural activities in discrimination of social calls, and provide simulated results for a noise robust discrimination. In this way, the biomimetic network allows us to infer the neural mechanisms by which the bat’s IC processes natural sounds used to construct the auditory scene.

Neural Response Selectivity to Natural Sounds in the Bat Midbrain

Little is known about the neural mechanisms that mediate differential action-selection responses to communication and echolocation calls in bats. For example, in the big brown bat, frequency modulated (FM) food-claiming communication calls closely resemble FM echolocation calls, which guide social and orienting behaviors, respectively. Using advanced signal processing methods, we identified fine differences in temporal structure of these natural sounds that appear key to auditory discrimination and behavioral decisions. We recorded extracellular potentials from single neurons in the midbrain inferior colliculus (IC) of passively listening animals, and compared responses to playbacks of acoustic signals used by bats for social communication and echolocation. We combined information obtained from spike number and spike triggered averages (STA) to reveal a robust classification of neuron selectivity for communication or echolocation calls. These data highlight the importance of temporal acoustic structure for differentiating echolocation and food-claiming social calls and point to general mechanisms of natural sound processing across species.

Responses of midbrain auditory neurons to two different environmental sounds-A new approach on cross-sound modeling

When modeling auditory responses to environmental sounds, results are satisfactory if both training and testing are restricted to datasets of one type of sound. To predict 'cross-sound' responses (i.e., to predict the response to one type of sound e.g., rat Eating sound, after training with another type of sound e.g., rat Drinking sound), performance is typically poor. Here we implemented a novel approach to improve such cross-sound modeling (single unit datasets were collected at the auditory midbrain of anesthetized rats). The method had two key features: (a) population responses (e.g., average of 32 units) instead of responses of individual units were analyzed; and (b) the long sound segment was first divided into short segments (single sound-bouts), their similarity was then computed over a new metric involving the response (called Stimulus Response Model map or SRM map), and finally similar sound-bouts (regardless of sound type) and their associated responses (peri-stimulus time histograms, PSTHs) were modelled. Specifically, a committee machine model (artificial neural networks with 20 stratified spectral inputs) was trained with datasets from one sound type before predicting PSTH responses to another sound type. Model performance was markedly improved up to 92%. Results also suggested the involvement of different neural mechanisms in generating the early and late responses to amplitude transients in the broad-band environmental sounds. We concluded that it is possible to perform rather satisfactory cross-sound modeling on datasets grouped together based on their similarities in terms of the new metric of SRM map.

Describing complex cells in primary visual cortex: a comparison of context and multifilter LN models

Receptive field (RF) models are an important tool for deciphering neural responses to sensory stimuli. The two currently popular RF models are multifilter linear-nonlinear (LN) models and context models. Models are, however, never correct, and they rely on assumptions to keep them simple enough to be interpretable. As a consequence, different models describe different stimulus-response mappings, which may or may not be good approximations of real neural behavior. In the current study, we take up two tasks: 1) we introduce new ways to estimate context models with realistic nonlinearities, that is, with logistic and exponential functions, and 2) we evaluate context models and multifilter LN models in terms of how well they describe recorded data from complex cells in cat primary visual cortex. Our results, based on single-spike information and correlation coefficients, indicate that context models outperform corresponding multifilter LN models of equal complexity (measured in terms of number of parameters), with the best increase in performance being achieved by the novel context models. Consequently, our results suggest that the multifilter LN-model framework is suboptimal for describing the behavior of complex cells: the context-model framework is clearly superior while still providing interpretable quantizations of neural behavior. NEW & NOTEWORTHY We used data from complex cells in primary visual cortex to estimate a wide variety of receptive field models from two frameworks that have previously not been compared with each other. The models included traditionally used multifilter linear-nonlinear models and novel variants of context models. Using mutual information and correlation coefficients as performance measures, we showed that context models are superior for describing complex cells and that the novel context models performed the best.

Inter-trial effects in visual pop-out search: Factorial comparison of Bayesian updating models

Many previous studies on visual search have reported inter-trial effects, that is, observers respond faster when some target property, such as a defining feature or dimension, or the response associated with the target repeats versus changes across consecutive trial episodes. However, what processes drive these inter-trial effects is still controversial. Here, we investigated this question using a combination of Bayesian modeling of belief updating and evidence accumulation modeling in perceptual decision-making. In three visual singleton ('pop-out') search experiments, we explored how the probability of the response-critical states of the search display (e.g., target presence/absence) and the repetition/switch of the target-defining dimension (color/ orientation) affect reaction time distributions. The results replicated the mean reaction time (RT) inter-trial and dimension repetition/switch effects that have been reported in previous studies. Going beyond this, to uncover the underlying mechanisms, we used the Drift-Diffusion Model (DDM) and the Linear Approach to Threshold with Ergodic Rate (LATER) model to explain the RT distributions in terms of decision bias (starting point) and information processing speed (evidence accumulation rate). We further investigated how these different aspects of the decision-making process are affected by different properties of stimulus history, giving rise to dissociable inter-trial effects. We approached this question by (i) combining each perceptual decision making model (DDM or LATER) with different updating models, each specifying a plausible rule for updating of either the starting point or the rate, based on stimulus history, and (ii) comparing every possible combination of trial-wise updating mechanism and perceptual decision model in a factorial model comparison. Consistently across experiments, we found that the (recent) history of the response-critical property influences the initial decision bias, while repetition/switch of the target-defining dimension affects the accumulation rate, likely reflecting an implicit 'top-down' modulation process. This provides strong evidence of a disassociation between response- and dimension-based inter-trial effects.

Auditory Attention Causes Gain Enhancement and Frequency Sharpening at Successive Stages of Cortical Processing-Evidence from Human Electroencephalography

Previous findings have suggested that auditory attention causes not only enhancement in neural processing gain, but also sharpening in neural frequency tuning in human auditory cortex. The current study was aimed to reexamine these findings. Specifically, we aimed to investigate whether attentional gain enhancement and frequency sharpening emerge at the same or different processing levels and whether they represent independent or cooperative effects. For that, we examined the pattern of attentional modulation effects on early, sensory-driven cortical auditory-evoked potentials occurring at different latencies. Attention was manipulated using a dichotic listening task and was thus not selectively directed to specific frequency values. Possible attention-related changes in frequency tuning selectivity were measured with an adaptation paradigm. Our results show marked disparities in attention effects between the earlier N1 deflection and the subsequent P2 deflection, with the N1 showing a strong gain enhancement effect, but no sharpening, and the P2 showing clear evidence of sharpening, but no independent gain effect. They suggest that gain enhancement and frequency sharpening represent successive stages of a cooperative attentional modulation mechanism that increases the representational bandwidth of attended versus unattended sounds.

Capturing contextual effects in spectro-temporal receptive fields

Spectro-temporal receptive fields (STRFs) are thought to provide descriptive images of the computations performed by neurons along the auditory pathway. However, their validity can be questioned because they rely on a set of assumptions that are probably not fulfilled by real neurons exhibiting contextual effects, that is, nonlinear interactions in the time or frequency dimension that cannot be described with a linear filter. We used a novel approach to investigate how a variety of contextual effects, due to facilitating nonlinear interactions and synaptic depression, affect different STRF models, and if these effects can be captured with a context field (CF). Contextual effects were incorporated in simulated networks of spiking neurons, allowing one to define the true STRFs of the neurons. This, in turn, made it possible to evaluate the performance of each STRF model by comparing the estimations with the true STRFs. We found that currently used STRF models are particularly poor at estimating inhibitory regions. Specifically, contextual effects make estimated STRFs dependent on stimulus density in a contrasting fashion: inhibitory regions are underestimated at lower densities while artificial inhibitory regions emerge at higher densities. The CF was found to provide a solution to this dilemma, but only when it is used together with a generalized linear model. Our results therefore highlight the limitations of the traditional STRF approach and provide useful recipes for how different STRF models and stimuli can be used to arrive at reliable quantifications of neural computations in the presence of contextual effects. The results therefore push the purpose of STRF analysis from simply finding an optimal stimulus toward describing context-dependent computations of neurons along the auditory pathway.

Neuron-specific stimulus masking reveals interference in spike timing at the cortical level

The auditory system is capable of robust recognition of sounds in the presence of competing maskers (e.g., other voices or background music). This capability arises despite the fact that masking stimuli can disrupt neural responses at the cortical level. Since the origins of such interference effects remain unknown, in this study, we work to identify and quantify neural interference effects that originate due to masking occurring within and outside receptive fields of neurons. We record from single and multi-unit auditory sites from field L, the auditory cortex homologue in zebra finches. We use a novel method called spike timing-based stimulus filtering that uses the measured response of each neuron to create an individualized stimulus set. In contrast to previous adaptive experimental approaches, which have typically focused on the average firing rate, this method uses the complete pattern of neural responses, including spike timing information, in the calculation of the receptive field. When we generate and present novel stimuli for each neuron that mask the regions within the receptive field, we find that the time-varying information in the neural responses is disrupted, degrading neural discrimination performance and decreasing spike timing reliability and sparseness. We also find that, while removing stimulus energy from frequency regions outside the receptive field does not significantly affect neural responses for many sites, adding a masker in these frequency regions can nonetheless have a significant impact on neural responses and discriminability without a significant change in the average firing rate. These findings suggest that maskers can interfere with neural responses by disrupting stimulus timing information with power either within or outside the receptive fields of neurons.

Forward suppression in the auditory cortex is frequency-specific

We investigated how physiologically observed forward suppression interacts with stimulus frequency in neuronal responses in the guinea pig auditory cortex. The temporal order and frequency proximity of sounds influence both their perception and neuronal responses. Psychophysically, preceding sounds (conditioners) can make successive sounds (probes) harder to hear. These effects are larger when the two sounds are spectrally similar. Physiological forward suppression is usually maximal for conditioner tones near to a unit's characteristic frequency (CF), the frequency to which a neuron is most sensitive. However, in most physiological studies, the frequency of the probe tone and CF are identical, so the role of unit CF and probe frequency cannot be distinguished. Here, we systemically varied the frequency of the probe tone, and found that the tuning of suppression was often more closely related to the frequency of the probe tone than to the unit's CF, i.e. suppressed tuning was specific to probe frequency. This relationship was maintained for all measured gaps between the conditioner and the probe tones. However, when the probe frequency and CF were similar, CF tended to determine suppressed tuning. In addition, the bandwidth of suppression was slightly wider for off-CF probes. Changes in tuning were also reflected in the firing rate in response to probe tones, which was maximally reduced when probe and conditioner tones were matched in frequency. These data are consistent with the idea that cortical neurons receive convergent inputs with a wide range of tuning properties that can adapt independently.

de Bruijn cycles for neural decoding

Stimulus counterbalance is critical for studies of neural habituation, bias, anticipation, and (more generally) the effect of stimulus history and context. We introduce de Bruijn cycles, a class of combinatorial objects, as the ideal source of pseudo-random stimulus sequences with arbitrary levels of counterbalance. Neuro-vascular imaging studies (such as BOLD fMRI) have an additional requirement imposed by the filtering and noise properties of the method: only some temporal frequencies of neural modulation are detectable. Extant methods of generating counterbalanced stimulus sequences yield neural modulations that are weakly (or not at all) detected by BOLD fMRI. We solve this limitation using a novel "path-guided" approach for the generation of de Bruijn cycles. The algorithm encodes a hypothesized neural modulation of specific temporal frequency within the seemingly random order of events. By positioning the modulation between the signal and noise bands of the neuro-vascular imaging method, the resulting sequence markedly improves detection power. These sequences may be used to study stimulus context and history effects in a manner not previously possible.

Facilitatory mechanisms shape selectivity for the rate and direction of FM sweeps in the inferior colliculus of the pallid bat

The inferior colliculus (IC) of the pallid bat has a large percentage of neurons that respond selectively to the rate and direction of the bat's echolocation pulse, a downward FM sweep. Three underlying mechanisms have been previously described. Here we describe a fourth mechanism, facilitation, that shapes selectivity for both sweep rate and direction. The neurons studied are termed FM specialists, because they do not respond to tones. Most were selective for the downward sweep direction, and this preference was expressed even when presented with narrowband, 1 kHz sweeps that crossed only a fraction of their excitatory receptive fields. This selectivity was also expressed in response to two tones delayed in time, termed two-tone facilitation (TTF). Direction-selective neurons showed a greatly facilitated response when a higher-frequency tone preceded a lower-frequency tone, simulating conditions in a downward sweep. The degree of temporal asymmetry in facilitation accurately predicted direction selectivity. When the spectral difference between the two tones was increased, the best delay also increased and could be used to predict a neuron's preferred sweep rate. To determine whether TTF alone created rate and direction selectivity, low- and high-frequency inhibitory sidebands, which can also shape selectivity, were eliminated from sweeps. In most cases, selectivity persisted. These results support the idea of spectral delay lines that produce an overlap and summation of excitatory inputs only when a dynamic stimulus traverses a receptive field in one direction at a specific velocity.