Spectro-temporal characteristics of single units in the auditory midbrain of the lightly anaesthetised grass frog (Rana temporaria L) investigated with noise stimuli

Differential effects of sound level and temporal structure of calls on phonotaxis by female gray treefrogs, Hyla versicolor

We investigated how communication distance influenced the efficacy of communication by studying the effects of two attributes of male chorus sounds, namely, reduction in sound level and degradation of temporal sound structure, on attraction and accuracy of female phonotaxis in gray treefrogs, Hyla versicolor. For this, we conducted acoustic playback experiments, using synthetic calls and natural calls recorded at increasing distances from a focal male as stimuli. We found that the degradation of temporal structure had a greater effect on signal attractiveness than did the reduction in sound level, and that increasing sound level preferentially affected the attractiveness of proximally recorded calls, with less temporal degradation. Unlike signal attraction, accuracy of female localization increased systematically with the sound level. These results suggest that the degradation of temporal fine structure from both the chorus and signal-environmental effects imposes a limit for effective communication distances for female treefrogs in nature.

The structure and timescales of heat perception in larval zebrafish

Avoiding temperatures outside the physiological range is critical for animal survival, but how temperature dynamics are transformed into behavioral output is largely not understood. Here, we used an infrared laser to challenge freely swimming larval zebrafish with "white-noise" heat stimuli and built quantitative models relating external sensory information and internal state to behavioral output. These models revealed that larval zebrafish integrate temperature information over a time-window of 400 ms preceding a swimbout and that swimming is suppressed right after the end of a bout. Our results suggest that larval zebrafish compute both an integral and a derivative across heat in time to guide their next movement. Our models put important constraints on the type of computations that occur in the nervous system and reveal principles of how somatosensory temperature information is processed to guide behavioral decisions such as sensitivity to both absolute levels and changes in stimulation.

The immediate effects of acoustic trauma on excitation and inhibition in the inferior colliculus: A Wiener-kernel analysis

Noise-induced tinnitus and hyperacusis are thought to correspond to a disrupted balance between excitation and inhibition in the central auditory system. Excitation and inhibition are often studied using pure tones; however, these responses do not reveal inhibition within the excitatory pass band. Therefore, we used a Wiener-kernel analysis, complemented with singular value decomposition (SVD), to investigate the immediate effects of acoustic trauma on excitation and inhibition in the inferior colliculus (IC). Neural responses were recorded from the IC of three anesthetized albino guinea pigs before and immediately after a one-hour bilateral exposure to an 11-kHz tone of 124 dB SPL. Neural activity was recorded during the presentation of a 1-h continuous 70 dB SPL Gaussian-noise stimulus. Spike trains were subjected to Wiener-kernel analysis in which the second-order kernel was decomposed into excitatory and inhibitory components using SVD. Hearing thresholds between 3 and 22 kHz were elevated (13-47 dB) immediately after acoustic trauma. The presence and frequency tuning of excitation and inhibition in units with a low characteristic frequency (CF; < 3 kHz) was not affected, inhibition disappeared whereas excitation was not affected in mid-CF units (3 < CF < 11 kHz), and both excitation and inhibition disappeared in high-CF units (CF > 11 kHz). This specific differentiation could not be identified by tone-evoked receptive-field analysis, in which inhibitory responses disappeared in all units, along with excitatory responses in high-CF units. This study is the first to apply Wiener-kernel analysis, complemented with SVD, to study the effects of acoustic trauma on spike trains derived from the IC. With this analysis, a reduction of inhibition and preservation of good response thresholds was shown in mid-CF units immediately after acoustic trauma. These neurons may mediate noise-induced tinnitus and/or hyperacusis. Moreover, an immediate profound high-frequency hearing loss was reflected by reduced evoked firing rates and loss of both excitation and inhibition in high-CF units.

Binaural gain modulation of spectrotemporal tuning in the interaural level difference-coding pathway

In the brainstem, the auditory system diverges into two pathways that process different sound localization cues, interaural time differences (ITDs) and level differences (ILDs). We investigated the site where ILD is detected in the auditory system of barn owls, the posterior part of the lateral lemniscus (LLDp). This structure is equivalent to the lateral superior olive in mammals. The LLDp is unique in that it is the first place of binaural convergence in the brainstem where monaural excitatory and inhibitory inputs converge. Using binaurally uncorrelated noise and a generalized linear model, we were able to estimate the spectrotemporal tuning of excitatory and inhibitory inputs to these cells. We show that the response of LLDp neurons is highly locked to the stimulus envelope. Our data demonstrate that spectrotemporally tuned, temporally delayed inhibition enhances the reliability of envelope locking by modulating the gain of LLDp neurons' responses. The dependence of gain modulation on ILD shown here constitutes a means for space-dependent coding of stimulus identity by the initial stages of the auditory pathway.

Modeling complex responses of FM-sensitive cells in the auditory midbrain using a committee machine

Frequency modulation (FM) is an important building block of complex sounds that include speech signals. Exploring the neural mechanisms of FM coding with computer modeling could help understand how speech sounds are processed in the brain. Here, we modeled the single unit responses of auditory neurons recorded from the midbrain of anesthetized rats. These neurons displayed spectral temporal receptive fields (STRFs) that had multiple-trigger features, and were more complex than those with single-trigger features. Their responses have not been modeled satisfactorily with simple artificial neural networks, unlike neurons with simple-trigger features. To improve model performance, here we tested an approach with the committee machine. For a given neuron, the peri-stimulus time histogram (PSTH) was first generated in response to a repeated random FM tone, and peaks in the PSTH were segregated into groups based on the similarity of their pre-spike FM trigger features. Each group was then modeled using an artificial neural network with simple architecture, and, when necessary, by increasing the number of neurons in the hidden layer. After initial training, the artificial neural networks with their optimized weighting coefficients were pooled into a committee machine for training. Finally, the model performance was tested by prediction of the response of the same cell to a novel FM tone. The results showed improvement over simple artificial neural networks, supporting that trigger-feature-based modeling can be extended to cells with complex responses. This article is part of a Special Issue entitled Neural Coding 2012. This article is part of a Special Issue entitled Neural Coding 2012.

Modeling frequency modulated responses of midbrain auditory neurons based on trigger features and artificial neural networks

Frequency modulation (FM) is an important building block of communication signals for animals and human. Attempts to predict the response of central neurons to FM sounds have not been very successful, though achieving successful results could bring insights regarding the underlying neural mechanisms. Here we proposed a new method to predict responses of FM-sensitive neurons in the auditory midbrain. First we recorded single unit responses in anesthetized rats using a random FM tone to construct their spectro-temporal receptive fields (STRFs). Training of neurons in the artificial neural network to respond to a second random FM tone was based on the temporal information derived from the STRF. Specifically, the time window covered by the presumed trigger feature and its delay time to spike occurrence were used to train a finite impulse response neural network (FIRNN) to respond to this random FM. Finally we tested the model performance in predicting the response to another similar FM stimuli (third random FM tone). We found good performance in predicting the time of responses if not also the response magnitudes. Furthermore, the weighting function of the FIRNN showed temporal 'bumps' suggesting temporal integration of synaptic inputs from different frequency laminae. This article is part of a Special Issue entitled: Neural Coding.

Subdivisions of the auditory midbrain (n. mesencephalicus lateralis, pars dorsalis) in zebra finches using calcium-binding protein immunocytochemistry

The midbrain nucleus mesencephalicus lateralis pars dorsalis (MLd) is thought to be the avian homologue of the central nucleus of the mammalian inferior colliculus. As such, it is a major relay in the ascending auditory pathway of all birds and in songbirds mediates the auditory feedback necessary for the learning and maintenance of song. To clarify the organization of MLd, we applied three calcium binding protein antibodies to tissue sections from the brains of adult male and female zebra finches. The staining patterns resulting from the application of parvalbumin, calbindin and calretinin antibodies differed from each other and in different parts of the nucleus. Parvalbumin-like immunoreactivity was distributed throughout the whole nucleus, as defined by the totality of the terminations of brainstem auditory afferents; in other words parvalbumin-like immunoreactivity defines the boundaries of MLd. Staining patterns of parvalbumin, calbindin and calretinin defined two regions of MLd: inner (MLd.I) and outer (MLd.O). MLd.O largely surrounds MLd.I and is distinct from the surrounding intercollicular nucleus. Unlike the case in some non-songbirds, however, the two MLd regions do not correspond to the terminal zones of the projections of the brainstem auditory nuclei angularis and laminaris, which have been found to overlap substantially throughout the nucleus in zebra finches.

Ultrasound-evoked immediate early gene expression in the brainstem of the Chinese torrent frog, Odorrana tormota

The concave-eared torrent frog, Odorrana tormota, has evolved the extraordinary ability to communicate ultrasonically (i.e., using frequencies > 20 kHz), and electrophysiological experiments have demonstrated that neurons in the frog’s midbrain (torus semicircularis) respond to frequencies up to 34 kHz. However, at this time, it is unclear which region(s) of the torus and what other brainstem nuclei are involved in the detection of ultrasound. To gain insight into the anatomical substrate of ultrasound detection, we mapped expression of the activity-dependent gene, egr-1, in the brain in response to a full-spectrum mating call, a filtered, ultrasound-only call, and no sound. We found that the ultrasound-only call elicited egr-1 expression in the superior olivary and principal nucleus of the torus semicircularis. In sampled areas of the principal nucleus, the ultrasound-only call tended to evoke higher egr-1 expression than the full-spectrum call and, in the center of the nucleus, induced significantly higher egr-1 levels than the no-sound control. In the superior olivary nucleus, the full-spectrum and ultrasound-only calls evoked similar levels of expression that were significantly greater than the control, and egr-1 induction in the laminar nucleus showed no evidence of acoustic modulation. These data suggest that the sampled areas of the principal nucleus are among the regions sensitive to ultrasound in this species.

Context dependence of spectro-temporal receptive fields with implications for neural coding

The spectro-temporal receptive field (STRF) is frequently used to characterize the linear frequency-time filter properties of the auditory system up to the neuron recorded from. STRFs are extremely stimulus dependent, reflecting the strong non-linearities in the auditory system. Changes in the STRF with stimulus type (tonal, noise-like, vocalizations), sound level and spectro-temporal sound density are reviewed here. Effects on STRF shape of task and attention are also briefly reviewed. Models to account for these changes, potential improvements to STRF analysis, and implications for neural coding are discussed.

Should spikes be treated with equal weightings in the generation of spectro-temporal receptive fields?

Knowledge on the trigger features of central auditory neurons is important in the understanding of speech processing. Spectro-temporal receptive fields (STRFs) obtained using random stimuli and spike-triggered averaging allow visualization of trigger features which often appear blurry in the time-versus-frequency plot. For a clearer visualization we have previously developed a dejittering algorithm to sharpen trigger features in the STRF of FM-sensitive cells. Here we extended this algorithm to segregate spikes, based on their dejitter values, into two groups: normal and outlying, and to construct their STRF separately. We found that while the STRF of the normal jitter group resembled full trigger feature in the original STRF, those of the outlying jitter group resembled a different or partial trigger feature. This algorithm allowed the extraction of other weaker trigger features. Due to the presence of different trigger features in a given cell, we proposed that in the generation of STRF, the evoked spikes should not be treated indiscriminately with equal weightings.

Temporal symmetry in primary auditory cortex: implications for cortical connectivity

Neurons in primary auditory cortex (AI) in the ferret (Mustela putorius) that are well described by their spectrotemporal response field (STRF) are found also to have a distinctive property that we call temporal symmetry. For temporally symmetric neurons, every temporal cross-section of the STRF (impulse response) is given by the same function of time, except for a scaling and a Hilbert rotation. This property held in 85% of neurons (123 out of 145) recorded from awake animals and in 96% of neurons (70 out of 73) recorded from anesthetized animals. This property of temporal symmetry is highly constraining for possible models of functional neural connectivity within and into AI. We find that the simplest models of functional thalamic input, from the ventral medial geniculate body (MGB), into the entry layers of AI are ruled out because they are incompatible with the constraints of the observed temporal symmetry. This is also the case for the simplest models of functional intracortical connectivity. Plausible models that do generate temporal symmetry, from both thalamic and intracortical inputs, are presented. In particular, we propose that two specific characteristics of the thalamocortical interface may be responsible. The first is a temporal mismatch between the fast dynamics of the thalamus and the slow responses of the cortex. The second is that all thalamic inputs into a cortical module (or a cluster of cells) must be restricted to one point of entry (or one cell in the cluster). This latter property implies a lack of correlated horizontal interactions across cortical modules during the STRF measurements. The implications of these insights in the auditory system, and comparisons with similar properties in the visual system, are explored.

Preservation of spectrotemporal tuning between the nucleus laminaris and the inferior colliculus of the barn owl

Performing sound recognition is a task that requires an encoding of the time-varying spectral structure of the auditory stimulus. Similarly, computation of the interaural time difference (ITD) requires knowledge of the precise timing of the stimulus. Consistent with this, low-level nuclei of birds and mammals implicated in ITD processing encode the ongoing phase of a stimulus. However, the brain areas that follow the binaural convergence for the computation of ITD show a reduced capacity for phase locking. In addition, we have shown that in the barn owl there is a pooling of ITD-responsive neurons to improve the reliability of ITD coding. Here we demonstrate that despite two stages of convergence and an effective loss of phase information, the auditory system of the anesthetized barn owl displays a graceful transition to an envelope coding that preserves the spectrotemporal information throughout the ITD pathway to the neurons of the core of the central nucleus of the inferior colliculus.

Tuning properties of turtle auditory nerve fibers: evidence for suppression and adaptation

Second-order reverse correlation (second-order Wiener-kernel analysis) was carried out between spike responses in single afferent units from the basilar papilla of the red-eared turtle and band limited white noise auditory stimuli. For units with best excitatory frequencies (BEFs) below approximately 500 Hz, the analysis revealed suppression similar to that observed previously in anuran amphibians. For units with higher BEFs, the analysis revealed dc response with narrow-band tuning centered about the BEF, combined with broad-band ac response at lower frequencies. For all units, the analysis revealed the relative timing and tuning of excitation and various forms of inhibitory or suppressive effects.

The contribution of spike threshold to acoustic feature selectivity, spike information content, and information throughput

Hypotheses of sensory coding range from the notion of nonlinear "feature detectors" to linear rate coding strategies. Here, we report that auditory neurons exhibit a novel trade-off in the relationship between sound selectivity and the information that can be communicated to a postsynaptic cell. Recordings from the cat inferior colliculus show that neurons with the lowest spike rates reliably signal the occurrence of stereotyped stimulus features, whereas those with high response rates exhibit lower selectivity. The highest information conveyed by individual action potentials comes from neurons with low spike rate and high selectivity. Surprisingly, spike information is inversely related to spike rates, following a trend similar to that of feature selectivity. Information per time interval, however, was proportional to measured spike rates. A neuronal model based on the spike threshold of the synaptic drive accurately accounts for this trade-off: higher thresholds enhance the spiking fidelity at the expense of limiting the total communicated information. Such a constraint on the specificity and throughput creates a continuum in the neural code with two extreme forms of information transfer that likely serve complementary roles in the representation of the auditory environment.

Stimulus-invariant processing and spectrotemporal reverse correlation in primary auditory cortex

The spectrotemporal receptive field (STRF) provides a versatile and integrated, spectral and temporal, functional characterization of single cells in primary auditory cortex (AI). In this paper, we explore the origin of, and relationship between, different ways of measuring and analyzing an STRF. We demonstrate that STRFs measured using a spectrotemporally diverse array of broadband stimuli-such as dynamic ripples, spectrotemporally white noise, and temporally orthogonal ripple combinations (TORCs)-are very similar, confirming earlier findings that the STRF is a robust linear descriptor of the cell. We also present a new deterministic analysis framework that employs the Fourier series to describe the spectrotemporal modulations contained in the stimuli and responses. Additional insights into the STRF measurements, including the nature and interpretation of measurement errors, is presented using the Fourier transform, coupled to singular-value decomposition (SVD), and variability analyses including bootstrap. The results promote the utility of the STRF as a core functional descriptor of neurons in AI.

New variation on the derivation of spectro-temporal receptive fields for primary auditory afferent axons

The spectro-temporal receptive field [Hear. Res 5 (1981) 147; IEEE Trans BME 15 (1993) 177] provides an explicit image of the spectral and temporal aspects of the responsiveness of a primary auditory afferent axon. It exhibits the net effects of the competition between excitatory and inhibitory (or suppressive) phenomena. In this paper, we introduce a method for derivation of the spectro-temporal receptive field directly from a second-order Wiener kernel (produced by second-order reverse correlation between spike responses and broad-band white-noise stimulus); and we expand the concept of the spectro-temporal receptive field by applying the new method not only to the second-order kernel itself, but also to its excitatory and inhibitory subkernels. This produces separate spectro-temporal images of the excitatory and inhibitory phenomena putatively underlying the competition. Applied, in simulations, to models with known underlying excitatory and suppressive tuning and timing properties, the method successfully extracted a faithful image of those properties for excitation and one for inhibition. Applied to three auditory axons from the frog, it produced images consistent with previously published physiology.

New variations on the derivation of spectro-temporal receptive fields for primary auditory afferent axons

The spectro-temporal receptive field [Hear. Res 5 (1981) 147; IEEE Trans BME 15 (1993) 177] provides an explicit image of the spectral and temporal aspects of the responsiveness of a primary auditory afferent axon. It exhibits the net effects of the competition between excitatory and inhibitory (or suppressive) phenomena. In this paper, we introduce a method for derivation of the spectro-temporal receptive field directly from a second-order Wiener kernel (produced by second-order reverse correlation between spike responses and broad-band white-noise stimulus); and we expand the concept of the spectro-temporal receptive field by applying the new method not only to the second-order kernel itself, but also to its excitatory and inhibitory subkernels. This produces separate spectro-temporal images of the excitatory and inhibitory phenomena putatively underlying the competition. Applied, in simulations, to models with known underlying excitatory and suppressive tuning and timing properties, the method successfully extracted a faithful image of those properties for excitation and one for inhibition. Applied to three auditory axons from the frog, it produced images consistent with previously published physiology.

Feature analysis of natural sounds in the songbird auditory forebrain

Although understanding the processing of natural sounds is an important goal in auditory neuroscience, relatively little is known about the neural coding of these sounds. Recently we demonstrated that the spectral temporal receptive field (STRF), a description of the stimulus-response function of auditory neurons, could be derived from responses to arbitrary ensembles of complex sounds including vocalizations. In this study, we use this method to investigate the auditory processing of natural sounds in the birdsong system. We obtain neural responses from several regions of the songbird auditory forebrain to a large ensemble of bird songs and use these data to calculate the STRFs, which are the best linear model of the spectral-temporal features of sound to which auditory neurons respond. We find that these neurons respond to a wide variety of features in songs ranging from simple tonal components to more complex spectral-temporal structures such as frequency sweeps and multi-peaked frequency stacks. We quantify spectral and temporal characteristics of these features by extracting several parameters from the STRFs. Moreover, we assess the linearity versus nonlinearity of encoding by quantifying the quality of the predictions of the neural responses to songs obtained using the STRFs. Our results reveal successively complex functional stages of song analysis by neurons in the auditory forebrain. When we map the properties of auditory forebrain neurons, as characterized by the STRF parameters, onto conventional anatomical subdivisions of the auditory forebrain, we find that although some properties are shared across different subregions, the distribution of several parameters is suggestive of hierarchical processing.

Between sound and perception: reviewing the search for a neural code

This review investigates the roles of representation, transformation and coding as part of a hierarchical process between sound and perception. This is followed by a survey of how speech sounds and elements thereof are represented in the activity patterns along the auditory pathway. Then the evidence for a place representation of texture features of sound, comprising frequency, periodicity pitch, harmonicity in vowels, and direction and speed of frequency modulation, and for a temporal and synchrony representation of sound contours, comprising onsets, offsets, voice onset time, and low rate amplitude modulation, in auditory cortex is reviewed. Contours mark changes and transitions in sound and auditory cortex appears particularly sensitive to these dynamic aspects of sound. Texture determines which neurons, both cortical and subcortical, are activated by the sound whereas the contours modulate the activity of those neurons. Because contours are temporally represented in the majority of neurons activated by the texture aspects of sound, each of these neurons is part of an ensemble formed by the combination of contour and texture sensitivity. A multiplexed coding of complex sound is proposed whereby the contours set up widespread synchrony across those neurons in all auditory cortical areas that are activated by the texture of sound.

Representation of temporal features of complex sounds by the discharge patterns of neurons in the owl's inferior colliculus

The spiking pattern evoked in cells of the owl's inferior colliculus by repeated presentation of the same broadband noise was found to be highly reproducible and synchronized with the temporal features of the noise stimulus. The pattern remained largely unchanged when the stimulus was presented from spatial loci that evoke similar average firing rates. To better understand this patterning, we computed the pre-event stimulus ensemble (PESE)-the average of the stimuli that preceded each spike. Computing the PESE by averaging the pressure waveforms produced a noisy, featureless trace, suggesting that the patterning was not synchronized to a particular waveform in the fine structure. By contrast, computing the PESE by averaging the stimulus envelope revealed an average envelope waveform, the "PESE envelope," typically having a peak preceded by a trough. Increasing the overall stimulus level produced PESE envelopes with higher amplitudes, suggesting a decrease in the jitter of the cell's response. The effect of carrier frequency on the PESE envelope was investigated by obtaining a cell's response to broadband noise and either estimating the PESE envelope for each spectral band or by computing a spectrogram of the stimulus prior to each spike. Either method yielded the cell's PESE spectrogram, a plot of the average amplitude of each carrier-frequency component at various pre-spike times. PESE spectrograms revealed surfaces with peaks and troughs at certain frequencies and pre-spike times. These features are collectively called the spectrotemporal receptive field (STRF). The shape of the STRF showed that in many cases, the carrier frequency can affect the PESE envelope. The modulation transfer function (MTF), which describes a cell's ability to respond to time-varying amplitudes, was estimated with sinusoidally amplitude-modulated (SAM) noises. Comparison of the PESE envelope with the MTF in the time and frequency domains showed that the two were closely matched, suggesting that a cell's response to SAM stimuli is largely predictable from its response to a noise-modulated carrier. The STRF is considered to be a model of the linear component of a system's response to dynamic stimuli. Using the STRF, we estimated the degree to which we could predict a cell's response to an arbitrary broadband noise by comparing the convolution of the STRF and the envelope of the noise with the cell's post-stimulus time histogram to the same noise. The STRF explained 18-46% of the variance of a cell's response to broadband noise.

Neural representation and the cortical code

The principle function of the central nervous system is to represent and transform information and thereby mediate appropriate decisions and behaviors. The cerebral cortex is one of the primary seats of the internal representations maintained and used in perception, memory, decision making, motor control, and subjective experience, but the basic coding scheme by which this information is carried and transformed by neurons is not yet fully understood. This article defines and reviews how information is represented in the firing rates and temporal patterns of populations of cortical neurons, with a particular emphasis on how this information mediates behavior and experience.

Robust spectrotemporal reverse correlation for the auditory system: optimizing stimulus design

The spectrotemporal receptive field (STRF) is a functional descriptor of the linear processing of time-varying acoustic spectra by the auditory system. By cross-correlating sustained neuronal activity with the dynamic spectrum of a spectrotemporally rich stimulus ensemble, one obtains an estimate of the STRF. In this article, the relationship between the spectrotemporal structure of any given stimulus and the quality of the STRF estimate is explored and exploited. Invoking the Fourier theorem, arbitrary dynamic spectra are described as sums of basic sinusoidal components--that is, moving ripples. Accurate estimation is found to be especially reliant on the prominence of components whose spectral and temporal characteristics are of relevance to the auditory locus under study and is sensitive to the phase relationships between components with identical temporal signatures. These and other observations have guided the development and use of stimuli with deterministic dynamic spectra composed of the superposition of many temporally orthogonal moving ripples having a restricted, relevant range of spectral scales and temporal rates. The method, termed sum-of-ripples, is similar in spirit to the white-noise approach but enjoys the same practical advantages--which equate to faster and more accurate estimation--attributable to the time-domain sum-of-sinusoids method previously employed in vision research. Application of the method is exemplified with both modeled data and experimental data from ferret primary auditory cortex (AI).

Multi-unit recording from regenerated bullfrog eighth nerve using implantable silicon-substrate microelectrodes

Multi-microelectrode silicon devices were developed for extracellular recording from multiple axons in regenerated eighth cranial nerves of American bullfrogs. Each includes a photolithographically defined array of holes and adjacent metal microelectrodes. A device is implanted within a transected eighth nerve; regenerating fibers grow through the holes en route to the brainstem. Multiple spike trains were recorded from two animals at up to 21 weeks after implantation. Single units were tracked for over 8 h. Some responded to sound with tuning typical of fibers innervating the amphibian and basilar papillae. Units of vestibular origin also were recorded. Action potentials were 30-140 microV P-P amid noise of 5 10 microV RMS, an adequate signal-to-noise ratio for spike detection and sorting. Histology confirmed that bundles of myelinated fibers grew through holes near electrodes that recorded activity. The implantation success rate was low, due to surgical morbidity, device extrusion, and lack of nerve regeneration through some devices. Future designs will address these issues and incorporate transistor amplifiers on devices to increase signal-to-noise ratios. The potential of implanted silicon devices to simultaneously record from many axons offers an opportunity for multicellular studies of auditor, vestibular and seismic signal processing in the vertebrate inner ear.

Responses of inferior colliculus neurons in C57BL/6J mice with and without sensorineural hearing loss: effects of changing the azimuthal location of a continuous noise masker on responses to contralateral tones

Extracellular recordings were obtained from inferior colliculus neurons of young adult (2-month-old) C57 mice with normal hearing and middle-aged (6-month-old) C57 mice with sensorineural hearing loss as they responded to best frequency (BF) tones (signal) in the presence of a continuous background noise (masker). Rate/level functions were obtained for the signal alone, noise bursts alone, and the signal in continuous noise as a function of masker location. For both groups of mice, thresholds for BF tones were significantly elevated in the presence of noise at all three noise locations. Separating the signal and masker sources significantly improved masked tone thresholds of 2-month-old mice but not hearing-impaired mice. The decreased ability of middle-aged mice to benefit from separation of the signal and masker sources may reflect alterations in binaural processing as a result of sensorineural hearing loss.

Wiener and Volterra analyses applied to the auditory system

The application of a particular branch of non-linear system analysis, the functional series expansion or integral method, to the auditory system is reviewed. Both the Volterra and Wiener approach are discussed and an extension of the Wiener method from its traditional white-noise stimulus approach to that of Poisson distributed clicks is presented. This type of analysis has been applied to compound and single-unit responses from the auditory nerve, cochlear nucleus, auditory midbrain and medial geniculate body. Most studies have estimated only first-order Wiener kernels but in recent years second-order Wiener and Volterra kernels have been estimated, particularly with reference to dynamic non-linearities. A particular form of second-order analysis, the Spectro Temporal Receptive Field, offers an alternative to first-order cross-correlation when phase-lock is absent. The correlation method has revealed that neural synchronization is less affected by intensity changes and damage to the hair cells than is neural firing rate. Although the presence of the static cochlear non-linearity could be demonstrated on the basis of the intensity dependence of the first-order Wiener kernel, the identification of the exact form of the nonlinearity of the peripheral auditory system on basis of higher-order Wiener kernels has so far been inconclusive. However, successes of the method can be found in the description of the dynamic non-linearities and non-linear neural interactions.

A spectrotemporal analysis of DCN single unit responses to wideband noise in guinea pig

Spectrotemporal receptive fields (STRFs) were estimated for chopper and pauser units recorded in guinea pig dorsal cochlear nucleus (DCN). Sixteen wideband, periodic noise stimuli, represented as time-frequency surfaces of energy density, were cross correlated in time with the unit's corresponding period histograms to determine if specific energy patterns tended to precede spike occurrence. The STRFs obtained were unique to the DCN, as compared to the ventral cochlear nucleus (VCN) [Clopton and Backoff, 1991, Hear. Res. 52, 329-344] in their degree of temporal and spectral complexity. Certain unit response types, classified from their peristimulus-time histograms (PSTHs) to tonebursts, were associated with distinctive patterns in the STRFs. All STRFs had at least one region of elevated energy density (peak region) closely preceding spike occurrence, which may reflect a short-pathway, primary excitatory input (or inputs) to the neuron. In addition, some units displayed low-energy regions (troughs) with greater temporal precedences on their STRFs, particularly when higher stimulus intensities were used. This analysis approach appears to have potential for investigating functional neural connectivity and predicting responses to novel complex stimuli, although specific implementations of the technique impose limitations on the interpretation of results.

Spectrotemporal receptive fields of neurons in cochlear nucleus of guinea pig

Spectrotemporal receptive fields (STRFs) [Hermes et al., Hear. Res. 5, 147-178, 1981] for neurons in the cochlear nuclei (CN) of guinea pig were estimated. Sixteen periodic segments of bandlimited, synthesized noise evoked replicable, distinctive period histograms for spike discharges. All driven units in the major divisions of the CN having their characteristic frequency (CF) within the noise bandlimits had unique STRFs for a given intensity of noise stimulation. The STRF maximum corresponded to the unit's CF, and details of the STRF patterns differed over CN divisions and response classes derived from tonebursts. The sizes of features in STRFs from this mammal appeared significantly smaller in their temporal and spectral extents than those reported in the torus semicircularis of an amphibian and were roughly comparable to the few units reported from cat ventral CN [Eggermont et al., Quart. Rev. Biophys. 16, 341-414, 1983]. STRFs, as they are presently obtained, provide useful insight into some aspects of afferent processing and perhaps connectivity, but their interpretation is specific to the level of stimulation and limited by the need to choose a specific energy distribution to represent the stimulus.

A combined sensitivity for frequency and interaural intensity difference in neurons in the auditory midbrain of the grassfrog

The relation between spectral tuning and sensitivity for interaural intensity difference (IID) was studied for single units in the auditory midbrain of the grassfrog. The stimuli consisted of sequences of pure tones of different frequency and interaural intensity differences presented by means of a closed sound system. At best excitatory frequency, three types of binaural interaction were observed: E0 (one ear excitatory 23%), EE (both ears excitatory 9%) and EI (one ear excitatory, the other inhibitory 67%). For a considerable number of units different types of binaural interaction were observed for different stimulus frequencies. More than 30% of the binaural units had multiple excitatory and inhibitory regions in their spectrotemporal selectivity. E0 and EI units had uniformly distributed best frequencies, EE units generally had best frequencies near 1.0 kHz. The E0 and EE categories had response latencies less than about 70 ms whereas EI units could have longer latencies. Most EE and all EI category units had sigmoidally shaped IID-rate curves. About 40% of the units had a combined sensitivity for sound spectrum and IID which was invariant to overall stimulus intensity. For nearly all EI units the inhibitory influence of the ipsilateral ear was confined to frequencies in the 0.4-1.6 kHz range and was not correlated with a unit's best frequency. By means of a simple additive model we demonstrated that determination of sound source laterality can be achieved by ensemble coding in the auditory midbrain.

Sensitivity of neurons in the dorsal medullary nucleus of the grassfrog to spectral and temporal characteristics of sound

The responses of 58 dorsal medullary nucleus units to a set of spectrally and temporally structured stimuli were investigated. Responses to tonepips and noise indicated monomodal spectral sensitivities, with diverse response patterns. Phase-locking was strong for frequencies from 0.1 to 0.2 kHz, and in one unit extended up to 0.6 kHz. To clicks, amplitude modulated tonebursts and natural and artificial versions of the mating call various responses were found. Most low-frequency units fired tonically. They showed a non-selective or low-pass rate response to increasing modulation frequency, and a low-pass synchronization behavior to the envelope. A group of mid-frequency units fired phasically and exhibited a band-pass rate characteristic of amplitude modulated tonebursts. Frequently this was combined with a low-pass rate characteristic of click trains. These units hardly responded to the time-reversed mating call, but fired in a time-locked fashion to the pulses of the original mating call, up to a signal-to-noise ratio of 0 dB. This suggests that aspects of pulse envelope and interpulse interval are coded in the dorsal medullary nucleus.

Sensitivity of neurons in the auditory midbrain of the grassfrog to temporal characteristics of sound. I. Stimulation with acoustic clicks

The coding of fine-temporal structure of sound, especially pulse repetition rate, was investigated on the single-unit level in the auditory midbrain of the grassfrog. As stimuli periodic click trains and Poisson distributed click ensembles have been used. The response to periodic click trains was studied in two aspects, focussing on two types of possible codes: a rate code and a synchrony code. From the iso-intensity rate histogram five basic average response rate characteristics as function of pulse repetition rate have been established: low-pass, band-pass, high-pass, bimodal and non-selective unit types. The synchronization capability, expressed in a synchronization index, was for a small majority of units non-significant and a low-pass function of pulse repetition rate for most of the other units. The rate code showed the largest diversity of response types and an enhanced selectivity to pulse repetition rate. The stimulus-response relation to Poisson distributed click ensembles was investigated by a non-linear system theoretical approach. On the basis of first- and second-order Poisson kernels possible neural mechanisms accounting for temporal selectivity were determined. A considerable fraction of units exhibited response characteristics that were invariant to changes in sound pressure level and average click rate. These units may function as feature detectors of fine-temporal structure of sound. The spectro-temporal sensitivity range of the auditory midbrain of the grassfrog appeared to be broad and not particularly tuned to the ensemble of conspecific cells.

Sensitivity of neurons in the auditory midbrain of the grassfrog to temporal characteristics of sound. II. Stimulation with amplitude modulated sound

The coding of fine-temporal structure of sound, especially of frequency of amplitude modulation, was investigated on the single-unit level in the auditory midbrain of the grassfrog. As stimuli sinusoidally amplitude modulated sound bursts and continuous sound with low-pass Gaussian noise amplitude modulation have been used. Both tonal and wideband noise carriers have been applied. The response to sinusoidally amplitude modulated sound bursts was studied in two aspects focussing on two types of possible codes: a rate code and a synchrony code. From the iso-intensity rate histogram five basic average response characteristics as function of modulation frequency have been observed: low-pass, band-pass, high-pass, bimodal and non-selective types. The synchronization capability, expressed in a synchronization index, was non-significant for 38% of the units and a low-pass function of modulation frequency for most of the other units. The stimulus-response relation to noise amplitude modulated sound was investigated by a non-linear system theoretical approach. On the basis of first- and second-order Wiener-Volterra kernels possible neural mechanisms accounting for temporal selectivity were obtained. About one quarter of the units had response characteristics that were invariant to changes in sound pressure level and spectral content of the carrier. These units may function as feature detectors of fine-temporal structure of sound. The spectro-temporal sensitivity range of the auditory midbrain of the grassfrog appeared not to be restricted to and showed no preference for the spectro-temporal characteristics of the ensemble of conspecific calls. Comparison of response characteristics to periodic click trains as studied in the companion paper (Epping and Eggermont, 1986) and sinusoidally amplitude modulated sound bursts revealed that the observed temporal sensitivity is due to a combination of sensitivities to sound periodicity and pulse duration. It was found that for most units the first-order kernels for Gaussian amplitude modulated stimuli and Poisson distributed click stimuli were alike. In contrast second-order kernels for the Gaussian amplitude modulated stimuli often represented only static non-linearities, while second-order kernels for Poisson distributed clicks (Epping and Eggermont, 1986) mostly revealed dynamic non-linearities.

Directional hearing in the grassfrog (Rana temporaria L.). II. Acoustics and modelling of the auditory periphery

In an earlier paper (Vlaming et al., 1984) we reported on optical measurements (laser-doppler interferometry) of the vibrations characteristics of the grassfrog's tympanic membrane. In the present paper these measurements were extended to include acoustic measurements concerning the functional role of the mouth cavity in frog hearing. Based on these measurements a model of the frog's acoustic periphery, consisting of three coupled linear oscillators with three entrance ports for sound, was developed and analyzed mathematically to give the various relevant transfer functions. The model is characterized by six parameters, all of which could be estimated from the available experimental data. For frequencies up to some 1500 Hz the model adequately describes the experimental data, both our own and earlier, seemingly conflicting data in the literature. For higher frequencies deviations occur, possibly due to nonuniform vibrations of the membranes. The model was used to evaluate the monaural directional sensitivity of the frog under free-field stimulation. Essentially it behaves as a combined pressure-gradient receiver, with highly frequency-dependent directional sensitivity. Directional sensitivity of the tympanic membrane could be modulated drastically by changing the resonance properties of the mouth cavity, without affecting the intrinsic membrane properties. This, theoretically, allows the frog to manipulate its direction sensitivity by actively tuning the volume of its mouth cavity. In order to account for discrepancies with known properties of low-frequency auditory nerve fibers an additional, extra-tympanic channel was included into the model. The extended model, the second-channel possibly involving the opercularis complex, provides a good quantitative fit to the available data on tympanic membrane movement as well as auditory nerve activity. Finally, the model enables to simulate a (moving) sound source in space, while stimulating the frog via closed couplers.

Single-unit characteristics in the auditory midbrain of the immobilized grassfrog

The anuran auditory midbrain of the grassfrog (Rana temporaria L.) was studied by a combined spectro-temporal analysis of sound preceding neural events. From the spectro-temporal sensitivities (STS) estimates of best frequencies (BF) and latencies (LT) were derived. Several types of STSs were observed: monomodal excitatory STSs comprised about half of the cases. Bimodal excitatory STSs, i.e. STSs with two discrete excitation regions, were observed in about 25%. Trimodal and broadly tuned STSs comprised about 5%. The remaining 20% of the STSs were characterized by inhibitory phenomena such as pure inhibition, sideband inhibition and post-activation inhibition. The distribution of best frequencies matches the frequency spectrum of the animal's vocalizations. A relative absence of monomodal units was noted in the mid frequency range. The distribution of latencies was bimodal over the range 7-108 ms. For each unit 6 functional parameters were determined; besides BF and LT these were: form of the STS (i.e. monomodality versus multimodality), spontaneous activity, binaural interaction, and firing mode (i.e. sustained versus transient) upon continuous noises stimulation. In addition, two structural parameters were considered: location in the torus and action potential waveform. Large correlations appeared between LT and action potential waveform, and between BF and binaural interaction type. Tonotopy was not found. A comparison was made between results from this study with a previous study on lightly anesthetized grassfrogs, using the same stimulus paradigms (D.J. Hermes et al. (1981): Hearing Res. 5, 147-178; D.J. Hermes et al. (1982): Hearing Res. 6, 103-126). Spontaneous activity, inhibitory phenomena and complex STSs were common using immobilization, whereas these have hardly been observed using anesthesia. Furthermore, interdependencies between the neural characteristics are substantially weaker for the immobilized preparation.

Relation of binaural interaction and spectro-temporal characteristics in the auditory midbrain of the grassfrog

The relation between binaural interaction type and spectro-temporal characteristics was studied for single units in the auditory midbrain of the grassfrog. Tonal and continuous wideband noise ensembles have been used as stimuli. Spectro-temporal sensitivities were determined for ipsi-, contra- and bilateral stimulus presentation by a closed sound system. Binaural interaction was classified in monaural EO (one ear excitatory), binaural EE (both ears excitatory) and EI (one ear excitatory, the other inhibitory) and purely inhibitory categories. Binaural interaction appeared to be rather invariant to alterations in stimulus intensity and type. A very clear correlation was observed between best frequency and binaural interaction type: EE units are predominantly of high best frequency, whereas EI units are predominantly of low best frequency. The correlation with latency was less significant: EE units tended to have somewhat shorter latencies that EI units. EO units take an intermediate position. Comparisons of ipsi-, contra- and bilateral spectro-temporal sensitivities, revealed differences in best frequency, latency and temporal discharge pattern. In some units a complex interplay of excitatory and inhibitory monaural influences was demonstrated. A number of units was recorded, which were characterized by multiple activation or suppression areas. The majority of these units exhibited frequency-dependent binaural interaction types. In some units it was noticed that binaural interaction type can be dependent on state of adaptation. A comparison of binaural interaction types of neighbouring units provided only weak evidence for a binaural organization in the anuran auditory midbrain, since simultaneously recorded pairs shared the same binaural interaction type only slightly more than expected by mere chance (chi 2-test, P less than 0.10).

Auditory responses in the torus semicircularis of the cane toad, Bufo marinus. II. Single unit studies

The responses of single units to brief tone bursts presented in the free field have been recorded in the torus semicircularis of the toad, Bufo marinus. The characteristic frequencies of the units fell into three main groups. The peri stimulus time histograms (p.s.t.h.s) for units in the torus showed a variety of forms but most histograms had a peak near the beginning of the response. The latencies of these peaks varied between 10 and 90 ms after the onset of the stimulus. As the intensity of a stimulus at the characteristic frequency was increased, the number of spikes elicited increased and the latency of the first peak in the p.s.t.h. decreased. All units that exhibited a high sensitivity to changes in stimulus intensity had characteristic frequencies in the low region of the auditory range and relatively long latencies. The number of spikes elicited and the latencies of the responses also varied as the location of the stimulus was changed. For those units whose spike output was highly sensitive to stimulus direction, the latency of the response was longer and showed greater variation with stimulus direction than the less sensitive units. The characteristic frequencies of the more highly sensitive units were also restricted to the low region of the auditory range. The properties of units with a high sensitivity to stimulus intensity were similar to the properties of units that were highly sensitive to stimulus direction. The difference between these properties and those of units with lower sensitivity to stimulus intensity and direction suggests that the auditory system in the brainstem of anura may be composed of at least two functionally distinct pathways. One of these pathways probably involves a more complex neuronal integration of the afferent input following low frequency stimulation.

Directional hearing in the grass frog (Rana temporaria L.): I. Mechanical vibrations of tympanic membrane

The vibration characteristics (amplitude and phase as a function of frequency) of the tympanic membrane in the grass frog were measured using a laser-doppler velocity meter. It was tested to what extent the frog's acoustic system behaves as a pressure gradient receiver. This might clarify how the frog localizes sound. Using a closed sound system the membrane was stimulated at three different entrances: in front of the membrane, at the contralateral ear and from inside the mouth. A combination of these can describe the motion of the membrane under free field conditions. It is found that the sound entrance from inside the mouth will give almost identical vibration characteristics as stimulation in front of the membrane. This can yield a perfect gradient receiver mechanism, when the frog opens its mouth. It is doubted however whether the frog in nature needs to open its mouth for localization of sound. With mouth closed the effectiveness of the gradient receiver will be determined by the transmission characteristics of sound across the tissues of the mouth. The entrance of sound via the contralateral ear is only effective at frequencies between 800 and 1600 Hz. At those frequencies crosstalk between the membranes is however not more than -4 to -8 dB. This is subject to changes in the acoustic properties of the mouth cavity and can possibly be altered by the frog in free nature.

Reverse-correlation methods in auditory research

Single unit recordings have provided us with a basis for understanding the auditory system, especially about how it behaves under stimulation with simple sounds such as clicks and tones. The experimental as well as the theoretical approach to single unit studies has been dichotomous. One approach, the more familiar, gives a representation of nervous system activity in the form of peri-stimulus-time (PST) histograms, period histograms, iso-intensity rate curves and frequency tuning curves. This approach observes the neural output of units in the various nuclei in the auditory nervous system, and, faced with the random way in which the neurons respond to sound, proceeds by repeatedly presenting the same stimulus in order to obtain averaged results. These are the various histogram procedures (Gerstein & Kiang, 1960; Kiang et al. 1965).

Quantitative characterisation procedure for auditory neurons based on the spectro-temporal receptive field

Studies dealing with auditory information processing often present the dynamic spectrum of the sound stimulus (sonogram) in addition to the stimulus waveform. The sonogram, presenting the spectral and temporal properties of the sound in a combined way, reflects properties that are assumed relevant in central information processing. For 12 neurons recorded from the midbrain of the grass frog the sonogram of a Gaussian wide-band noise stimulus was correlated with the output of the neuron to that noise. From this input-output correlogram the spectro-temporal receptive field (STRF) was calculated. The STRF reflects those spectral and temporal properties of the stimulus that influence the firing probability of the neuron. A quantitative procedure was developed to calculate the neuron's response as far as it could be derived from the STRF. This procedure basically consisted of a convolution between STRF and the sonogram of the stimulus followed by a summation over the various frequency bands. In this way it proved possible to estimate to what extent the STRF characterised the neuron's firing behaviour. Heuristic approaches, in which the neuron was modelled to a parallel series of band-pass filters, a summator and a static nonlinearity, representing a spike-generating mechanism, resulted in a considerable improvement of the characterisation.

Prediction of the responses of auditory neurons in the midbrain of the grass frog based on the spectro-temporal receptive field

The spectro-temporal receptive field (STRF) of an auditory neuron represents those characteristics of the sound stimulus in both the time and frequency domain that affect the firing probability of the neuron. The STRF is determined under stationary stimulus conditions for Gaussian wide-band noise. It has been demonstrated that for some neurons the response to that noise could to a considerable extent be derived from the STRF. In the present study the usefulness of the STRF is tested to predict responses to other stimuli such as noise with different frequency content and to species-specific vocalisations. It appears that the predicted response to vocalisations is at best in qualitative agreement with the actual response.

Tonotopic organisation of the auditory midbrain nuclei of the midwife toad (Alytes obstetricans)

The torus semicircularis (TS) of Alytes obstetricans is tonotopically organized. A stereotactic system was used to obtain isointensity responses with a few-units recording method; at each recording site the dominant frequency (that eliciting maximal discharge) was noted. Neurons activated by acoustic stimuli were found in the laminar, principal and magnocellular nuclei; they were rare in the commissural nucleus, and in the subependymal nucleus no stimulus-correlated responses were recorded. High-frequency dominance (greater than or equal to 900 Hz) was found only in a particular region of the torus, extending from caudomedial to rostrolateral, and it was restricted to ventral sites in the caudal and lateral parts of this region. In a few of the more rostral penetrations high-frequency dominance was found at dorsal as well as ventral positions. In a rostromedial area high-frequency neurons predominated over the entire dorsoventral extent of the torus, and in a caudolateral area low-frequency (less than 500 Hz) neurons were similarly distributed. The maximal discharge elicited by high tones proved, almost without exception, to derive from neurons of the laminar and magnocellular nuclei. Low-frequency dominance was found at some positions in these nuclei as well as in the principal and commissural nuclei.

Stimulus dependent neural correlations in the auditory midbrain of the grassfrog (Rana temporaria L.)

Few-unit recordings were obtained using metal microelectrodes. Separation into single-unit spike trains was based on differences in spike amplitude and spike waveform. For that purpose a hardware microprocessor based spike waveform analyser was designed and built. Spikes are filtered by four matched filters and filter outputs at the moments of spike occurrence are read by a computer and used for off-line separation and spike waveform reconstruction. Thirty-one double unit recordings were obtained and correlation between the separated spike trains was determined. After stimulus correction correlation remained in only 8 of the double unit records. It appeared that in most cases this neural correlation was stimulus dependent. Continuous noise stimulation resulted in the strongest neural correlation remaining after correction for stimulus coupling, stimulation with 48 ms duration tonepips presented once per second generally did not result in a significant neural correlation after the correction procedure for stimulus lock. The usefulness of the additive model for neural correlation and the correction procedure based thereupon is discussed.

Statistical and dimensional analysis of the neural representation of the acoustic biotope of the frog

The field of investigation is the neural representation of acoustic stimuli occurring in the natural environment of the frog. The point of departure is the description of a stimulus ensemble consisting of natural sounds: the acoustic biotope. A relation of statistical and dimensional structure of the acoustic biotope is indicated. The animal used in the neurophysiological experiments is the grass frog, Rana temporaria L.; microelectrode recordings are made in the auditory midbrain. A method is described to determine the existence of a relation between acoustic stimulus and neural events. The form of this relation has been investigated by first- and second-order stimulus-event correlation. While the first one does not give significant results, the second one leads to the spectrotemporal receptive field of the neuron for natural stimuli. Questions are formulated to estimate the value of this receptive field as a functional descriptor of the neuron. Finally, an outline is sketched for a synthetic construction of the bioacoustic space from neuroacoustic subspaces.

Spectro-temporal characteristics of single units in the auditory midbrain of the lightly anaesthetised grass frog (Rana temporaria L.) investigated with tonal stimuli

Responses were obtained from 112 auditory neurons in the midbrain of the grass frog in response to sequences of tones. Their spectro-temporal sensitivities (STS) were determined by a second-order cross-correlation technique. For the majority of units the shape of their action potentials, the degree of timelock to the stimulus and the recording sites were obtained. Two stages of information processing could be distinguished. One was characterized by short latencies (less than 30 ms), strong timelock to the stimulus and many of these units had axon-like action potential waveforms. They were localised in the ventral part of the principal nucleus from the torus semicircularis and in the transition region between laminar and principal nucleus. The other stage comprised units, found all over the torus, with longer latencies, and a weaker timelock to the stimulus. Several units which were predominantly found in the central part of the torus, especially the magnocellular nucleus, showed a broad or multiple STS. Within the principal nucleus a weak tonotopy was found, the dorsoposterior part being sensitive to lower frequencies, the ventroanterior part to the higher frequencies. Binaural-interaction properties are discussed with respect to the eardrum coupling through the mouth cavity. An organisational plan for the torus semicircularis is proposed.

The phonochrome: a coherent spectro-temporal representation of sound

Representation of simple stationary sounds can be given either in the temporal form by display of the waveform as function of time or in the spectral form by intensity and phase as function of frequency. For complex nonstationary sounds, e.g. animal vocalisations and human speech, a combined spectro-temporal representation is more directly associated with auditory perception. The well-known sonogram or dynamic power spectrum has a fixed spectro-temporal resolution and neglects phase relations of different spectral and temporal sound components. In this paper the complex spectro-temporal intensity density CoSTID) is presented as a coherent spectro-temporal image of a sound, based on the analytic signal representation. The CoSTID allows an arbitrary form of the spectro-temporal resolution and preserves phase relations of different sound components. Since the CoSTID is a complex function of two variables, it leads naturally to the use of colour images for the spectro-temporal representation of sound: the phonochrome. The phonochromes are shown for different technical and natural sounds. Applications of this technique for study of phonation and audition and for biomedical signal processing are indicated.

Spectro-temporal characterization of auditory neurons: redundant or necessary

For neurons in the auditory midbrain of the grass frog the use of a combined spectro-temporal characterization has been evaluated against the separate characterizations of frequency-sensitivity and temporal response properties. By factoring the joint density function of stimulus intensity, I (f, t), preceding a spike, into two marginal density functions I1(f) and I2(t) one may under the assumption of statistical independence reconstruct the joint density by multiplication: I1(f).I2(t). The reconstructed I(f, t) is compared to the original I(f, t) for 83 neurons: in 23% thereof the I(f, t) appeared to be vastly different from I(f, t). These units appeared to be located dominantly in the ventral parts of the auditory midbrain and had a latency exceeding 30 ms. On the basis of the action-potential wave forms the absence of non-separable I(f, t) in the incoming nerve fiber population is concluded. A spectro-temporal characterization of auditory neurons seems mandatory for investigations in and central from the auditory midbrain.

A comparison of the spectro-temporal sensitivity of auditory neurons to tonal and natural stimuli

The spectro-temporal sensitivity of auditory neurons has been investigated experimentally by averaging the spectrograms of stimuli preceding the occurrence of action potentials or neural events ( the APES : Aertsen et al., 1980, 1981). The properties of the stimulus ensemble are contained in this measure of neural selectivity. The spectro-temporal receptive field (STRF) has been proposed as a theoretical concept which should give a stimulus-invariant representation of the second order characteristics of the neuron's system function (Aertsen and Johannesma, 1981). The present paper investigates the relation between the experimental and the theoretical description of the neuron's spectro-temporal sensitivity for sound. The aim is to derive a formally based stimulus-normalization procedure for the results of the experimental averaging procedure. Under particular assumptions, regarding both the neuron and the stimulus ensemble, an integral equation connecting the APES and the STRF is derived. This integral expression enables to calculate the APES from the STRF by taking into account the stimulus spectral composition and the characteristics of the spectrogram analysis. The inverse relation, i.e. starting from the experimental results and by application of a formal normalization procedure arriving at the theoretical STRF, is effectively hindered by the nature of the spectrogram analysis. An approximative "normalization" procedure, based on intuitive manipulation of the integral equation, has been applied to a number of single unit recordings from the grassfrog's auditory midbrain area to tonal and natural stimulus ensembles. The results indicate tha spectrogram analysis, while being a useful real-time tool in investigating the spectro-temporal transfer properties of auditory neurons, shows fundamental shortcomings for a theoretical treatment of the questions of interest.

The spectro-temporal receptive field. A functional characteristic of auditory neurons

The Spectro-Temporal Receptive Field (STRF) of an auditory neuron has been introduced experimentally on the base of the average spectro-temporal structure of the acoustic stimuli which precede the occurrence of action potentials (Aertsen et al., 1980, 1981). In the present paper the STRF is considered in the general framework of nonlinear system theory, especially in the form of the Volterra integral representation. The STRF is proposed to be formally identified with a linear functional of the second order Volterra kernel. The experimental determination of the STRF leads to a formulation in terms of the Wiener expansion where the kernels can be identified by evaluation of the system's input-output correlations. For a Gaussian stimulus ensemble and a nonlinear system with no even order contributions of order higher than two, it is shown that the second order cross correlation of stimulus and response, normalized with respect to the spectral contents of the stimulus ensemble, leads to the stimulus-invariant spectro-temporal receptive field. The investigation of stimulus-invariance of the STRF for more general nonlinear systems and for stimulus ensembles which can be generated by nonlinear transformations of Gaussian noise involve the evaluation of higher order stimulus-response correlation functions.