A New Approach to Model Pitch Perception Using Sparse Coding

Deep neural network models reveal interplay of peripheral coding and stimulus statistics in pitch perception

Perception is thought to be shaped by the environments for which organisms are optimized. These influences are difficult to test in biological organisms but may be revealed by machine perceptual systems optimized under different conditions. We investigated environmental and physiological influences on pitch perception, whose properties are commonly linked to peripheral neural coding limits. We first trained artificial neural networks to estimate fundamental frequency from biologically faithful cochlear representations of natural sounds. The best-performing networks replicated many characteristics of human pitch judgments. To probe the origins of these characteristics, we then optimized networks given altered cochleae or sound statistics. Human-like behavior emerged only when cochleae had high temporal fidelity and when models were optimized for naturalistic sounds. The results suggest pitch perception is critically shaped by the constraints of natural environments in addition to those of the cochlea, illustrating the use of artificial neural networks to reveal underpinnings of behavior.

Periodicity Pitch Perception

This study presents a computational model to reproduce the biological dynamics of "listening to music." A biologically plausible model of periodicity pitch detection is proposed and simulated. Periodicity pitch is computed across a range of the auditory spectrum. Periodicity pitch is detected from subsets of activated auditory nerve fibers (ANFs). These activate connected model octopus cells, which trigger model neurons detecting onsets and offsets; thence model interval-tuned neurons are innervated at the right interval times; and finally, a set of common interval-detecting neurons indicate pitch. Octopus cells rhythmically spike with the pitch periodicity of the sound. Batteries of interval-tuned neurons stopwatch-like measure the inter-spike intervals of the octopus cells by coding interval durations as first spike latencies (FSLs). The FSL-triggered spikes synchronously coincide through a monolayer spiking neural network at the corresponding receiver pitch neurons.

Modeling Pitch Perception With an Active Auditory Model Extended by Octopus Cells

Pitch is an essential category for musical sensations. Models of pitch perception are vividly discussed up to date. Most of them rely on definitions of mathematical methods in the spectral or temporal domain. Our proposed pitch perception model is composed of an active auditory model extended by octopus cells. The active auditory model is the same as used in the Stimulation based on Auditory Modeling (SAM), a successful cochlear implant sound processing strategy extended here by modeling the functional behavior of the octopus cells in the ventral cochlear nucleus and by modeling their connections to the auditory nerve fibers (ANFs). The neurophysiological parameterization of the extended model is fully described in the time domain. The model is based on latency-phase en- and decoding as octopus cells are latency-phase rectifiers in their local receptive fields. Pitch is ubiquitously represented by cascaded firing sweeps of octopus cells. Based on the firing patterns of octopus cells, inter-spike interval histograms can be aggregated, in which the place of the global maximum is assumed to encode the pitch.

Impairment of the Missing Fundamental Phenomenon in Individuals with Alzheimer’s Disease: A Neuropsychological and Voxel-Based Morphometric Study

Background/Aims

The missing fundamental phenomenon (MFP) is a universal pitch perception illusion that occurs in animals and humans. In this study, we aimed to determine whether the MFP is impaired in patients with Alzheimer's disease (AD) using an auditory pitch perception experiment. We further examined anatomical correlates of the MFP in patients with AD by measuring gray matter volume (GMV) on magnetic resonance images via voxel-based morphometric analysis.

Methods

We prospectively enrolled 29 patients with AD and 20 healthy older adults. Auditory stimuli included 12 melodies of Japanese nursery songs that were expected to be familiar to participants. We constructed the melodies using pure and missing fundamental tones (MFTs).

Results

Patients with AD exhibited significantly poorer performance on the MFT task than healthy controls. MFT scores were positively correlated with GMV in the bilateral insula and temporal poles, left inferior frontal gyrus, right entorhinal cortex, and right cerebellum.

Conclusions

These results suggest that impairments in the MFP represent a manifestation of the degeneration of auditory-related brain regions in AD. Further studies are required to more fully elucidate the neural mechanisms underlying auditory impairments in patients with AD and related dementia disorders.