Getting the cue: sensory contributions to auditory emotion recognition impairments in schizophrenia

Auditory emotion recognition impairments in schizophrenia: relationship to acoustic features and cognition

OBJECTIVE

Schizophrenia is associated with deficits in the ability to perceive emotion based on tone of voice. The basis for this deficit remains unclear, however, and relevant assessment batteries remain limited. The authors evaluated performance in schizophrenia on a novel voice emotion recognition battery with well-characterized physical features, relative to impairments in more general emotional and cognitive functioning.

METHOD

The authors studied a primary sample of 92 patients and 73 comparison subjects. Stimuli were characterized according to both intended emotion and acoustic features (e.g., pitch, intensity) that contributed to the emotional percept. Parallel measures of visual emotion recognition, pitch perception, general cognition, and overall outcome were obtained. More limited measures were obtained in an independent replication sample of 36 patients, 31 age-matched comparison subjects, and 188 general comparison subjects.

RESULTS

Patients showed statistically significant large-effect-size deficits in voice emotion recognition (d=1.1) and were preferentially impaired in recognition of emotion based on pitch features but not intensity features. Emotion recognition deficits were significantly correlated with pitch perception impairments both across (r=0.56) and within (r=0.47) groups. Path analysis showed both sensory-specific and general cognitive contributions to auditory emotion recognition deficits in schizophrenia. Similar patterns of results were observed in the replication sample.

CONCLUSIONS

The results demonstrate that patients with schizophrenia show a significant deficit in the ability to recognize emotion based on tone of voice and that this deficit is related to impairment in detecting the underlying acoustic features, such as change in pitch, required for auditory emotion recognition. This study provides tools for, and highlights the need for, greater attention to physical features of stimuli used in studying social cognition in neuropsychiatric disorders.

Differential relationships of mismatch negativity and visual p1 deficits to premorbid characteristics and functional outcome in schizophrenia

BACKGROUND

Mismatch negativity (MMN) and visual P1 are established event-related potential (ERP) markers of impaired auditory and visual sensory function in schizophrenia. Differential relationships of these measures with premorbid and present function and with clinical course have been noted previously in independent cohorts, but measures have not yet been compared within the same patient group.

METHODS

Twenty-six schizophrenia patients and 19 control subjects participated in a simultaneous visual and auditory ERPs experiment. Attended visual ERPs were obtained to low- and high-spatial frequency stimuli. Simultaneously, MMN was obtained to unattended pitch, duration, and intensity deviant stimuli. Premorbid function, symptom, and global outcome measures were obtained as correlational measures.

RESULTS

Patients showed substantial P1 reductions to low- but not high-spatial frequency stimuli, unrelated to visual acuity. Patients also exhibited reduced MMN to all deviant types. No significant correlations were observed between visual ERPs and premorbid or global outcome measures or illness duration. In contrast, MMN amplitude correlated significantly and independently with premorbid educational achievement, cognitive symptoms, global function, and illness duration. The MMN to duration versus other deviants was differentially reduced in individuals with poor premorbid function.

CONCLUSIONS

Visual and auditory ERP measures are differentially related to the pathophysiology of schizophrenia. Visual deficits correlate poorly with functional measures and illness duration and serve primarily as trait vulnerability markers. The MMN deficits are independently related to premorbid function and illness duration, suggesting independent neurodevelopmental and neurodegenerative contributions. The lack of correlation between auditory and visual ERPs in schizophrenia suggests contributions from divergent underlying neurophysiological processes.

Increased expression of Kalirin-9 in the auditory cortex of schizophrenia subjects: its role in dendritic pathology

Reductions in dendritic arbor length and complexity are among the most consistently replicated changes in neuronal structure in post mortem studies of cerebral cortical samples from subjects with schizophrenia, however, the underlying molecular mechanisms have not been identified. This study is the first to identify an alteration in a regulatory protein which is known to promote both dendritic length and arborization in developing neurons, Kalirin-9. We found Kalirin-9 expression to be paradoxically increased in schizophrenia. We followed up this observation by overexpressing Kalirin-9 in mature primary neuronal cultures, causing reduced dendritic length and complexity. Kalirin-9 overexpression represents a potential mechanism for dendritic changes seen in schizophrenia.

Preliminary Evidence of Pre-Attentive Distinctions of Frequency-Modulated Tones that Convey Affect

Recognizing emotion is an evolutionary imperative. An early stage of auditory scene analysis involves the perceptual grouping of acoustic features, which can be based on both temporal coincidence and spectral features such as perceived pitch. Perceived pitch, or fundamental frequency (F₀), is an especially salient cue for differentiating affective intent through speech intonation (prosody). We hypothesized that: (1) simple frequency-modulated tone abstractions, based on the parameters of actual prosodic stimuli, would be reliably classified as representing differing emotional categories; and (2) that such differences would yield significant mismatch negativities (MMNs) – an index of pre-attentive deviance detection within the auditory environment. We constructed a set of FM tones that approximated the F₀ mean and variation of reliably recognized happy and neutral prosodic stimuli. These stimuli were presented to 13 subjects using a passive listening oddball paradigm. We additionally included stimuli with no frequency modulation (FM) and FM tones with identical carrier frequencies but differing modulation depths as control conditions. Following electrophysiological recording, subjects were asked to identify the sounds they heard as happy, sad, angry, or neutral. We observed that FM tones abstracted from happy and no-expression speech stimuli elicited MMNs. Post hoc behavioral testing revealed that subjects reliably identified the FM tones in a consistent manner. Finally, we also observed that FM tones and no-FM tones elicited equivalent MMNs. MMNs to FM tones that differentiate affect suggests that these abstractions may be sufficient to characterize prosodic distinctions, and that these distinctions can be represented in pre-attentive auditory sensory memory.

Not pitch perfect: sensory contributions to affective communication impairment in schizophrenia

BACKGROUND

Schizophrenia patients have vocal affect (prosody) deficits that are treatment resistant and associated with negative symptoms and poor outcome. The neural correlates of this dysfunction are unclear. Prior study has suggested that schizophrenia vocal affect perception deficits stem from an inability to use acoustic cues, notably pitch, in decoding emotion.

METHODS

Functional magnetic resonance imaging was performed in 24 schizophrenia patients and 28 healthy control subjects, during the performance of a four-choice (happiness, fear, anger, neutral) vocal affect identification task in which items for each emotion varied parametrically in affective salient acoustic cue levels.

RESULTS

We observed that parametric increases in cue levels in schizophrenia failed to produce the same identification rate increases as in control subjects. These deficits correlated with diminished reciprocal activation changes in superior temporal and inferior frontal gyri and reduced temporo-frontal connectivity. Task activation also correlated with independent measures of pitch perception and negative symptom severity.

CONCLUSIONS

These findings illustrate the interplay between sensory and higher-order cognitive dysfunction in schizophrenia. Sensory contributions to vocal affect deficits also suggest that this neurobehavioral marker could be targeted by pharmacological or behavioral remediation of acoustic feature discrimination.

Evidence for impaired sound intensity processing in schizophrenia

Patients with schizophrenia are impaired in many aspects of auditory processing, but indirect evidence suggests that intensity perception is intact. However, because the extraction of meaning from dynamic intensity relies on structures that appear to be altered in schizophrenia, we hypothesized that the perception of auditory looming is impaired as well. Twenty inpatients with schizophrenia and 20 control participants, matched for age, gender, and education, gave intensity ratings of rising (looming) and falling intensity sounds with different mean intensities. Intensity change was overestimated in looming as compared with receding sounds in both groups. However, healthy individuals showed a stronger effect at higher mean intensity, in keeping with previous findings, while patients with schizophrenia lacked this modulation. We discuss how this might support the notion of a more general deficit in extracting emotional meaning from different sensory cues, including intensity and pitch.

N-methyl-d-aspartate (NMDA) receptor dysfunction or dysregulation: the final common pathway on the road to schizophrenia?

Schizophrenia is a severe mental disorder associated with a characteristic constellation of symptoms and neurocognitive deficits. At present, etiological mechanisms remain relatively unknown, although multiple points of convergence have been identified over recent years. One of the primary convergence points is dysfunction of N-methyl-d-aspartate (NMDAR)-type glutamate receptors. Antagonists of NMDAR produce a clinical syndrome that closely resembles, and uniquely incorporates negative and cognitive symptoms of schizophrenia, along with the specific pattern of neurocognitive dysfunction seen in schizophrenia. Genetic polymorphisms involving NMDAR subunits, particularly the GRIN2B subunit have been described. In addition, polymorphisms have been described in modulatory systems involving the NMDAR, including the enzymes serine racemase and d-amino acid oxidase/G72 that regulate brain d-serine synthesis. Reductions in plasma and brain glycine, d-serine and glutathione levels have been described as well, providing potential mechanisms underlying NMDAR dysfunction. Unique characteristics of the NMDAR are described that may explain the characteristic pattern of symptoms and neurocognitive deficits observed in schizophrenia. Finally, the NMDAR complex represents a convergence point for potential new treatment approaches in schizophrenia aimed at correcting underlying abnormalities in synthesis and regulation of allosteric modulators, as well as more general potentiation of pre- and post-synaptic glutamatergic and NMDAR function.

"It's Not What You Say, But How You Say it": A Reciprocal Temporo-frontal Network for Affective Prosody

Humans communicate emotion vocally by modulating acoustic cues such as pitch, intensity and voice quality. Research has documented how the relative presence or absence of such cues alters the likelihood of perceiving an emotion, but the neural underpinnings of acoustic cue-dependent emotion perception remain obscure. Using functional magnetic resonance imaging in 20 subjects we examined a reciprocal circuit consisting of superior temporal cortex, amygdala and inferior frontal gyrus that may underlie affective prosodic comprehension. Results showed that increased saliency of emotion-specific acoustic cues was associated with increased activation in superior temporal cortex [planum temporale (PT), posterior superior temporal gyrus (pSTG), and posterior superior middle gyrus (pMTG)] and amygdala, whereas decreased saliency of acoustic cues was associated with increased inferior frontal activity and temporo-frontal connectivity. These results suggest that sensory-integrative processing is facilitated when the acoustic signal is rich in affective information, yielding increased activation in temporal cortex and amygdala. Conversely, when the acoustic signal is ambiguous, greater evaluative processes are recruited, increasing activation in inferior frontal gyrus (IFG) and IFG STG connectivity. Auditory regions may thus integrate acoustic information with amygdala input to form emotion-specific representations, which are evaluated within inferior frontal regions.

When top-down meets bottom-up: auditory training enhances verbal memory in schizophrenia

A critical research priority for our field is to develop treatments that enhance cognitive functioning in schizophrenia and thereby attenuate the functional losses associated with the illness. In this article, we describe such a treatment method that is grounded in emerging research on the widespread sensory processing impairments of schizophrenia, as described elsewhere in this special issue. We first present the rationale for this treatment approach, which consists of cognitive training exercises that make use of principles derived from the past 2 decades of basic science research in learning-induced neuroplasticity; these exercises explicitly target not only the higher order or "top-down" processes of cognition but also the content building blocks of accurate and efficient sensory representations to simultaneously achieve "bottom-up" remediation. We then summarize our experience to date and briefly review our behavioral and serum biomarker findings from a randomized controlled trial of this method in outpatients with long-term symptoms of schizophrenia. Finally, we present promising early psychophysiological evidence that supports the hypothesis that this cognitive training method induces changes in aspects of impaired bottom-up sensory processing in schizophrenia. We conclude with the observation that neuroplasticity-based cognitive training brings patients closer to physiological patterns seen in healthy participants, suggesting that it changes the brain in an adaptive manner in schizophrenia.

Sensory processing in schizophrenia: neither simple nor intact

This special issue focuses on the theme of sensory processing dysfunction in schizophrenia. For more than 50 years, from approximately the time of Bleuler until the early 1960s, sensory function was considered one of the few preserved functions in schizophrenia (Javitt1). Fortunately, the last several decades have brought a renewed and accelerating interest in this topic. The articles included in the issue range from those addressing fundamental bases of sensory dysfunction (Brenner, Yoon, and Turetsky) to those that examine how elementary deficits in sensory processing affect the sensory experience of individuals with schizophrenia (Butler, Kantrowitz, and Coleman) to the question of how sensory-based treatments may lead to improvement in remediation strategies (Adcock). Although addressing only a small portion of the current complex and burgeoning literature on sensory impairments across modalities, the present articles provide a cross-section of the issues currently under investigation. These studies also underscore the severe challenges that individuals with schizophrenia face when trying to decode the complex world around them.

Steady state responses: electrophysiological assessment of sensory function in schizophrenia

Persons with schizophrenia experience subjective sensory anomalies and objective deficits on assessment of sensory function. Such deficits could be produced by abnormal signaling in the sensory pathways and sensory cortex or later stage disturbances in cognitive processing of such inputs. Steady state responses (SSRs) provide a noninvasive method to test the integrity of sensory pathways and oscillatory responses in schizophrenia with minimal task demands. SSRs are electrophysiological responses entrained to the frequency and phase of a periodic stimulus. Patients with schizophrenia exhibit pronounced auditory SSR deficits within the gamma frequency range (35-50 Hz) in response to click trains and amplitude-modulated tones. Visual SSR deficits are also observed, most prominently in the alpha and beta frequency ranges (7-30 Hz) in response to high-contrast, high-luminance stimuli. Visual SSR studies that have used the psychophysical properties of a stimulus to target specific visual pathways predominantly report magnocellular-based deficits in those with schizophrenia. Disruption of both auditory and visual SSRs in schizophrenia are consistent with neuropathological and magnetic resonance imaging evidence of anatomic abnormalities affecting the auditory and visual cortices. Computational models suggest that auditory SSR abnormalities at gamma frequencies could be secondary to gamma-aminobutyric acid-mediated or N-methyl-D-aspartic acid dysregulation. The pathophysiological process in schizophrenia encompasses sensory processing that probably contributes to alterations in subsequent encoding and cognitive processing. The developmental evolution of these abnormalities remains to be characterized.

When doors of perception close: bottom-up models of disrupted cognition in schizophrenia

Schizophrenia is a major mental disorder that affects approximately 1% of the population worldwide. Cognitive deficits are a key feature of schizophrenia and a primary cause of long-term disability. Current neurophysiological models of schizophrenia focus on distributed brain dysfunction with bottom-up as well as top-down components. Bottom-up deficits in cognitive processing are driven by impairments in basic perceptual processes that localize to primary sensory brain regions. Within the auditory system, deficits are apparent in elemental sensory processing, such as tone matching following brief delay. Such deficits lead to impairments in higher-order processes such as phonological processing and auditory emotion recognition. Within the visual system, deficits are apparent in functioning of the magnocellular visual pathway, leading to higher-order deficits in processes such as perceptual closure, object recognition, and reading. In both auditory and visual systems, patterns of deficit are consistent with underlying impairment of brain N-methyl-d-aspartate receptor systems.