Neurology of affective prosody and its functional-anatomic organization in right hemisphere

Brain lateralization probed by water diffusion at the atomic to micrometric scale

Combined neutron scattering and diffusion nuclear magnetic resonance experiments have been used to reveal significant interregional asymmetries (lateralization) in bovine brain hemispheres in terms of myelin arrangement and water dynamics at micron to atomic scales. Thicker myelin sheaths were found in the left hemisphere using neutron diffraction. 4.7 T dMRI and quasi-elastic neutron experiments highlighted significant differences in the properties of water dynamics in the two hemispheres. The results were interpreted in terms of hemisphere-dependent cellular composition (number of neurons, cell distribution, etc.) as well as specificity of neurological functions (such as preferential networking).

Aprosodia and prosoplegia with right frontal neurodegeneration

Affective prosody and facial expression are essential components of human communication. Aprosodic syndromes are associated with focal right cerebral lesions that impair the affective-prosodic aspects of language, but are rarely identified because affective prosody is not routinely assessed by clinicians. Inability to produce emotional faces (affective prosoplegia) is a related and important aspect of affective communication has overlapping neuroanatomic substrates with affective prosody. We describe a patient with progressive aprosodia and prosoplegia who had right greater than left perisylvian and temporal atrophy with an anterior predominance. We discuss the importance of assessing affective prosody and facial expression to arrive at an accurate clinical diagnosis.

Neural architectures of music - Insights from acquired amusia

The ability to perceive and produce music is a quintessential element of human life, present in all known cultures. Modern functional neuroimaging has revealed that music listening activates a large-scale bilateral network of cortical and subcortical regions in the healthy brain. Even the most accurate structural studies do not reveal which brain areas are critical and causally linked to music processing. Such questions may be answered by analysing the effects of focal brain lesions in patients´ ability to perceive music. In this sense, acquired amusia after stroke provides a unique opportunity to investigate the neural architectures crucial for normal music processing. Based on the first large-scale longitudinal studies on stroke-induced amusia using modern multi-modal magnetic resonance imaging (MRI) techniques, such as advanced lesion-symptom mapping, grey and white matter morphometry, tractography and functional connectivity, we discuss neural structures critical for music processing, consider music processing in light of the dual-stream model in the right hemisphere, and propose a neural model for acquired amusia.

Tracking Training-Related Plasticity by Combining fMRI and DTI: The Right Hemisphere Ventral Stream Mediates Musical Syntax Processing

As a functional homolog for left-hemispheric syntax processing in language, neuroimaging studies evidenced involvement of right prefrontal regions in musical syntax processing, of which underlying white matter connectivity remains unexplored so far. In the current experiment, we investigated the underlying pathway architecture in subjects with 3 levels of musical expertise. Employing diffusion tensor imaging tractography, departing from seeds from our previous functional magnetic resonance imaging study on music syntax processing in the same participants, we identified a pathway in the right ventral stream that connects the middle temporal lobe with the inferior frontal cortex via the extreme capsule, and corresponds to the left hemisphere ventral stream, classically attributed to syntax processing in language comprehension. Additional morphometric consistency analyses allowed dissociating tract core from more dispersed fiber portions. Musical expertise related to higher tract consistency of the right ventral stream pathway. Specifically, tract consistency in this pathway predicted the sensitivity for musical syntax violations. We conclude that enduring musical practice sculpts ventral stream architecture. Our results suggest that training-related pathway plasticity facilitates the right hemisphere ventral stream information transfer, supporting an improved sound-to-meaning mapping in music.

Rethinking the Neural Basis of Prosody and Non-literal Language: Spared Pragmatics and Cognitive Compensation in a Bilingual With Extensive Right-Hemisphere Damage

Above and beyond the critical contributions of left perisylvian regions to language, the neural networks supporting pragmatic aspects of verbal communication in native and non-native languages (L1s and L2, respectively) have often been ascribed to the right hemisphere (RH). However, several reports have shown that left-hemisphere activity associated with pragmatic domains (e.g., prosody, indirect speech, figurative language) is comparable to or even greater than that observed in the RH, challenging the proposed putative role of the latter for relevant domains. Against this background, we report on an adult bilingual patient showing preservation of pragmatic verbal skills in both languages (L1: Spanish, L2: English) despite bilateral damage mainly focused on the RH. After two strokes, the patient sustained lesions in several regions previously implicated in pragmatic functions (vast portions of the right fronto-insulo-temporal cortices, the bilateral amygdalae and insular cortices, and the left putamen). Yet, comparison of linguistic and pragmatic skills with matched controls revealed spared performance on multiple relevant tasks in both her L1 and L2. Despite mild difficulties in some aspects of L2 prosody, she showed no deficits in comprehending metaphors and idioms, or understanding indirect speech acts in either language. Basic verbal skills were also preserved in both languages, including verbal auditory discrimination, repetition of words and pseudo-words, cognate processing, grammaticality judgments, equivalent recognition, and word and sentence translation. Taken together, the evidence shows that multiple functions of verbal communication can be widely spared despite extensive damage to the RH, and that claims for a putative relation between pragmatics and the RH may have been overemphasized in the monolingual and bilingual literature. We further discuss the case in light of previous reports of pragmatic and linguistic deficits following brain lesions and address its relation to cognitive compensation in bilingual patients.

The Cerebellar Predictions for Social Interactions: Theory of Mind Abilities in Patients With Degenerative Cerebellar Atrophy

Recent studies have focused on the role of the cerebellum in the social domain, including in Theory of Mind (ToM). ToM, or the “mentalizing” process, is the ability to attribute mental states, such as emotion, intentions and beliefs, to others to explain and predict their behavior. It is a fundamental aspect of social cognition and crucial for social interactions, together with more automatic mechanisms, such as emotion contagion. Social cognition requires complex interactions between limbic, associative areas and subcortical structures, including the cerebellum. It has been hypothesized that the typical cerebellar role in adaptive control and predictive coding could also be extended to social behavior. The present study aimed to investigate the social cognition abilities of patients with degenerative cerebellar atrophy to understand whether the cerebellum acts in specific ToM components playing a role as predictive structure. To this aim, an ad hoc social cognition battery was administered to 27 patients with degenerative cerebellar pathology and 27 healthy controls. In addition, 3D T1-weighted and resting-state fMRI scans were collected to characterize the structural and functional changes in cerebello-cortical loops. The results evidenced that the patients were impaired in lower-level processes of immediate perception as well as in the more complex conceptual level of mentalization. Furthermore, they presented a pattern of GM reduction in cerebellar portions that are involved in the social domain such as crus I-II, lobule IX and lobule VIIIa. These areas showed decreased functional connectivity with projection cerebral areas involved in specific aspects of social cognition. These findings boost the idea that the cerebellar modulatory function on the cortical projection areas subtends the social cognition process at different levels. Particularly, regarding the lower-level processes, the cerebellum may act by implicitly matching the external information (i.e., expression of the eyes) with the respective internal representation to guarantee an immediate judgment about the mental state of others. Otherwise, at a more complex conceptual level, the cerebellum seems to be involved in the construction of internal models of mental processes during social interactions in which the prediction of sequential events plays a role, allowing us to anticipate the other person's behavior.

A historical review of investigations on laterality of emotions in the human brain

Different models of emotional lateralization, advanced since the first clinical observations raised this issue, will be reviewed following their historical progression. The clinical investigations that have suggested a general dominance of the right hemisphere for all kinds of emotions and the experimental studies that have proposed a different hemispheric specialization for positive vs. negative emotions (valence hypothesis) or for approach vs. withdrawal tendencies (motivational hypothesis) will be reviewed first and extensively. This historical review will be followed by a short discussion of recent anatomo-clinical and activation studies that have investigated (a) emotional and behavioral disorders of patients with asymmetrical forms of fronto-temporal degeneration and (b) laterality effects in specific brain structures (amygdala, ventro-medial prefrontal cortex, and anterior insula) playing a critical role in different components of emotions. Overall, these studies support the hypothesis of a right hemisphere dominance for all components of the emotional system.

Neurophysiology of spontaneous facial expressions: II. Motor control of the right and left face is partially independent in adults

Facial expressions are described traditionally as monolithic or unitary entities. However, humans have the capacity to produce facial blends of emotion in which the upper and lower face simultaneously display different expressions. Recent neuroanatomical studies in monkeys have demonstrated that there are separate cortical motor areas for controlling the upper and lower face in each hemisphere that, presumably, also occur in humans. Using high-speed videography, we began measuring the movement dynamics of spontaneous facial expressions, including facial blends, to develop a more complete understanding of the neurophysiology underlying facial expressions. In our part 1 publication in Cortex (2016), we found that hemispheric motor control of the upper and lower face is overwhelmingly independent; 242 (99%) of the expressions were classified as demonstrating independent hemispheric motor control whereas only 3 (1%) were classified as demonstrating dependent hemispheric motor control. In this companion paper (part 2), 251 unitary facial expressions that occurred on either the upper or lower face were analyzed. 164 (65%) expressions demonstrated dependent hemispheric motor control whereas 87 (35%) expressions demonstrated independent or dual hemispheric motor control, indicating that some expressions represent facial blends of emotion that occur across the vertical facial axis. These findings also support the concepts that 1) spontaneous facial expressions are organized predominantly across the horizontal facial axis and secondarily across the vertical facial axis and 2) facial expressions are complex, multi-component, motoric events. Based on the Emotion-type hypothesis of cerebral lateralization, we propose that facial expressions modulated by a primary-emotional response to an environmental event are initiated by the right hemisphere on the left side of the face whereas facial expressions modulated by a social-emotional response to an environmental event are initiated by the left hemisphere on the right side of the face.

Validated automatic speech biomarkers in primary progressive aphasia

Objective

To automatically extract and quantify specific disease biomarkers of prosody from the acoustic properties of speech in patients with primary progressive aphasia.

Methods

We analyzed speech samples from 59 progressive aphasic patients (non‐fluent/agrammatic = 15, semantic = 21, logopenic = 23; ages 50–85 years) and 31 matched healthy controls (ages 54–89 years). Using a novel, automated speech analysis protocol, we extracted acoustic measurements of prosody, including fundamental frequency and speech and silent pause durations, and compared these between groups. We then examined their relationships with clinical tests, gray matter atrophy, and cerebrospinal fluid analytes.

Results

We found a narrowed range of fundamental frequency in patients with non‐fluent/agrammatic variant aphasia (mean 3.86 ± 1.15 semitones) compared with healthy controls (6.06 ± 1.95 semitones; P < 0.001) and patients with semantic variant aphasia (6.12 ± 1.77 semitones; P = 0.001). Mean pause rate was significantly increased in the non‐fluent/agrammatic group (mean 61.4 ± 20.8 pauses per minute) and the logopenic group (58.7 ± 16.4 pauses per minute) compared to controls. In an exploratory analysis, narrowed fundamental frequency range was associated with atrophy in the left inferior frontal cortex. Cerebrospinal level of phosphorylated tau was associated with an acoustic classifier combining fundamental frequency range and pause rate (r = 0.58, P = 0.007). Receiver operating characteristic analysis with this combined classifier distinguished non‐fluent/agrammatic speakers from healthy controls (AUC = 0.94) and from semantic variant patients (AUC = 0.86).

Interpretation

Restricted fundamental frequency range and increased pause rate are characteristic markers of speech in non‐fluent/agrammatic primary progressive aphasia. These can be extracted with automated speech analysis and are associated with left inferior frontal atrophy and cerebrospinal phosphorylated tau level.

Neural Correlates of Hypokinetic Dysarthria and Mechanisms of Effective Voice Treatment in Parkinson Disease

Background. Hypokinetic dysarthria is highly prevalent in idiopathic Parkinson disease (PD), and effectiveness of high-intensity voice treatment is well established. However, the neural correlates remain largely unknown. Objective. We aimed to specify cerebral pathophysiology of hypokinetic dysarthria and treatment-induced changes using functional magnetic resonance imaging (fMRI). Methods. We used fMRI to investigate healthy controls (HCs) and patients with idiopathic PD–associated dysarthria before and after treatment according to the Lee Silverman Voice Treatment LOUD (LSVT). During fMRI, participants covertly read sentences with normal (eg, conversation in a quiet room) or high (eg, shouting on a windy beach) intensity. In addition, we tested LSVT effects on intelligibility and different speech features (intensity, pitch, articulation). Results. LSVT effectively improved intelligibility, articulation, and pitch in patients. Covert high-intensity speech compared with covert normal-intensity speech led to increased activation of mainly secondary motor areas and bilateral superior and medial temporal regions. Prior to LSVT, patients showed less activity in several speech-associated areas compared with HCs. As a neural correlate of effective LSVT, increased right-sided superior temporal activity correlated with improved intelligibility. Conclusion. This is the first brain imaging study using a covert speech paradigm in PD, which revealed cortical hypoactivation as correlate of hypokinetic dysarthria. Furthermore, cortical correlates of effective LSVT treatment colocalized with the neuronal network, showing increased activation during high- versus normal-intensity speech generation.

Emotions and the Right Hemisphere: Can New Data Clarify Old Models?

Models advanced to explain hemispheric asymmetries in representation of emotions will be discussed following their historical progression. First, the clinical observations that have suggested a general dominance of the right hemisphere for all kinds of emotions will be reviewed. Then the experimental investigations that have led to proposal of a different hemispheric specialization for positive versus negative emotions (valence hypothesis) or, alternatively, for approach versus avoidance tendencies (motivational hypothesis) will be surveyed. The discussion of these general models will be followed by a review of recent studies which have documented laterality effects within specific brain structures, known to play a critical role in different components of emotions, namely the amygdata in the computation of emotionally laden stimuli, the ventromedial prefrontal cortex in the integration between cognition and emotion and in the control of impulsive reactions and the anterior insula in the conscious experience of emotion. Results of these recent investigations support and provide an updated integrated version of early models assuming a general right hemisphere dominance for all kinds of emotions.

Reduced Performance During a Sentence Repetition Task by Continuous Theta-Burst Magnetic Stimulation of the Pre-supplementary Motor Area

The pre-supplementary motor area (pre-SMA) is engaged in speech comprehension under difficult circumstances such as poor acoustic signal quality or time-critical conditions. Previous studies found that left pre-SMA is activated when subjects listen to accelerated speech. Here, the functional role of pre-SMA was tested for accelerated speech comprehension by inducing a transient “virtual lesion” using continuous theta-burst stimulation (cTBS). Participants were tested (1) prior to (pre-baseline), (2) 10 min after (test condition for the cTBS effect), and (3) 60 min after stimulation (post-baseline) using a sentence repetition task (formant-synthesized at rates of 8, 10, 12, 14, and 16 syllables/s). Speech comprehension was quantified by the percentage of correctly reproduced speech material. For high speech rates, subjects showed decreased performance after cTBS of pre-SMA. Regarding the error pattern, the number of incorrect words without any semantic or phonological similarity to the target context increased, while related words decreased. Thus, the transient impairment of pre-SMA seems to affect its inhibitory function that normally eliminates erroneous speech material prior to speaking or, in case of perception, prior to encoding into a semantically/pragmatically meaningful message.

Selective impairments in components of affective prosody in neurologically impaired individuals

The intent and feelings of the speaker are often conveyed less by what they say than by how they say it, in terms of the affective prosody - modulations in pitch, loudness, rate, and rhythm of the speech to convey emotion. Here we propose a cognitive architecture of the perceptual, cognitive, and motor processes underlying recognition and generation of affective prosody. We developed the architecture on the basis of the computational demands of the task, and obtained evidence for various components by identifying neurologically impaired patients with relatively specific deficits in one component. We report analysis of performance across tasks of recognizing and producing affective prosody by four patients (three with right hemisphere stroke and one with frontotemporal dementia). Their distinct patterns of performance across tasks and quality of their abnormal performance provides preliminary evidence that some of the components of the proposed architecture can be selectively impaired by focal brain damage.

Right Hemisphere Regions Critical for Expression of Emotion Through Prosody

Impaired expression of emotion through pitch, loudness, rate, and rhythm of speech (affective prosody) is common and disabling after right hemisphere (RH) stroke. These deficits impede all social interactions. Previous studies have identified cortical areas associated with impairments of expression, recognition, or repetition of affective prosody, but have not identified critical white matter tracts. We hypothesized that: (1) differences across patients in specific acoustic features correlate with listener judgment of affective prosody and (2) these differences are associated with infarcts of specific RH gray and white matter regions. To test these hypotheses, 41 acute ischemic RH stroke patients had MRI diffusion weighted imaging and described a picture. Affective prosody of picture descriptions was rated by 21 healthy volunteers. We identified percent damage (lesion load) to each of seven regions of interest previously associated with expression of affective prosody and two control areas that have been associated with recognition but not expression of prosody. We identified acoustic features that correlated with listener ratings of prosody (hereafter “prosody acoustic measures”) with Spearman correlations and linear regression. We then identified demographic variables and brain regions where lesion load independently predicted the lowest quartile of each of the “prosody acoustic measures” using logistic regression. We found that listener ratings of prosody positively correlated with four acoustic measures. Furthermore, the lowest quartile of each of these four “prosody acoustic measures” was predicted by sex, age, lesion volume, and percent damage to the seven regions of interest. Lesion load in pars opercularis, supramarginal gyrus, or associated white matter tracts (and not control regions) predicted lowest quartile of the four “prosody acoustic measures” in logistic regression. Results indicate that listener perception of reduced affective prosody after RH stroke is due to reduction in specific acoustic features caused by infarct in right pars opercularis or supramarginal gyrus, or associated white matter tracts.

Neural measures of the role of affective prosody in empathy for pain

Emotional communication often needs the integration of affective prosodic and semantic components from speech and the speaker’s facial expression. Affective prosody may have a special role by virtue of its dual-nature; pre-verbal on one side and accompanying semantic content on the other. This consideration led us to hypothesize that it could act transversely, encompassing a wide temporal window involving the processing of facial expressions and semantic content expressed by the speaker. This would allow powerful communication in contexts of potential urgency such as witnessing the speaker’s physical pain. Seventeen participants were shown with faces preceded by verbal reports of pain. Facial expressions, intelligibility of the semantic content of the report (i.e., participants’ mother tongue vs. fictional language) and the affective prosody of the report (neutral vs. painful) were manipulated. We monitored event-related potentials (ERPs) time-locked to the onset of the faces as a function of semantic content intelligibility and affective prosody of the verbal reports. We found that affective prosody may interact with facial expressions and semantic content in two successive temporal windows, supporting its role as a transverse communication cue.

Auditory object perception: A neurobiological model and prospective review

Interaction with the world is a multisensory experience, but most of what is known about the neural correlates of perception comes from studying vision. Auditory inputs enter cortex with its own set of unique qualities, and leads to use in oral communication, speech, music, and the understanding of emotional and intentional states of others, all of which are central to the human experience. To better understand how the auditory system develops, recovers after injury, and how it may have transitioned in its functions over the course of hominin evolution, advances are needed in models of how the human brain is organized to process real-world natural sounds and "auditory objects". This review presents a simple fundamental neurobiological model of hearing perception at a category level that incorporates principles of bottom-up signal processing together with top-down constraints of grounded cognition theories of knowledge representation. Though mostly derived from human neuroimaging literature, this theoretical framework highlights rudimentary principles of real-world sound processing that may apply to most if not all mammalian species with hearing and acoustic communication abilities. The model encompasses three basic categories of sound-source: (1) action sounds (non-vocalizations) produced by 'living things', with human (conspecific) and non-human animal sources representing two subcategories; (2) action sounds produced by 'non-living things', including environmental sources and human-made machinery; and (3) vocalizations ('living things'), with human versus non-human animals as two subcategories therein. The model is presented in the context of cognitive architectures relating to multisensory, sensory-motor, and spoken language organizations. The models' predictive values are further discussed in the context of anthropological theories of oral communication evolution and the neurodevelopment of spoken language proto-networks in infants/toddlers. These phylogenetic and ontogenetic frameworks both entail cortical network maturations that are proposed to at least in part be organized around a number of universal acoustic-semantic signal attributes of natural sounds, which are addressed herein.

Neurocircuitry of impaired affective sound processing: A clinical disorders perspective

Decoding affective meaning from sensory information is central to accurate and adaptive behavior in many natural and social contexts. Human vocalizations (speech and non-speech), environmental sounds (e.g. thunder, noise, or animal sounds) and human-produced sounds (e.g. technical sounds or music) can carry a wealth of important aversive, threatening, appealing, or pleasurable affective information that sometimes implicitly influences and guides our behavior. A deficit in processing such affective information is detrimental to adaptive environmental behavior, psychological well-being, and social interactive abilities. These deficits can originate from a diversity of psychiatric and neurological disorders, and are associated with neural dysfunctions across largely distributed brain networks. Recent neuroimaging studies in psychiatric and neurological patients outline the cortical and subcortical neurocircuitry of the complimentary and differential functional roles for affective sound processing. This points to and confirms a recently proposed distributed network rather than a single brain region underlying affective sound processing, and highlights the notion of a multi-functional process that can be differentially impaired in clinical disorders.

Automatic measurement of prosody in behavioral variant FTD

OBJECTIVE

To help understand speech changes in behavioral variant frontotemporal dementia (bvFTD), we developed and implemented automatic methods of speech analysis for quantification of prosody, and evaluated clinical and anatomical correlations.

METHODS

We analyzed semi-structured, digitized speech samples from 32 patients with bvFTD (21 male, mean age 63 ± 8.5, mean disease duration 4 ± 3.1 years) and 17 matched healthy controls (HC). We automatically extracted fundamental frequency (f0, the physical property of sound most closely correlating with perceived pitch) and computed pitch range on a logarithmic scale (semitone) that controls for individual and sex differences. We correlated f0 range with neuropsychiatric tests, and related f0 range to gray matter (GM) atrophy using 3T T1 MRI.

RESULTS

We found significantly reduced f0 range in patients with bvFTD (mean 4.3 ± 1.8 ST) compared to HC (5.8 ± 2.1 ST; p = 0.03). Regression related reduced f0 range in bvFTD to GM atrophy in bilateral inferior and dorsomedial frontal as well as left anterior cingulate and anterior insular regions.

CONCLUSIONS

Reduced f0 range reflects impaired prosody in bvFTD. This is associated with neuroanatomic networks implicated in language production and social disorders centered in the frontal lobe. These findings support the feasibility of automated speech analysis in frontotemporal dementia and other disorders.

Categorical learning revealed in activity pattern of left fusiform cortex

The brain is organized such that it encodes and maintains category information about thousands of objects. However, how learning shapes these neural representations of object categories is unknown. The present study focuses on faces, examining whether: (1) Enhanced categorical discrimination or (2) Feature analysis enhances face/non-face categorization in the brain. Stimuli ranged from non-faces to faces with two-toned Mooney images used for testing and gray-scale images used for training. The stimulus set was specifically chosen because it has a true categorical boundary between faces and non-faces but the stimuli surrounding that boundary have very similar features, making the boundary harder to learn. Brain responses were measured using functional magnetic resonance imaging while participants categorized the stimuli before and after training. Participants were either trained with a categorization task, or with non-categorical semblance analyzation. Interestingly, when participants were categorically trained, the neural activity pattern in the left fusiform gyrus shifted from a graded representation of the stimuli to a categorical representation. This corresponded with categorical face/non-face discrimination, critically including both an increase in selectivity to faces and a decrease in false alarm response to non-faces. By contrast, while activity pattern in the right fusiform cortex correlated with face/non-face categorization prior to training, it was not affected by learning. Our results reveal the key role of the left fusiform cortex in learning face categorization. Given the known right hemisphere dominance for face-selective responses, our results suggest a rethink of the relationship between the two hemispheres in face/non-face categorization. Hum Brain Mapp 38:3648-3658, 2017. © 2017 Wiley Periodicals, Inc.

Affective speech prosody perception and production in stroke patients with left-hemispheric damage and healthy controls

PURPOSE

'Affective prosody' defines the supra-segmental features of speech that, when manipulated, can change the type and intensity of emotion conveyed by the speaker. Although the right hemisphere is predominantly linked to the processing of affective prosodic cues, existing literature also suggests that damage to the left hemisphere can result in similar deficits. This study aims to demonstrate, and add to the evidence, that patients with left-hemisphere injury experience difficulties with affective prosodic perception and production, measured via a new combination of assessments and analyses. It is also hypothesised that aphasia severity will be correlated with impaired processing of affective prosody.

RESULTS

Stroke and control participants differed significantly on prosody perception tests of matching auditory affective cues to visual images. Prosodic production was measured by participants vocalising different affective expressions of words and monosyllables - from which significant differences were found in perceptual judgements of emotion accuracy and intensity, and acoustic analyses of pitch range and variance. There were significant correlations between participants' Western Aphasia Battery (WAB) scores, quality of life, and prosody production.

CONCLUSION

Individuals with left-hemisphere damage after stroke have impaired affective prosodic perception and production that may be associated with reduced quality of life.

Stroke of bad luck?

We hypothesized that distinct acute right hemisphere lesions disrupt separate components of valuation and emotional response to winning and losing money and of emotional empathy in observing a partner win or lose money. We measured skin conductance response (SCR) and ratings of emotions when acute right hemisphere stroke patients or healthy controls won or lost money in roulette, or when they watched a partner win or lose. Our results showed that percentage of damage after stroke to right anterior insula and frontal operculum negatively correlated with both SCR to winning and losing and difference between rating wins versus losses.

Pitch perception deficits in nonverbal learning disability

The nonverbal learning disability (NLD) is a neurological dysfunction that affects cognitive functions predominantly related to the right hemisphere such as spatial and abstract reasoning. Previous evidence in healthy adults suggests that acoustic pitch (i.e., the relative difference in frequency between sounds) is, under certain conditions, encoded in specific areas of the right hemisphere that also encode the spatial elevation of external objects (e.g., high vs. low position). Taking this evidence into account, we explored the perception of pitch in preadolescents and adolescents with NLD and in a group of healthy participants matched by age, gender, musical knowledge and handedness. Participants performed four speeded tests: a stimulus detection test and three perceptual categorization tests based on colour, spatial position and pitch. Results revealed that both groups were equally fast at detecting visual targets and categorizing visual stimuli according to their colour. In contrast, the NLD group showed slower responses than the control group when categorizing space (direction of a visual object) and pitch (direction of a change in sound frequency). This pattern of results suggests the presence of a subtle deficit at judging pitch in NLD along with the traditionally-described difficulties in spatial processing.

Recruitment of Language-, Emotion- and Speech-Timing Associated Brain Regions for Expressing Emotional Prosody: Investigation of Functional Neuroanatomy with fMRI

We aimed to progress understanding of prosodic emotion expression by establishing brain regions active when expressing specific emotions, those activated irrespective of the target emotion, and those whose activation intensity varied depending on individual performance. BOLD contrast data were acquired whilst participants spoke non-sense words in happy, angry or neutral tones, or performed jaw-movements. Emotion-specific analyses demonstrated that when expressing angry prosody, activated brain regions included the inferior frontal and superior temporal gyri, the insula, and the basal ganglia. When expressing happy prosody, the activated brain regions also included the superior temporal gyrus, insula, and basal ganglia, with additional activation in the anterior cingulate. Conjunction analysis confirmed that the superior temporal gyrus and basal ganglia were activated regardless of the specific emotion concerned. Nevertheless, disjunctive comparisons between the expression of angry and happy prosody established that anterior cingulate activity was significantly higher for angry prosody than for happy prosody production. Degree of inferior frontal gyrus activity correlated with the ability to express the target emotion through prosody. We conclude that expressing prosodic emotions (vs. neutral intonation) requires generic brain regions involved in comprehending numerous aspects of language, emotion-related processes such as experiencing emotions, and in the time-critical integration of speech information.

"Frank" presentations as a novel research construct and element of diagnostic decision-making in autism spectrum disorder

Many individuals with ASD have a distinctive behavioral presentation that is recognizable within moments, a phenomenon we call "frank" ASD. This phenomenon has been discussed informally for decades, perhaps as "classic" ASD; however, there is no unitary "classic" presentation, and classic autism does not seem to correspond to level of functioning. Thus, neither "frank" nor "classic" autism has been delineated or studied as a research construct. To initiate the empirical study of frank ASD, we surveyed 151 clinicians, from a range of disciplines that diagnose ASD, about this phenomenon. Respondents completed a 13-item questionnaire about frank ASD, which was analyzed using a mixed-methods approach. Ninety-seven percentage of respondents were familiar with the phenomenon. Respondents estimated that 40% of the ASD population has a frank presentation. Respondents reported the most highly specific behaviors associated with frank presentations were a general sense of impaired reciprocity, quality of eye contact, atypical vocal prosody, presence of motor mannerisms, and atypical gait or posture. In general, respondents reported detecting frank features rapidly, with the majority forming their impressions within the first ten minutes of interaction or observation. Although unstudied empirically, "frank" presentations of ASD are familiar to diagnosing clinicians, and appear to be based on behaviors both central to ASD diagnostic criteria (e.g., impaired reciprocity), and absent from diagnostic criteria (e.g., atypical gait or posture). We discuss these findings within the context of diagnostic decision-making and behavioral phenotyping of ASD. Autism Res 2016,. © 2016 International Society for Autism Research, Wiley Periodicals, Inc. Autism Res 2017, 10: 653-662. © 2016 International Society for Autism Research, Wiley Periodicals, Inc.

Acute Ischemic Lesions Associated with Impairments in Expression and Recognition of Affective Prosody

PURPOSE

We aimed to: (a) review existing data on the neural basis of affective prosody;(b) test the hypothesis that there are double dissociations in impairments of expression and recognition of affective prosody; and (c) identify areas of infarct associated with impaired expression and/or recognition of affective prosody after acute right hemisphere (RH) ischemic stroke.

METHODS

Participants were tested on recognition of emotional prosody in content-neutral sentences. Expression was evaluated by measuring variability in fundamental frequency. Voxel-based symptom mapping was used to identify areas associated with severity of expressive deficits.

RESULTS

We found that 9/23 patients had expressive prosody impairments; 5/9 of these patients also had impaired recognition of affective prosody; 2/9 had selective deficits in expressive prosody; recognition was not tested in 2/9. Another 6/23 patients had selective impairment in recognition of affective prosody. Severity of expressive deficits was associated with lesions in right temporal pole; patients with temporal pole lesions had deficits in expression and recognition.

CONCLUSIONS

Expression and recognition of prosody can be selectively impaired. Damage to right anterior temporal pole is associated with impairment of both, indicating a role of this structure in a mechanism shared by expression and production of affective prosody.

The role of the supplementary motor area for speech and language processing

Apart from its function in speech motor control, the supplementary motor area (SMA) has largely been neglected in models of speech and language processing in the brain. The aim of this review paper is to summarize more recent work, suggesting that the SMA has various superordinate control functions during speech communication and language reception, which is particularly relevant in case of increased task demands. The SMA is subdivided into a posterior region serving predominantly motor-related functions (SMA proper) whereas the anterior part (pre-SMA) is involved in higher-order cognitive control mechanisms. In analogy to motor triggering functions of the SMA proper, the pre-SMA seems to manage procedural aspects of cognitive processing. These latter functions, among others, comprise attentional switching, ambiguity resolution, context integration, and coordination between procedural and declarative memory structures. Regarding language processing, this refers, for example, to the use of inner speech mechanisms during language encoding, but also to lexical disambiguation, syntax and prosody integration, and context-tracking.

The sound of emotions-Towards a unifying neural network perspective of affective sound processing

Affective sounds are an integral part of the natural and social environment that shape and influence behavior across a multitude of species. In human primates, these affective sounds span a repertoire of environmental and human sounds when we vocalize or produce music. In terms of neural processing, cortical and subcortical brain areas constitute a distributed network that supports our listening experience to these affective sounds. Taking an exhaustive cross-domain view, we accordingly suggest a common neural network that facilitates the decoding of the emotional meaning from a wide source of sounds rather than a traditional view that postulates distinct neural systems for specific affective sound types. This new integrative neural network view unifies the decoding of affective valence in sounds, and ascribes differential as well as complementary functional roles to specific nodes within a common neural network. It also highlights the importance of an extended brain network beyond the central limbic and auditory brain systems engaged in the processing of affective sounds.

Picturing the Size and Site of Stroke With an Expanded National Institutes of Health Stroke Scale

Background and Purpose—

The National Institutes of Health Stroke Scale (NIHSS) includes minimal assessment of cognitive function, particularly in right hemisphere (RH) stroke. Descriptions of the Cookie Theft picture from the NIHSS allow analyses that (1) correlate with aphasia severity and (2) identify communication deficits in RH stroke. We hypothesized that analysis of the picture description contributes valuable information about volume and location of acute stroke.

Methods—

We evaluated 67 patients with acute ischemic stroke (34 left hemisphere [LH]; 33 RH) with the NIHSS, analysis of the Cookie Theft picture, and magnetic resonance imaging, compared with 35 sex- and age-matched controls. We evaluated descriptions for total content units (CU), syllables, ratio of left:right CU, CU/minute, and percent interpretive CU, based on previous studies. Lesion volume and percent damage to regions of interest were measured on diffusion-weighted imaging. Multivariable linear regression identified variables associated with infarct volume, independently of NIHSS score, age and sex.

Results—

Patients with RH and LH stroke differed from controls, but not from each other, on CU, syllables/CU, and CU/minute. Left:right CU was lower in RH compared with LH stroke. CU, syllables/CU, and NIHSS each correlated with lesion volume in LH and RH stroke. Lesion volume was best accounted by a model that included CU, syllables/CU, NIHSS, left:right CU, percent interpretive CU, and age, in LH and RH stroke. Each discourse variable and NIHSS score were associated with percent damage to different regions of interest, independently of lesion volume and age.

Conclusions—

Brief picture description analysis complements NIHSS scores in predicting stroke volume and location.

Somatosensory Representations Link the Perception of Emotional Expressions and Sensory Experience

Studies of human emotion perception have linked a distributed set of brain regions to the recognition of emotion in facial, vocal, and body expressions. In particular, lesions to somatosensory cortex in the right hemisphere have been shown to impair recognition of facial and vocal expressions of emotion. Although these findings suggest that somatosensory cortex represents body states associated with distinct emotions, such as a furrowed brow or gaping jaw, functional evidence directly linking somatosensory activity and subjective experience during emotion perception is critically lacking. Using functional magnetic resonance imaging and multivariate decoding techniques, we show that perceiving vocal and facial expressions of emotion yields hemodynamic activity in right somatosensory cortex that discriminates among emotion categories, exhibits somatotopic organization, and tracks self-reported sensory experience. The findings both support embodied accounts of emotion and provide mechanistic insight into how emotional expressions are capable of biasing subjective experience in those who perceive them.

Effect of Subliminal Lexical Priming on the Subjective Perception of Images: A Machine Learning Approach

The purpose of the study is to examine the effect of subliminal priming in terms of the perception of images influenced by words with positive, negative, and neutral emotional content, through electroencephalograms (EEGs). Participants were instructed to rate how much they like the stimuli images, on a 7-point Likert scale, after being subliminally exposed to masked lexical prime words that exhibit positive, negative, and neutral connotations with respect to the images. Simultaneously, the EEGs were recorded. Statistical tests such as repeated measures ANOVAs and two-tailed paired-samples t-tests were performed to measure significant differences in the likability ratings among the three prime affect types; the results showed a strong shift in the likeness judgment for the images in the positively primed condition compared to the other two. The acquired EEGs were examined to assess the difference in brain activity associated with the three different conditions. The consistent results obtained confirmed the overall priming effect on participants' explicit ratings. In addition, machine learning algorithms such as support vector machines (SVMs), and AdaBoost classifiers were applied to infer the prime affect type from the ERPs. The highest classification rates of 95.0% and 70.0% obtained respectively for average-trial binary classifier and average-trial multi-class further emphasize that the ERPs encode information about the different kinds of primes.

White matter tracts critical for recognition of sarcasm

Failure to recognize sarcasm can lead to important miscommunications. Few previous studies have identified brain lesions associated with impaired recognition of sarcasm. We tested the hypothesis that percent damage to specific white matter tracts, age, and education together predict accuracy in sarcasm recognition. Using multivariable linear regression, with age, education, and percent damage to each of eight white matter tracts as independent variables, and percent accuracy on sarcasm recognition as the dependent variable, we developed a model for predicting sarcasm recognition. Percent damage to the sagittal stratum had the greatest weight and was the only independent predictor of sarcasm recognition.

Language comprehension and brain function in individuals with an optimal outcome from autism

Although Autism Spectrum Disorder (ASD) is generally a lifelong disability, a minority of individuals with ASD overcome their symptoms to such a degree that they are generally indistinguishable from their typically-developing peers. That is, they have achieved an Optimal Outcome (OO). The question addressed by the current study is whether this normalized behavior reflects normalized brain functioning, or alternatively, the action of compensatory systems. Either possibility is plausible, as most participants with OO received years of intensive therapy that could alter brain networks to align with typical function or work around ASD-related neural dysfunction. Individuals ages 8 to 21 years with high-functioning ASD (n = 23), OO (n = 16), or typical development (TD; n = 20) completed a functional MRI scan while performing a sentence comprehension task. Results indicated similar activations in frontal and temporal regions (left middle frontal, left supramarginal, and right superior temporal gyri) and posterior cingulate in OO and ASD groups, where both differed from the TD group. Furthermore, the OO group showed heightened “compensatory” activation in numerous left- and right-lateralized regions (left precentral/postcentral gyri, right precentral gyrus, left inferior parietal lobule, right supramarginal gyrus, left superior temporal/parahippocampal gyrus, left middle occipital gyrus) and cerebellum, relative to both ASD and TD groups. Behaviorally normalized language abilities in OO individuals appear to utilize atypical brain networks, with increased recruitment of language-specific as well as right homologue and other systems. Early intensive learning and experience may normalize behavioral language performance in OO, but some brain regions involved in language processing may continue to display characteristics that are more similar to ASD than typical development, while others show characteristics not like ASD or typical development.

•

fMRI study of "optimal outcome" (OO) youth with no symptoms of autism spectrum disorder.

•

Results show “compensatory” language activation in some areas in OO.

•

OO youth also had some “residual ASD” patterns of activation (OO, ASD > TD).

•

There was no evidence of areas of normalized brain function (OO, TD ≠ ASD).

•

Early treatment may normalize behavior but not brain in some individuals with ASD.

Advanced Parkinson disease patients have impairment in prosody processing

BACKGROUND

The ability to recognize and interpret emotions in others is a crucial prerequisite of adequate social behavior. Impairments in emotion processing have been reported from the early stages of Parkinson's disease (PD). This study aims to characterize emotion recognition in advanced Parkinson's disease (APD) candidates for deep-brain stimulation and to compare emotion recognition abilities in visual and auditory domains.

METHOD

APD patients, defined as those with levodopa-induced motor complications (N = 42), and healthy controls (N = 43) matched by gender, age, and educational level, undertook the Comprehensive Affect Testing System (CATS), a battery that evaluates recognition of seven basic emotions (happiness, sadness, anger, fear, surprise, disgust, and neutral) on facial expressions and four emotions on prosody (happiness, sadness, anger, and fear). APD patients were assessed during the "ON" state. Group performance was compared with independent-samples t tests.

RESULTS

Compared to controls, APD had significantly lower scores on the discrimination and naming of emotions in prosody, and visual discrimination of neutral faces, but no significant differences in visual emotional tasks.

CONCLUSION

The contrasting performance in emotional processing between visual and auditory stimuli suggests that APD candidates for surgery have either a selective difficulty in recognizing emotions in prosody or a general defect in prosody processing. Studies investigating early-stage PD, and the effect of subcortical lesions in prosody processing, favor the latter interpretation. Further research is needed to understand these deficits in emotional prosody recognition and their possible contribution to later behavioral or neuropsychiatric manifestations of PD.

Impact of Parkinson's disease and levodopa on resting state functional connectivity related to speech prosody control

BACKGROUND

Impaired speech prosody is common in Parkinson's disease (PD). We assessed the impact of PD and levodopa on MRI resting-state functional connectivity (rs-FC) underlying speech prosody control.

METHODS

We studied 19 PD patients in the OFF and ON dopaminergic conditions and 15 age-matched healthy controls using functional MRI and seed partial least squares correlation (PLSC) analysis. In the PD group, we also correlated levodopa-induced rs-FC changes with the results of acoustic analysis.

RESULTS

The PLCS analysis revealed a significant impact of PD but not of medication on the rs-FC strength of spatial correlation maps seeded by the anterior cingulate (p = 0.006), the right orofacial primary sensorimotor cortex (OF_SM1; p = 0.025) and the right caudate head (CN; p = 0.047). In the PD group, levodopa-induced changes in the CN and OF_SM1 connectivity strengths were related to changes in speech prosody.

CONCLUSIONS

We demonstrated an impact of PD but not of levodopa on rs-FC within the brain networks related to speech prosody control. When only the PD patients were taken into account, the association between treatment-induced changes in speech prosody and changes in rs-FC within the associative striato-prefrontal and motor speech networks was found.

Lateralized resting-state functional connectivity in the task-positive and task-negative networks

Studies on functional brain lateralization using functional magnetic resonance imaging (fMRI) have generally focused on lateralization of local brain regions. To explore the lateralization on the whole-brain level, lateralization of functional connectivity using resting-state fMRI (N=87, right handed) was analyzed and left- and right-lateralized networks were mapped. Four hundred two equally spaced regions of interest (ROI) covering the entire gray matter were divided into 358 task-positive and 44 task-negative ROIs. Lateralization of functional connectivity was analyzed separately for the task-positive and task-negative regions to prevent spuriously high lateralization indices caused by negative correlations between task-positive and task-negative regions. Lateralized functional connections were obtained using k-means clustering analysis. Within the task-positive network, the right-lateralized functional connections were between the occipital and inferior/middle frontal regions among other connections, whereas the left-lateralized functional connections were among fusiform gyrus and inferior frontal and inferior/superior parietal regions. Within the task-negative network, the left-lateralized connections were mainly between the precuneus and medial prefrontal regions. Specific brain regions exhibited different left- or right-lateralized connections with other regions, which suggest the importance of reporting lateralized connections over lateralized seed regions. The mean lateralization indices of the left- and right-lateralized connections were correlated, suggesting that the lateralization of connectivity may result from complementary processes between the lateralized networks. The potential functions of the lateralized networks were discussed.

Aggressive vocal expressions-an investigation of their underlying neural network

Recent neural network models for the production of primate vocalizations are largely based on research in nonhuman primates. These models seem yet not fully capable of explaining the neural network dynamics especially underlying different types of human vocalizations. Unlike animal vocalizations, human affective vocalizations might involve higher levels of vocal control and monitoring demands, especially in case of more complex vocal expressions of emotions superimposed on speech. Here we therefore investigated the functional cortico-subcortical network underlying different types (evoked vs. repetition) of producing human affective vocalizations in terms of affective prosody, especially examining the aggressive tone of a voice while producing meaningless speech-like utterances. Functional magnetic resonance imaging revealed, first, that bilateral auditory cortices showed a close functional interconnectivity during affective vocalizations pointing to a bilateral exchange of relevant acoustic information of produced vocalizations. Second, bilateral motor cortices (MC) that directly control vocal motor behavior showed functional connectivity to the right inferior frontal gyrus (IFG) and the right superior temporal gyrus (STG). Thus, vocal motor behavior during affective vocalizations seems to be controlled by a right lateralized network that provides vocal monitoring (IFG), probably based on auditory feedback processing (STG). Third, the basal ganglia (BG) showed both positive and negative modulatory connectivity with several frontal (ACC, IFG) and temporal brain regions (STG). Finally, the repetition of affective prosody compared to evoked vocalizations revealed a more extended neural network probably based on higher control and vocal monitoring demands. Taken together, the functional brain network underlying human affective vocalizations revealed several features that have been so far neglected in models of primate vocalizations.

Vocal acoustic analysis as a biometric indicator of information processing: implications for neurological and psychiatric disorders

Vocal expression reflects an integral component of communication that varies considerably within individuals across contexts and is disrupted in a range of neurological and psychiatric disorders. There is reason to suspect that variability in vocal expression reflects, in part, the availability of "on-line" resources (e.g., working memory, attention). Thus, understanding vocal expression is a potentially important biometric index of information processing, not only across but within individuals over time. A first step in this line of research involves establishing a link between vocal expression and information processing systems in healthy adults. The present study employed a dual attention experimental task where participants provided natural speech while simultaneously engaged in a baseline, medium or high nonverbal processing-load task. Objective, automated, and computerized analysis was employed to measure vocal expression in 226 adults. Increased processing load resulted in longer pauses, fewer utterances, greater silence overall and less variability in frequency and intensity levels. These results provide compelling evidence of a link between information processing resources and vocal expression, and provide important information for the development of an automated, inexpensive and uninvasive biometric measure of information processing.

Auditory agnosia

Auditory agnosia refers to impairments in sound perception and identification despite intact hearing, cognitive functioning, and language abilities (reading, writing, and speaking). Auditory agnosia can be general, affecting all types of sound perception, or can be (relatively) specific to a particular domain. Verbal auditory agnosia (also known as (pure) word deafness) refers to deficits specific to speech processing, environmental sound agnosia refers to difficulties confined to non-speech environmental sounds, and amusia refers to deficits confined to music. These deficits can be apperceptive, affecting basic perceptual processes, or associative, affecting the relation of a perceived auditory object to its meaning. This chapter discusses what is known about the behavioral symptoms and lesion correlates of these different types of auditory agnosia (focusing especially on verbal auditory agnosia), evidence for the role of a rapid temporal processing deficit in some aspects of auditory agnosia, and the few attempts to treat the perceptual deficits associated with auditory agnosia. A clear picture of auditory agnosia has been slow to emerge, hampered by the considerable heterogeneity in behavioral deficits, associated brain damage, and variable assessments across cases. Despite this lack of clarity, these striking deficits in complex sound processing continue to inform our understanding of auditory perception and cognition.

Atypical right hemispheric functioning in the euthymic state of bipolar affective disorder

Bipolar disorder (BD) has been associated with right hemisphere dysfunction. These findings usually come from studies that have not distinguished between symptomatic and euthymic states of BD. The present study aims to investigate atypical right (and left) hemispheric functioning in euthymic BD patients. We evaluated 40 participants (18 healthy controls and 22 euthymic BD patients) using an emotional prosody dichotic listening task and a linguistic dichotic listening task which have been shown to produce a strong left ear advantage (LEA) and right ear advantage (REA), indicating a right and left hemisphere superiority, respectively. The results replicate the well-known LEA in emotional prosody for healthy controls. In contrast, no ear advantage was found for emotional prosody in euthymic BD patients. Both groups revealed the well-established REA in the linguistic dichotic listening task. The patient group was heterogeneous with regard to medication, as it consisted of patients with a variety of pharmacological treatments. The results are in line with previous studies in symptomatic BD patients, and suggest that atypical LEA in emotional prosody can be interpreted as a neurobehavioral vulnerability marker of emotional dysregulation and dysfunction in the right hemispheric fronto-temporal network in both symptomatic and euthymic BD patients.

Hemispheric asymmetry in the formation of musical pitch expectations: a monaural listening and probe tone study

This study investigated hemispheric asymmetry in the formation of musical pitch expectations by combining the monaural listening and probe tone paradigms. On each trial, adult participants heard a short context melody and a single pitch (i.e. a probe tone). Both the context and the probe tone were played in the left or right ear. The context was an ascending major scale or pitches from the major scale in a random order. Following each context, participants rated one of three probe tones for how well it fit with the context they just heard. Probe tones were one of two pitches from the major scale (the tonic or the supertonic) or an out-of-set pitch. Participants provided the highest ratings for the tonic, followed by the supertonic, followed by the out-of-set pitch. Ratings did not differ for the tonic or out-of-set pitch between the two ears, but participants provided lower ratings for the supertonic in the right ear. For the ascending context only, the difference in ratings between the tonic and supertonic was greater in the right ear. These results suggest that the left hemisphere differentiates the stability of pitches in a set by forming temporal expectations for specific, in-set pitches.

Manual praxis in stone tool manufacture: implications for language evolution

Alternative functions of the left-hemisphere dominant Broca's region have induced hypotheses regarding the evolutionary parallels between manual praxis and language in humans. Many recent studies on Broca's area reveal several assumptions about the cognitive mechanisms that underlie both functions, including: (1) an accurate, finely controlled body schema, (2) increasing syntactical abilities, particularly for goal-oriented actions, and (3) bilaterality and fronto-parietal connectivity. Although these characteristics are supported by experimental paradigms, many researchers have failed to acknowledge a major line of evidence for the evolutionary development of these traits: stone tools. The neuroscience of stone tool manufacture is a viable proxy for understanding evolutionary aspects of manual praxis and language, and may provide key information for evaluating competing hypotheses on the co-evolution of these cognitive domains in our species.