Music and emotion: Electrophysiological correlates of the processing of pleasant and unpleasant music

Do you hear the same? Cardiorespiratory responses between mothers and infants during tonal and atonal music

This study examined the effects of tonal and atonal music on respiratory sinus arrhythmia (RSA) in 40 mothers and their 3-month-old infants. The tonal music fragment was composed using the structure of a harmonic series that corresponds with the pitch ratio characteristics of mother–infant vocal dialogues. The atonal fragment did not correspond with a tonal structure. Mother–infant ECG and respiration were registered along with simultaneous video recordings. RR-interval, respiration rate, and RSA were calculated. RSA was corrected for any confounding respiratory and motor activities. The results showed that the infants’ and the mothers’ RSA-responses to the tonal and atonal music differed. The infants showed significantly higher RSA-levels during the tonal fragment than during the atonal fragment and baseline, suggesting increased vagal activity during tonal music. The mothers showed RSA-responses that were equal to their infants only when the infants were lying close to their bodies and when they heard the difference between the two fragments, preferring the tonal above the atonal fragment. The results are discussed with regard to music-related topics, psychophysiological integration and mother-infant vocal interaction processes.

Distinct iEEG activity patterns in temporal-limbic and prefrontal sites induced by emotional intentionality

Our emotions tend to be directed towards someone or something. Such emotional intentionality calls for the integration between two streams of information; abstract hedonic value and its associated concrete content. In a previous functional magnetic resonance imaging (fMRI) study we found that the combination of these two streams, as modeled by short emotional music excerpts and neutral film clips, was associated with synergistic activation in both temporal-limbic (TL) and ventral-lateral PFC (vLPFC) regions. This additive effect implies the integration of domain-specific 'affective' and 'cognitive' processes. Yet, the low temporal resolution of the fMRI limits the characterization of such cross-domain integration. To this end, we complemented the fMRI data with intracranial electroencephalogram (iEEG) recordings from twelve patients with intractable epilepsy. As expected, the additive fMRI activation in the amygdala and vLPFC was associated with distinct spatio-temporal iEEG patterns among electrodes situated within the vicinity of the fMRI activation foci. On the one hand, TL channels exhibited a transient (0-500 msec) increase in gamma power (61-69 Hz), possibly reflecting initial relevance detection or hedonic value tagging. On the other hand, vLPFC channels showed sustained (1-12 sec) suppression of low frequency power (2.3-24 Hz), possibly mediating changes in gating, enabling an on-going readiness for content-based processing of emotionally tagged signals. Moreover, an additive effect in delta-gamma phase-amplitude coupling (PAC) was found among the TL channels, possibly reflecting the integration between distinct domain specific processes. Together, this study provides a multi-faceted neurophysiological signature for computations that possibly underlie emotional intentionality in humans.

An Intracranial EEG Study of the Neural Dynamics of Musical Valence Processing

The processing of valence is known to recruit the amygdala, orbitofrontal cortex, and relevant sensory areas. However, how these regions interact remains unclear. We recorded cortical electrical activity from 7 epileptic patients implanted with depth electrodes for presurgical evaluation while they listened to positively and negatively valenced musical chords. Time-frequency analysis suggested a specific role of the orbitofrontal cortex in the processing of positively valenced stimuli while, most importantly, Granger causality analysis revealed that the amygdala tends to drive both the orbitofrontal cortex and the auditory cortex in theta and alpha frequency bands, during the processing of valenced stimuli. Results from the current study show the amygdala to be a critical hub in the emotion processing network: specifically one that influences not only the higher order areas involved in the evaluation of a stimulus's emotional value but also the sensory cortical areas involved in the processing of its low-level acoustic features.

Enhanced response to music in pregnancy

Given a possible effect of estrogen on the pleasure-mediating dopaminergic system, musical appreciation in participants whose estrogen levels are naturally elevated during the oral contraceptive cycle and pregnancy has been investigated (n = 32, 15 pregnant, 17 nonpregnant; mean age 27.2). Results show more pronounced blood pressure responses to music in pregnant women. However, estrogen level differences during different phases of oral contraceptive intake did not have any effect, indicating that the observed changes were not related to estrogen. Effects of music on blood pressure were independent of valence, and dissonance elicited the greatest drop in blood pressure. Thus, the enhanced physiological response in pregnant women probably does not reflect a protective mechanism to avoid unpleasantness. Instead, this enhanced response is discussed in terms of a facilitation of prenatal conditioning to acoustical (musical) stimuli.

Fusion of electroencephalographic dynamics and musical contents for estimating emotional responses in music listening

Electroencephalography (EEG)-based emotion classification during music listening has gained increasing attention nowadays due to its promise of potential applications such as musical affective brain-computer interface (ABCI), neuromarketing, music therapy, and implicit multimedia tagging and triggering. However, music is an ecologically valid and complex stimulus that conveys certain emotions to listeners through compositions of musical elements. Using solely EEG signals to distinguish emotions remained challenging. This study aimed to assess the applicability of a multimodal approach by leveraging the EEG dynamics and acoustic characteristics of musical contents for the classification of emotional valence and arousal. To this end, this study adopted machine-learning methods to systematically elucidate the roles of the EEG and music modalities in the emotion modeling. The empirical results suggested that when whole-head EEG signals were available, the inclusion of musical contents did not improve the classification performance. The obtained performance of 74~76% using solely EEG modality was statistically comparable to that using the multimodality approach. However, if EEG dynamics were only available from a small set of electrodes (likely the case in real-life applications), the music modality would play a complementary role and augment the EEG results from around 61-67% in valence classification and from around 58-67% in arousal classification. The musical timber appeared to replace less-discriminative EEG features and led to improvements in both valence and arousal classification, whereas musical loudness was contributed specifically to the arousal classification. The present study not only provided principles for constructing an EEG-based multimodal approach, but also revealed the fundamental insights into the interplay of the brain activity and musical contents in emotion modeling.

Classifying different emotional states by means of EEG-based functional connectivity patterns

This study aimed to classify different emotional states by means of EEG-based functional connectivity patterns. Forty young participants viewed film clips that evoked the following emotional states: neutral, positive, or negative. Three connectivity indices, including correlation, coherence, and phase synchronization, were used to estimate brain functional connectivity in EEG signals. Following each film clip, participants were asked to report on their subjective affect. The results indicated that the EEG-based functional connectivity change was significantly different among emotional states. Furthermore, the connectivity pattern was detected by pattern classification analysis using Quadratic Discriminant Analysis. The results indicated that the classification rate was better than chance. We conclude that estimating EEG-based functional connectivity provides a useful tool for studying the relationship between brain activity and emotional states.

On the analysis of EEG power, frequency and asymmetry in Parkinson's disease during emotion processing

OBJECTIVE

While Parkinson's disease (PD) has traditionally been described as a movement disorder, there is growing evidence of disruption in emotion information processing associated with the disease. The aim of this study was to investigate whether there are specific electroencephalographic (EEG) characteristics that discriminate PD patients and normal controls during emotion information processing.

METHOD

EEG recordings from 14 scalp sites were collected from 20 PD patients and 30 age-matched normal controls. Multimodal (audio-visual) stimuli were presented to evoke specific targeted emotional states such as happiness, sadness, fear, anger, surprise and disgust. Absolute and relative power, frequency and asymmetry measures derived from spectrally analyzed EEGs were subjected to repeated ANOVA measures for group comparisons as well as to discriminate function analysis to examine their utility as classification indices. In addition, subjective ratings were obtained for the used emotional stimuli.

RESULTS

Behaviorally, PD patients showed no impairments in emotion recognition as measured by subjective ratings. Compared with normal controls, PD patients evidenced smaller overall relative delta, theta, alpha and beta power, and at bilateral anterior regions smaller absolute theta, alpha, and beta power and higher mean total spectrum frequency across different emotional states. Inter-hemispheric theta, alpha, and beta power asymmetry index differences were noted, with controls exhibiting greater right than left hemisphere activation. Whereas intra-hemispheric alpha power asymmetry reduction was exhibited in patients bilaterally at all regions. Discriminant analysis correctly classified 95.0% of the patients and controls during emotional stimuli.

CONCLUSION

These distributed spectral powers in different frequency bands might provide meaningful information about emotional processing in PD patients.

Professional musicians listen differently to music

INTRODUCTION

Experience-based adaptation of emotional responses is an important faculty for cognitive and emotional functioning. Professional musicians represent an ideal model in which to elicit experience-driven changes in the emotional processing domain. The changes of the central representation of emotional arousal due to musical expertise are still largely unknown. The aim of the present study was to investigate the electroencephalogram (EEG) correlates of experience-driven changes in the domain of emotional arousal. Therefore, the differences in perceived (subjective arousal via ratings) and physiologically measured (EEG) arousal between amateur and professional musicians were examined.

PROCEDURE

A total of 15 professional and 19 amateur musicians listened to the first movement of Ludwig van Beethoven's 5th symphony (duration=∼7.4min), during which a continuous 76-channel EEG was recorded. In a second session, the participants evaluated their emotional arousal during listening. In a tonic analysis, we examined the average EEG data over the time course of the music piece. For a phasic analysis, a fast Fourier transform was performed and covariance maps of spectral power were computed in association with the subjective arousal ratings.

RESULTS

The subjective arousal ratings of the professional musicians were more consistent than those of the amateur musicians. In the tonic EEG analysis, a mid-frontal theta activity was observed in the professionals. In the phasic EEG, the professionals exhibited an increase of posterior alpha, central delta, and beta rhythm during high arousal.

DISCUSSION

Professionals exhibited different and/or more intense patterns of emotional activation when they listened to the music. The results of the present study underscore the impact of music experience on emotional reactions.

Emotion classification in Parkinson's disease by higher-order spectra and power spectrum features using EEG signals: a comparative study

Deficits in the ability to process emotions characterize several neuropsychiatric disorders and are traits of Parkinson's disease (PD), and there is need for a method of quantifying emotion, which is currently performed by clinical diagnosis. Electroencephalogram (EEG) signals, being an activity of central nervous system (CNS), can reflect the underlying true emotional state of a person. This study applied machine-learning algorithms to categorize EEG emotional states in PD patients that would classify six basic emotions (happiness and sadness, fear, anger, surprise and disgust) in comparison with healthy controls (HC). Emotional EEG data were recorded from 20 PD patients and 20 healthy age-, education level- and sex-matched controls using multimodal (audio-visual) stimuli. The use of nonlinear features motivated by the higher-order spectra (HOS) has been reported to be a promising approach to classify the emotional states. In this work, we made the comparative study of the performance of k-nearest neighbor (kNN) and support vector machine (SVM) classifiers using the features derived from HOS and from the power spectrum. Analysis of variance (ANOVA) showed that power spectrum and HOS based features were statistically significant among the six emotional states (p < 0.0001). Classification results shows that using the selected HOS based features instead of power spectrum based features provided comparatively better accuracy for all the six classes with an overall accuracy of 70.10% ± 2.83% and 77.29% ± 1.73% for PD patients and HC in beta (13-30 Hz) band using SVM classifier. Besides, PD patients achieved less accuracy in the processing of negative emotions (sadness, fear, anger and disgust) than in processing of positive emotions (happiness, surprise) compared with HC. These results demonstrate the effectiveness of applying machine learning techniques to the classification of emotional states in PD patients in a user independent manner using EEG signals. The accuracy of the system can be improved by investigating the other HOS based features. This study might lead to a practical system for noninvasive assessment of the emotional impairments associated with neurological disorders.

Revealing spatio-spectral electroencephalographic dynamics of musical mode and tempo perception by independent component analysis

Background

Music conveys emotion by manipulating musical structures, particularly musical mode- and tempo-impact. The neural correlates of musical mode and tempo perception revealed by electroencephalography (EEG) have not been adequately addressed in the literature.

Method

This study used independent component analysis (ICA) to systematically assess spatio-spectral EEG dynamics associated with the changes of musical mode and tempo.

Results

Empirical results showed that music with major mode augmented delta-band activity over the right sensorimotor cortex, suppressed theta activity over the superior parietal cortex, and moderately suppressed beta activity over the medial frontal cortex, compared to minor-mode music, whereas fast-tempo music engaged significant alpha suppression over the right sensorimotor cortex.

Conclusion

The resultant EEG brain sources were comparable with previous studies obtained by other neuroimaging modalities, such as functional magnetic resonance imaging (fMRI) and positron emission tomography (PET). In conjunction with advanced dry and mobile EEG technology, the EEG results might facilitate the translation from laboratory-oriented research to real-life applications for music therapy, training and entertainment in naturalistic environments.

EEG changes caused by spontaneous facial self-touch may represent emotion regulating processes and working memory maintenance

Spontaneous facial self-touch gestures (sFSTG) are performed manifold every day by every human being, primarily in stressful situations. These movements are not usually designed to communicate and are frequently accomplished with little or no awareness. The aim of the present study was to investigate whether sFSTG are associated with specific changes in the electrical brain activity that might indicate an involvement of regulatory emotional processes and working memory. Fourteen subjects performed a delayed memory task of complex haptic stimuli. The stimuli had to be explored and then remembered for a retention interval of 5min. The retention interval was interrupted by unpleasant sounds from The International Affective Digitized Sounds and short sound-free periods. During the experiment a video stream of behavior, 19-channel EEG, and EMG (of forearm muscles) were recorded. Comparisons of the behavioral data and spectral power of different EEG frequency bands (theta, alpha, beta, and gamma) were conducted. An increase of sFSTG during the application of unpleasant sounds was observed. A significant increase of spectral theta and beta power was observed after exploration of the stimuli as well as after sFSTG in centro-parietal electrodes. The spectral theta power extremely decreased just before sFSTG during the retention interval. Contrary to this, no significant changes were detected in any of the frequencies when the spectral power before and after instructed facial self-touch movements (b-iFSTG and a-iFSTG) were compared. The changes of spectral theta power in the intervals before and after sFSTG in centro-parietal electrodes imply that sFSTG are associated with cortical regulatory processes in the domains of working memory and emotions.

Neurophysiological and behavioral responses to music therapy in vegetative and minimally conscious States

Assessment of awareness for those with disorders of consciousness is a challenging undertaking, due to the complex presentation of the population. Debate surrounds whether behavioral assessments provide greatest accuracy in diagnosis compared to neuro-imaging methods, and despite developments in both, misdiagnosis rates remain high. Music therapy may be effective in the assessment and rehabilitation with this population due to effects of musical stimuli on arousal, attention, and emotion, irrespective of verbal or motor deficits. However, an evidence base is lacking as to which procedures are most effective. To address this, a neurophysiological and behavioral study was undertaken comparing electroencephalogram (EEG), heart rate variability, respiration, and behavioral responses of 20 healthy subjects with 21 individuals in vegetative or minimally conscious states (VS or MCS). Subjects were presented with live preferred music and improvised music entrained to respiration (procedures typically used in music therapy), recordings of disliked music, white noise, and silence. ANOVA tests indicated a range of significant responses (p ≤ 0.05) across healthy subjects corresponding to arousal and attention in response to preferred music including concurrent increases in respiration rate with globally enhanced EEG power spectra responses (p = 0.05-0.0001) across frequency bandwidths. Whilst physiological responses were heterogeneous across patient cohorts, significant post hoc EEG amplitude increases for stimuli associated with preferred music were found for frontal midline theta in six VS and four MCS subjects, and frontal alpha in three VS and four MCS subjects (p = 0.05-0.0001). Furthermore, behavioral data showed a significantly increased blink rate for preferred music (p = 0.029) within the VS cohort. Two VS cases are presented with concurrent changes (p ≤ 0.05) across measures indicative of discriminatory responses to both music therapy procedures. A third MCS case study is presented highlighting how more sensitive selective attention may distinguish MCS from VS. The findings suggest that further investigation is warranted to explore the use of music therapy for prognostic indicators, and its potential to support neuroplasticity in rehabilitation programs.

Effects of voice on emotional arousal

Music is a powerful medium capable of eliciting a broad range of emotions. Although the relationship between language and music is well documented, relatively little is known about the effects of lyrics and the voice on the emotional processing of music and on listeners' preferences. In the present study, we investigated the effects of vocals in music on participants' perceived valence and arousal in songs. Participants (N = 50) made valence and arousal ratings for familiar songs that were presented with and without the voice. We observed robust effects of vocal content on perceived arousal. Furthermore, we found that the effect of the voice on enhancing arousal ratings is independent of familiarity of the song and differs across genders and age: females were more influenced by vocals than males; furthermore these gender effects were enhanced among older adults. Results highlight the effects of gender and aging in emotion perception and are discussed in terms of the social roles of music.

From understanding to appreciating music cross-culturally

It has long been debated which aspects of music perception are universal and which are developed only after exposure to a specific musical culture. Here we investigated whether “iconic” meaning in Western music, emerging from musical information resembling qualities of objects, or qualities of abstract concepts, can be recognized cross-culturally. To this end we acquired a profile of semantic associations (such as, for example, fight, river, etc.) to Western musical pieces from each participant, and then compared these profiles across cultural groups. Results show that the association profiles between Mafa, an ethnic group from northern Cameroon, and Western listeners are different, but that the Mafa have a consistent association profile, indicating that their associations are strongly informed by their enculturation. Results also show that listeners for whom Western music is novel, but whose association profile was more similar to the mean Western music association profile also had a greater appreciation of the Western music. The data thus show that, to some degree, iconic meaning transcends cultural boundaries, with a high inter-individual variance, probably because meaning in music is prone to be overwritten by individual and cultural experience.

Music and emotion: an EEG connectivity study in patients with disorders of consciousness

Human emotion perception is a topic of great interest for both cognitive and clinical neuroscience, but its electrophysiological correlates are still poorly understood. The present study is aimed at evaluating if measures of synchronization and indexes based on graph-theory are a tool suitable to study and quantify electrophysiological changes due to emotional stimuli perception. In particular, our study is aimed at evaluating if different EEG connectivity patterns can be induced by pleasant (consonant) or unpleasant (dissonant) music, in a population of healthy subjects, and in patients with severe disorders of consciousness (DOCs), namely vegetative state (VS) patients. In the control group, pleasant music induced an increase in network number of connections, compared with the resting condition, while no changes were caused by the unpleasant stimuli. However, clustering coefficient and path length, two indexes derived from graph theory, able to characterise segregation and integration properties of a network, were not affected by the stimuli, neither pleasant nor unpleasant. In the VS group, changes were found only in those patients with the less severe consciousness impairment, according to the clinical assessment. In these patients a stronger synchronization was found during the unpleasant condition; moreover we observed changes in the network topology, with decreased values of clustering coefficient and path length during both musical stimuli.Our results show that measures of synchronization can provide new insights into the study of the electro physiological correlates of emotion perception, indicating that these tools can be used to study patients with DOCs, in whom the issue of objective measures and quantification of the degree of impairment is still an open and unsolved question.

Anatomical differences in the human inferior colliculus relate to the perceived valence of musical consonance and dissonance

Helmholtz himself speculated about a role of the cochlea in the perception of musical dissonance. Here we indirectly investigated this issue, assessing the valence judgment of musical stimuli with variable consonance/dissonance and presented diotically (exactly the same dissonant signal was presented to both ears) or dichotically (a consonant signal was presented to each ear--both consonant signals were rhythmically identical but differed by a semitone in pitch). Differences in brain organisation underlying inter-subject differences in the percept of dichotically presented dissonance were determined with voxel-based morphometry. Behavioral results showed that diotic dissonant stimuli were perceived as more unpleasant than dichotically presented dissonance, indicating that interactions within the cochlea modulated the valence percept during dissonance. However, the behavioral data also suggested that the dissonance percept did not depend crucially on the cochlea, but also occurred as a result of binaural integration when listening to dichotic dissonance. These results also showed substantial between-participant variations in the valence response to dichotic dissonance. These differences were in a voxel-based morphometry analysis related to differences in gray matter density in the inferior colliculus, which strongly substantiated a key role of the inferior colliculus in consonance/dissonance representation in humans.

Brain oscillations and electroencephalography scalp networks during tempo perception

In the current study we used electroencephalography (EEG) to investigate the relation between musical tempo perception and the oscillatory activity in specific brain regions, and the scalp EEG networks in the theta, alpha, and beta bands. The results showed that the theta power at the frontal midline decreased with increased arousal level related to tempo. The alpha power induced by original music at the bilateral occipital-parietal regions was stronger than that by tempo-transformed music. The beta power did not change with tempo. At the network level, the original music-related alpha network had high global efficiency and the optimal path length. This study was the first to use EEG to investigate multi-oscillatory activities and the data support the tempo-specific timing hypothesis.

Cognitive-neural effects of brush writing of chinese characters: cortical excitation of theta rhythm

Chinese calligraphy has been scientifically investigated within the contexts and principles of psychology, cognitive science, and the cognitive neuroscience. On the basis of vast amount of research in the last 30 years, we have developed a cybernetic theory of handwriting and calligraphy to account for the intricate interactions of several psychological dimensions involved in the dynamic act of graphic production. Central to this system of writing are the role of sensory, bio-, cognitive, and neurofeedback mechanisms for the initiation, guidance, and regulation of the writing motions vis-a-vis visual-geometric variations of Chinese characters. This experiment provided the first evidence of cortical excitation in EEG theta wave as a neural hub that integrates information coming from changes in the practitioner's body, emotions, and cognition. In addition, it has also confirmed neurofeedback as an essential component of the cybernetic theory of handwriting and calligraphy.

A review on the computational methods for emotional state estimation from the human EEG

A growing number of affective computing researches recently developed a computer system that can recognize an emotional state of the human user to establish affective human-computer interactions. Various measures have been used to estimate emotional states, including self-report, startle response, behavioral response, autonomic measurement, and neurophysiologic measurement. Among them, inferring emotional states from electroencephalography (EEG) has received considerable attention as EEG could directly reflect emotional states with relatively low costs and simplicity. Yet, EEG-based emotional state estimation requires well-designed computational methods to extract information from complex and noisy multichannel EEG data. In this paper, we review the computational methods that have been developed to deduct EEG indices of emotion, to extract emotion-related features, or to classify EEG signals into one of many emotional states. We also propose using sequential Bayesian inference to estimate the continuous emotional state in real time. We present current challenges for building an EEG-based emotion recognition system and suggest some future directions.

Individual visual working memory capacities and related brain oscillatory activities are modulated by color preferences

Subjective preferences affect many processes, including motivation, along with individual differences. Although incentive motivations are proposed to increase our limited visual working memory (VWM) capacity, much less is known about the effects of subjective preferences on VWM-related brain systems, such as the prefrontal and parietal cortices. Here, we investigate the differences in VWM capacities and brain activities during presentation of preferred and non-preferred colors. To this end, we used time-frequency (TF) analyses of electroencephalograph (EEG) data recorded during a delayed-response task. Behavioral results showed that the individual VWM capacities of preferred colors were significantly higher than those of non-preferred colors. The EEG results showed that the frontal theta and beta amplitudes for maintenance of preferred colors were higher than those of non-preferred colors. Interestingly, the frontal beta amplitudes were consistent with recent EEG recordings of the effects of reward on VWM systems, in that they were strongly and individually correlated with increasing VWM capacities from non-preferred to preferred colors. These results suggest that subjective preferences affect VWM systems in a similar manner to reward-incentive motivations.

Conditioned place preference and aversion for music in a virtual reality environment

The use of a virtual reality environment (VRE) enables behavioral scientists to create different spatial contexts in which human participants behave freely, while still confined to the laboratory. In this article, VRE was used to study conditioned place preference (CPP) and aversion (CPA). In Experiment 1, half of the participants were asked to visit a house for 2 min with consonant music and then they were asked to visit an alternate house with static noise for 2 min, whereas the remaining participants did the visits in reverse order. In Experiment 2, we used the same design as Experiment 1, except for replacing consonant music with dissonant music. After conditioning in both experiments, the participants were given a choice between spending time in the two houses. In Experiment 1, participants spent more time in the house associated with the consonant music, thus showing a CPP toward that house. In Experiment 2, participants spent less time in the house associated with the dissonant music, thus showing a CPA for that house. These results support VRE as a tool to extend research on CPP/CPA in humans.

Toward an EEG-based recognition of music liking using time-frequency analysis

Affective phenomena, as reflected through brain activity, could constitute an effective index for the detection of music preference. In this vein, this paper focuses on the discrimination between subjects' electroencephalogram (EEG) responses to self-assessed liked or disliked music, acquired during an experimental procedure, by evaluating different feature extraction approaches and classifiers to this end. Feature extraction is based on time-frequency (TF) analysis by implementing three TF techniques, i.e., spectrogram, Zhao-Atlas-Marks distribution and Hilbert-Huang spectrum (HHS). Feature estimation also accounts for physiological parameters that relate to EEG frequency bands, reference states, time intervals, and hemispheric asymmetries. Classification is performed by employing four classifiers, i.e., support vector machines, k-nearest neighbors (k -NN), quadratic and Mahalanobis distance-based discriminant analyses. According to the experimental results across nine subjects, best classification accuracy {86.52 (±0.76)%} was achieved using k-NN and HHS-based feature vectors ( FVs) representing a bilateral average activity, referred to a resting period, in β (13-30 Hz) and γ (30-49 Hz) bands. Activity in these bands may point to a connection between music preference and emotional arousal phenomena. Furthermore, HHS-based FVs were found to be robust against noise corruption. The outcomes of this study provide early evidence and pave the way for the development of a generalized brain computer interface for music preference recognition.

Music therapy modulates fronto-temporal activity in rest-EEG in depressed clients

Fronto-temporal areas process shared elements of speech and music. Improvisational psychodynamic music therapy (MT) utilizes verbal and musical reflection on emotions and images arising from clinical improvisation. Music listening is shifting frontal alpha asymmetries (FAA) in depression, and increases frontal midline theta (FMT). In a two-armed randomized controlled trial (RCT) with 79 depressed clients (with comorbid anxiety), we compared standard care (SC) versus MT added to SC at intake and after 3 months. We found that MT significantly reduced depression and anxiety symptoms. The purpose of this study is to test whether or not MT has an impact on anterior fronto-temporal resting state alpha and theta oscillations. Correlations between anterior EEG, Montgomery-Åsberg Depression Rating Scale (MADRS) and the Hospital Anxiety and Depression Scale-Anxiety Subscale (HADS-A), power spectral analysis (topography, means, asymmetry) and normative EEG database comparisons were explored. After 3 month of MT, lasting changes in resting EEG were observed, i.e., significant absolute power increases at left fronto-temporal alpha, but most distinct for theta (also at left fronto-central and right temporoparietal leads). MT differed to SC at F7-F8 (z scored FAA, p < .03) and T3-T4 (theta, p < .005) asymmetry scores, pointing towards decreased relative left-sided brain activity after MT; pre/post increased FMT and decreased HADS-A scores (r = .42, p < .05) indicate reduced anxiety after MT. Verbal reflection and improvising on emotions in MT may induce neural reorganization in fronto-temporal areas. Alpha and theta changes in fronto-temporal and temporoparietal areas indicate MT action and treatment effects on cortical activity in depression, suggesting an impact of MT on anxiety reduction.

The utility of EEG band power analysis in the study of infancy and early childhood

Research employing electroencephalographic (EEG) techniques with infants and young children has flourished in recent years due to increased interest in understanding the neural processes involved in early social and cognitive development. This review focuses on the functional characteristics of the alpha, theta, and gamma frequency bands in the developing EEG. Examples of how analyses of EEG band power have been applied to specific lines of developmental research are also discussed. These examples include recent work on the infant mu rhythm and action processing, frontal alpha asymmetry and approach-withdrawal tendencies, and EEG power measures in the study of early psychosocial adversity.

Towards wireless emotional valence detection from EEG

Intelligent affective computers can have many medical and non-medical applications. However today's affective computers are limited in scope by their transferability to other application environments or that they monitor only one aspect of physiological emotion expression. Here, the use of a wireless EEG system, which can be implemented in a body area network, is used to investigate the potential of monitoring emotional valence in EEG, for application in real-life situations. The results show 82% accuracy for automatic classification of positive, negative and neutral valence based on film clip viewing, using features containing information on both the frequency content of the EEG and how this changes over time.

Dynamic modulation of emotional processing

Recent findings suggest the processing of emotional stimuli is prioritized compared to neutral stimuli; however, it is not necessarily automatic and depends on several modulating factors. The current paper highlights three major factors that affect the reactions to emotional stimuli: (i) stimulus properties, (ii) task demands and attention, and (iii) individual characteristics. The evidence reviewed here suggests that individual characteristics shape the structure, function and connectivity within a neural network that is involved in the reactions to emotional stimuli. This neural network includes regions related to emotion and attention, in line with evidence for reciprocal connections between these two processes. Activation in this network further depends on the emotional value of a certain item, as well as physical features of the stimulus. This integrative view can lead to better understanding of the underlying mechanisms of emotional reactions, as well as better therapeutic approaches.

Personality correlates of reporting Chinese words from the Deutsch "high-low" word illusion by Chinese-speaking people

OBJECTIVE

When English-speaking people listen to the Deutsch "high-low" word illusion, they report hearing English words. Whether Chinese-speaking people report Chinese words when listening to the illusion, or whether any reported words might be correlated with personality traits as previous investigations have demonstrated for listening to music in other cultures, is open to question. The present study aimed to address this.

METHODS

A total of 308 right-handed, healthy volunteers (177 women and 131 men) were given the illusion test and asked to answer the Zuckerman-Kuhlman personality questionnaire (ZKPQ). Their depressive tendency was measured by the Plutchik-van Praag depression inventory (PVP).

RESULTS

There was no gender effect regarding either the PVP score or the number of reported Chinese words from the illusion. Women scored higher on ZKPQ neuroticism-anxiety than men. The number of meaningful Chinese words reported was correlated with the ZKPQ impulsive sensation-seeking, aggression-hostility, and activity scores. Some words reported by participants who scored higher on these three traits were related in meaning to those scales.

CONCLUSION

Our preliminary results suggest that when Chinese-speaking people listen to the Deutsch "high-low" word illusion, they might use personality-related, specific cognitive schemata.

The contribution of sound intensity in vocal emotion perception: behavioral and electrophysiological evidence

Although its role is frequently stressed in acoustic profile for vocal emotion, sound intensity is frequently regarded as a control parameter in neurocognitive studies of vocal emotion, leaving its role and neural underpinnings unclear. To investigate these issues, we asked participants to rate the angry level of neutral and angry prosodies before and after sound intensity modification in Experiment 1, and recorded electroencephalogram (EEG) for mismatching emotional prosodies with and without sound intensity modification and for matching emotional prosodies while participants performed emotional feature or sound intensity congruity judgment in Experiment 2. It was found that sound intensity modification had significant effect on the rating of angry level for angry prosodies, but not for neutral ones. Moreover, mismatching emotional prosodies, relative to matching ones, induced enhanced N2/P3 complex and theta band synchronization irrespective of sound intensity modification and task demands. However, mismatching emotional prosodies with reduced sound intensity showed prolonged peak latency and decreased amplitude in N2/P3 complex and smaller theta band synchronization. These findings suggest that though it cannot categorically affect emotionality conveyed in emotional prosodies, sound intensity contributes to emotional significance quantitatively, implying that sound intensity should not simply be taken as a control parameter and its unique role needs to be specified in vocal emotion studies.

Influences of audio-visual environments on feelings of deliciousness during having sweet foods: an electroencephalogram frequency analysis study

Feelings of deliciousness during having foods are mainly produced by perceptions of sensory information extracted from foods themselves, such as taste and olfaction. However, environmental factors might modify the feeling of deliciousness. In the present study, we investigated how the condition of audio-visual environments affects the feeling of deliciousness during having sweet foods. Electroencephalograms (EEGs) were recorded from the frontal region of the scalp of healthy participants under virtual scenes of tearoom and construction work, respectively. The participants were asked to rate deliciousness after the recordings. Frequency analyses were performed from the EEGs. During having the foods, occupancy rates of beta frequency band between tearoom scenes and construction work scenes were markedly different, but not in other frequency bands. During having no food, in contrast, there was no difference of occupancy rates in respective frequency bands between the two different scenes. With regard to deliciousness during having sweet foods, all participants rated high scores under the scenes of tearoom than those under the scenes of construction work. Interestingly, there is a positive correlation between occupancy rates of beta frequency band and scores of deliciousness. These findings suggest that comfortable audio-visual environments play an important role in increasing the feeling of deliciousness during having sweet foods, in which beta frequency rhythms may be concerned with producing comprehensive feelings of deliciousness.

Effects of subjective preference of colors on attention-related occipital theta oscillations

Human daily behaviors are often affected by subjective preferences. Studies have shown that physical responses are affected by unconscious preferences before conscious decision making. Accordingly, attention-related neural activities could be influenced by unconscious preferences. However, few neurological data exist on the relationship between visual attention and subjective preference. To address this issue, we focused on lateralization during visual attention and investigated the effects of subjective color preferences on visual attention-related brain activities. We recorded electroencephalograph (EEG) data during a preference judgment task that required 19 participants to choose their preferred color from 2 colors simultaneously presented to the right and left hemifields. In addition, to identify oscillatory activity during visual attention, we conducted a control experiment in which the participants focused on either the right or the left color without stating their preference. The EEG results showed enhanced theta (4-6 Hz) and decreased alpha (10-12 Hz) activities in the right and left occipital electrodes when the participants focused on the color in the opposite hemifield. Occipital theta synchronizations also increased contralaterally to the hemifield to which the preferred color was presented, whereas the alpha desynchronizations showed no lateralization. The contralateral occipital theta activity lasted longer than the ipsilateral occipital theta activity. Interestingly, theta lateralization was observed even when the preferred color was presented to the unattended side in the control experiment, revealing the strength of the preference-related theta-modulation effect irrespective of visual attention. These results indicate that subjective preferences modulate visual attention-related brain activities.

Performing music can induce greater modulation of emotion-related psychophysiological responses than listening to music

The present study investigated the differential effects of music-induced emotion on heart rate (HR) and its variability (HRV) while playing music on the piano and listening to a recording of the same piece of music. Sixteen pianists were monitored during tasks involving emotional piano performance, non-emotional piano performance, emotional perception, and non-emotional perception. It was found that emotional induction during both perception and performance modulated HR and HRV, and that such modulations were significantly greater during musical performance than during perception. The results confirmed that musical performance was far more effective in modulating emotion-related autonomic nerve activity than musical perception in musicians. The findings suggest the presence of a neural network of reward-emotion-associated autonomic nerve activity for musical performance that is independent of a neural network for musical perception.

Electroencephalographic dynamics of musical emotion perception revealed by independent spectral components

This study explores the electroencephalographic (EEG) correlates of emotional experience during music listening. Independent component analysis and analysis of variance were used to separate statistically independent spectral changes of the EEG in response to music-induced emotional processes. An independent brain process with equivalent dipole located in the fronto-central region exhibited distinct δ-band and θ-band power changes associated with self-reported emotional states. Specifically, the emotional valence was associated with δ-power decreases and θ-power increases in the frontal-central area, whereas the emotional arousal was accompanied by increases in both δ and θ powers. The resultant emotion-related component activations that were less interfered by the activities from other brain processes complement previous EEG studies of emotion perception to music.

Human brain EEG indices of emotions: delineating responses to affective vocalizations by measuring frontal theta event-related synchronization

At present there is no direct brain measure of basic emotional dynamics from the human brain. EEG provides non-invasive approaches for monitoring brain electrical activity to emotional stimuli. Event-related desynchronization/synchronization (ERD/ERS) analysis, based on power shifts in specific frequency bands, has some potential as a method for differentiating responses to basic emotions as measured during brief presentations of affective stimuli. Although there appears to be fairly consistent theta ERS in frontal regions of the brain during the earliest phases of processing affective auditory stimuli, the patterns do not readily distinguish between specific emotions. To date it has not been possible to consistently differentiate brain responses to emotion-specific affective states or stimuli, and some evidence to suggests the theta ERS more likely measures general arousal processes rather than yielding veridical indices of specific emotional states. Perhaps cortical EEG patterns will never be able to be used to distinguish discrete emotional states from the surface of the brain. The implications and limitations of such approaches for understanding human emotions are discussed.

Biased emotional recognition in depression: perception of emotions in music by depressed patients

BACKGROUND

Depression is a highly prevalent mood disorder, that impairs a person's social skills and also their quality of life. Populations affected with depression also suffer from a higher mortality rate. Depression affects person's ability to recognize emotions. We designed a novel experiment to test the hypothesis that depressed patients show a judgment bias towards negative emotions.

METHODS

To investigate how depressed patients differ in their perception of emotions conveyed by musical examples, both healthy (n=30) and depressed (n=79) participants were presented with a set of 30 musical excerpts, representing one of five basic target emotions, and asked to rate each excerpt using five Likert scales that represented the amount of each one of those same emotions perceived in the example.

RESULTS

Depressed patients showed moderate but consistent negative self-report biases both in the overall use of the scales and their particular application to certain target emotions, when compared to healthy controls. Also, the severity of the clinical state (depression, anxiety and alexithymia) had an effect on the self-report biases for both positive and negative emotion ratings, particularly depression and alexithymia.

LIMITATIONS

Only musical stimuli were used, and they were all clear examples of one of the basic emotions of happiness, sadness, fear, anger and tenderness. No neutral or ambiguous excerpts were included.

CONCLUSIONS

Depressed patients' negative emotional bias was demonstrated using musical stimuli. This suggests that the evaluation of emotional qualities in music could become a means to discriminate between depressed and non-depressed subjects. The practical implications of the present study relate both to diagnostic uses of such perceptual evaluations, as well as a better understanding of the emotional regulation strategies of the patients.

Affective Priming Effects of Musical Sounds on the Processing of Word Meaning

Recent studies have shown that music is capable of conveying semantically meaningful concepts. Several questions have subsequently arisen particularly with regard to the precise mechanisms underlying the communication of musical meaning as well as the role of specific musical features. The present article reports three studies investigating the role of affect expressed by various musical features in priming subsequent word processing at the semantic level. By means of an affective priming paradigm, it was shown that both musically trained and untrained participants evaluated emotional words congruous to the affect expressed by a preceding chord faster than words incongruous to the preceding chord. This behavioral effect was accompanied by an N400, an ERP typically linked with semantic processing, which was specifically modulated by the (mis)match between the prime and the target. This finding was shown for the musical parameter of consonance/dissonance (Experiment 1) and then extended to mode (major/minor) (Experiment 2) and timbre (Experiment 3). Seeing that the N400 is taken to reflect the processing of meaning, the present findings suggest that the emotional expression of single musical features is understood by listeners as such and is probably processed on a level akin to other affective communications (i.e., prosody or vocalizations) because it interferes with subsequent semantic processing. There were no group differences, suggesting that musical expertise does not have an influence on the processing of emotional expression in music and its semantic connotations.

EEG-based emotion recognition in music listening

Ongoing brain activity can be recorded as electroencephalograph (EEG) to discover the links between emotional states and brain activity. This study applied machine-learning algorithms to categorize EEG dynamics according to subject self-reported emotional states during music listening. A framework was proposed to optimize EEG-based emotion recognition by systematically 1) seeking emotion-specific EEG features and 2) exploring the efficacy of the classifiers. Support vector machine was employed to classify four emotional states (joy, anger, sadness, and pleasure) and obtained an averaged classification accuracy of 82.29% +/- 3.06% across 26 subjects. Further, this study identified 30 subject-independent features that were most relevant to emotional processing across subjects and explored the feasibility of using fewer electrodes to characterize the EEG dynamics during music listening. The identified features were primarily derived from electrodes placed near the frontal and the parietal lobes, consistent with many of the findings in the literature. This study might lead to a practical system for noninvasive assessment of the emotional states in practical or clinical applications.