10 years of BAWLing into affective and aesthetic processes in reading: what are the echoes?

Predicting subjective ratings of affect and comprehensibility with text features: a reader response study of narrative poetry

Literary reading is an interactive process between a reader and a text that depends on a balance between cognitive effort and emotional rewards. By studying both the crucial features of the text and of the subjective reader reception, a better understanding of this interactive process can be reached. In the present study, subjects (N=31) read and rated a work of narrative fiction that was written in a poetic style, thereby offering the readers two pathways to cognitive rewards: Aesthetic appreciation and narrative immersion. Using purely text-based quantitative descriptors, we were able to independently and accurately predict the subjective ratings in the dimensions comprehensibility, valence, arousal, and liking across roughly 140 pages of naturalistic text. The specific text features that were most important in predicting each rating dimension are discussed in detail. In addition, the implications of the findings are discussed more generally in the context of existing models of literary processing and future research avenues for empirical literary studies.

The role of valence and arousal for phonological iconicity in the lexicon of German: a cross-validation study using pseudoword ratings

The notion of sound symbolism receives increasing interest in psycholinguistics. Recent research - including empirical effects of affective phonological iconicity on language processing (Adelman et al., 2018; Conrad et al., 2022) - suggested language codes affective meaning at a basic phonological level using specific phonemes as sublexical markers of emotion. Here, in a series of 8 rating-experiments, we investigate the sensitivity of language users to assumed affectively-iconic systematic distribution patterns of phonemes across the German vocabulary:After computing sublexical-affective-values (SAV) concerning valence and arousal for the entire German phoneme inventory according to occurrences of syllabic onsets, nuclei and codas in a large-scale affective normative lexical database, we constructed pseudoword material differing in SAV to test for subjective affective impressions.Results support affective iconicity as affective ratings mirrored sound-to-meaning correspondences in the lexical database. Varying SAV of otherwise semantically meaningless pseudowords altered affective impressions: Higher arousal was consistently assigned to pseudowords made of syllabic constituents more often used in high-arousal words - contrasted by less straightforward effects of valence SAV. Further disentangling specific differential effects of the two highly-related affective dimensions valence and arousal, our data clearly suggest arousal, rather than valence, as the relevant dimension driving affective iconicity effects.

Movement Termination of Slow-Wave Sleep-A Potential Biomarker?

The duration of slow-wave sleep (SWS) is related to the reported sleep quality and to the important variables of mental and physical health. The internal cues to end an episode of SWS are poorly understood. One such internal cue is the initiation of a body movement, which is detectable as electromyographic (EMG) activity in sleep-electroencephalography (EEG). In the present study, we characterized the termination of SWS episodes by movement to explore its potential as a biomarker. To this end, we characterized the relation between the occurrence of SWS termination by movement and individual characteristics (age, sex), SWS duration and spectral content, chronotype, depression, medication, overnight memory performance, and, as a potential neurological application, epilepsy. We analyzed 94 full-night EEG-EMG recordings (75/94 had confirmed epilepsy) in the video-EEG monitoring unit of the EpiCARE Centre Salzburg, Austria. Segments of SWS were counted and rated for their termination by movement or not through the visual inspection of continuous EEG and EMG recordings. Multiple linear regression was used to predict the number of SWS episodes that ended with movement by depression, chronotype, type of epilepsy (focal, generalized, no epilepsy, unclear), medication, gender, total duration of SWS, occurrence of seizures during the night, occurrence of tonic-clonic seizures during the night, and SWS frequency spectra. Furthermore, we assessed whether SWS movement termination was related to overnight memory retention. According to multiple linear regression, patients with overall longer SWS experienced more SWS episodes that ended with movement (t = 5.64; p = 0.001). No other variable was related to the proportion of SWS that ended with movement, including no epilepsy-related variable. A small sample (n = 4) of patients taking Sertraline experienced no SWS that ended with movement, which was significant compared to all other patients (t = 8.00; p < 0.001) and to n = 35 patients who did not take any medication (t = 4.22; p < 0.001). While this result was based on a small subsample and must be interpreted with caution, it warrants replication in a larger sample with and without seizures to further elucidate the role of the movement termination of SWS and its potential to serve as a biomarker for sleep continuity and for medication effects on sleep.

The effects of slow wave sleep characteristics on semantic, episodic, and procedural memory in people with epilepsy

Slow wave sleep (SWS) is highly relevant for verbal and non-verbal/spatial memory in healthy individuals, but also in people with epilepsy. However, contradictory findings exist regarding the effect of seizures on overnight memory retention, particularly relating to procedural and non-verbal memory, and thorough examination of episodic memory retention with ecologically valid tests is missing. This research explores the interaction of SWS duration with epilepsy-relevant factors, as well as the relation of spectral characteristics of SWS on overnight retention of procedural, verbal, and episodic memory. In an epilepsy monitoring unit, epilepsy patients (N = 40) underwent learning, immediate and 12 h delayed testing of memory retention for a fingertapping task (procedural memory), a word-pair task (verbal memory), and an innovative virtual reality task (episodic memory). We used multiple linear regression to examine the impact of SWS duration, spectral characteristics of SWS, seizure occurrence, medication, depression, seizure type, gender, and epilepsy duration on overnight memory retention. Results indicated that none of the candidate variables significantly predicted overnight changes for procedural memory performance. For verbal memory, the occurrence of tonic-clonic seizures negatively impacted memory retention and higher psychoactive medication load showed a tendency for lower verbal memory retention. Episodic memory was significantly impacted by epilepsy duration, displaying a potential nonlinear impact with a longer duration than 10 years negatively affecting memory performance. Higher drug load of anti-seizure medication was by tendency related to better overnight retention of episodic memory. Contrary to expectations longer SWS duration showed a trend towards decreased episodic memory performance. Analyses on associations between memory types and EEG band power during SWS revealed lower alpha-band power in the frontal right region as significant predictor for better episodic memory retention. In conclusion, this research reveals that memory modalities are not equally affected by important epilepsy factors such as duration of epilepsy and medication, as well as SWS spectral characteristics.

MA-EM: A neurocognitive model for understanding mixed and ambiguous emotions and morality

Understanding emotions and moral intentions of other people is integral to being human. Humanities scholars have long recognized the complex and ambiguous nature of emotions and morality. People are rarely 'just' happy, or sad. Neither are they 'just' good or bad people. Despite this, most knowledge about the psychological and neural basis of emotions and moral understanding comes from experiments investigating unidimensional and non-ambiguous emotions and morality. The goal of this paper is twofold. First I want to point out why mixed and ambiguous emotions and morality are a promising research topic for cognitive neuroscientists. Observing or experiencing mixed or ambiguous emotions and morality tends to have a strong impact on humans. This impact is clearly visible in narratives and fiction, and I will argue that narratives make an excellent stimulus to study the effects of emotional and moral ambiguity. Second, I will sketch a model to help guide research in this promising corner of human cognition.

The Elephant in the Room: A Systematic Review of Stimulus Control in Neuro-Measurement Studies on Figurative Language Processing

The processing of metaphors and idioms has been the subject of neuroscientific research for several decades. However, results are often contradictory, which can be traced back to inconsistent terminology and stimulus control. In this systematic review of research methods, we analyse linguistic aspects of 116 research papers which used EEG, fMRI, PET, MEG, or NIRS to investigate the neural processing of the two figurative subtypes metaphor and idiom. We critically examine the theoretical foundations as well as stimulus control by performing a systematic literature synthesis according to the PRISMA guidelines. We explicitly do not analyse the findings of the studies but instead focus on four primary aspects: definitions of figurative language and its subtypes, linguistic theory behind the studies, control for factors influencing figurative language processing, and the relationship between theoretical and operational definitions. We found both a lack and a broad variety in existing definitions and operationalisation, especially in regard to familiarity and conventionality. We identify severe obstacles in the comparability and validation potential of the results of the papers in our review corpus. We propose the development of a consensus in fundamental terminology and more transparency in the reporting of stimulus design in the research on figurative language processing.

Micropoetry Meets Neurocognitive Poetics: Influence of Associations on the Reception of Poetry

Reading and understanding poetic texts is often described as an interactive process influenced by the words and phrases building the poems and all associations and images induced by them in the readers mind. Iser, for example, described the understanding process as the closing of a good Gestalt promoted by mental images. Here, we investigate the effect that semantic cohesion, that is the internal connection of a list words, has on understanding and appreciation of poetic texts. To do this, word lists are presented as modern micropoems to the participants and the (ease of) extraction of underlying concepts as well as the affective and aesthetic responses are implicitly and explicitly measured. We found that a unifying concept is found more easily and unifying concepts vary significantly less between participants when the words composing a micropoem are semantically related. Moreover these items are liked better and are understood more easily. Our study shows evidence for the assumed relationship between building spontaneous associations, forming mental imagery, and understanding and appreciation of poetic texts. In addition, we introduced a new method well-suited to manipulate backgrounding features independently of foregrounding features which allows to disentangle the effects of both on poetry reception.

Meditation affects word recognition of meditation novices

This work represents one of the first attempts to examine the effects of meditation on the processing of written single words. In the present longitudinal study, participants conducted a lexical decision task and rated the affective valence of nouns before and after a 7-week class in mindfulness meditation, loving-kindness meditation, or a control intervention. Both meditation groups rated the emotional valence of nouns more neutral after the interventions, suggesting a general down-regulation of emotions. In the loving-kindness group, positive words were rated more positively after the intervention, suggesting a specific intensification of positive feelings. After both meditation interventions, response times in the lexical decision task accelerated significantly, with the largest facilitation occurring in the loving-kindness group. We assume that meditation might have led to increased attention, better visual discrimination, a broadened attentional focus, and reduced mind-wandering, which in turn enabled accelerated word recognition. These results extend findings from a previous study with expert Zen meditators, in which we found that one session of advanced meditation can affect word recognition in a very similar way.

Neuroimaging of valence decisions in children and adults

To date, the neural underpinnings of affective components in language processing in children remain largely unknown. To fill this gap, the present study examined behavioural and neural correlates of children and adults performing the same auditory valence decision task with an event-related fMRI paradigm. Based on previous findings in adults, activations in anterior and posterior cingulate cortex, orbitofrontal cortex and left inferior frontal gyrus were expected for both positive and negative valence categories. Recent behavioural findings on valence decisions showed similar ratings and reaction time patterns in children and adults. This finding was successfully replicated in the present study. On a neural level, our analysis of affective language processing showed activations in regions associated with both semantic (superior and middle temporal and frontal) and affective (anterior and posterior cingulate, orbitofrontal and inferior frontal, insula and amygdala) processing. Neural activations in children and adults were systematically different in explicit affective word processing. In particular, adults showed a more distributed semantic network activation while children recruited additional subcortical structures.

Different semantic and affective meaning of the words associated to physical and social pain in cancer patients on early palliative/supportive care and in healthy, pain-free individuals

Early palliative/supportive care (ePSC) is a medical intervention focused on patient's needs, that integrates standard oncological treatment, shortly after a diagnosis of advanced/metastatic cancer. ePSC improves the appropriate management of cancer pain. Understanding the semantic and emotional impact of the words used by patients to describe their pain may further improve its assessment in the ePSC setting. Psycholinguistics assumes that the semantic and affective properties of words affect the ease by which they are processed and comprehended. Therefore, in this cross-sectional survey study we collected normative data about the semantic and affective properties of words associated to physical and social pain, in order to investigate how patients with cancer pain on ePSC process them compared to healthy, pain-free individuals. One hundred ninety patients and 124 matched controls rated the Familiarity, Valence, Arousal, Pain-relatedness, Intensity, and Unpleasantness of 94 words expressing physical and social pain. Descriptive and inferential statistics were performed on ratings in order to unveil patients' semantic and affective representation of pain and compare it with those from controls. Possible effects of variables associated to the illness experience were also tested. Both groups perceived the words conveying social pain as more negative and pain-related than those expressing physical pain, confirming previous evidence of social pain described as worse than physical pain. Patients rated pain words as less negative, less pain-related, and conveying a lower intense and unpleasant pain than controls, suggesting either an adaptation to the pain experience or the role played by ePSC in improving patients' ability to cope with it. This exploratory study suggests that a chronic pain experience as the one experienced by cancer patients on ePSC affects the semantic and affective representation of pain words.

Neural correlates of affective contributions to lexical decisions in children and adults

The goal of the present study was to investigate whether 6-9-year old children and adults show similar neural responses to affective words. An event-related neuroimaging paradigm was used in which both age cohorts performed the same auditory lexical decision task (LDT). The results show similarities in (auditory) lexico-semantic network activation as well as in areas associated with affective information. In both age cohorts' activations were stronger for positive than for negative words, thus exhibiting a positivity superiority effect. Children showed less activation in areas associated with affective information in response to all three valence categories than adults. Our results are discussed in the light of computational models of word recognition, and previous findings of affective contributions to LDT in adults.

Sentiment Analysis of Children and Youth Literature: Is There a Pollyanna Effect?

If the words of natural human language possess a universal positivity bias, as assumed by Boucher and Osgood’s (1969) famous Pollyanna hypothesis and computationally confirmed for large text corpora in several languages (Dodds et al., 2015), then children and youth literature (CYL) should also show a Pollyanna effect. Here we tested this prediction applying an unsupervised vector space model-based sentiment analysis tool called SentiArt (Jacobs, 2019) to two CYL corpora, one in English (372 books) and one in German (500 books). Pitching our analysis at the sentence level, and assessing semantic as well as lexico-grammatical information, both corpora show the Pollyanna effect and thus add further evidence to the universality hypothesis. The results of our multivariate sentiment analyses provide interesting testable predictions for future scientific studies of literature.

From Abstract Symbols to Emotional (In-)Sights: An Eye Tracking Study on the Effects of Emotional Vignettes and Pictures

Reading is known to be a highly complex, emotion-inducing process, usually involving connected and cohesive sequences of sentences and paragraphs. However, most empirical results, especially from studies using eye tracking, are either restricted to simple linguistic materials (e.g., isolated words, single sentences) or disregard valence-driven effects. The present study addressed the need for ecologically valid stimuli by examining the emotion potential of and reading behavior in emotional vignettes, often used in applied psychological contexts and discourse comprehension. To allow for a cross-domain comparison in the area of emotion induction, negatively and positively valenced vignettes were constructed based on pre-selected emotional pictures from the Nencki Affective Picture System (NAPS; Marchewka et al., 2014). We collected ratings of perceived valence and arousal for both material groups and recorded eye movements of 42 participants during reading and picture viewing. Linear mixed-effects models were performed to analyze effects of valence (i.e., valence category, valence rating) and stimulus domain (i.e., textual, pictorial) on ratings of perceived valence and arousal, eye movements in reading, and eye movements in picture viewing. Results supported the success of our experimental manipulation: emotionally positive stimuli (i.e., vignettes, pictures) were perceived more positively and less arousing than emotionally negative ones. The cross-domain comparison indicated that vignettes are able to induce stronger valence effects than their pictorial counterparts, no differences between vignettes and pictures regarding effects on perceived arousal were found. Analyses of eye movements in reading replicated results from experiments using isolated words and sentences: perceived positive text valence attracted shorter reading times than perceived negative valence at both the supralexical and lexical level. In line with previous findings, no emotion effects on eye movements in picture viewing were found. This is the first eye tracking study reporting superior valence effects for vignettes compared to pictures and valence-specific effects on eye movements in reading at the supralexical level.

Zen meditation neutralizes emotional evaluation, but not implicit affective processing of words

There is ample evidence that meditation can regulate emotions. It is questionable, however, whether meditation can down-regulate sensitivity to emotional experience in high-level cognitive representations such as words. The present study shows that adept Zen meditators rated the emotional valence of (low-arousal) positive and (high- and low-arousal) negative nouns significantly more neutral after a meditation session, while there was no change of valence ratings after a comparison intervention in the comparison group. Because the Zen group provided greater "openness to experience" and lower "need for achievement and performance" in the "Big Five" personality assessment, we used these scores as covariates for all analyses. We found no differential emotion effects of Zen meditation during lexical decision, but we replicated the slow-down of low-arousal negative words during lexical decision in both groups. Interestingly, Zen meditation elicited a global facilitation of all response times, which we discuss in terms of increased attentional resources after meditation.

Computing the Affective-Aesthetic Potential of Literary Texts

In this paper, we compute the affective-aesthetic potential (AAP) of literary texts by using a simple sentiment analysis tool called SentiArt. In contrast to other established tools, SentiArt is based on publicly available vector space models (VSMs) and requires no emotional dictionary, thus making it applicable in any language for which VSMs have been made available (>150 so far) and avoiding issues of low coverage. In a first study, the AAP values of all words of a widely used lexical databank for German were computed and the VSM’s ability in representing concrete and more abstract semantic concepts was demonstrated. In a second study, SentiArt was used to predict ~2800 human word valence ratings and shown to have a high predictive accuracy (R2 > 0.5, p < 0.0001). A third study tested the validity of SentiArt in predicting emotional states over (narrative) time using human liking ratings from reading a story. Again, the predictive accuracy was highly significant: R2adj = 0.46, p < 0.0001, establishing the SentiArt tool as a promising candidate for lexical sentiment analyses at both the micro- and macrolevels, i.e., short and long literary materials. Possibilities and limitations of lexical VSM-based sentiment analyses of diverse complex literary texts are discussed in the light of these results.

The Impact of Context on Affective Norms: A Case of Study With Suspense

The emotional response to a stimulus is typically measured in three variables called valence, arousal and dominance. Based on such dimensions, Bradley and Lang (1999) published the Affective Norms for English Words (ANEW), a corpus of affective ratings for 1,034 non-contextualized words. Expanded and adapted to many languages, ANEW provides a corpus to evaluate and to predict human responses to different stimuli, and it has been used in a number of studies involving analysis of emotions. However, ANEW seems not to appropriately predict affective responses to concepts when these are contextualized in certain situational backgrounds, in which words can have different connotations from those in non-contextualized scenarios. These contextualized affective norms have not been sufficiently contrasted yet because the literature does not provide a corpus of the ANEW list in specific contexts. On this basis, this paper reports on the creation of a new corpus of affective norms for the original 1,034 ANEW words in a particular context (a fictional scene of suspense). An extensive quantitative data analysis comparing both corpora was carried out, confirming that the affective ratings are highly influenced by the context. The corpus can be downloaded as Supplementary Material.

Affective iconic words benefit from additional sound-meaning integration in the left amygdala

Recent studies have shown that a similarity between sound and meaning of a word (i.e., iconicity) can help more readily access the meaning of that word, but the neural mechanisms underlying this beneficial role of iconicity in semantic processing remain largely unknown. In an fMRI study, we focused on the affective domain and examined whether affective iconic words (e.g., high arousal in both sound and meaning) activate additional brain regions that integrate emotional information from different domains (i.e., sound and meaning). In line with our hypothesis, affective iconic words, compared to their non‐iconic counterparts, elicited additional BOLD responses in the left amygdala known for its role in multimodal representation of emotions. Functional connectivity analyses revealed that the observed amygdalar activity was modulated by an interaction of iconic condition and activations in two hubs representative for processing sound (left superior temporal gyrus) and meaning (left inferior frontal gyrus) of words. These results provide a neural explanation for the facilitative role of iconicity in language processing and indicate that language users are sensitive to the interaction between sound and meaning aspect of words, suggesting the existence of iconicity as a general property of human language.

The Role of Emotional Valence for the Processing of Facial and Verbal Stimuli-Positivity or Negativity Bias?

Emotional valence is predominately conveyed in social interactions by words and facial expressions. The existence of broad biases which favor more efficient processing of positive or negative emotions is still a controversial matter. While so far this question has been investigated separately for each modality, in this narrative review of the literature we focus on valence effects in processing both words and facial expressions. In order to identify the factors underlying positivity and negativity effects, and to uncover whether these effects depend on modality and age, we present and analyze three representative overviews of the literature concerning valence effects in word processing, face processing, and combinations of word and face processing. Our analysis of word processing studies points to a positivity bias or a balanced processing of positive and negative words, whereas the analysis of face processing studies showed the existence of separate positivity and negativity biases depending on the experimental paradigm. The mixed results seem to be a product of the different methods and types of stimuli being used. Interestingly, we found that children exhibit a clear positivity advantage for both word and face processing, indicating similar processing biases in both modalities. Over the course of development, the initial positivity advantage gradually disappears, and in some face processing studies even reverses into a negativity bias. We therefore conclude that there is a need for future research that systematically analyses the impact of age and modality on the emergence of these valence effects. Finally, we discuss possible explanations for the presence of the early positivity advantage and its subsequent decrease.

Sentiment Analysis for Words and Fiction Characters From the Perspective of Computational (Neuro-)Poetics

Two computational studies provide different sentiment analyses for text segments (e.g., "fearful" passages) and figures (e.g., "Voldemort") from the Harry Potter books (Rowling, 1997, 1998, 1999, 2000, 2003, 2005, 2007) based on a novel simple tool called SentiArt. The tool uses vector space models together with theory-guided, empirically validated label lists to compute the valence of each word in a text by locating its position in a 2d emotion potential space spanned by the words of the vector space model. After testing the tool's accuracy with empirical data from a neurocognitive poetics study, it was applied to compute emotional figure and personality profiles (inspired by the so-called "big five" personality theory) for main characters from the book series. The results of comparative analyses using different machine-learning classifiers (e.g., AdaBoost, Neural Net) show that SentiArt performs very well in predicting the emotion potential of text passages. It also produces plausible predictions regarding the emotional and personality profile of fiction characters which are correctly identified on the basis of eight character features, and it achieves a good cross-validation accuracy in classifying 100 figures into "good" vs. "bad" ones. The results are discussed with regard to potential applications of SentiArt in digital literary, applied reading and neurocognitive poetics studies such as the quantification of the hybrid hero potential of figures.

Idiomatic expressions evoke stronger emotional responses in the brain than literal sentences

Recent neuroscientific research shows that metaphors engage readers at the emotional level more strongly than literal expressions. What still remains unclear is what makes metaphors more engaging, and whether this generalises to all figurative expressions, no matter how conventionalised they are. This fMRI study aimed to investigate whether idiomatic expressions - the least creative part of figurative language - indeed trigger a higher affective resonance than literal expressions, and to explore possible interactions between activation in emotion-relevant neural structures and regions associated with figurative language processing. Participants silently read for comprehension a set of emotionally positive, negative and neutral idioms embedded in short sentences, and similarly valenced literal sentences. As in studies on metaphors, we found enhanced activation of the left inferior frontal gyrus and left amygdala in response to idioms, indexing stronger recruitment of executive control functions and enhanced emotional engagement, respectively. This suggests that the comprehension of even highly conventionalised and familiar figurative expressions, namely idioms, recruits regions involved in emotional processing. Furthermore, increased activation of the IFG interacted positively with activation in the amygdala, suggesting that the stronger cognitive engagement driven by idioms may in turn be coupled with stronger involvement at the emotional level.

Reading Shakespeare Sonnets: Combining Quantitative Narrative Analysis and Predictive Modeling -an Eye Tracking Study

As a part of a larger interdisciplinary project on Shakespeare sonnets' reception (1, 2), the present study analyzed the eye movement behavior of participants reading three of the 154 sonnets as a function of seven lexical features extracted via Quantitative Narrative Analysis (QNA). Using a machine learning-based predictive modeling approach five 'surface' features (word length, orthographic neighborhood density, word frequency, orthographic dissimilarity and sonority score) were detected as important predictors of total reading time and fixation probability in poetry reading. The fact that one phonological feature, i.e., sonority score, also played a role is in line with current theorizing on poetry reading. Our approach opens new ways for future eye movement research on reading poetic texts and other complex literary materials(3).

Why 'piss' is ruder than 'pee'? The role of sound in affective meaning making

Most language users agree that some words sound harsh (e.g. grotesque) whereas others sound soft and pleasing (e.g. lagoon). While this prominent feature of human language has always been creatively deployed in art and poetry, it is still largely unknown whether the sound of a word in itself makes any contribution to the word's meaning as perceived and interpreted by the listener. In a large-scale lexicon analysis, we focused on the affective substrates of words' meaning (i.e. affective meaning) and words' sound (i.e. affective sound); both being measured on a two-dimensional space of valence (ranging from pleasant to unpleasant) and arousal (ranging from calm to excited). We tested the hypothesis that the sound of a word possesses affective iconic characteristics that can implicitly influence listeners when evaluating the affective meaning of that word. The results show that a significant portion of the variance in affective meaning ratings of printed words depends on a number of spectral and temporal acoustic features extracted from these words after converting them to their spoken form (study1). In order to test the affective nature of this effect, we independently assessed the affective sound of these words using two different methods: through direct rating (study2a), and through acoustic models that we implemented based on pseudoword materials (study2b). In line with our hypothesis, the estimated contribution of words' sound to ratings of words' affective meaning was indeed associated with the affective sound of these words; with a stronger effect for arousal than for valence. Further analyses revealed crucial phonetic features potentially causing the effect of sound on meaning: For instance, words with short vowels, voiceless consonants, and hissing sibilants (as in 'piss') feel more arousing and negative. Our findings suggest that the process of meaning making is not solely determined by arbitrary mappings between formal aspects of words and concepts they refer to. Rather, even in silent reading, words' acoustic profiles provide affective perceptual cues that language users may implicitly use to construct words' overall meaning.

The Fictive Brain: Neurocognitive Correlates of Engagement in Literature

Fiction is vital to our being. Many people enjoy engaging with fiction every day. Here we focus on literary reading as 1 instance of fiction consumption from a cognitive neuroscience perspective. The brain processes which play a role in the mental construction of fiction worlds and the related engagement with fictional characters, remain largely unknown. The authors discuss the neurocognitive poetics model ( Jacobs, 2015a ) of literary reading specifying the likely neuronal correlates of several key processes in literary reading, namely inference and situation model building, immersion, mental simulation and imagery, figurative language and style, and the issue of distinguishing fact from fiction. An overview of recent work on these key processes is followed by a discussion of methodological challenges in studying the brain bases of fiction processing.

Affective Congruence between Sound and Meaning of Words Facilitates Semantic Decision

A similarity between the form and meaning of a word (i.e., iconicity) may help language users to more readily access its meaning through direct form-meaning mapping. Previous work has supported this view by providing empirical evidence for this facilitatory effect in sign language, as well as for onomatopoetic words (e.g., cuckoo) and ideophones (e.g., zigzag). Thus, it remains largely unknown whether the beneficial role of iconicity in making semantic decisions can be considered a general feature in spoken language applying also to “ordinary” words in the lexicon. By capitalizing on the affective domain, and in particular arousal, we organized words in two distinctive groups of iconic vs. non-iconic based on the congruence vs. incongruence of their lexical (meaning) and sublexical (sound) arousal. In a two-alternative forced choice task, we asked participants to evaluate the arousal of printed words that were lexically either high or low arousing. In line with our hypothesis, iconic words were evaluated more quickly and more accurately than their non-iconic counterparts. These results indicate a processing advantage for iconic words, suggesting that language users are sensitive to sound-meaning mappings even when words are presented visually and read silently.

The Sound of Words Evokes Affective Brain Responses

The long history of poetry and the arts, as well as recent empirical results suggest that the way a word sounds (e.g., soft vs. harsh) can convey affective information related to emotional responses (e.g., pleasantness vs. harshness). However, the neural correlates of the affective potential of the sound of words remain unknown. In an fMRI study involving passive listening, we focused on the affective dimension of arousal and presented words organized in two discrete groups of sublexical (i.e., sound) arousal (high vs. low), while controlling for lexical (i.e., semantic) arousal. Words sounding high arousing, compared to their low arousing counterparts, resulted in an enhanced BOLD signal in bilateral posterior insula, the right auditory and premotor cortex, and the right supramarginal gyrus. This finding provides first evidence on the neural correlates of affectivity in the sound of words. Given the similarity of this neural network to that of nonverbal emotional expressions and affective prosody, our results support a unifying view that suggests a core neural network underlying any type of affective sound processing.

Do Words Stink? Neural Reuse as a Principle for Understanding Emotions in Reading

How do we understand the emotional content of written words? Here, we investigate the hypothesis that written words that carry emotions are processed through phylogenetically ancient neural circuits that are involved in the processing of the very same emotions in nonlanguage contexts. This hypothesis was tested with respect to disgust. In an fMRI experiment, it was found that the same region of the left anterior insula responded whether people observed facial expressions of disgust or whether they read words with disgusting content. In a follow-up experiment, it was found that repetitive TMS over the left insula in comparison with a control site interfered with the processing of disgust words to a greater extent than with the processing of neutral words. Together, the results support the hypothesis that the affective processes we experience when reading rely on the reuse of phylogenetically ancient brain structures that process basic emotions in other domains and species.

Moved by words: Affective ratings for a set of 2,266 Spanish words in five discrete emotion categories

The two main theoretical accounts of the human affective space are the dimensional perspective and the discrete-emotion approach. In recent years, several affective norms have been developed from a dimensional perspective, including ratings for valence and arousal. In contrast, the number of published datasets relying on the discrete-emotion approach is much lower. There is a need to fill this gap, considering that discrete emotions have an effect on word processing above and beyond those of valence and arousal. In the present study, we present ratings from 1,380 participants for a set of 2,266 Spanish words in five discrete emotion categories: happiness, anger, fear, disgust, and sadness. This will be the largest dataset published to date containing ratings for discrete emotions. We also present, for the first time, a fine-grained analysis of the distribution of words into the five emotion categories. This analysis reveals that happiness words are the most consistently related to a single, discrete emotion category. In contrast, there is a tendency for many negative words to belong to more than one discrete emotion. The only exception is disgust words, which overlap least with the other negative emotions. Normative valence and arousal data already exist for all of the words included in this corpus. Thus, the present database will allow researchers to design studies to contrast the predictions of the two most influential theoretical perspectives in this field. These studies will undoubtedly contribute to a deeper understanding of the effects of emotion on word processing.

Quantifying the Beauty of Words: A Neurocognitive Poetics Perspective

In this paper I would like to pave the ground for future studies in Computational Stylistics and (Neuro-)Cognitive Poetics by describing procedures for predicting the subjective beauty of words. A set of eight tentative word features is computed via Quantitative Narrative Analysis (QNA) and a novel metric for quantifying word beauty, the aesthetic potential is proposed. Application of machine learning algorithms fed with this QNA data shows that a classifier of the decision tree family excellently learns to split words into beautiful vs. ugly ones. The results shed light on surface and semantic features theoretically relevant for affective-aesthetic processes in literary reading and generate quantitative predictions for neuroaesthetic studies of verbal materials.

Die semantische Repräsentation von Emotionsbegriffen bei Kindern im Grundschulalter

Zusammenfassung. Dem Erwerb von Emotionsbegriffen kommt eine besondere Bedeutung im kindlichen Lexikonerwerb zu. Zum einen ermöglicht das Emotionsvokabular den zwischenmenschlichen Austausch über Gefühle, zum anderen erfüllen Emotionsbegriffe aufgrund ihrer besonderen semantischen Eigenschaften eine Brückenfunktion für den Erwerb abstrakter Wortbedeutungen. Die vorliegende Studie untersucht die Wortverarbeitung bei 86 Kindern zwischen sechs und neun Jahren an einer Auswahl von 24 Emotionsbegriffen. Vier Aufgaben mit unterschiedlichem Schwierigkeitsgrad und unterschiedlichen Anforderungen an die semantische Verarbeitung wurden eingesetzt: lexikalisches Entscheiden (Wort-Pseudowort), emotionales Kategorisieren (positiv-negativ), Wortverstehen (Wortauswahl aus Ablenkermenge) und Wortproduktion (Satzvervollständigung). In allen Aufgabentypen zeigten sich Verbesserungen mit zunehmendem Alter, wobei sich die Leistungen in Abhängigkeit vom Aufgabentyp unterschieden. Die Ergebnisse zu Korrektheit, Reaktionszeit und Fehlertypen verdeutlichen, wie Kinder ihr Wissen über die Bedeutung von Emotionsbegriffen im Laufe des Grundschulalters ausdifferenzieren.

Electrophysiological correlates of the drift diffusion model in visual word recognition

This study was designed to explore the electrophysiological correlates of the diffusion models drift rate parameter in cognitive decision making. Eighty-two participants completed a lexical decision task while their stimulus-dependent event-related potentials (ERP) and theta frequency band power were measured. A mass univariate approach was applied to examine the timeline at which correlations were evident. Individual differences in drift rate parameter and condition-wise within-subject differences in drift rates for word emotionality and item repetition were found to be related to amplitude differences in the late positive complex (LPC). No relations to theta frequency band power changes were obtained. The drift rate parameter captures information accumulation of noisy evidence, while LPC amplitudes are discussed to reflect the strength of a memory trace. While these results point to a common underlying cognitive mechanism to explain drift rates and LPC modulation, they also provide a new angle on the timeline of visual word processing following word identification. Further confirmations of the results are needed to approve the LPC as neurophysiological marker of information accumulation. Hum Brain Mapp 38:5616-5627, 2017. © 2017 Wiley Periodicals, Inc.

Age-Dependent Positivity-Bias in Children's Processing of Emotion Terms

Emotions play an important role in human communication, and the daily-life interactions of young children often include situations that require the verbalization of emotional states with verbal means, e.g., with emotion terms. Through them, one can express own emotional states and those of others. Thus, the acquisition of emotion terms allows children to participate more intensively in social contexts - a basic requirement for learning new words and for elaborating socio-emotional skills. However, little is known about how children acquire and process this specific word category, which is positioned between concrete and abstract words. In particular, the influence of valence on emotion word processing during childhood has not been sufficiently investigated. Previous research points to an advantage of positive words over negative and neutral words in word processing. While previous studies found valence effects to be influenced by factors such as arousal, frequency, concreteness, and task, it is still unclear if and how valence effects are also modified by age. The present study compares the performance of children aged from 5 to 12 years and adults in two experimental tasks: lexical decision (word or pseudoword) and emotional categorization (positive or negative). Stimuli consisted of 48 German emotion terms (24 positive and 24 negative) matched for arousal, concreteness, age of acquisition, word class, word length, morphological complexity, frequency, and neighborhood density. Results from both tasks reveal two developmental trends: First, with increasing age children responded faster and more correctly, suggesting that emotion vocabulary gradually becomes more stable and differentiated during middle childhood. Second, the influence of valence varied with age: younger children (5- and 6-year-olds) showed significantly higher performance levels for positive emotion terms compared to negative emotion terms, whereas older children and adults did not. This age-related valence effect in emotion word processing will be discussed with respect to linguistic and methodological aspects.

If You Don't Have Valence, Ask Your Neighbor: Evaluation of Neutral Words as a Function of Affective Semantic Associates

How do humans perform difficult forced-choice evaluations, e.g., of words that have been previously rated as being neutral? Here we tested the hypothesis that in this case, the valence of semantic associates is of significant influence. From corpus based co-occurrence statistics as a measure of association strength we computed individual neighborhoods for single neutral words comprised of the 10 words with the largest association strength. We then selected neutral words according to the valence of the associated words included in the neighborhoods, which were either mostly positive, mostly negative, mostly neutral or mixed positive and negative, and tested them using a valence decision task (VDT). The data showed that the valence of semantic neighbors can predict valence judgments to neutral words. However, all but the positive neighborhood items revealed a high tendency to elicit negative responses. For the positive and negative neighborhood categories responses congruent with the neighborhood's valence were faster than incongruent responses. We interpret this effect as a semantic network process that supports the evaluation of neutral words by assessing the valence of the associative semantic neighborhood. In this perspective, valence is considered a semantic super-feature, at least partially represented in associative activation patterns of semantic networks.

On the Relation between the General Affective Meaning and the Basic Sublexical, Lexical, and Inter-lexical Features of Poetic Texts-A Case Study Using 57 Poems of H. M. Enzensberger

The literary genre of poetry is inherently related to the expression and elicitation of emotion via both content and form. To explore the nature of this affective impact at an extremely basic textual level, we collected ratings on eight different general affective meaning scales—valence, arousal, friendliness, sadness, spitefulness, poeticity, onomatopoeia, and liking—for 57 German poems (“die verteidigung der wölfe”) which the contemporary author H. M. Enzensberger had labeled as either “friendly,” “sad,” or “spiteful.” Following Jakobson's (1960) view on the vivid interplay of hierarchical text levels, we used multiple regression analyses to explore the specific influences of affective features from three different text levels (sublexical, lexical, and inter-lexical) on the perceived general affective meaning of the poems using three types of predictors: (1) Lexical predictor variables capturing the mean valence and arousal potential of words; (2) Inter-lexical predictors quantifying peaks, ranges, and dynamic changes within the lexical affective content; (3) Sublexical measures of basic affective tone according to sound-meaning correspondences at the sublexical level (see Aryani et al., 2016). We find the lexical predictors to account for a major amount of up to 50% of the variance in affective ratings. Moreover, inter-lexical and sublexical predictors account for a large portion of additional variance in the perceived general affective meaning. Together, the affective properties of all used textual features account for 43–70% of the variance in the affective ratings and still for 23–48% of the variance in the more abstract aesthetic ratings. In sum, our approach represents a novel method that successfully relates a prominent part of variance in perceived general affective meaning in this corpus of German poems to quantitative estimates of affective properties of textual components at the sublexical, lexical, and inter-lexical level.

When emotions are expressed figuratively: Psycholinguistic and Affective Norms of 619 Idioms for German (PANIG)

Despite flourishing research on the relationship between emotion and literal language, and despite the pervasiveness of figurative expressions in communication, the role of figurative language in conveying affect has been underinvestigated. This study provides affective and psycholinguistic norms for 619 German idiomatic expressions and explores the relationships between affective and psycholinguistic idiom properties. German native speakers rated each idiom for emotional valence, arousal, familiarity, semantic transparency, figurativeness, and concreteness. They also described the figurative meaning of each idiom and rated how confident they were about the attributed meaning. The results showed that idioms rated high in valence were also rated high in arousal. Negative idioms were rated as more arousing than positive ones, in line with results from single words. Furthermore, arousal correlated positively with figurativeness (supporting the idea that figurative expressions are more emotionally engaging than literal expressions) and with concreteness and semantic transparency. This suggests that idioms may convey a more direct reference to sensory representations, mediated by the meanings of their constituting words. Arousal correlated positively with familiarity. In addition, positive idioms were rated as more familiar than negative idioms. Finally, idioms without a literal counterpart were rated as more emotionally valenced and arousing than idioms with a literal counterpart. Although the meanings of ambiguous idioms were less correctly defined than those of unambiguous idioms, ambiguous idioms were rated as more concrete than unambiguous ones. We also discuss the relationships between the various psycholinguistic variables characterizing idioms, with reference to the literature on idiom structure and processing.

Drifting through Basic Subprocesses of Reading: A Hierarchical Diffusion Model Analysis of Age Effects on Visual Word Recognition

Reading is one of the most popular leisure activities and it is routinely performed by most individuals even in old age. Successful reading enables older people to master and actively participate in everyday life and maintain functional independence. Yet, reading comprises a multitude of subprocesses and it is undoubtedly one of the most complex accomplishments of the human brain. Not surprisingly, findings of age-related effects on word recognition and reading have been partly contradictory and are often confined to only one of four central reading subprocesses, i.e., sublexical, orthographic, phonological and lexico-semantic processing. The aim of the present study was therefore to systematically investigate the impact of age on each of these subprocesses. A total of 1,807 participants (young, N = 384; old, N = 1,423) performed four decision tasks specifically designed to tap one of the subprocesses. To account for the behavioral heterogeneity in older adults, this subsample was split into high and low performing readers. Data were analyzed using a hierarchical diffusion modeling approach, which provides more information than standard response time/accuracy analyses. Taking into account incorrect and correct response times, their distributions and accuracy data, hierarchical diffusion modeling allowed us to differentiate between age-related changes in decision threshold, non-decision time and the speed of information uptake. We observed longer non-decision times for older adults and a more conservative decision threshold. More importantly, high-performing older readers outperformed younger adults at the speed of information uptake in orthographic and lexico-semantic processing, whereas a general age-disadvantage was observed at the sublexical and phonological levels. Low-performing older readers were slowest in information uptake in all four subprocesses. Discussing these results in terms of computational models of word recognition, we propose age-related disadvantages for older readers to be caused by inefficiencies in temporal sampling and activation and/or inhibition processes.

On Elementary Affective Decisions: To Like Or Not to Like, That Is the Question

Perhaps the most ubiquitous and basic affective decision of daily life is deciding whether we like or dislike something/somebody, or, in terms of psychological emotion theories, whether the object/subject has positive or negative valence. Indeed, people constantly make such liking decisions within a glimpse and, importantly, often without expecting any obvious benefit or knowing the exact reasons for their judgment. In this paper, we review research on such elementary affective decisions (EADs) that entail no direct overt reward with a special focus on Neurocognitive Poetics and discuss methods and models for investigating the neuronal and cognitive-affective bases of EADs to verbal materials with differing degrees of complexity. In line with evolutionary and appraisal theories of (aesthetic) emotions and data from recent neurocognitive studies, the results of a decision tree modeling approach simulating EADs to single words suggest that a main driving force behind EADs is the extent to which such high-dimensional stimuli are associated with the “basic” emotions joy/happiness and disgust.

Mixing positive and negative valence: Affective-semantic integration of bivalent words

Single words have affective and aesthetic properties that influence their processing. Here we investigated the processing of a special case of word stimuli that are extremely difficult to evaluate, bivalent noun-noun-compounds (NNCs), i.e. novel words that mix a positive and negative noun, e.g. ‘Bombensex’ (bomb-sex). In a functional magnetic resonance imaging (fMRI) experiment we compared their processing with easier-to-evaluate non-bivalent NNCs in a valence decision task (VDT). Bivalent NNCs produced longer reaction times and elicited greater activation in the left inferior frontal gyrus (LIFG) than non-bivalent words, especially in contrast to words of negative valence. We attribute this effect to a LIFG-grounded process of semantic integration that requires greater effort for processing converse information, supporting the notion of a valence representation based on associations in semantic networks.

The Berlin Affective Word List for Children (kidBAWL): Exploring Processing of Affective Lexical Semantics in the Visual and Auditory Modalities

While research on affective word processing in adults witnesses increasing interest, the present paper looks at another group of participants that have been neglected so far: pupils (age range: 6-12 years). Introducing a variant of the Berlin Affective Wordlist (BAWL) especially adapted for children of that age group, the "kidBAWL," we examined to what extent pupils process affective lexical semantics similarly to adults. In three experiments using rating and valence decision tasks in both the visual and auditory modality, it was established that children show the two ubiquitous phenomena observed in adults with emotional word material: the asymmetric U-shaped function relating valence to arousal ratings, and the inversely U-shaped function relating response times to valence decision latencies. The results for both modalities show large structural similarities between pupil and adult data (taken from previous studies) indicating that in the present age range, the affective lexicon and the dynamic interplay between language and emotion is already well-developed. Differential effects show that younger children tend to choose less extreme ratings than older children and that rating latencies decrease with age. Overall, our study should help to develop more realistic models of word recognition and reading that include affective processes and offer a methodology for exploring the roots of pleasant literary experiences and ludic reading.

Human, Nature, Dynamism: The Effects of Content and Movement Perception on Brain Activations during the Aesthetic Judgment of Representational Paintings

Movement perception and its role in aesthetic experience have been often studied, within empirical aesthetics, in relation to the human body. No such specificity has been defined in neuroimaging studies with respect to contents lacking a human form. The aim of this work was to explore, through functional magnetic imaging (f MRI), how perceived movement is processed during the aesthetic judgment of paintings using two types of content: human subjects and scenes of nature. Participants, untutored in the arts, were shown the stimuli and asked to make aesthetic judgments. Additionally, they were instructed to observe the paintings and to rate their perceived movement in separate blocks. Observation highlighted spontaneous processes associated with aesthetic experience, whereas movement judgment outlined activations specifically related to movement processing. The ratings recorded during aesthetic judgment revealed that nature scenes received higher scored than human content paintings. The imaging data showed similar activation, relative to baseline, for all stimuli in the three tasks, including activation of occipito-temporal areas, posterior parietal, and premotor cortices. Contrast analyses within aesthetic judgment task showed that human content activated, relative to nature, precuneus, fusiform gyrus, and posterior temporal areas, whose activation was prominent for dynamic human paintings. In contrast, nature scenes activated, relative to human stimuli, occipital and posterior parietal cortex/precuneus, involved in visuospatial exploration and pragmatic coding of movement, as well as central insula. Static nature paintings further activated, relative to dynamic nature stimuli, central and posterior insula. Besides insular activation, which was specific for aesthetic judgment, we found a large overlap in the activation pattern characterizing each stimulus dimension (content and dynamism) across observation, aesthetic judgment, and movement judgment tasks. These findings support the idea that the aesthetic evaluation of artworks depicting both human subjects and nature scenes involves a motor component, and that the associated neural processes occur quite spontaneously in the viewer. Furthermore, considering the functional roles of posterior and central insula, we suggest that nature paintings may evoke aesthetic processes requiring an additional proprioceptive and sensori-motor component implemented by “motor accessibility” to the represented scenario, which is needed to judge the aesthetic value of the observed painting.

The emotion potential of simple sentences: additive or interactive effects of nouns and adjectives?

The vast majority of studies on affective processes in reading focus on single words. The most robust finding is a processing advantage for positively valenced words, which has been replicated in the rare studies investigating effects of affective features of words during sentence or story comprehension. Here we were interested in how the different valences of words in a sentence influence its processing and supralexical affective evaluation. Using a sentence verification task we investigated how comprehension of simple declarative sentences containing a noun and an adjective depends on the valences of both words. The results are in line with the assumed general processing advantage for positive words. We also observed a clear interaction effect, as can be expected from the affective priming literature: sentences with emotionally congruent words (e.g., The grandpa is clever) were verified faster than sentences containing emotionally incongruent words (e.g., The grandpa is lonely). The priming effect was most prominent for sentences with positive words suggesting that both, early processing as well as later meaning integration and situation model construction, is modulated by affective processing. In a second rating task we investigated how the emotion potential of supralexical units depends on word valence. The simplest hypothesis predicts that the supralexical affective structure is a linear combination of the valences of the nouns and adjectives (Bestgen, 1994). Overall, our results do not support this: The observed clear interaction effect on ratings indicate that especially negative adjectives dominated supralexical evaluation, i.e., a sort of negativity bias in sentence evaluation. Future models of sentence processing thus should take interactive affective effects into account.

Basic Emotions in the Nencki Affective Word List (NAWL BE): New Method of Classifying Emotional Stimuli

The Nencki Affective Word List (NAWL) has recently been introduced as a standardized database of Polish words suitable for studying various aspects of language and emotions. Though the NAWL was originally based on the most commonly used dimensional approach, it is not the only way of studying emotions. Another framework is based on discrete emotional categories. Since the two perspectives are recognized as complementary, the aim of the present study was to supplement the NAWL database by the addition of categories corresponding to basic emotions. Thus, 2902 Polish words from the NAWL were presented to 265 subjects, who were instructed to rate them according to the intensity of each of the five basic emotions: happiness, anger, sadness, fear and disgust. The general characteristics of the present word database, as well as the relationships between the studied variables are shown to be consistent with typical patterns found in previous studies using similar databases for different languages. Here we present the Basic Emotions in the Nencki Affective Word List (NAWL BE) as a database of verbal material suitable for highly controlled experimental research. To make the NAWL more convenient to use, we introduce a comprehensive method of classifying stimuli to basic emotion categories. We discuss the advantages of our method in comparison to other methods of classification. Additionally, we provide an interactive online tool (http://exp.lobi.nencki.gov.pl/nawl-analysis) to help researchers browse and interactively generate classes of stimuli to meet their specific requirements.

Neurocognitive poetics: methods and models for investigating the neuronal and cognitive-affective bases of literature reception

A long tradition of research including classical rhetoric, esthetics and poetics theory, formalism and structuralism, as well as current perspectives in (neuro)cognitive poetics has investigated structural and functional aspects of literature reception. Despite a wealth of literature published in specialized journals like Poetics, however, still little is known about how the brain processes and creates literary and poetic texts. Still, such stimulus material might be suited better than other genres for demonstrating the complexities with which our brain constructs the world in and around us, because it unifies thought and language, music and imagery in a clear, manageable way, most often with play, pleasure, and emotion (Schrott and Jacobs, 2011). In this paper, I discuss methods and models for investigating the neuronal and cognitive-affective bases of literary reading together with pertinent results from studies on poetics, text processing, emotion, or neuroaesthetics, and outline current challenges and future perspectives.