Emotional sound symbolism: Languages rapidly signal valence via phonemes

Valence without meaning: Investigating form and semantic components in pseudowords valence

Valence is a dominant semantic dimension, and it is fundamentally linked to basic approach-avoidance behavior within a broad range of contexts. Previous studies have shown that it is possible to approximate the valence of existing words based on several surface-level and semantic components of the stimuli. Parallelly, recent studies have shown that even completely novel and (apparently) meaningless stimuli, like pseudowords, can be informative of meaning based on the information that they carry at the subword level. Here, we aimed to further extend this evidence by investigating whether humans can reliably assign valence to pseudowords and, additionally, to identify the factors explaining such valence judgments. In Experiment 1, we trained several models to predict valence judgments for existing words from their combined form and meaning information. Then, in Experiment 2 and Experiment 3, we extended the results by predicting participants' valence judgments for pseudowords, using a set of models indexing different (possible) sources of valence and selected the best performing model in a completely data-driven procedure. Results showed that the model including basic surface-level (i.e., letters composing the pseudoword) and orthographic neighbors information performed best, thus tracing back pseudoword valence to these components. These findings support perspectives on the nonarbitrariness of language and provide insights regarding how humans process the valence of novel stimuli.

PHONETIC UNDERPINNINGS OF SOUND SYMBOLISM ACROSS MULTIPLE DOMAINS OF MEANING

Sound symbolism occurs when the sound of a word alone can convey its meaning, e.g. 'balloon' and 'spike' sound rounded and pointed, respectively. Sound-symbolic correspondences are widespread in natural languages, but it is unclear how they are instantiated across different domains of meaning. Here, participants rated auditory pseudowords on opposing scales of seven different sound-symbolic domains: shape (rounded-pointed), texture (hard-soft), weight (light-heavy), size (small-big), brightness (bright-dark), arousal (calming-exciting), and valence (good-bad). Ratings showed cross-domain relationships, some mirroring those between corresponding physical domains, e.g. size and weight ratings were associated, reflecting a physical size-weight relationship, while others involved metaphorical mappings, e.g., bright/dark mapped onto good/bad, respectively. The phonetic features of the pseudowords formed unique sets with characteristic feature weightings for each domain and tended to follow the cross-domain ratings relationships. These results suggest that sound-symbolic correspondences rely on domain-specific patterns of phonetic features, with cross-domain correspondences reflecting physical or metaphorical relationships.

The bright side of words: Norms for 9000 Spanish words in seven discrete positive emotions

In recent years, assumptions about the existence of a single construct of happiness that accounts for all positive emotions have been questioned. Instead, several discrete positive emotions with their own neurobiological and psychological mechanisms have been proposed. Of note, the effects of positive emotions on language processing are not yet properly understood. Here we provide a database for a large set of 9000 Spanish words scored by 3437 participants in the positive emotions of awe, contentment, amusement, excitement, serenity, relief, and pleasure. We also report significant correlations between discrete positive emotions and several affective (e.g., valence, arousal, happiness, negative discrete emotions) and lexico-semantic (e.g., frequency of use, familiarity, concreteness, age of acquisition) characteristics of words. Finally, we analyze differences between words conveying a single emotion ("pure" emotion words) and those denoting more than one emotion ("mixed" emotion words). This study will provide researchers a rich source of information to do research that contributes to expanding the current knowledge on the role of positive emotions in language. The norms are available at https://doi.org/10.6084/m9.figshare.21533571.v2.

The role of valence and arousal for phonological iconicity in the lexicon of German: a cross-validation study using pseudoword ratings

The notion of sound symbolism receives increasing interest in psycholinguistics. Recent research - including empirical effects of affective phonological iconicity on language processing (Adelman et al., 2018; Conrad et al., 2022) - suggested language codes affective meaning at a basic phonological level using specific phonemes as sublexical markers of emotion. Here, in a series of 8 rating-experiments, we investigate the sensitivity of language users to assumed affectively-iconic systematic distribution patterns of phonemes across the German vocabulary:After computing sublexical-affective-values (SAV) concerning valence and arousal for the entire German phoneme inventory according to occurrences of syllabic onsets, nuclei and codas in a large-scale affective normative lexical database, we constructed pseudoword material differing in SAV to test for subjective affective impressions.Results support affective iconicity as affective ratings mirrored sound-to-meaning correspondences in the lexical database. Varying SAV of otherwise semantically meaningless pseudowords altered affective impressions: Higher arousal was consistently assigned to pseudowords made of syllabic constituents more often used in high-arousal words - contrasted by less straightforward effects of valence SAV. Further disentangling specific differential effects of the two highly-related affective dimensions valence and arousal, our data clearly suggest arousal, rather than valence, as the relevant dimension driving affective iconicity effects.

Statistical Relationships Between Phonological Form, Emotional Valence and Arousal of Spanish Words

A number of studies have provided evidence of limited non-arbitrary associations between the phonological forms and meanings of affective words, a finding referred to as affective sound symbolism. Here, we explored whether the affective connotations of Spanish words might have more extensive statistical relationships with phonological/phonetic features, or affective form typicality. After eliminating words with poor affective rating agreement and morphophonological redundancies (e.g., negating prefixes), we found evidence of significant form typicality for emotional valence, emotionality, and arousal in a large sample of monosyllabic and polysyllabic words. These affective form-meaning mappings remained significant even when controlling for a range of lexico-semantic variables. We show that affective variables and their corresponding form typicality measures are able to significantly predict lexical decision performance using a megastudy dataset. Overall, our findings provide new evidence that affective form typicality is a statistical property of the Spanish lexicon.

Sound symbolic associations in Spanish emotional words: affective dimensions and discrete emotions

Sound symbolism refers to non-arbitrary associations between word forms and meaning, such as those observed for some properties of sounds and size or shape. Recent evidence suggests that these connections extend to emotional concepts. Here we investigated two types of non-arbitrary relationships. Study 1 examined whether iconicity scores (i.e. resemblance-based mapping between aspects of a word's form and its meaning) for words can be predicted from ratings in the affective dimensions of valence and arousal and/or the discrete emotions of happiness, anger, fear, disgust and sadness. Words denoting negative concepts were more likely to have more iconic word forms. Study 2 explored whether statistical regularities in single phonemes (i.e. systematicity) predicted ratings in affective dimensions and/or discrete emotions. Voiceless (/p/, /t/) and voiced plosives (/b/, /d/, /g/) were related to high arousing words, whereas high arousing negative words tended to include fricatives (/s/, /z/). Hissing consonants were also more likely to occur in words denoting all negative discrete emotions. Additionally, words conveying certain discrete emotions included specific phonemes. Overall, our data suggest that emotional features might explain variations in iconicity and provide new insight about phonemic patterns showing sound symbolic associations with the affective properties of words.

Finding biomarkers of experience in animals

At a time when there is a growing public interest in animal welfare, it is critical to have objective means to assess the way that an animal experiences a situation. Objectivity is critical to ensure appropriate animal welfare outcomes. Existing behavioural, physiological, and neurobiological indicators that are used to assess animal welfare can verify the absence of extremely negative outcomes. But welfare is more than an absence of negative outcomes and an appropriate indicator should reflect the full spectrum of experience of an animal, from negative to positive. In this review, we draw from the knowledge of human biomedical science to propose a list of candidate biological markers (biomarkers) that should reflect the experiential state of non-human animals. The proposed biomarkers can be classified on their main function as endocrine, oxidative stress, non-coding molecular, and thermobiological markers. We also discuss practical challenges that must be addressed before any of these biomarkers can become useful to assess the experience of an animal in real-life.

Using artificial intelligence to explore sound symbolic expressions of gender in American English

This study investigates the extent to which gender can be inferred from the phonemes that make up given names and words in American English. Two extreme gradient boosted algorithms were constructed to classify words according to gender, one using a list of the most common given names (N∼1,000) in North America and the other using the Glasgow Norms (N∼5,500), a corpus consisting of nouns, verbs, adjectives, and adverbs which have each been assigned a psycholinguistic score of how they are associated with male or female behaviour. Both models report significant findings, but the model constructed using given names achieves a greater accuracy despite being trained on a smaller dataset suggesting that gender is expressed more robustly in given names than in other word classes. Feature importance was examined to determine which features were contributing to the decision-making process. Feature importance scores revealed a general pattern across both models, but also show that not all word classes express gender the same way. Finally, the models were reconstructed and tested on the opposite dataset to determine whether they were useful in classifying opposite samples. The results showed that the models were not as accurate when classifying opposite samples, suggesting that they are more suited to classifying words of the same class.

Sound-action symbolism in relation to precision manipulation and whole-hand grasp usage

It has been suggested that actions can provide a fruitful conceptual context for sound symbolism phenomena, and that tight interaction between manual and articulatory processes might cause that hand actions, in particular, are sound-symbolically associated with specific speech sounds. Experiment 1 investigated whether novel words, built from speech sounds that have been previously linked to precision or power grasp responses, are implicitly associated with perceived actions that present precision manipulation or whole-hand grasp tool-use or the corresponding utilisation pantomimes. In the two-alternative forced-choice task, the participants were more likely to match novel words to tool-use actions and corresponding pantomimes that were sound-symbolically congruent with the words. Experiment 2 showed that the same or even larger sound-action symbolism effect can be observed when the pantomimes present unfamiliar utilisation actions. Based on this we propose that the sound-action symbolism might originate from the same sensorimotor mechanisms that process the meaning of iconic gestural signs. The study presents a novel sound-action phenomenon and supports the view that hand-mouth interaction might manifest itself by associating specific speech sounds with grasp-related utilisations.

Exploring the Emotional Functions of Co-Speech Hand Gesture in Language and Communication

Research over the past four decades has built a convincing case that co-speech hand gestures play a powerful role in human cognition . However, this recent focus on the cognitive function of gesture has, to a large extent, overlooked its emotional role-a role that was once central to research on bodily expression. In the present review, we first give a brief summary of the wealth of research demonstrating the cognitive function of co-speech gestures in language acquisition, learning, and thinking. Building on this foundation, we revisit the emotional function of gesture across a wide range of communicative contexts, from clinical to artistic to educational, and spanning diverse fields, from cognitive neuroscience to linguistics to affective science. Bridging the cognitive and emotional functions of gesture highlights promising avenues of research that have varied practical and theoretical implications for human-machine interactions, therapeutic interventions, language evolution, embodied cognition, and more.

A cross-linguistic, sound symbolic relationship between labial consonants, voiced plosives, and Pokémon friendship

Introduction

This paper presents a cross-linguistic study of sound symbolism, analysing a six-language corpus of all Pokémon names available as of January 2022. It tests the effects of labial consonants and voiced plosives on a Pokémon attribute known as friendship. Friendship is a mechanic in the core series of Pokémon video games that arguably reflects how friendly each Pokémon is.

Method

Poisson regression is used to examine the relationship between the friendship mechanic and the number of times /p/, /b/, /d/, /m/, /g/, and /w/ occur in the names of English, Japanese, Korean, Chinese, German, and French Pokémon.

Results

Bilabial plosives, /p/ and /b/, typically represent high friendship values in Pokémon names while /m/, /d/, and /g/ typically represent low friendship values. No association is found for /w/ in any language.

Discussion

Many of the previously known cases of cross-linguistic sound symbolic patterns can be explained by the relationship between how sounds in words are articulated and the physical qualities of the referents. This study, however, builds upon the underexplored relationship between sound symbolism and abstract qualities.

Constructing Pseudowords with Constraints on Morphological Features - Application for Polish Pseudonouns and Pseudoverbs

Pseudowords allow researchers to investigate multiple grammatical or syntactic aspects of language processing. In order to serve that purpose, pseudoword stimuli need to preserve certain properties of real language. We provide a Python-based pipeline for the generation of pseudoword stimuli that sound/read naturally in a given language. The pseudowords are designed to resemble real words and clearly indicate their grammatical class for languages that use specific suffixes from parts of speech. We also provide two sets of pseudonouns and pseudoverbs in Polish that are outcomes of the applied pipeline. The sets are equipped with psycholinguistically relevant properties of words, such as orthographic Levenshtein distance 20. We also performed two studies (overall N = 640) to test the validity of the algorithmically constructed stimuli in a human sample. Thus, we present stimuli that were deprived of direct meaning yet are clearly classifiable as grammatical categories while being orthographically and phonologically plausible.

The In-Out Effect in the Perception and Production of Real Words

The in‐out effect refers to the tendency that novel words whose consonants follow an inward‐wandering pattern (e.g., P‐T‐K) are rated more positively than stimuli whose consonants follow an outward‐wandering pattern (e.g., K‐T‐P). While this effect appears to be reliable, it is not yet clear to what extent it generalizes to existing words in a language. In two large‐scale studies, we sought to extend the in‐out effect from pseudowords to real words and from perception to production. In Study 1, we investigated whether previously collected affective ratings for English and Dutch words were more positive for inward‐wandering words and more negative for outward‐wandering words. No systematic relationship between wandering direction and affective valence was found. In Study 2, we investigated whether inward‐wandering words are more likely to occur in positive online consumer restaurant reviews written in English and Dutch, compared to negative reviews, and whether this association was stronger for food ratings than for decor ratings. Again, no systematic relationship between wandering direction and review rating emerged. We suggest that the affective states triggered by different consonantal wandering directions might be used as a cue for forming judgments in the absence of other information, but that wandering direction is too low in salience to drive the shape of words in the lexicon.

ERPs reveal an iconic relation between sublexical phonology and affective meaning

Classical linguistic theory assumes that formal aspects, like sound, are not internally related to the meaning of words. However, recent research suggests language might code affective meaning such as threat and alert sublexically. Positing affective phonological iconicity as a systematic organization principle of the German lexicon, we calculated sublexical affective values for sub-syllabic phonological word segments from a large-scale affective lexical German database by averaging valence and arousal ratings of all words any phonological segment appears in. We tested word stimuli with either consistent or inconsistent mappings between lexical affective meaning and sublexical affective values (negative-valence/high-arousal vs. neutral-valence/low-arousal) in an EEG visual-lexical-decision task. A mismatch between sublexical and lexical affective values elicited an increased N400 response. These results reveal that systematic affective phonological iconicity - extracted from the lexicon - impacts the extraction of lexical word meaning during reading.

Analogical mapping across sensory modalities and evidence for a general analogy factor

Analogy is a central component of human cognition. Analogical "mapping" of similarities between pieces of information present in our experiences supports cognitive and social development, classroom learning, and creative insights and innovation. To date, analogical mapping has primarily been studied within separate modalities of information (e.g., verbal analogies between words, visuo-spatial analogies between objects). However, human experience, in development and adulthood, includes highly variegated information (e.g., words, sounds, objects) received via multiple sensory and information-processing pathways (e.g., visual vs. auditory pathways). Whereas cross-modal correspondences (e.g., between pitch and height) have been observed, the correspondences were between individual items, rather than between relations. Thus, analogical mapping (characterized by second-order relations between relations) has not been directly tested as a basis for cross-modal correspondence. Here, we devised novel cross-modality analogical stimuli (lines-to-sounds, lines-to-words, words-to-sounds) that explicated second-order comparisons between relations. In four samples across three studies-participants demonstrated well-above-chance identification of cross-modal second-order relations, providing robust evidence of analogy across modalities. Further, performance across all analogy types was explained by a single factor, indicating a modality-general analogical ability (i.e., an "analo-g" factor). Analo-g explained performance over-and-above fluid intelligence as well as verbal and spatial abilities, though a stronger relationship to verbal than visuo-spatial ability emerged, consistent with verbal/semantic contributions to analogy. The present data suggests novel questions about our ability to find/learn second-order relations among the diverse information sources that populate human experience, and about cross-modal human and AI analogical mapping in developmental, educational, and creative contexts.

What is preferred in the in-out effect: articulation locations or articulation movement direction?

Words whose consonant articulation locations move inward (from the front to the back of the mouth) are preferred over words with the opposite consonant articulation location direction, a phenomenon termed the in-out effect. Recently, an alternative explanation for the in-out effect has been proposed based on position-weighted consonant preferences instead of articulation location movement preferences. However, this explanation has only been tested with word fragments. In two experiments, we tested these explanations using both, word fragment and pseudo-word stimuli. For word fragments, preferences could be explained by position-weighted consonant preferences, while, for pseudo-words, stimuli containing articulation location movement were evaluated more favourably than stimuli not containing articulation location movement. Thus, the in-out effect for word stimuli depends on movement of articulation locations. This finding demonstrates that a word's sound symbolic meaning cannot always be explained by its individual letters but can depend on letter sequences.

Sound-Action Symbolism

Recent evidence has shown linkages between actions and segmental elements of speech. For instance, close-front vowels are sound symbolically associated with the precision grip, and front vowels are associated with forward-directed limb movements. The current review article presents a variety of such sound-action effects and proposes that they compose a category of sound symbolism that is based on grounding a conceptual knowledge of a referent in articulatory and manual action representations. In addition, the article proposes that even some widely known sound symbolism phenomena such as the sound-magnitude symbolism can be partially based on similar sensorimotor grounding. It is also discussed that meaning of suprasegmental speech elements in many instances is similarly grounded in body actions. Sound symbolism, prosody, and body gestures might originate from the same embodied mechanisms that enable a vivid and iconic expression of a meaning of a referent to the recipient.

The Relationships Between Initial Consonants in Japanese Sound Symbolic Words and Familiarity, Multi-Sensory Imageability, Emotional Valence, and Arousal

Sound symbolic words consist of inevitable associations between sounds and meanings. We aimed to identify differences in familiarity, visual imageability, auditory imageability, tactile imageability, emotional valence, and arousal between Japanese sound symbolic words with voiced initial consonants (VCs; dakuon in Japanese; e.g., biribiri) and Japanese sound symbolic words with semi-voiced initial consonants (SVCs; handakuon in Japanese; e.g., piripiri), and between VCs (e.g., daradara) and Japanese sound symbolic words with voiceless initial consonants (VLCs; seion in Japanese; e.g., taratara). First, auditory imageability and arousal were significantly higher in VCs than SVCs, whereas familiarity, tactile imageability, and positive emotion (emotional valence) were significantly higher in SVCs than VCs. Second, visual imageability was higher in VCs than VLCs, while familiarity and positive emotion were higher in VLCs than VCs. Initial consonants in Japanese sound symbolic words could be associated with specific subjective evaluations such as familiarity, visual imageability, auditory imageability, tactile imageability, emotional valence, and arousal.

Sound symbolism shapes the English language: The maluma/takete effect in English nouns

Sound symbolism refers to associations between language sounds (i.e., phonemes) and perceptual and/or semantic features. One example is the maluma/takete effect: an association between certain phonemes (e.g., /m/, /u/) and roundness, and others (e.g., /k/, /ɪ/) and spikiness. While this association has been demonstrated in laboratory tasks with nonword stimuli, its presence in existing spoken language is unknown. Here we examined whether the maluma/takete effect is attested in English, across a broad sample of words. Best-worst judgments from 171 university students were used to quantify the shape of 1,757 objects, from spiky to round. We then examined whether the presence of certain phonemes in words predicted the shape of the objects to which they refer. We found evidence that phonemes associated with roundness are more common in words referring to round objects, and phonemes associated with spikiness are more common in words referring to spiky objects. This represents an instance of iconicity, and thus nonarbitrariness, in human language.

Measuring Farm Animal Emotions-Sensor-Based Approaches

Understanding animal emotions is a key to unlocking methods for improving animal welfare. Currently there are no 'benchmarks' or any scientific assessments available for measuring and quantifying the emotional responses of farm animals. Using sensors to collect biometric data as a means of measuring animal emotions is a topic of growing interest in agricultural technology. Here we reviewed several aspects of the use of sensor-based approaches in monitoring animal emotions, beginning with an introduction on animal emotions. Then we reviewed some of the available technological systems for analyzing animal emotions. These systems include a variety of sensors, the algorithms used to process biometric data taken from these sensors, facial expression, and sound analysis. We conclude that a single emotional expression measurement based on either the facial feature of animals or the physiological functions cannot show accurately the farm animal's emotional changes, and hence compound expression recognition measurement is required. We propose some novel ways to combine sensor technologies through sensor fusion into efficient systems for monitoring and measuring the animals' compound expression of emotions. Finally, we explore future perspectives in the field, including challenges and opportunities.

A Sound Explanation for Motor Cortex Engagement during Action Word Comprehension

Comprehending action words often engages similar brain regions to those involved in perceiving and executing actions. This finding has been interpreted as support for grounding of conceptual processing in motor representations or that conceptual processing involves motor simulation. However, such demonstrations cannot confirm the nature of the mechanism(s) responsible, as word comprehension involves multiple processes (e.g., lexical, semantic, morphological, phonological). In this study, we tested whether this motor cortex engagement instead reflects processing of statistical regularities in sublexical phonological features. Specifically, we measured brain activity in healthy participants using functional magnetic resonance imaging while they performed an auditory lexical decision paradigm involving monosyllabic action words associated with specific effectors (face, arm, and leg). We show that nonwords matched to the action words in terms of their phonotactic probability elicit common patterns of activation. In addition, we show that a measure of the action words' phonological typicality, the extent to which a word's phonology is typical of other words in the grammatical category to which it belongs (i.e., more or less verb-like), is responsible for their activating a significant portion of primary and premotor cortices. These results indicate motor cortex engagement during action word comprehension is more likely to reflect processing of statistical regularities in sublexical phonological features than conceptual processing. We discuss the implications for current neurobiological models of language, all of which implicitly or explicitly assume that the relationship between the sound of a word and its meaning is arbitrary.

Semantics Based on the Physical Characteristics of Facial Expressions Used to Produce Japanese Vowels

Previous studies have reported that verbal sounds are associated-non-arbitrarily-with specific meanings (e.g., sound symbolism and onomatopoeia), including visual forms of information such as facial expressions; however, it remains unclear how mouth shapes used to utter each vowel create our semantic impressions. We asked 81 Japanese participants to evaluate mouth shapes associated with five Japanese vowels by using 10 five-item semantic differential scales. The results reveal that the physical characteristics of the facial expressions (mouth shapes) induced specific evaluations. For example, the mouth shape made to voice the vowel "a" was the one with the biggest, widest, and highest facial components compared to other mouth shapes, and people perceived words containing that vowel sound as bigger. The mouth shapes used to pronounce the vowel "i" were perceived as more likable than the other four vowels. These findings indicate that the mouth shapes producing vowels imply specific meanings. Our study provides clues about the meaning of verbal sounds and what the facial expressions in communication represent to the perceiver.

Iconicity ratings for 10,995 Spanish words and their relationship with psycholinguistic variables

The study of iconicity, or the resemblance between word forms and their meanings, has been the focus of increasing attention in recent years. Nevertheless, there is a lack of large-scale normative studies on the iconic properties of words, which could prove crucial to expanding our understanding of form-meaning associations. In this work, we report subjective iconicity ratings for 10,995 visually presented Spanish words from 1350 participants who were asked to repeat each of the words aloud before rating them. The response reliability and the consistency between the present and previous ratings were good. The relationships between iconicity and several psycholinguistic variables were examined through multiple regression analyses. We found that sensory experience ratings were the main predictor of iconicity, and that early-acquired and more abstract words received higher iconicity scores. We also found that onomatopoeias and interjections were the most iconic words, followed by adjectives. Finally, a follow-up study was conducted in which a subsample of 360 words with different levels of iconicity from the visual presentation study was auditorily presented to the participants. A high correlation was observed between the iconicity scores in the visual and auditory presentations. The normative data provided in this database might prove useful in expanding the body of knowledge on issues such as the processing of the iconic properties of words and the role of word-form associations in the acquisition of vocabularies. The database can be downloaded from https://osf.io/v5er3/ .

Sound Predicts Meaning: Cross-Modal Associations Between Formant Frequency and Emotional Tone in Stanzas

Research on the relation between sound and meaning in language has reported substantial evidence for implicit associations between articulatory-acoustic characteristics of phonemes and emotions. In the present study, we specifically tested the relation between the acoustic properties of a text and its emotional tone as perceived by readers. To this end, we asked participants to assess the emotional tone of single stanzas extracted from a large variety of poems. The selected stanzas had either an extremely high, a neutral, or an extremely low average formant dispersion. To assess the average formant dispersion per stanza, all words were phonetically transcribed and the distance between the first and second formant per vowel was calculated. Building on a long tradition of research on associations between sound frequency on the one hand and non-acoustic concepts such as size, strength, or happiness on the other hand, we hypothesized that stanzas with an extremely high average formant dispersion would be rated lower on items referring to Potency (dominance) and higher on items referring to Activity (arousal) and Evaluation (emotional valence). The results confirmed our hypotheses for the dimensions of Potency and Evaluation, but not for the dimension of Activity. We conclude that, at least in poetic language, extreme values of acoustic features of vowels are a significant predictor for the emotional tone of a text.

Emotional Valence Coded in the Phonemic Content – Statistical Evidence Based on Corpus Analysis

This study investigates the relationship between the phonemic content of texts in English and the emotional valence they inspire. The sublexical content is presented in terms of biphones composed by one vowel and one consonant. The statistical analysis of a vast corpus of emotionally evaluated sentences reveals a strong correlation between this sublexical presentation and the evaluations of valence provided by the readers. An initial test performed with other valence-rated prose texts makes believing that the feature observed within the corpus can be useful for the emotion classification of texts.

Bouba and Kiki inside objects: Sound-shape correspondence for objects with a hole

Visual holes (cutouts in a surface) have recently intrigued vision scientists as interesting and useful stimuli in the studies of shape perception and as a perceptual conundrum regarding figure/ground organization. Adopting the Bouba/Kiki paradigm, this study addressed a controversial issue of whether the perceived shape of a closed region alters when the region changes from a solid object to an empty hole, in a more direct manner than previous studies did. Observers were presented with two doughnut-like cardboard cutouts, one with a flower-shaped hole and the other with a star-shaped hole, and then matched them with two nonsense words. The curvature profile of the hole boundary was manipulated so that the shape of the interior region (i.e., a hole) and that of the exterior region (i.e., material edges) give rise to opposite shape impressions (i.e., one rounded and the other spiky). The results of Experiment 1 revealed that shape-name matching for holed objects is based on the interior shapes of holes, but not those of materially defined inner edges. The following three experiments replicated the same pattern of results even when holes appeared like oral apertures in animal character faces (Experiments 2-3) and when they were irregular, non-symmetric, and low in semantic association with familiar real-world objects (Experiment 4). Lastly, Experiment 5 showed that shape-name matching for "C"-shaped, negative-part stimuli is also interior-shape-based if the opening of the interior region is relatively small. These findings suggest that the interior shapes of holes are automatically accessible. I conclude with a discussion of my hypothesis that the only global-level, unitary shape representation of a bounded region of a single connected surface is that of the interior region for both objects and holes, imposing an important constraint in visual shape processing.

Towards emotion recognition in texts: A sound-symbolic experiment

The purpose of this study is to investigate the relationship between the phonetic content of prose texts in English and the emotion that the texts inspire, namely - the effect of vowel-consonant bi-phones on subjects’ evaluation of positive or negative emotional valence when reading. The methodology is based on data from an experiment where the participants, native speakers of three different languages, evaluated the valence invoked in them by one-page texts from English books. The sub-lexical level of the texts was obtained using phonetic transcriptions of the words and their further decomposition into vowel-consonant bi-phones. The statistical investigation relies on density-measures of the investigated bi-phones over each text as a whole. The result shows that there exists a correlation between the obtained sub-lexical representation and the valence perceived by the readers. Concerning the type of the consonants in the bi-phones (abrupt or sonorant), the influence of the abrupt bi-phones is stronger. However, sub-sets of both types of bi-phones showed relatedness with the emotional valence conveyed by the texts. In conclusion, the speech, expressed in written form, is laden with emotional valence even when the words’ lexicological meaning is not taken into consideration and the words are apprehended as mere phonetic constructs. This prompts hypothesizing that words’ semantics itself is partly underpinned by some mental emotion-related level of conceptualization, influenced by sounds. For practical purposes, the result suggests that based on the syllabic content of a text it should be possible to predict the valence that the text would inspire in its readers.