1
|
Tang E, Gong J, Zhang J, Zhang J, Fang R, Guan J, Ding H. Chinese Emotional Speech Audiometry Project (CESAP): Establishment and Validation of a New Material Set With Emotionally Neutral Disyllabic Words. JOURNAL OF SPEECH, LANGUAGE, AND HEARING RESEARCH : JSLHR 2024; 67:1945-1963. [PMID: 38749011 DOI: 10.1044/2024_jslhr-23-00625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/21/2024]
Abstract
PURPOSE The Chinese Emotional Speech Audiometry Project (CESAP) aims to establish a new material set for Chinese speech audiometry tests, which can be used in both neutral and emotional prosody settings. As the first endeavor of CESAP, this study demonstrates the development of the material foundation and reports its validation in neutral prosody. METHOD In the development step, 40 phonetically balanced word lists consisting of 30 Chinese disyllabic words with neutral valence were first generated. In a following affective rating experiment, 35 word lists were qualified for validation based on the familiarity and valence ratings from 30 normal-hearing (NH) participants. For validation, performance-intensity functions of each word list were fitted with responses from 60 NH subjects under six presentation levels (-1, 3, 5, 7, 11, and 20 dB HL). The final material set was determined by the intelligibility scores at each decibel level and the mean slopes. RESULTS First, 35 lists satisfied the criteria of phonetic balance, limited repetitions, high familiarity, and neutral valence and were selected for validation. Second, 15 lists were compiled in the final material set based on the pairwise differences in intelligibility scores and the fitted 20%-80% slopes. The established material set had high reliability and validity and was sensitive to detect intelligibility changes (50% slope: 6.20%/dB; 20%-80% slope: 5.45%/dB), with small covariance of variation for thresholds (15%), 50% slope (12%), and 20%-80% slope (12%). CONCLUSION Our final material set of 15 word lists takes the initiative to control the emotional aspect of audiometry tests, which enriches available Mandarin speech recognition materials and warrants future assessments in emotional prosody among populations with hearing impairments. SUPPLEMENTAL MATERIAL https://doi.org/10.23641/asha.25742814.
Collapse
Affiliation(s)
- Enze Tang
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
- Department of Psychology and Behavioral Sciences, Zhejiang University, Hangzhou, China
| | - Jie Gong
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
- National Research Centre for Language and Well-being, Shanghai, China
| | - Jing Zhang
- SONOVA Innovation Center, Shanghai, China
| | - Jiaqi Zhang
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
- National Research Centre for Language and Well-being, Shanghai, China
| | - Ruomei Fang
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
- National Research Centre for Language and Well-being, Shanghai, China
| | | | - Hongwei Ding
- Speech-Language-Hearing Center, School of Foreign Languages, Shanghai Jiao Tong University, China
- National Research Centre for Language and Well-being, Shanghai, China
| |
Collapse
|
2
|
Vieitez L, Padrón I, Fraga I. When unpleasantness meets feminines: a behavioural study on gender agreement and emotionality. Cogn Emot 2024:1-11. [PMID: 38554263 DOI: 10.1080/02699931.2024.2334834] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/13/2023] [Accepted: 03/19/2024] [Indexed: 04/01/2024]
Abstract
The emotional connotation of words is known to affect word and sentence processing. However, the when and how of the interaction between emotion and grammar are still up for debate. In this behavioural experiment, 35 female university students read noun phrases (NPs) composed by a determiner and a noun in their L1 (Spanish), and were asked to indicate if the NPs were grammatically correct (elmasc camareromasc) or not (*lafem tornillomasc; i.e. a gender agreement task). The type of gender (arbitrary/natural), the emotionality (unpleasant/neutral), and the gender class (feminine/masculine) of the nouns were manipulated. We found an overall grammaticality effect, responses being faster in grammatically correct trials than in incorrect ones. However, the effects of emotionality and gender class varied depending on gender type. For arbitrary gender, the grammaticality effect was greater in feminine nouns than in masculine nouns and independent of emotionality. For natural gender, the grammaticality effect interacted with gender class and emotionality, this effect only emerging in unpleasant stimuli for feminine nouns. Our results reveal that it is possible to find emotional effects at the behavioural level in an intrinsically grammatical task. Yet, these effects depend on gender properties like the type of gender and the gender class.
Collapse
Affiliation(s)
- Lucía Vieitez
- Cognitive Processes & Behaviour Research Group, Department of Social Psychology, Basic Psychology, and Methodology, Universidade de Santiago de Compostela, Santiago de Compostela, Spain
| | - Isabel Padrón
- Cognitive Processes & Behaviour Research Group, Department of Social Psychology, Basic Psychology, and Methodology, Universidade de Santiago de Compostela, Santiago de Compostela, Spain
| | - Isabel Fraga
- Cognitive Processes & Behaviour Research Group, Department of Social Psychology, Basic Psychology, and Methodology, Universidade de Santiago de Compostela, Santiago de Compostela, Spain
| |
Collapse
|
3
|
Kaakinen JK, Werlen E, Kammerer Y, Acartürk C, Aparicio X, Baccino T, Ballenghein U, Bergamin P, Castells N, Costa A, Falé I, Mégalakaki O, Ruiz Fernández S. IDEST: International Database of Emotional Short Texts. PLoS One 2022; 17:e0274480. [PMID: 36206273 PMCID: PMC9544016 DOI: 10.1371/journal.pone.0274480] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2022] [Accepted: 08/29/2022] [Indexed: 11/18/2022] Open
Abstract
We introduce a database (IDEST) of 250 short stories rated for valence, arousal, and comprehensibility in two languages. The texts, with a narrative structure telling a story in the first person and controlled for length, were originally written in six different languages (Finnish, French, German, Portuguese, Spanish, and Turkish), and rated for arousal, valence, and comprehensibility in the original language. The stories were translated into English, and the same ratings for the English translations were collected via an internet survey tool (N = 573). In addition to the rating data, we also report readability indexes for the original and English texts. The texts have been categorized into different story types based on their emotional arc. The texts score high on comprehensibility and represent a wide range of emotional valence and arousal levels. The comparative analysis of the ratings of the original texts and English translations showed that valence ratings were very similar across languages, whereas correlations between the two pairs of language versions for arousal and comprehensibility were modest. Comprehensibility ratings correlated with only some of the readability indexes. The database is published in osf.io/9tga3, and it is freely available for academic research.
Collapse
Affiliation(s)
- Johanna K. Kaakinen
- Department of Psychology and Speech-Language Pathology, University of Turku, Turku, Finland
- INVEST Research Flagship, University of Turku, Turku, Finland
| | - Egon Werlen
- Institute for Research in Open, Distance and eLearning, Swiss Distance University of Applied Sciences, Brig, Switzerland
| | - Yvonne Kammerer
- Leibniz-Institut für Wissensmedien, Tübingen, Germany
- Stuttgart Media University, Stuttgart, Germany
| | - Cengiz Acartürk
- Cognitive Science Department, Jagiellonian University, Kraków, Poland
- Cognitive Science Department, Middle East Technical University, Ankara, Turkey
| | | | | | - Ugo Ballenghein
- Université Paris Est Créteil, Bonneuil, France
- Université Paris 8, Saint-Denis, France
| | - Per Bergamin
- Institute for Research in Open, Distance and eLearning, Swiss Distance University of Applied Sciences, Brig, Switzerland
| | | | - Armanda Costa
- Center of Linguistics, School of Arts and Humanities, University of Lisbon, Lisbon, Portugal
| | - Isabel Falé
- Center of Linguistics, School of Arts and Humanities, University of Lisbon, Lisbon, Portugal
- Universidade Aberta, Lisbon, Portugal
| | - Olga Mégalakaki
- Université de Picardie Jules Verne, Amiens, France
- Sigmund Freud University, Paris, France
| | - Susana Ruiz Fernández
- Leibniz-Institut für Wissensmedien, Tübingen, Germany
- FOM University of Applied Sciences, Essen, Germany
| |
Collapse
|
4
|
Picou EM, Singh G, Russo FA. A Comparison between a remote testing and a laboratory test setting for evaluating emotional responses to non-speech sounds. Int J Audiol 2021; 61:799-808. [PMID: 34883031 DOI: 10.1080/14992027.2021.2007422] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
Abstract
OBJECTIVE To evaluate remote testing as a tool for measuring emotional responses to non-speech sounds. DESIGN Participants self-reported their hearing status and rated valence and arousal in response to non-speech sounds on an Internet crowdsourcing platform. These ratings were compared to data obtained in a laboratory setting with participants who had confirmed normal or impaired hearing. STUDY SAMPLE Adults with normal and impaired hearing. RESULTS In both settings, participants with hearing loss rated pleasant sounds as less pleasant than did their peers with normal hearing. The difference in valence ratings between groups was generally smaller when measured in the remote setting than in the laboratory setting. This difference was the result of participants with normal hearing rating sounds as less extreme (less pleasant, less unpleasant) in the remote setting than did their peers in the laboratory setting, whereas no such difference was noted for participants with hearing loss. Ratings of arousal were similar from participants with normal and impaired hearing; the similarity persisted in both settings. CONCLUSIONS In both test settings, participants with hearing loss rated pleasant sounds as less pleasant than did their normal hearing counterparts. Future work is warranted to explain the ratings of participants with normal hearing.
Collapse
Affiliation(s)
- Erin M Picou
- Department of Hearing and Speech Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Gurjit Singh
- Phonak, Canada, Mississauga, Canada.,Department of Psychology, Ryerson University, Toronto, Canada.,Department of Speech-Language Pathology, University of Toronto, Toronto, Canada
| | - Frank A Russo
- Department of Psychology, Ryerson University, Toronto, Canada
| |
Collapse
|
5
|
Saarimäki H. Naturalistic Stimuli in Affective Neuroimaging: A Review. Front Hum Neurosci 2021; 15:675068. [PMID: 34220474 PMCID: PMC8245682 DOI: 10.3389/fnhum.2021.675068] [Citation(s) in RCA: 45] [Impact Index Per Article: 11.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/02/2021] [Accepted: 05/17/2021] [Indexed: 11/13/2022] Open
Abstract
Naturalistic stimuli such as movies, music, and spoken and written stories elicit strong emotions and allow brain imaging of emotions in close-to-real-life conditions. Emotions are multi-component phenomena: relevant stimuli lead to automatic changes in multiple functional components including perception, physiology, behavior, and conscious experiences. Brain activity during naturalistic stimuli reflects all these changes, suggesting that parsing emotion-related processing during such complex stimulation is not a straightforward task. Here, I review affective neuroimaging studies that have employed naturalistic stimuli to study emotional processing, focusing especially on experienced emotions. I argue that to investigate emotions with naturalistic stimuli, we need to define and extract emotion features from both the stimulus and the observer.
Collapse
Affiliation(s)
- Heini Saarimäki
- Human Information Processing Laboratory, Faculty of Social Sciences, Tampere University, Tampere, Finland
| |
Collapse
|
6
|
Usée F, Jacobs AM, Lüdtke J. From Abstract Symbols to Emotional (In-)Sights: An Eye Tracking Study on the Effects of Emotional Vignettes and Pictures. Front Psychol 2020; 11:905. [PMID: 32528357 PMCID: PMC7264705 DOI: 10.3389/fpsyg.2020.00905] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/09/2019] [Accepted: 04/14/2020] [Indexed: 02/04/2023] Open
Abstract
Reading is known to be a highly complex, emotion-inducing process, usually involving connected and cohesive sequences of sentences and paragraphs. However, most empirical results, especially from studies using eye tracking, are either restricted to simple linguistic materials (e.g., isolated words, single sentences) or disregard valence-driven effects. The present study addressed the need for ecologically valid stimuli by examining the emotion potential of and reading behavior in emotional vignettes, often used in applied psychological contexts and discourse comprehension. To allow for a cross-domain comparison in the area of emotion induction, negatively and positively valenced vignettes were constructed based on pre-selected emotional pictures from the Nencki Affective Picture System (NAPS; Marchewka et al., 2014). We collected ratings of perceived valence and arousal for both material groups and recorded eye movements of 42 participants during reading and picture viewing. Linear mixed-effects models were performed to analyze effects of valence (i.e., valence category, valence rating) and stimulus domain (i.e., textual, pictorial) on ratings of perceived valence and arousal, eye movements in reading, and eye movements in picture viewing. Results supported the success of our experimental manipulation: emotionally positive stimuli (i.e., vignettes, pictures) were perceived more positively and less arousing than emotionally negative ones. The cross-domain comparison indicated that vignettes are able to induce stronger valence effects than their pictorial counterparts, no differences between vignettes and pictures regarding effects on perceived arousal were found. Analyses of eye movements in reading replicated results from experiments using isolated words and sentences: perceived positive text valence attracted shorter reading times than perceived negative valence at both the supralexical and lexical level. In line with previous findings, no emotion effects on eye movements in picture viewing were found. This is the first eye tracking study reporting superior valence effects for vignettes compared to pictures and valence-specific effects on eye movements in reading at the supralexical level.
Collapse
Affiliation(s)
- Franziska Usée
- Department of Experimental and Neurocognitive Psychology, Freie Universität Berlin, Berlin, Germany
| | - Arthur M Jacobs
- Department of Experimental and Neurocognitive Psychology, Freie Universität Berlin, Berlin, Germany.,Center for Cognitive Neuroscience Berlin, Freie Universität Berlin, Berlin, Germany
| | - Jana Lüdtke
- Department of Experimental and Neurocognitive Psychology, Freie Universität Berlin, Berlin, Germany
| |
Collapse
|
7
|
Soares AP, Macedo J, Oliveira HM, Lages A, Hernández-Cabrera J, Pinheiro AP. Self-reference is a fast-acting automatic mechanism on emotional word processing: evidence from a masked priming affective categorisation task. JOURNAL OF COGNITIVE PSYCHOLOGY 2019. [DOI: 10.1080/20445911.2019.1599003] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/26/2022]
Affiliation(s)
- Ana P. Soares
- Laboratório de Cognição Humana, Centro de Investigação em Psicologia (CIPSI), Universidade do Minho, Braga, Portugal
| | - Joana Macedo
- Laboratório de Cognição Humana, Centro de Investigação em Psicologia (CIPSI), Universidade do Minho, Braga, Portugal
| | - Helena M. Oliveira
- Laboratório de Cognição Humana, Centro de Investigação em Psicologia (CIPSI), Universidade do Minho, Braga, Portugal
| | - Alexandrina Lages
- Laboratório de Cognição Humana, Centro de Investigação em Psicologia (CIPSI), Universidade do Minho, Braga, Portugal
| | - Juan Hernández-Cabrera
- Laboratorio de Neurociencia Cognitiva y Psicolingüística, Facultad de Psicología, Universidad de la Laguna, Tenerife, España
| | - Ana P. Pinheiro
- Laboratório de Voz, Afeto e Fala, Faculdade de Psicologia, Universidade de Lisboa, Lisboa, Portugal
| |
Collapse
|
8
|
Concurrent emotional response and semantic unification: An event-related potential study. COGNITIVE AFFECTIVE & BEHAVIORAL NEUROSCIENCE 2018; 19:154-164. [PMID: 30357658 DOI: 10.3758/s13415-018-00652-5] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
Using event-related potentials, in this study we examined how implied emotion is derived from sentences. In the same sentential context, different emotionally neutral words rendered the whole sentence emotionally neutral and semantically congruent, emotionally negative and semantically congruent, or emotionally neutral and semantically incongruent. Relative to the words in the neutral-congruent condition, the words in the neutral-incongruent condition elicited a larger N400, indicating increased semantic processing, whereas the words in the negative-congruent condition elicited a long-lasting positivity between 300 and 1,000 ms, indicating an emotional response. The overlapping time windows of semantic processing and the emotional response suggest that the construction of emotional meaning operates concurrently with semantic unification. The results indicate that the implied emotional processing of sentences may be a result of unification operations but does not necessarily involve causal appraisal of a sentence's mental representation.
Collapse
|
9
|
Portuguese Norms of Name Agreement, Concept Familiarity, Subjective Frequency and Visual Complexity for 150 Colored and Tridimensional Pictures. SPANISH JOURNAL OF PSYCHOLOGY 2018; 21:E8. [PMID: 29633684 DOI: 10.1017/sjp.2018.10] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Pictures are complex stimuli that require a careful control of several characteristics and attributes standardized for different languages. In this work we present for the first time European Portuguese (EP) norms for name agreement, concept familiarity, subjective frequency and visual complexity for a new set of 150 colored pictures. These pictures were selected to represent exemplars of the most used semantic categories in research and to depict objects which, though familiar to the participants, were rarely used in daily life, which makes them particularly prone to speech failures such as tip-of-the-tongue (TOT) states. Norms were collected from 640 EP native speakers that rated each picture in the four variables through a web-survey procedure. Results showed, as expected, that a large number of pictures in the dataset elicited a TOT response, and additionally that the ratings obtained in each of the dimensions are in line with those observed in other pictorial datasets. Norms can be freely downloaded at https://www.psi.uminho.pt/en/Research/Psycholinguistics/Pages/Databases.aspx.
Collapse
|
10
|
Imbir KK. The Affective Norms for Polish Short Texts (ANPST) Database Properties and Impact of Participants' Population and Sex on Affective Ratings. Front Psychol 2017; 8:855. [PMID: 28611707 PMCID: PMC5447762 DOI: 10.3389/fpsyg.2017.00855] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2016] [Accepted: 05/09/2017] [Indexed: 11/13/2022] Open
Abstract
The Affective Norms for Polish Short Texts (ANPST) dataset (Imbir, 2016d) is a list of 718 affective sentence stimuli with known affective properties with respect to subjectively perceived valence, arousal, dominance, origin, subjective significance, and source. This article examines the reliability of the ANPST and the impact of population type and sex on affective ratings. The ANPST dataset was introduced to provide a recognized method of eliciting affective states with linguistic stimuli more complex than single words and that included contextual information and thus are less ambiguous in interpretation than single word. Analysis of the properties of the ANPST dataset showed that norms collected are reliable in terms of split-half estimation and that the distributions of ratings are similar to those obtained in other affective norms studies. The pattern of correlations was the same as that found in analysis of an affective norms dataset for words based on the same six variables. Female psychology students' valence ratings were also more polarized than those of their female student peers studying other subjects, but arousal ratings were only higher for negative words. Differences also appeared for all other measured dimensions. Women's valence ratings were found to be more polarized and arousal ratings were higher than those made by men, and differences were also present for dominance, origin, and subjective significance. The ANPST is the first Polish language list of sentence stimuli and could easily be adapted for other languages and cultures.
Collapse
Affiliation(s)
- Kamil K Imbir
- Faculty of Psychology, University of WarsawWarsaw, Poland
| |
Collapse
|
11
|
What is the Melody of That Voice? Probing Unbiased Recognition Accuracy with the Montreal Affective Voices. JOURNAL OF NONVERBAL BEHAVIOR 2017. [DOI: 10.1007/s10919-017-0253-4] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/29/2022]
|
12
|
Imbir KK. Affective Norms for 718 Polish Short Texts (ANPST): Dataset with Affective Ratings for Valence, Arousal, Dominance, Origin, Subjective Significance and Source Dimensions. Front Psychol 2016; 7:1030. [PMID: 27458420 PMCID: PMC4930931 DOI: 10.3389/fpsyg.2016.01030] [Citation(s) in RCA: 14] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/17/2016] [Accepted: 06/23/2016] [Indexed: 01/27/2023] Open
Abstract
Affective sciences are of burgeoning interest and are attracting more and more research attention. Three components of stimuli meaning have traditionally been distinguished: valence (degree of pleasantness), arousal (degree of intensity of sensations), and dominance (degree of control over sensations). Recently, another three dimensions have been introduced to measure qualities connected to the emotion-duality model: origin (the main component originating in the heart or in the mind), subjective significance (the degree of the subjective goal's relevance), and source (the location of the stimuli evoking the state). All six affective dimensions were assessed in our study of 718 Polish short texts (sentences of 5-23 words and 36-133 characters in length) describing situations or states in a way that can be referenced to an individual's experience. Assessments were carried out by 148 psychology students (all women for 108 sentences) and 2,091 students of different faculties (social science, engineering, life science, and science) from Warsaw colleges and universities (1,061 women and 1,030 men for all 718 sentences). Assessing sets of sentences for emotional response is especially useful for researchers interested in emotion elicitation through the use of a phrase such as "imagine that …" or by simply reading emotionally charged material that is more complex and that provides better context than single pictures or words.
Collapse
Affiliation(s)
- Kamil K Imbir
- Faculty of Psychology, University of Warsaw Warsaw, Poland
| |
Collapse
|