1
|
Tsuji Y, Kanazawa S, Yamaguchi MK. Emotional response in babies' pupil contagion. J Exp Child Psychol 2024; 238:105801. [PMID: 37883903 DOI: 10.1016/j.jecp.2023.105801] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/15/2022] [Revised: 10/01/2023] [Accepted: 10/01/2023] [Indexed: 10/28/2023]
Abstract
In this study, it was investigated whether an emotional response would occur in pupil contagion by using skin conductance response (SCR) in 5- and 6-month-old infants. In the experiment, emotional responses to pupil diameter change (dilating/constricting) between the face and eyes regions were compared by using pupil diameter response and SCR. The results showed that pupil diameter responses to pupil diameter changes did not differ between face and eyes regions. The emotional response indicated by the SCR significantly increased when participants looked at dilating pupils of face stimuli compared with when participants looked at constricted pupils of face stimuli. In addition, we found a significant correlation between SCR and pupil dilation in the face. This means that pupil diameter expansion significantly increases emotional response in pupil dilation of the face region.
Collapse
Affiliation(s)
- Yuki Tsuji
- Institute of Cultural Sciences, Chuo University, Hachioji, Tokyo 192-0393, Japan; Research Fellow of Japan Society for the Promotion of Science, Chiyoda-ku, Tokyo 102-0083, Japan.
| | - So Kanazawa
- Department of Psychology, Japan Women's University, Bunkyo-ku, Tokyo 112-8681, Japan
| | - Masami K Yamaguchi
- Department of Psychology, Chuo University, Hachioji-shi, Tokyo 192-0393, Japan
| |
Collapse
|
2
|
Polo EM, Farabbi A, Mollura M, Paglialonga A, Mainardi L, Barbieri R. Comparative Assessment of Physiological Responses to Emotional Elicitation by Auditory and Visual Stimuli. IEEE JOURNAL OF TRANSLATIONAL ENGINEERING IN HEALTH AND MEDICINE 2023; 12:171-181. [PMID: 38088996 PMCID: PMC10712661 DOI: 10.1109/jtehm.2023.3324249] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Subscribe] [Scholar Register] [Received: 02/15/2023] [Revised: 09/28/2023] [Accepted: 10/07/2023] [Indexed: 12/18/2023]
Abstract
The study of emotions through the analysis of the induced physiological responses gained increasing interest in the past decades. Emotion-related studies usually employ films or video clips, but these stimuli do not give the possibility to properly separate and assess the emotional content provided by sight or hearing in terms of physiological responses. In this study we have devised an experimental protocol to elicit emotions by using, separately and jointly, pictures and sounds from the widely used International Affective Pictures System and International Affective Digital Sounds databases. We processed galvanic skin response, electrocardiogram, blood volume pulse, pupillary signal and electroencephalogram from 21 subjects to extract both autonomic and central nervous system indices to assess physiological responses in relation to three types of stimulation: auditory, visual, and auditory/visual. Results show a higher galvanic skin response to sounds compared to images. Electrocardiogram and blood volume pulse show different trends between auditory and visual stimuli. The electroencephalographic signal reveals a greater attention paid by the subjects when listening to sounds compared to watching images. In conclusion, these results suggest that emotional responses increase during auditory stimulation at both central and peripheral levels, demonstrating the importance of sounds for emotion recognition experiments and also opening the possibility toward the extension of auditory stimuli in other fields of psychophysiology. Clinical and Translational Impact Statement- These findings corroborate auditory stimuli's importance in eliciting emotions, supporting their use in studying affective responses, e.g., mood disorder diagnosis, human-machine interaction, and emotional perception in pathology.
Collapse
Affiliation(s)
- Edoardo M. Polo
- DEIBPolitecnico di Milano20133MilanItaly
- DIAGSapienza University of Rome00185RomeItaly
| | | | | | - Alessia Paglialonga
- Cnr-Istituto di Elettronica e di Ingegneria dell’Informazione e delle Telecomunicazioni (CNR-IEIIT)20133MilanItaly
| | | | | |
Collapse
|
3
|
Liu XH, Gan L, Zhang ZT, Yu PK, Dai J. Probing the processing of facial expressions in monkeys via time perception and eye tracking. Zool Res 2023; 44:882-893. [PMID: 37545418 PMCID: PMC10559096 DOI: 10.24272/j.issn.2095-8137.2023.003] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/07/2023] [Accepted: 08/04/2023] [Indexed: 08/08/2023] Open
Abstract
Accurately recognizing facial expressions is essential for effective social interactions. Non-human primates (NHPs) are widely used in the study of the neural mechanisms underpinning facial expression processing, yet it remains unclear how well monkeys can recognize the facial expressions of other species such as humans. In this study, we systematically investigated how monkeys process the facial expressions of conspecifics and humans using eye-tracking technology and sophisticated behavioral tasks, namely the temporal discrimination task (TDT) and face scan task (FST). We found that monkeys showed prolonged subjective time perception in response to Negative facial expressions in monkeys while showing longer reaction time to Negative facial expressions in humans. Monkey faces also reliably induced divergent pupil contraction in response to different expressions, while human faces and scrambled monkey faces did not. Furthermore, viewing patterns in the FST indicated that monkeys only showed bias toward emotional expressions upon observing monkey faces. Finally, masking the eye region marginally decreased the viewing duration for monkey faces but not for human faces. By probing facial expression processing in monkeys, our study demonstrates that monkeys are more sensitive to the facial expressions of conspecifics than those of humans, thus shedding new light on inter-species communication through facial expressions between NHPs and humans.
Collapse
Affiliation(s)
- Xin-He Liu
- Shenzhen Technological Research Center for Primate Translational Medicine, Shenzhen-Hong Kong Institute of Brain Science, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China
- CAS Key Laboratory of Brain Connectome and Manipulation, Brain Cognition and Brain Disease Institute, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China
- Guangdong Provincial Key Laboratory of Brain Connectome and Behavior, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China
| | - Lu Gan
- Research Center for Medical Artificial Intelligence, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China
| | - Zhi-Ting Zhang
- Shenzhen Technological Research Center for Primate Translational Medicine, Shenzhen-Hong Kong Institute of Brain Science, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China
- CAS Key Laboratory of Brain Connectome and Manipulation, Brain Cognition and Brain Disease Institute, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China
- Guangdong Provincial Key Laboratory of Brain Connectome and Behavior, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China
| | - Pan-Ke Yu
- Shenzhen Technological Research Center for Primate Translational Medicine, Shenzhen-Hong Kong Institute of Brain Science, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China
- University of Chinese Academy of Sciences, Beijing 100049, China
| | - Ji Dai
- Shenzhen Technological Research Center for Primate Translational Medicine, Shenzhen-Hong Kong Institute of Brain Science, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China
- CAS Key Laboratory of Brain Connectome and Manipulation, Brain Cognition and Brain Disease Institute, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China
- Guangdong Provincial Key Laboratory of Brain Connectome and Behavior, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, Guangdong 518055, China
- University of Chinese Academy of Sciences, Beijing 100049, China. E-mail:
| |
Collapse
|
4
|
Investigating the relationship between background luminance and self-reported valence of auditory stimuli. Acta Psychol (Amst) 2022; 224:103532. [PMID: 35151005 DOI: 10.1016/j.actpsy.2022.103532] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/19/2021] [Revised: 01/28/2022] [Accepted: 02/07/2022] [Indexed: 11/20/2022] Open
Abstract
The present study investigated the effect of background luminance on the self-reported valence ratings of auditory stimuli, as suggested by some earlier work. A secondary aim was to better characterise the effect of auditory valence on pupillary responses, on which the literature is inconsistent. Participants were randomly presented with sounds of different valence categories (negative, neutral, and positive) obtained from the IADS-E database. At the same time, the background luminance of the computer screen (in blue hue) was manipulated across three levels (i.e., low, medium, and high), with pupillometry confirming the expected strong effect of luminance on pupil size. Participants were asked to rate the valence of the presented sound under these different luminance levels. On a behavioural level, we found evidence for an effect of background luminance on the self-reported valence rating, with generally more positive ratings as background luminance increased. Turning to valence effects on pupil size, irrespective of background luminance, interestingly, we observed that pupils were smallest in the positive valence and the largest in negative valence condition, with neutral valence in between. In sum, the present findings provide evidence concerning a relationship between luminance perception (and hence pupil size) and self-reported valence of auditory stimuli, indicating a possible cross-modal interaction of auditory valence processing with completely task-irrelevant visual background luminance. We furthermore discuss the potential for future applications of the current findings in the clinical field.
Collapse
|
5
|
Nakakoga S, Shimizu K, Muramatsu J, Kitagawa T, Nakauchi S, Minami T. Pupillary response reflects attentional modulation to sound after emotional arousal. Sci Rep 2021; 11:17264. [PMID: 34446768 PMCID: PMC8390645 DOI: 10.1038/s41598-021-96643-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/29/2020] [Accepted: 08/06/2021] [Indexed: 11/09/2022] Open
Abstract
There have been various studies on the effects of emotional visual processing on subsequent non-emotional auditory stimuli. A previous study with EEG has shown that responses to deviant sounds presented after presenting negative pictures collected more attentional resources than those for neutral pictures. To investigate such a compelling between emotional and cognitive processing, this study aimed to examined pupillary responses to an auditory stimulus after a positive, negative, or neutral emotional state was elicited by an emotional image. An emotional image was followed by a beep sound that was either repetitive or unexpected, and the pupillary dilation was measured. As a result, we found that the early component of the pupillary response to the beep sound was larger for negative and positive emotional states than the neutral emotional state, whereas the late component was larger for the positive emotional state than the negative and neutral emotional states. In addition, the peak latency of the pupillary response was earlier for negative than neutral or positive images. Further, to compensate for the disadvantage of low-temporal resolution of the pupillary data, the pupillary responses were deconvoluted and used in the analysis. The deconvolution analysis of pupillary responses confirmed that the responses to beep sound were more likely to be modulated by the emotional state rather than being influenced by the short presentation interval between the images and sounds. These findings suggested that pupil size index modulations in the compelling situation between emotional and cognitive processing.
Collapse
Affiliation(s)
- Satoshi Nakakoga
- Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1, Hibarigaoka Tempaku, Toyohashi, Aichi, 441-8580, Japan
| | - Kengo Shimizu
- Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1, Hibarigaoka Tempaku, Toyohashi, Aichi, 441-8580, Japan
| | - Junya Muramatsu
- System & Electronics Engineering Dept. II, TOYOTA Central R&D Labs., Inc., 41-1, Yokomichi, Nagakute, Aichi, 480-1192, Japan
| | - Takashi Kitagawa
- R&D and Engineering Management Div., TOYOTA MOTOR CORPORATION, 1, Toyota-cho, Toyota, Aichi, 471-8502, Japan
| | - Shigeki Nakauchi
- Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1, Hibarigaoka Tempaku, Toyohashi, Aichi, 441-8580, Japan
| | - Tetsuto Minami
- Department of Computer Science and Engineering, Toyohashi University of Technology, 1-1, Hibarigaoka Tempaku, Toyohashi, Aichi, 441-8580, Japan.
- Electronics-Inspired Interdisciplinary Research Institute, Toyohashi University of Technology, 1-1, Hibarigaoka Tempaku, Toyohashi, Aichi, 441-8580, Japan.
| |
Collapse
|
6
|
Cosme G, Rosa PJ, Lima CF, Tavares V, Scott S, Chen S, Wilcockson TDW, Crawford TJ, Prata D. Pupil dilation reflects the authenticity of received nonverbal vocalizations. Sci Rep 2021; 11:3733. [PMID: 33580104 PMCID: PMC7880996 DOI: 10.1038/s41598-021-83070-x] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/12/2020] [Accepted: 01/27/2021] [Indexed: 11/10/2022] Open
Abstract
The ability to infer the authenticity of other’s emotional expressions is a social cognitive process taking place in all human interactions. Although the neurocognitive correlates of authenticity recognition have been probed, its potential recruitment of the peripheral autonomic nervous system is not known. In this work, we asked participants to rate the authenticity of authentic and acted laughs and cries, while simultaneously recording their pupil size, taken as proxy of cognitive effort and arousal. We report, for the first time, that acted laughs elicited higher pupil dilation than authentic ones and, reversely, authentic cries elicited higher pupil dilation than acted ones. We tentatively suggest the lack of authenticity in others’ laughs elicits increased pupil dilation through demanding higher cognitive effort; and that, reversely, authenticity in cries increases pupil dilation, through eliciting higher emotional arousal. We also show authentic vocalizations and laughs (i.e. main effects of authenticity and emotion) to be perceived as more authentic, arousing and contagious than acted vocalizations and cries, respectively. In conclusion, we show new evidence that the recognition of emotional authenticity can be manifested at the level of the autonomic nervous system in humans. Notwithstanding, given its novelty, further independent research is warranted to ascertain its psychological meaning.
Collapse
Affiliation(s)
- Gonçalo Cosme
- Instituto de Biofísica e Engenharia Biomédica, Faculdade de Ciências da Universidade de Lisboa, Campo Grande, 1749-016, Lisboa, Portugal
| | - Pedro J Rosa
- HEI-LAB: Human-Environment Interaction Lab, Universidade Lusófona de Humanidades e Tecnologias, Campo Grande, 376, 1749-024, Lisboa, Portugal.,Instituto Universitário de Lisboa (Iscte-IUL), CIS-Iscte, Avenida das Forças Armadas, 1649-026, Lisboa, Portugal
| | - César F Lima
- Instituto Universitário de Lisboa (Iscte-IUL), CIS-Iscte, Avenida das Forças Armadas, 1649-026, Lisboa, Portugal
| | - Vânia Tavares
- Instituto de Biofísica e Engenharia Biomédica, Faculdade de Ciências da Universidade de Lisboa, Campo Grande, 1749-016, Lisboa, Portugal.,Faculdade de Medicina da Universidade de Lisboa, Avenida Professor Egas Moniz MB, 1649-028, Lisboa, Portugal
| | - Sophie Scott
- Institute of Cognitive Neuroscience, University College London, Alexandra House, 17-19 Queen Square, Bloomsbury, London, UK
| | - Sinead Chen
- Risk Society and Policy Research Center, National Taiwan University, Roosevelt Rd., Daan Dist., Taipei, 10617, Taiwan
| | - Thomas D W Wilcockson
- Department of Psychology, Lancaster University, Lancaster, LA1 4YF, UK.,School of Sport, Exercise, and Health Sciences, Loughborough University, Clyde Williams Building, Epinal Way, Loughborough, LE11 3GE, UK
| | - Trevor J Crawford
- Department of Psychology, Lancaster University, Lancaster, LA1 4YF, UK
| | - Diana Prata
- Instituto de Biofísica e Engenharia Biomédica, Faculdade de Ciências da Universidade de Lisboa, Campo Grande, 1749-016, Lisboa, Portugal. .,Instituto Universitário de Lisboa (Iscte-IUL), CIS-Iscte, Avenida das Forças Armadas, 1649-026, Lisboa, Portugal. .,Department of Neuroimaging, Institute of Psychiatry, Psychology and Neuroscience, King's College London, 16 De Crespigny Park, Camberwell, London, SE5 8AF, UK.
| |
Collapse
|
7
|
Is accommodation a confounder in pupillometry research? Biol Psychol 2021; 160:108046. [PMID: 33581231 DOI: 10.1016/j.biopsycho.2021.108046] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/27/2020] [Revised: 02/07/2021] [Accepted: 02/07/2021] [Indexed: 11/24/2022]
Abstract
Much psychological research uses pupil diameter measurements to investigate the cognitive and emotional effects of visual stimuli. A potential problem is that accommodating at a nearby point causes the pupil to constrict. This study examined to what extent accommodation is a confounder in pupillometry research. Participants solved multiplication problems at different distances (Experiment 1) and looked at line drawings with different monocular depth cues (Experiment 2) while their pupil diameter, refraction, and vergence angle were recorded using a photorefractor. Experiment 1 showed that the pupils dilated while performing the multiplications, for all presentation distances. Pupillary constriction due to accommodation was not strong enough to override pupil dilation due to cognitive load. Experiment 2 showed that monocular depth cues caused a small shift in refraction in the expected direction. We conclude that, for the young student sample we used, pupil diameter measurements are not substantially affected by accommodation.
Collapse
|