1
|
Kasahara S, Kumasaki N, Shimizu K. Investigating the impact of motion visual synchrony on self face recognition using real time morphing. Sci Rep 2024; 14:13090. [PMID: 38849381 PMCID: PMC11161490 DOI: 10.1038/s41598-024-63233-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2023] [Accepted: 05/27/2024] [Indexed: 06/09/2024] Open
Abstract
Face recognition is a crucial aspect of self-image and social interactions. Previous studies have focused on static images to explore the boundary of self-face recognition. Our research, however, investigates the dynamics of face recognition in contexts involving motor-visual synchrony. We first validated our morphing face metrics for self-face recognition. We then conducted an experiment using state-of-the-art video processing techniques for real-time face identity morphing during facial movement. We examined self-face recognition boundaries under three conditions: synchronous, asynchronous, and static facial movements. Our findings revealed that participants recognized a narrower self-face boundary with moving facial images compared to static ones, with no significant differences between synchronous and asynchronous movements. The direction of morphing consistently biased the recognized self-face boundary. These results suggest that while motor information of the face is vital for self-face recognition, it does not rely on movement synchronization, and the sense of agency over facial movements does not affect facial identity judgment. Our methodology offers a new approach to exploring the 'self-face boundary in action', allowing for an independent examination of motion and identity.
Collapse
Affiliation(s)
- Shunichi Kasahara
- Sony Computer Science Laboratories, Inc., Tokyo, 141-0022, Japan.
- Okinawa Institute of Science and Technology Graduate University, Okinawa, 904-0412, Japan.
| | - Nanako Kumasaki
- Sony Computer Science Laboratories, Inc., Tokyo, 141-0022, Japan
| | - Kye Shimizu
- Sony Computer Science Laboratories, Inc., Tokyo, 141-0022, Japan
| |
Collapse
|
2
|
Lee JKW, Janssen SMJ, Estudillo AJ. A more featural based processing for the self-face: An eye-tracking study. Conscious Cogn 2022; 105:103400. [PMID: 36030615 DOI: 10.1016/j.concog.2022.103400] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2021] [Revised: 08/15/2022] [Accepted: 08/18/2022] [Indexed: 01/27/2023]
Abstract
Studies have suggested that the holistic advantage in face perception is not always reported for the own face. With two eye-tracking experiments, we explored the role of holistic and featural processing in the processing and the recognition of self, personally familiar, and unfamiliar faces. Observers were asked to freely explore (Exp.1) and recognize (Exp.2) their own, a friend's, and an unfamiliar face. In Exp.1, self-face was fixated more and longer and there was a preference for the mouth region when seeing the own face and for the nose region when seeing a friend and unfamiliar faces. In Exp.2, the viewing strategies did not differ across all faces, with eye fixations mostly directed to the nose region. These results suggest that task demands might modulate the way that the own face is perceived and highlights the importance of considering the role of the distinct visual experience people have for the own face in the processing and recognition of the self-face.
Collapse
|
3
|
Estudillo AJ, Kaufmann JM, Bindemann M, Schweinberger SR. Multisensory stimulation modulates perceptual and post perceptual face representations: Evidence from event-related potentials. Eur J Neurosci 2019; 48:2259-2271. [PMID: 30107052 DOI: 10.1111/ejn.14112] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2016] [Revised: 07/16/2018] [Accepted: 07/27/2018] [Indexed: 01/03/2023]
Abstract
Seeing a face being touched in spatial and temporal synchrony with the own face produces a bias in self-recognition, whereby the other face becomes more likely to be perceived as the self. The present study employed event-related potentials to explore whether this enfacement effect reflects initial face encoding, enhanced distinctiveness of the enfaced face, modified self-identity representations, or even later processing stages that are associated with the emotional processing of faces. Participants were stroked in synchrony or asynchrony with an unfamiliar face they observed on a monitor in front of them, in a situation approximating a mirror image. Subsequently, event-related potentials were recorded during the presentation of (a) a previously synchronously stimulated face, (b) an asynchronously stimulated face, (c) observers' own face, (d) filler faces, and (e) a to-be-detected target face, which required a response. Observers reported a consistent enfacement illusion after synchronous stimulation. Importantly, the synchronously stimulated face elicited more prominent N170 and P200 responses than the asynchronously stimulated face. By contrast, similar N250 and P300 responses were observed in these conditions. These results suggest that enfacement modulates early neural correlates of face encoding and facial prototypicality, rather than identity self-representations and associated emotional processes.
Collapse
Affiliation(s)
- Alejandro J Estudillo
- School of Psychology, University of Nottingham Malaysia Campus, Semenyih, Malaysia.,School of Psychology, University of Kent, Canterbury, UK.,Department of Psychology, Friedrich Schiller University of Jena, Jena, Germany
| | - Jürgen M Kaufmann
- Department of Psychology, Friedrich Schiller University of Jena, Jena, Germany.,DFG Research Unit Person Perception, Friedrich Schiller University of Jena, Jena, Germany
| | | | - Stefan R Schweinberger
- Department of Psychology, Friedrich Schiller University of Jena, Jena, Germany.,DFG Research Unit Person Perception, Friedrich Schiller University of Jena, Jena, Germany.,Australian Research Council Centre of Excellence in Cognition and its Disorders, The University of Western Australia, Perth, Western Australia, Australia
| |
Collapse
|
4
|
Ma K, Sellaro R, Hommel B. Personality assimilation across species: enfacing an ape reduces own intelligence and increases emotion attribution to apes. PSYCHOLOGICAL RESEARCH 2018; 83:373-383. [PMID: 29968086 PMCID: PMC6433798 DOI: 10.1007/s00426-018-1048-x] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/21/2017] [Accepted: 06/27/2018] [Indexed: 12/29/2022]
Abstract
Seeing another person's face while that face and one's own face are stroked synchronously or controlling a virtual face by moving one's own induces the illusion that the other face has become a part of oneself-the enfacement effect. Here, we demonstrate that humans can enface even members of another species and that this enfacement promotes "feature migration" in terms of intelligence and emotional attribution from the representation of other to the representation of oneself, and vice versa. We presented participants with a virtual human face moving in or out of sync with their own face, and then morphed it into an ape face. Participants tended to perceive the ape face as their own in the sync condition, as indicated by body-ownership and inclusion-of-others-in-the-self ratings. More interestingly, synchrony also reduced performance in a fluid-intelligence task and increased the willingness to attribute emotions to apes. These observations, which fully replicated in another experiment, fit with the idea that self and other are represented in terms of feature codes, just like non-social events (as implied by the Theory of Event Coding), so that representational self-other overlap invites illusory conjunctions of features from one representation to the other.
Collapse
Affiliation(s)
- Ke Ma
- Cognitive Psychology Unit, Institute for Psychological Research and Leiden Institute for Brain and Cognition, Leiden University, Wassenaarseweg 52, 2333 AK, Leiden, The Netherlands
- Key Laboratory of Personality and Cognition, Faculty of Psychological Science, Southwest University, Beibei, Chongqing, China
| | - Roberta Sellaro
- Cognitive Psychology Unit, Institute for Psychological Research and Leiden Institute for Brain and Cognition, Leiden University, Wassenaarseweg 52, 2333 AK, Leiden, The Netherlands
| | - Bernhard Hommel
- Cognitive Psychology Unit, Institute for Psychological Research and Leiden Institute for Brain and Cognition, Leiden University, Wassenaarseweg 52, 2333 AK, Leiden, The Netherlands.
| |
Collapse
|
5
|
The ‘Enfacement’ illusion: A window on the plasticity of the self. Cortex 2018; 104:261-275. [DOI: 10.1016/j.cortex.2018.01.007] [Citation(s) in RCA: 42] [Impact Index Per Article: 7.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/02/2017] [Revised: 10/05/2017] [Accepted: 01/15/2018] [Indexed: 12/17/2022]
|
6
|
Estudillo AJ. Commentary: My face or yours? Event-related potential correlates of self-face processing. Front Psychol 2017; 8:608. [PMID: 28473790 PMCID: PMC5397524 DOI: 10.3389/fpsyg.2017.00608] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Key Words] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/18/2017] [Accepted: 04/03/2017] [Indexed: 11/16/2022] Open
|
7
|
Porciello G, Daum MM, Menghini C, Brugger P, Lenggenhager B. Not That Heart-Stopping After All: Visuo-Cardiac Synchrony Does Not Boost Self-Face Attribution. PLoS One 2016; 11:e0160498. [PMID: 27541587 PMCID: PMC4991789 DOI: 10.1371/journal.pone.0160498] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/23/2016] [Accepted: 07/20/2016] [Indexed: 11/18/2022] Open
Abstract
Recent experimental evidence and theoretical models suggest that an integration of exteroceptive and interoceptive signals underlies several key aspects of the bodily self. While it has been shown that self-attribution of both the hand and the full-body are altered by conflicting extero-exteroceptive (e.g. visuo-tactile) and extero-interoceptive (e.g. visuo-cardiac) information, no study has thus far investigated whether self-attribution of the face might be altered by visuo-cardiac stimulation similarly to visuo-tactile stimulation. In three independent groups of participants we presented ambiguous (i.e. morphed with a stranger's face) self-faces flashing synchronously or asynchronously with the participants’ heartbeat. We then measured the subjective percentages of self-face attribution of morphed stimuli. To control for a potential effect of visuo-cardiac synchrony on familiarity, a task assessing the attribution of a familiar face was introduced. Moreover, different durations of visuo-cardiac flashing and different degrees of asynchronicity were used. Based on previous studies showing that synchronous visuo-cardiac stimulation generally increases self-attribution of the full-body and the hand, and that synchronous visuo-tactile stimulation increases self-face attribution, we predicted higher self-face attribution during the synchronous visuo-cardiac flashing of the morphed stimuli. In contrast to this hypothesis, the results showed no difference between synchronous and asynchronous stimulation on self-face attribution in any of the three studies. We thus conclude that visuo-cardiac synchrony does not boost self-attribution of the face as it does that of hand and full-body.
Collapse
Affiliation(s)
- Giuseppina Porciello
- Department of Psychology, ‘Sapienza’, University of Rome, Rome, Italy
- Social and Cognitive Neuroscience Laboratory, IRCCS, Santa Lucia Foundation, Rome, Italy
- Department of Neurology, University Hospital Zurich, Zurich, Switzerland
- * E-mail: (GP); (BL)
| | - Moritz M. Daum
- Department of Psychology, University of Zurich, Zurich, Switzerland
| | - Cristina Menghini
- Department of Neurology, University Hospital Zurich, Zurich, Switzerland
| | - Peter Brugger
- Department of Neurology, University Hospital Zurich, Zurich, Switzerland
- Institute of Physiology and Zurich Center for Integrative Human Physiology (ZIHP), University of Zurich, Zurich, Switzerland
| | - Bigna Lenggenhager
- Department of Neurology, University Hospital Zurich, Zurich, Switzerland
- Institute of Physiology and Zurich Center for Integrative Human Physiology (ZIHP), University of Zurich, Zurich, Switzerland
- * E-mail: (GP); (BL)
| |
Collapse
|