1
|
Grasso-Cladera A, Costa-Cordella S, Mattoli-Sánchez J, Vilina E, Santander V, Hiltner SE, Parada FJ. Embodied hyperscanning for studying social interaction: A scoping review of simultaneous brain and body measurements. Soc Neurosci 2024:1-17. [PMID: 39387663 DOI: 10.1080/17470919.2024.2409758] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 01/31/2024] [Revised: 08/12/2024] [Indexed: 10/15/2024]
Abstract
We systematically investigated the application of embodied hyperscanning methodologies in social neuroscience research. Hyperscanning enables the simultaneous recording of neurophysiological and physiological signals from multiple participants. We highlight the trend toward integrating Mobile Brain/Body Imaging (MoBI) within the 4E research framework, which emphasizes the interconnectedness of brain, body, and environment. Our analysis revealed a geographic concentration of studies in the Global North, calling for global collaboration and transcultural research to balance the field. The predominant use of Magneto/Electroencephalogram (M/EEG) in these studies suggests a traditional brain-centric perspective in social neuroscience. Future research directions should focus on integrating diverse techniques to capture the dynamic interplay between brain and body functions in real-world contexts. Our review also finds a preference for tasks involving natural settings. Nevertheless, the analysis in hyperscanning studies is often limited to physiological signal synchrony between participants. This suggests a need for more holistic and complex approaches that combine inter-corporeal synchrony with intra-individual measures. We believe that the future of the neuroscience of relationships lies in embracing the complexity of cognition, integrating diverse methods and theories to enrich our grasp of human social behavior in its natural contexts.
Collapse
Affiliation(s)
| | - Stefanella Costa-Cordella
- Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
- Centro de Estudios en Psicología Clínica y Psicoterapia (CEPPS), Facultad de Psicología, Universidad Diego Portales institution, Santiago, Chile
- Instituto Milenio para la Investigación en Depresión y Personalidad (MIDAP), Santiago, Chile
| | - Josefina Mattoli-Sánchez
- Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
- Programa de Pregrado en Psicología, Facultad de Psicología. Universidad Diego Portales, Santiago, Chile
| | - Erich Vilina
- Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
| | - Valentina Santander
- Programa de Magíster en Neurociencia Social, Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
| | - Shari E Hiltner
- Department of Psychology, Carl-von-Ossietzky University of Oldenburg, Oldenburg, Germany
| | - Francisco J Parada
- Department of Psychology, Carl-von-Ossietzky University of Oldenburg, Oldenburg, Germany
- Escuela de Diseño, Facultad de Arquitectura, Arte y Diseño, Universidad Diego Portales, Santiago, Chile
| |
Collapse
|
2
|
Naveilhan C, Saulay-Carret M, Zory R, Ramanoël S. Spatial Contextual Information Modulates Affordance Processing and Early Electrophysiological Markers of Scene Perception. J Cogn Neurosci 2024; 36:2084-2099. [PMID: 39023371 DOI: 10.1162/jocn_a_02223] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/20/2024]
Abstract
Scene perception allows humans to extract information from their environment and plan navigation efficiently. The automatic extraction of potential paths in a scene, also referred to as navigational affordance, is supported by scene-selective regions (SSRs) that enable efficient human navigation. Recent evidence suggests that the activity of these SSRs can be influenced by information from adjacent spatial memory areas. However, it remains unexplored how this contextual information could influence the extraction of bottom-up information, such as navigational affordances, from a scene and the underlying neural dynamics. Therefore, we analyzed ERPs in 26 young adults performing scene and spatial memory tasks in artificially generated rooms with varying numbers and locations of available doorways. We found that increasing the number of navigational affordances only impaired performance in the spatial memory task. ERP results showed a similar pattern of activity for both tasks, but with increased P2 amplitude in the spatial memory task compared with the scene memory. Finally, we reported no modulation of the P2 component by the number of affordances in either task. This modulation of early markers of visual processing suggests that the dynamics of SSR activity are influenced by a priori knowledge, with increased amplitude when participants have more contextual information about the perceived scene. Overall, our results suggest that prior spatial knowledge about the scene, such as the location of a goal, modulates early cortical activity associated with SSRs, and that this information may interact with bottom-up processing of scene content, such as navigational affordances.
Collapse
Affiliation(s)
| | | | - Raphaël Zory
- LAMHESS, Université Côte d'Azur, Nice, France
- Institut Universitaire de France (IUF)
| | - Stephen Ramanoël
- LAMHESS, Université Côte d'Azur, Nice, France
- INSERM, CNRS, Institut de la Vision, Sorbonne Université, Paris, France
| |
Collapse
|
3
|
Wang S, Djebbara Z, Sanches de Oliveira G, Gramann K. Human brain dynamics dissociate early perceptual and late motor-related stages of affordance processing. Eur J Neurosci 2024; 60:4639-4660. [PMID: 39034404 DOI: 10.1111/ejn.16461] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/13/2023] [Revised: 04/24/2024] [Accepted: 06/21/2024] [Indexed: 07/23/2024]
Abstract
Affordances, the opportunities for action offered by the environment to an agent, are vital for meaningful behaviour and exist in every interaction with the environment. There is an ongoing debate in the field about whether the perception of affordances is an automated process. Some studies suggest that affordance perception is an automated process that is independent from the visual context and bodily interaction with the environment, whereas others argue that it is modulated by the visual and motor context in which affordances are perceived. The present paper aims to resolve this debate by examining affordance automaticity from the perspective of sensorimotor time windows. To investigate the impact of different forms of bodily interactions with an environment, that is, the movement context (physical vs. joystick movement), we replicated a previous study on affordance perception in which participants actively moved through differently wide doors in an immersive 3D virtual environment. In the present study, we displayed the same environment on a 2D screen with participants moving through doors of different widths using the keys on a standard keyboard. We compared components of the event-related potential (ERP) from the continuously recorded electroencephalogram (EEG) that were previously reported to be related to affordance perception of architectural transitions (passable and impassable doors). Comparing early sensory and later motor-related ERPs, our study replicated ERPs reflecting early affordance perception but found differences in later motor-related components. These results indicate a shift from automated perception of affordances during early sensorimotor time windows to movement context dependence of affordance perception at later stages, suggesting that affordance perception is a dynamic and flexible process that changes over sensorimotor stages.
Collapse
Affiliation(s)
- Sheng Wang
- Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
| | - Zakaria Djebbara
- Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
- Department of Architecture, Design and Media Technology, Aalborg University, Aalborg, Denmark
| | | | - Klaus Gramann
- Biological Psychology and Neuroergonomics, Technische Universität Berlin, Berlin, Germany
| |
Collapse
|
4
|
Parada FJ, Grasso-Cladera A, Rossi A, Soto-Icaza P, Arenas-Pérez M, Errázuriz MC. Applied human neuroscience: Fostering and designing inclusive environments with the 3E-Cognition perspective. Eur J Neurosci 2024; 60:4148-4168. [PMID: 39001625 DOI: 10.1111/ejn.16463] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/03/2024] [Revised: 06/17/2024] [Accepted: 06/26/2024] [Indexed: 08/07/2024]
Abstract
The conventional medical paradigm often focuses on deficits and impairments, failing to capture the rich tapestry of experiences and abilities inherent in neurodiversity conditions. In this article, we introduce the 3E-Cognition perspective, offering a paradigm shift by emphasizing the dynamic interplay between the brain, body, and environment in shaping cognitive processes. The perspective fosters a more inclusive and supportive understanding of neurodiversity, with potential applications across various domains such as education, workplace, and healthcare. We begin by introducing the 3E-Cognition principles: embodied, environmentally scaffolded, and enactive. Then, we explore how the 3E-Cognition perspective can be applied to create inclusive environments and experiences for neurodiverse individuals. We provide examples in the realms of education, workplace, and healthcare. In all of these domains, spaces, methodologies, epistemologies, and roles that cater to diverse needs and strengths can be designed using the 3E principles. Finally, we discuss the challenges and benefits of implementing the 3E-Cognition perspective. We focus on the need for technological advancements and research in complex real-world scenarios; we suggest mobile brain/body imaging is a possible solution. We furthermore highlight the importance of recognizing and valuing the diverse manners of experiencing and interacting with the world, the promotion of diverse well-being, and the facilitation of innovation and creativity. Thus, we conclude that the 3E-Cognition perspective offers a groundbreaking approach to understanding and supporting neurodiversity: by embracing the inherent interconnectedness of the brain, body, and environment, we can create a more inclusive and supportive world.
Collapse
Affiliation(s)
- Francisco J Parada
- Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
- Escuela de Diseño, Facultad de Arquitectura, Arte y Diseño, Universidad Diego Portales, Santiago, Chile, Salvador Sanfuentes 2221, Santiago, Metropolitan, Chile
| | | | - Alejandra Rossi
- Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
| | - Patricia Soto-Icaza
- Laboratorio de Neurociencia Social y Neuromodulación, Centro de Investigación en Complejidad Social (neuroCICS), Facultad de Gobierno, Universidad del Desarrollo, Santiago, Chile
| | - Maritza Arenas-Pérez
- Centro de Estudios en Neurociencia Humana y Neuropsicología (CENHN), Facultad de Psicología, Universidad Diego Portales, Santiago, Chile
| | | |
Collapse
|
5
|
Pastor A, Bourdin-Kreitz P. Comparing episodic memory outcomes from walking augmented reality and stationary virtual reality encoding experiences. Sci Rep 2024; 14:7580. [PMID: 38555291 PMCID: PMC10981735 DOI: 10.1038/s41598-024-57668-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2023] [Accepted: 03/11/2024] [Indexed: 04/02/2024] Open
Abstract
Episodic Memory (EM) is the neurocognitive capacity to consciously recollect personally experienced events in specific spatio-temporal contexts. Although the relevance of spatial and temporal information is widely acknowledged in the EM literature, it remains unclear whether and how EM performance and organisation is modulated by self-motion, and by motor- and visually- salient environmental features (EFs) of the encoding environment. This study examines whether and how EM is modulated by locomotion and the EFs encountered in a controlled lifelike learning route within a large-scale building. Twenty-eight healthy participants took part in a museum-tour encoding task implemented in walking Augmented Reality (AR) and stationary Virtual Reality (VR) conditions. EM performance and organisation were assessed immediately and 48-hours after trials using a Remember/Familiar recognition paradigm. Results showed a significant positive modulation effect of locomotion on distinctive EM aspects. Findings highlighted a significant performance enhancement effect of stairway-adjacent locations compared to dead-end and mid-route stimuli-presentation locations. The results of this study may serve as design criteria to facilitate neurocognitive rehabilitative interventions of EM. The underlying technological framework developed for this study represents a novel and ecologically sound method for evaluating EM processes in lifelike situations, allowing researchers a naturalistic perspective into the complex nature of EM.
Collapse
Affiliation(s)
- Alvaro Pastor
- XR-Lab, Research-HUB, Universitat Oberta de Catalunya, Barcelona, Spain
- Computer Science, Multimedia and Telecommunication Department, Universitat Oberta de Catalunya, Barcelona, Spain
| | - Pierre Bourdin-Kreitz
- XR-Lab, Research-HUB, Universitat Oberta de Catalunya, Barcelona, Spain.
- Computer Science, Multimedia and Telecommunication Department, Universitat Oberta de Catalunya, Barcelona, Spain.
| |
Collapse
|
6
|
Charalambous E, Djebbara Z. On natural attunement: Shared rhythms between the brain and the environment. Neurosci Biobehav Rev 2023; 155:105438. [PMID: 37898445 DOI: 10.1016/j.neubiorev.2023.105438] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Revised: 10/19/2023] [Accepted: 10/24/2023] [Indexed: 10/30/2023]
Abstract
Rhythms exist both in the embodied brain and the built environment. Becoming attuned to the rhythms of the environment, such as repetitive columns, can greatly affect perception. Here, we explore how the built environment affects human cognition and behavior through the concept of natural attunement, often resulting from the coordination of a person's sensory and motor systems with the rhythmic elements of the environment. We argue that the built environment should not be reduced to mere states, representations, and single variables but instead be considered a bundle of highly related continuous signals with which we can resonate. Resonance and entrainment are dynamic processes observed when intrinsic frequencies of the oscillatory brain are influenced by the oscillations of an external signal. This allows visual rhythmic stimulations of the environment to affect the brain and body through neural entrainment, cross-frequency coupling, and phase resetting. We review how real-world architectural settings can affect neural dynamics, cognitive processes, and behavior in people, suggesting the crucial role of everyday rhythms in the brain-body-environment relationship.
Collapse
Affiliation(s)
| | - Zakaria Djebbara
- Aalborg University, Department of Architecture, Design, Media, and Technology, Denmark; Technical University of Berlin, Biological Psychology and Neuroergonomics, Germany.
| |
Collapse
|
7
|
Djebbara Z. Naturalistic paradigms: Rich behaviors and environmental features comment on "Beyond simple laboratory studies: Developing sophisticated models to study rich behavior" by Maselli et al. Phys Life Rev 2023; 47:151-153. [PMID: 39491435 DOI: 10.1016/j.plrev.2023.10.010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/11/2023] [Accepted: 10/17/2023] [Indexed: 11/05/2024]
Affiliation(s)
- Zakaria Djebbara
- Department of Architecture, Design, Media and Technology, Aalborg University, Denmark; Biological Psychology and Neuroergonomics, Technical University Berlin, Germany.
| |
Collapse
|
8
|
Presti P, Galasso GM, Ruzzon D, Avanzini P, Caruana F, Rizzolatti G, Vecchiato G. Architectural experience influences the processing of others' body expressions. Proc Natl Acad Sci U S A 2023; 120:e2302215120. [PMID: 37782807 PMCID: PMC10576150 DOI: 10.1073/pnas.2302215120] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2023] [Accepted: 08/28/2023] [Indexed: 10/04/2023] Open
Abstract
The interplay between space and cognition is a crucial issue in Neuroscience leading to the development of multiple research fields. However, the relationship between architectural space and the movement of the inhabitants and their interactions has been too often neglected, failing to provide a unifying view of architecture's capacity to modulate social cognition broadly. We bridge this gap by requesting participants to judge avatars' emotional expression (high vs. low arousal) at the end of their promenade inside high- or low-arousing architectures. Stimuli were presented in virtual reality to ensure a dynamic, naturalistic experience. High-density electroencephalography (EEG) was recorded to assess the neural responses to the avatar's presentation. Observing highly aroused avatars increased Late Positive Potentials (LPP), in line with previous evidence. Strikingly, 250 ms before the occurrence of the LPP, P200 amplitude increased due to the experience of low-arousing architectures, reflecting an early greater attention during the processing of body expressions. In addition, participants stared longer at the avatar's head and judged the observed posture as more arousing. Source localization highlighted a contribution of the dorsal premotor cortex to both P200 and LPP. In conclusion, the immersive and dynamic architectural experience modulates human social cognition. In addition, the motor system plays a role in processing architecture and body expressions suggesting that the space and social cognition interplay is rooted in overlapping neural substrates. This study demonstrates that the manipulation of mere architectural space is sufficient to influence human social cognition.
Collapse
Affiliation(s)
- Paolo Presti
- Institute of Neuroscience, National Research Council of Italy, Parma43125, Italy
- Department of Medicine and Surgery, University of Parma, Parma43125, Italy
| | - Gaia Maria Galasso
- Department of Medicine and Surgery, University of Parma, Parma43125, Italy
| | - Davide Ruzzon
- Dipartimento di Culture del Progetto, IUAV University, Venice30135, Italy
- TUNED, Lombardini22 s.p.a., Milan20143, Italy
| | - Pietro Avanzini
- Institute of Neuroscience, National Research Council of Italy, Parma43125, Italy
| | - Fausto Caruana
- Institute of Neuroscience, National Research Council of Italy, Parma43125, Italy
| | - Giacomo Rizzolatti
- Institute of Neuroscience, National Research Council of Italy, Parma43125, Italy
| | - Giovanni Vecchiato
- Institute of Neuroscience, National Research Council of Italy, Parma43125, Italy
- Department of Medicine and Surgery, University of Parma, Parma43125, Italy
| |
Collapse
|
9
|
Djebbara Z, Kalantari S. Affordances and curvature preference: The case of real objects and spaces. Ann N Y Acad Sci 2023; 1527:14-19. [PMID: 37429830 DOI: 10.1111/nyas.15038] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 07/12/2023]
Abstract
Chuquichambi and colleagues recently questioned the prevailing belief that a universal human visual preference exists for curved shapes and lines. Their comprehensive meta-analysis demonstrated that while curvature preference is widespread, it is not universally constant or invariant. By revisiting their dataset, we made an intriguing discovery: a negative relationship between curvature preference and an object's "affordances." Taking an embodiment perspective into account, we propose an explanation for this phenomenon, suggesting that the diminished curvature preference in objects with abundant affordances can be understood through the lens of embodied cognition.
Collapse
Affiliation(s)
- Zakaria Djebbara
- Department of Architecture, Design, Media, and Technology, Aalborg University, Aalborg, Denmark
- Biological Psychology and Neuroergonomics, Technical University of Berlin, Berlin, Germany
| | - Saleh Kalantari
- Department of Human Centered Design, College of Human Ecology, Cornell University, Ithaca, New York, USA
| |
Collapse
|