Joint Perception of a Shared Object: A Minimalist Perceptual Crossing Experiment

An open-source perceptual crossing device for investigating brain dynamics during human interaction

The Perceptual Crossing Device (PCD) introduced in this report is an updated tool designed to facilitate the exploration of brain activity during human interaction with seamless real time integration with EEG equipment. It incorporates haptic and auditory feedback mechanisms, enabling interactions between two users within a virtual environment. Through a unique circular motion interface that enables intuitive virtual interactions, users can experience the presence of their counterpart via tactile or auditory cues. This paper highlights the key characteristics of the PCD, aiming to validate its efficacy in augmenting the understanding of human interactions. Furthermore, by offering an accessible and intuitive interface, the PCD stands to foster greater community engagement in the realm of embodied cognitive science and human interaction studies. Through this device, we anticipate a deeper comprehension of the complex neural dynamics underlying human interaction, thereby contributing a valuable resource to both the scientific community and the broader public.

Co-perceiving: Bringing the social into perception

Humans and other animals possess the remarkable ability to effectively navigate a shared perceptual environment by discerning which objects and spaces are perceived by others and which remain private to themselves. Traditionally, this capacity has been encapsulated under the umbrella of joint attention or joint action. In this comprehensive review, we advocate for a broader and more mechanistic understanding of this phenomenon, termed co-perception. Co-perception encompasses the sensitivity to the perceptual engagement of others and the capability to differentiate between objects perceived privately and those perceived commonly with others. It represents a distinct concept from mere simultaneous individual perception. Moreover, discerning between private and common objects doesn't necessitate intricate mind-reading abilities or mutual coordination. The act of perceiving objects as either private or common provides a comprehensive account for social scenarios where individuals simply share the same context or may even engage in competition. This conceptual framework encourages a re-examination of classical paradigms that demonstrate social influences on perception. Furthermore, it suggests that the impacts of shared experiences extend beyond affective responses, also influencing perceptual processes. This article is categorized under: Psychology > Attention Philosophy > Foundations of Cognitive Science Philosophy > Psychological Capacities.

An Interaction Theory Account of (Mediated) Social Touch

Research on mediated social touch (MST) has, either implicitly or explicitly, built on theoretical assumptions regarding social interactions that align with "theory theory" or "simulation theory" of social cognition. However, these approaches struggle to explain MST interactions that occur outside of a laboratory setting. I briefly discuss these approaches and will argue in favor of an alternative, "interaction theory" approach to the study of MST. I make three suggestions for future research to focus on.

Preferential Engagement and What Can We Learn from Online Chess?

An online game of chess against a human opponent appears to be indistinguishable from a game against a machine: both happen on the screen. Yet, people prefer to play chess against other people despite the fact that machines surpass people in skill. When the philosophers of 1970’s and 1980’s argued that computers will never surpass us in chess, perhaps their intuitions were rather saying “Computers will never be favored as opponents”? In this paper we analyse through the introduced concepts of psychological affordances and psychological interplay, what are the mechanisms that make a human-human (HH) interaction more meaningful than a human-computer (HC) interaction. We claim that an HH chess game consists of two intertwined, but independent simultaneous games—only one of which is retained in the HC game. To help with the analysis we introduce the thought experiment of a Preferential Engagement Test (PET) which is inspired by, but non-equivalent to, the Standard Turing Test. We also explore how the PET can illuminate, and be illuminated by, various philosophies of mind reading: Theory Theory, Simulation Theory and Mind Minding. We propose that our analysis along with the concept of PET could illuminate in a new way the conditions and challenges a machine (or its designers) must face before it can replace humans in a given occupation.

The Feeling Is Mutual: Clarity of Haptics-Mediated Social Perception Is Not Associated With the Recognition of the Other, Only With Recognition of Each Other

The enactive theory of perception hypothesizes that perceptual access to objects depends on the mastery of sensorimotor contingencies, that is, on the know-how of the regular ways in which changes in sensations depend on changes in movements. This hypothesis can be extended into the social domain: perception of other minds is constituted by mastery of self-other contingencies, that is, by the know-how of the regular ways in which changes in others' movements depend on changes in one's movements. We investigated this proposal using the perceptual crossing paradigm, in which pairs of players are required to locate each other in an invisible one-dimensional virtual space by using a minimal haptic interface. We recorded and analyzed the real-time embodied social interaction of 10 pairs of adult participants. The results reveal a process of implicit perceptual learning: on average, clarity of perceiving the other's presence increased over trials and then stabilized. However, a clearer perception of the other was not associated with correctness of recognition as such, but with both players correctly recognizing each other. Furthermore, the moments of correct mutual recognition tended to happen within seconds. The fact that changes in social experience can only be explained by the successful performance at the level of the dyad, and that this veridical mutual perception tends toward synchronization, lead us to hypothesize that integration of neural activity across both players played a role.

Investigating real-time social interaction in pairs of adolescents with the Perceptual Crossing Experiment

The study of real-time social interaction provides ecologically valid insight into social behavior. The objective of the current research is to experimentally assess real-time social contingency detection in an adolescent population, using a shortened version of the Perceptual Crossing Experiment (PCE). Pairs of 148 adolescents aged between 12 and 19 were instructed to find each other in a virtual environment interspersed with other objects by interacting with each other using tactile feedback only. Across six rounds, participants demonstrated increasing accuracy in social contingency detection, which was associated with increasing subjective experience of the mutual interaction. Subjective experience was highest in rounds when both participants were simultaneously accurate in detecting each other's presence. The six-round version yielded comparable social contingency detection outcome measures to a ten-round version of the task. The shortened six-round version of the PCE has therefore enabled us to extend the previous findings on social contingency detection in adults to an adolescent population, enabling implementation in prospective research designs to assess the development of social contingency detection over time.

Aproximación al concepto de atención desde la perspectiva del enactivismo

Este artículo presenta una reflexión teórica sobre el fenómeno de la atención. Se subraya la importancia de la relación entre atención y acción. Una caracterización inicial de la atención es desarrollada y una división es establecida entre las posturas representacionalistas (que emplean modelos formales para explicar el fenómeno en términos de procesamiento de información) y las posturas no-representacionalistas (que explican la cognición, incluida la atención, privilegiando la acción, la corporalidad y las situaciones (e.g., el enactivismo)). Entre las propuestas que buscan comprender la relación atención-acción, la propuestade Wayne Wu (2014) se discute de manera especial, en tanto se considera una propuestanovedosa que enfatiza la importancia de la acción y la agencia corporal para elestudio de la atención. Finalmente, algunas consideraciones centrales del enfoqueenactivista son articuladas con miras a complementar algunos aspectos que Wu dejaal margen, en especial, el carácter activo del sujeto, el papel del cuerpo y la relación con elmundo y los otros.

Sensitivity to Social Contingency in Adults with High-Functioning Autism during Computer-Mediated Embodied Interaction

Autism Spectrum Disorder (ASD) can be understood as a social interaction disorder. This makes the emerging "second-person approach" to social cognition a more promising framework for studying ASD than classical approaches focusing on mindreading capacities in detached, observer-based arrangements. According to the second-person approach, embodied, perceptual, and embedded or interactive capabilities are also required for understanding others, and these are hypothesized to be compromised in ASD. We therefore recorded the dynamics of real-time sensorimotor interaction in pairs of control participants and participants with High-Functioning Autism (HFA), using the minimalistic human-computer interface paradigm known as "perceptual crossing" (PC). We investigated whether HFA is associated with impaired detection of social contingency, i.e., a reduced sensitivity to the other's responsiveness to one's own behavior. Surprisingly, our analysis reveals that, at least under the conditions of this highly simplified, computer-mediated, embodied form of social interaction, people with HFA perform equally well as controls. This finding supports the increasing use of virtual reality interfaces for helping people with ASD to better compensate for their social disabilities. Further dynamical analyses are necessary for a better understanding of the mechanisms that are leading to the somewhat surprising results here obtained.

A Sensorimotor Signature of the Transition to Conscious Social Perception: Co-regulation of Active and Passive Touch

It is not yet well understood how we become conscious of the presence of other people as being other subjects in their own right. Developmental and phenomenological approaches are converging on a relational hypothesis: my perception of a "you" is primarily constituted by another subject's attention being directed toward "me." This is particularly the case when my body is being physically explored in an intentional manner. We set out to characterize the sensorimotor signature of the transition to being aware of the other by re-analyzing time series of embodied interactions between pairs of adults (recorded during a "perceptual crossing" experiment). Measures of turn-taking and movement synchrony were used to quantify social coordination, and transfer entropy was used to quantify direction of influence. We found that the transition leading to one's conscious perception of the other's presence was indeed characterized by a significant increase in one's passive reception of the other's tactile stimulations. Unexpectedly, one's clear experience of such passive touch was consistently followed by a switch to active touching of the other, while the other correspondingly became more passive, which suggests that this intersubjective experience was reciprocally co-regulated by both participants.