Quantifying long-range correlations and 1/f patterns in a minimal experiment of social interaction

An open-source perceptual crossing device for investigating brain dynamics during human interaction

The Perceptual Crossing Device (PCD) introduced in this report is an updated tool designed to facilitate the exploration of brain activity during human interaction with seamless real time integration with EEG equipment. It incorporates haptic and auditory feedback mechanisms, enabling interactions between two users within a virtual environment. Through a unique circular motion interface that enables intuitive virtual interactions, users can experience the presence of their counterpart via tactile or auditory cues. This paper highlights the key characteristics of the PCD, aiming to validate its efficacy in augmenting the understanding of human interactions. Furthermore, by offering an accessible and intuitive interface, the PCD stands to foster greater community engagement in the realm of embodied cognitive science and human interaction studies. Through this device, we anticipate a deeper comprehension of the complex neural dynamics underlying human interaction, thereby contributing a valuable resource to both the scientific community and the broader public.

Machine Impostors Can Avoid Human Detection and Interrupt the Formation of Stable Conventions by Imitating Past Interactions: A Minimal Turing Test

Interactions between humans and bots are increasingly common online, prompting some legislators to pass laws that require bots to disclose their identity. The Turing test is a classic thought experiment testing humans' ability to distinguish a bot impostor from a real human from exchanging text messages. In the current study, we propose a minimal Turing test that avoids natural language, thus allowing us to study the foundations of human communication. In particular, we investigate the relative roles of conventions and reciprocal interaction in determining successful communication. Participants in our task could communicate only by moving an abstract shape in a 2D space. We asked participants to categorize their online social interaction as being with a human partner or a bot impostor. The main hypotheses were that access to the interaction history of a pair would make a bot impostor more deceptive and interrupt the formation of novel conventions between the human participants. Copying their previous interactions prevents humans from successfully communicating through repeating what already worked before. By comparing bots that imitate behavior from the same or a different dyad, we find that impostors are harder to detect when they copy the participants' own partners, leading to less conventional interactions. We also show that reciprocity is beneficial for communicative success when the bot impostor prevents conventionality. We conclude that machine impostors can avoid detection and interrupt the formation of stable conventions by imitating past interactions, and that both reciprocity and conventionality are adaptive strategies under the right circumstances. Our results provide new insights into the emergence of communication and suggest that online bots mining personal information, for example, on social media, might become indistinguishable from humans more easily.

A Minimal Turing Test: Reciprocal Sensorimotor Contingencies for Interaction Detection

In the classical Turing test, participants are challenged to tell whether they are interacting with another human being or with a machine. The way the interaction takes place is not direct, but a distant conversation through computer screen messages. Basic forms of interaction are face-to-face and embodied, context-dependent and based on the detection of reciprocal sensorimotor contingencies. Our idea is that interaction detection requires the integration of proprioceptive and interoceptive patterns with sensorimotor patterns, within quite short time lapses, so that they appear as mutually contingent, as reciprocal. In other words, the experience of interaction takes place when sensorimotor patterns are contingent upon one's own movements, and vice versa. I react to your movement, you react to mine. When I notice both components, I come to experience an interaction. Therefore, we designed a "minimal" Turing test to investigate how much information is required to detect these reciprocal sensorimotor contingencies. Using a new version of the perceptual crossing paradigm, we tested whether participants resorted to interaction detection to tell apart human from machine agents in repeated encounters with these agents. In two studies, we presented participants with movements of a human agent, either online or offline, and movements of a computerized oscillatory agent in three different blocks. In each block, either auditory or audiovisual feedback was provided along each trial. Analysis of participants' explicit responses and of the implicit information subsumed in the dynamics of their series will reveal evidence that participants use the reciprocal sensorimotor contingencies within short time windows. For a machine to pass this minimal Turing test, it should be able to generate this sort of reciprocal contingencies.

Multi-Scale Coordination of Distinctive Movement Patterns During Embodied Interaction Between Adults With High-Functioning Autism and Neurotypicals

Autism Spectrum Disorder (ASD) can be understood as a social interaction disorder. This requires researchers to take a “second-person” stance and to use experimental setups based on bidirectional interactions. The present work offers a quantitative description of movement patterns exhibited during computer-mediated real-time sensorimotor interaction in 10 dyads of adult participants, each consisting of one control individual (CTRL) and one individual with high-functioning autism (HFA). We applied time-series analyses to their movements and found two main results. First, multi-scale coordination between participants was present. Second, despite this dyadic alignment and our previous finding that individuals with HFA can be equally sensitive to the other’s presence, individuals’ movements differed in style: in contrast to CTRLs, HFA participants appeared less inclined to sustain mutual interaction and instead explored the virtual environment more generally. This finding is consistent with social motivation deficit accounts of ASD, as well as with hypersensitivity-motivated avoidance of overstimulation. Our research demonstrates the utility of time series analyses for the second-person stance and complements previous work focused on non-dynamical and performance-based variables.

Long-Range Correlation Underlying Childhood Language and Generative Models

Long-range correlation, a property of time series exhibiting relevant statistical dependence between two distant subsequences, is mainly studied in the statistical physics domain and has been reported to exist in natural language. By using a state-of-the-art method for such analysis, long-range correlation is first shown to occur in long CHILDES data sets. To understand why, generative stochastic models of language, originally proposed in the cognitive scientific domain, are investigated. Among representative models, the Simon model is found to exhibit surprisingly good long-range correlation, but not the Pitman-Yor model. Because the Simon model is known not to correctly reflect the vocabulary growth of natural languages, a simple new model is devised as a conjunct of the Simon and Pitman-Yor models, such that long-range correlation holds with a correct vocabulary growth rate. The investigation overall suggests that uniform sampling is one cause of long-range correlation and could thus have some relation with actual linguistic processes.

Sensitivity to Social Contingency in Adults with High-Functioning Autism during Computer-Mediated Embodied Interaction

Autism Spectrum Disorder (ASD) can be understood as a social interaction disorder. This makes the emerging "second-person approach" to social cognition a more promising framework for studying ASD than classical approaches focusing on mindreading capacities in detached, observer-based arrangements. According to the second-person approach, embodied, perceptual, and embedded or interactive capabilities are also required for understanding others, and these are hypothesized to be compromised in ASD. We therefore recorded the dynamics of real-time sensorimotor interaction in pairs of control participants and participants with High-Functioning Autism (HFA), using the minimalistic human-computer interface paradigm known as "perceptual crossing" (PC). We investigated whether HFA is associated with impaired detection of social contingency, i.e., a reduced sensitivity to the other's responsiveness to one's own behavior. Surprisingly, our analysis reveals that, at least under the conditions of this highly simplified, computer-mediated, embodied form of social interaction, people with HFA perform equally well as controls. This finding supports the increasing use of virtual reality interfaces for helping people with ASD to better compensate for their social disabilities. Further dynamical analyses are necessary for a better understanding of the mechanisms that are leading to the somewhat surprising results here obtained.

The Stance Leads the Dance: The Emergence of Role in a Joint Supra-Postural Task

Successfully meeting a shared goal usually requires co-actors to adopt complementary roles. However, in many cases, who adopts what role is not explicitly predetermined, but instead emerges as a consequence of the differences in the individual abilities and constraints imposed upon each actor. Perhaps the most basic of roles are leader and follower. Here, we investigated the emergence of “leader-follower” dynamics in inter-personal coordination using a joint supra-postural task paradigm (Ramenzoni et al., 2011; Athreya et al., 2014). Pairs of actors were tasked with holding two objects in alignment (each actor manually controlled one of the objects) as they faced different demands for stance (stable vs. difficult) and control (which actor controlled the larger or smaller object). Our results indicate that when actors were in identical stances, neither led the inter-personal (between actors) coordination by any systematic fashion. Alternatively, when asymmetries in postural demands were introduced, the actor with the more difficult stance led the coordination (as determined using cross-recurrence quantification analysis). Moreover, changes in individual stance difficulty resulted in similar changes in the structure of both intra-personal (individual) and inter-personal (dyadic) coordination, suggesting a scale invariance of the task dynamics. Implications for the study of interpersonal coordination are discussed.

What does the interactive brain hypothesis mean for social neuroscience? A dialogue

A recent framework inspired by phenomenological philosophy, dynamical systems theory, embodied cognition and robotics has proposed the interactive brain hypothesis (IBH). Whereas mainstream social neuroscience views social cognition as arising solely from events in the brain, the IBH argues that social cognition requires, in addition, causal relations between the brain and the social environment. We discuss, in turn, the foundational claims for the IBH in its strongest form; classical views of cognition that can be raised against the IBH; a defence of the IBH in the light of these arguments; and a response to this. Our goal is to initiate a dialogue between cognitive neuroscience and enactive views of social cognition. We conclude by suggesting some new directions and emphases that social neuroscience might take.

Time-Series Analysis of Embodied Interaction: Movement Variability and Complexity Matching As Dyadic Properties

There is a growing consensus that a fuller understanding of social cognition depends on more systematic studies of real-time social interaction. Such studies require methods that can deal with the complex dynamics taking place at multiple interdependent temporal and spatial scales, spanning sub-personal, personal, and dyadic levels of analysis. We demonstrate the value of adopting an extended multi-scale approach by re-analyzing movement time-series generated in a study of embodied dyadic interaction in a minimal virtual reality environment (a perceptual crossing experiment). Reduced movement variability revealed an interdependence between social awareness and social coordination that cannot be accounted for by either subjective or objective factors alone: it picks out interactions in which subjective and objective conditions are convergent (i.e., elevated coordination is perceived as clearly social, and impaired coordination is perceived as socially ambiguous). This finding is consistent with the claim that interpersonal interaction can be partially constitutive of direct social perception. Clustering statistics (Allan Factor) of salient events revealed fractal scaling. Complexity matching defined as the similarity between these scaling laws was significantly more pronounced in pairs of participants as compared to surrogate dyads. This further highlights the multi-scale and distributed character of social interaction and extends previous complexity matching results from dyadic conversation to non-verbal social interaction dynamics. Trials with successful joint interaction were also associated with an increase in local coordination. Consequently, a local coordination pattern emerges on the background of complex dyadic interactions in the PCE task and makes joint successful performance possible.

Multi-scale interactions in interpersonal coordination

BACKGROUND

Interpersonal coordination is an essential aspect of daily life, and crucial to performance in cooperative and competitive team sports. While empirical research has investigated interpersonal coordination using a wide variety of analytical tools and frameworks, to date very few studies have employed multifractal techniques to study the nature of interpersonal coordination across multiple spatiotemporal scales. In the present study we address this gap.

METHODS

We investigated the dynamics of a simple dyadic interpersonal coordination task where each participant manually controlled a virtual object in relation to that of his or her partner. We tested whether the resulting hand-movement time series exhibits multi-scale properties and whether those properties are associated with successful performance.

RESULTS

Using the formalism of multifractals, we show that the performance on the coordination task is strongly multi-scale, and that the multi-scale properties appear to arise from interaction-dominant dynamics. Further, we find that the measure of across-scale interactions, multifractal spectrum width, predicts successful performance at the level of the dyad.

CONCLUSION

The results are discussed with respect to the implications of multifractals and interaction-dominance for understanding control in an interpersonal context.