Humans utilize sensory evidence of others' intended action to make online decisions

Interpersonal strategy for controlling unpredictable opponents in soft tennis

Competition in sports, unlike cooperation in everyday life, does not involve a single solution because individuals aim to behave unpredictably, thereby preventing others from predicting their actions. This study determined how individuals in court-based sports attempted to control others' unpredictable behaviors, addressing the gap in previous studies regarding the lack of clarity around strategies employed by individuals in competitive situations. We achieved this by applying a switching hybrid dynamics model, considering external inputs to analyze individual behaviors. Consequently, the study indicates that skilled individuals, in contrast to intermediate players, exhibit greater consistency in their behaviors. These skilled individuals lead others to anticipate their consistency and subsequently employ strategies to disrupt these expectations. This strategy exploits the principles of active human inference, implying that competition involves cooperation. This was revealed by an analysis of both human decision-making and behavior in actual matches as discrete and continuous dynamical systems. This interpersonal strategy could assist policymakers in the field of everyday life to enhance competitiveness. This strategy enables policymakers to adopt new policies that promote cooperation with competitors, ultimately increasing competitiveness in various aspects of our daily lives.

Deciphering social traits and pathophysiological conditions from natural behaviors in common marmosets

Nonhuman primates (NHPs) are indispensable animal models by virtue of the continuity of behavioral repertoires across primates, including humans. However, behavioral assessment at the laboratory level has so far been limited. Employing the application of three-dimensional (3D) pose estimation and the optimal integration of subsequent analytic methodologies, we demonstrate that our artificial intelligence (AI)-based approach has successfully deciphered the ethological, cognitive, and pathological traits of common marmosets from their natural behaviors. By applying multiple deep neural networks trained with large-scale datasets, we established an evaluation system that could reconstruct and estimate the 3D poses of the marmosets, a small NHP that is suitable for analyzing complex natural behaviors in laboratory setups. We further developed downstream analytic methodologies to quantify a variety of behavioral parameters beyond motion kinematics. We revealed the distinct parental roles of male and female marmosets through automated detections of food-sharing behaviors using a spatial-temporal filter on 3D poses. Employing a recurrent neural network to analyze 3D pose time series data during social interactions, we additionally discovered that marmosets adjusted their behaviors based on others' internal state, which is not directly observable but can be inferred from the sequence of others' actions. Moreover, a fully unsupervised approach enabled us to detect progressively appearing symptomatic behaviors over a year in a Parkinson's disease model. The high-throughput and versatile nature of an AI-driven approach to analyze natural behaviors will open a new avenue for neuroscience research dealing with big-data analyses of social and pathophysiological behaviors in NHPs.

Attention-Based Variational Autoencoder Models for Human-Human Interaction Recognition via Generation

The remarkable human ability to predict others' intent during physical interactions develops at a very early age and is crucial for development. Intent prediction, defined as the simultaneous recognition and generation of human-human interactions, has many applications such as in assistive robotics, human-robot interaction, video and robotic surveillance, and autonomous driving. However, models for solving the problem are scarce. This paper proposes two attention-based agent models to predict the intent of interacting 3D skeletons by sampling them via a sequence of glimpses. The novelty of these agent models is that they are inherently multimodal, consisting of perceptual and proprioceptive pathways. The action (attention) is driven by the agent's generation error, and not by reinforcement. At each sampling instant, the agent completes the partially observed skeletal motion and infers the interaction class. It learns where and what to sample by minimizing the generation and classification errors. Extensive evaluation of our models is carried out on benchmark datasets and in comparison to a state-of-the-art model for intent prediction, which reveals that classification and generation accuracies of one of the proposed models are comparable to those of the state of the art even though our model contains fewer trainable parameters. The insights gained from our model designs can inform the development of efficient agents, the future of artificial intelligence (AI).

Punishment Leads to Greater Sensorimotor Learning But Less Movement Variability Compared to Reward

When a musician practices a new song, hitting a correct note sounds pleasant while striking an incorrect note sounds unpleasant. Such reward and punishment feedback has been shown to differentially influence the ability to learn a new motor skill. Recent work has suggested that punishment leads to greater movement variability, which causes greater exploration and faster learning. To further test this idea, we collected 102 participants over two experiments. Unlike previous work, in Experiment 1 we found that punishment did not lead to faster learning compared to reward (n = 68), but did lead to a greater extent of learning. Surprisingly, we also found evidence to suggest that punishment led to less movement variability, which was related to the extent of learning. We then designed a second experiment that did not involve adaptation, allowing us to further isolate the influence of punishment feedback on movement variability. In Experiment 2, we again found that punishment led to significantly less movement variability compared to reward (n = 34). Collectively our results suggest that punishment feedback leads to less movement variability. Future work should investigate whether punishment feedback leads to a greater knowledge of movement variability and or increases the sensitivity of updating motor actions.

Virtual fashion experiences in virtual reality fashion show spaces

Introduction

Virtual reality (VR) provides a new fashion space and fashion experience. This study focuses on immersive VR and fashion shows to empirically explore the VR fashion space and fashion experience. Insights specific to fashion have not been presented in as much depth in the literature; thus, the current findings are particularly valuable and insightful.

Methods

This study employed three immersive VR (IVR) fashion show stimuli and in-depth interviews according to a semi-structured questionnaire. Collected data were analyzed based on the concept of VR space and VR experience derived through literature research.

Results

The VR fashion space was divided into three types and VR experiences of cognitive presence, sensible immersion, emotional immersion, and aesthetic interaction were derived accordingly. First, the physical representation of a fashion show induced a cognitive and emotional sense of presence, in which users felt as though they had moved to the same time and place as those at the fashion show. Second, participants experienced cognitive confusion owing to the differences with a priori experiences in the fashion show space (i.e., reality and imagination coexist). Third, participants transcended the limitations of physical reality while in the fashion show space of pataphysics (which was realized with human imagination), and they moved beyond the stage of confusion that is experienced while facing realistic objects to connect to creative inspiration.

Discussion

The difference in the properties of VR space may be associated with distinct VR fashion experiences. The findings suggest that (1) a priori elements such as sociocultural contexts and personal experiences differ in the experiential dimension of virtual space, (2) the VR fashion show space induces a psychological experience between brand and consumer, and (3) creative inspiration and exploratory play can be greatly induced in a user if the immersive fashion space is further from the original source.

The sensorimotor system modulates muscular co-contraction relative to visuomotor feedback responses to regulate movement variability

The naturally occurring variability in our movements often poses a significant challenge when attempting to produce precise and accurate actions, which is readily evident when playing a game of darts. Two differing, yet potentially complementary, control strategies that the sensorimotor system may use to regulate movement variability are impedance control and feedback control. Greater muscular co-contraction leads to greater impedance that acts to stabilize the hand, while visuomotor feedback responses can be used to rapidly correct for unexpected deviations when reaching toward a target. Here, we examined the independent roles and potential interplay of impedance control and visuomotor feedback control when regulating movement variability. Participants were instructed to perform a precise reaching task by moving a cursor through a narrow visual channel. We manipulated cursor feedback by visually amplifying movement variability and/or delaying the visual feedback of the cursor. We found that participants decreased movement variability by increasing muscular co-contraction, aligned with an impedance control strategy. Participants displayed visuomotor feedback responses during the task but, unexpectedly, there was no modulation between conditions. However, we did find a relationship between muscular co-contraction and visuomotor feedback responses, suggesting that participants modulated impedance control relative to feedback control. Taken together, our results highlight that the sensorimotor system modulates muscular co-contraction, relative to visuomotor feedback responses, to regulate movement variability and produce accurate actions.NEW & NOTEWORTHY The sensorimotor system has the constant challenge of dealing with the naturally occurring variability in our movements. Here, we investigated the potential roles of muscular co-contraction and visuomotor feedback responses to regulate movement variability. When we visually amplified movements, we found that the sensorimotor system primarily uses muscular co-contraction to regulate movement variability. Interestingly, we found that muscular co-contraction was modulated relative to inherent visuomotor feedback responses, suggesting an interplay between impedance and feedback control.

Learning from humans to build social cognition among robots

Self-organized groups of robots have generally coordinated their behaviors using quite simple social interactions. Although simple interactions are sufficient for some group behaviors, future research needs to investigate more elaborate forms of coordination, such as social cognition, to progress towards real deployments. In this perspective, we define social cognition among robots as the combination of social inference, social learning, social influence, and knowledge transfer, and propose that these abilities can be established in robots by building underlying mechanisms based on behaviors observed in humans. We review key social processes observed in humans that could inspire valuable capabilities in robots and propose that relevant insights from human social cognition can be obtained by studying human-controlled avatars in virtual environments that have the correct balance of embodiment and constraints. Such environments need to allow participants to engage in embodied social behaviors, for instance through situatedness and bodily involvement, but, at the same time, need to artificially constrain humans to the operational conditions of robots, for instance in terms of perception and communication. We illustrate our proposed experimental method with example setups in a multi-user virtual environment.