Perceived Intensity of Emotional Point-Light Displays is Reduced in Subjects with ASD

EMOKINE: A software package and computational framework for scaling up the creation of highly controlled emotional full-body movement datasets

EMOKINE is a software package and dataset creation suite for emotional full-body movement research in experimental psychology, affective neuroscience, and computer vision. A computational framework, comprehensive instructions, a pilot dataset, observer ratings, and kinematic feature extraction code are provided to facilitate future dataset creations at scale. In addition, the EMOKINE framework outlines how complex sequences of movements may advance emotion research. Traditionally, often emotional-'action'-based stimuli are used in such research, like hand-waving or walking motions. Here instead, a pilot dataset is provided with short dance choreographies, repeated several times by a dancer who expressed different emotional intentions at each repetition: anger, contentment, fear, joy, neutrality, and sadness. The dataset was simultaneously filmed professionally, and recorded using XSENS® motion capture technology (17 sensors, 240 frames/second). Thirty-two statistics from 12 kinematic features were extracted offline, for the first time in one single dataset: speed, acceleration, angular speed, angular acceleration, limb contraction, distance to center of mass, quantity of motion, dimensionless jerk (integral), head angle (with regards to vertical axis and to back), and space (convex hull 2D and 3D). Average, median absolute deviation (MAD), and maximum value were computed as applicable. The EMOKINE software is appliable to other motion-capture systems and is openly available on the Zenodo Repository. Releases on GitHub include: (i) the code to extract the 32 statistics, (ii) a rigging plugin for Python for MVNX file-conversion to Blender format (MVNX=output file XSENS® system), and (iii) a Python-script-powered custom software to assist with blurring faces; latter two under GPLv3 licenses.

A 5-emotions stimuli set for emotion perception research with full-body dance movements

Ekman famously contended that there are different channels of emotional expression (face, voice, body), and that emotion recognition ability confers an adaptive advantage to the individual. Yet, still today, much emotion perception research is focussed on emotion recognition from the face, and few validated emotionally expressive full-body stimuli sets are available. Based on research on emotional speech perception, we created a new, highly controlled full-body stimuli set. We used the same-sequence approach, and not emotional actions (e.g., jumping of joy, recoiling in fear): One professional dancer danced 30 sequences of (dance) movements five times each, expressing joy, anger, fear, sadness or a neutral state, one at each repetition. We outline the creation of a total of 150, 6-s-long such video stimuli, that show the dancer as a white silhouette on a black background. Ratings from 90 participants (emotion recognition, aesthetic judgment) showed that intended emotion was recognized above chance (chance: 20%; joy: 45%, anger: 48%, fear: 37%, sadness: 50%, neutral state: 51%), and that aesthetic judgment was sensitive to the intended emotion (beauty ratings: joy > anger > fear > neutral state, and sad > fear > neutral state). The stimuli set, normative values and code are available for download.

The McNorm library: creating and validating a new library of emotionally expressive whole body dance movements

The ability to exchange affective cues with others plays a key role in our ability to create and maintain meaningful social relationships. We express our emotions through a variety of socially salient cues, including facial expressions, the voice, and body movement. While significant advances have been made in our understanding of verbal and facial communication, to date, understanding of the role played by human body movement in our social interactions remains incomplete. To this end, here we describe the creation and validation of a new set of emotionally expressive whole-body dance movement stimuli, named the Motion Capture Norming (McNorm) Library, which was designed to reconcile a number of limitations associated with previous movement stimuli. This library comprises a series of point-light representations of a dancer's movements, which were performed to communicate to observers neutrality, happiness, sadness, anger, and fear. Based on results from two validation experiments, participants could reliably discriminate the intended emotion expressed in the clips in this stimulus set, with accuracy rates up to 60% (chance = 20%). We further explored the impact of dance experience and trait empathy on emotion recognition and found that neither significantly impacted emotion discrimination. As all materials for presenting and analysing this movement library are openly available, we hope this resource will aid other researchers in further exploration of affective communication expressed by human bodily movement.

No faces, just body movements—Effects of perceived emotional valence of body kinetics and psychological factors on interpersonal distance behavior within an immersive virtual environment

In an immersive virtual environment, it was investigated how the perception of body kinetics contributes to social distance behavior when the facial expression and other physical properties of a social interaction partner cannot be perceived. Based on point light displays, both the subject and the social interaction partner were depicted as stick figures, both moving simultaneously in the same space. In addition, the effects of relevant psychological factors of the perceiver on social distance behavior were examined. The results were consistent with those from studies with facial expressions or realistic full-body interactants. A greater distance was maintained from characters with emotionally negative expressions of body kinetics. Stationary objects stimuli, which were also included in the study, were mostly passed closer than neutral agents. However, the results are not entirely clear and require further investigation. Depressive symptom burden and factors mainly related to anxiety and avoidance showed effects on social distance in an IVE. The CID, a test often used to assess the interpersonal distance at which a person is comfortable, correlated with that overt behavior. In summary, the results of the study provide experimental evidence that the perception of body kinetics has a similarly significant influence on the regulation of social distance as, for example, facial affect. Implementing this study in real life would be incredibly complex, if not impossible. It is interesting to see that the comparatively simple method used in this study to create and operate an immersive virtual environment turned out to be suitable for studying at least simple types of social behavior based on body movements.

Perception of Dynamic Point Light Facial Expression

This study uses point light displays both to investigate the roles of global and local motion analyses in the perception of dynamic facial expressions and to measure the information threshold for reliable recognition of emotions. We videotaped the faces of actors wearing black makeup with white dots while they dynamically produced each of 6 basic Darwin/Ekman emotional expressions. The number of point lights was varied to systematically manipulate amount of information available. For all but one of the expressions, discriminability (d′) increased approximately linearly with number of point lights, with most remaining largely discriminable with as few as only 6 point lights. This finding supports reliance on global motion patterns produced by facial muscles. However, discriminability for the happy expression was notably higher and largely unaffected by number of point lights and thus appears to rely on characteristic local motion, probably the unique upward curvature of the mouth. The findings indicate that recognition of facial expression is not a unitary process and that different expressions may be conveyed by different perceptual information, but in general, basic facial emotional expressions typically remain largely discriminable with as few as 6 dynamic point lights.

Distinct Biological Motion Perception in Autism Spectrum Disorder: A Meta-Analysis

If neurotypical people rely on specialized perceptual mechanisms when perceiving biological motion, then one would not expect an association between task performance and IQ. However, if those with ASD recruit higher order cognitive skills when solving biological motion tasks, performance may be predicted by IQ. In a meta-analysis that included 19 articles, we found an association between biological motion perception and IQ among observers with ASD but no significant relationship among typical observers. If the task required emotion perception, then there was an even stronger association with IQ in the ASD group.

Brief Report: Emotional Picture and Language Processing in Adults with Autism Spectrum Disorder

There is currently limited research and a lack of consensus on emotional processing impairments among adults with autism spectrum disorder (ASD). The present pilot study sought to characterize the extent to which adults with ASD are impaired in processing emotions in both words and pictures. Ten adults with ASD rated word and picture stimuli on emotional valence and arousal. Their ratings were compared to normative data for both stimuli sets using item-level correlations. Adults with ASD rank-ordered stimuli similarly to typically developing individuals, demonstrating relatively typical understanding of emotional words and pictures. However, they used a narrower range of the scales which suggests more subtle impairments affecting emotion-processing. Future directions arising from the findings of this pilot study are discussed.

Does co-presence affect the way we perceive and respond to emotional interactions?

This study compared how two virtual display conditions of human body expressions influenced explicit and implicit dimensions of emotion perception and response behavior in women and men. Two avatars displayed emotional interactions (angry, sad, affectionate, happy) in a "pictorial" condition depicting the emotional interactive partners on a screen within a virtual environment and a "visual" condition allowing participants to share space with the avatars, thereby enhancing co-presence and agency. Subsequently to stimulus presentation, explicit valence perception and response tendency (i.e. the explicit tendency to avoid or approach the situation) were assessed on rating scales. Implicit responses, i.e. postural and autonomic responses towards the observed interactions were measured by means of postural displacement and changes in skin conductance. Results showed that self-reported presence differed between pictorial and visual conditions, however, it was not correlated with skin conductance responses. Valence perception was only marginally influenced by the virtual condition and not at all by explicit response behavior. There were gender-mediated effects on postural response tendencies as well as gender differences in explicit response behavior but not in valence perception. Exploratory analyses revealed a link between valence perception and preferred behavioral response in women but not in men. We conclude that the display condition seems to influence automatic motivational tendencies but not higher level cognitive evaluations. Moreover, intragroup differences in explicit and implicit response behavior highlight the importance of individual factors beyond gender.

Autism Insurance Mandates in the US: Comparison of Mandated Commercial Insurance Benefits Across States

INTRODUCTION

Autism mandates are laws that require commercial insurers to cover certain evidence-based treatments for Autism Spectrum Disorder (ASD). The purpose of this study was to review state variability in autism insurance mandates and the benefits they cover and to discuss recommendations for research and policy to improve ASD services across states.

METHODS

Data were extracted from 2001 to 2020 from all 50 states plus the District of Columbia (N = 51) from policy text. News articles and websites of ASD advocacy organizations were also reviewed to ensure inclusion of the most recent policy changes. Descriptive statistics and heatmaps were used to characterize the autism mandate landscape and visualize variability in benefit parameters across states.

RESULTS

Autism mandates vary greatly in benefit parameters across US states, but there is a common set of benefits that most states have adopted. These include coverage of provider-recommended ASD services except for medical equipment, coverage up to an age limit of 18 to 21, an annual dollar limit of $36,000 with no restriction on the number of hours or visits, no lifetime cap on benefits, and requirement of BCBA® certification or its equivalent for providers of ABA.

DISCUSSION

There is a need for continued research evaluating the impact of autism mandates and benefit parameters on access to care, service utilization, and clinical outcomes for the ASD population. Stakeholder engagement and understanding the impact of autism mandates on clinical and patient-centered outcomes may provide direction for policy advocacy and public health initiatives.

The symptoms of autism including social communication deficits and repetitive and restricted behaviors are associated with different emotional and behavioral problems

The aim of the study was to investigate the associations between symptoms of autism and emotional and behavioral problems in children with autism spectrum disorder from both caregivers’ and clinicians’ perspectives. Three main findings were found in our study. First, the association patterns were similar in the preschool and school-aged children. Second, different association patterns were found from caregivers’ and professionals’ perspectives. From the professionals’ perspective, only repetitive behaviors were associated with behavioral problems, while from the caregivers’ perspective, all symptoms of autism were associated with emotional and behavioral problems. Third, different types of symptoms of autism were associated with different types of emotional and behavioral problems. For example, from the professionals’ perspective, restricted and repetitive behaviors were only associated with hyperactivity and inattention. From the caregivers’ perspective, social emotion was associated with emotional symptoms, and other symptoms of autism were associated with hyperactivity and inattention, as well as with peer problems. The results of our study provided deeper understanding of the relationships between symptoms of autism and emotional and behavioral problems, and the findings could serve as a reference for intervention planning when clinicians approach children with autism spectrum disorder.

Anomalous Perception of Biological Motion in Autism: A Conceptual Review and Meta-Analysis

Despite its popularity, the construct of biological motion (BM) and its putative anomalies in autism spectrum disorder (ASD) are not completely clarified. In this article, we present a meta-analysis investigating the putative anomalies of BM perception in ASD. Through a systematic literature search, we found 30 studies that investigated BM perception in both ASD and typical developing peers by using point-light display stimuli. A general meta-analysis including all these studies showed a moderate deficit of individuals with ASD in BM processing, but also a high heterogeneity. This heterogeneity was explored in different additional meta-analyses where studies were grouped according to levels of complexity of the BM task employed (first-order, direct and instrumental), and according to the manipulation of low-level perceptual features (spatial vs. temporal) of the control stimuli. Results suggest that the most severe deficit in ASD is evident when perception of BM is serving a secondary purpose (e.g., inferring intentionality/action/emotion) and, interestingly, that temporal dynamics of stimuli are an important factor in determining BM processing anomalies in ASD. Our results question the traditional understanding of BM anomalies in ASD as a monolithic deficit and suggest a paradigm shift that deconstructs BM into distinct levels of processing and specific spatio-temporal subcomponents.

Neural Processing and Production of Gesture in Children and Adolescents With Autism Spectrum Disorder

Individuals with autism spectrum disorder (ASD) demonstrate impairments in non-verbal communication, including gesturing and imitation deficits. Reduced sensitivity to biological motion (BM) in ASD may impair processing of dynamic social cues like gestures, which in turn may impede encoding and subsequent performance of these actions. Using both an fMRI task involving observation of action gestures and a charade style paradigm assessing gesture performance, this study examined the brain-behavior relationships between neural activity during gesture processing, gesturing abilities and social symptomology in a group of children and adolescents with and without ASD. Compared to typically developing (TD) controls, participants with ASD showed atypical sensitivity to movement in right posterior superior temporal sulcus (pSTS), a region implicated in action processing, and had poorer overall gesture performance with specific deficits in hand posture. The TD group showed associations between neural activity, gesture performance and social skills, that were weak or non-significant in the ASD group. These findings suggest that those with ASD demonstrate abnormalities in both processing and production of gestures and may reflect dysfunction in the mechanism underlying perception-action coupling resulting in atypical development of social and communicative skills.

Biological motion perception in autism spectrum disorder: a meta-analysis

Background

Biological motion, namely the movement of others, conveys information that allows the identification of affective states and intentions. This makes it an important avenue of research in autism spectrum disorder where social functioning is one of the main areas of difficulty. We aimed to create a quantitative summary of previous findings and investigate potential factors, which could explain the variable results found in the literature investigating biological motion perception in autism.

Methods

A search from five electronic databases yielded 52 papers eligible for a quantitative summarisation, including behavioural, eye-tracking, electroencephalography and functional magnetic resonance imaging studies.

Results

Using a three-level random effects meta-analytic approach, we found that individuals with autism generally showed decreased performance in perception and interpretation of biological motion. Results additionally suggest decreased performance when higher order information, such as emotion, is required. Moreover, with the increase of age, the difference between autistic and neurotypical individuals decreases, with children showing the largest effect size overall.

Conclusion

We highlight the need for methodological standards and clear distinctions between the age groups and paradigms utilised when trying to interpret differences between the two populations.