DARMA: Software for dual axis rating and media annotation

Variance Decomposition of the Continuous Assessment of Interpersonal Dynamics (CAID) system: Assessing sources of influence and reliability of observations of parent-teen interactions

The Continuous Assessment of Interpersonal Dynamics (CAID) is an observational tool that measures warmth and dominance dynamics in real time and is sensitive to individual, dyadic, and contextual influences. Parent-adolescent interpersonal dynamics, which conceptually map onto parenting styles, are an integral part of positive adolescent adjustment and protect against risky outcomes. The current study's goal was to test the degree to which sources of influence on CAID data observed in a previous study of married couples generalize to a sample of parent-adolescent dyads. We examined data from ten raters who rated moment-to-moment warmth and dominance using CAID in a sample of 61 parent-adolescent dyads (N = 122) who were largely non-Hispanic White (62%) or African American (30%) based on parent report (adolescent M age = 14; 57% female). Dyads interacted in four different discussion segments (situations). We applied Generalizability Theory to delineate several sources of variance in CAID parameters and estimated within and between-person reliability. Results revealed a number of different influences, including the person, kinsperson (adolescent versus parent), dyad, rater, situation, and interactions among these factors, on ratings of parent-adolescent interpersonal behavior. These results largely replicate results from married couples, suggesting that the factors that influence ratings of interpersonal interactions largely generalize across sample types.

DynAMoS: The Dynamic Affective Movie Clip Database for Subjectivity Analysis

In this paper, we describe the design, collection, and validation of a new video database that includes holistic and dynamic emotion ratings from 83 participants watching 22 affective movie clips. In contrast to previous work in Affective Computing, which pursued a single "ground truth" label for the affective content of each moment of each video (e.g., by averaging the ratings of 2 to 7 trained participants), we embrace the subjectivity inherent to emotional experiences and provide the full distribution of all participants' ratings (with an average of 76.7 raters per video). We argue that this choice represents a paradigm shift with the potential to unlock new research directions, generate new hypotheses, and inspire novel methods in the Affective Computing community. We also describe several interdisciplinary use cases for the database: to provide dynamic norms for emotion elicitation studies (e.g., in psychology, medicine, and neuroscience), to train and test affective content analysis algorithms (e.g., for dynamic emotion recognition, video summarization, and movie recommendation), and to study subjectivity in emotional reactions (e.g., to identify moments of emotional ambiguity or ambivalence within movies, identify predictors of subjectivity, and develop personalized affective content analysis algorithms). The database is made freely available to researchers for noncommercial use at https://dynamos.mgb.org.

A Survey on Physiological Signal-Based Emotion Recognition

Physiological signals are the most reliable form of signals for emotion recognition, as they cannot be controlled deliberately by the subject. Existing review papers on emotion recognition based on physiological signals surveyed only the regular steps involved in the workflow of emotion recognition such as pre-processing, feature extraction, and classification. While these are important steps, such steps are required for any signal processing application. Emotion recognition poses its own set of challenges that are very important to address for a robust system. Thus, to bridge the gap in the existing literature, in this paper, we review the effect of inter-subject data variance on emotion recognition, important data annotation techniques for emotion recognition and their comparison, data pre-processing techniques for each physiological signal, data splitting techniques for improving the generalization of emotion recognition models and different multimodal fusion techniques and their comparison. Finally, we discuss key challenges and future directions in this field.

Assessing Parent-Adolescent Substance Use Discussions Using the Continuous Assessment of Interpersonal Dynamics

Assessing parent-child interactions is critical for understanding family dynamics, however tools available for capturing these dynamics are limited. The current study sought to examine the validity of the Continuous Assessment of Interpersonal Dynamics (CAID) for understanding the dynamics of parent-adolescent substance use discussions. Specifically, we examined how CAID parameters were related to indicators of parenting and substance use. Sixty-one parent-adolescent dyads (M adolescent age = 14.02, 57% female; M parent age = 46.40; 98% female) completed three 9-minute video-taped conflict, alcohol, and cannabis discussions as well as self-report measures of parenting (e.g., monitoring, psychological control) and substance use behaviors (e.g., intentions, use with parental permission). Interactions were coded using the CAID which provides continuous assessments of parent and adolescent warmth and dominance. Parental warmth, adolescent warmth, and dominance complementarity CAID parameters were positively associated with adaptive parenting and negatively associated with maladaptive parenting factors. Parental warmth in the cannabis discussion was negatively associated with the substance use and intentions factor. These findings support CAID as a reliable and valid assessment of interpersonal dynamics that characterize parent-adolescent substance use discussions and suggest that substance use conversations may be most effective when parents and adolescents act warmly throughout the discussion and exhibit dominance complementarity.

Using Interpersonal Dimensions of Personality and Personality Pathology to Examine Momentary and Idiographic Patterns of Alliance Rupture

The Alternative Model of Personality Disorders (AMPD) integrates several theoretical models of personality functioning, including interpersonal theory. The interpersonal circumplex dimensions of warmth and dominance can be conceptualized as traits similar to those in AMPD Criterion B, but interpersonal theory also offers dynamic hypotheses about how these variables that change from moment to moment, which help to operationalize some of the processes alluded to in AMPD Criterion A. In the psychotherapy literature, dynamic interpersonal behaviors are thought to be critical for identifying therapeutic alliance ruptures, yet few studies have examined moment-to-moment interpersonal behaviors that are associated with alliance ruptures at an idiographic level. The current study examined the concurrent and cross-lagged relationships between interpersonal behaviors and alliance ruptures within each session in the famous Gloria films (“Three Approaches to Psychotherapy”). Interpersonal behaviors (warmth and dominance) as well as alliance ruptures (i.e., withdrawal and confrontation) were calculated at half minute intervals for each dyad. We identified distinct interpersonal patterns associated with alliance ruptures for each session: Gloria (patient)’s warmth was positively related with withdrawal ruptures concurrently in the session with Carl Rogers; Gloria’s dominance and coldness were related with increased confrontation ruptures in the session with Fritz Perls concurrently, while her coldness was also predicted by confrontation ruptures at previous moments; lastly, both Gloria’s dominance and Albert Ellis’s submissiveness were positively related with withdrawal ruptures. These interpersonal patterns demonstrated the promise of using AMPD dimensions to conceptualize momentary interpersonal processes related to therapy ruptures, as well as the clinical importance of attuning to repetitive, dyad-specific interpersonal cues of ruptures within each session.

Full throttle: Demonstrating the speed, accuracy, and validity of a new method for continuous two-dimensional self-report and annotation

Research on fine-grained dynamic psychological processes has increasingly come to rely on continuous self-report measures. Recent studies have extended continuous self-report methods to simultaneously collecting ratings on two dimensions of an experience. For all the variety of approaches, several limitations are inherent to most of them. First, current methods are primarily suited for bipolar, as opposed to unipolar, constructs. Second, respondents report on two dimensions using one hand, which may produce method driven error, including spurious relationships between the two dimensions. Third, two-dimensional reports have primarily been validated for consistency between reporters, rather than the predictive validity of idiosyncratic responses. In a series of tasks, the study reported here addressed these limitations by comparing a previously used method to a newly developed two-handed method, and by explicitly testing the validity of continuous two-dimensional responses. Results show that our new method is easier to use, faster, more accurate, with reduced method-driven dependence between the two dimensions, and preferred by participants. The validity of two-dimensional responding was also demonstrated in comparison to one-dimensional reporting, and in relation to post hoc ratings. Together, these findings suggest that our two-handed method for two-dimensional continuous ratings is a powerful and reliable tool for future research.

Six assumptions of contemporary integrative interpersonal theory of personality and psychopathology

Contemporary integrative interpersonal theory is an evidence-based model of personality, psychopathology, and intervention. In this article, we review six assumptions of contemporary integrative interpersonal theory that distinguish it from other frameworks and suggest five particularly promising and important areas for future research.

CorrNet: Fine-Grained Emotion Recognition for Video Watching Using Wearable Physiological Sensors

Recognizing user emotions while they watch short-form videos anytime and anywhere is essential for facilitating video content customization and personalization. However, most works either classify a single emotion per video stimuli, or are restricted to static, desktop environments. To address this, we propose a correlation-based emotion recognition algorithm (CorrNet) to recognize the valence and arousal (V-A) of each instance (fine-grained segment of signals) using only wearable, physiological signals (e.g., electrodermal activity, heart rate). CorrNet takes advantage of features both inside each instance (intra-modality features) and between different instances for the same video stimuli (correlation-based features). We first test our approach on an indoor-desktop affect dataset (CASE), and thereafter on an outdoor-mobile affect dataset (MERCA) which we collected using a smart wristband and wearable eyetracker. Results show that for subject-independent binary classification (high-low), CorrNet yields promising recognition accuracies: 76.37% and 74.03% for V-A on CASE, and 70.29% and 68.15% for V-A on MERCA. Our findings show: (1) instance segment lengths between 1–4 s result in highest recognition accuracies (2) accuracies between laboratory-grade and wearable sensors are comparable, even under low sampling rates (≤64 Hz) (3) large amounts of neutral V-A labels, an artifact of continuous affect annotation, result in varied recognition performance.

Self or (M)other? Infants' Sensitivity to Bodily Overlap With Their Mother Reflects Their Dyadic Coordination

Adults experience greater self-other bodily overlap in romantic than platonic relationships. One of the closest relationships is between mother and infant, yet little is known about their mutual bodily representations. This study measured infants' sensitivity to bodily overlap with their mother. Twenty-one 6- to 8-month-olds watched their mother's face or a stranger's face being stroked synchronously versus asynchronously with their own face. Infants preferred synchrony only when viewing their mother, not when viewing the stranger. Infants who strongly preferred synchrony with their mother also experienced less coordination with her in naturalistic interactions. Infants thus appear sensitive to bodily overlap with their mother, and this overlap reflects dyadic coordination, supporting theoretical accounts of intersubjectivity in the development of the bodily self.

A dataset of continuous affect annotations and physiological signals for emotion analysis

From a computational viewpoint, emotions continue to be intriguingly hard to understand. In research, a direct and real-time inspection in realistic settings is not possible. Discrete, indirect, post-hoc recordings are therefore the norm. As a result, proper emotion assessment remains a problematic issue. The Continuously Annotated Signals of Emotion (CASE) dataset provides a solution as it focusses on real-time continuous annotation of emotions, as experienced by the participants, while watching various videos. For this purpose, a novel, intuitive joystick-based annotation interface was developed, that allowed for simultaneous reporting of valence and arousal, that are instead often annotated independently. In parallel, eight high quality, synchronized physiological recordings (1000 Hz, 16-bit ADC) were obtained from ECG, BVP, EMG (3x), GSR (or EDA), respiration and skin temperature sensors. The dataset consists of the physiological and annotation data from 30 participants, 15 male and 15 female, who watched several validated video-stimuli. The validity of the emotion induction, as exemplified by the annotation and physiological data, is also presented.

Splitting the affective atom: Divergence of valence and approach-avoidance motivation during a dynamic emotional experience

Valence and approach-avoidance motivation are two distinct but closely related components of affect. However, little is known about how these two processes evolve and covary in a dynamic affective context. We formulated several hypotheses based on the Motivational Dimensional Model of Affect. We expected that anger would be a unique approach-related rather than avoidance-related negative emotion. We also expected that high-approach positive emotions (e.g., desire) would differ from low-approach positive emotions (e.g., amusement) producing a stronger link between valence and approach-avoidance motivation. We also explored other dynamic properties of discrete emotions such as the difference between approach-avoidance motivation and valence as a marker of balance within affective components. We asked 69 participants to provide continuous ratings of valence and approach-avoidance motivation for eight standardized clips representing different discrete emotions. Using multilevel modeling, we established a significant relationship between valence and approach-avoidance motivation with high-approach emotions producing a stronger link between valence and approach-avoidance motivation compared to neutral states and low-approach emotions. Contrary to expectations, we observed that individuals exhibited an avoidance response during anger elicitation. Finally, we found that awe was a distinct positive emotion where approach motivation dominated over valence. These findings are relevant to the theory and research on diverging processes within the core structure of affect.

Properties of the Continuous Assessment of Interpersonal Dynamics Across Sex, Level of Familiarity, and Interpersonal Conflict

The Continuous Assessment of Interpersonal Dynamics (CAID) is a method in which trained observers continuously code the dominance and warmth of individuals who interact with one another in dyads. This method has significant promise for assessing dynamic interpersonal processes. The purpose of this study was to examine the impact of individual sex, dyadic familiarity, and situational conflict on patterns of interpersonal warmth, dominance, and complementarity as assessed via CAID. We used six samples with 603 dyads, including two samples of unacquainted mixed-sex undergraduates interacting in a collaborative task, two samples of couples interacting in both collaborative and conflict tasks, and two samples of mothers and children interacting in both collaborative and conflict tasks. Complementarity effects were robust across all samples, and individuals tended to be relatively warm and dominant. Results from multilevel models indicated that women were slightly warmer than men, whereas there were no sex differences in dominance. Unfamiliar dyads and dyads interacting in more collaborative tasks were relatively warmer, more submissive, and more complementary on warmth but less complementary on dominance. These findings speak to the utility of the CAID method for assessing interpersonal dynamics and provide norms for researchers who use the method for different types of samples and applications.

Momentary patterns of covariation between specific affects and interpersonal behavior: Linking relationship science and personality assessment

Relationships are among the most salient factors affecting happiness and wellbeing for individuals and families. Relationship science has identified the study of dyadic behavioral patterns between couple members during conflict as an important window in to relational functioning with both short-term and long-term consequences. Several methods have been developed for the momentary assessment of behavior during interpersonal transactions. Among these, the most popular is the Specific Affect Coding System (SPAFF), which organizes social behavior into a set of discrete behavioral constructs. This study examines the interpersonal meaning of the SPAFF codes through the lens of interpersonal theory, which uses the fundamental dimensions of Dominance and Affiliation to organize interpersonal behavior. A sample of 67 couples completed a conflict task, which was video recorded and coded using SPAFF and a method for rating momentary interpersonal behavior, the Continuous Assessment of Interpersonal Dynamics (CAID). Actor partner interdependence models in a multilevel structural equation modeling framework were used to study the covariation of SPAFF codes and CAID ratings. Results showed that a number of SPAFF codes had clear interpersonal signatures, but many did not. Additionally, actor and partner effects for the same codes were strongly consistent with interpersonal theory's principle of complementarity. Thus, findings reveal points of convergence and divergence in the 2 systems and provide support for central tenets of interpersonal theory. Future directions based on these initial findings are discussed. (PsycINFO Database Record