Exploring the movement dynamics of deception

Mining Bodily Cues to Deception

A significant body of research has investigated potential correlates of deception and bodily behavior. The vast majority of these studies consider discrete, subjectively coded bodily movements such as specific hand or head gestures. Such studies fail to consider quantitative aspects of body movement such as the precise movement direction, magnitude and timing. In this paper, we employ an innovative data mining approach to systematically study bodily correlates of deception. We re-analyze motion capture data from a previously published deception study, and experiment with different data coding options. We report how deception detection rates are affected by variables such as body part, the coding of the pose and movement, the length of the observation, and the amount of measurement noise. Our results demonstrate the feasibility of a data mining approach, with detection rates above 65%, significantly outperforming human judgement (52.80%). Owing to the systematic analysis, our analyses allow for an understanding of the importance of various coding factor. Moreover, we can reconcile seemingly discrepant findings in previous research. Our approach highlights the merits of data-driven research to support the validation and development of deception theory.

Detecting ulterior motives from verbal cues in group deliberations

Introduction

Forensic interviewing entails practitioners interviewing suspects to secure valid information and elicit confessions. Such interviews are often conducted in police stations but may also occur in field settings such as border crossings, security checkpoints, bus terminals, and sports venues. Because these real-world interviews often lack experimental control and ground truth, this investigation explored whether results of non-forensic interviews generalize to forensic ones.

Methods

Organizational espionage was simulated to determine (1) what verbal signals distinguish truth from deception, (2) whether deception in groups aligns with deception in dyads, and (3) whether non-forensic venues can be generalized to forensic ones. Engaging in a mock hiring deliberation, participants (4-5 strangers) reviewed and discussed resumes of potential candidates. Surreptitiously, two group members assigned the role of "organizational spies" attempted to persuade the group to hire an inferior candidate. Each group member presented notes from an interview of "their" candidate, followed by a discussion of all candidates. Spies were to use any means possible, including deception, to persuade others to select their candidate. A financial incentive was offered for having one's candidate chosen. The interview reports and discussions were transcribed and analyzed with SPLICE, an automated text analysis program.

Results

Deceivers were perceived as less trustworthy than truth-tellers, especially when the naïve players won but overall, deceivers were difficult for non-spies to detect even though they were seen as less trustworthy than the naïve participants. Deceivers' language was more complex and exhibited an "echoing" strategy of repeating others' opinions. This collusion evolved naturally, without pre-planning. No other verbal differences were evident, which suggests that the difference between spies and non-spies was subtle and difficult for truth-tellers to spot.

Discussion

Whether deception can be successfully detected hinges on a variety of factors including the deceiver's skill to disguise and the detector's ability to sense and process information. Furthermore, the group dynamics and communication context subtly moderate how deception manifests and influence the accuracy of detecting ulterior motives. Our future investigations could encompass non-verbal communication channels and verbal patterns rooted in content, thereby providing a more comprehensive understanding of deception detection.

High-frequency imagery to capture coral tissue (Montipora capricornis) response to environmental stress, a pilot study

Environment stress is a major threat to the existence of coral reefs and has generated a lot of interest in the coral research community. Under the environmental stress, corals can experience tissue loss and/or the breakdown of symbiosis between the cnidarian host and its symbiotic algae causing the coral tissue to appear white as the skeleton can be seen by transparency. Image analysis is a common method used to assess tissue response under the environmental stress. However, the traditional approach is limited by the dynamic nature of the coral-algae symbiosis. Here, we observed coral tissue response in the scleractinian coral, Montipora capricornis, using high frequency image analysis throughout the experiment, as opposed to the typical start/end point assessment method. Color analysis reveals that the process can be divided into five stages with two critical stages according to coral tissue morphology and color ratio. We further explore changes to the morphology of individual polyps by means of the Pearson correlation coefficient and recurrence plots, where the quasi-periodic and nonstationary dynamics can be identified. The recurrence quantification analysis also allows the comparison between the different polyps. Our research provides a detailed visual and mathematical analysis of coral tissue response to environmental stress, which potentially shows universal applicability. Moreover, our approach provides a robust quantitative advancement for improving our insight into a suite of biotic responses in the perspective of coral health evaluation and fate prediction.

Clusters of nonverbal behavior differentiate truths and lies about future malicious intent in checkpoint screening interviews

Recent research has shown that nonverbal behavior (NVB) assessed across multiple channels can differentiate truthtellers from liars. No study, however, has examined whether or not multiple NVBs can differentiate truths from lies about intent regarding future malicious behavior, or across multiple cultural/ethnic groups. We address this gap by examining truths and lies about intent to commit a malicious act in the future in brief, checkpoint-type security screening interviews. Data from four NVB channels producing twenty-one observable NVBs were coded and analyzed using different analytic strategies. Clusters of NVB were found to differentiate truthtellers from liars at statistically significant levels, and substantially beyond the ability of human observers. The findings showed that clusters of NVB can differentiate truthtellers from liars even in brief, checkpoint-type interviews.

A Brief Introduction to Nonlinear Time Series Analysis and Recurrence Plots

Nonlinear time series analysis gained prominence from the late 1980s on, primarily because of its ability to characterize, analyze, and predict nontrivial features in data sets that stem from a wide range of fields such as finance, music, human physiology, cognitive science, astrophysics, climate, and engineering. More recently, recurrence plots, initially proposed as a visual tool for the analysis of complex systems, have proven to be a powerful framework to quantify and reveal nontrivial dynamical features in time series data. This tutorial review provides a brief introduction to the fundamentals of nonlinear time series analysis, before discussing in greater detail a few (out of the many existing) approaches of recurrence plot-based analysis of time series. In particular, it focusses on recurrence plot-based measures which characterize dynamical features such as determinism, synchronization, and regime changes. The concept of surrogate-based hypothesis testing, which is crucial to drawing any inference from data analyses, is also discussed. Finally, the presented recurrence plot approaches are applied to two climatic indices related to the equatorial and North Pacific regions, and their dynamical behavior and their interrelations are investigated.

To freeze or not to freeze: A culture-sensitive motion capture approach to detecting deceit

We present a new signal for detecting deception: full body motion. Previous work on detecting deception from body movement has relied either on human judges or on specific gestures (such as fidgeting or gaze aversion) that are coded by humans. While this research has helped to build the foundation of the field, results are often characterized by inconsistent and contradictory findings, with small-stakes lies under lab conditions detected at rates little better than guessing. We examine whether a full body motion capture suit, which records the position, velocity, and orientation of 23 points in the subject's body, could yield a better signal of deception. Interviewees of South Asian (n = 60) or White British culture (n = 30) were required to either tell the truth or lie about two experienced tasks while being interviewed by somebody from their own (n = 60) or different culture (n = 30). We discovered that full body motion-the sum of joint displacements-was indicative of lying 74.4% of the time. Further analyses indicated that including individual limb data in our full body motion measurements can increase its discriminatory power to 82.2%. Furthermore, movement was guilt- and penitential-related, and occurred independently of anxiety, cognitive load, and cultural background. It appears that full body motion can be an objective nonverbal indicator of deceit, showing that lying does not cause people to freeze.

Behavioral Priming 2.0: Enter a Dynamical Systems Perspective

On a daily basis, people are exposed to numerous stimuli, ranging from colors and smells to sounds and words, that could potentially activate different cognitive constructs and influence their actions. This type of influence on human behavior is referred to as priming. Roughly two decades ago, behavioral priming was hailed as one of the core forces that shape automatic behavior. However, failures to replicate some of the representative findings in this domain soon followed, which posed the following question: "How robust are behavioral priming effects, and to what extent are they actually important in shaping people's actions?" To shed a new light on this question, I revisit behavioral priming through the prism of a dynamical systems perspective (DSP). The DSP is a scientific paradigm that has been developed through a combined effort of many different academic disciplines, ranging from mathematics and physics to biology, economics, psychology, etc., and it deals with behavior of simple and complex systems over time. In the present paper, I use conceptual and methodological tools stemming from the DSP to propose circumstances under which behavioral priming effects are likely to occur. More precisely, I outline three possible types of the influence of priming on human behavior, to which I refer as emergence, readjustment, and attractor switch, and propose experimental designs to examine them. Finally, I discuss relevant implications for behavioral priming effects and their replications.

Conversing with a devil's advocate: Interpersonal coordination in deception and disagreement

This study investigates the presence of dynamical patterns of interpersonal coordination in extended deceptive conversations across multimodal channels of behavior. Using a novel "devil's advocate" paradigm, we experimentally elicited deception and truth across topics in which conversational partners either agreed or disagreed, and where one partner was surreptitiously asked to argue an opinion opposite of what he or she really believed. We focus on interpersonal coordination as an emergent behavioral signal that captures interdependencies between conversational partners, both as the coupling of head movements over the span of milliseconds, measured via a windowed lagged cross correlation (WLCC) technique, and more global temporal dependencies across speech rate, using cross recurrence quantification analysis (CRQA). Moreover, we considered how interpersonal coordination might be shaped by strategic, adaptive conversational goals associated with deception. We found that deceptive conversations displayed more structured speech rate and higher head movement coordination, the latter with a peak in deceptive disagreement conversations. Together the results allow us to posit an adaptive account, whereby interpersonal coordination is not beholden to any single functional explanation, but can strategically adapt to diverse conversational demands.

Comparing a Perceptual and an Automated Vision-Based Method for Lie Detection in Younger Children

The present study investigates how easily it can be detected whether a child is being truthful or not in a game situation, and it explores the cue validity of bodily movements for such type of classification. To achieve this, we introduce an innovative methodology – the combination of perception studies (in which eye-tracking technology is being used) and automated movement analysis. Film fragments from truthful and deceptive children were shown to human judges who were given the task to decide whether the recorded child was being truthful or not. Results reveal that judges are able to accurately distinguish truthful clips from lying clips in both perception studies. Even though the automated movement analysis for overall and specific body regions did not yield significant results between the experimental conditions, we did find a positive correlation between the amount of movement in a child and the perception of lies, i.e., the more movement the children exhibited during a clip, the higher the chance that the clip was perceived as a lie. The eye-tracking study revealed that, even when there is movement happening in different body regions, judges tend to focus their attention mainly on the face region. This is the first study that compares a perceptual and an automated method for the detection of deceptive behavior in children whose data have been elicited through an ecologically valid paradigm.

Deceit and facial expression in children: the enabling role of the "poker face" child and the dependent personality of the detector

This study presents the relation between the facial expression of a group of children when they told a lie and the accuracy in detecting the lie by a sample of adults. To evaluate the intensity and type of emotional content of the children's faces, we applied an automated method capable of analyzing the facial information from the video recordings (FaceReader 5.0 software). The program classified videos as showing a neutral facial expression or an emotional one. There was a significant higher mean of hits for the emotional than for the neutral videos, and a significant negative correlation between the intensity of the neutral expression and the number of hits from the detectors. The lies expressed with emotional facial expression were more easily recognized by adults than the lies expressed with a "poker face"; thus, the less expressive the child the harder it was to guess. The accuracy of the lie detectors was then correlated with their subclinical traits of personality disorders, to find that participants scoring higher in the dependent personality were significantly better lie detectors. A non-significant tendency for women to discriminate better was also found, whereas men tended to be more suspicious than women when judging the children's veracity. This study is the first to automatically decode the facial information of the lying child and relate these results with personality characteristics of the lie detectors in the context of deceptive behavior research. Implications for forensic psychology were suggested: to explore whether the induction of an emotion in a child during an interview could be useful to evaluate the testimony during legal trials.

Investigating Conversational Dynamics: Interactive Alignment, Interpersonal Synergy, and Collective Task Performance

This study investigates interpersonal processes underlying dialog by comparing two approaches, interactive alignment and interpersonal synergy, and assesses how they predict collective performance in a joint task. While the interactive alignment approach highlights imitative patterns between interlocutors, the synergy approach points to structural organization at the level of the interaction-such as complementary patterns straddling speech turns and interlocutors. We develop a general, quantitative method to assess lexical, prosodic, and speech/pause patterns related to the two approaches and their impact on collective performance in a corpus of task-oriented conversations. The results show statistical presence of patterns relevant for both approaches. However, synergetic aspects of dialog provide the best statistical predictors of collective performance and adding aspects of the alignment approach does not improve the model. This suggests that structural organization at the level of the interaction plays a crucial role in task-oriented conversations, possibly constraining and integrating processes related to alignment.

Nonverbal synchrony of head- and body-movement in psychotherapy: different signals have different associations with outcome

Objective: The coordination of patient’s and therapist’s bodily movement – nonverbal synchrony – has been empirically shown to be associated with psychotherapy outcome. This finding was based on dynamic movement patterns of the whole body. The present paper is a new analysis of an existing dataset (Ramseyer and Tschacher, 2011), which extends previous findings by differentiating movements pertaining to head and upper-body regions.

Method: In a sample of 70 patients (37 female, 33 male) treated at an outpatient psychotherapy clinic, we quantified nonverbal synchrony with an automated objective video-analysis algorithm (motion energy analysis). Head- and body-synchrony was quantified during the initial 15 min of video-recorded therapy sessions. Micro-outcome was assessed with self-report post-session questionnaires provided by patients and their therapists. Macro-outcome was measured with questionnaires that quantified attainment of treatment goals and changes in experiencing and behavior at the end of therapy.

Results: The differentiation of head- and body-synchrony showed that these two facets of motor coordination were differentially associated with outcome. Head-synchrony predicted global outcome of therapy, while body-synchrony did not, and body-synchrony predicted session outcome, while head-synchrony did not.

Conclusion: The results pose an important amendment to previous findings, which showed that nonverbal synchrony embodied both outcome and interpersonal variables of psychotherapy dyads. The separation of head- and body-synchrony suggested that distinct mechanisms may operate in these two regions: Head-synchrony embodied phenomena with a long temporal extension (overall therapy success), while body-synchrony embodied phenomena of a more immediate nature (session-level success). More explorations with fine-grained analyses of synchronized phenomena in nonverbal behavior may shed additional light on the embodiment of psychotherapy process.

Three-dimensional reach trajectories as a probe of real-time decision-making between multiple competing targets

Though several features of cognitive processing can be inferred from the discrete measurement [e.g., reaction time (RT), accuracy, etc.] of participants' conscious reports (e.g., verbal or key-press responses), it is becoming increasingly clear that a much richer understanding of these features can be captured from continuous measures of rapid, largely non-conscious behaviors like hand or eye movements. Here, using new experimental data, we describe in detail both the approach and analyses implemented in some of our previous studies that have used rapid reaching movements under cases of target uncertainty in order to probe the features, constraints and dynamics of stimulus-related processing in the brain. This work, as well as that of others, shows that when individuals are simultaneously presented with multiple potential targets—only one of which will be cued after reach onset—they produce initial reach trajectories that are spatially biased in accordance with the probabilistic distribution of targets. Such “spatial averaging” effects are consistent with observations from neurophysiological studies showing that neuronal populations in sensorimotor brain structures represent multiple target choices in parallel and they compete for selection. These effects also confirm and help extend computational models aimed at understanding the underlying mechanisms that support action-target selection. We suggest that the use of this simple, yet powerful behavioral paradigm for providing a “real-time” visualization of ongoing cognitive processes occurring at the neural level offers great promise for studying processes related to a wide range of psychological phenomena, such as decision-making and the representation of objects.

Comprehending body language and mimics: an ERP and neuroimaging study on Italian actors and viewers

In this study, the neural mechanism subserving the ability to understand people’s emotional and mental states by observing their body language (facial expression, body posture and mimics) was investigated in healthy volunteers. ERPs were recorded in 30 Italian University students while they evaluated 280 pictures of highly ecological displays of emotional body language that were acted out by 8 male and female Italian actors. Pictures were briefly flashed and preceded by short verbal descriptions (e.g., “What a bore!”) that were incongruent half of the time (e.g., a picture of a very attentive and concentrated person shown after the previous example verbal description). ERP data and source reconstruction indicated that the first recognition of incongruent body language occurred 300 ms post-stimulus. swLORETA performed on the N400 identified the strongest generators of this effect in the right rectal gyrus (BA11) of the ventromedial orbitofrontal cortex, the bilateral uncus (limbic system) and the cingulate cortex, the cortical areas devoted to face and body processing (STS, FFA EBA) and the premotor cortex (BA6), which is involved in action understanding. These results indicate that face and body mimics undergo a prioritized processing that is mostly represented in the affective brain and is rapidly compared with verbal information. This process is likely able to regulate social interactions by providing on-line information about the sincerity and trustfulness of others.