Detection of text-based social cues in adults with traumatic brain injury

OBJECTIVES

Written text contains verbal immediacy cues-word form or grammatical cues that indicate positive attitude or liking towards an object, action, or person. We asked if adults with moderate-severe traumatic brain injury (TBI) would respond to these cues, given evidence of TBI-related social communication impairments.

METHODS

Sixty-nine adults with TBI and 74 healthy comparison (HC) peers read pairs of sentences containing different types of immediacy cues (e.g., speaker A said "these Canadians" vs. B said "those Canadians.") and identified which speaker (A or B) had a more positive attitude towards the underlined entity (Task 1); and pairs of sentences comprised of a context sentence (e.g., Fred is asked, "Did you visit Joan and Sue?") and a statement sentence (Fred says, "I visited Sue and Joan.") and were asked to indicate how much Fred liked or disliked the underlined words (Task 2).

RESULTS

HC group scores were significantly higher on Task 1, indicating more sensitivity to cues. On Task 2, TBI and HC group ratings differed across cue types and immediacy types, and the TBI group appeared to have less sensitivity to these cues.

CONCLUSIONS

Findings suggest that TBI-related impairments may reduce sensitivity to subtle social cues in text.

Characterizing computer-mediated communication, friendship, and social participation in adults with traumatic brain injury

BACKGROUND

Adults with traumatic brain injury (TBI) report loss of friendship and reduced social participation after injury, but there is limited information regarding quantity of friends and methods of communication. Our objective was to characterize friendship networks, social participation, and methods of communication, including computer-mediated communication (CMC), used by adults with TBI compared to uninjured adults.

METHODS

Participants were 25 adults with TBI and 26 uninjured healthy comparisons (HC) adults, who completed the Participation Assessment with Recombined Tools-Objective (PART-O) and the Social Network Questionnaire (SNQ).

RESULTS

Adults with TBI had significantly fewer total friends and significantly lower levels of productivity and overall social participation. Face-to-face interaction was the preferred method of contact for both groups. Adults with TBI were significantly less likely to use texting as a primary method of communication than their uninjured peers, but used other methods of communication at similar rates.

CONCLUSION

Our study supports prior findings of reduced friendships and reduced social participation after TBI and adds new information about similarities and differences in communication methods between adults with and without TBI.

Facial emotion recognition of older adults with traumatic brain injury

OBJECTIVES

The objective of this study was to examine the effects of traumatic brain injury (TBI) and age on facial emotion recognition abilities in adults. Age and TBI were expected to have negative effects on emotion recognition and a TBI by age interaction was hypothesized such that older adults with TBI would have the lowest emotion recognition scores.

METHODS

A prospective cohort study was conducted. Participants were 26 adults with moderate-severe TBI (13 older and 13 younger) and 26 uninjured peers matched for age, sex, and education. Emotion recognition was measured using the Emotion Recognition Task, which is comprised of dynamically morphed facial expressions of the six basic emotions, presented at different intensity levels.

RESULTS

TBI and older age were associated with poorer recognition of both subtle and intense expressions, but only for expressions of anger and sadness. There was no interaction of age and TBI.

CONCLUSIONS

Results add to the growing evidence of emotion recognition impairments after TBI, particularly for select negative emotions, and extend this finding to adults over the age of 60. Further research is needed to better understand social cognitive effects of TBI across the adult lifespan.

Friendship Quality, Friendship Quantity, and Social Participation in Adults with Traumatic Brain Injury

Adults with traumatic brain injury (TBI) often report reduced social participation and loss of friends, but little is known about quality of friendship after TBI. Our objective was to characterize social participation, friendship quantity, and friendship quality of adults with TBI and a comparison group of uninjured adults. Participants included 18 adults with moderate to severe TBI and 16 of their informant friends; and 18 uninjured adults and 11 of their informant friends. The main measures used were the Participation Assessment with Recombined Tools-Objective, the Social Network Questionnaire, and the McGill Friendship Questionnaire. Participants with TBI reported significantly less social participation and had fewer total friends, although this difference was not statistically significant. Adults with TBI differed from their friends on one measure of friendship quality, but reports for friendship quality were high in both groups. Adults with TBI reported overall high levels of friendship quality despite having lower levels of social participation compared with uninjured adults. Future research should investigate how the balance of quantity and quality of friendships relates to satisfaction with social participation and overall quality of life.

Social-cue perception and mentalizing ability following traumatic brain injury: A human-robot interaction study

PRIMARY OBJECTIVE

Research studies and clinical observations of individuals with traumatic brain injury (TBI) indicate marked deficits in mentalizing-perceiving social information and integrating it into judgements about the affective and mental states of others. The current study investigates social-cognitive mechanisms that underlie mentalizing ability to advance our understanding of social consequences of TBI and inform the development of more effective clinical interventions.

RESEARCH DESIGN

The study followed a mixed-design experiment, manipulating the presence of a mentalizing gaze cue across trials and participant population (TBI vs. healthy comparisons).

METHODS AND PROCEDURES

Participants, 153 adults, 74 with moderate-severe TBI and 79 demographically matched healthy comparison peers, were asked to judge a humanoid robot's mental state based on precisely controlled gaze cues presented by the robot and apply those judgements to respond accurately on the experimental task.

MAIN OUTCOMES AND RESULTS

Results showed that, contrary to our hypothesis, the social cues improved task performance in the TBI group but not the healthy comparison group.

CONCLUSIONS

Results provide evidence that, in specific contexts, individuals with TBI can perceive, correctly recognize, and integrate dynamic gaze cues and motivate further research to understand why this ability may not translate to day-to-day social interactions.

A flexible optimization-based method for synthesizing intent-expressive robot arm motion

We present an approach to synthesize robot arm trajectories that effectively communicate the robot’s intent to a human collaborator while achieving task goals. Our approach uses nonlinear constrained optimization to encode task requirements and desired motion properties. Our implementation allows for a wide range of constraints and objectives. We introduce a novel objective function to optimize robot arm motions for intent-expressiveness that works in a range of scenarios and robot arm types. Our formulation supports experimentation with different theories of how viewers interpret robot motion. Through a series of human-subject experiments on real and simulated robots, we demonstrate that our method leads to improved collaborative performance against other methods, including the current state of the art. These experiments also show how our perception heuristic can affect collaborative outcomes.

White matter correlates of different aspects of facial affect recognition impairment following traumatic brain injury

Although facial affect recognition deficits are well documented in individuals with moderate-to-severe traumatic brain injury (TBI), little research has examined the neural mechanisms underlying these impairments. Here, we use diffusion tensor imaging (DTI), specifically the scalars fractional anisotropy (FA), mean diffusivity (MD), and radial diffusivity (RD), to examine relationships between regional white-matter integrity and two facial affect sub-skills: perceptual affect recognition abilities (measured by an affect matching task) and verbal categorization of facial affect (measured by an affect labeling task). Our results showed that, within the TBI group, higher levels of white-matter integrity in tracts involved in affect recognition (inferior fronto-occipital, inferior longitudinal, and uncinate fasciculi) were associated with better performance on both tasks. Verbal categorization skills were specifically and positively correlated with integrity of the left uncinate fasciculus. Moreover, we observed a striking lateralization effect, with perceptual abilities having an almost exclusive relationship with integrity of right hemisphere tracts, while verbal abilities were associated with both left and right hemisphere integrity. The findings advance our understanding of the neurobiological mechanisms that underlie subcomponents of facial affect recognition and lead to different patterns of facial affect recognition impairment in adults with TBI.

Different aspects of facial affect recognition impairment following traumatic brain injury: The role of perceptual and interpretative abilities

It is well established that many individuals with traumatic brain injury (TBI) are impaired at facial affect recognition, yet little is known about the mechanisms underlying such deficits. In particular, little work has examined whether the breakdown of facial affect recognition abilities occurs at the perceptual level (e.g., recognizing a smile) or at the verbal categorization stage (e.g., assigning the label "happy" to a smiling face). The aim of the current study was to investigate the integrity of these two distinct facial affect recognition subskills in a sample of 38 individuals with moderate-to-severe TBI and 24 demographically matched healthy individuals. Participants were administered an affect matching (perceptual skills) and an affect labeling (verbal categorization skills) task. Statistical analyses revealed that, while individuals with TBI showed significantly higher levels of impairment in the verbal categorization task than in the perceptual task, they performed less well than healthy comparison participants on both tasks. These findings indicate that facial affect recognition impairment can occur at different cognitive stages following TBI, suggesting the necessity of careful screening to offer targeted treatment. Moreover, they provide further neuropsychological evidence supporting the notion that distinct types of subskills are necessary to achieve successful recognition of facial affects.

Impaired theory of mind in adults with traumatic brain injury: A replication and extension of findings

OBJECTIVE

To replicate a previous study of Theory of Mind (ToM) task performance in adults with traumatic brain injury (TBI) under different working memory (WM) demands, and determine if there are sex-based differences in effects of WM load on ToM task performance.

METHOD

58 adults with moderate-severe TBI (24 females) and 66 uninjured adults (34 females) matched group-wise for age, sex, and education viewed a series of video vignettes from the Video Social Inference Task (VSIT) (Turkstra, 2008) and answered ToM questions. Vignette presentation format required updating and maintenance of information, and WM load was manipulated by varying presence of distracters.

RESULTS

There were main effects of group and WM load, no significant effect of sex, and a marginal interaction of group by WM load, with larger between-group differences in conditions with higher WM load. VSIT scores for the condition with the highest WM load were significantly correlated with scores on the first trial of the California Verbal Learning Test.

CONCLUSIONS

We replicated findings of lower scores in adults with TBI on a video-based ToM task, and provided additional evidence of the effect of WM load on social cognition task performance. There were no significant accuracy differences between men and women, inconsistent with prior evidence - including our own data using the same test. There is strong evidence of a female advantage on other social cognition tasks, and the parameters of this advantage remain to be discovered.

Turn-Taking and Coordination in Human-Machine Interaction

This issue of AI Magazine brings together a collection of articles on challenges, mechanisms, and research progress in turn-taking and coordination between humans and machines. The contributing authors work in interrelated fields of spoken dialog systems, intelligent virtual agents, human-computer interaction, human-robot interaction, and semiautonomous collaborative systems and explore core concepts in coordinating speech and actions with virtual agents, robots, and other autonomous systems. Several of the contributors participated in the AAAI Spring Symposium on Turn-Taking and Coordination in Human-Machine Interaction, held in March 2015, and several articles in this issue are extensions of work presented at that symposium. The articles in the collection address key modeling, methodological, and computational challenges in achieving effective coordination with machines, propose solutions that overcome these challenges under sensory, cognitive, and resource restrictions, and illustrate how such solutions can facilitate coordination across diverse and challenging domains. The contributions highlight turn-taking and coordination in human-machine interaction as an emerging and evolving research area with important implications for future applications of AI.

Predictors and Prognostic Significance of Troponin-I Release following Elective Coronary Angioplasty

The objective of this study was to investigate the predictors and prognostic significance of post-procedural cardiac troponin (cTn)-I elevations in a consecutive series of patients who underwent elective percutaneous coronary intervention (PCI). cTn-I was measured in 100 patients immediately before and within 24 h after the elective PCI. Post-procedural cTn-I elevation was observed in 27 of the 100 patients. In multivariate analysis, basal haemoglobin values and the number of repeated balloon dilatations were found to be independent predictors of cTn-I elevation. During the follow-up period of 12 ± 1.2 months, the cTn-I-positive group had more major adverse cardiovascular events than the cTn-I-negative group (33.3% versus 16.4%, respectively), but the difference was not significant. An increase in cTn-I levels following elective PCI procedures was frequent but did not predict a poor long-term outcome.

Using gaze patterns to predict task intent in collaboration

In everyday interactions, humans naturally exhibit behavioral cues, such as gaze and head movements, that signal their intentions while interpreting the behavioral cues of others to predict their intentions. Such intention prediction enables each partner to adapt their behaviors to the intent of others, serving a critical role in joint action where parties work together to achieve a common goal. Among behavioral cues, eye gaze is particularly important in understanding a person's attention and intention. In this work, we seek to quantify how gaze patterns may indicate a person's intention. Our investigation was contextualized in a dyadic sandwich-making scenario in which a "worker" prepared a sandwich by adding ingredients requested by a "customer." In this context, we investigated the extent to which the customers' gaze cues serve as predictors of which ingredients they intend to request. Predictive features were derived to represent characteristics of the customers' gaze patterns. We developed a support vector machine-based (SVM-based) model that achieved 76% accuracy in predicting the customers' intended requests based solely on gaze features. Moreover, the predictor made correct predictions approximately 1.8 s before the spoken request from the customer. We further analyzed several episodes of interactions from our data to develop a deeper understanding of the scenarios where our predictor succeeded and failed in making correct predictions. These analyses revealed additional gaze patterns that may be leveraged to improve intention prediction. This work highlights gaze cues as a significant resource for understanding human intentions and informs the design of real-time recognizers of user intention for intelligent systems, such as assistive robots and ubiquitous devices, that may enable more complex capabilities and improved user experience.

Look together: analyzing gaze coordination with epistemic network analysis

When conversing and collaborating in everyday situations, people naturally and interactively align their behaviors with each other across various communication channels, including speech, gesture, posture, and gaze. Having access to a partner's referential gaze behavior has been shown to be particularly important in achieving collaborative outcomes, but the process in which people's gaze behaviors unfold over the course of an interaction and become tightly coordinated is not well understood. In this paper, we present work to develop a deeper and more nuanced understanding of coordinated referential gaze in collaborating dyads. We recruited 13 dyads to participate in a collaborative sandwich-making task and used dual mobile eye tracking to synchronously record each participant's gaze behavior. We used a relatively new analysis technique—epistemic network analysis—to jointly model the gaze behaviors of both conversational participants. In this analysis, network nodes represent gaze targets for each participant, and edge strengths convey the likelihood of simultaneous gaze to the connected target nodes during a given time-slice. We divided collaborative task sequences into discrete phases to examine how the networks of shared gaze evolved over longer time windows. We conducted three separate analyses of the data to reveal (1) properties and patterns of how gaze coordination unfolds throughout an interaction sequence, (2) optimal time lags of gaze alignment within a dyad at different phases of the interaction, and (3) differences in gaze coordination patterns for interaction sequences that lead to breakdowns and repairs. In addition to contributing to the growing body of knowledge on the coordination of gaze behaviors in joint activities, this work has implications for the design of future technologies that engage in situated interactions with human users.

Gaze and Attention Management for Embodied Conversational Agents

To facilitate natural interactions between humans and embodied conversational agents (ECAs), we need to endow the latter with the same nonverbal cues that humans use to communicate. Gaze cues in particular are integral in mechanisms for communication and management of attention in social interactions, which can trigger important social and cognitive processes, such as establishment of affiliation between people or learning new information. The fundamental building blocks of gaze behaviors are gaze shifts : coordinated movements of the eyes, head, and body toward objects and information in the environment. In this article, we present a novel computational model for gaze shift synthesis for ECAs that supports parametric control over coordinated eye, head, and upper body movements. We employed the model in three studies with human participants. In the first study, we validated the model by showing that participants are able to interpret the agent’s gaze direction accurately. In the second and third studies, we showed that by adjusting the participation of the head and upper body in gaze shifts, we can control the strength of the attention signals conveyed, thereby strengthening or weakening their social and cognitive effects. The second study shows that manipulation of eye--head coordination in gaze enables an agent to convey more information or establish stronger affiliation with participants in a teaching task, while the third study demonstrates how manipulation of upper body coordination enables the agent to communicate increased interest in objects in the environment.

The features of infectious diseases departments and anti-infective practices in France and Turkey: a cross-sectional study

The aim of this study was to assess the infectious diseases (ID) wards of tertiary hospitals in France and Turkey for technical capacity, infection control, characteristics of patients, infections, infecting organisms, and therapeutic approaches. This cross-sectional study was carried out on a single day on one of the weekdays of June 17-21, 2013. Overall, 36 ID departments from Turkey (n = 21) and France (n = 15) were involved. On the study day, 273 patients were hospitalized in Turkish and 324 patients were followed in French ID departments. The numbers of patients and beds in the hospitals, and presence of an intensive care unit (ICU) room in the ID ward was not different in both France and Turkey. Bed occupancy in the ID ward, single rooms, and negative pressure rooms were significantly higher in France. The presence of a laboratory inside the ID ward was more common in Turkish ID wards. The configuration of infection control committees, and their qualifications and surveillance types were quite similar in both countries. Although differences existed based on epidemiology, the distribution of infections were uniform on both sides. In Turkey, anti-Gram-positive agents, carbapenems, and tigecycline, and in France, cephalosporins, penicillins, aminoglycosides, and metronidazole were more frequently preferred. Enteric Gram-negatives and hepatitis B and C were more frequent in Turkey, while human immunodeficiency virus (HIV) and streptococci were more common in France (p < 0.05 for all significances). Various differences and similarities existed in France and Turkey in the ID wards. However, the current scene is that ID are managed with high standards in both countries.

Left ventricular strain and strain rate by two-dimensional speckle tracking echocardiography in patients with subclinical hypothyroidism

AIM

Subclinical hypothyroidism (SH) is an asymptomatic condition defined by increased serum thyroid-stimulating hormone (TSH) with normal free thyroid hormone levels. Heart is a major target organ for thyroid hormone action. The aim of this study was to evaluate cardiac functions in patients with SH by speckle tracking imaging.

PATIENTS AND METHODS

We included 23 consecutive patients with untreated SH (Group A; 7 male, mean age: 40.9±1.6 years) and 21 patients with treated SH (Group B; 6 male, mean age: 40.2±2.1 years). The control group included 25 healthy volunteers (8 male, mean age: 39.9±2.8 years). Left ventricular (LV) functions were assessed with speckle tracking imaging.

RESULTS

Age and sex distributions were similar among the groups. Mean serum TSH and free T4 levels were 11.7±2.9 µIU/mL, 1.16±0.06 ng/dL for group A; 2.6±0.3 µIU/mL, 1.35±0.09 ng/dL for group B; 1.4±0.3 µIU/mL, 1.31±0.09 ng/dL for controls, respectively (p = 0.001, p = 0.122). The untreated SH patients had significantly lower LV strain and strain rate values compared to controls. The treated SH patients had higher LV strain and strain rate values compared to untreated SH patients although the difference was not statistically significant. The treated SH patients had lower LV strain and strain rate values compared to controls but the difference was not statistically significant.

CONCLUSIONS

Untreated SH is associated with impairment in LV longitudinal myocardial function. Speckle tracking echocardiography appears to be useful both for early detection of LV impairment in patients with SH and documentation of improvement in myocardial deformation parameters with treatment.