Does Facebook Use Provide Social Benefits to Adults with Traumatic Brain Injury?

Drawing on the social compensation hypothesis, this study investigates whether Facebook use facilitates social connectedness for individuals with traumatic brain injury (TBI), a common and debilitating medical condition that often results in social isolation. In a survey (N = 104 participants; n = 53 with TBI, n = 51 without TBI), individuals with TBI reported greater preference for self-disclosure on Facebook (vs. face-to-face) compared to noninjured individuals. For noninjured participants, a preference for Facebook self-disclosure was associated with the enactment of relational maintenance behaviors on Facebook, which was then associated with greater closeness with Facebook friends. However, no such benefits emerged for individuals with TBI, whose preference for Facebook self-disclosure was not associated with relationship maintenance behaviors on Facebook, and did not lead to greater closeness with Facebook friends. These findings show that the social compensation hypothesis has partial utility in the novel context of TBI, and suggest the need for developing technological supports to assist this vulnerable population on social media platforms.

Manually Acquiring Targets From Multiple Viewpoints Using Video Feedback

OBJECTIVE

The effect of camera viewpoint was studied when performing visually obstructed psychomotor targeting tasks.

BACKGROUND

Previous research in laparoscopy and robotic teleoperation found that complex perceptual-motor adaptations associated with misaligned viewpoints corresponded to degraded performance in manipulation. Because optimal camera positioning is often unavailable in restricted environments, alternative viewpoints that might mitigate performance effects are not obvious.

METHODS

A virtual keyboard-controlled targeting task was remotely distributed to workers of Amazon Mechanical Turk. The experiment was performed by 192 subjects for a static viewpoint with independent parameters of target direction, Fitts' law index of difficulty, viewpoint azimuthal angle (AA), and viewpoint polar angle (PA). A dynamic viewpoint experiment was also performed by 112 subjects in which the viewpoint AA changed after every trial.

RESULTS

AA and target direction had significant effects on performance for the static viewpoint experiment. Movement time and travel distance increased while AA increased until there was a discrete improvement in performance for 180°. Increasing AA from 225° to 315° linearly decreased movement time and distance. There were significant main effects of current AA and magnitude of transition for the dynamic viewpoint experiment. Orthogonal direction and no-change viewpoint transitions least affected performance.

CONCLUSIONS

Viewpoint selection should aim to minimize associated rotations within the manipulation plane when performing targeting tasks whether implementing a static or dynamic viewing solution. Because PA rotations had negligible performance effects, PA adjustments may extend the space of viable viewpoints.

APPLICATIONS

These results can inform viewpoint selection for visual feedback during psychomotor tasks.

Human Robot Collaboration for Enhancing Work Activities

OBJECTIVE

Trade-offs between productivity, physical workload (PWL), and mental workload (MWL) were studied when integrating collaborative robots (cobots) into existing manual work by optimizing the allocation of tasks.

BACKGROUND

As cobots become more widely introduced in the workplace and their capabilities greatly improved, there is a need to consider how they can best help their human partners.

METHODS

A theoretical data-driven analysis was conducted using the O*NET Content Model to evaluate 16 selected jobs for associated work context, skills, and constraints. Associated work activities were ranked by potential for substitution by a cobot. PWL and MWL were estimated using variables from the O*Net database that represent variables for the Strain Index and NASA-TLX. An algorithm was developed to optimize work activity assignment to cobots and human workers according to their most suited abilities.

RESULTS

Human workload for some jobs decreased while workload for some jobs increased after cobots were reassigned tasks, and residual human capacity was used to perform job activities designated the most important to increase productivity. The human workload for other jobs remained unchanged.

CONCLUSIONS

The changes in human workload from the introduction of cobots may not always be beneficial for the human worker unless trade-offs are considered.Application: The framework of this study may be applied to existing jobs to identify the relationship between productivity and worker tolerances that integrate cobots into specific tasks.

Facial affect recognition in context in adults with and without TBI

Introduction

Several studies have reported impaired emotion recognition in adults with traumatic brain injury (TBI), but studies have two major design features that limit application of results to real-world contexts: (1) participants choose from among lists of basic emotions, rather than generating emotion labels, and (2) images are typically presented in isolation rather than in context. To address these limitations, we created an open-labeling task with faces shown alone or in real-life scenes, to more closely approximate how adults with TBI label facial emotions beyond the lab.

Methods

Participants were 55 adults (29 female) with moderate to severe TBI and 55 uninjured comparison peers, individually matched for race, sex, and age. Participants viewed 60 photographs of faces, either alone or in the pictured person's real-life context, and were asked what that person was feeling. We calculated the percent of responses that were standard forced-choice-task options, and also used sentiment intensity analysis to compare verbal responses between the two groups. We tracked eye movements for a subset of participants, to explore whether gaze duration or number of fixations helped explain any group differences in labels.

Results

Over 50% of responses in both groups were words other than basic emotions on standard affect tasks, highlighting the importance of eliciting open-ended responses. Valence of labels by participants with TBI was attenuated relative to valence of Comparison group labels, i.e., TBI group responses were less positive to positive images and the same was true for negative images, although the TBI group responses had higher lexical diversity. There were no significant differences in gaze duration or number of fixations between groups.

Discussion

Results revealed qualitative differences in affect labels between adults with and without TBI that would not have emerged on standard forced-choice tasks. Verbal differences did not appear to be attributable to differences in gaze patterns, leaving open the question of mechanisms of atypical affect processing in adults with TBI.

Emotion recognition of faces and emoji in individuals with moderate-severe traumatic brain injury

BACKGROUND

Facial emotion recognition deficits are common after moderate-severe traumatic brain injury (TBI) and linked to poor social outcomes. We examine whether emotion recognition deficits extend to facial expressions depicted by emoji.

METHODS

Fifty-one individuals with moderate-severe TBI (25 female) and fifty-one neurotypical peers (26 female) viewed photos of human faces and emoji. Participants selected the best-fitting label from a set of basic emotions (anger, disgust, fear, sadness, neutral, surprise, happy) or social emotions (embarrassed, remorseful, anxious, neutral, flirting, confident, proud).

RESULTS

We analyzed the likelihood of correctly labeling an emotion by group (neurotypical, TBI), stimulus condition (basic faces, basic emoji, social emoji), sex (female, male), and their interactions. Participants with TBI did not significantly differ from neurotypical peers in overall emotion labeling accuracy. Both groups had poorer labeling accuracy for emoji compared to faces. Participants with TBI (but not neurotypical peers) had poorer accuracy for labeling social emotions depicted by emoji compared to basic emotions depicted by emoji. There were no effects of participant sex.

DISCUSSION

Because emotion representation is more ambiguous in emoji than human faces, studying emoji use and perception in TBI is an important consideration for understanding functional communication and social participation after brain injury.

Faces synchronize when communication through spoken language is prevented

Cooperating with another person requires communicating intentions and coordinating behavior. People often accomplish these tasks using spoken language, but verbal communication is not always available. Here, we test the hypothesis that, to establish successful cooperative interaction, people compensate for the temporary loss of one means, verbal communication, by amplifying another, namely nonverbal expressive synchrony. Fifty-seven female dyads, half of whom were prevented from using spoken language, completed four cooperative tasks, two of which induced expressions of emotion, while their faces were filmed. The no-language dyads displayed more facial-expressive synchrony, quantified using a novel application of multidimensional dynamic time warping. We find that solutions to coordinating interaction solved by spoken language can be compensated for by synchronizing facial expressions. The findings also point to one social force-the lack of shared language-that might, in the long-term, select for cultures of increased nonverbal expressiveness and synchrony. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Designing evidence-based support aids for social media access for individuals with moderate-severe traumatic brain injury: A preliminary acceptability study

Background

Adults with traumatic brain injury (TBI) report significant barriers to using current social media platforms, including cognitive overload and challenges in interpreting social cues. Rehabilitation providers may be tasked with helping to address these barriers.

Objectives

To develop technological supports to increase social media accessibility for people with TBI-related cognitive impairments and to obtain preliminary data on the perceived acceptability, ease of use, and utility of proposed technology aids.

Methods

We identified four major barriers to social media use among individuals with TBI: sensory overload, memory impairments, misreading of social cues, and a lack of confidence to actively engage on social media platforms. We describe the process of developing prototypes of support aids aimed at reducing these specific social media barriers. We created mock-ups of these prototypes and asked 46 community-dwelling adults with TBI (24 females) to rate the proposed aids in terms of their acceptability, ease of use, and utility.

Results

Across all aids, nearly one-third of respondents agreed they would use the proposed aids frequently, and the majority of respondents rated the proposed aids as easy to use. Respondents indicated that they would be more likely to use the memory and post-writing aids than the attention and social cue interpretation aids.

Conclusions

Findings provide initial support for social-media-specific technology aids to support social media access and social participation for adults with TBI. Results from this study have design implications for future development of evidence-based social media support aids. Future work should develop and deploy such aids and investigate user experience.

Facebook Experiences of Users With Traumatic Brain Injury: A Think-Aloud Study

BACKGROUND

A critical gap in our knowledge about social media is whether we can alleviate accessibility barriers and challenges for individuals with traumatic brain injury (TBI), to improve their social participation and health. To do this, we need real-time information about these barriers and challenges, to design appropriate aids.

OBJECTIVE

The aim of this study was to characterize the ways people with TBI accessed and used social media websites and understand unique challenges they faced.

METHODS

We invited 8 adults with moderate to severe TBI to log onto their own Facebook page and use it as they regularly would while thinking aloud. Their comments were recorded and transcribed for qualitative analysis. We first analyzed participants' utterances using a priori coding based on a framework proposed by Meshi et al to classify adults' motives for accessing social media. We next used an open coding method to understand the challenges that people with TBI faced while using Facebook. In other words, we analyzed participants' needs for using Facebook and then identified Facebook features that made it challenging for them to meet those needs.

RESULTS

Participants used all categories of codes in the framework by Meshi et al and provided detailed feedback about the Facebook user interface. A priori coding revealed 2 dimensions that characterized participants' Facebook use: whether they were active or passive about posting and self-disclosure on Facebook and their familiarity and fluency in using Facebook. The open coding analysis revealed 6 types of challenges reported by participants with TBI, including difficulty with language production and interpretation, attention and information overload, perceptions of negativity and emotional contagion, insufficient guidance to use Facebook, concerns about web-based scams and frauds, and general accessibility concerns.

CONCLUSIONS

Results showed that individuals with TBI used Facebook for the same reasons typical adults do, suggesting that it can help increase social communication and reduce isolation and loneliness. Participants also identified barriers, and we propose modifications that could improve access for individuals with brain injury. On the basis of identified functions and challenges, we conclude by proposing design ideas for social media support tools that can promote more active use of social media sites by adults with TBI.

Risk assessment in inoperable chronic thromboembolic pulmonary hypertension

Background

Our objective was to investigate an abbreviated version of the the current European PH guidelines, noninvasive French model, an abridged version of the REVEAL 2.0 risk score calculator, REVEAL Lite 2, and a refined 4-strata risk assessment model, COMPERA 2.0 for inoperable chronic thromboembolic pulmonary hypertension (CTEPH).

Methods

We enrolled inoperable CTEPH patients from 8 PAH centers from December 2009 to June 2020 (n=123). 70% of patients were treated with PAH therapies. Noninvasive French model comprising WHO functional class (FC), 6-minute walk distance (6 MWD), and N-terminal pro–brain natriuretic peptide (NT-pro BNP) or BNP was used for 63 patients. REVEAL Lite 2 including FC, systolic blood pressure, heart rate, 6MWD, BNP/NT-pro BNP, and estimated glomerular filtration rate was used for 71 patients. COMPERA 2.0 including FC, 6MWD and BNP/NT-pro BNP was used for 71 patients. Patients were grouped into three categories according to the French model and REVEAL Lite 2 scores, and into four categories according to COMPERA 2.0. Kaplan-Meier (KM) survival was assessed in each risk group with all-cause mortality as the end point. Log-rank test was used to compare estimates.

Results

The mean age was 64±13 years at diagnosis. The median follow-up was 22.7 months. 26 patients had died. None of the patients had balloon pulmonary angioplasty. Most patients had received monotherapy (55%). 23.8% of patients were WHO FC I-II, 65.6% III, and 10.7% IV at initial evaluation (Table 1). All models discriminated risk in our cohort. Patients having none of low-risk criteria or high risk profiles by REVEAL Lite 2 and COMPERA 2.0 at follow-up had the worst survival. Figure 1 demonstrates KM survival curves for noninvasive French model (A), REVEAL Lite 2 (B), and COMPERA 2.0 (C). 37.3% of patients achieved 2 or more low risk criteria at follow-up. 44.8% of patients were in low risk at follow-up (REVEAL lite 2). 52.1% of patients were in low and intermediate-low risk at follow-up (COMPERA 2.0). The estimated survival rate at 5 years of patients meeting 2 and more low-risk criteria was 86% vs. 55% for patients meeting 0 low-risk criterion (p=0.04). The corresponding survival rate was 45% for high-risk patient, 79% for intermediate-risk patient, and 82% for low-risk patient (REVEAL lite 2) (p=0.029). The corresponding survival rates were 51.1% for high-risk patient and 91.6% for intermediate-low risk patient (COMPERA 2.0) (p=0.017). COMPERA 2.0 seems more accurate based on c-index. Survival was similar between patients treated and not treated with PAH therapies (p=0.735).

Conclusions

Noninvasive French model, REVEAL Lite 2, and COMPERA 2.0 may provide a simplified method of risk assessment for inoperable CTEPH. This analysis also supports the value of goal-oriented treatment in CTEPH. Patients who have not achieved low risk category at follow-up may benefit from escalation of their treatment regimen.

Funding Acknowledgement

Type of funding sources: None.

Human-machine teaming is key to AI adoption: clinicians' experiences with a deployed machine learning system

While a growing number of machine learning (ML) systems have been deployed in clinical settings with the promise of improving patient care, many have struggled to gain adoption and realize this promise. Based on a qualitative analysis of coded interviews with clinicians who use an ML-based system for sepsis, we found that, rather than viewing the system as a surrogate for their clinical judgment, clinicians perceived themselves as partnering with the technology. Our findings suggest that, even without a deep understanding of machine learning, clinicians can build trust with an ML system through experience, expert endorsement and validation, and systems designed to accommodate clinicians’ autonomy and support them across their entire workflow.

Using Smart Displays to Implement an eHealth System for Older Adults With Multiple Chronic Conditions: Protocol for a Randomized Controlled Trial

Background

Voice-controlled smart speakers and displays have a unique but unproven potential for delivering eHealth interventions. Many laptop- and smartphone-based interventions have been shown to improve multiple outcomes, but voice-controlled platforms have not been tested in large-scale rigorous trials. Older adults with multiple chronic health conditions, who need tools to help with their daily management, may be especially good candidates for interventions on voice-controlled devices because these patients often have physical limitations, such as tremors or vision problems, that make the use of laptops and smartphones challenging.

Objective

The aim of this study is to assess whether participants using an evidence-based intervention (ElderTree) on a smart display will experience decreased pain interference and improved quality of life and related measures in comparison with participants using ElderTree on a laptop and control participants who are given no device or access to ElderTree.

Methods

A total of 291 adults aged ≥60 years with chronic pain and ≥3 additional chronic conditions will be recruited from primary care clinics and community organizations and randomized 1:1:1 to ElderTree access on a smart display along with their usual care, ElderTree access on a touch screen laptop along with usual care, or usual care alone. All patients will be followed for 8 months. The primary outcomes are differences between groups in measures of pain interference and psychosocial quality of life. The secondary outcomes are between-group differences in system use at 8 months, physical quality of life, pain intensity, hospital readmissions, communication with medical providers, health distress, well-being, loneliness, and irritability. We will also examine mediators and moderators of the effects of ElderTree on both platforms. At baseline, 4 months, and 8 months, patients will complete written surveys comprising validated scales selected for good psychometric properties with similar populations. ElderTree use data will be collected continuously in system logs. We will use linear mixed-effects models to evaluate outcomes over time, with treatment condition and time acting as between-participant factors. Separate analyses will be conducted for each outcome.

Results

Recruitment began in August 2021 and will run through April 2023. The intervention period will end in December 2023. The findings will be disseminated via peer-reviewed publications.

Conclusions

To our knowledge, this is the first study with a large sample and long time frame to examine whether a voice-controlled smart device can perform as well as or better than a laptop in implementing a health intervention for older patients with multiple chronic health conditions. As patients with multiple conditions are such a large cohort, the implications for cost as well as patient well-being are significant. Making the best use of current and developing technologies is a critical part of this effort.

Trial Registration

ClinicalTrials.gov NCT04798196; https://clinicaltrials.gov/ct2/show/NCT04798196

International Registered Report Identifier (IRRID)

PRR1-10.2196/37522

Assessing limited visibility feedback for overhead manufacturing assembly tasks

Worker posture, task time and performance are often affected when one-handed manual dexterous tasks are performed in small overhead spaces under an obscured view. A common method used for supplementing visual feedback in these cases is a hand-held telescopic mirror, but that involves working with both arms extended overhead, and is often accompanied by awkward neck and shoulder postures. A video camera was considered as an alternative to using a mirror for visual feedback and reducing overhead reach. A mirror, a borescope and an omnidirectional camera were evaluated while laboratory participants performed three one-handed simulated manufacturing tasks in a small overhead enclosure. Videos were recorded for quantifying the time that postures were assumed while performing the tasks. The average time that both arms were above mid-shoulder height for the omnidirectional camera was more than 2.5 times less than for the mirror and borescope. The average proportion of neck strain time was 0.01% (or less) for both the omnidirectional camera and the borescope, compared to 83.68% for the mirror. No significant differences were observed in task completion times between the three modalities. Hence, an omnidirectional camera can provide visibility while reducing straining postures for manufacturing operations involving overhead work.

Task-Level Authoring for Remote Robot Teleoperation

Remote teleoperation of robots can broaden the reach of domain specialists across a wide range of industries such as home maintenance, health care, light manufacturing, and construction. However, current direct control methods are impractical, and existing tools for programming robot remotely have focused on users with significant robotic experience. Extending robot remote programming to end users, i.e., users who are experts in a domain but novices in robotics, requires tools that balance the rich features necessary for complex teleoperation tasks with ease of use. The primary challenge to usability is that novice users are unable to specify complete and robust task plans to allow a robot to perform duties autonomously, particularly in highly variable environments. Our solution is to allow operators to specify shorter sequences of high-level commands, which we call task-level authoring, to create periods of variable robot autonomy. This approach allows inexperienced users to create robot behaviors in uncertain environments by interleaving exploration, specification of behaviors, and execution as separate steps. End users are able to break down the specification of tasks and adapt to the current needs of the interaction and environments, combining the reactivity of direct control to asynchronous operation. In this paper, we describe a prototype system contextualized in light manufacturing and its empirical validation in a user study where 18 participants with some programming experience were able to perform a variety of complex telemanipulation tasks with little training. Our results show that our approach allowed users to create flexible periods of autonomy and solve rich manipulation tasks. Furthermore, participants significantly preferred our system over comparative more direct interfaces, demonstrating the potential of our approach for enabling end users to effectively perform remote robot programming.

Computer-Mediated Communication in Adults With and Without Moderate-to-Severe Traumatic Brain Injury: Survey of Social Media Use

BACKGROUND

Individuals with a history of traumatic brain injury (TBI) report fewer social contacts, less social participation, and more social isolation than noninjured peers. Cognitive-communication disabilities may prevent individuals with TBI from accessing the opportunities for social connection afforded by computer-mediated communication, as individuals with TBI report lower overall usage of social media than noninjured peers and substantial challenges with accessibility and usability. Although adaptations for individuals with motor and sensory impairments exist to support social media use, there have been no parallel advances to support individuals with cognitive disabilities, such as those exhibited by some people with TBI. In this study, we take a preliminary step in the development process by learning more about patterns of social media use in individuals with TBI as well as their input and priorities for developing social media adaptations.

OBJECTIVE

This study aims to characterize how and why adults with TBI use social media and computer-mediated communication platforms, to evaluate changes in computer-mediated communication after brain injury, and to elicit suggestions from individuals with TBI to improve access to social media after injury.

METHODS

We conducted a web-based survey of 53 individuals with a chronic history of moderate-to-severe TBI and a demographically matched group of 51 noninjured comparison peers.

RESULTS

More than 90% of participants in both groups had an account on at least one computer-mediated communication platform, with Facebook and Facebook Messenger being the most popular platforms in both groups. Participants with and without a history of TBI reported that they use Facebook more passively than actively and reported that they most frequently maintain web-based relationships with close friends and family members. However, participants with TBI reported less frequently than noninjured comparison participants that they use synchronous videoconferencing platforms, are connected with acquaintances on the web, or use social media as a gateway for offline social connection (eg, to find events). Of the participants with TBI, 23% (12/53) reported a change in their patterns of social media use caused by brain injury and listed concerns about accessibility, safety, and usability as major barriers.

CONCLUSIONS

Although individuals with TBI maintain social media accounts to the same extent as healthy comparisons, some may not use them in a way that promotes social connection. Thus, it is important to design social media adaptations that address the needs and priorities of individuals with TBI, so they can also reap the benefits of social connectedness offered by these platforms. By considering computer-mediated communication as part of individuals' broader social health, we may be able to increase web-based participation in a way that is meaningful, positive, and beneficial to broader social life.

Single-query Path Planning Using Sample-efficient Probability Informed Trees

In this work, we present a novel sampling-based path planning method, called SPRINT. The method finds solutions for high dimensional path planning problems quickly and robustly. Its efficiency comes from minimizing the number of collision check samples. This reduction in sampling relies on heuristics that predict the likelihood that samples will be useful in the search process. Specifically, heuristics (1) prioritize more promising search regions; (2) cull samples from local minima regions; and (3) steer the search away from previously observed collision states. Empirical evaluations show that our method finds shorter or comparable-length solution paths in significantly less time than commonly used methods. We demonstrate that these performance gains can be largely attributed to our approach to achieve sample efficiency.

Corrective Shared Autonomy for Addressing Task Variability

Many tasks, particularly those involving interaction with the environment, are characterized by high variability, making robotic autonomy difficult. One flexible solution is to introduce the input of a human with superior experience and cognitive abilities as part of a shared autonomy policy. However, current methods for shared autonomy are not designed to address the wide range of necessary corrections (e.g., positions, forces, execution rate, etc.) that the user may need to provide to address task variability. In this paper, we present corrective shared autonomy, where users provide corrections to key robot state variables on top of an otherwise autonomous task model. We provide an instantiation of this shared autonomy paradigm and demonstrate its viability and benefits such as low user effort and physical demand via a system-level user study on three tasks involving variability situated in aircraft manufacturing.

The virtual and the physical: two frames of mind

Virtual and physical embodiments of interactive artificial agents utilize similar core technologies for perception, planning, and interaction and engage with people in similar ways. Thus, designers have typically considered these embodiments to be broadly interchangeable, and the choice of embodiment primarily depends on the practical demands of an application. This paper makes the case that virtual and physical embodiments elicit fundamentally different "frames of mind" in the users of the technology and follow different metaphors for interaction, resulting in diverging expectations, forms of engagement, and eventually interaction outcomes. It illustrates these differences through the lens of five key mechanisms: "situativity, interactivity, agency, proxemics, and believability". It also outlines the design implications of the two frames of mind, arguing for different domains of interaction serving as appropriate context for virtual and physical embodiments.

Reading socially: Transforming the in-home reading experience with a learning-companion robot

Social robots hold great promise as companions and peer learners for children, yet little is known about how they can be best designed for this population, what interaction scenarios can benefit from their use, and how they might fit into learning activities and environments. We aimed to close this gap by designing a learning-companion robot to augment guided reading activity and examined the robot's impact on an in-home reading experience. In this paper, we compared the experiences of early adolescent children aged 10 to 12 years (N = 24) who completed guided reading activities either with a learning-companion robot or as a paper-based activity in a 2-week-long, in-home field study. We found similar reading frequency and duration in both conditions and that both guided reading activities were described as positive experiences that helped to build reading skill and to sustain engagement. Children who read with the learning-companion robot further reported that the activities supported reading comprehension and motivated them to read and indicated a deepening social connection (i.e., companionship or affiliation) with the robot. We conclude that, rather than the activity falling off after a novelty effect, our simple prototype social robot is capable of preserving the benefits of an existing in-home learning activity while transforming the reading experience into a valuable, social one. Our findings contribute to an understanding of how we might capitalize on the capacity of social robots to serve as a transformative learning tool as robots become more widely available to the public.

Shared control-based bimanual robot manipulation

Human-centered environments provide affordances for and require the use of two-handed, or bimanual, manipulations. Robots designed to function in, and physically interact with, these environments have not been able to meet these requirements because standard bimanual control approaches have not accommodated the diverse, dynamic, and intricate coordinations between two arms to complete bimanual tasks. In this work, we enabled robots to more effectively perform bimanual tasks by introducing a bimanual shared-control method. The control method moves the robot's arms to mimic the operator's arm movements but provides on-the-fly assistance to help the user complete tasks more easily. Our method used a bimanual action vocabulary, constructed by analyzing how people perform two-hand manipulations, as the core abstraction level for reasoning about how to assist in bimanual shared autonomy. The method inferred which individual action from the bimanual action vocabulary was occurring using a sequence-to-sequence recurrent neural network architecture and turned on a corresponding assistance mode, signals introduced into the shared-control loop designed to make the performance of a particular bimanual action easier or more efficient. We demonstrate the effectiveness of our method through two user studies that show that novice users could control a robot to complete a range of complex manipulation tasks more successfully using our method compared to alternative approaches. We discuss the implications of our findings for real-world robot control scenarios.

Age-related characteristics of infective endocarditis: prospective data from the Euro-Endo registry

Introduction

The profile of infective endocarditis (IE) is continuously evolving over time, and this may probably be partly due to increasing age of the patients.

Methods

All data were collected from the EURO-ENDO registry, which is a one-year prospective international multicentre observational survey on patients with definite or possible IE included between 2016 and 2018. Subjects were stratified into 3 groups according to their age at index hospitalization.

Results

Among the 3113 patients included, 1670 patients (54%, Young group) were <65, 1068 (34%, Medium group) between 65 and 80 and 375 (12%, Old group) ≥80 years old. The most striking age-related differences were (old group vs others) (table 1) 1) the higher comorbidity burden and Charlson index; 2) the lower rate of embolic events on admission and under therapy; 3) the higher rate of Enterocci and digestive streptococci; 4) the lower rate of surgery during acute IE despite a theoretical indication; 5) the higher in-hospital and 1-year mortality. With regards to surgery, young and medium age were predictive of more frequent performance of surgery as compared to old age (Young: OR 4.33, 95% CI [3.09–6.06], Medium: 3.62, [2.57–5.10], p<0.001). In multivariable analysis, age per se was not predictive of in-hospital and 1yr FU mortality, but lack of surgical procedures when indicated (27% of the old group), was strongly predictive.

Conclusion

This is the largest contemporary registry showing the strong influence of age on the demographic, clinical, therapeutic, and prognostic profile of IE. Non-performance of surgical procedures when indicated is frequent in old patients and is a strong predictor of mortality while age per se is not. Endocarditis Teams should take these results into account when considering surgery in elderly patients.

Funding Acknowledgement

Type of funding source: Other. Main funding source(s): EORP grant

Sex and Gender Differences in Emotion Recognition and Theory of Mind After TBI: A Narrative Review and Directions for Future Research

A growing body of literature has examined sex differences in a variety of outcomes from moderate-severe traumatic brain injury (TBI), including outcomes for social functioning. Social functioning is an area in which adults with TBI have significant long-term challenges (1-4), and a better understanding of sex and gender differences in this domain may have a significant clinical impact. This paper presents a brief narrative review of current evidence regarding sex differences in one aspect of social functioning in adults with TBI: social cognition, specifically affect recognition and Theory of Mind (ToM). Data from typical adults and adults with TBI are considered in the broader context of common stereotypes about social skills and behaviors in men vs. women. We then discuss considerations for future research on sex- and gender-based differences in social cognition in TBI, and in adults more generally.

Facial-affect recognition deficit as a predictor of different aspects of social-communication impairment in traumatic brain injury

OBJECTIVE

To examine the relationship between facial-affect recognition and different aspects of self- and proxy-reported social-communication impairment following moderate-severe traumatic brain injury (TBI).

METHOD

Forty-six adults with chronic TBI (>6 months postinjury) and 42 healthy comparison (HC) adults were administered the La Trobe Communication Questionnaire (LCQ) Self and Other forms to assess different aspects of communication competence and the Emotion Recognition Test (ERT) to measure their ability to recognize facial affects.

RESULTS

Individuals with TBI underperformed HC adults in the ERT and self-reported, as well as were reported by close others, as having more communication problems than did HC adults. TBI group ERT scores were significantly and negatively correlated with LCQ-Other (but not LCQ-Self) scores (i.e., participants with lower emotion-recognition scores were rated by close others as having more communication problems). Multivariate regression analysis revealed that adults with higher ERT scores self-reported more problems with disinhibition-impulsivity and partner sensitivity and had fewer other-reported problems with disinhibition-impulsivity and conversational effectiveness.

CONCLUSIONS

Our findings support growing evidence that emotion-recognition deficits play a role in specific aspects of social-communication outcomes after TBI and should be considered in treatment planning. (PsycINFO Database Record

Detection of text-based social cues in adults with traumatic brain injury

OBJECTIVES

Written text contains verbal immediacy cues-word form or grammatical cues that indicate positive attitude or liking towards an object, action, or person. We asked if adults with moderate-severe traumatic brain injury (TBI) would respond to these cues, given evidence of TBI-related social communication impairments.

METHODS

Sixty-nine adults with TBI and 74 healthy comparison (HC) peers read pairs of sentences containing different types of immediacy cues (e.g., speaker A said "these Canadians" vs. B said "those Canadians.") and identified which speaker (A or B) had a more positive attitude towards the underlined entity (Task 1); and pairs of sentences comprised of a context sentence (e.g., Fred is asked, "Did you visit Joan and Sue?") and a statement sentence (Fred says, "I visited Sue and Joan.") and were asked to indicate how much Fred liked or disliked the underlined words (Task 2).

RESULTS

HC group scores were significantly higher on Task 1, indicating more sensitivity to cues. On Task 2, TBI and HC group ratings differed across cue types and immediacy types, and the TBI group appeared to have less sensitivity to these cues.

CONCLUSIONS

Findings suggest that TBI-related impairments may reduce sensitivity to subtle social cues in text.

Characterizing computer-mediated communication, friendship, and social participation in adults with traumatic brain injury

BACKGROUND

Adults with traumatic brain injury (TBI) report loss of friendship and reduced social participation after injury, but there is limited information regarding quantity of friends and methods of communication. Our objective was to characterize friendship networks, social participation, and methods of communication, including computer-mediated communication (CMC), used by adults with TBI compared to uninjured adults.

METHODS

Participants were 25 adults with TBI and 26 uninjured healthy comparisons (HC) adults, who completed the Participation Assessment with Recombined Tools-Objective (PART-O) and the Social Network Questionnaire (SNQ).

RESULTS

Adults with TBI had significantly fewer total friends and significantly lower levels of productivity and overall social participation. Face-to-face interaction was the preferred method of contact for both groups. Adults with TBI were significantly less likely to use texting as a primary method of communication than their uninjured peers, but used other methods of communication at similar rates.

CONCLUSION

Our study supports prior findings of reduced friendships and reduced social participation after TBI and adds new information about similarities and differences in communication methods between adults with and without TBI.

Facial emotion recognition of older adults with traumatic brain injury

OBJECTIVES

The objective of this study was to examine the effects of traumatic brain injury (TBI) and age on facial emotion recognition abilities in adults. Age and TBI were expected to have negative effects on emotion recognition and a TBI by age interaction was hypothesized such that older adults with TBI would have the lowest emotion recognition scores.

METHODS

A prospective cohort study was conducted. Participants were 26 adults with moderate-severe TBI (13 older and 13 younger) and 26 uninjured peers matched for age, sex, and education. Emotion recognition was measured using the Emotion Recognition Task, which is comprised of dynamically morphed facial expressions of the six basic emotions, presented at different intensity levels.

RESULTS

TBI and older age were associated with poorer recognition of both subtle and intense expressions, but only for expressions of anger and sadness. There was no interaction of age and TBI.

CONCLUSIONS

Results add to the growing evidence of emotion recognition impairments after TBI, particularly for select negative emotions, and extend this finding to adults over the age of 60. Further research is needed to better understand social cognitive effects of TBI across the adult lifespan.

Friendship Quality, Friendship Quantity, and Social Participation in Adults with Traumatic Brain Injury

Adults with traumatic brain injury (TBI) often report reduced social participation and loss of friends, but little is known about quality of friendship after TBI. Our objective was to characterize social participation, friendship quantity, and friendship quality of adults with TBI and a comparison group of uninjured adults. Participants included 18 adults with moderate to severe TBI and 16 of their informant friends; and 18 uninjured adults and 11 of their informant friends. The main measures used were the Participation Assessment with Recombined Tools-Objective, the Social Network Questionnaire, and the McGill Friendship Questionnaire. Participants with TBI reported significantly less social participation and had fewer total friends, although this difference was not statistically significant. Adults with TBI differed from their friends on one measure of friendship quality, but reports for friendship quality were high in both groups. Adults with TBI reported overall high levels of friendship quality despite having lower levels of social participation compared with uninjured adults. Future research should investigate how the balance of quantity and quality of friendships relates to satisfaction with social participation and overall quality of life.

Social-cue perception and mentalizing ability following traumatic brain injury: A human-robot interaction study

PRIMARY OBJECTIVE

Research studies and clinical observations of individuals with traumatic brain injury (TBI) indicate marked deficits in mentalizing-perceiving social information and integrating it into judgements about the affective and mental states of others. The current study investigates social-cognitive mechanisms that underlie mentalizing ability to advance our understanding of social consequences of TBI and inform the development of more effective clinical interventions.

RESEARCH DESIGN

The study followed a mixed-design experiment, manipulating the presence of a mentalizing gaze cue across trials and participant population (TBI vs. healthy comparisons).

METHODS AND PROCEDURES

Participants, 153 adults, 74 with moderate-severe TBI and 79 demographically matched healthy comparison peers, were asked to judge a humanoid robot's mental state based on precisely controlled gaze cues presented by the robot and apply those judgements to respond accurately on the experimental task.

MAIN OUTCOMES AND RESULTS

Results showed that, contrary to our hypothesis, the social cues improved task performance in the TBI group but not the healthy comparison group.

CONCLUSIONS

Results provide evidence that, in specific contexts, individuals with TBI can perceive, correctly recognize, and integrate dynamic gaze cues and motivate further research to understand why this ability may not translate to day-to-day social interactions.

A flexible optimization-based method for synthesizing intent-expressive robot arm motion

We present an approach to synthesize robot arm trajectories that effectively communicate the robot’s intent to a human collaborator while achieving task goals. Our approach uses nonlinear constrained optimization to encode task requirements and desired motion properties. Our implementation allows for a wide range of constraints and objectives. We introduce a novel objective function to optimize robot arm motions for intent-expressiveness that works in a range of scenarios and robot arm types. Our formulation supports experimentation with different theories of how viewers interpret robot motion. Through a series of human-subject experiments on real and simulated robots, we demonstrate that our method leads to improved collaborative performance against other methods, including the current state of the art. These experiments also show how our perception heuristic can affect collaborative outcomes.

White matter correlates of different aspects of facial affect recognition impairment following traumatic brain injury

Although facial affect recognition deficits are well documented in individuals with moderate-to-severe traumatic brain injury (TBI), little research has examined the neural mechanisms underlying these impairments. Here, we use diffusion tensor imaging (DTI), specifically the scalars fractional anisotropy (FA), mean diffusivity (MD), and radial diffusivity (RD), to examine relationships between regional white-matter integrity and two facial affect sub-skills: perceptual affect recognition abilities (measured by an affect matching task) and verbal categorization of facial affect (measured by an affect labeling task). Our results showed that, within the TBI group, higher levels of white-matter integrity in tracts involved in affect recognition (inferior fronto-occipital, inferior longitudinal, and uncinate fasciculi) were associated with better performance on both tasks. Verbal categorization skills were specifically and positively correlated with integrity of the left uncinate fasciculus. Moreover, we observed a striking lateralization effect, with perceptual abilities having an almost exclusive relationship with integrity of right hemisphere tracts, while verbal abilities were associated with both left and right hemisphere integrity. The findings advance our understanding of the neurobiological mechanisms that underlie subcomponents of facial affect recognition and lead to different patterns of facial affect recognition impairment in adults with TBI.

Different aspects of facial affect recognition impairment following traumatic brain injury: The role of perceptual and interpretative abilities

It is well established that many individuals with traumatic brain injury (TBI) are impaired at facial affect recognition, yet little is known about the mechanisms underlying such deficits. In particular, little work has examined whether the breakdown of facial affect recognition abilities occurs at the perceptual level (e.g., recognizing a smile) or at the verbal categorization stage (e.g., assigning the label "happy" to a smiling face). The aim of the current study was to investigate the integrity of these two distinct facial affect recognition subskills in a sample of 38 individuals with moderate-to-severe TBI and 24 demographically matched healthy individuals. Participants were administered an affect matching (perceptual skills) and an affect labeling (verbal categorization skills) task. Statistical analyses revealed that, while individuals with TBI showed significantly higher levels of impairment in the verbal categorization task than in the perceptual task, they performed less well than healthy comparison participants on both tasks. These findings indicate that facial affect recognition impairment can occur at different cognitive stages following TBI, suggesting the necessity of careful screening to offer targeted treatment. Moreover, they provide further neuropsychological evidence supporting the notion that distinct types of subskills are necessary to achieve successful recognition of facial affects.

Impaired theory of mind in adults with traumatic brain injury: A replication and extension of findings

OBJECTIVE

To replicate a previous study of Theory of Mind (ToM) task performance in adults with traumatic brain injury (TBI) under different working memory (WM) demands, and determine if there are sex-based differences in effects of WM load on ToM task performance.

METHOD

58 adults with moderate-severe TBI (24 females) and 66 uninjured adults (34 females) matched group-wise for age, sex, and education viewed a series of video vignettes from the Video Social Inference Task (VSIT) (Turkstra, 2008) and answered ToM questions. Vignette presentation format required updating and maintenance of information, and WM load was manipulated by varying presence of distracters.

RESULTS

There were main effects of group and WM load, no significant effect of sex, and a marginal interaction of group by WM load, with larger between-group differences in conditions with higher WM load. VSIT scores for the condition with the highest WM load were significantly correlated with scores on the first trial of the California Verbal Learning Test.

CONCLUSIONS

We replicated findings of lower scores in adults with TBI on a video-based ToM task, and provided additional evidence of the effect of WM load on social cognition task performance. There were no significant accuracy differences between men and women, inconsistent with prior evidence - including our own data using the same test. There is strong evidence of a female advantage on other social cognition tasks, and the parameters of this advantage remain to be discovered.

Turn-Taking and Coordination in Human-Machine Interaction

This issue of AI Magazine brings together a collection of articles on challenges, mechanisms, and research progress in turn-taking and coordination between humans and machines. The contributing authors work in interrelated fields of spoken dialog systems, intelligent virtual agents, human-computer interaction, human-robot interaction, and semiautonomous collaborative systems and explore core concepts in coordinating speech and actions with virtual agents, robots, and other autonomous systems. Several of the contributors participated in the AAAI Spring Symposium on Turn-Taking and Coordination in Human-Machine Interaction, held in March 2015, and several articles in this issue are extensions of work presented at that symposium. The articles in the collection address key modeling, methodological, and computational challenges in achieving effective coordination with machines, propose solutions that overcome these challenges under sensory, cognitive, and resource restrictions, and illustrate how such solutions can facilitate coordination across diverse and challenging domains. The contributions highlight turn-taking and coordination in human-machine interaction as an emerging and evolving research area with important implications for future applications of AI.

Predictors and Prognostic Significance of Troponin-I Release following Elective Coronary Angioplasty

The objective of this study was to investigate the predictors and prognostic significance of post-procedural cardiac troponin (cTn)-I elevations in a consecutive series of patients who underwent elective percutaneous coronary intervention (PCI). cTn-I was measured in 100 patients immediately before and within 24 h after the elective PCI. Post-procedural cTn-I elevation was observed in 27 of the 100 patients. In multivariate analysis, basal haemoglobin values and the number of repeated balloon dilatations were found to be independent predictors of cTn-I elevation. During the follow-up period of 12 ± 1.2 months, the cTn-I-positive group had more major adverse cardiovascular events than the cTn-I-negative group (33.3% versus 16.4%, respectively), but the difference was not significant. An increase in cTn-I levels following elective PCI procedures was frequent but did not predict a poor long-term outcome.

Using gaze patterns to predict task intent in collaboration

In everyday interactions, humans naturally exhibit behavioral cues, such as gaze and head movements, that signal their intentions while interpreting the behavioral cues of others to predict their intentions. Such intention prediction enables each partner to adapt their behaviors to the intent of others, serving a critical role in joint action where parties work together to achieve a common goal. Among behavioral cues, eye gaze is particularly important in understanding a person's attention and intention. In this work, we seek to quantify how gaze patterns may indicate a person's intention. Our investigation was contextualized in a dyadic sandwich-making scenario in which a "worker" prepared a sandwich by adding ingredients requested by a "customer." In this context, we investigated the extent to which the customers' gaze cues serve as predictors of which ingredients they intend to request. Predictive features were derived to represent characteristics of the customers' gaze patterns. We developed a support vector machine-based (SVM-based) model that achieved 76% accuracy in predicting the customers' intended requests based solely on gaze features. Moreover, the predictor made correct predictions approximately 1.8 s before the spoken request from the customer. We further analyzed several episodes of interactions from our data to develop a deeper understanding of the scenarios where our predictor succeeded and failed in making correct predictions. These analyses revealed additional gaze patterns that may be leveraged to improve intention prediction. This work highlights gaze cues as a significant resource for understanding human intentions and informs the design of real-time recognizers of user intention for intelligent systems, such as assistive robots and ubiquitous devices, that may enable more complex capabilities and improved user experience.

Look together: analyzing gaze coordination with epistemic network analysis

When conversing and collaborating in everyday situations, people naturally and interactively align their behaviors with each other across various communication channels, including speech, gesture, posture, and gaze. Having access to a partner's referential gaze behavior has been shown to be particularly important in achieving collaborative outcomes, but the process in which people's gaze behaviors unfold over the course of an interaction and become tightly coordinated is not well understood. In this paper, we present work to develop a deeper and more nuanced understanding of coordinated referential gaze in collaborating dyads. We recruited 13 dyads to participate in a collaborative sandwich-making task and used dual mobile eye tracking to synchronously record each participant's gaze behavior. We used a relatively new analysis technique—epistemic network analysis—to jointly model the gaze behaviors of both conversational participants. In this analysis, network nodes represent gaze targets for each participant, and edge strengths convey the likelihood of simultaneous gaze to the connected target nodes during a given time-slice. We divided collaborative task sequences into discrete phases to examine how the networks of shared gaze evolved over longer time windows. We conducted three separate analyses of the data to reveal (1) properties and patterns of how gaze coordination unfolds throughout an interaction sequence, (2) optimal time lags of gaze alignment within a dyad at different phases of the interaction, and (3) differences in gaze coordination patterns for interaction sequences that lead to breakdowns and repairs. In addition to contributing to the growing body of knowledge on the coordination of gaze behaviors in joint activities, this work has implications for the design of future technologies that engage in situated interactions with human users.

Gaze and Attention Management for Embodied Conversational Agents

To facilitate natural interactions between humans and embodied conversational agents (ECAs), we need to endow the latter with the same nonverbal cues that humans use to communicate. Gaze cues in particular are integral in mechanisms for communication and management of attention in social interactions, which can trigger important social and cognitive processes, such as establishment of affiliation between people or learning new information. The fundamental building blocks of gaze behaviors are gaze shifts : coordinated movements of the eyes, head, and body toward objects and information in the environment. In this article, we present a novel computational model for gaze shift synthesis for ECAs that supports parametric control over coordinated eye, head, and upper body movements. We employed the model in three studies with human participants. In the first study, we validated the model by showing that participants are able to interpret the agent’s gaze direction accurately. In the second and third studies, we showed that by adjusting the participation of the head and upper body in gaze shifts, we can control the strength of the attention signals conveyed, thereby strengthening or weakening their social and cognitive effects. The second study shows that manipulation of eye--head coordination in gaze enables an agent to convey more information or establish stronger affiliation with participants in a teaching task, while the third study demonstrates how manipulation of upper body coordination enables the agent to communicate increased interest in objects in the environment.

The features of infectious diseases departments and anti-infective practices in France and Turkey: a cross-sectional study

The aim of this study was to assess the infectious diseases (ID) wards of tertiary hospitals in France and Turkey for technical capacity, infection control, characteristics of patients, infections, infecting organisms, and therapeutic approaches. This cross-sectional study was carried out on a single day on one of the weekdays of June 17-21, 2013. Overall, 36 ID departments from Turkey (n = 21) and France (n = 15) were involved. On the study day, 273 patients were hospitalized in Turkish and 324 patients were followed in French ID departments. The numbers of patients and beds in the hospitals, and presence of an intensive care unit (ICU) room in the ID ward was not different in both France and Turkey. Bed occupancy in the ID ward, single rooms, and negative pressure rooms were significantly higher in France. The presence of a laboratory inside the ID ward was more common in Turkish ID wards. The configuration of infection control committees, and their qualifications and surveillance types were quite similar in both countries. Although differences existed based on epidemiology, the distribution of infections were uniform on both sides. In Turkey, anti-Gram-positive agents, carbapenems, and tigecycline, and in France, cephalosporins, penicillins, aminoglycosides, and metronidazole were more frequently preferred. Enteric Gram-negatives and hepatitis B and C were more frequent in Turkey, while human immunodeficiency virus (HIV) and streptococci were more common in France (p < 0.05 for all significances). Various differences and similarities existed in France and Turkey in the ID wards. However, the current scene is that ID are managed with high standards in both countries.

Left ventricular strain and strain rate by two-dimensional speckle tracking echocardiography in patients with subclinical hypothyroidism

AIM

Subclinical hypothyroidism (SH) is an asymptomatic condition defined by increased serum thyroid-stimulating hormone (TSH) with normal free thyroid hormone levels. Heart is a major target organ for thyroid hormone action. The aim of this study was to evaluate cardiac functions in patients with SH by speckle tracking imaging.

PATIENTS AND METHODS

We included 23 consecutive patients with untreated SH (Group A; 7 male, mean age: 40.9±1.6 years) and 21 patients with treated SH (Group B; 6 male, mean age: 40.2±2.1 years). The control group included 25 healthy volunteers (8 male, mean age: 39.9±2.8 years). Left ventricular (LV) functions were assessed with speckle tracking imaging.

RESULTS

Age and sex distributions were similar among the groups. Mean serum TSH and free T4 levels were 11.7±2.9 µIU/mL, 1.16±0.06 ng/dL for group A; 2.6±0.3 µIU/mL, 1.35±0.09 ng/dL for group B; 1.4±0.3 µIU/mL, 1.31±0.09 ng/dL for controls, respectively (p = 0.001, p = 0.122). The untreated SH patients had significantly lower LV strain and strain rate values compared to controls. The treated SH patients had higher LV strain and strain rate values compared to untreated SH patients although the difference was not statistically significant. The treated SH patients had lower LV strain and strain rate values compared to controls but the difference was not statistically significant.

CONCLUSIONS

Untreated SH is associated with impairment in LV longitudinal myocardial function. Speckle tracking echocardiography appears to be useful both for early detection of LV impairment in patients with SH and documentation of improvement in myocardial deformation parameters with treatment.