Multimodal Communication in Aphasia: Perception and Production of Co-speech Gestures During Face-to-Face Conversation

Communication strategies for adults in palliative care: the speech-language therapists' perspective

BACKGROUND

Communication disorders are a challenge that many patients in palliative care (PC) may encounter. This intervention area is emerging for the speech-language therapist (SLT), the professional who works in preventing, assessing, diagnosing, and treating human communication disorders. This study aims to identify and classify the communication strategies considered most important by SLTs for use in PC and evaluate whether there are any differences in perception regarding the importance of strategies between SLTs with and without PC experience.

METHODS

This cross-sectional quantitative study was conducted using a survey, which employed a well-structured, self-completion questionnaire previously validated by a panel of experts with over six years of PC experience.

RESULTS

The strategies rated as most important within each group were the following: (i) adjust the patient's position and minimise environmental noise; (ii) establish eye contact and adjust the pace of speech; (iii) adjust the language level and raise one topic at a time; (iv) use images of the patient's interests and their personal objects; (v) use orality and multimodal form; (vi) use simplified language and structured pauses; and (vii) use tables with images and books with pictures.

CONCLUSIONS

Verbal and non-verbal strategies were rated as highly important. There was no evidence of differences in perception in terms of importance between the SLTs with or without experience in PC, but more studies are needed to support this aspect. The patient's communication ability is one of the cornerstones of PC quality. Through their actions, speech-language professionals could empower the patient with strategies so that they can autonomously and self-determinedly express their experiences and most significant needs.

Development of Self-made Gestures as an Adaptive Strategy for Communication in an Individual With Childhood Apraxia of Speech

Individuals with childhood apraxia of speech often exhibit greater difficulty with expressive language than with receptive language. As a result, they may benefit from alternative modes of communication. Here, we present a patient with childhood apraxia of speech who used pointing as a means of communication at age 2 ¼ years and self-made gestures at age 3½, when he had severe difficulties speaking in spite of probable normal comprehension abilities. His original gestures included not only word-level expressions, but also sentence-length ones. For example, when expressing "I am going to bed," he pointed his index finger at himself (meaning I ) and then put both his hands together near his ear ( sleep ). When trying to convey the meaning of "I enjoyed the meal and am leaving," he covered his mouth with his right hand ( delicious ), then joined both of his hands in front of himself ( finish ) and finally waved his hands ( goodbye ). These original gestures and pointing peaked at the age of 4 and then subsided and completely disappeared by the age of 7, when he was able to make himself understood to some extent with spoken words. The present case demonstrates an adaptive strategy for communication that might be an inherent competence for human beings.

Looking at gesture: The reciprocal influence between gesture and conversation

INTRODUCTION

There is limited research in group communication treatment for people with aphasia but existing studies report benefits of gesture to support conversation. Gesture supports conversation through recipient design features and reducing linguistic demands of lexical retrieval and formulation. Additionally, gesture serves an affiliative function. However, the relationship between gesture use and gestural capacity has not been widely examined. As part of a larger study on group cohesiveness and conversation, this investigation examined the patterns of co-speech gesture within authentic conversations among persons with aphasia to discern the functions of gesture use for the participants, changes in the use of gesture over time, and the relationship between gesture use and gesture ability.

METHODS

Conversation Analysis (CA) was applied in an embedded case-study design. Three participants received an academic semester of group and individual conversation-based treatment according to Facilitating Authentic Conversation (Damico et al., 2015). Four conversations from the treatment were selected and transcribed for multi-modality communication with CA conventions applied, and then cyclically analysed for patterns of gesture.

RESULTS

Participants demonstrated gesture that served social and linguistic functions: ratifying clinicians' proxy turns, turn-allocation, turn repair, relaying novel visual information, emphasizing content, demonstrating affiliation with the prior speaker, demonstrating their assessment others' talk, and demonstrating humor. All three participants showed an increased rate of gesture per turn and increasingly used gesture to repair conversation breakdown. Increased gesture use over the course of the semester coincided with increased scores for pantomime on the Porch Index of Communicative Ability (Porch, 1981, PICA).

CONCLUSION

Individuals with aphasia demonstrated increased use of gesture for varied purposes and improved gestural processing following a semester of conversation-based treatment. This is significant because gesture is an effective support for the repair of conversation breakdown typical of persons with aphasia.

Multimodal communication reported by familiar caregivers to build communication capacity in persons who are minimally conscious

PURPOSE

Limited clinical and research evidence is available to support healthcare practitioners in the communication assessment and intervention of persons who are minimally conscious. This study placed a specific focus on the multimodal communication strategies familiar caregivers of persons who are minimally conscious observed, as well as the verbal and the nonverbal communication strategies they employed to build communication capacity. This may inform clinical practice as it provides valuable autobiographical information as well as familiar stimuli that may elicit responses from persons in a minimally conscious state.

METHOD

A descriptive qualitative design employing in-depth semi-structured interviews with familiar caregivers was utilised to address the purpose of the study.

RESULT

Familiar caregivers reported that they used both nonverbal and verbal communication strategies to obtain a response from persons who are minimally conscious. These caregivers also reported that these persons appeared to rely on nonverbal communication strategies to express 36 different communication functions.

CONCLUSION

Based on the findings of this study, it is clear that caregivers can be beneficial to persons who are minimally conscious, if they are able to observe and capitalise on naturally occurring multimodal communication strategies and functions. This study emphasises that familiar caregivers respect and value the dignity of persons who are minimally conscious and want to improve their communication capacity, but often lack confidence in their own communication skills.

Exploring How People with Expressive Aphasia Interact with and Perceive a Social Robot

People with aphasia need high-intensive language training to significantly improve their language skills, however practical barriers arise. Socially assistive robots have been proposed as a possibility to provide additional language training. However, it is yet unknown how people with aphasia perceive interacting with a social robot, and which factors influence this interaction. The aim of this study was to gain insight in how people with mild to moderate chronic expressive aphasia perceived interacting with the social robot NAO, and to explore what needs and requisites emerged. A total of 11 participants took part in a single online semi-structured interaction, which was analysed using observational analysis, thematic analysis, and post-interaction questionnaire. The findings show that participants overall felt positive towards using the social robot NAO. Moreover, they perceived NAO as enjoyable, useful, and to a lesser extent easy to use. This exploratory study provides a tentative direction for the intention of people with mild to moderate chronic expressive aphasia to use social robots. Design implications and directions for future research are proposed.

Unaided communication behaviours displayed by adults with severe cerebrovascular accidents and little or no functional speech: A scoping review

BACKGROUND

Unaided communication behaviours may provide communication support for persons with severe cerebrovascular accidents (CVA), as these individuals often experience severe communication difficulties, regardless of the aetiology. Though often subtle, these behaviours are present during all stages of recovery, and therefore communication partners need to know not only which unaided strategies are used as communication attempts, but also what their function is (i.e., what the person aims to achieve with the communication).

AIM

To identify the unaided communication behaviours that adults with severe CVA and little or no functional speech use to communicate, and to determine the communication functions addressed by these behaviours.

METHODS & PROCEDURES

The study used a scoping review methodology and included articles on communication partners of persons with CVA published between 1986 and 2020. Initially the searches yielded 732 studies from which 211 duplicates were identified. The remaining studies (n = 531) were then screened on title, abstract and full-text level resulting in a final inclusion of 18 studies. Of the 18 studies, five were qualitative and 13 consisted of quantitative methodologies.

MAIN CONTRIBUTION

The subtle communication behaviours used by persons with CVA (and resultant severe communication difficulties) are often misinterpreted or overlooked by their partners. If partners are trained to recognise such subtle or unaided communication behaviours, they can provide adequate support to access a range of communication functions. The unaided communication behaviours, which include 13 primary behaviours ranging from non-linguistic to linguistic, were utilised to convey 31 communication functions classified into four main communication categories.

CONCLUSIONS & IMPLICATIONS

Although unaided communication behaviours often appear as limiting, they can be utilised to communicate various communication functions. The findings of this review support the training of partners to identify these behaviours and improve person-partner communication. WHAT IS KNOWN?: Unaided communication has been widely researched. However, a summary is needed of the various unaided communication behaviours and of the different communication functions addressed by these behaviours. What the paper adds… This paper emphasises that unaided communication behaviours range from non-linguistic to linguistic, and they can support unintentional, pre-intentional and intentional communication functions. Clinical implications Even though aided communication is preferred, unaided communication behaviours are generally used in contexts with limited resources, as well as among culturally and linguistically diverse populations. This study advocates the identification of unaided communication behaviours by partners as well as the support and provision of access to communication strategies for persons with severe CVA. Future research should include more untrained communication partners.

Suggestions for Improving the Investigation of Gesture in Aphasia

Purpose When we speak, we gesture, and indeed, persons with aphasia gesture more frequently. The reason(s) for this is still being investigated, spurring an increase in the number of studies of gesture in persons with aphasia. As the number of studies increases, so too does the need for a shared set of best practices for gesture research in aphasia. After briefly reviewing the importance and use of gesture in persons with aphasia, this viewpoint puts forth methodological and design considerations when evaluating gesture in persons with aphasia. Method & Results We explore several different design and methodological considerations for gesture research specific to persons with aphasia, such as video angle specifications, data collection techniques, and analysis considerations. The goal of these suggestions is to develop transparent and reproducible methods for evaluating gesture in aphasia to build a solid foundation for continued work in this area. Conclusions We have proposed that it is critical to evaluate multimodal communication in a methodologically robust way to facilitate increased knowledge about the relationship of gesture to spoken language, cognition, and to other aspects of living with aphasia and recovery from aphasia. We conclude by postulating future directions for gesture research in aphasia.

Judgmental perception of co-speech gestures in MDD

Cognitive bias in depression may increase sensitivity to judgmental appraisal of communicative cues. Nonverbal communication encompassing co-speech gestures is crucial for social functioning and is perceived differentially by men and women, however, little is known about the effect of depression on the perception of appraisal. We investigate if a cognitive bias influences the perception of appraisal and judgement of nonverbal communication in major depressive disorder (MDD). During watching videos of speakers retelling a story and gesticulating, 22 patients with MDD and 22 matched healthy controls pressed a button when they perceived the speaker as appraising in a positive or negative way. The speakers were presented in four different conditions (with and without speech and with natural speaker or as stick-figures) to evaluate context effects. Inter-subject covariance (ISC) of the button-press time series measured consistency across the groups of the response pattern depending on the factors diagnosis and gender. Significant effects emerged for the factors diagnosis (p = .002), gender (p = .007), and their interaction (p < .001). The female healthy controls perceived the gestures more consistently appraising than male controls, the female patients, and male patients whereas the latter three groups did not differ. Further, the ISC measure for consistency correlated negatively with depression severity. The natural speaker video without audio speech yielded the highest responses consistency. Indeed co-speech gestures may drive these ISC effects because number of gestures but not facial shrugs correlated with ISC amplitude. During co-speech gestures, a cognitive bias led to disturbed perception of appraisal in MDD for females. Social communication is critical for functional outcomes in mental disorders; thus perception of gestural communication is important in rehabilitation.

The Role of Iconic Gestures in Speech Comprehension: An Overview of Various Methodologies

Iconic gesture-speech integration is a relatively recent field of investigation with numerous researchers studying its various aspects. The results obtained are just as diverse. The definition of iconic gestures is often overlooked in the interpretations of results. Furthermore, while most behavioral studies have demonstrated an advantage of bimodal presentation, brain activity studies show a diversity of results regarding the brain regions involved in the processing of this integration. Clinical studies also yield mixed results, some suggesting parallel processing channels, others a unique and integrated channel. This review aims to draw attention to the methodological variations in research on iconic gesture-speech integration and how they impact conclusions regarding the underlying phenomena. It will also attempt to draw together the findings from other relevant research and suggest potential areas for further investigation in order to better understand processes at play during speech integration process.

The management of subacute and chronic vascular aphasia: an updated review

Background

Post-stroke aphasia (PSA) is an impairment of the generation or comprehension of language due to acute cerebrovascular lesions. Subacute phase span the 7th day to 24 weeks post-onset while > 6 months is termed chronic phase. Language recovery does not arise immediately in chronic PSA, unlike the acute phase. The majority of the treatment modalities in these two PSA phases are still in the infancy stage, facing dilemmas and considered experimental requiring constant updates. Hence, we aimed to upgrade the existing literature regarding available PSA management options, advances, and drawbacks pertaining to subacute and chronic phases.

Main text

In this review, we analyzed the management options for subacute and chronic vascular aphasia. MEDLINE, through PubMed, ScienceDirect, and Google Scholar were explored for English studies by utilizing the terms “stroke aphasia” Plus “vascular aphasia”; 160,753 articles were retrieved. The latest studies, published from 2016 to July 2020, were selected. Article headings and abstracts were analyzed for relevance and filtered; eventually, 92 articles were included in this review. Various management options were extracted as follows: noninvasive brain stimulation (NIBS), technology-based therapies, speech-language therapy (SLT), pharmacotherapy, music-based therapies, and psychosocial interventions.

Conclusion

The PSA therapy evolves towards more intense SLT therapy, yet the optimal dosage of the emerging high-intensity therapies is controversial. As spinal and cerebellar NIBS, Telespeech, and E-mental health mark PSA's future, distinct pharmacological options remain a dilemma. Across the continuum of care, PSA–depression comorbidity and inadequate PSA post-discharge education to patient’s families are the significant therapeutic challenges. Future therapeutic mechanisms, optimal dose/timing, and tolerability/safety exploration are obliged.

Gesture, communication, and adult acquired hearing loss

Nonverbal communication, specifically hand and arm movements (commonly known as gesture), has long been recognized and explored as a significant element in human interaction as well as potential compensatory behavior for individuals with communication difficulties. The use of gesture as a compensatory communication method in expressive and receptive human communication disorders has been the subject of much investigation. Yet within the context of adult acquired hearing loss, gesture has received limited research attention and much remains unknown about patterns of nonverbal behaviors in conversations in which hearing loss is a factor. This paper presents key elements of the background of gesture studies and the theories of gesture function and production followed by a review of research focused on adults with hearing loss and the role of gesture and gaze in rehabilitation. The current examination of the visual resource of co-speech gesture in the context of everyday interactions involving adults with acquired hearing loss suggests the need for the development of an evidence base to effect enhancements and changes in the way in which rehabilitation services are conducted.

The Production of Gesture and Speech by People With Aphasia: Influence of Communicative Constraints

Purpose People with aphasia (PWA) use different kinds of gesture spontaneously when they communicate. Although there is evidence that the nature of the communicative task influences the linguistic performance of PWA, so far little is known about the influence of the communicative task on the production of gestures by PWA. We aimed to investigate the influence of varying communicative constraints on the production of gesture and spoken expression by PWA in comparison to persons without language impairment. Method Twenty-six PWA with varying aphasia severities and 26 control participants (CP) without language impairment participated in the study. Spoken expression and gesture production were investigated in 2 different tasks: (a) spontaneous conversation about topics of daily living and (b) a cartoon narration task, that is, retellings of short cartoon clips. The frequencies of words and gestures as well as of different gesture types produced by the participants were analyzed and tested for potential effects of group and task. Results Main results for task effects revealed that PWA and CP used more iconic gestures and pantomimes in the cartoon narration task than in spontaneous conversation. Metaphoric gestures, deictic gestures, number gestures, and emblems were more frequently used in spontaneous conversation than in cartoon narrations by both participant groups. Group effects show that, in both tasks, PWA's gesture-to-word ratios were higher than those for the CP. Furthermore, PWA produced more interactive gestures than the CP in both tasks, as well as more number gestures and pantomimes in spontaneous conversation. Conclusions The current results suggest that PWA use gestures to compensate for their verbal limitations under varying communicative constraints. The properties of the communicative task influence the use of different gesture types in people with and without aphasia. Thus, the influence of communicative constraints needs to be considered when assessing PWA's multimodal communicative abilities.

Differential roles of gestures on spatial language in neurotypical elderly adults and individuals with focal brain injury

Gestures might serve communicative functions by supplementing spoken expressions or restorative functions by facilitating speech production. Also, speakers with speech deficits use gestures to compensate for their speech impairments. In this study, we examined gesture use in speakers with and without speech impairments and how spoken spatial expressions changed when gestures were restrained. Six patients with speech problems and with left frontal and/or temporal lesions and 20 neurotypical controls described motion events in 3 different conditions (spontaneous gesture, only speech, and only gesture). In addition to the group analyses, we ran case analyses. Results showed that patients used more gestures compared to controls. Gestures served both communicative and restorative functions for patients whereas controls only used gestures for communicative purposes. Case analyses revealed that there were differential patterns among patients. Overall, gesture production is multifunctional and gestures serve different functions for different populations as well as within a population.