Exploring Treatment Fidelity in Persons With Aphasia Autonomously Practicing With Computerized Therapy Materials

Motivation Theory and Practice in Aphasia Rehabilitation: A Scoping Review

PURPOSE

In the aphasia literature, motivation has been described as potentially influencing rehabilitation outcomes, and there are reports that researchers and clinicians have acted to promote it. However, studies directly investigating the range of beliefs and practices surrounding motivation do not exist currently. The purpose of this scoping review is to develop themes related to the beliefs and practices appearing in the recent aphasia literature.

METHOD

Four databases (CINAHL, PsycINFO, PubMed, and Google Scholar) were searched using keywords aphasia and motivation (including derivatives such as motiv*) for articles published between 2009 and 2020. Searches returned 19,731 articles; after deleting duplicates and applying inclusionary criteria, 365 articles remained. In each article, text surrounding the term motivation was highlighted and thematic analysis was applied to these quotations.

RESULTS

Sixteen themes were developed through thematic analysis and placed into two groups. The first group contained five themes suggesting that researchers believed that motivation should be studied and recognized the value of motivation in person(s) with aphasia when participating in research or clinical activities. The second group contained 11 themes reporting diverse beliefs and practices in how motivation is incorporated in research and clinical activities.

CONCLUSIONS

Results from this scoping review suggest that aphasia researchers, clinicians, and persons with aphasia hold beliefs about motivation that can influence clinical and research decisions. In general, beliefs and decisions related to motivation appeared to be guided by intuition rather than theories of motivation. These themes are discussed within the context of three psychological needs proposed by self-determination theory: competency, autonomy, and relatedness. Applying theories of motivation to future study in aphasia rehabilitation will guide work that can provide empirical support for these beliefs.

Treatment fidelity of technology-enhanced reading therapy (CommuniCATE) for people with aphasia

BACKGROUND

Treatment fidelity (TF), that is, the degree to which the treatment delivery has adhered to protocol, is an important aspect of establishing treatment validity and reliability. Research has shown that establishing TF is only done in a small percentage of aphasia treatment studies.

AIMS

This project supports the work of the CommuniCATE study, which explored the benefits of technology-enhanced aphasia therapy on participants' reading, writing, speech and conversation skills. It examines the TF of the Reading strand of the CommuniCATE project by assessing whether the therapy adhered to the protocol. The following research questions were asked: Does treatment delivery adhere to treatment protocol? Does the degree of TF vary according to the person delivering the therapy (i.e. student therapist or qualified therapist)? Does the degree of TF vary over time (early treatment sessions compared with later treatment sessions)? Was the checklist tool reliable?

METHODS & PROCEDURES

This study assessed the fidelity of 38 retrospective video recordings of therapy. It used a checklist measure of criteria to which the delivery of the sessions should adhere, and against which the sessions were rated. Participants were the people with aphasia receiving therapy, the students and qualified speech and language therapists delivering therapy, and the independent raters assessing the sessions. A sample of sessions was randomly chosen, including sessions delivered by qualified therapists and by students, and sessions from different time points in the treatment process. The fidelity was rated by the first author, and the fidelity rating calculated as a percentage. Comparisons in fidelity scores for the different variables were drawn using Mann-Whitney tests. The reliability of the checklist was assessed through inter and intra-rater reliability testing, and the results were analysed using Kappa statistics.

OUTCOMES & RESULTS

High fidelity was found across all therapy conditions with a mean score of 98.2%. Fidelity scores were not affected by the administrator of therapy; sessions delivered by qualified and student therapists were rated equally highly. There was a small but significant effect of time, with later treatment sessions scoring more highly than earlier sessions. However, scores across both periods > 90%. Inter-rater reliability found a high percentage agreement of 93.3% and a Poor Kappa agreement level. Intra-rater agreement found a high percentage agreement of 97.3% and a Fair Kappa agreement level.

CONCLUSIONS & IMPLICATIONS

The CommuniCATE reading therapy was implemented as per the protocol across time points, and withstood delegation to students. The high fidelity and good reliability scores have positive implications for the study's validity and reliability, and for the study's replication.

WHAT THIS PAPER ADDS

What is already known on the subject TF refers to the degree to which the delivery of core components of a treatment matches the implementation guidelines, that is, the adherence to protocol. Despite the acknowledged importance of TF reporting, this is often neglected in the literature. What this paper adds to existing knowledge This paper shows that the TF assessment of the CommuniCATE study (reading strand) found a 98.2% fidelity score, and that high fidelity was not compromised across treatment conditions. This paper outlines the principles of TF and highlights the need for measures to be in place to establish TF, for example, manuals, training and supervision; and to monitor TF, for example, via the use of checklists. This paper also underlines the scarcity of TF measures and checks in aphasia research. This paper therefore serves as a model of TF practice in aphasia therapy research. What are the potential or actual clinical implications of this work? This study contributes to the findings of the CommuniCATE project (reading strand), and the high fidelity findings enhance the validity of the project and indicate that the therapy manual and training enable accurate implementation of delivery. This paper also contributes to the literature on TF evaluation in aphasia studies, which is presently lacking, and highlights the need for increased focus on the optimum strategies of TF reporting.

App-based data collection, mental imagery, and naming performance in adults with aphasia

BACKGROUND AND PURPOSE

Naming impairments are often found in aphasia. Combining mHealth technology with mental imagery may offer new insights into novel approaches to naming interventions in persons with aphasia. The aims of this study are to (1) explore whether mental imagery can improve performance during a naming task in adults with aphasia; and, (2) demonstrate the use of app-based data collection for research in aphasia rehabilitation through utilization of an app designed specifically for this study.

MATERIALS AND METHODS

A single subject non-concurrent multiple baseline design across participants was utilized. Four participants with anomic and conduction aphasia were included. Each participant's percentage of naming accuracy was measured before the initiating intervention to establish a baseline level of performance.

RESULTS

Per overlap metrics, two of the participants demonstrated a strong effect in improving naming from baseline to intervention on items using the app. Two participants showed no effect in naming accuracy from the imagery intervention.

CONCLUSION

Some participants showed improvement in naming items following an imagery script, suggesting that this complementary health practice should continue to be explored. Additionally, this study demonstrates the successful use of app-based data collection.

A Systematically Conducted Scoping Review of the Evidence and Fidelity of Treatments for Verb Deficits in Aphasia: Verb-in-Isolation Treatments

Purpose Aphasia research demonstrates increasing interest in the treatment of verb retrieval deficits. This systematically conducted scoping review reports on the level and fidelity of the current evidence for verb treatments; on its effectiveness regarding the production of trained and untrained verbs, functional communication, sentences, and discourse; and on the potential active ingredients. Recommendations to guide clinical decision making and future research are made. Method The computerized database search included studies from January 1980 to September 2018. The level of evidence of each study was documented, as was fidelity in terms of treatment delivery, enactment, and receipt. Studies were also categorized according to the treatment methods used. Results Thirty-seven studies were accepted into the review, and all but 1 constituted a low level of evidence. Thirty-three studies (89%) described treatment in sufficient detail to allow replication, dosage was poorly reported, and the fidelity of treatment was rarely assessed. The most commonly reported treatment techniques were phonological and semantic cueing in 25 (67.5%) and 20 (54%) studies, respectively. Retrieval of trained verbs improved for 80% of participants, and improvements generalized to untrained verbs for 15% of participants. There was not sufficient detail to evaluate the impact of treatment on sentence production, functional communication, and discourse. Conclusions The evidence for verb treatments is predominantly of a low level. There are encouraging findings in terms of treatments being replicable; however, this is tempered by poor monitoring of treatment fidelity. The quality of verb treatment research would be improved by researchers reaching consensus regarding outcome measures (including generalization to, e.g., sentences and discourse) by manualizing treatment to facilitate implementation and exploring the opinions of participants. Finally, while treatment is largely effective in improving production of trained verbs, lack of generalization to untrained items leads to the recommendation that personally relevant verbs are prioritized.

Developing, Implementing, and Improving Assessment and Treatment Fidelity in Clinical Aphasia Research

Purpose The purpose of this study was to describe the development and implementation of a fidelity program for an ongoing, multifacility, aphasia intervention study and to explain how initial fidelity measures are being used to improve study integrity. Method A Clinical Core team developed and incorporated a fidelity plan in this study. The aims of the Clinical Core team were to (a) supervise data collection and data management at each clinical site, (b) optimize and monitor assessment fidelity, and (c) optimize and monitor treatment fidelity. Preliminary data are being used to guide ongoing efforts to preserve and improve the fidelity of this intervention study. Results Preliminary results show that specific recruitment strategies help to improve appropriate referrals and that accommodations to participants and their families help to maintain excellent retention. A streamlined and centralized training program assures the reliability of assessors and raters for the study's assessment and treatment protocols. Ongoing monitoring of both assessment and treatment tasks helps to maintain study integrity. Less-than-optimal interrater reliability data for the raters of some of the discourse measures guided the Clinical Core team to address the training and coding inconsistencies in a timely manner. Conclusions The creation of a Clinical Core team is instrumental in developing and implementing a fidelity plan for improved assessment and treatment fidelity. Intentional planning and assignment of study staff to implement and monitor ongoing fidelity measures assures that clinical data are reliable and valid. Ongoing review of the plan shows areas of strengths and weaknesses for continuing adjustments and improvement of study fidelity.