Quality of guidelines for cognitive rehabilitation following traumatic brain injury

INCOG 2.0 Guidelines for Cognitive Rehabilitation Following Traumatic Brain Injury: Methods, Overview, and Principles

INTRODUCTION

Moderate to severe traumatic brain injury (TBI) results in complex cognitive sequelae. Despite hundreds of clinical trials in cognitive rehabilitation, the translation of these findings into clinical practice remains a challenge. Clinical practice guidelines are one solution. The objective of this initiative was to reconvene the international group of cognitive researchers and clinicians (known as INCOG) to develop INCOG 2.0: Guidelines for Cognitive Rehabilitation Following TBI.

METHODS

The guidelines adaptation and development cycle was used to update the recommendations and derive new ones. The team met virtually and reviewed the literature published since the original INCOG (2014) to update the recommendations and decision algorithms. The team then prioritized the recommendations for implementation and modified the audit tool accordingly to allow for the evaluation of adherence to best practices.

RESULTS

In total, the INCOG update contains 80 recommendations (25 level A, 15 level B, and 40 level C) of which 27 are new. Recommendations developed for posttraumatic amnesia, attention, memory, executive function and cognitive-communication are outlined in other articles, whereas this article focuses on the overarching principles of care for which there are 38 recommendations pertaining to: assessment (10 recommendations), principles of cognitive rehabilitation (6 recommendations), medications to enhance cognition (10 recommendations), teleassessment (5 recommendations), and telerehabilitation intervention (7 recommendations). One recommendation was supported by level A evidence, 7 by level B evidence, and all remaining recommendations were level C evidence. New to INCOG are recommendations for telehealth-delivered cognitive assessment and rehabilitation. Evidence-based clinical algorithms and audit tools for evaluating the state of current practice are also provided.

CONCLUSIONS

Evidence-based cognitive rehabilitation guided by these recommendations should be offered to individuals with TBI. Despite the advancements in TBI rehabilitation research, further high-quality studies are needed to better understand the role of cognitive rehabilitation in improving patient outcomes after TBI.

A Review of Implementation Concepts and Strategies Surrounding Traumatic Brain Injury Clinical Care Guidelines

Despite considerable efforts to advance the science surrounding traumatic brain injury (TBI), formal efforts supporting the current and future implementation of scientific findings within clinical practice and healthcare policy are limited. While many and varied guidelines inform the clinical management of TBI across the spectrum, clinicians and healthcare systems are not broadly adopting, implementing, and/or adhering to them. As part of the Brain Trauma Blueprint TBI State of the Science, an expert workgroup was assembled to guide this review article, which describes: (1) possible etiologies of inadequate adoption and implementation; (2) enablers to successful implementation strategies; and (3) strategies to mitigate the barriers to adoption and implementation of future research.

Factors affecting functional outcomes of traumatic brain injury rehabilitation at a rehabilitation facility in Saudi Arabia

Objectives:

To identify the factors that affect disability after inpatient rehabilitation (IPR) in persons with traumatic brain injury (TBI).

Methods:

This retrospective study identified 140 patients aged ≥16 years who were admitted to the TBI rehabilitation unit at King Fahad Medical City, Riyadh, Kingdom of Saudi Arabia between 2015 and 2017. The collected data included demographic variables, TBI cause, coma duration, time from injury to IPR, LOS, and Functional Independence Measure (FIM) scores at IPR admission and discharge.

Results:

Majority of the patients were young males. The TBI was caused by motor vehicle accidents (MVA) in 95% of patients. The mean coma duration, time from injury to IPR admission, and LOS were 47±38, 264±357, and 75±52 days, respectively. The factors that were found to have an association with FIM change were time from injury to IPR admission (p=0.003, r=-0.250), admission FIM score (p=0.003, r=-0.253), and discharge FIM score (p<0.001, r=0.390). Employed patients had high FIM scores at admission (p=0.029, r=0.184) and discharge (p=0.003, r=0.252).

Conclusion:

Reduction in disability at discharge was positively associated with the severity of disability at admission and negatively with the time duration from injury to IPR admission, indicating a need to reduce time before admittance to an IPR setup. The high incidence of MVA causing TBI in a young male population strongly points to a need for appropriate measures of prevention.

Quality Appraisal of Systematic Reviews for Behavioral Treatments of Attention Disorders in Traumatic Brain Injury

OBJECTIVE

This review appraised the quality of systematic reviews (SRs) and meta-analyses (MAs) to summarize research on behavioral interventions for attention disorders in persons with traumatic brain injury.

METHODS

A search of 7 databases revealed 15 MAs/SRs reporting outcomes for attention treatments in traumatic brain injury. Two examiners independently coded the quality of reviews with the Critical Appraisal of Systematic Review or Meta-Analysis and the Evidence in Augmentative and Alternative Communication Systematic Review Scale.

RESULTS

The findings of both scales were highly correlated. Four reviews were conducted with high methodologic rigor indicated by a score of 60% or greater on both scales. No other study scored above 45%. Among the well-conducted SRs/MAs, evidence for direct attention training effects was limited to basic attention exercises, with little generalization to functional activities. Strategy training for activities and tasks requiring attentional abilities had a stronger evidence base in 1 rigorous MA.

CONCLUSIONS

This appraisal provides valuable practice information. The conclusions of 4 rigorous reviews suggest that there is only limited positive scientific support for the effects of attention treatments for traumatic brain injury. Future SRs/MAs would benefit from adherence to review guidelines.

Unique Features of the INESSS-ONF Rehabilitation Guidelines for Moderate to Severe Traumatic Brain Injury: Responding to Users' Needs

OBJECTIVE

Traumatic brain injury (TBI) clinical practice guidelines are a potential solution to rapidly expanding literature. The project objective was to convene experts to develop a unique set of TBI rehabilitation recommendations incorporating users' priorities for format and implementation tools including indicators of adherence.

METHODS

The Guidelines Adaptation & Development Cycle informed recommendation development. Published TBI recommendations were identified and tabulated. Experts convened to adapt or, where appropriate, develop new evidence-based recommendations. These draft recommendations were validated by systematically reviewing relevant literature. Surveys of experts and target users were triangulated with strength of evidence to identify priority topics.

RESULTS

The final recommendation set included a rationale, implementation tools (algorithms/adherence indicators), key process indicators, and evidence summaries, and were divided in 2 sections: Section I: Components of the Optimal TBI Rehabilitation System (71 recommendations) and Section II: Assessment and Rehabilitation of Brain Injury Sequelae (195 recommendations). The recommendations address top priorities for the TBI rehabilitation system: (1) intensity/frequency of interventions; (2) rehabilitation models; (3) duration of interventions; and (4) continuity-of-care mechanisms. Key sequelae addressed (1) behavioral disorders; (2) cognitive dysfunction; (3) fatigue and sleep disturbances; and (4) mental health.

CONCLUSION

This TBI rehabilitation guideline used a robust development process to address users' priorities.

A technical appraisal of guidelines for the management of skin rash in patients on chemotherapy and targeted therapy

BACKGROUND

Skin rash remains one of the most prevalent and troublesome clinical problems experienced by patients on chemotherapy and targeted therapy. To ensure high-quality care, guidelines are seen as the best guidance. Considering the quality of guidelines varies greatly, a systematical appraisal of the methodological quality of guidelines for the management of skin rash in patients on chemotherapeutic drugs and targeted anticancer therapies was undertaken, in order to identify appropriate ones for healthcare professionals.

METHODS

A systematic search of databases and Internet was conducted to obtain pertinent guidelines. Two reviewers independently assessed the eligibility of guidelines according to the inclusion criteria. Then the guidelines included were appraised by three researchers with the methodological quality of eligible guideline using Appraisal of Guidelines for Research and Evaluation II (AGREEII).

RESULTS

Totally nineteen guidelines met the inclusion criteria. The quality ranged from good to acceptable in scope and purpose (mean: 78.80%, range: 66.67-94.44%) and clarity of presentation domains (mean: 85.38%, 75.00-91.67%), but not in stakeholder involvement (mean: 50.15%, range: 36.11-75.00%), rigor of development (mean: 23.65%, range: 6.25-70.83%), applicability (mean: 23.96%, range: 4.17-52.08%), and editorial independence domains (mean: 45.18%, range: 0.00-87.50%). Overall, two guidelines were classified as "recommended".

CONCLUSIONS

Only two guidelines were recommended to manage skin rash in patients on chemotherapy and targeted therapies, most guidelines issued were of low to moderate quality. Thus, more attention should be paid to the methodological quality of guideline development in this field.

A systematic review of the content and quality of clinical practice guidelines for management of the neurogenic bladder following spinal cord injury

INTRODUCTION

Neurogenic bladder following acute spinal cord injury (SCI) increases urinary tract infection (UTI) risk and affects quality of life and health system costs.

OBJECTIVES

This study aimed to identify, describe and evaluate quality of clinical practice guidelines (CPGs) for managing neurogenic bladder following SCI.

METHODS

A comprehensive search covered six electronic databases (PubMed, Web of Science, Health Systems Evidence, Cochrane, CINAHL, Epistomonikos) and 12 CPG portals. Inclusion criteria were English language CPG; includes recommendations for managing neurogenic bladder in adults; all phases of care; published 2011 onwards in peer-reviewed journal/CPG portal. For eligible CPGs, key characteristics including years covered by CPG searching and number of neurogenic bladder recommendations were extracted. Quality appraisal used the AGREE II instrument. Appraiser agreement was assessed using the intraclass correlation coefficient.

RESULTS

Searching yielded 4028 citations and eight relevant CPGs. Collectively the CPGs contained 304 recommendations. Over half (160) pertained to assessment, surgery or education. Most surgery recommendations were from older CPGs; more recent CPGs emphasised conservative therapy. Methodological quality across CPGs was good in the domains of 'clarity of presentation' (84% mean domain score), 'scope and purpose' (72%) and 'editorial independence' (68%). There were shortcomings in the domains of 'rigor of development' (52%) 'stakeholder involvement' (42%) and 'applicability' (33%).

CONCLUSION

CPGs for the management of neurogenic bladder following SCI are generally robust in stating their scope and clearly presenting recommendations. Only three CPGs attained domain scores over 70% pertaining to methodological rigor. Future CPGs should also focus on providing implementation / audit resources and incorporating patient perspectives.

Cognitive Rehabilitation Following Traumatic Brain Injury: A Survey of Current Practice in Australia

Background and Objective: As cognitive impairments represent the greatest impediment to participation following moderate–severe traumatic brain injury (TBI), cognitive rehabilitation is vital. Several sets of guidelines for cognitive rehabilitation have been published, including INCOG in 2014. However, little is known about current practice by therapists working with individuals with TBI. This study aimed to characterise current cognitive rehabilitation practices via an online survey of therapists engaged in rehabilitation in individuals with TBI.

Method: The survey documented demographic information, current cognitive rehabilitation practice, resources used to inform cognitive rehabilitation, and reflections on cognitive rehabilitation provided.

Results: The 221 Australian respondents were predominantly occupational therapists, neuropsychologists, and speech pathologists with an average 9 years of clinical experience in cognitive rehabilitation and TBI. Cognitive retraining and compensatory strategies were the most commonly identified approaches used in cognitive rehabilitation. Executive functioning was mostly targeted for retraining, whereas memory was targeted with compensatory strategies. Attentional problems were less frequently addressed. Client self-awareness, family involvement, team collaboration, and goal-setting were seen as important ingredients for success.

Conclusion: Clinical practice of cognitive rehabilitation in Australia is broadly consistent with guidelines. However, addressing the impediments to its delivery is important to enhance the quality of life for individuals with TBI.

Analyzing the clinical actionability of germline pharmacogenomic findings in oncology

BACKGROUND

Germline and tumor pharmacogenomics impact drug responses, but germline markers less commonly guide oncology prescribing. The authors hypothesized that a critical number of clinically actionable germline pharmacogenomic associations exist, representing clinical implementation opportunities.

METHODS

In total, 125 oncology drugs were analyzed for positive germline pharmacogenomic associations in journals with impact factors ≥5. Studies were assessed for design and genotyping quality, clinically relevant outcomes, statistical rigor, and evidence of drug-gene effects. Associations from studies of high methodologic quality were deemed potentially clinically actionable, and translational summaries were written as point-of-care clinical decision support (CDS) tools and formally evaluated using the Appraisal of Guidelines for Research and Evaluation (AGREE) II instrument.

RESULTS

The authors identified germline pharmacogenomic results for 56 of 125 oncology drugs (45%) across 173 publications. Actionable associations were detected for 12 drugs, including 6 that had germline pharmacogenomic information within US Food and Drug Administration labels or published guidelines (capecitabine/fluorouracil/dihydropyrimidine dehydrogenase [DPYD], irinotecan/uridine diphosphate glucuronosyltransferase family 1 member A1 [UGT1A1], mercaptopurine/thioguanine/thiopurine S-methyltransferase [TPMT], tamoxifen/cytochrome P450 [CYP] family 2 subfamily D member 6 [CYP2D6]), and 6 others were novel (asparaginase/nuclear factor of activated T-cells 2 [NFATC2]/human leukocyte antigen D-related β1 [HLA-DRB1], cisplatin/acylphosphatase 2 [ACYP2], doxorubicin/adenosine triphosphate-binding cassette subfamily C member 2/Rac family small guanosine triphosphatase 2/neutrophil cytosolic factor 4 [ABCC2/RAC2/NCF4], lapatinib/human leukocyte antigen DQ α1 [HLA-DQA1], sunitinib/cytochrome P450 family 3 subfamily A member 5 [CYP3A5], vincristine/centrosomal protein 72 [CEP72]). By using AGREE II, the developed CDS summaries had high mean ± standard deviation scores (maximum score, 100) for scope and purpose (92.7 ± 5.1) and rigour of development (87.6 ± 7.4) and moderate yet robust scores for clarity of presentation (58.6 ± 25.1) and applicability (55.9 ± 24.6). The overall mean guideline quality score was 5.2 ± 1.0 (maximum score, 7). Germline pharmacogenomic CDS summaries for these 12 drugs were recommended for implementation.

CONCLUSIONS

Several oncology drugs have actionable germline pharmacogenomic information, justifying their delivery through institutional pharmacogenomic implementations to determine clinical utility. Cancer 2018;124:3052-65. © 2018 American Cancer Society.

Guideline appraisal with AGREE II: online survey of the potential influence of AGREE II items on overall assessment of guideline quality and recommendation for use

Background

The AGREE II instrument is the most commonly used guideline appraisal tool. It includes 23 appraisal criteria (items) organized within six domains. AGREE II also includes two overall assessments (overall guideline quality, recommendation for use). Our aim was to investigate how strongly the 23 AGREE II items influence the two overall assessments.

Methods

An online survey of authors of publications on guideline appraisals with AGREE II and guideline users from a German scientific network was conducted between 10th February 2015 and 30th March 2015. Participants were asked to rate the influence of the AGREE II items on a Likert scale (0 = no influence to 5 = very strong influence). The frequencies of responses and their dispersion were presented descriptively.

Results

Fifty-eight of the 376 persons contacted (15.4%) participated in the survey and the data of the 51 respondents with prior knowledge of AGREE II were analysed. Items 7–12 of Domain 3 (rigour of development) and both items of Domain 6 (editorial independence) had the strongest influence on the two overall assessments. In addition, Items 15–17 (clarity of presentation) had a strong influence on the recommendation for use. Great variations were shown for the other items. The main limitation of the survey is the low response rate.

Conclusions

In guideline appraisals using AGREE II, items representing rigour of guideline development and editorial independence seem to have the strongest influence on the two overall assessments. In order to ensure a transparent approach to reaching the overall assessments, we suggest the inclusion of a recommendation in the AGREE II user manual on how to consider item and domain scores. For instance, the manual could include an a-priori weighting of those items and domains that should have the strongest influence on the two overall assessments. The relevance of these assessments within AGREE II could thereby be further specified.

Electronic supplementary material

The online version of this article (10.1186/s12913-018-2954-8) contains supplementary material, which is available to authorized users.

A qualitative study adopting a user-centered approach to design and validate a brain computer interface for cognitive rehabilitation for people with brain injury

Cognitive rehabilitation is established as a core intervention within rehabilitation programs following a traumatic brain injury (TBI). Digitally enabled assistive technologies offer opportunities for clinicians to increase remote access to rehabilitation supporting transition into home. Brain Computer Interface (BCI) systems can harness the residual abilities of individuals with limited function to gain control over computers through their brain waves. This paper presents an online cognitive rehabilitation application developed with therapists, to work remotely with people who have TBI, who will use BCI at home to engage in the therapy. A qualitative research study was completed with people who are community dwellers post brain injury (end users), and a cohort of therapists involved in cognitive rehabilitation. A user-centered approach over three phases in the development, design and feasibility testing of this cognitive rehabilitation application included two tasks (Find-a-Category and a Memory Card task). The therapist could remotely prescribe activity with different levels of difficulty. The service user had a home interface which would present the therapy activities. This novel work was achieved by an international consortium of academics, business partners and service users.

Guideline appraisal with AGREE II: Systematic review of the current evidence on how users handle the 2 overall assessments

INTRODUCTION

The Appraisal of Guidelines for Research & Evaluation (AGREE) II instrument is the most commonly used guideline appraisal tool. It includes 23 appraisal criteria (items) organized within 6 domains and 2 overall assessments (1. overall guideline quality; 2. recommendation for use). The aim of this systematic review was twofold. Firstly, to investigate how often AGREE II users conduct the 2 overall assessments. Secondly, to investigate the influence of the 6 domain scores on each of the 2 overall assessments.

MATERIALS AND METHODS

A systematic bibliographic search was conducted for publications reporting guideline appraisals with AGREE II. The impact of the 6 domain scores on the overall assessment of guideline quality was examined using a multiple linear regression model. Their impact on the recommendation for use (possible answers: "yes", "yes, with modifications", "no") was examined using a multinomial regression model.

RESULTS

118 relevant publications including 1453 guidelines were identified. 77.1% of the publications reported results for at least one overall assessment, but only 32.2% reported results for both overall assessments. The results of the regression analyses showed a statistically significant influence of all domains on overall guideline quality, with Domain 3 (rigour of development) having the strongest influence. For the recommendation for use, the results showed a significant influence of Domains 3 to 5 ("yes" vs. "no") and Domains 3 and 5 ("yes, with modifications" vs. "no").

CONCLUSIONS

The 2 overall assessments of AGREE II are underreported by guideline assessors. Domains 3 and 5 have the strongest influence on the results of the 2 overall assessments, while the other domains have a varying influence. Within a normative approach, our findings could be used as guidance for weighting individual domains in AGREE II to make the overall assessments more objective. Alternatively, a stronger content analysis of the individual domains could clarify their importance in terms of guideline quality. Moreover, AGREE II should require users to transparently present how they conducted the assessments.

INCOG recommendations for management of cognition following traumatic brain injury, part IV: cognitive communication

INTRODUCTION

Cognitive-communication disorders are common in individuals with traumatic brain injury (TBI) and can have a major impact on long-term outcome. Guidelines for evidence-informed rehabilitation are needed, thus an international group of researchers and clinicians (known as INCOG) convened to develop recommendations for assessment and intervention.

METHODS

An expert panel met to select appropriate recommendations for assessment and treatment of cognitive-communication disorders based on available literature. To promote implementation, the team developed decision algorithms incorporating the recommendations, based on inclusion and exclusion criteria of published trials, and then prioritized recommendations for implementation and developed audit criteria to evaluate adherence to best practice recommendations.

RESULTS

Rehabilitation of individuals with cognitive-communication disorders should consider premorbid communication status; be individualized to the person's needs, goals, and skills; provide training in use of assistive technology where appropriate; include training of communication partners; and occur in context to minimize the need for generalization. Evidence supports treatment of social communication problems in a group format.

CONCLUSION

There is strong evidence for person-centered treatment of cognitive-communication disorders and use of instructional strategies such as errorless learning, metacognitive strategy training, and group treatment. Future studies should include tests of alternative service delivery models and development of participation-level outcome measures.