Measurement properties of performance-based instruments to assess mental function during activity and participation in traumatic brain injury: A systematic review

Measurement Properties of the Mayo-Portland Adaptability Inventory (MPAI-4) and Related Measures: A Systematic Review

OBJECTIVE

To assess the Mayo-Portland Adaptability Inventory-version 4 (MPAI-4) and related measures' measurement properties and the quality of evidence supporting these results; and identify the interpretability and feasibility of the MPAI-4 and related measures.

DATA SOURCES

We conducted a systematic review according to COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) guidelines. We searched 9 electronic databases and registries, and hand searched reference lists of included articles.

STUDY SELECTION

Two independent reviewers screened and selected all articles. From 605 retrieved articles, 48 were included.

DATA EXTRACTION

Two independent reviewers appraised the evidence quality and rated the extracted classical test theory and Rasch results from each study.

DATA SYNTHESIS

We used meta-analysis and COSMIN's approach to synthesize measurement properties evidence (insufficient, sufficient), and the modified Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to synthesize evidence quality (very low, low, moderate, high) by diagnosis (traumatic brain injury [TBI], stroke), and setting (inpatient, outpatient). The MPAI-4 and its subscales are sufficiently comprehensible (GRADE: very low), but there is currently no other content validity evidence (relevance, comprehensiveness). The MPAI-4 and its participation index (M2PI) have sufficient interrater reliability for stroke and TBI outpatients (GRADE: moderate), whereas interrater reliability between TBI inpatients and clinicians is currently insufficient (GRADE: moderate). There is no evidence for measurement error. For stroke and TBI outpatients, the MPAI-4 and M2PI have sufficient construct validity (GRADE: high) and responsiveness (GRADE: moderate-high). For TBI inpatients, the MPAI-4 and M2PI have mixed indeterminant/sufficient construct validity and responsiveness evidence (GRADE: moderate-high). There is 1 study with mixed insufficient/sufficient evidence for each MPAI-4 adaptation (21- and 22-item MPAI, 9-item M2PI) (GRADE: low-high).

CONCLUSION

Users can be most confident in using the MPAI-4 and M2PI in TBI and stroke outpatient settings. Future research is needed on reliability, measurement error, predictive validity, and content validity of the MPAI-4 and its related measures across populations and settings.

Why a clinical trial is as good as its outcome measure: A framework for the selection and use of cognitive outcome measures for clinical trials of Alzheimer's disease

A crucial aspect of any clinical trial is using the right outcome measure to assess treatment efficacy. Compared to the rapidly evolved understanding and measurement of pathophysiology in preclinical and early symptomatic stages of Alzheimer's disease (AD), relatively less progress has been made in the evolution of clinical outcome assessments (COAs) for those stages. The current paper aims to provide a benchmark for the design and evaluation of COAs for use in early AD trials. We discuss lessons learned on capturing cognitive changes in predementia stages of AD, including challenges when validating novel COAs for those early stages and necessary evidence for their implementation in clinical trials. Moving forward, we propose a multi-step framework to advance the use of more effective COAs to assess clinically meaningful changes in early AD, which will hopefully contribute to the much-needed consensus around more appropriate outcome measures to assess clinical efficacy of putative treatments. HIGHLIGHTS: We discuss lessons learned on capturing cognitive changes in predementia stages of AD. We propose a framework for the design and evaluation of performance based cognitive tests for use in early AD trials. We provide recommendations to facilitate the implementation of more effective cognitive outcome measures in AD trials.

Measurement properties of performance-based instruments to assess mental function during activity and participation in persons who have survived a stroke: A systematic review protocol

BACKGROUND

A frequent consequence of stroke is impaired mental function, which often affects the ability to perform activities and participate in life situation. In occupational therapy practice, performance-based instruments during activity and participation are often used. However, it is important to assess if the instruments used are valid, reliable and responsive.

OBJECTIVE

The objective of this systematic review is to investigate measurement properties of performance-based instruments to assess mental function during activity and participation in persons who have survived stroke.

MATERIAL AND METHODS

Systematic database searches of PubMed, EMBASE, CINAHL, PsycINFO, and OTseeker will be conducted. COSMIN Risk of Bias checklist will be used to evaluate methodological quality of the included articles. Measurement properties of the included studies will be rated against criteria for good measurement properties. The overall evidence of each measurement property per instrument is graded using a modified GRADE approach.

RESULTS

Results will be presented in text and tables.

CONCLUSIONS

Conclusion will be drawn up-on the overall evidence to give recommendations on the most suitable instrument.

SIGNIFICANCE

It is expected that findings of the review will provide evidence to guide professionals in the selection of a performance-based instruments to measure mental function in practice and research.

TRIAL REGISTRATION NUMBER

PROSPERO CRD42018086744.

Virtual-Reality Performance-Based Assessment of Cognitive Functions in Adult Patients With Acquired Brain Injury: A Scoping Review

Individuals with acquired brain injury (ABI) commonly present with impairments in cognitive abilities. As these competencies seem to be predictive of patients' abilities to reintegrate into the everyday settings, it is crucial to assess them properly. However, previous research has indicated that patients may perform relatively well on standard tests of cognitive functioning, but may nonetheless encounter significant difficulties in organizing and executing everyday tasks. In order to overcome this issue, virtual reality (VR) methods have been introduced in clinical practice with the aim of creating assessments that simulate real-world activities and thus, provide a clearer picture of patients' functioning in everyday settings. This review offers an overview of VR assessment tools described in the scientific literature between 2010 and 2019. Overall, 38 relevant records describing 31 different tools were found. Among these tools, 16 assessed executive functions and prospective memory, while the other 15 assessed visuo-spatial abilities. Although promising results have been reported, our analysis indicated that about half of the tools deliver tasks that differ from everyday activities, thus limiting the generalizability of patients' performance to the real-world. Moreover, a variety of methodological shortfalls related to study Internal and External Validity have been highlighted, which hamper the possibility of drawing definite recommendations on tool choice. These limitations suggest the importance of putting considerable efforts into the improvement or development of VR tools for patients with ABI for both research and clinical purposes, considering the great potential of this form of assessment.