Making sense of pragmatic criteria for the selection of geriatric rehabilitation measurement tools

OMERACT Core outcome measurement set for shared decision making in rheumatic and musculoskeletal conditions: a scoping review to identify candidate instruments

OBJECTIVES

Shared decision making (SDM) is a central tenet in rheumatic and musculoskeletal care. The lack of standardization regarding SDM instruments and outcomes in clinical trials threatens the comparative effectiveness of interventions. The Outcome Measures in Rheumatology (OMERACT) SDM Working Group is developing a Core Outcome Set for trials of SDM interventions in rheumatology and musculoskeletal health. The working group reached consensus on a Core Outcome Domain Set in 2020. The next step is to develop a Core Outcome Measurement Set through the OMERACT Filter 2.2.

METHODS

We conducted a scoping review (PRISMA-ScR) to identify candidate instruments for the OMERACT Filter 2.2 We systematically reviewed five databases (Ovid MEDLINE®, Embase, Cochrane Library, CINAHL and Web of Science). An information specialist designed search strategies to identify all measurement instruments used in SDM studies in adults or children living with rheumatic or musculoskeletal diseases or their important others. Paired reviewers independently screened titles, abstracts, and full text articles. We extracted characteristics of all candidate instruments (e.g., measured construct, measurement properties). We classified candidate instruments and summarized evidence gaps with an adapted version of the Summary of Measurement Properties (SOMP) table.

RESULTS

We found 14,464 citations, read 239 full text articles, and included 99 eligible studies. We identified 220 potential candidate instruments. The five most used measurement instruments were the Decisional Conflict Scale (traditional and low literacy versions) (n=38), the Hip/Knee-Decision Quality Instrument (n=20), the Decision Regret Scale (n=9), the Preparation for Decision Making Scale (n=8), and the CollaboRATE (n=8). Only 44 candidate instruments (20%) had any measurement properties reported by the included studies. Of these instruments, only 57% matched with at least one of the 7-criteria adapted SOMP table.

CONCLUSION

We identified 220 candidate instruments used in the SDM literature amongst people with rheumatic and musculoskeletal diseases. Our classification of instruments showed evidence gaps and inconsistent reporting of measurement properties. The next steps for the OMERACT SDM Working Group are to match candidate instruments with Core Domains, assess feasibility and review validation studies of measurement instruments in rheumatic diseases or other conditions. Development and validation of new instruments may be required for some Core Domains.

Feasibility and clinical applicability of a novel power wheelchair training approach

PURPOSE

To evaluate the feasibility and the clinical applicability of administering the COMET (cognition, occupation, mobility, evaluation and training) intervention.

MATERIALS AND METHODS

A pilot research was conducted with adults who were being considered for power wheelchair (PWC) provision, or who were recently provided a PWC, and who had been identified to benefit from a PWC training. The COMET intervention applies a goal directed, client-centred and occupation-based approach. Feasibility and applicability indicators were collected for: process, resources, management and treatment. Indicators were evaluated as "successful/unsuccessful". Clinical outcomes included the Goal Attainment Scale (GAS), the Canadian Occupational Performance Measure (COPM), the Power mobility Indoor Driving Assessment (PIDA) and the Wheelchair Skills Test (WST).

RESULTS

Four females (62.5 ± 3.5 years) with cognitive impairment participated in the study. Among the 13 indicators, 10 were successfully achieved. Indicators that did not meet the criteria for success were adherence rate, safety and treatment for the PIDA. Two adverse events were reported, with one minor injury. Participants demonstrated better than expected results on the GAS, the COPM scores and the WST. However, only two reported an improvement beyond 4% of the PIDA.

CONCLUSIONS

With few modifications, the COMET intervention and the study protocol will be feasible and applicable in clinical practice. Individuals with complex cognitive and mobility impairment demonstrated abilities to learn PWC use. Further investigation of the COMET intervention is required to evaluate its efficacy.Implications for rehabilitationA novel power wheelchair (PWC) training approach adapted to individual with complex mobility and cognitive impairments was developed: the COMET (cognition, occupation, mobility, evaluation and training) intervention.The COMET intervention applies a goal directed, client-centred and occupation-based approach.With minor modifications, the COMET intervention may be feasible and clinically applicable to train individuals with complex motor and cognitive impairments how to use a PWC.Further evaluation of the COMET intervention and lager control trialsare suggested.

Measurement Properties of the Mayo-Portland Adaptability Inventory (MPAI-4) and Related Measures: A Systematic Review

OBJECTIVE

To assess the Mayo-Portland Adaptability Inventory-version 4 (MPAI-4) and related measures' measurement properties and the quality of evidence supporting these results; and identify the interpretability and feasibility of the MPAI-4 and related measures.

DATA SOURCES

We conducted a systematic review according to COnsensus-based Standards for the selection of health Measurement Instruments (COSMIN) guidelines. We searched 9 electronic databases and registries, and hand searched reference lists of included articles.

STUDY SELECTION

Two independent reviewers screened and selected all articles. From 605 retrieved articles, 48 were included.

DATA EXTRACTION

Two independent reviewers appraised the evidence quality and rated the extracted classical test theory and Rasch results from each study.

DATA SYNTHESIS

We used meta-analysis and COSMIN's approach to synthesize measurement properties evidence (insufficient, sufficient), and the modified Grading of Recommendations Assessment, Development and Evaluation (GRADE) approach to synthesize evidence quality (very low, low, moderate, high) by diagnosis (traumatic brain injury [TBI], stroke), and setting (inpatient, outpatient). The MPAI-4 and its subscales are sufficiently comprehensible (GRADE: very low), but there is currently no other content validity evidence (relevance, comprehensiveness). The MPAI-4 and its participation index (M2PI) have sufficient interrater reliability for stroke and TBI outpatients (GRADE: moderate), whereas interrater reliability between TBI inpatients and clinicians is currently insufficient (GRADE: moderate). There is no evidence for measurement error. For stroke and TBI outpatients, the MPAI-4 and M2PI have sufficient construct validity (GRADE: high) and responsiveness (GRADE: moderate-high). For TBI inpatients, the MPAI-4 and M2PI have mixed indeterminant/sufficient construct validity and responsiveness evidence (GRADE: moderate-high). There is 1 study with mixed insufficient/sufficient evidence for each MPAI-4 adaptation (21- and 22-item MPAI, 9-item M2PI) (GRADE: low-high).

CONCLUSION

Users can be most confident in using the MPAI-4 and M2PI in TBI and stroke outpatient settings. Future research is needed on reliability, measurement error, predictive validity, and content validity of the MPAI-4 and its related measures across populations and settings.

Expected Health Benefits as the Ultimate Outcome of Information Available on Stroke Engine, a Knowledge Translation Stroke Rehabilitation Website: Web-Based Survey

BACKGROUND

Electronic knowledge resources are readily available and typically target different audiences, including health professionals and the public, that is, those with lived experience and their relatives. The knowledge-to-action framework, in combination with the information assessment method (IAM), considering both the value-of-information construct and the conceptual model of acquisition-cognition-application, can be used to support the evaluation process of such resources. As an example, Stroke Engine is an evidence-based knowledge translation resource in stroke rehabilitation (assessments and interventions) for health professionals and students as well as individuals who have sustained a stroke and their relatives. According to Google Analytics, the website is perused >10,000 times per week.

OBJECTIVE

With the overall aim to improve the content available on Stroke Engine, we documented Stroke Engine users' perceptions of situational relevance, cognitive impact, intention to use, and expected patient and health benefits regarding the information consulted.

METHODS

A web-based survey anchored in the IAM was made available via an invitation tab. The IAM is a validated questionnaire that is designed to assess the value of information. Sociodemographic characteristics were also collected, and a space for free-text comments was provided. Descriptive statistics were used, and thematic analysis was used for the free-text comments.

RESULTS

The sample consisted of 6634 respondents. Health professionals (3663/6634, 55.22%) and students (2784/6634, 41.97%) represented 97.18% (6447/6634) of the total responses. The remaining 2.82% (187/6634) of the responses were from individuals who had sustained a stroke (87/6634, 1.31%) and their relatives (100/6634, 1.51%). Regarding situational relevance, assessments (including selecting, obtaining, and interpreting results from a test) was the main topic searched by health professionals (1838/3364, 54.64%) and students (1228/2437, 50.39%), whereas general information on stroke rehabilitation was the top-ranked topic for nearly two-thirds of the individuals with stroke (45/76, 59%) and their relatives (57/91, 63%). Cognitive impact was characterized by learning something new. Intention to use was high (4572/6379, 71.67%) among the respondents and varied in context (eg, refine a topic, research, class assignments, teaching, and education). Respondents commented on ways to improve content. Expected patient and health benefits such as improvement in health and well-being was the top-ranked category for all 4 subgroups, followed by the avoidance of unnecessary or inappropriate treatment for health professionals (183/623, 29.4%) and a feeling of being reassured for individuals with stroke (26/75, 35%) and their relatives (28/97, 29%).

CONCLUSIONS

Valuable feedback on Stroke Engine was obtained in terms of its accessibility, relevance for informational needs and retrieval, accuracy, and applicability; however, of utmost importance is the potential implementation of its evidence-based content in clinical practice and the perceived expected impact on patients, their relatives, and their health professionals. The feedback received allowed for corrections and the identification of key topics for further development.

A Sensibility Assessment of the Job Demands and Accommodation Planning Tool (JDAPT): A Tool to Help Workers with an Episodic Disability Plan Workplace Support

Purpose Sensibility refers to a tool's comprehensiveness, understandability, relevance, feasibility, and length. It is used in the early development phase to begin assessing a new tool or intervention. This study examined the sensibility of the job demands and accommodation planning tool (JDAPT). The JDAPT identifies job demands related to physical, cognitive, interpersonal, and working conditions to better target strategies for workplace supports and accommodations aimed at assisting individuals with chronic health conditions. Methods Workers with a chronic health condition and workplace representatives were recruited from health charities, workplaces, and newsletters using convenience sampling. Cognitive interviews assessed the JDAPT's sensibility. A 70% endorsement rate was the minimum level of acceptability for sensibility concepts. A short screening tool also was administered, and answers compared to the complete JDAPT. Results Participants were 46 workers and 23 organizational representatives (n = 69). Endorsements highly exceeded the 70% cut-off for understandability, relevance, and length. Congruence between screening questions and the complete JDAPT suggested both workers and organizational representatives overlooked job demands when completing the screener. Participants provided additional examples and three new items to improve comprehensiveness. The JDAPT was rated highly relevant and useful, although not always easy to complete for someone with an episodic condition. Conclusions This study highlights the need for tools that facilitate accommodations for workers with episodic disabilities and provides early evidence for the sensibility of the JDAPT.

Quality of mobility measures among individuals with acquired brain injury: an umbrella review

Background and objective

While several mobility measures exist, there is large variability across measures in how mobility is conceptualized, the source of information and the measurement properties making it challenging to select relevant mobility measures for individuals with acquired brain injury (ABI). Therefore, the objective was to conduct a comprehensive synthesis of existing evidence on the measurement properties, the interpretability and the feasibility of mobility measures from various sources of information (patients, clinicians, technology) using an umbrella review of published systematic reviews among individuals with ABI.

Methods

Ovid MEDLINE, CINHAL, Cochrane Library and EMBASE electronic databases were searched from 2000 to March 2020. Two independent reviewers appraised the methodological quality of the systematic reviews using the Joanna Briggs Institute critical appraisal checklist. Measurement properties and quality of evidence were applied according to COnsensus-based Standards for the Selection of Health Measurement Instrument (COSMIN) guidelines. Mobility measures were categorized using international standards with the international classification of functioning, disability and health (ICF).

Results

Thirty-five systematic reviews were included covering 147 mobility measures, of which 85% were mapped to the ICF Activity and Participation component. Results showed an acceptable overall "sufficient" rating for reliability, construct validity and responsiveness for 132 (90%), 127 (86%) and 76 (52%) of the measures, respectively; however, among these measures, ≤ 25% of the methods for evaluating these properties were rated as ‘high’ quality of evidence. Also, there was limited information that supports measure feasibility and scoring interpretability.

Conclusions

Future systematic reviews should report measures’ content validity to support the use of the measure in clinical care and research. More evaluations of the minimal important difference and floor and ceiling effects are needed to help guide clinical interpretation.

Registration information

International Prospective Register of Systematic Reviews (PROSPERO); ID: CRD42018100068.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-022-03103-4.

The Applicability of the Patient-Specific Functional Scale (PSFS) in Rehabilitation for Patients with Acquired Brain Injury (ABI) - A Cohort Study

Aim

The primary aim of this study was to investigate the applicability of the Patient-Specific Functional Scale (PSFS) in patients with acquired brain injury (ABI) admitted to a specialized rehabilitation unit in a regional hospital. A secondary aim was to identify patient characteristics and functioning that predicted changes in the PSFS.

Patients and Methods

In a cohort study, 59 patients with ABI were assessed for the ability to complete the PSFS. A trained multidisciplinary team applied the PSFS as part of a collaborative development of rehabilitation goals. The modified Rankin Scale (mRS), the Functional Ambulation Categories (FAC), the Rivermead Behavioural Memory Test (RBMT), the Norwegian Basic Aphasia Assessment (NBAA) and the Loewenstein Occupational Therapy Cognitive Assessment (LOTCA) were used to identify characteristics of the sample. Multivariate regression analyses were performed to investigate associations between changes in the PSFS score from admission to discharge and a selected set of participant baseline characteristics and functioning.

Results

Fifty-four patients (92%) of the patients with ABI were able to complete the PSFS. The five (8%) who were unable to complete the PSFS had severe cognitive or language impairment. The PSFS score improved by a mean of 2.6 (SD 2.0) points from admission to discharge. The LOTCA score made the strongest unique contribution to explain the change in the PSFS score (beta = 0.477, p= 0.020).

Conclusion

In the present study, most patients with ABI (92%) were able to complete the PSFS. Cognitive function on admission was a predictor of improved functioning on the PSFS.

A Systematic Review of Thirty-One Assessment Tests to Evaluate Mobility in Older Adults

Assessments of gait, balance, and transfer in elderly people play a valuable role in maintaining healthy aging and preventing a decline in mobility. Several evaluation tools have been proposed; however, clinicians should select the most accurate ones wisely, based on numerous criteria. This systematic review aims to identify all applicable elderly mobility assessment tests and show their measurement properties with as much detail as possible. Initially, a broad search was performed. Articles were screened based on their titles and abstracts, and only studies published in English were considered. Based on our inclusion and exclusion criteria, 31 assessment tests evaluating the mobility of healthy elderly people were found. Then, further searches were completed to identify the measurement properties of each test. These characteristics include the origin and year of establishment, several practicality factors, and validity. The analysis of our outcomes illustrates the similarities and differences between the identified tests.

Face validity of the youth Multiple Errands Test (yMET) in the community: A focus group and pilot study

Introduction

During late adolescence and early adulthood, maturation of cognitive functions including executive functions are occurring. The multiple errands test is an assessment of real-world executive functions and, to date, non-virtual reality multiple errands test research has focused primarily on adults with acquired brain injury in hospital settings. There is poor evidence across multiple errands test studies for content and face validity and limited studies in the community. This study aimed to explore multiple errands test face validity for typically developing youth (age 16–24 years) and describe their community setting performance on a youth multiple errands test.

Methods

A youth focus group ( N = 5) was conducted to explore perceptions of the multiple errands test. From their input, the youth multiple errands test was developed and pilot tested ( N = 9) in a shopping mall.

Results

Two themes emerged from focus group analysis and limited changes, relevant to youth, were made to develop the youth multiple errands test. The focus group and pilot study found the youth multiple errands test was acceptable and cognitively challenging for youth, with older youth performing better than younger youth. Overall youth multiple errands test performance suggests similarities to healthy adults in previous studies.

Conclusion

Findings must be interpreted with caution since the sample was small, but preliminary results indicate that future studies with the youth multiple errands test are feasible and warranted.

Instruments to evaluate mobility capacity of older adults during hospitalization: A systematic review

Independent mobility is a key factor in predicting morbidity and determining hospital discharge readiness for older patients. The main objective was identify and appraise relevant instruments for the measurement of mobility of hospitalized geriatric patients. A systematic review was performed in two consecutive steps. Based on the definition of mobility of the International Classification of Functioning (ICF). Step 1 identified mobility measurement instruments used to assess patients 60 years of age and over hospitalized in acute care or intensive geriatric rehabilitation unit. Aim of the instrument, coverage of mobility construct, applicability (format, training required, administration time and use of assistive devices) were extracted. For each included instrument, Step 2 identified and appraised articles reporting about their measurement properties. Consensus-based Standards for the selection of health status Measurement INstruments (COSMIN) was used by two independent reviewers to critically appraise and compare the measurement properties. Step 1 resulted in 6350 articles, of which 28 articles reported about 17 different instruments. Step 2 retained 11 instruments with 70 articles reporting about their measurement properties in various settings. Judgement-based instruments (n=5) covered the ICF mobility construct more broadly than performance-based measures (n=6). Our results showed that 3 instruments (DEMMI, SPPB and Tinetti scale) had the most extensive and robust measurement properties, and from those, SPPB and DEMMI covered the mobility construct more broadly but SPPB had the longest administration (10-15min). Conclusion SPPB presents the best balance between mobility coverage, measurement properties and applicability to acute care or intensive geriatric rehabilitation unit.

How do assessments of activities of daily living address executive functions: A scoping review

Executive functions (EF) allow persons to adapt to situations arising in daily life and can be affected following acquired brain injury (ABI). Measuring the impact of EF impairments on the accomplishment of activities of daily living (ADL) requires specific assessment tools, but choosing the right tool may be difficult.

PURPOSE

To conduct a scoping review on how assessments of ADL address EF and EF impairments in persons with ABI.

METHOD

A scoping review of literature (peer-reviewed and grey literature) published until August 2014 was conducted. Using a systematic procedure, literature was selected, results were charted, and tools were analysed with respect to their goals, underlying models, psychometric properties and applicability. The analysis also included how tools considered components of EF according to Lezak's model.

RESULTS

12 tools, developed either to assess EF in ADL, independence in ADL considering EF or ADL capacities, were identified and analysed according to multiple criteria.

CONCLUSIONS

This review provides important information about existing tools to assist in tool selection and clinical decision-making related to ABI and EF.

Canadian Physiotherapy Assessment of Clinical Performance: Face and Content Validity

PURPOSE

To investigate face and content validity of a draft measure to be used across Canada to assess physiotherapy students' performance in clinical education, through broad consultation with physiotherapy clinical instructors (CIs) across Canada.

METHODS

An online survey was used to collect input on the draft measure. In addition to demographics, the questionnaire included questions on the preferred rating scale, the items within the measure that should have their own rating scale, and general impressions.

RESULTS

Among the 259 CIs who completed the survey, a discrete rating scale with six anchors and 10 boxes or a continuous-line rating scale with six anchors was preferred. Respondents favoured using one rating scale for each key competency in the Expert role but considered a single rating scale sufficient for assessing the Scholarly Practitioner role. CIs agreed that the proposed measure would allow them to assess a student who was performing poorly or very well. The name Canadian Physiotherapy Assessment of Clinical Performance (ACP) received the most votes in the questionnaire.

CONCLUSIONS

CIs' collective preferences on the design, organization, and naming of the measure they will use in evaluating students are reflected in the second draft of the ACP.

The Instrumental Activity of Daily Living Profile in Aging: A Feasibility Study

BACKGROUND

Dysfunctions in complex activities of daily living (ADLs) are a normal part of the aging process. However, differentiating functional decline associated with healthy aging from the subtle decline experienced by individuals with mild cognitive impairment and early dementia constitutes a challenge. Finding an appropriate tool that can capture these subtle but important functional changes represents a priority.

OBJECTIVES

The aims of this study were to evaluate the feasibility of using the Instrumental Activities of Daily Living Profile (IADL Profile) with elderly participants and to describe their level of difficulty encountered in each task.

METHODS

The tool was administered to a group of 40 elderly participants living in the community.

RESULTS

The IADL Profile was found to be feasible to use in older individuals; the tool also showed sensitivity to the difficulties experienced by this population in everyday functioning.

CONCLUSION

The IADL Profile is a promising ecological tool to evaluate independence in aging and may help to identify individuals with MCI. This tool may also contribute to the development of tailored interventions to enhance everyday functioning in the older population.

A Call for Evidence-based Decision Making When Selecting Outcome Measurement Instruments for Summary of Findings Tables in Systematic Reviews: Results from an OMERACT Working Group

OBJECTIVE

Systematic reviews often struggle with how to combine information when more than 1 instrument is used across studies being synthesized. Different techniques have been suggested based on frequency of use in the literature, or on consensus. We explore an approach blending 2 initiatives: OMERACT (Outcome Measurement in Rheumatology) and COSMIN (Consensus On Selection of Measurement Instruments), and investigate the effects of an evidence-based measurement approach on selection of outcomes.

METHODS

Readings were circulated to attendees registered for a preconference workshop on pain measurement. Three instruments were considered and exercises conducted to engage people in the content and measurement performance of these tools. Consensus was sought that an evidence-based approach could be created for selection of instruments for summary of findings (SoF) tables.

RESULTS

The blending of COSMIN and OMERACT approaches led to an evidence-based approach that depended both on a clear definition of target concept and a review of measurement performance of the instrument. Participants emphasized that conceptual clarity and practical considerations should come before measurement property results.

CONCLUSION

Evidence-based approaches can be adopted for selection of instruments for SoF tables. A research agenda was formulated.

A cross-cultural adaptation of the Upper Limb Functional Index in French Canadian

STUDY DESIGN

Clinical measurement.

INTRODUCTION

The Upper Limb Functional Index (ULFI) is a self-report questionnaire assessing activity limitations/participation restrictions resulting from an upper limb musculoskeletal disorder (UL-MSD). It is suitable for use in a rehabilitation context where clinicians have important time constraints due to a heavy caseload. However, no French version was available until now.

PURPOSE/METHODS

To perform a cross-cultural adaptation of the ULFI in French Canadian and examine the psychometric properties and clinical applicability of the adapted version (ULFI-FC) among 50 bilingual patients.

RESULTS

The ULFI-FC showed high internal consistency (Cronbach α = 0.93), good convergent validity with the original ULFI (r = 0.85) and with the French Canadian version of the Disabilities of the Arm, Shoulder and Hand (r = -0.85) and good applicability.

CONCLUSION

This study supports the suitability of the ULFI-FC for use in a busy rehabilitation setting for French-speaking patients with UL-MSD.

LEVEL OF EVIDENCE

N/A.

Sensibility of a new instrument to assess clinical reasoning in post-graduate orthopaedic manual physical therapy education

Sound application of clinical reasoning (CR) by the physical therapist is critical to achieving optimal patient outcomes. As such, it is important for institutions granting certification in orthopaedic manual physical therapy (OMPT) to ensure that the assessment of CR is sufficiently robust. At present, the dearth of validated instruments to assess CR in OMPT presents a serious challenge to certifying institutions. Moreover, the lack of documentation of the development process for instruments that measure CR pose additional challenges. The purpose of this study is to evaluate the sensibility of a newly developed instrument for assessing written responses to a test of CR in OMPT; a 'pilot' phase that examines instrument feasibility and acceptability. Using a sequential mixed-methods approach, Canadian OMPT examiners were recruited to first review and use the instrument. Participants completed a sensibility questionnaire followed by semi-structured interviews, the latter of which were used to elaborate on questionnaire responses regarding feasibility and acceptability. Eleven examiners completed the questionnaire and interviews. Questionnaire results met previously established sensibility criteria, while interview data revealed participants' (dis)comfort with exerting their own judgment and with the rating scale. Quantitative and qualitative data provided valuable insight regarding content validity and issues related to efficiency in assessing CR competence; all of which will ultimately inform further psychometric testing. While results suggest that the new instrument for assessing clinical reasoning in the Canadian certification context is sensible, future research should explore how rater judgment can be utilized effectively and the mental workload associated with appraising clinical reasoning.

Mobile applications for participation at the shopping mall: content analysis and usability for persons with physical disabilities and communication or cognitive limitations

The aim of this exploratory study was to determine the important features in content and usability of existing mobile applications evaluating environmental barriers and facilitators (EBF) to participation for persons with physical disabilities presenting mild communication or cognitive limitations. A rigorous process based on a user-centered design approach led to the identification of two relevant mobile applications to evaluate the EBF. An accessibility expert, the research team as well as five users then tested the mobile applications in a shopping mall. A thematic content analysis of the research team's and users' comments established 10 categories of key features that adequately respond to the needs of the clientele targeted in this study. In terms of content, granularity and contextualization of the information provided were considered important. With respect to usability, relevant features were place finding, rating system, presentation of results, compatibility, user-friendliness, aesthetics, credibility of the information as well as connectivity/interactiveness. The research team and the users agreed on some aspects such as aesthetics, but had different perspectives on features such as the rating system or the connectivity/interactiveness of the application. The users proposed new features suggesting that the existing mobile applications did not correspond to all their needs.

Reliability of the Cooking Task in adults with acquired brain injury

Acquired brain injury (ABI) often leads to deficits in executive functioning (EF) responsible for severe and long-standing disabilities in daily life activities. The Cooking Task is an ecological and valid test of EF involving multi-tasking in a real environment. Given its complex scoring system, it is important to establish the tool's reliability. The objective of the study was to examine the reliability of the Cooking Task (internal consistency, inter-rater and test-retest reliability). A total of 160 patients with ABI (113 men, mean age 37 years, SD = 14.3) were tested using the Cooking Task. For test-retest reliability, patients were assessed by the same rater on two occasions (mean interval 11 days) while two raters independently and simultaneously observed and scored patients' performances to estimate inter-rater reliability. Internal consistency was high for the global scale (Cronbach α = .74). Inter-rater reliability (n = 66) for total errors was also high (ICC = .93), however the test-retest reliability (n = 11) was poor (ICC = .36). In general the Cooking Task appears to be a reliable tool. The low test-retest results were expected given the importance of EF in the performance of novel tasks.

Updating the OMERACT filter: discrimination and feasibility

The "Discrimination" part of the OMERACT Filter asks whether a measure discriminates between situations that are of interest. "Feasibility" in the OMERACT Filter encompasses the practical considerations of using an instrument, including its ease of use, time to complete, monetary costs, and interpretability of the question(s) included in the instrument. Both the Discrimination and Reliability parts of the filter have been helpful but were agreed on primarily by consensus of OMERACT participants rather than through explicit evidence-based guidelines. In Filter 2.0 we wanted to improve this definition and provide specific guidance and advice to participants.

How to choose core outcome measurement sets for clinical trials: OMERACT 11 approves filter 2.0

OBJECTIVE

The Outcome Measures in Rheumatology (OMERACT) initiative works to develop core sets of outcome measures for trials and observational studies in rheumatology. At the OMERACT 11 meeting, substantial time was devoted to discussing a conceptual framework and a proposal for a more explicit working process to develop what we now propose to term core outcome measurement sets, collectively termed "OMERACT Filter 2.0."

METHODS

Preconference work included a literature review, and discussion of preliminary proposals through face-to-face discussions and Internet-based surveys with people within and outside rheumatology. At the conference, 5 interactive sessions comprising plenary and small-group discussions reflected on the proposals from the viewpoint of previous and ongoing OMERACT work. These considerations were brought together in a final OMERACT presentation seeking consensus agreement for the Filter 2.0 framework.

RESULTS

After debate, clarification, and agreed alterations, the final proposal suggested all core sets should contain at least 1 measurement instrument from 3 Core Areas: Death, Life Impact, and Pathophysiological Manifestations, and preferably 1 from the area Resource Use. The process of core set development for a health condition starts by selecting core domains within the areas ("core domain set"). This requires literature searches, involvement (especially of patients), and at least 1 consensus process. Next, developers select at least 1 applicable measurement instrument for each core domain. Applicability refers to the original OMERACT Filter and means that the instrument must be truthful (face, content, and construct validity), discriminative (between situations of interest) and feasible (understandable and with acceptable time and monetary costs). Depending on the quality of the instruments, participants formulate either a preliminary or a final "core outcome measurement set." At final vote, 96% of participants agreed "The proposed overall framework for Filter 2.0 is a suitable basis on which to elaborate a Filter 2.0 Handbook."

CONCLUSION

Within OMERACT, Filter 2.0 has made established working processes more explicit and includes a broadly endorsed conceptual framework for core outcome measurement set development.

Identifying a standard set of outcome parameters for the evaluation of orthogeriatric co-management for hip fractures

BACKGROUND AND PURPOSE

Osteoporotic fractures are an increasing problem in the world due to the ageing of the population. Different models of orthogeriatric co-management are currently in use worldwide. These models differ for instance by the health-care professional who has the responsibility for care in the acute and early rehabilitation phases. There is no international consensus regarding the best model of care and which outcome parameters should be used to evaluate these models. The goal of this project was to identify which outcome parameters and assessment tools should be used to measure and compare outcome changes that can be made by the implementation of orthogeriatric co-management models and to develop recommendations about how and when these outcome parameters should be measured. It was not the purpose of this study to describe items that might have an impact on the outcome but cannot be influenced such as age, co-morbidities and cognitive impairment at admission.

METHODS

Based on a review of the literature on existing orthogeriatric co-management evaluation studies, 14 outcome parameters were evaluated and discussed in a 2-day meeting with panellists. These panellists were selected based on research and/or clinical expertise in hip fracture management and a common interest in measuring outcome in hip fracture care.

RESULTS

We defined 12 objective and subjective outcome parameters and how they should be measured: mortality, length of stay, time to surgery, complications, re-admission rate, mobility, quality of life, pain, activities of daily living, medication use, place of residence and costs. We could not recommend an appropriate tool to measure patients' satisfaction and falls. We defined the time points at which these outcome parameters should be collected to be at admission and discharge, 30 days, 90 days and 1 year after admission.

CONCLUSION

Twelve objective and patient-reported outcome parameters were selected to form a standard set for the measurement of influenceable outcome of patients treated in different models of orthogeriatric co-managed care.

Outcome assessment in hip fracture: evaluation of the practicality of commonly-used outcomes in hip fracture studies

INTRODUCTION

Elderly patients are at a major risk for a first hip fracture. The decrease in bone mineral density may account for 60-85% of the variability in fracture risk. Other contributing factors for hip fractures include cognitive impairment as well as impaired mobility and visual depth perception. Dizziness and poor or fair self-perceived health care characteristics are predictive of a second hip fracture. In general, patients over the age of 65 years admitted to a geriatric rehabilitation unit after proximal hip fracture have complex multiple interacting pathologies with 78% having significant co-morbidity. Because of the added co-morbidity, we believed that the choice of outcome assessment in hip fracture studies would reflect the practical qualities of an instrument. The purpose of our study was to evaluate the practicality of functional outcome instruments found in the current literature in the elderly following postoperative hip fracture.

METHODS

We coded the instruments according to the International Classification of Functioning, Disability and Health conceptual framework. 24 different instruments measuring Body Function, 13 instruments evaluating Activity and Participation and 8 composite scores were identified. Practicality was evaluated using four dimensions: respondent burden, examiner burden, score distribution and format compatibility.

RESULTS

All instruments evaluating Body Function were performance-based and used exclusively in rehabilitation trials. Performance-based instruments also correlated with a high score in examiner and respondent burden. Surgical trials mostly adopted the Harris hip score which was rated low in examiner and respondent burden. The SF-36 was rated with an adequate score distribution but low in format compatibility.

DISCUSSION AND CONCLUSION

An instrument with low respondent burden and minimal examiner burden demonstrated better potential for being applicable in randomized trials with elderly hip fracture patients presenting with co-morbidities. In the future we believe that practical qualities should also be considered when developing or utilizing instruments.

Reliability and validity of the telephone administration of the wheelchair outcome measure (WhOM) for middle-aged and older users of power mobility devices

OBJECTIVE

To examine the measurement properties of the tele-phone administration of the Wheelchair Outcome Measure (WhOM).

SUBJECTS

Power mobility device users aged 50-89 years.

METHODS

Two independent cohorts were recruited: (i) a prospective cohort (n = 40) to estimate test-retest reliability and to determine the applicability of the telephone format, and (ii) a cross-sectional cohort to examine construct validity with 3 groups: (a) people waiting for a first power mobility device (n = 44); (b) initial users (n = 35; 1-6 months); and (c) long-term users (n = 39; 12-18 months).

RESULTS

The tool demonstrated good test-retest reliability (intraclass correlation coefficient 0.77-1.00), took 10.9 min (standard deviation = 5.2) to administer and was practical to use over the telephone. Validity testing showed moderate correlations with the Quebec User Evaluation of Satisfaction with Technology (rS = 0.36-0.45) and the Psychosocial Impact of Assistive Devices Scale (rS = 0.31-0.43). WhOM scores could discriminate non-users from users (wait-list vs initial users; wait-list vs long-term users, p < 0.001) and power wheelchair from scooter users (total WhOM scores, p < 0.05).

CONCLUSION

The WhOM is a stable, valid and applicable measure for telephone administration with older power mobility device users. It is moderately linked to satisfaction with the device and to the psychosocial impact of the device, and therefore complements rather than replaces those measures.

Quality criteria and user-friendliness in self-reported questionnaires on cancer-related fatigue: a review

OBJECTIVE

Cancer-related fatigue (CRF) is a distressing, persistent, subjective sense of tiredness or exhaustion that occurs in 70-100% of cancer patients. The purpose of this review was to provide an overview of the quality of research performed on existing CRF self-report questionnaires and compare their reported psychometric properties and user-friendliness.

METHODS

Database searches of CINAHL, Cochrane Library, EMBASE, MEDLINE, Scopus, PEDro, and PsycINFO were undertaken to find published scales. Standardized criteria were used to assess quality and user-friendliness.

RESULTS

Thirty-five articles were included that described 18 questionnaires-seven one-dimensional questionnaires and 11 multidimensional questionnaires. The mean item count was 20.8 (range: 3-83). The mean overall score of the one-dimensional questionnaires was 10.4 of a maximum of 18 points (range: 7.6-14.3). The mean overall score of the multidimensional questionnaires was 9.4 of a maximum of 18 points (range: 4.3-14.4).

CONCLUSION

Recommendations were made for the selection of a scale. We argue in favor of repeatedly reassessing psychometric properties of even established questionnaires to ensure they comply with evermore increasing stringent quality criteria.

Clinimetric evaluation of measurement tools used in hand therapy to assess activity and participation

STUDY DESIGN

Systematic review.

INTRODUCTION

A number of measurement tools with strong clinimetric properties address activities and participation in hand-injured persons.

PURPOSE OF THE STUDY

To evaluate clinimetric quality of measurement tools assessing activities and participation in patients with hand injuries.

METHODS

The electronic databases Medline, Cochrane library, EMBASE, PEDro, Cumulative Index to Nursing and Allied Health Literature (ClNAHL), and Allied and Complementary Medicine Database (AMED) were searched for appropriate literature. Descriptive data of included tools were given, and their clinimetric quality was scored with specific criteria.

RESULTS

The literature search identified 696 publications, referring to 15 measurement tools that met the inclusion criteria. For most of the included tests, applicability was good, whereas information on clinimetric properties was often lacking, especially for the performance tests. Overall, the Disabilities of the Arm, Shoulder, and Hand (DASH) was the most extensively studied tool with positive ratings for all criteria, closely followed by the Michigan Hand Outcomes Questionnaire (MHQ). Of the performance tests, the Functional Dexterity Test (FDT) received the best ratings.

CONCLUSIONS

Optimal measurement tool selection depends highly on the purpose of measurement and the type of hand injury.

LEVEL OF EVIDENCE

2a-.

Connecting with clinicians: opportunities to strengthen rehabilitation research

PURPOSE

This article examines the distinctive opportunities and challenges involved in connecting with clinicians to strengthen rehabilitation research.

METHOD

The relevant literature on various factors that link researchers and clinicians is summarized and discussed.

RESULTS

Links between researchers and clinicians are demonstrated by evidence-based practice, common conceptual background and the development of research capacity. Sustainable partnerships can evolve throughout the research process by using various enduring strategies such as experts' committee as well as novel approaches like communities of practice.

CONCLUSION

This paper reflects the conviction that reducing the gap between research and clinical practice will be facilitated by implementing partnerships originating from both researchers and clinicians.

Issues for the selection of wheelchair-specific activity and participation outcome measures: a review

OBJECTIVES

To use the World Health Organization's International Classification of Functioning, Disability and Health as a framework to identify and to evaluate wheelchair-specific outcome instruments that are useful for measuring activity and participation.

DATA SOURCES

CINHAL, PsychInfo, EMBASE, Google Scholar, Dissertation Abstracts Medline databases, and conference proceedings.

STUDY SELECTION

Activity and participation measures that were specifically intended for adults who use wheelchairs and that were published in English in a peer-reviewed journal were included in this review. Based on electronic database searches using a variety of search terms, articles were identified by title, and appropriate abstracts were retrieved. Articles were obtained for all relevant abstracts. For peer-reviewed measures included in the review, we obtained any instruction manuals and related publications, frequently published in conference proceedings and theses or available electronically, on the development and testing of the measure.

DATA EXTRACTION

Tools included in the review were evaluated based on their conceptual coverage, reliability, validity, responsiveness, usefulness, and wheelchair contribution, which indicated how well the tool isolated the effect of the wheelchair on activity and participation outcomes.

DATA SYNTHESIS

A number of conceptual, psychometric, and applicability issues were identified with the 11 wheelchair-specific measures included in the review. A majority of the measures were mobility focused. No single tool received excellent ratings in all areas of the review. Some of the most frequent issues identified included a failure to account for differences attributable to different wheelchairs and wheelchair seating, limited psychometric testing, and high administrative and respondent burden.

CONCLUSIONS

Good reliability evidence was reported for most of the measures, but validity information was only available for 6 of the 11 measures, and responsiveness information for 3. This review suggests that these measures could be improved with further psychometric testing and with some modification to ensure that the contribution of the wheelchair to activity and participation outcomes is clearly identified.