Measurement properties of disease-specific questionnaires in patients with neck pain: a systematic review

Assessment of the wish to hasten death in patients with advanced disease: A systematic review of measurement instruments

BACKGROUND

Patients with advanced conditions may present a wish to hasten death. Assessing this wish is complex due to the nature of the phenomenon and the difficulty of conceptualising it.

AIM

To identify and analyse existing instruments for assessing the wish to hasten death and to rate their reported psychometric properties.

DESIGN

Systematic review based on PRISMA guidelines. The COnsensus-based Standards for the selection of health Measurement INstruments checklist was used to evaluate the methodological quality of validation studies and the measurement properties of the instrument described.

DATA SOURCES

The CINAHL, PsycINFO, Pubmed and Web of Science databases were searched from inception to November 2015.

RESULTS

A total of 50 articles involving assessment of the wish to hasten death were included. Eight concerned instrument validation and were evaluated using COnsensus-based Standards for the selection of health Measurement INstruments criteria. They reported data for between two and seven measurement properties, with ratings between fair and excellent. Of the seven instruments identified, the Desire for Death Rating Scale or the Schedule of Attitudes toward Hastened Death feature in 48 of the 50 articles. The Schedule of Attitudes toward Hastened Death is the most widely used and is the instrument whose psychometric properties have been most often analysed. Versions of the Schedule of Attitudes toward Hastened Death are available in five languages other than the original English.

CONCLUSION

This systematic review has analysed existing instruments for assessing the wish to hasten death. It has also explored the methodological quality of studies that have examined the measurement properties of these instruments and offers ratings of the reported properties. These results will be useful to clinicians and researchers with an interest in a phenomenon of considerable relevance to advanced patients.

Measures of upper limb function for people with neck pain. A systematic review of measurement and practical properties

There is a strong relationship between neck pain (NP) and upper limb disability (ULD). Optimal management of NP should incorporate upper limb rehabilitation and therefore include the use of an ULD measure in the assessment and management process. Clear guidance regarding the suitability of available measures does not exist. The aim of this study was to identify all available measures of ULD for populations with NP, critically evaluate their measurement properties and finally recommend a list of suitable measures. This two-phase systematic review is reported in accordance with the PRISMA statement. Phase one identified clearly reproducible measures of ULD for patients with NP. Phase two identified evidence of their measurement properties. In total, 11 papers evaluating the measurement properties of five instruments were included in this review. The instruments identified were the DASH questionnaire, the QuickDASH questionnaire, the NULI questionnaire, the SFA and the SAMP test. There was limited positive evidence of validity of the DASH, QuickDASH, NULI, SFA and SAMP. There was limited positive evidence of reliability of the NULI, SFA and SAMP. There was unknown evidence of responsiveness of the DASH and QuickDASH. Although all measures are supported by a limited amount of low quality evidence, the DASH, QuickDASH, NULI questionnaires, and the SAMP test are promising measures, but they require further robust evaluation.

Instruments to evaluate mobility capacity of older adults during hospitalization: A systematic review

Independent mobility is a key factor in predicting morbidity and determining hospital discharge readiness for older patients. The main objective was identify and appraise relevant instruments for the measurement of mobility of hospitalized geriatric patients. A systematic review was performed in two consecutive steps. Based on the definition of mobility of the International Classification of Functioning (ICF). Step 1 identified mobility measurement instruments used to assess patients 60 years of age and over hospitalized in acute care or intensive geriatric rehabilitation unit. Aim of the instrument, coverage of mobility construct, applicability (format, training required, administration time and use of assistive devices) were extracted. For each included instrument, Step 2 identified and appraised articles reporting about their measurement properties. Consensus-based Standards for the selection of health status Measurement INstruments (COSMIN) was used by two independent reviewers to critically appraise and compare the measurement properties. Step 1 resulted in 6350 articles, of which 28 articles reported about 17 different instruments. Step 2 retained 11 instruments with 70 articles reporting about their measurement properties in various settings. Judgement-based instruments (n=5) covered the ICF mobility construct more broadly than performance-based measures (n=6). Our results showed that 3 instruments (DEMMI, SPPB and Tinetti scale) had the most extensive and robust measurement properties, and from those, SPPB and DEMMI covered the mobility construct more broadly but SPPB had the longest administration (10-15min). Conclusion SPPB presents the best balance between mobility coverage, measurement properties and applicability to acute care or intensive geriatric rehabilitation unit.

Psychometric evaluation of the Signs of Depression Scale with a revised scoring mechanism in stroke patients with communicative impairment

OBJECTIVES

To investigate (1) the diagnostic value of the Signs of Depression Scale (SODS) in a Likert scale format and (2) whether the Likert scale improves the diagnostic value compared with the original dichotomous scale.

DESIGN

Cross-sectional multicentre study.

SETTING

One general and one university hospital in the Netherlands.

SUBJECTS

A total of 116 consecutive hospitalized stroke patients, of whom 53 were patients with communicative impairment.

MAIN MEASURES

Depression was diagnosed with the Composite International Diagnostic Interview (CIDI) administered to the patients' relatives. The Barthel Index (BI) was used as an external validator.

RESULTS

The correlation between the CIDI and the SODS-Likert or the SODS was small ( r_b = 0.18), and the correlation between the Barthel Index and the SODS-Likert ( r_s = -0.30) or the SODS ( r_s = -0.33) was moderate. For both instruments, the discriminatory power for diagnosing depression when compared with the CIDI was best at a cut-off score of ⩾2. The internal consistency of the SODS-Likert was acceptable (α = 0.69) and slightly higher than that of the SODS (α = 0.57). The inter-rater reliability of the SODS-Likert and the SODS was acceptable (intraclass correlation coefficient (ICC) 0.66 and ICC 0.80, respectively). The clinical utility was rated good.

CONCLUSION

The diagnostic value of the SODS did not improve using a Likert scale format. However, the diagnostic value of the original dichotomous SODS is reasonable for the initial mood assessment of stroke patients with communicative impairment.

A Systematic Review of Measurement Properties of Patient-Reported Outcome Measures Used in Patients Undergoing Total Knee Arthroplasty

BACKGROUND

While clinical research on total knee arthroplasty (TKA) outcomes is prevalent in the literature, studies often have poor methodological and reporting quality. A high-quality patient-reported outcome instrument is reliable, valid, and responsive. Many studies evaluate these properties, but none have done so with a systematic and accepted method. The objectives of this study were to identify patient-reported outcome measures (PROMs) for TKA, and to critically appraise, compare, and summarize their psychometric properties using accepted methods.

METHODS

MEDLINE, EMBASE, SCOPUS, Web of Science, PsycINFO, and SPORTDiscus were systematically searched for articles with the following inclusion criteria: publication before December 2014, English language, non-generic PRO, and evaluation in the TKA population. Methodological quality and evidence of psychometric properties were assessed with the COnsensus-based standards for the selection of health Status Measurement INstruments (COSMIN) checklist and criteria for psychometric evidence proposed by the COSMIN group and Terwee et al.

RESULTS

One-hundred fifteen studies on 32 PROMs were included in this review. Only the Work, Osteoarthritis or joint-Replacement Questionnaire, the Oxford Knee Score, and the Western Ontario and McMaster Universities Arthritis Index had 4 or more properties with positive evidence.

CONCLUSION

Most TKA PROMs have limited evidence for their psychometric properties. Although not all the properties were studied, the Work, Osteoarthritis or joint-Replacement Questionnaire, with the highest overall ratings, could be a useful PROM for evaluating patients undergoing TKA. The methods and reporting of this literature can improve by following accepted guidelines.

Urdu version of the neck disability index: a reliability and validity study

BACKGROUND

Despite the wide use of the neck disability index (NDI) for assessing disability in patients with neck pain, the NDI has not yet been translated and validated in Urdu. The first purpose of the present study was to translate and cross-culturally adapt the NDI into the Urdu language (NDI-U). The second purpose was to investigate the reliability, validity and responsiveness of the NDI-U in Urdu-speaking patients experiencing chronic mechanical neck pain (CMNP).

METHODS

Translation and cross-cultural adaptation of the original version of the NDI were carried out using previously described procedures. Seventy-six patients with CMNP and thirty healthy participants were recruited for the study. NDI-U and visual analogue scales for pain intensity (VASpain) and disability (VASdisability) were administered to all the participants at baseline and to the patients 3 weeks after receiving physiotherapy intervention. The global rating of change scale (GROC) was also administered at this time. Test-retest reliability and internal consistency were carried out on forty-six randomly selected patients two days after they completed the NDI-U. The NDI-U was evaluated for factor analysis, content validity, construct validity (discriminative and convergent validity) and responsiveness.

RESULTS

An intra-class correlation coefficient (ICC2,1) revealed excellent test-retest reliability for all items (ICC2,1 = 0.86-0.98) and total scores (ICC2,1 = 0.99) of the NDI-U. The NDI-U was found internally consistent with a Cronbach's alpha of 0.90 and a fair to good correlation between single items and the NDI-U total scores (r = 0.34 to 0.89). Factor analysis of the NDI-U produced two factors explaining 66.71% of the variance. Content validity was good, as no floor or ceiling effects were detected for the NDI-U total score. To determine discriminative validity, an independent t-test revealed a significant difference in the NDI-U total scores between the patients and healthy controls (P < 0.001). For convergent validity, Pearson's correlation coefficient showed a strong correlation between NDI-U and VASdisability (r = 0.83, P < 0.001) and a moderate correlation between NDI-U and VASpain (r = 0.62, P < 0.001). To measure responsiveness, an independent t-test showed a significant difference in the NDI-U change scores between the stable and the improved groups (P < 0.001). Furthermore, moderate correlations were found between the NDI-U change scores and the GROC (r = 0.50, P < 0.001), VASdisability change scores (r = 0.58, P < 0.001) and VASpain change scores (r = 0.55, P < 0.001).

CONCLUSION

The results showed that the NDI-U is a reliable, valid and responsive questionnaire to measure disability in Urdu-speaking patients with CMNP.

Do Subjects with Whiplash-Associated Disorders Respond Differently in the Short-Term to Manual Therapy and Exercise than Those with Mechanical Neck Pain?

Objective

To compare the short-term effects of manual therapy and exercise on pain, related disability, range of motion, and pressure pain thresholds between subjects with mechanical neck pain and whiplash-associated disorders.

Methods

Twenty-two subjects with mechanical neck pain and 28 with whiplash-associated disorders participated. Clinical and physical outcomes including neck pain intensity, neck-related disability, and pain area, as well as cervical range of motion and pressure pain thresholds over the upper trapezius and tibialis anterior muscles, were obtained at baseline and after the intervention by a blinded assessor. Each subject received six sessions of manual therapy and specific neck exercises. Mixed-model repeated measures analyses of covariance (ANCOVAs) were used for the analyses.

Results

Subjects with whiplash-associated disorders exhibited higher neck-related disability ( P  = 0.021), larger pain area ( P  = 0.003), and lower pressure pain thresholds in the tibialis anterior muscle ( P  = 0.009) than those with mechanical neck pain. The adjusted ANCOVA revealed no between-group differences for any outcome (all P  > 0.15). A significant main effect of time was demonstrated for clinical outcomes and cervical range of motion with both groups experiencing similar improvements (all P  < 0.01). No changes in pressure pain thresholds were observed in either group after treatment ( P  > 0.222).

Conclusions

The current clinical trial found that subjects with mechanical neck pain and whiplash-associated disorders exhibited similar clinical and neurophysiological responses after a multimodal physical therapy intervention, suggesting that although greater signs of central sensitization are present in subjects with whiplash-associated disorders, this does not alter the response in the short term to manual therapy and exercises.

Core outcome sets for research and clinical practice

BACKGROUND

This masterclass introduces the topic of core outcome sets, describing rationale and methods for developing them, and providing some examples that are relevant for clinical research and practice.

METHOD

A core outcome set is a minimum consensus-based set of outcomes that should be measured and reported in all clinical trials for a specific health condition and/or intervention. Issues surrounding outcome assessment, such as selective reporting and inconsistency across studies, can be addressed by the development of a core set. As suggested by key initiatives in this field (i.e. OMERACT and COMET), the development requires achieving consensus on: (1) core outcome domains and (2) core outcome measurement instruments. Different methods can be used to reach consensus, including: literature systematic reviews to inform the process, qualitative research with clinicians and patients, group discussions (e.g. nominal group technique), and structured surveys (e.g. Delphi technique). Various stakeholders should be involved in the process, with particular attention to patients.

RESULTS AND CONCLUSIONS

Several COSs have been developed for musculoskeletal conditions including a longstanding one for low back pain, IMMPACT recommendations on outcomes for chronic pain, and OMERACT COSs for hip, knee and hand osteoarthritis. There is a lack of COSs for neurological, geriatric, cardio-respiratory and pediatric conditions, therefore, future research could determine the value of developing COSs for these conditions.

Measurement properties of quality-of-life measurement instruments for infants, children and adolescents with eczema: a systematic review

BACKGROUND

Quality of life (QoL) is one of the core outcome domains identified by the Harmonising Outcome Measures for Eczema (HOME) initiative to be assessed in every eczema trial. There is uncertainty about the most appropriate QoL instrument to measure this domain in infants, children and adolescents.

OBJECTIVES

To systematically evaluate the measurement properties of existing measurement instruments developed and/or validated for the measurement of QoL in infants, children and adolescents with eczema.

METHODS

A systematic literature search in PubMed and Embase, complemented by a thorough hand search of reference lists, retrieved studies on measurement properties of eczema QoL instruments for infants, children and adolescents. For all eligible studies, we judged the adequacy of the measurement properties and the methodological study quality with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. Results from different studies were summarized in a best-evidence synthesis and formed the basis to assign four degrees of recommendation.

RESULTS

Seventeen articles, three of which were found by hand search, were included. These 17 articles reported on 24 instruments. No instrument can be recommended for use in all eczema trials because none fulfilled all required adequacy criteria. With adequate internal consistency, reliability and hypothesis testing, the U.S. version of the Childhood Atopic Dermatitis Impact Scale (CADIS), a proxy-reported instrument, has the potential to be recommended depending on the results of further validation studies. All other instruments, including all self-reported ones, lacked significant validation data.

CONCLUSIONS

Currently, no QoL instrument for infants, children and adolescents with eczema can be highly recommended. Future validation research should primarily focus on the CADIS, but also attempt to broaden the evidence base for the validity of self-reported instruments.

Comparison of psychometric properties between usual-week and past-week self-reported physical activity questionnaires: a systematic review

The aim was to critically appraise the methodological quality of studies and determine the psychometric qualities of Past-week and Usual-week Physical Activity Questionnaires (PAQs). Data sources were obtained from Pubmed and Embase. The eligibility criteria for selecting studies included: 1) at least one psychometric property of PAQs was examined in adults; 2) the PAQs either had a recall period of usual 7-days (Usual-week PAQs) within the past 12 months or during the past 7-days (Past-week PAQs); and 3) PAQs were self-administered. Study quality was evaluated using the COSMIN taxonomy and the overall psychometric qualities evaluated using pre-established psychometric criteria. Overall, 45 studies were reviewed to assess the psychometric properties of 21 PAQs with the methodological quality of most studies showing good to excellent ratings. When the relationship between PAQs and other instruments (i.e., convergent validity) were compared between recall methods, Past-week PAQs appeared to have stronger correlations than Usual-week PAQs. For the overall psychometric quality, the Incidental and Planned Exercise Questionnaire for the Usual-week (IPEQ-WA) and for the Past-week (IPEQ-W) had the greatest number of positive ratings. For all included PAQs, very few psychometric properties were assessed with poor ratings for the majority of the overall qualities of psychometric properties indicating the limitation of current PAQs. More research that covers a greater spectrum of psychometric properties is required to gain a better understanding of the qualities of current PAQs.

Measurement of outcomes for patients with centralising versus non-centralising neck pain

OBJECTIVE

The purpose of this study is to determine whether individuals with neck pain who demonstrate centralisation of symptoms have more favourable outcome than individuals who do not demonstrate centralisation.

METHODS

Eleven subjects with neck pain were evaluated and treated by two physical therapists certified in Mechanical Diagnosis and Therapy (MDT). Eleven physical therapy patients underwent a routine initial evaluation and were treated 2-3 times per week using MDT principles and other physical therapy interventions. The Neck Disability Index (NDI) tool was administered at the initial examination, approximately 2 weeks following the initial examination, each subsequent re-evaluation, and at discharge from the study to measure changes in functional outcomes for each subject. Patients continued with treatments until they were discharged or removed from the study. Four subjects were referred back to their physician by treating physical therapist secondary to non-centralisation (NC) and worsening of symptoms.

RESULTS

Of the 11 subjects, six demonstrated centralisation (CEN) and five demonstrated NC. At initial evaluation, the average NDI score for the CEN group was 51.0 (SD ± 19.4) and 56.4 (SD ± 17.6) for the NC group. For the CEN group, the average change in NDI score between initial evaluation and discharge was 41.2 (SD ± 13.2 and 12.2 (SD ± 13.0) for the NC group. The correlation coefficient of CEN and change in NDI score was 0.772 and was statistically significant (P = 0.005).

CONCLUSIONS

In this limited sample, people with neck pain demonstrated more favourable outcomes when the CEN phenomenon was observed. Future research on CEN should be investigated with a larger sample size and with a greater number of clinicians trained in the MDT approach.

Health-related quality-of-life outcome measures in paediatric palliative care: A systematic review of psychometric properties and feasibility of use

BACKGROUND

The number of children worldwide requiring palliative care services is increasing due to advances in medical care and technology. The use of outcome measures is important to improve the quality and effectiveness of care.

AIM

To systematically identify health-related quality-of-life outcome measures that could be used in paediatric palliative care and examine their feasibility of use and psychometric properties.

DESIGN

A systematic literature review and analysis of psychometric properties.

DATA SOURCES

PsychInfo, Medline and EMBASE were searched from 1 January 1990 to 10 December 2014. Hand searches of the reference list of included studies and relevant reviews were also performed.

RESULTS

From 3460 articles, 125 papers were selected for full-text assessment. A total of 41 articles met the eligibility criteria and examined the psychometric properties of 22 health-related quality-of-life measures. Evidence was limited as at least half of the information on psychometric properties per instrument was missing. Measurement error was not analysed in any of the included articles and responsiveness was only analysed in one study. The methodological quality of included studies varied greatly.

CONCLUSION

There is currently no 'ideal' outcome assessment measure for use in paediatric palliative care. The domains of generic health-related quality-of-life measures are not relevant to all children receiving palliative care and some domains within disease-specific measures are only relevant for that specific population. Potential solutions include adapting an existing measure or developing more individualized patient-centred outcome and experience measures. Either way, it is important to continue work on outcome measurement in this field.

Evaluating the Psychometric Properties of the Eating Assessment Tool (EAT-10) Using Rasch Analysis

Early and reliable screening for oropharyngeal dysphagia (OD) symptoms in at-risk populations is important and a crucial first stage in effective OD management. The Eating Assessment Tool (EAT-10) is a commonly utilized screening and outcome measure. To date, studies using classic test theory methodologies report good psychometric properties, but the EAT-10 has not been evaluated using item response theory (e.g., Rasch analysis). The aim of this multisite study was to evaluate the internal consistency and structural validity and conduct a preliminary investigation of the cross-cultural validity of the EAT-10; floor and ceiling effects were also checked. Participants involved 636 patients deemed at risk of OD, from outpatient clinics in Spain, Turkey, Sweden, and Italy. The EAT-10 and videofluoroscopic and/or fiberoptic endoscopic evaluation of swallowing were used to confirm OD diagnosis. Patients with esophageal dysphagia were excluded to ensure a homogenous sample. Rasch analysis was used to investigate person and item fit statistics, response scale, dimensionality of the scale, differential item functioning (DIF), and floor and ceiling effect. The results indicate that the EAT-10 has significant weaknesses in structural validity and internal consistency. There are both item redundancy and lack of easy and difficult items. The thresholds of the rating scale categories were disordered and gender, confirmed OD, and language, and comorbid diagnosis showed DIF on a number of items. DIF analysis of language showed preliminary evidence of problems with cross-cultural validation, and the measure showed a clear floor effect. The authors recommend redevelopment of the EAT-10 using Rasch analysis.

Subjective sleep measures for adolescents: a systematic review

BACKGROUND

Sleep disturbances in adolescents have received significant attention because of their high prevalence and the negative health outcomes. Relative to objective measures, subjective sleep instruments have been the most practical tools used to identify sleep problems and assess responses to interventions in research and clinical settings. This systematic review aims to examine the psychometric properties of subjective measures that are used to assess sleep quality and disturbances among adolescents, identify the strength and limitation of each measurement and inform recommendations for practice.

METHODS

PubMed, Embase and PsycInfo were searched from 2000 through May 2016. The reference lists of important articles were included if they met the inclusion criteria. The available measures were evaluated and classified as positive, intermediate or poor according to the quality criteria for health status questionnaires.

RESULTS

Thirteen self-reported or parent-reported sleep measures met the inclusion criteria. Of the measurements reviewed, six were generic instruments assessing overall sleep quality and disturbances; five were dimension-specific instruments measuring daytime sleepiness, sleep insufficiency and sleep hygiene; and two were condition-specific instruments for insomnia. None of the subjective sleep measures for adolescents has a psychometric profile with all essential measurement properties. Specifically, the generic sleep measurements capture multiple dimensions but face issues of participant burden and compatibility. Among the domain-specific tools, the Cleveland Adolescent Sleepiness Questionnaire and the Chronic Sleep Reduction Questionnaire have achieved good psychometric merits but need further evaluation for responsiveness. Likewise, essential measurement properties of condition-specific tools for insomnia have yet to be established.

CONCLUSIONS

Because of the limited evidence, no definite recommendations can be made at this point. However, each available measurement has its own uniqueness and strength despite the limitations. Future research on measurement development and evaluation for adolescent sleep is needed to ensure the relevance and suitability to different stages of adolescence and social contexts.

A systematic review of measurement properties of the instruments measuring health-related quality of life in patients with irritable bowel syndrome

PURPOSE

The systematic review of patient-reported outcome instruments can allow the selection of the most appropriate instrument for use in research and clinical practice. There has been no systematic review of the measurement properties of irritable bowel syndrome (IBS)-specific health-related quality-of-life (HRQOL) instruments. The purposes of this study were to identify all available instruments for measuring the IBS-specific HRQOL and to determine which is the most appropriate instrument to apply in clinical practice.

METHODS

A systematic review study was conducted. The MEDLINE, EMBASE, and CINAHL databases were searched. The methodological quality of the included studies was assessed using the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) checklist. The measurement property results of each study were assessed using Terwee's quality criteria.

RESULTS

Seven instruments were identified: The Irritable Bowel Syndrome-Quality of Life (IBS-QOL) instrument was the only one that had been analyzed in multiple studies, with each of the remaining six instruments only being analyzed in a single psychometric study. The IBS-QOL demonstrated moderate positive evidence for internal consistency and reliability and is the best instrument based on the currently available evidence.

CONCLUSIONS

Even though the IBS-QOL is currently the best instrument, there is conflicting evidence for its underlying structural validity. The factor structure or dimensionality of the IBS-QOL needs to be elucidated further.

Psychometric viability of measures of functional performance commonly used for people with dementia: a systematic review of measurement properties

BACKGROUND

Confidence in findings can only be drawn from measurement tools that have sound psychometric properties for the population with which they are used. Within a dementia specific population, measures of physical function have been poorly justified in exercise intervention studies, with justification of measures based on validity or reliability studies from dissimilar clinical populations, such as people with bronchitis or healthy older adults without dementia.

OBJECTIVES

To review the reliability and validity of quantitative measures of pre-identified physical function, as commonly used within exercise intervention literature for adults with dementia.

INCLUSION CRITERIA TYPES OF PARTICIPANTS

Participants were adults, aged 65 years and older, with a confirmed medical diagnosis of dementia.

TYPES OF INTERVENTION(S)/PHENOMENA OF INTEREST

n/a

TYPES OF STUDIES

Desired studies were observational and cross-sectional and that assessed measures from a pre-identified list of measures of physical function.

OUTCOMES

Studies that assessed the psychometric constructs of reliability and validity were targeted. COSMIN taxology was used to define reliability and validity. This included, but were not limited to, Intra-Class Correlations, Kappa, Cronbach's Alpha, Chi Squared, Standard Error of Measurement, Minimal Detectable Change and Limits of Agreement.

SEARCH STRATEGY

Published material was sourced from the following four databases: MEDLINE, EMBASE, CINAHL and ISI Web of Science. Grey literature was searched for using ALOIS, Google Scholar and ProQuest.

METHODOLOGICAL QUALITY

The COSMIN checklist was used to assess methodological quality of included studies. Assessment was completed by two reviewers independently.

DATA EXTRACTION

Reliability and validity data was extracted from included studies using standardized Joanna Briggs Institute data collection forms. Extraction was completed by two reviewers.

DATA SYNTHESIS

A narrative synthesis of measurement properties of the tools used to measure physical function was performed. Quantitative meta-analysis was conducted for Intra-Class Correlation Coefficients only.

RESULTS

With respect to relative reliability, studies reporting assessed measures had intraclass correlation coefficients greater than 0.71, indicating their suitability for use at a group level. However, a consistent finding among studies that included assessment of absolute reliability was that intra individual variation was too large for meaningful measurement of individuals. This was indicated by large Minimal Detectable Change (MDC) scores. Walk Speed has the smallest reported Mimimal Detectable Change score at 0.11m/s. This represented a change of 35% before statistical variation could be eliminated as the cause for this change. All measures had large MDC values. Walk Speed had the smallest MDC values at 0.11m/s, which represented a necessary change of 35%. Only a limited number of studies assessed the validity of measures. This supports the use of these measures in a very narrow selection of circumstances (see Summary of Findings).

CONCLUSIONS

In summary, measures have shown appropriate levels of relative reliability. This supports their use at the group level. However, large levels of intra-individual variation undermine their applicability at the individual level. Limited studies of validity were available to this review, which limits a conclusion on whether measures are valid for people with dementia.

Systematic review of patient-reported outcome measures (PROMs) for assessing disease activity in rheumatoid arthritis

Patient assessment of disease activity in rheumatoid arthritis (RA) may be useful in clinical practice, offering a patient-friendly, location independent, and a time-efficient and cost-efficient means of monitoring the disease. The objective of this study was to identify patient-reported outcome measures (PROMs) to assess disease activity in RA and to evaluate the measurement properties of these measures. Systematic literature searches were performed in the PubMed and EMBASE databases to identify articles reporting on clinimetric development or evaluation of PROM-based instruments to monitor disease activity in patients with RA. 2 reviewers independently selected articles for review and assessed their methodological quality based on the Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) recommendations. A total of 424 abstracts were retrieved for review. Of these abstracts, 56 were selected for reviewing the full article and 34 articles, presenting 17 different PROMs, were finally included. Identified were: Rheumatoid Arthritis Disease Activity Index (RADAI), RADAI-5, Patient-based Disease Activity Score (PDAS) I & II, Patient-derived Disease Activity Score with 28-joint counts (Pt-DAS28), Patient-derived Simplified Disease Activity Index (Pt-SDAI), Global Arthritis Score (GAS), Patient Activity Score (PAS) I & II, Routine Assessment of Patient Index Data (RAPID) 2–5, Patient Reported Outcome-index (PRO-index) continuous (C) & majority (M), Patient Reported Outcome CLinical ARthritis Activity (PRO-CLARA). The quality of reports varied from poor to good. Typically 5 out of 10 clinimetric domains were covered in the validations of the different instruments. The quality and extent of clinimetric validation varied among PROMs of RA disease activity. The Pt-DAS28, RADAI, RADAI-5 and RAPID 3 had the strongest and most extensive validation. The measurement properties least reported and in need of more evidence were: reliability, measurement error, cross-cultural validity and interpretability of measures.

Responsiveness and minimal important change for the ProFitMap-neck questionnaire and the Neck Disability Index in women with neck-shoulder pain

Purpose

The aim was to determine the responsiveness and minimal important change (MIC) of the questionnaire ProFitMap-neck that measures symptoms and functional limitations in women with neck pain. The same measurement properties were determined for Neck Disability Index (NDI) for comparison purposes.

Methods

Longitudinal data were derived from two randomized controlled trials, including 103 and 120 women with non-specific neck pain, with questionnaire measurements performed before and after interventions. Sensitivity and specificity to discriminate between improved and not or little changed participants, based on categorization of a global rating of change scale (GRCS), were determined for the ProFitMap-neck indices and NDI by using area under receiver operating characteristic curves (AUC). Correlations between the GRCS anchor and change scores of the questionnaires were also used to assess responsiveness. The change score that showed the highest combination of sensitivity and specificity was set for MIC.

Results

The ProFitMap-neck indices showed similar responsiveness as NDI with AUC exceeding 0.70 (Range: ProFitMap-neck, 0.74–0.83; NDI, 0.75–0.86). The MIC in the two samples ranged between 6.6 and 13.6 % for ProFitMap-neck indices and 5.2 and 6.3 % for NDI. Both questionnaires had significant correlations with GRCS (Spearman’s rho 0.47–0.72).

Conclusions

Validity of change scores was endorsed for the ProFitMap-neck indices and NDI with adequate ability to discriminate between improved and not or little changed participants. Values of minimal important change were presented.

Knee Injury and Osteoarthritis Outcome Score (KOOS): systematic review and meta-analysis of measurement properties

OBJECTIVE

To conduct a systematic review and meta-analysis to synthesize evidence regarding measurement properties of the Knee injury and Osteoarthritis Outcome Score (KOOS).

DESIGN

A comprehensive literature search identified 37 eligible papers evaluating KOOS measurement properties in participants with knee injuries and/or osteoarthritis (OA). Methodological quality was evaluated using the COSMIN checklist. Where possible, meta-analysis of extracted data was conducted for all studies and stratified by age and knee condition; otherwise narrative synthesis was performed.

RESULTS

KOOS has adequate internal consistency, test-retest reliability and construct validity in young and old adults with knee injuries and/or OA. The ADL subscale has better content validity for older patients and Sport/Rec for younger patients with knee injuries, while the Pain subscale is more relevant for painful knee conditions. The five-factor structure of the original KOOS is unclear. There is some evidence that the KOOS subscales demonstrate sufficient unidimensionality, but this requires confirmation. Although measurement error requires further evaluation, the minimal detectable change for KOOS subscales ranges from 14.3 to 19.6 for younger individuals, and ≥20 for older individuals. Evidence of responsiveness comes from larger effect sizes following surgical (especially total knee replacement) than non-surgical interventions.

CONCLUSIONS

KOOS demonstrates adequate content validity, internal consistency, test-retest reliability, construct validity and responsiveness for age- and condition-relevant subscales. Structural validity, cross-cultural validity and measurement error require further evaluation, as well as construct validity of KOOS Physical function Short form. Suggested order of subscales for different knee conditions can be applied in hierarchical testing of endpoints in clinical trials.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO (CRD42011001603).

Measurement properties of instruments evaluating self-care and related concepts in people with chronic obstructive pulmonary disease: A systematic review

The use of valid and reliable instruments for assessing self-care is crucial for the evaluation of chronic obstructive pulmonary disease (COPD) management programs. The aim of this review is to evaluate the measurement properties and theoretical foundations of instruments for assessing self-care and related concepts in people with COPD. A systematic review was conducted of articles describing the development and validation of self-care instruments. The methodological quality of the measurement properties was assessed using the COSMIN checklist. Ten studies were included evaluating five instruments: three for assessing self-care and self-management and two for assessing self-efficacy. The COPD Self-Efficacy Scale was the most studied instrument, but due to poor study methodological quality, evidence about its measurement properties is inconclusive. Evidence from the COPD Self-Management Scale is more promising, but only one study tested its properties. Due to inconclusive evidence of their measurement properties, no instrument can be recommended for clinical use.

Patient-reported outcome measures for non-specific neck pain validated in the Italian-language: a systematic review

BACKGROUND

Patient-reported outcome measures can improve the management of patients with non-specific neck pain. The choice of measure greatly depends on its content and psychometric properties. Most questionnaires were developed for English-speaking people, and need to undergo cross-cultural validation for use in different language contexts. To help Italian clinicians select the most appropriate tool, we systematically reviewed the validated Italian-language outcome measures for non-specific neck pain, and analyzed their psychometric properties and clinical utility.

METHODS

The search was performed in MEDLINE, EMBASE, CINAHL, Scopus, Web of Science, and Cochrane Library. All articles published in English or Italian regarding the development, translation, or validation of patient-reported outcome measures available in the Italian language were included. Two reviewers independently selected the studies, extracted data, and assessed methodological quality using the COSMIN checklist.

RESULTS

Out of 4891articles screened, 66 were eligible. Overall, they were of poor or fair methodological quality. Four instruments measuring function and disability (Neck Disability Index, Neck Pain and Disability Scale, Neck Bournemouth Questionnaire, and Core Outcome Measures Index), and one measuring activity-related fear of movement (NeckPix©) were identified. Each scale showed some psychometric weaknesses or problems with functioning, and none emerged as a gold standard.

CONCLUSIONS

Several patient-reported outcome measures are now available for assessing Italian people with non-specific neck pain. While the Neck Disability Index is the one most widely used, the Neck Bournemouth Questionnaire appears the most promising tool from a psychometric point of view.

Identifying depression post-stroke in patients with aphasia: a systematic review of the reliability, validity and feasibility of available instruments

Objective:

To identify and critically appraise the evidence for instruments assessing depression in stroke patients with aphasia.

Methods:

The PubMed, CINAHL, Web of Science, Psych Info and Cochrane databases were searched from inception until May 2015.

Results:

Of the 383 titles found in the search, 15 articles met the inclusion criteria and six instruments were identified: The Aphasic Depression Rating Scale, the Clinical Global Impression-Scale, the Stroke Aphasic Depression Questionnaire (four versions), the Signs of Depression Scale, the Visual Analogue Mood Scale (three versions) and the Visual Analogue Self Esteem Scale. Supporting evidence for reliability and validity was limited owing to methodological flaws in the studies influencing the ratings of methodological quality. Feasibility data were available for all instruments. Rating time of the instruments ranged from less than one minute to five minutes, two instruments required extensive training.

Conclusion:

A number of instruments to assess depressive symptoms in patients with aphasia are available. None of the instruments however, were found to be sufficiently investigated and most of the studies identified were of low methodological quality. Given the present evidence, the Stroke Aphasic Depression Questionnaire-10, the Stroke Aphasic Depression Questionnaire-H10 and the Signs of Depression Scale are the most feasible and can be recommended for clinical practice.

Psychometric Properties of the Dutch Version of the Signs of Depression Scale

The early detection of depression after stroke is essential for the optimization of recovery in aphasic stroke patients. The purpose of this study was to evaluate the psychometric properties of the Signs of Depression Scale (SODS), a non-language-based screening instrument. We conducted a cross-sectional study in a sample of 58 stroke patients in a rehabilitation center. The internal consistency and interrater reliability were good (α = .71 and intraclass correlation coefficient [ICC] = .79). The pre-defined hypotheses confirmed the construct validity, and the correlation between the SODS and the Patient Health Questionnaire-9 (PHQ-9) was moderate ( r_b = .32). At a cutoff score of ≥1, the sensitivity was 0.80, and the specificity was 0.39. These findings indicate that the SODS is appropriate to screen for depressive symptoms and can be used by nurses to identify symptoms of depression in patients with aphasia who require further assessment.

Appraising convergent validity of patient-reported outcome measures in systematic reviews: constructing hypotheses and interpreting outcomes

Purpose

Convergent validity is one type of validity that is commonly assessed for patient-reported outcome measures (PROMs). It is assessed by means of “hypothesis testing”: determining whether the scores of the instrument under study correlate with other instruments in the way that one would expect. Authors of systematic reviews on measurement properties for PROMs may encounter validation articles which do not state hypotheses by which convergent validity can be tested. The information in these articles can therefore not be readily used to determine the adequacy of convergent validity. We suggest that in these cases, reviewers construct their own hypotheses. However, constructing hypotheses and interpreting outcomes is not always straightforward, and we wish to aid reviewers based on our own recent experiences with a systematic review on measurement properties.

Recommendations

We have the following recommendations for authors of a systematic review on measurement properties who wish to construct hypotheses for convergent validity: take an active role in judging the suitability of the comparator instruments of validation articles; be transparent about which hypotheses were constructed, the underlying assumptions on which they are based, and whether they were constructed by the authors of the validation article or by the reviewer; discuss unmet hypotheses, especially if convergent validity is judged to be inadequate; and when synthesizing data, add up the results of all hypotheses for one instrument, rather than judging convergent validity per study.

Evaluation of measurement properties of self-administered PROMs aimed at patients with non-specific shoulder pain and "activity limitations": a systematic review

OBJECTIVE

To critically appraise and compare the measurement properties of self-administered patient-reported outcome measures (PROMs) focussing on the shoulder, assessing "activity limitations."

STUDY DESIGN

Systematic review. The study population had to consist of patients with shoulder pain. We excluded postoperative patients or patients with generic diseases. The methodological quality of the selected studies and the results of the measurement properties were critically appraised and rated using the COSMIN checklist.

RESULTS

Out of a total of 3427 unique hits, 31 articles, evaluating 7 different questionnaires, were included. The SPADI is the most frequently evaluated PROM and its measurement properties seem adequate apart from a lack of information regarding its measurement error and content validity.

CONCLUSION

For English, Norwegian and Turkish users, we recommend to use the SPADI. Dutch users could use either the SDQ or the SST. In German, we recommend the DASH. In Tamil, Slovene, Spanish and the Danish languages, the evaluated PROMs were not yet of acceptable validity. None of these PROMs showed strong positive evidence for all measurement properties. We propose to develop a new shoulder PROM focused on activity limitations, taking new knowledge and techniques into account.

Measurement properties of adult quality-of-life measurement instruments for eczema: a systematic review

BACKGROUND

The Harmonising Outcome Measures for Eczema (HOME) initiative has identified quality of life (QoL) as a core outcome domain to be evaluated in every eczema trial. It is unclear which of the existing QoL instruments is most appropriate for this domain. Thus, the aim of this review was to systematically assess the measurement properties of existing measurement instruments developed and/or validated for the measurement of QoL in adult eczema.

METHODS

We conducted a systematic literature search in PubMed and Embase identifying studies on measurement properties of adult eczema QoL instruments. For all eligible studies, we assessed the adequacy of the measurement properties and the methodological quality with the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. A best evidence synthesis summarizing findings from different studies was the basis to assign four degrees of recommendation (A-D).

RESULTS

A total of 15 articles reporting on 17 instruments were included. No instrument fulfilled the criteria for category A. Six instruments were placed in category B, meaning that they have the potential to be recommended depending on the results of further validation studies. Three instruments had poor adequacy in at least one required adequacy criterion and were therefore put in category C. The remaining eight instruments were minimally validated and were thus placed in category D.

CONCLUSIONS

Currently, no QoL instrument can be recommended for use in adult eczema. The Quality of Life Index for Atopic Dermatitis (QoLIAD) and the Dermatology Life Quality Index (DLQI) are recommended for further validation research.

Patient-Reported Mobility: A Systematic Review

OBJECTIVES

To identify the self-administered instruments to assess mobility in adults with disability, to link the mobility assessed by these instruments to the International Classification of Functioning, Disability and Health (ICF), and to evaluate their methodological quality.

DATA SOURCES

Scopus, Science Direct, and Web of Science were systematically searched up to July 2015.

STUDY SELECTION

Studies on the development and validation of self-administered questionnaires in which at least half of the items were related to movement or mobility were included.

DATA EXTRACTION

The mobility assessed by the instruments was classified according to the ICF categories. The methodological quality was assessed according to the Consensus-based Standards for the Selection of Health Measurement Instruments checklist.

DATA SYNTHESIS

Of 5791 articles, 34 studies were eligible for inclusion. Only 10 of the instruments contained items that exclusively assessed mobility. The most frequently linked ICF categories were "changing basic body position" (19.4%), "walking" (14.8%), and "moving around" (13.5%). Measurement properties evaluated included internal consistency (5 studies), reliability (5 studies), measurement error (1 study), content validity (9 studies), structural validity (4 studies), hypotheses testing (6 studies), and responsiveness (1 study). Only content validity obtained the highest quality, probably because the studies included in the review reported the development and initial validation of the instruments.

CONCLUSIONS

Self-administered mobility questionnaires published in the scientific literature assess mobility activities rather than functions related to movement, and do so from the perspective of disability, frequently including self-care and domestic life as domains for assessment. The instruments that presented the highest methodological quality were the Outpatient Physical Therapy Improvement in Movement Assessment Log, the Movement Ability Measure, and the Mobility Activities Measure for Inpatient Rehabilitation Settings.

Mapping the neck disability index to SF-6D in patients with chronic neck pain

Background

This study sought to statistically map the neck disability index (NDI) to the six-dimension health state short form (SF-6D) to estimate algorithms for use in economic analyses in patients with chronic neck pain (CNP).

Methods

The relationships between NDI and SF-6D scores were estimated by using data from a cohort of patients with chronic neck pain (n = 272). By using ordinary least squares (OLS), generalized linear modeling (GLM), censored least absolute deviations (CLAD) and Tobit regression, scores from all 10 items of the NDI instruments were univariately tested against SF-6D values and retained in a multivariate regression model, if statistically significant. The predictive ability of the model was assessed by mean absolute error (MAE), root mean square error (RMSE) and normalized RMSE.

Results

The mean age of the 272 CNP patients was 39.9 ± 12.3 years; 57.8 % of the CNP patients were female. An OLS regression equation that included recreation item of NDI was optimal, with a MAE of 0.04and 0.04 and an RMSE of 0.06and 0.05in the derivation set and validation set, respectively. Predicted utilities accurately represented the observed ones.

Conclusions

We have provided algorithms for the estimation of health state utility values from the response of NDI. Future economic evaluations of the interventions for chronic neck pain could be informed by these algorithms.

Measurement properties of quality of life measurement instruments for infants, children and adolescents with eczema: protocol for a systematic review

BACKGROUND

Eczema is a common chronic or chronically relapsing, inflammatory skin disease that exerts a substantial negative impact on quality of life (QoL). The Harmonising Outcome Measures for Eczema (HOME) initiative has used a consensus-based process which identified QoL as one of the four core outcome domains to be assessed in all eczema clinical trials. A number of measurement instruments exist to measure QoL in infants, children, and adolescents with eczema, and there is a great variability in both content and quality of the instruments used. Therefore, the objective of the proposed research is to comprehensively and systematically assess the measurement properties of the existing measurement instruments that were developed and/or validated for the measurement of patient-reported QoL in infants, children, and adolescents with eczema.

METHODS/DESIGN

This study is a systematic review of the measurement properties of patient-reported measures of QoL developed and/or validated for infants, children, and adolescents with eczema. A systematic literature search will be carried out in MEDLINE via PubMed and EMBASE using a selection of relevant search terms. Eligible studies will be primary empirical studies evaluating, describing, or comparing measurement properties of QoL instruments for infants, children, and adolescents with eczema. Two reviewers will independently perform eligibility assessment and data abstraction. Evidence tables will be used to record study characteristics, instrument characteristics, measurement properties, and interpretability. The adequacy of the measurement properties will be assessed using predefined criteria. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist will be used to evaluate the methodological quality of included studies. A best evidence synthesis will be undertaken if more than one study has examined a particular measurement property.

DISCUSSION

The proposed systematic review will yield a comprehensive assessment of measurement properties of existing QoL instruments in infants, children, and adolescents with eczema. The results will serve as a basis to recommend a QoL measurement instrument for infants, one for children, and one for adolescents for use in future clinical trials.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42015023483.

Child-Report Measures of Occupational Performance: A Systematic Review

Introduction

Improving occupational performance is a key service of occupational therapists and client-centred approach to care is central to clinical practice. As such it is important to comprehensively evaluate the quality of psychometric properties reported across measures of occupational performance; in order to guide assessment and treatment planning.

Objective

To systematically review the literature on the psychometric properties of child-report measures of occupational performance for children ages 2–18 years.

Methods

A systematic search of the following six electronic databases was conducted: CINAHL; PsycINFO; EMBASE; PubMed; the Health and Psychosocial Instruments (HAPI) database; and Google Scholar. The quality of the studies was evaluated against the COSMIN taxonomy of measurement properties and the overall quality of psychometric properties was evaluated using pre-set psychometric criteria.

Results

Fifteen articles and one manual were reviewed to assess the psychometric properties of the six measures–the PEGS, MMD, CAPE, PAC, COSA, and OSA- which met the inclusion criteria. Most of the measures had conducted good quality studies to evaluate the psychometric properties of measures (PEGS, CAPE, PAC, OSA); however, the quality of the studies for two of these measures was relatively weak (MMD, COSA). When integrating the quality of the psychometric properties of the measures with the quality of the studies, the PAC stood out as having superior psychometric qualities.

Conclusions

The overall quality of the psychometric properties of most measures was limited. There is a need for continuing research into the psychometric properties of child-report measures of occupational performance, and to revise and improve the psychometric properties of existing measures.

Additional Effects of a Physical Therapy Protocol on Headache Frequency, Pressure Pain Threshold, and Improvement Perception in Patients With Migraine and Associated Neck Pain: A Randomized Controlled Trial

OBJECTIVE

To evaluate the additional effect provided by physical therapy in migraine treatment.

DESIGN

Randomized controlled trial.

SETTING

Tertiary university-based hospital.

PARTICIPANTS

Among the 300 patients approached, 50 women (age range, 18-55y) diagnosed with migraine were randomized into 2 groups: a control group (n=25) and a physiotherapy plus medication group (n=25) (N=50).

INTERVENTIONS

Both groups received medication for migraine treatment. Additionally, physiotherapy plus medication patients received 8 sessions of physical therapy over 4 weeks, comprised mainly of manual therapy and stretching maneuvers lasting 50 minutes.

MAIN OUTCOME MEASURES

A blinded examiner assessed the clinical outcomes of headache frequency, intensity, and self-perception of global change and physical outcomes of pressure pain threshold and cervical range of motion. Data were recorded at baseline, posttreatment, and 1-month follow-up.

RESULTS

Twenty-three patients experienced side effects from the medication. Both groups reported a significantly reduced frequency of headaches; however, no differences were observed between groups (physiotherapy plus medication patients showed an additional 18% improvement at posttreatment and 12% improvement at follow-up compared with control patients, P>.05). The reduction observed in the physiotherapy plus medication patients was clinically relevant at posttreatment, whereas clinical relevance for control patients was demonstrated only at follow-up. For pain intensity, physiotherapy plus medication patients showed statistical evidence and clinical relevance with reduction posttreatment (P<.05). In addition, they showed better self-perception of global change than control patients (P<.05). The cervical muscle pressure pain threshold increased significantly in the physiotherapy plus medication patients and decreased in the control patients, but statistical differences between groups were observed only in the temporal area (P<.05). No differences were observed between groups regarding cervical range of motion.

CONCLUSIONS

We cannot assume that physical therapy promotes additional improvement in migraine treatment; however, it can increase the cervical pressure pain threshold, anticipate clinically relevant changes, and enhance patient satisfaction.

Patient-Reported Outcome (PRO) questionnaires for people with pain in any spine region. A systematic review

BACKGROUND/OBJECTIVE

This systematic review investigates the measurement properties of Patient-Reported Outcome (PRO) questionnaires which evaluate disability associated with pain in any area of the spine.

METHOD

PRO questionnaires for people with pain in any spinal region were identified from existing systematic reviews and recent studies. Databases were searched for studies which evaluated the measurement properties of the included questionnaires to August 2015. Data synthesis used a levels of evidence approach which considered study methodological quality.

RESULTS

The Extended Aberdeen Back Pain Scale (EA), Functional Rating Index (FRI) and Spine Functional Index (SFI) were identified as eligible for this review. The FRI was evaluated in 15 studies, with positive results for internal consistency, structural validity, hypothesis testing and responsiveness, negative results for measurement error and conflicting results for reliability. The SFI was evaluated in 3 studies with positive results for internal consistency, reliability, content validity, and structural validity. Conflicting results were found for hypothesis testing. The EA was evaluated in 3 studies which found negative results for internal consistency and structural validity.

CONCLUSIONS

The FRI is provisionally recommended for the assessment of disability in people with multi-area spinal pain. This conclusion is based on studies of mainly fair methodological quality.

The burden of neck pain: its meaning for persons with neck pain and healthcare providers, explored by concept mapping

Purpose

To empirically define the concept of burden of neck pain. The lack of a clear understanding of this construct from the perspective of persons with neck pain and care providers hampers adequate measurement of this burden. An additional aim was to compare the conceptual model obtained with the frequently used Neck Disability Index (NDI).

Methods

Concept mapping, combining qualitative (nominal group technique and group consensus) and quantitative research methods (cluster analysis and multidimensional scaling), was applied to groups of persons with neck pain (n = 3) and professionals treating persons with neck pain (n = 2). Group members generated statements, which were organized into concept maps. Group members achieved consensus about the number and description of domains and the researchers then generated an overall mind map covering the full breadth of the burden of neck pain.

Results

Concept mapping revealed 12 domains of burden of neck pain: impaired mobility neck, neck pain, fatigue/concentration, physical complaints, psychological aspects/consequences, activities of daily living, social participation, financial consequences, difficult to treat/difficult to diagnose, difference of opinion with care providers, incomprehension by social environment, and how person with neck pain deal with complaints. All ten items of the NDI could be linked to the mind map, but the NDI measures only part of the burden of neck pain.

Conclusion

This study revealed the relevant domains for the burden of neck pain from the viewpoints of persons with neck pain and their care providers. These results can guide the identification of existing measurements instruments for each domain or the development of new ones to measure the burden of neck pain.

A Systematic Review of the Psychometric Properties of Patient-Reported Outcome Instruments for Use in Patients With Rotator Cuff Disease

BACKGROUND

Many patient-reported outcome instruments (or questionnaires) have been developed for use in patients with rotator cuff disease. Before an instrument is implemented, its psychometric properties should be carefully assessed, and the methodological quality of papers that investigate a psychometric component of an instrument must be carefully evaluated. Together, the psychometric evidence and the methodological quality can then be used to arrive at an estimate of an instrument's quality.

PURPOSE

To identify patient-reported outcome instruments used in patients with rotator cuff disease and to critically appraise and summarize their psychometric properties to guide researchers and clinicians in using high-quality patient-reported outcome instruments in this population.

STUDY DESIGN

Systematic review.

METHODS

Systematic literature searches were performed to find English-language articles concerning the development or evaluation of a psychometric property of a patient-reported outcome instrument for use in patients with rotator cuff disease. Methodological quality and psychometric evidence were critically appraised and summarized through 2 standardized sets of criteria.

RESULTS

A total of 1881 articles evaluating 39 instruments were found per the search strategy, of which 73 articles evaluating 16 instruments were included in this study. The Constant-Murley score, the DASH (Disability of the Arm, Shoulder, and Hand), and the Shoulder Pain and Disability Index were the 3 most frequently evaluated instruments. In contrast, the psychometric properties of the Korean Shoulder Scoring System, Shoulder Activity Level, Subjective Shoulder Value, and Western Ontario Osteoarthritis Shoulder index were evaluated by only 1 study each. The Western Ontario Rotator Cuff Index was found to have the best overall quality of psychometric properties per the established criteria, with positive evidence found in internal consistency, reliability, content validity, hypothesis testing, and responsiveness. The DASH, Shoulder Pain and Disability Index, and Simple Shoulder Test had good evidence in support of internal consistency, reliability, structural validity, hypothesis testing, and responsiveness. Inadequate methodological quality was found across many studies, particularly in internal consistency, reliability, measurement error, hypothesis testing, and responsiveness.

CONCLUSION

More high-quality methodological studies should be performed to assess the properties in all identified instruments.

A Call for Evidence-based Decision Making When Selecting Outcome Measurement Instruments for Summary of Findings Tables in Systematic Reviews: Results from an OMERACT Working Group

OBJECTIVE

Systematic reviews often struggle with how to combine information when more than 1 instrument is used across studies being synthesized. Different techniques have been suggested based on frequency of use in the literature, or on consensus. We explore an approach blending 2 initiatives: OMERACT (Outcome Measurement in Rheumatology) and COSMIN (Consensus On Selection of Measurement Instruments), and investigate the effects of an evidence-based measurement approach on selection of outcomes.

METHODS

Readings were circulated to attendees registered for a preconference workshop on pain measurement. Three instruments were considered and exercises conducted to engage people in the content and measurement performance of these tools. Consensus was sought that an evidence-based approach could be created for selection of instruments for summary of findings (SoF) tables.

RESULTS

The blending of COSMIN and OMERACT approaches led to an evidence-based approach that depended both on a clear definition of target concept and a review of measurement performance of the instrument. Participants emphasized that conceptual clarity and practical considerations should come before measurement property results.

CONCLUSION

Evidence-based approaches can be adopted for selection of instruments for SoF tables. A research agenda was formulated.

Measurement properties of patient-reported outcome measures (PROMs) in adults with obstructive sleep apnea (OSA): A systematic review

This systematic review summarizes the evidence regarding the quality of patient-reported outcome measures (PROMs) validated in patients with obstructive sleep apnea (OSA). We performed a systematic literature search of all PROMs validated in patients with OSA, and found 22 measures meeting our inclusion criteria. The quality of the studies was assessed using the consensus-based standards for the selection of health status measurement instruments (COSMIN) checklist. The results showed that most of the measurement properties of the PROMs were not, or not adequately, assessed. For many identified PROMs there was no involvement of patients with OSA during their development or before the PROM was tested in patients with OSA. Positive exceptions and the best current candidates for assessing health status in patients with OSA are the sleep apnea quality of life index (SAQLI), Maugeri obstructive sleep apnea syndrome (MOSAS) questionnaire, Quebec sleep questionnaire (QSQ) and the obstructive sleep apnea patient-oriented severity index (OSAPOSI). Even though there is not enough evidence to fully judge the quality of these PROMs as outcome measure, when interpreted with caution, they have the potential to add value to clinical research and clinical practice in evaluating aspects of health status that are important to patients.

The Neck Disability Index-Russian Language Version (NDI-RU): A Study of Validity and Reliability

STUDY DESIGN

Cross-cultural adaptation and psychometric testing.

OBJECTIVE

To perform a validated Russian translation and then to evaluate the validity and reliability of the Russian language version of the Neck Disability Index (NDI-RU).

SUMMARY OF BACKGROUND DATA

Neck pain is highly prevalent and can greatly affect daily activity. The Neck Disability Index (NDI) is the most frequently used scale for self-rating of disability due to neck pain. Its translated versions are applied in many countries. However, the Russian language version of the NDI has not been developed yet.

METHODS

Cross-cultural adaptation of the NDI-RU was performed according to established guidelines. Then, the NDI-RU was evaluated for content validity, concurrent criterion validity, internal consistency, test-retest reliability, factor structure, and minimum detectable change.

RESULTS

Two hundred thirty-two patients took part in the study in total: 109 in validity (39.5 ± 10 yr), 123 in reliability (38.4 ± 11 yr; 80 in the test-retest phase). A culturally valid translation was achieved. NDI-RU total scores were distributed normally. Floor/ceiling effects were absent. Good values of Cronbach α were obtained for each item (from 0.80 to 0.84) and for the total NDI-RU (0.83). A 2-factor solution was found for the NDI-RU. The average interitem correlation coefficient was 0.53. Intraclass correlation coefficients for test-retest reliability coefficients ranged from 0.65 to 0.92 for different items and 0.91 for the total NDI-RU. Moderate correlation (Spearman rs = 0.62; P < 0.05) was found between the NDI-RU total score and graphic rating scalepain score. Completion of the NDI-RU takes 3.6 ± 1 minutes.

CONCLUSION

The development of a Russian language version of the Neck Disability Index resulted in a valid, reliable instrument that can be used both in clinical practice and scientific investigations.

LEVEL OF EVIDENCE

1.

Migraine co-existing tension-type headache and neck pain: Validation of questionnaires

Background and aim

Migraine often includes co-existing tension-type headache (TTH) and neck pain (NP). Multiple headache questionnaires assessing headache impact have beendescribed previously; however, none of the existing questionnaires have been designed to cover migraine with co-existing TTH and NP. Therefore a new questionnaire was developed to measure these co-morbidities. The aim was to determine face and content validity of the newly developed questionnaire, “Impact of Migraine, Tension-Type Headache and Neck Pain” (impact M-TTH-NP) and to determine face and content validity of the International Physical Activity Questionnaire (IPAQ short form), Migraine-Specific Quality of Life Questionnaire (MSQ v. 2.1), WHO-Five Well-Being Index (WHO-5), Major Depression Inventory (MDI) and Neck Disability Index (NDI) not yet validated in this target population.

Material and methods

The new multi-dimensional questionnaire “Impact M-TTH-NP” cover pain, triggers, psychosocial, socioeconomic and work related aspects, based on a four-week recall period. The items are rated on an 11-point numeric rating scale with the end points 0 = no impact and 10 = most imaginable impact. Face validity was assessed by migraine patients with co-existing TTH and NP. They were recruited between September 2012 and March 2013 from a tertiary referral headache centre. Nine women with a mean age of 38 years participated in group interviews. The questionnaires were reviewed for relevance and meaningfulness. Content validity was assessed by 13 headache experts. They had worked with headache diseases for an average of 9 (range, 2–38) years. Experts were recruited between August 2012 and October 2012. Nine medical doctors, two physical therapists, one headache nurse and one psychologist (eight women and five men, mean age of 42 years) participated. The experts rated each item of the questionnaires using a four-point Likert scale with the end points 1 = not relevant and 4 = highly relevant. The quantitative measurement of content validity was calculated by the item-level content validity index (I-CVI) and the scale-level content validity average method (S-CVI/Ave). The average deviation (AD) index was used as a measure of interrater agreement.

Results

Impact M-TTH-NP showed acceptable face validity. Of 78 items twelve were revised and one was added based on group interviews and expert review. Seventy-two items (92%) obtained I-CVI≥0.78 (range 0.78–1.00) indicating excellent content validity, 71 items (91%) obtained acceptable AD index. Nine items did not meet either the limit for excellent I-CVI and/or acceptable AD index. The overall S-CVI/Ave was 0.92 indicating an excellent content validity. In addition, four of the five additional questionnaires showed acceptable face validity (MSQ, WHO-5, MDI and NDI) and three showed excellent content validity (WHO-5, MDI and NDI) for patients suffering from migraine and co-existing TTH and NP.

Conclusions and implications

The impact M-TTH-NP questionnaire showed acceptable face validity and excellent content validity and may be useful when evaluating treatment effect in this target group. The new impact M-TTH-NP questionnaire in combination with the additional questionnaires that together assess pain, triggers, psychosocial and socioeconomic aspects may provide a deeper understanding of the complexity of migraine with co-existing TTH and NP

Measurement properties of adult quality-of-life measurement instruments for eczema: protocol for a systematic review

BACKGROUND

Eczema is a common chronic or chronically relapsing skin disease that has a substantial impact on quality of life (QoL). By means of a consensus-based process, the Harmonising Outcome Measures in Eczema (HOME) initiative has identified QoL as one of the four core outcome domains to be assessed in all eczema trials (Allergy 67(9):1111-7, 2012). Various measurement instruments exist to measure QoL in adults with eczema, but there is a great variability in both content and quality (for example, reliability and validity) of the instruments used, and it is not always clear if the best instrument is being used. Therefore, the aim of the proposed research is a comprehensive systematic assessment of the measurement properties of the existing measurement instruments that were developed and/or validated for the measurement of patient-reported QoL in adults with eczema.

METHODS/DESIGN

This study is a systematic review of the measurement properties of patient-reported measures of QoL developed and/or validated for adults with eczema. Medline via PubMed and EMBASE will be searched using a selection of relevant search terms. Eligible studies will be primary empirical studies evaluating, describing, or comparing measurement properties of QoL instruments for adult patients with eczema. Eligibility assessment and data abstraction will be performed independently by two reviewers. Evidence tables will be generated for study characteristics, instrument characteristics, measurement properties, and interpretability. The quality of the measurement properties will be assessed using predefined criteria. Methodological quality of studies will be assessed using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist. A best evidence synthesis will be undertaken if more than one study has investigated a particular measurement property.

DISCUSSION

The proposed systematic review will produce a comprehensive assessment of measurement properties of existing QoL instruments in adult patients with eczema. We aim to identify one best currently available instrument to measure QoL in eczema patients.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42015017138.

Health-related quality of life after TBI: a systematic review of study design, instruments, measurement properties, and outcome

Measurement of health-related quality of life (HRQL) is essential to quantify the subjective burden of traumatic brain injury (TBI) in survivors. We performed a systematic review of HRQL studies in TBI to evaluate study design, instruments used, methodological quality, and outcome. Fifty-eight studies were included, showing large variation in HRQL instruments and assessment time points used. The Short Form-36 (SF-36) was most frequently used. A high prevalence of health problems during and after the first year of TBI was a common finding of the studies included. In the long term, patients with a TBI still showed large deficits from full recovery compared to population norms. Positive results for internal consistency and interpretability of the SF-36 were reported in validity studies. The Quality of Life after Brain Injury instrument (QOLIBRI), European Brain Injury Questionnaire (EBIQ), Child Health Questionnaire (CHQ), and the World Health Organization Quality of Life short version (WHOQOL-BREF) showed positive results, but evidence was limited. Meta-analysis of SF-36 showed that TBI outcome is heterogeneous, encompassing a broad spectrum of HRQL, with most problems reported in the physical, emotional, and social functioning domain. The use of SF-36 in combination with a TBI-specific instrument, i.e., QOLIBRI, seems promising. Consensus on preferred methodologies of HRQL measurement in TBI would facilitate comparability across studies, resulting in improved insights in recovery patterns and better estimates of the burden of TBI.

Kinesiophobia in pre-operative patients with cervical discopathy and coexisting degenerative changes in relation to pain-related variables, psychological state and sports activity

BACKGROUND

No research group has ever investigated the level of kinesiophobia in a well defined group of preoperative patients treated due to cervical discopathy and degenerative spine disease, confirmed by X-ray and magnetic resonance imaging (MRI) examinations. We aimed to investigate the degree of kinesiophobia and the differences in pain-related and psychosocial characteristics between patients with high and low levels of kinesiophobia, in relation to factors commonly associated with neck pain.

MATERIAL/METHODS

Sixty-five consecutive patients with cervical discopathy and coexisting degenerative changes were assessed pre-surgically. The mean pain duration was 31.7 SD 34.0 months. Patients completed the Polish versions of the Tampa Scale for Kinesiophobia (TSK-PL) on 2 occasions, and the following once: Neck Disability Index (NDI-PL), State-Trait Anxiety Inventory (STAI-PL), Coping Strategies Questionnaire (CSQ-PL), and the Visual Analogue Scale (VAS-PL).

RESULTS

A high level of kinesiophobia was indicated in 81.5% and 87.7% of patients in first and second completion, respectively. Patients with high and low kinesiophobia differ in regards to the recreation section of NDI-PL (p=0.012), gender (p=0.043), and sports activity (p=0.024). Correlations were identified between TSK-PL and marital status (p=0.023) and sports activity (p=0.024).

CONCLUSIONS

Kinesiophobia levels are higher in patients with chronic cervical pain before surgical treatment. Fear of movement tends to be higher in women and among patients avoiding sports recreation before surgical treatment. Although sports activity and socio-demographic data are predictors of kinesiophobia, psychological, pain-related, and clinical data are not. These findings should be considered when planning rehabilitation after surgical treatment of cervical discopathy and coexisting degenerative changes.

Sample size used to validate a scale: a review of publications on newly-developed patient reported outcomes measures

PURPOSE

New patient reported outcome (PRO) measures are regularly developed to assess various aspects of the patients' perspective on their disease and treatment. For these instruments to be useful in clinical research, they must undergo a proper psychometric validation, including demonstration of cross-sectional and longitudinal measurement properties. This quantitative evaluation requires a study to be conducted on an appropriate sample size. The aim of this research was to list and describe practices in PRO and proxy PRO primary psychometric validation studies, focusing primarily on the practices used to determine sample size.

METHODS

A literature review of articles published in PubMed between January 2009 and September 2011 was conducted. Three selection criteria were applied including a search strategy, an article selection strategy, and data extraction. Agreements between authors were assessed, and practices of validation were described.

RESULTS

Data were extracted from 114 relevant articles. Within these, sample size determination was low (9.6%, 11/114), and were reported as either an arbitrary minimum sample size (n = 2), a subject to item ratio (n = 4), or the method was not explicitly stated (n = 5). Very few articles (4%, 5/114) compared a posteriori their sample size to a subject to item ratio. Content validity, construct validity, criterion validity and internal consistency were the most frequently measurement properties assessed in the validation studies. Approximately 92% of the articles reported a subject to item ratio greater than or equal to 2, whereas 25% had a ratio greater than or equal to 20. About 90% of articles had a sample size greater than or equal to 100, whereas 7% had a sample size greater than or equal to 1000.

CONCLUSIONS

The sample size determination for psychometric validation studies is rarely ever justified a priori. This emphasizes the lack of clear scientifically sound recommendations on this topic. Existing methods to determine the sample size needed to assess the various measurement properties of interest should be made more easily available.