Systematic Review of Health-Related Work Outcome Measures and Quality Criteria-Based Evaluations of Their Psychometric Properties

How Much Does Presenteeism Change in Response to Interventions or Alterations in Health Status? A Systematic Review and Meta-Analysis Using the COSMIN Methodology

Purpose The purpose of this study was to estimate the extent to which measures of presenteeism among workers change in response to alterations in health status induced by treatment or natural history. Methods We searched eight databases in August 2020 for studies published since 2012 measuring presenteeism longitudinally. Two independent reviewers screened the titles, abstracts, and full-text articles and performed data extraction. Studies were stratified into longitudinal studies using presenteeism as an outcome and measurement studies designed to test the responsiveness of presenteeism measures. We appraised the methodological quality of the measurement studies using the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) risk of bias checklist. Standardized response means (SRMs) for interventional studies where participants reported improvement on anchor measures were quantitatively pooled.Results Our searches returned 2882 results. Eleven measurement studies and 126 longitudinal studies were included. Of the measurement studies (n = 2625 participants), 7 had adequate study quality and 4 studies were deemed doubtful. Anchors and responsiveness methods varied considerably. Our estimate of responsiveness from 5 measurement studies and 4 presenteeism measures is an SRM of 0.85 (95% CI 0.77, 0.92) and Cohen's d of 0.54 (95% CI 0.49, 0.58), translating to an average important change of 17/100. For deterioration, the value is - 17/100. Conclusions We found considerable variation regarding how responsiveness data was reported in measurement studies. There is evidence that responsiveness is strong for four presenteeism measures: the Work Productivity Survey, the Work Functioning Impairment Scale, the Work Role Functioning Questionnaire, and the Nurses Work Functioning Questionnaire.

A general framework for selecting work participation outcomes in intervention studies among persons with health problems: a concept paper

Background

Work participation is important for health and can be considered as engagement in a major area of life which is of significance for most people, but it can also be thought of as fulfilling or discharging a role. Currently, academic research lacks a comprehensive classification of work participation outcomes. The International Classification of Functioning is the foremost model in defining work functioning and its counterpart work disability, but it does not provide a critical (core) set of outcomes. Standardizing the definitions and nomenclature used in the research of work participation would ensure that the outcomes of studies are comparable, and practitioners and guideline developers can better decide what works best. As work participation is a broad umbrella term including outcome categories which need unambiguous differentiation, a framework needs to be developed first.

Aim

To propose a framework which can be used to develop a generic core outcome set for work participation.

Methods

First, we performed a systematic literature search on the concept of (work) participation, views on how to measure it, and on existing classifications for outcome measurements. Next, we derived criteria for the framework and proposed a framework based on the criteria. Last, we applied the framework to six case studies as a proof of concept.

Results

Our literature search provided 2106 hits and we selected 59 studies for full-text analysis. Based on the literature and the developed criteria we propose four overarching outcome categories: (1) initiating employment, (2) having employment, (3) increasing or maintaining productivity at work, and (4) return to employment. These categories appeared feasible in our proof-of-concept assessment with six different case studies.

Conclusion

We propose to use the framework for work participation outcomes to develop a core outcome set for intervention studies to improve work participation.

Extensive variability of work participation outcomes measured in randomized controlled trials: a systematic review

OBJECTIVE

To investigate how work participation outcomes in randomized controlled trials are measured internationally and across disciplines.

STUDY DESIGN AND SETTING

We identified trials that reported on work participation in Medline, Embase, PsycINFO and Cochrane Central published between 2014 and 2019. Screening, selection, and data extraction were done by two authors independently. We grouped outcomes into four categories ("employment status", "absence from work", "at-work productivity loss," and "employability") and created subcategories according to how the outcome was measured.

RESULTS

From 10,022 database hits we selected 269 trials reporting on 435 work participation outcomes. Authors used inconsistent outcome terminology to describe the measured constructs. Grouped in four main categories we identified 70 outcomes that reported on "employment status", 196 on "absence from work" and return-to-work, 132 on "at-work productivity loss," and 37 on "employability" outcomes. Variability in measurement methods existed across all categories. Employment status and absenteeism measures consisted mostly of clinimetrically unvalidated tools. "At-work productivity loss" and "employability" were measured by at least 41 different questionnaires.

CONCLUSION

Extensive variability exists among trials in the measurement of outcomes, measurement methods and measurement instruments that focus on work participation. This study is a first step towards the development of a Core Outcome Set for work participation.

Cross-cultural adaptation, reliability, and validity of the work role functioning questionnaire 2.0 to Persian

PURPOSE

To translate and cross-culturally adapt, the Work Role Functioning Questionnaire 2.0 to Persian (WRFQ-Pr), and evaluate reliability and validity.

MATERIAL AND METHODS

Standardized protocols were followed including forward-backward translation then synthesis/consolidation. Subsequent pilot investigation of the draft WRFQ-Pr (n = 50, male = 68%, age = 33.5 ± 7.3 years) tested the alternative wording and determined face and content validity through readability, understandability, interpretation, and cultural relevance. Participants (n = 288) were recruited from a convenience sample to assess: construct validity through exploratory factor analysis (EFA) using Promax rotation and maximum least squares extraction; and internal consistency using Cronbach's α coefficient. Test-retest reliability was evaluated from the intraclass correlation coefficient (ICC_2.1).

RESULTS

The forward-backward translation was achieved with eight items (1,3,4,5,9,11,12,22) modified and reformulated due to idiomatic issues. Internal consistency for the subscales ranged from α = 0.87-0.95, and the test-retest reliability was ICC_(2,1)=0.92 (CI: 0.89-0.95). The EFA showed a four-factor solution, being identical to the original version, however items 20-22 loaded with items 23-26 in one factor, which was re-named "flexibility and social demand." One item (#26) did not load above the required 0.30 threshold and was removed from the WRFQ-Pr. No floor or ceiling effects were found.

CONCLUSIONS

The WRFQ translation and cross-cultural adaptation to Persian (WRFQ-Pr) was performed successfully. The determined properties of reliability and validity were comparable to those of the original English version.IMPLICATIONS FOR REHABILITATIONThe WRFW can simultaneously evaluate the health status of the worker, the existence of impairments, the involved factors in creating ability/disability at work, and the outcome of the interventions.There is no instrument available for the Persian-speaking population to evaluate related disability at work and the condition of return to work after a rehabilitation intervention.The WRFQ was translated and culturally adapted into Persian.The WRFW-Pr demonstrated excellent internal consistency, test-retest reliability and a four-factor structure.

Presenteeism and Absenteeism Before and After Total Hip and Knee Arthroplasty

BACKGROUND

Absenteeism is costly, yet evidence suggests that presenteeism-illness-related reduced productivity at work-is costlier. We quantified employed patients' presenteeism and absenteeism before and after total joint arthroplasty (TJA).

METHODS

We measured presenteeism (0-100 scale, 100 full performance) and absenteeism using the World Health Organization's Health and Work Performance Questionnaire before and after TJA among a convenience sample of employed patients. We captured detailed information about employment and job characteristics and evaluated how and among whom presenteeism and absenteeism improved.

RESULTS

In total, 636 primary, unilateral TJA patients responded to an enrollment email, confirmed employment, and completed a preoperative survey (mean age: 62.1 years, 55.3% women). Full at-work performance was reported by 19.7%. Among 520 (81.8%) who responded to a 1-year follow-up, 473 (91.0%) were still employed, and 461 (88.7%) had resumed working. Among patients reporting at baseline and 1 year, average at-work performance improved from 80.7 to 89.4. A Wilcoxon signed-rank test indicated that postoperative performance was significantly higher than preoperative performance (P < .0001). The percentage of patients who reported full at-work performance increased from 20.9% to 36.8% (delta = 15.9%, 95% confidence interval = [10.0%, 21.9%], P < .0001). Presenteeism gains were concentrated among patients who reported declining work performance leading up to surgery. Average changes in absences were relatively small. Combined, the average monthly value lost by employers to presenteeism declined from 15.3% to 8.3% and to absenteeism from 16.9% to 15.5% (ie, mitigated loss of 8.4% of monthly value).

CONCLUSION

Among employed patients before TJA, presenteeism and absenteeism were similarly costly. After, employed patients reported increased performance, concentrated among those with declining performance leading up to surgery.

Effects of Chiropractic Care on Strength, Balance, and Endurance in Active-Duty U.S. Military Personnel with Low Back Pain: A Randomized Controlled Trial

Objectives: To investigate whether chiropractic care influences strength, balance, and/or endurance in active-duty United States military personnel with low back pain (LBP). Design: This study employed a prospective randomized controlled trial using a pragmatic treatment approach. Participants were randomly allocated to 4 weeks of chiropractic care or to a wait-list control. Interventions: Chiropractic care consisted of spinal manipulation, education, advice, and reassurance. Settings/Location: Naval Air Technical Training Center branch clinic at the Naval Hospital Pensacola Florida. Subjects: One hundred ten active-duty military personnel 18-40 years of age with self-reported LBP. Outcome measures: Isometric pulling strength from a semisquat position was the primary outcome. Secondary outcomes were single-leg balance with eyes open and eyes closed, and trunk muscle endurance using the Biering-Sorensen test. Patient-reported outcomes such as pain severity and disability were also measured. Outcomes were measured at baseline and 4 weeks. Linear mixed-effects regression models over baseline and 4 weeks were used for analysis. Results: Participants had mean age of 30 years (18-40), 17% were female, 33% were non-white, and 86% reported chronic LBP. Mean maximum pulling strength in the chiropractic group increased by 5.08 kgs and decreased by 7.43 kgs in the wait-list group, with a statistically significant difference in mean change between groups (p = 0.003). Statistically significant differences in mean change between groups were also observed in trunk muscle endurance (13.9 sec, p = 0.002) and balance with eyes closed (0.47 sec, p = 0.01), but not in balance with eyes open (1.19 sec, p = 0.43). Differences in mean change between groups were statistically significant in favor of chiropractic for LBP-related disability, pain intensity and interference, and fear-avoidance behavior. Conclusions: Active-duty military personnel receiving chiropractic care exhibited improved strength and endurance, as well as reduced LBP intensity and disability, compared with a wait-list control.

The importance of physical and mental health in explaining health-related academic role impairment among college students

Research consistently documents high rates of mental health problems among college students and strong associations of these problems with academic role impairment. Less is known, though, about prevalence and effects of physical health problems in relation to mental health problems. The current report investigates this by examining associations of summary physical and mental health scores from the widely-used Short-Form 12 (SF-12) Health Survey with self-reported academic role functioning in a self-report survey of 3,855 first-year students from five universities in the northeastern United States (US; mean age 18.5; 53.0% female). The mean SF-12 physical component summary (PCS) score (55.1) was half a standard deviation above the benchmark US adult population mean. The mean SF-12 mental component summary (MCS) score (38.2) was more than a full standard deviation below the US adult population mean. Two-thirds of students (67.1%) reported at least mild and 10.5% severe health-related academic role impairment on a modified version of the Sheehan Disability Scale. Both PCS and MCS scores were significantly and inversely related to these impairment scores, but with nonlinearities and interactions and much stronger associations involving MCS than PCS. Simulation suggests that an intervention that improved the mental health of all students with scores below the MCS median to be at the median would result in a 61.3% reduction in the proportion of students who experienced severe health-related academic role impairment. Although low-cost scalable interventions exist to address student mental health problems, pragmatic trials are needed to evaluate the effectiveness of these interventions in reducing academic role impairment.

Rasch analysis of the upper-limb subscale of the stroke rehabilitation assessment of movement (STREAM) tool in an acute stroke cohort Rasch analysis of the upper-limb subscale of the STREAM tool in an acute stroke population

BACKGROUND

Stroke is a leading cause of disability worldwide. The most common impairment resulting from stroke is upper-limb weakness.

OBJECTIVES

To determine the usefulness and psychometric validity of the upper-limb subscale of the STREAM in an acute stroke population.

METHODS

Rasch Analysis, including unidimensionality assumption testing, determining model fit, and analysis of: reliability, residual correlations, and differential item functioning.

RESULTS

125 individuals were assessed using the upper-limb subscale of the Stroke Rehabilitation Assessment of Movement (STREAM) tool. Rasch analysis suggests the STREAM is a unidimensional measure. However, when scored using the originally proposed method (0-2), or using the response pattern (0-5) neither variant fit the Rasch model (p < 0.05). Although, the reliability was good (Person-Separation Index - 0.847 and 0.903, respectively). Correcting for the disordered thresholds, and thereby producing the new scoring pattern, led to substantial improvement in the overall fit (chi-square probability of fit - 22%), however, the reliability was slightly reduced (PSI - 0.806).

CONCLUSIONS

The study proposes a new scoring method for the upper-limb subscale of the STREAM outcome measure in the acute stroke population.

The sink or SWIM hypothesis; a roadmap from pathology to work instability

PURPOSE

Selecting the most appropriate health-related work outcome to evaluate an intervention can be fraught with difficulty. To aid clinicians in navigating this problem we have developed a model, which illustrates how pathology can affect specific measureable quantities, such as work instability.

METHODS

Using a modified-Delphi procedure, a panel of experts met initially to analyze the content of 95 health-related work outcome measures and organize the identified areas of measurement into a coherent model, complemented by a narrative review of the literature. This initial model underwent two rounds of stakeholder-based feedback, the results of which were incorporated in the final expert panel meeting to produce the States-traits Work Instability Model (SWIM).

RESULTS

The States-traits Work Instability Model (SWIM) illustrates how changes to an individual's physical and psychological states and traits might affect their work-related performance, well-being and self-efficacy. Moreover, each concept utilized in the model was specifically selected as it represents a measurable quantity, for which there are tools available.

CONCLUSION

The SWIM is arguably the first holistic model of work that is based on both the clinical realities of vocational rehabilitation, sociological research, and is born from analyzing the basis of practical measurements. Implications for Rehabilitation Work Instability   • Work instability has multiple causes many of which are amenable to intervention   • The model clarifies the measureable domains of vocational rehabilitation interventions, which is of particular benefit for services working with people with disability at work who are struggling to remain in work   • The model conceptualizes how the potential areas for intervention may be related based on evidence available in the literature.