Reliability and agreement of 5 Ergo-Kit functional capacity evaluation lifting tests in subjects with low back pain

Does category of strength predict return-to-work after occupational injury?

Background

Occupational accidents may lead laborers to lose their working capacities, affecting their physical and mental health. Occupational rehabilitation helps improve the ability of patients with occupational accidents and suggests appropriate jobs to avoid second injuries. This study aimed to identify whether any of the functional capacity evaluation (FCE) strength subtests predicted successful return to work.

Methods

Data were collected of 84 patients receiving government-subsidized occupational rehabilitation between September 2016 and December 2018. A structured questionnaire was employed for pre- and post-training assessment, including basic information, information of the occupational accident, status of the laborer at the opening of the injury case, physical requirement for the job, and physical capacity. Eight subtests of strength were included in the physical capacity evaluation, i.e., carrying, lifting to several levels, power grip, and lateral pinch, to explore the association between the strength tests and return to work.

Results

The unadjusted model showed that for every additional kilogram in bilateral carrying strength before work hardening training, the odds of successful return to work increased (crude odds ratio [OR] = 1.12, 95% confidence interval [CI] = 1.01–1.24, p = 0.027). After adjustment for basic demographic information and pre-accident physical functional elements of work, the odds of successful return to work increased (adjusted OR = 1.27, 95% CI = 1.04–1.54, p = 0.02) for every additional kilogram in the pre-training bilateral carrying strength. There were no statistically significant differences observed in the other seven subtests.

Conclusion

Through thorough evaluation and work hardening training provided in the occupational rehabilitation, patients’ physical capacity can be understood and improved. However, a full evaluation of functional capacities is prolonged and time-consuming. This study provides evidence that pre-work-hardening bilateral carrying strength may be a promising predictor of return to work and we recommend to consider it as a prioritized test to assist in determining appropriate advice regarding return to work.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12889-022-13817-2.

Understanding the Process and Challenges for Return-to-Work Post-Hematopoietic Cell Transplantation from a Musculoskeletal Perspective: A Narrative Review

The current paper seeks to inform healthcare professionals on how adapting various components of return to work (RTW) programs that are already in use by other musculoskeletal rehabilitation settings can help optimize return to work process for patients with or without musculoskeletal manifestations, posthematopoietic cell transplantation. Since there is no universally agreed RTW structure for hematopoietic cell transplant patients, a narrative approach has been taken utilizing evidence from the existing musculoskeletal return to work assessment publications to help draw parallel for the hematopoietic cell transplant patients. Databases were searched including PUBMED, CINHAL, AMED, SCOPUS, and Cochrane using keywords RTW, functional restoration program, hematopoietic cell transplant, bone marrow transplant, stem cell transplant, and musculoskeletal functional assessment. The authors have managed to outline and propose a structured RTW assessment and monitoring program which can aid in getting patients back to employment by utilizing the functional capacity and job evaluation to help hematopoietic cell transplantation patients reintegrate socially. Patients undergoing hematopoietic cell transplant require additional support and a robust assessment system to allow safe RTW. The proposed model of RTW assessment can prove to be beneficial in helping patients return to work safely. Clinical Significance. To acknowledge the individuality in functional limitation is important in determining not only the rehab needs but also the RTW capabilities. The proposed RTW plan not only promotes an individualized approach to patients but also provides a structure for return to work assessments for hematopoietic cell transplantation patients, thus, eliminating the need for guess work by healthcare professionals. In line with the International Classification of Functioning, Disability, and Health (ICF) recommendations, a RTW assessment combined with a job evaluation helps healthcare professionals and stakeholders to understand the unique challenges and strengths of a patient and thereby design an individualized therapy approach.

Updating the Evidence on Functional Capacity Evaluation Methods: A Systematic Review

Objectives To synthesize the evidence on the psychometrics functional capacity evaluation (FCE) methods. Methods A systematic literature search in nine databases. The resulting articles were screened based on predefined in- and exclusion criteria. Two reviewers independently performed this screening. Included studies were appraised based on their methodological quality. Results The search resulted in 20 eligible studies about nine different FCE methods. The Baltimore Therapeutic Equipment work simulator showed a moderate predictive validity. The Ergo-Kit (EK) showed moderate variability and high inter- and intra-rater reliability. Low discriminative abilities and high convergent validity were found for the EK. Concurrent validity of the EK and the ERGOS Work Simulator was low to moderate. Moderate to high test-retest, inter- and intra-reliability was found in the Isernhagen Work-Systems (IWS) FCE. The predictive validity of the IWS was low. The physical work performance evaluation (PWPE) showed moderate test-retest reliability and moderate to high inter-rater reliability. Low internal and external responsiveness were found for the PWPE, predictive validity was high. The predictive validity of the short-form FCE was also high but need to be further examined on several psychometric properties. Low discriminative and convergent validity were found for the work disability functional assessment battery. The WorkHab showed moderate to high test-retest, inter- and intra-rater reliability. Conclusion Well-known FCE methods have been rigorously studied, but some of the research indicates weaknesses in their reliability and validity. Future research should address how these weaknesses can be overcome.

Test-retest reliability and agreement of the SPI-Questionnaire to detect symptoms of digital ischemia in elite volleyball players

The Shoulder posterior circumflex humeral artery Pathology and digital Ischemia - questionnaire (SPI-Q) has been developed to enable periodic surveillance of elite volleyball players, who are at risk for digital ischemia. Prior to implementation, assessing reliability is mandatory. Therefore, the test-retest reliability and agreement of the SPI-Q were evaluated among the population at risk. A questionnaire survey was performed with a 2-week interval among 65 elite male volleyball players assessing symptoms of cold, pale and blue digits in the dominant hand during or after practice or competition using a 4-point Likert scale (never, sometimes, often and always). Kappa (κ) and percentage of agreement (POA) were calculated for individual symptoms, and to distinguish symptomatic and asymptomatic players. For the individual symptoms, κ ranged from "poor" (0.25) to "good" (0.63), and POA ranged from "moderate" (78%) to "good" (97%). To classify symptomatic players, the SPI-Q showed "good" reliability (κ = 0.83; 95%CI 0.69-0.97) and "good" agreement (POA = 92%). The current study has proven the SPI-Q to be reliable for detecting elite male indoor volleyball players with symptoms of digital ischemia.

Functional Capacity Evaluation Research: Report from the Second International Functional Capacity Evaluation Research Meeting

INTRODUCTION

Functional capacity evaluations are an important component of many occupational rehabilitation programs and can play a role in facilitating reintegration to work thus improving health and disability outcomes. The field of functional capacity evaluation (FCE) research has continued to develop over recent years, with growing evidence on the reliability, validity and clinical utility of FCE within different patient and healthy worker groups. The second International FCE Research Conference was held in Toronto, Canada on October 2nd 2014 adjacent to the 2014 Work Disability Prevention Integration conference. This paper describes the outcomes of the conference.

REPORT

Fifty-four participants from nine countries attended the conference where eleven research projects and three workshops were presented. The conference provided an opportunity to discuss FCE practice, present new research and provide a forum for discourse around the issues pertinent to FCE use. Conference presentations covered aspects of FCE use including the ICF-FCE interface, aspects of reliability and validity, consideration of specific injury populations, comparisons of FCE components and a lively debate on the merits of 'Man versus Machine' in FCE's.

FUTURE DIRECTIONS

Researchers, clinicians, and other professionals in the FCE area have a common desire to improve the content and quality of FCE research and to collaborate to further develop research across systems, cultures and countries.

An investigation of the inter-rater reliability of the Valpar Joule functional capacity evaluation in healthy adults

BACKGROUND

A functional capacity evaluation (FCE) can provide a comprehensive, objective measure of a worker's ability to meet work demands to support return to work decision making. Research evidence of a FCE's reliability and validity, involving more than one study, and covering all test components with a diverse range of populations, is essential to ensure confidence in any FCE system.

OBJECTIVE

This study aimed to establish the inter-rater reliability of the Valpar Joule FCE functional capacity evaluation (FCE) for which there is currently limited published literature regarding its reliability.

METHODS

Twelve healthy subjects were digitally recorded completing the initial protocol of the Valpar Joule. Assessments were rated separately by 3 raters and the results then compared.

RESULTS

Using Intraclass Correlation Coefficients (ICC), with percentages of agreement and t-tests to determine bias, inter-rater reliability was high for determining last safe weight lifted for forceful tasks with ICC>0.90. Agreement ranged from 97.2% -100% for determining reasons for terminating tests; 97.2% -98.6% for identifying maximum safe capacity, but was only between 8.3% -50% for full agreement for identification of last weight safely lifted in forceful tasks. Differences were identified between raters with different training and experience for identifying poor body mechanics in lifting.

CONCLUSION

Results demonstrated high inter-rater reliability for the Valpar Joule functional capacity evaluation in healthy adults. Further development of criteria identifying poor body mechanics and training in its use is recommended to increase evaluator objectivity.

Interest of the Ergo-Kit(®) for the clinical practice of the occupational physician. A study of 149 patients recruited in a rehabilitation program

OBJECTIVE

Functional capacity evaluation is commonly used to assess the abilities of patients to perform some tasks. Ergo-Kit(®) is a validated tool assessing both functional capacities of patients and workplace demands. The objective of this study was to evaluate the relevance of the Ergo-Kit(®) data for occupational physicians during the return-to-work process.

METHODS

A retrospective and monocenter study was conducted on all patients included in a rehabilitation program and assessed with the Ergo-Kit(®) tool between 2005 and 2014. Workplace demands and patients' functional capacities were evaluated and confronted. Self-beliefs and perceived disability were also assessed and compared to the functional capacity evaluation.

RESULTS

One hundred and forty-nine working-age patients (85 men, 64 women; 39±12 years) suffering from musculoskeletal disorders or other diseases were included. Main causes of mismatch between workplace demands and functional capacities were manual handling of loads, postures with arms away from the body and repetitive motions at work; sitting posture was correlated with a lesser physical workload; and Oswestry score was correlated with functional capacities evaluated by the Ergo-Kit(®).

CONCLUSION

Ergo-Kit(®) is a relevant tool to assess the multidimensional aspects of workplace demands and functional capacities. It could be very helpful for occupational physicians to manage return-to-work.

Quantification of the safe maximal lift in functional capacity evaluations: comparison of muscle recruitment using SEMG and therapist observation

INTRODUCTION

This study aimed to identify any correlation between muscle activity using surface electromyography (SEMG) and therapist determined safe maximal lift (SML) during the bench to shoulder lift of the WorkHab FCE. This would support construct (convergent) validity of SML determination in the WorkHab FCE.

METHOD

An experimental laboratory based study design was used. Twenty healthy volunteers performed the bench to shoulder lift of the WorkHab FCE whilst SEMG of upper trapezius, mid deltoid, thoracic, brachioradialis and bicep muscles were recorded. A summary of the data is presented using descriptive statistics and differences between groups were tested using generalised linear mixed models.

RESULTS

Results showed a significant difference in activity and duration of muscle activation with increasing weight lifted [p = 0.000 and p = 0.024 (brachioradialis)]. There was a significant difference between the up lift (bench to shoulder) and the down lift (shoulder to bench) for all muscles (p = 0.000) except the brachioradialis (p = 0.819). No significant change was found in muscle activity before or after the SML.

CONCLUSION

Convergent validity of the bench to shoulder lift of the WorkHab FCE was not established as no relationship between the muscle recruitment using SEMG and SML, as determined by therapist observation was identified during this lift.

Maximum acceptable weight of lift reflects peak lumbosacral extension moments in a functional capacity evaluation test using free style, stoop and squat lifting

It is unclear whether the maximum acceptable weight of lift (MAWL), a common psychophysical method, reflects joint kinetics when different lifting techniques are employed. In a within-participants study (n = 12), participants performed three lifting techniques--free style, stoop and squat lifting from knee to waist level--using the same dynamic functional capacity evaluation lifting test to assess MAWL and to calculate low back and knee kinetics. We assessed which knee and back kinetic parameters increased with the load mass lifted, and whether the magnitudes of the kinetic parameters were consistent across techniques when lifting MAWL. MAWL was significantly different between techniques (p = 0.03). The peak lumbosacral extension moment met both criteria: it had the highest association with the load masses lifted (r > 0.9) and was most consistent between the three techniques when lifting MAWL (ICC = 0.87). In conclusion, MAWL reflects the lumbosacral extension moment across free style, stoop and squat lifting in healthy young males, but the relation between the load mass lifted and lumbosacral extension moment is different between techniques.

PRACTITIONER SUMMARY

Tests of maximum acceptable weight of lift (MAWL) from knee to waist height are used to assess work capacity of individuals with low-back disorders. This article shows that the MAWL reflects the lumbosacral extension moment across free style, stoop and squat lifting in healthy young males, but the relation between the load mass lifted and lumbosacral extension moment is different between techniques. This suggests that standardisation of lifting technique used in tests of the MAWL would be indicated if the aim is to assess the capacity of the low back.

Inter- and intra-rater reliability of the manual handling component of the WorkHab Functional Capacity Evaluation

The WorkHab Functional Capacity Evaluation (FCE) is widely used in Australian workplace injury management and occupational rehabilitation arenas; however, there is a lack of published literature regarding its reliability and validity.

PURPOSE

 This study investigated the intra- and inter-rater reliability of the manual handling component of this FCE.

METHOD

 A DVD was produced containing footage of the manual handling components of the WorkHab conducted with four injured workers. Therapist raters (n = 17) who were trained and accredited in use of the WorkHab FCE scored these components and 14 raters re-evaluated them after approximately 2 weeks. Ratings were compared using intraclass correlation coefficients (ICCs), paired sample t-tests (intra-rater), chi-squared (inter-rater) and percentage agreement.

RESULTS

Intra-rater agreement was high with ICCs for the manual handling components and manual handling score showing excellent reliability (0.94-0.98) and good reliability for identification of the safe maximal lift (ICC: 0.81). Overall inter-rater agreement ranged from good to excellent for the manual handling components and safe maximal lift determination (ICC > 0.9). Agreement for safe maximal lift identification was good.

CONCLUSIONS

 Ratings demonstrated substantial levels of intra-rater and inter-rater reliability for the lifting components of the WorkHab FCEs.

Test-Retest Reliability of the GAPP Functional Capacity Evaluation in Healthy Adults

Background. Functional capacity evaluations are commonly used in work rehabilitation practice to assess a person's capacity to perform work-related activities. Purpose. This study examined the test-retest reliability of participants' performance and administrator ratings using the Gibson Approach to Functional Capacity Evaluation (GAPP FCE). Methods. Forty-eight healthy adults were evaluated twice on 12 recommended core items of the GAPP FCE and rated for overall performance. Findings. The ICCs and 95% CIs for the Physical Level of Work and Alternative Physical Level of Work Ratings were 0.93 (0.87-0.96) and 0.86 (0.72-0.93) respectively. The ICCs for the core item-level ratings ranged from 0.15 to 0.94, and the ICCs for the actual loads handled in the manual handling items ranged from 0.88 to 0.95. Implications. The stability of an overall physical level of work rating shows potential for use in functional capacity evaluation practice and research. Further research is needed to investigate other measurement properties of the GAPP FCE using populations with injury or disability.

Effect of Functional Capacity Evaluation information on the judgment of physicians about physical work ability in the context of disability claims

Purpose

To test whether Functional Capacity Evaluation (FCE) information lead insurance physicians (IPs) to change their judgment about the physical work ability of claimants with musculoskeletal disorders (MSDs).

Methods

Twenty-seven IPs scored twice the physical work ability of two claimants for 12 specified activities, using a visual analogue scale. One claimant performed an FCE, the other served as a control. Outcome measure was the difference between experimental and control group in number of shifts in the physical work ability for the total of 12 specified activities.

Results

The IPs changed their judgment about the work ability 141 times when using FCE information compared to 102 times when not using this information (P-value = 0.001), both in the direction of more and less ability.

Conclusions

The IPs change their judgment of the physical work ability of claimants with MSDs in the context of disability claim procedures more often when FCE information is provided.

Construct validity of functional capacity evaluation lifting tests in construction workers on sick leave as a result of musculoskeletal disorders

OBJECTIVES

To assess the construct (discriminative and convergent) validity of 5 Ergo-Kit (EK) functional capacity evaluation (FCE) lifting tests in construction workers on sick leave as a result of musculoskeletal disorders (MSDs).

DESIGN

Cross sectional within-subject design.

SETTING

Occupational health service for the construction industry.

PARTICIPANTS

Male construction workers (N=72) on 6-week sick leave as a result of MSDs.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURE

After being assessed on 5 EK FCE lifting tests, participants were asked to complete the Von Korff questionnaire on pain intensity and disability as a result of MSDs and the instrument for disability risk assessing the risk for work disability. Discriminative validity was evaluated by comparing the results of the EK FCE lifting test scores between the 2 groups of participants based on the instrument for disability risk scores (high risk for work disability compared with low risk for work disability). Convergent validity was evaluated by assessing the associations between the results of the EK FCE lifting tests and Von Korff questionnaire self-reported pain intensity and disability as a result of MSDs.

RESULTS

The hypothesized differences between both instrument for disability risk groups on the 5 EK FCE lifting tests were found in the expected direction but were not statistically significant (1 test exhibited a trend). Pearson correlation coefficients showed a poor convergent validity between the scores of the Von Korff questionnaire and the EK FCE lifting tests (-.29< or =r< or =.05).

CONCLUSIONS

Poor construct validity of the 5 EK lifting tests was found: discriminative validity was not statistically established, and convergent validity with self-reported pain intensity and disability was poor.