Inter-rater Reliability and Between-days Repeatability of Eight Physical Performance Tests

A Longitudinal Evaluation of Risk Factors and Interactions for the Development of Nonspecific Neck Pain in Office Workers in Two Cultures

OBJECTIVE

To identify risk factors for the development of interfering neck pain in office workers including an examination of the interaction effects between potential risk factors.

BACKGROUND

The 1-year incidence of neck pain in office workers is reported as the highest of all occupations. Identifying risk factors for the development of neck pain in office workers is therefore a priority to direct prevention strategies.

METHODS

Participants included 214 office workers without neck pain from two cultures. A battery of measures evaluating potential individual and workplace risk factors were administered at baseline, and the incidence of interfering neck pain assessed monthly for 12 months. Survival analysis was used to identify relationships between risk factors and the development of interfering neck pain.

RESULTS

One-year incidence was 1.93 (95% CI [1.41, 2.64]) per 100 person months. Factors increasing the risk of developing interfering neck pain were older age, female gender, increased sitting hours, higher job strain, and stress. A neutral thorax sitting posture, greater cervical range of motion and muscle endurance, and higher physical activity were associated with a decreased risk of neck pain. The effects of some risk factors on the development of neck pain were moderated by the workers' coping resources.

CONCLUSION

Multiple risk factors and interactions may explain the development of neck pain in office workers. Therefore, plans for preventing the development of interfering neck pain in office workers should consider multiple individual and work-related factors with some factors being potentially more modifiable than others.

Reliability and Validity of Clinical Tests for Measuring Strength or Endurance of Cervical Muscles: A Systematic Review and Meta-analysis

OBJECTIVE

To evaluate the reliability and validity of clinical tests for measuring cervical muscle strength or endurance in participants with and without neck pain.

DATA SOURCE

Systematic review and meta-analysis on reliability and validity. Literature search was conducted on January 28, 2020, using 5 databases: MEDLINE, Cumulative Index to Nursing and Allied Health, EMBASE, SPORTDiscus, and Scopus.

STUDY SELECTION

We included studies that investigated the reliability or validity of clinical tests for measuring cervical muscle strength or endurance in participants with nonspecific chronic neck pain, with or without irradiation, or healthy participants. We included only those that were viable for daily practice and of low cost.

DATA EXTRACTION

Data were extracted as follows: (1) author and year of publication, (2) demographic values and health condition, (3) reported clinical tests, (4) inclusion and exclusion criteria, (5) description of test, (6) interrater reliability, and (7) intrarater reliability. For validity studies we also extracted the (8) reference method and (9) validity estimates.

DATA SYNTHESIS

Methodological quality was assessed with the Quality Appraisal of Diagnostic Reliability and the Guidelines for Reporting Reliability and Agreement Studies. Data on reliability and validity were extracted from included articles and then analyzed.

RESULTS

Thirty-one studies were included. Cervical flexor and extensor endurance test, craniocervical flexion test (CCFT), AND cervical muscle strength using a handheld dynamometer (HHD) showed moderate to good intra- and interrater reliability (intraclass correlation coefficients ranging from 0.64-0.90). Concurrent validity was measured by only 2 studies, which do not provide adequate evidence for a recommendation.

CONCLUSIONS

The cervical flexor and extensor endurance tests, CCFT, and HHD for measuring cervical strength presented an acceptable interrater and intrarater reliability.

Total Hip Arthroplasty Digital Templating: Size Predicting Ability and Interobserver Variability

BACKGROUND

During the last century, total hip arthroplasties have become more popular. They have had a huge impact on the quality of life, pain, range of motion, social interaction, and psychological well-being. A number of studies have emphasized the importance of using templates to choose the appropriate implant size when planning the surgery. Our aim is to use MediCad^® software to analyze the ability of the digital template system MediCad^® to predict the size of the implant needed in total hip arthroplasties.

MATERIALS AND METHODS

An arthroplasty preoperative plan was created according to the MediCad^® software guidelines, on anteroposterior hip X-ray by one junior resident, one senior resident, and three experienced hip surgeons.

RESULTS

The median size accuracy was 0.7 (range: 0.27-0.87) for the cup, 0.73 (range: 0.36-0.83) for the stem, and 0.28 (range: -0.14-0.69) for the neck. Interobserver reliability was good (kappa > 0.4) and stronger when measuring the stem than when doing so with the cup. Conclusion: Digital preoperative total hip arthroplasty planning is a good method for predicting component size, restoring hip anatomy (vertical offset and horizontal offset), with good interobserver reliability.

Geometrical analysis of stemless shoulder arthroplasty: a radiological study of seventy TESS total shoulder prostheses

PURPOSE

The aim of this study was to investigate the ability of a stemless shoulder prosthesis to restore shoulder anatomy in relation to premorbid anatomy.

METHODS

This prospective study was performed between May 2007 and December 2013. The inclusion criteria were patients with primary osteoarthritis (OA) who had undergone stemless total anatomic shoulder arthroplasty. Radiographic measurements were done on anteroposterior X-ray views of the glenohumeral joint.

RESULTS

Sixty-nine patients (70 shoulders) were included in the study. The mean difference between premorbid centre of rotation (COR) and post-operative COR was 1 ± 2 mm (range -3 to 5.8 mm). The mean difference between premorbid humeral head height (HH) and post-operative HH was -1 ± 3 mm (range -9.7 to 8.5 mm). The mean difference between premorbid neck-shaft angle (NSA) and post-operative NSA was -3 ± 12° (range -26 to 20°).

CONCLUSIONS

Stemless implants could be of help to reconstruct the shoulder anatomy. This study shows that there are some challenges to be addressed when attempting to ensure optimal implant positioning. The critical step is to determine the correct level of bone cut to avoid varus or valgus humeral head inclination and ensure correct head size.

Validity and reliability of preoperative templating in total hip arthroplasty using a digital templating system

OBJECTIVES

To evaluate the validity, interobserver reliability, and intraobserver reproducibility of a digital templating system, the Mdesk™ in preoperative templating in cemented and reverse hybrid total hip arthroplasty (THA).

MATERIALS AND METHODS

Validity was evaluated by comparing the planned cup size, stem size, CCD angles, and neck length with the components used in 129 patients operated with cemented and reverse hybrid THA. The reliability was measured by comparing the templating results of two surgeons with each other (interobserver) and the results of two templatings carried out by first surgeon (intraobserver). The leg length discrepancy was measured before and after the operation to assess the templating ability to correct it.

RESULTS

The Mdesk™ system showed good validity (kappa value ranged from 0.64 to 0.96), especially when one size over and under the planned size were included. No difference between cemented and cementless stems was found. The interobserver reliability ranged from fair (kappa 0.23) to substantial (kappa 0.61) while the intraobserver reproducibility ranged from substantial (kappa 0.70) to excellent (kappa 0.82). Templating and intraoperative measures succeeded to restore the leg length.

CONCLUSIONS

The Mdesk™ system has comparable validity and reliability with other templating systems used in clinical practice. We recommend that the same surgeon who does the preoperative radiographic templating to also perform the operation. Further studies are required to evaluate the results of succeeded templating in the long run.

Reliability and Validity of Functional Capacity Evaluations: An Update

Functional capacity evaluations (FCEs) and other work-related assessments continue to be used in occupational rehabilitation to determine the capacity of injured and disabled workers to either return to their preinjury jobs, or to determine what they are capable of doing in a work context. New instruments have been developed and others refined. There is a continuing call however for these systems to demonstrate acceptable reliability and validity. Comprehensive reviews of reliability and validity of work-related assessments were published and included information up to the end of 1997. This study updates that information by examining research conducted on five FCEs over the subsequent 8-year period (January 1998–March 2006). The Isernhagen Work Systems (IWS) FCE had the most comprehensive coverage of all aspects of reliability and validity, while the Progressive Isoinertial Lifting Evaluation (PILE) was also extensively researched. Newer FCEs show promise and should continue to be investigated. Clinicians and others are encouraged to be informed consumers of the evidence that exists for the reliability and validity of FCEs and other work-related assessments.

Measurement of leg length discrepancy after total hip arthroplasty. The reliability of a plain radiographic method compared to CT-scanogram

OBJECTIVE

To measure the interobserver reliability and intraobserver reproducibility of post total hip arthroplasty (THA) leg length discrepancy (LLD) measurement on radiographs as well as to evaluate its accuracy by comparing it with LLD measurement on computed tomographic scanogram (CT-scanogram).

MATERIALS AND METHODS

In this prospective study, postoperative LLD measurements in ten THA patients were made by four observers on anteroposterior radiographs of the pelvis (inter-teardrop line to the tip of lesser trochanter) and compared to LLD measurements made on CT-scanogram scout views of the lower limb. Two observers repeated the LLD measurements on radiographs 8 weeks after the first measurements. The interobserver reliability of the LLD measurement on plain radiographs was evaluated by comparing the measurements of the four observers and the intraobserver reproducibility by comparing the two repeated measurements made by the two observers.

RESULTS

We found excellent interobserver reliability (mean ICC 0.83) and intraobserver reproducibility (ICC 0.90 and 0.88) of the LLD measurements on plain radiographs. There was a moderate to excellent agreement, but with wide variation of measurements among the four observers, when plain radiographic measurement was compared with CT-scanogram (ICC 0.58, 0.60, 0.71, and 0.82).

CONCLUSION

Despite the excellent interobserver reliability and intraobserver reproducibility of LLD measurement on radiographs, clinicians should be aware of its limited accuracy when compared to CT-scanogram.

Biering-Sorensen test performance of Japanese young males: comparison with other ethnicities and relationship to electromyography, near-infrared spectroscopy and exertion ratings

Back muscle endurance is a predictor of future low back pain and is commonly assessed using the Biering-Sorensen Test (BST). Differences exist between ethnic groups that may affect the performance and interpretation of the BST and should be investigated. This study's aim was to explore objective and subjective measures of the BST in a Japanese group in comparison with previous studies in other ethnic groups. A total of 27 young male Japanese students performed the BST while measures of muscle fatigue were collected. The mean BST time (152.7 (32.5) s) was greater than the median of the reported mean times in other ethnic groups over the previous decade (128.6 s). Objective measures indicated that the Japanese subjects' lumbar muscles were as fatigued as those of previous studies, while subjective measures appear to indicate that subjects under-reported exertion. The better performance of the Japanese subjects in the BST may reflect physical, psychosocial and lifestyle differences related to ethnicity. STATEMENT OF RELEVANCE: Ergonomics research and practice needs to be applicable to different ethnic groups. Despite the substantial body of evidence on back muscle endurance and indications of potential ethnicity related differences, this had not been previously investigated. These results help ergonomists to interpret physical ergonomics evidence in a multi-ethnic world.

Reduced endurance of the cervical flexor muscles in patients with concurrent temporomandibular disorders and neck disability

Subjects with temporomandibular disorders (TMDs) have been found to have clinical signs and symptoms of cervical dysfunction. Although many studies have investigated the relationship between the cervical spine and TMD, no study has evaluated the endurance capacity of the cervical muscles in patients with TMD. Thus the objective of this study was to determine whether patients with TMD had a reduced endurance of the cervical flexor muscles at any level of muscular contraction when compared with healthy subjects. One hundred and forty-nine participants provided data for this study (49 subjects were healthy, 54 had myogenous TMD, and 46 had mixed TMD). There was a significant difference in holding time at 25% MVC between subjects with mixed TMD when compared to subjects with myogenous TMD and healthy subjects. This implies that subjects with mixed TMD had less endurance capacity at a lower level of contraction (25% MVC) than healthy subjects and subjects with myogenous TMD. No significant associations between neck disability, jaw disability, clinical variables and neck flexor endurance test were found.

Test-Retest Reliability of the GAPP Functional Capacity Evaluation in Healthy Adults

Background. Functional capacity evaluations are commonly used in work rehabilitation practice to assess a person's capacity to perform work-related activities. Purpose. This study examined the test-retest reliability of participants' performance and administrator ratings using the Gibson Approach to Functional Capacity Evaluation (GAPP FCE). Methods. Forty-eight healthy adults were evaluated twice on 12 recommended core items of the GAPP FCE and rated for overall performance. Findings. The ICCs and 95% CIs for the Physical Level of Work and Alternative Physical Level of Work Ratings were 0.93 (0.87-0.96) and 0.86 (0.72-0.93) respectively. The ICCs for the core item-level ratings ranged from 0.15 to 0.94, and the ICCs for the actual loads handled in the manual handling items ranged from 0.88 to 0.95. Implications. The stability of an overall physical level of work rating shows potential for use in functional capacity evaluation practice and research. Further research is needed to investigate other measurement properties of the GAPP FCE using populations with injury or disability.

Clinimetric evaluation of methods to measure muscle functioning in patients with non-specific neck pain: a systematic review

Background

Neck pain is a significant health problem in modern society. There is evidence to suggest that neck muscle strength is reduced in patients with neck pain. This article provides a critical analysis of the research literature on the clinimetric properties of tests to measure neck muscle strength or endurance in patients with non-specific neck pain, which can be used in daily practice.

Methods

A computerised literature search was performed in the Medline, CINAHL and Embase databases from 1980 to January 2007. Two reviewers independently assessed the clinimetric properties of identified measurement methods, using a checklist of generally accepted criteria for reproducibility (inter- and intra-observer reliability and agreement), construct validity, responsiveness and feasibility.

Results

The search identified a total of 16 studies. The instruments or tests included were: muscle endurance tests for short neck flexors, craniocervical flexion test with an inflatable pressure biofeedback unit, manual muscle testing of neck musculature, dynamometry and functional lifting tests (the cervical progressive iso-inertial lifting evaluation (PILE) test and the timed weighted overhead test). All the articles included report information on the reproducibility of the tests. Acceptable intra- and inter-observer reliability was demonstrated for t enduranctest for short neck flexors and the cervical PILE test. Construct validity and responsiveness have hardly been documented for tests on muscle functioning.

Conclusion

The endurance test of the short neck flexors and the cervical PILE test can be regarded as appropriate instruments for measuring different aspects of neck muscle function in patients with non-specific neck pain. Common methodological flaws in the studies were their small sample size and an inappropriate description of the study design.

Factors explaining improvement of isoinertial lifting-capacity

INTRODUCTION

A clearer understanding of the factors involved in improving lifting-capacity may assist professional health workers to enhance patient's functioning and minimize chronic back pain. However, few studies have examined this association. This study is part of a trial comparing two secondary back pain prevention programs. It aims to identify anthropometric, physical, psychic and demographic baseline variables (baseline model), and over time change variables (comprehensive model), which explain the alteration of lumbar isoinertial lifting-capacity, from baseline to post-treatment.

METHODS

The association between these variables' baseline- or change values, and the change of lifting-capacity (PILE-test) over time, were analyzed with multiple regression analyses. Potential variables for the regression analyses were identified within a standardized stepwise selection process.

RESULTS

In the baseline model, 35.2% of the variance in lifting-capacity was mainly explained by a low baseline score of lumbar lifting-capacity, high body weight and gender. In the comprehensive model, 41.9% could be mainly explained by the same baseline variables, an increase of perceived exertion during the PILE-tests and decrease of fear-avoidance caused by work.

CONCLUSIONS

The results suggest that treatments to improve lifting-capacity in individuals with mild low back pain should particularly address the reduction of fear-avoidance beliefs. Although strong conclusions cannot be drawn from this study due to methodological limitations, they may be helpful to assign patients to appropriate and most beneficial treatment programs, as well as to develop specific programs. Fear-reduction may be an important target for early interventions in regard to functional capacity.

The reliability of a 10-test package for patients with prolonged back and neck pain: could an examiner without formal medical education be used without loss of quality? A methodological study

Background

In the rehabilitation of patients with prolonged back and neck pain, the physical impairment should be assessed. Previous research has exclusively engaged medically educated examiners, mostly physiotherapists. However, less biased evaluations of efforts at rehabilitation might be achieved by personnel standing outside the treatment work itself. Therefore, if medically untrained examiners could be used without cost to the quality, this might produce a better evaluation at defensible cost and could also be useful in a research context. The aim of this study was to answer the question: given a 10-test package for patients with prolonged back and neck pain, could an examiner without formal medical education be used without loss of quality? Five of the ten tests required the examiner to keep a firm hold against the foundation of those parts of the participant's body that were not supposed to move during the test.

Methods

Examination by an experienced physiotherapist (A) in performing the package was compared with that by a research assistant (B) without formal medical education. The reliability, including inter- and intra-rater reliability, was assessed. In the inter-rater reliability study, 50 participants (30 patients + 20 healthy subjects) were tested once each by A and B. In the intra-rater reliability study, the 20 healthy subjects were tested twice by A or B. One-way ANOVA intra-class-correlation coefficient (ICC) was calculated and its possible systematic error was determined using a t-test.

Results

All five tests that required no manual fixation had acceptable reliability (ICC > .60 and no indication of systematic error). Only one of the five tests that required fixation had acceptable reliability. The difference (five vs. one) was significant (p = .01).

Conclusion

In a 10-test package for patients with prolonged back and neck pain, an examiner without formal medical education could be used without loss of quality, at least for the five tests requiring no manual fixation. To make our results more generalizable and their implications more searching, a similar study should be conducted with two or more examiners with and without formal medical education, and the intra-rater reliability study should also include patients and involve more participants.

Reliability and agreement of 5 Ergo-Kit functional capacity evaluation lifting tests in subjects with low back pain

OBJECTIVE

To assess interrater reliability and agreement of 5 Ergo-Kit functional capacity evaluation lifting tests in subjects with low back pain (LBP).

DESIGN

Within-subjects design, with 2 repeated measurements.

SETTING

Academic medical center in The Netherlands.

PARTICIPANTS

Twenty-four subjects (10 men, 14 women) with LBP.

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURE

Five Ergo-Kit lifting tests (2 isometric, 3 dynamic) were assessed on 2 occasions (t1, t2), by 2 different raters (R1, R2). The interval between the test sessions was 3 days. Interrater reliability level was expressed with the intraclass correlation coefficient (ICC), and the level of agreement between raters with the standard error (SE) of measurement.

RESULTS

ICCs means (reliability) of isometric and dynamic Ergo-Kit lifting tests ranged from .94 to .97, and SE of measurement values (agreement) ranged from 1.9 to 8.6 kg.

CONCLUSIONS

There was good reliability and agreement between raters of the isometric and dynamic Ergo-Kit lifting tests in subjects with LBP, which supports the use of these tests to assess functional lifting capacity.

Reliability of procedures used in the physical examination of non-specific low back pain: a systematic review

The purpose of this systematic review was to determine the quality of the research and to assess the reliability of different types of physical examination procedures used in the assessment of patients with non-specific low back pain. A search of electronic databases (MEDLINE, PEDro, AMED, EMBASE, Cochrane, and CINAHL) up to August 2005 identified 48 relevant studies which were analysed for quality and reliability. Pre-established criteria were used to judge the quality of the studies and satisfactory reliability, and conclusions emphasised high quality studies (> or = 60% methods score). The mean quality score of the studies was 52% (range 0 to 88%), indicating weak to moderate methodology. Based on the upper threshold used (kappa/ICC > 0.85) most procedures demonstrated either conflicting evidence or moderate to strong evidence of low reliability. When the lower threshold was used (kappa/ICC > 0.70) evidence about pain response to repeated movements changed from contradictory to moderate evidence for high reliability. Most procedures commonly used by clinicians in the examination of patients with back pain demonstrate low reliability.

Intra- and interrater reliability of the Ergo-Kit functional capacity evaluation method in adults without musculoskeletal complaints

OBJECTIVE

To evaluate the intra- and interrater reliability of tests from the Ergo-Kit (EK) functional capacity evaluation method in adults without musculoskeletal complaints.

DESIGN

Within-subjects design.

SETTING

Academic medical center in The Netherlands.

PARTICIPANTS

Twenty-seven subjects without musculoskeletal complaints (15 men, 12 women).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Seven EK tests (2 isometric, 3 dynamic lifting, 2 manipulation tests) were each assessed 3 times (over 4 days), twice by 1 rater (R1) and once by another rater (R2). Intrarater reliability was calculated using the EK test scores assessed by R1. Interrater reliability was calculated using the EK test scores assessed by both raters. Counterbalancing the rater order made possible the calculation of 2 interrater reliability levels (at time intervals of 4 and 8d). All reliability levels were expressed as intraclass correlation coefficients (ICCs).

RESULTS

Intrarater and interrater reliability (8-d time interval) was high (ICC, >.80) for the isometric lifting tests, moderate (ICC range, .50-.80) for the dynamic lifting tests, and low (ICC, <.50) for the manipulation tests. The interrater reliability of the isometric and dynamic lifting tests (4-d time interval) was high (ICC, >.80), and it was moderate (ICC range, .50-.80) for both manipulation tests.

CONCLUSIONS

The isometric and dynamic lifting tests of the EK have a moderate to high level of reliability; the manipulation tests have a low level of reliability.

Morning warming-up exercise--effects on musculoskeletal fitness in construction workers

The aim of the present study was to evaluate the effects on muscle stretchability, joint flexibility, muscle strength and endurance in construction workers of a 3-month period of a 10-min morning warming-up exercise (MWU), performed at the building site every working day. Thirty construction workers participated in the program. Seventeen construction workers at other building sites served as controls. Muscle stretchability, joint flexibility, muscle strength and endurance were measured before and after the program. Significant increase of thoracic and lower back mobility, increase of hamstring and thigh muscle stretchability were seen in the MWU group. A significant difference in back muscle endurance was found due to decreased endurance in the controls. Muscular strength was not influenced by the MWU. The results indicate that a short dose of morning warming-up exercise could be beneficial for increasing or maintaining joint and muscle flexibility and muscle endurance for workers exposed to manual material handling and strenuous working positions.