An assessment of the inter examiner reliability of clinical tests for subacromial impingement and rotator cuff integrity

Comparing shoulder maneuvers to magnetic resonance imaging and arthroscopic findings in patients with supraspinatus tears

BACKGROUND

Shoulder maneuvers and magnetic resonance imaging (MRI) are performed to diagnose supraspinatus tendon tears regardless of arthroscopy exam. Although there are many studies on this subject, there is a lack of studies comparing the sensitivity (Se) and specificity (Sp) of shoulder maneuvers and MRI to arthroscopic findings (intact, partial, or full thickness supraspinatus tendon tear).

AIM

To compare the diagnostic values of shoulder maneuvers with MRI for supraspinatus tendon tears in patients undergoing shoulder arthroscopy.

METHODS

A total of 199 consecutive patients from four orthopedic centers met the eligibility criteria of shoulder pain persisting for at least four weeks. They were prospectively enrolled in this study from April 2017 to April 2019. Seven clinical tests (full can, empty can, drop arm, Hawkins’, painful arc, Neer’s sign and resisted external rotation) and MRI were performed, and all were compared with surgical findings. Full can, empty can and resisted external rotation tests were interpreted as positive in the case of pain and/or weakness. We assessed the Se, Sp, accuracy, positive predictive value (PPV) and negative predictive value (NPV), positive and negative likelihood ratio and diagnostic odds ratio for overall, partial and full-thickness supraspinatus tears.

RESULTS

MRI had the highest Se for overall (0.97), partial (0.91) and full-thickness (0.99) tears; moreover, MRI had the highest NPV: 0.90, 0.88 and 0.98 for overall, partial and full-thickness tears, respectively. For overall supraspinatus tears, the Se and PPV were: Painful arc (Se = 0.85/PPV = 0.91), empty can (pain) (Se = 0.80/PPV = 0.89), full can (pain) (Se = 0.78/PPV = 0.90), resisted external rotation (pain) (Se = 0.48/PPV = 0.87), drop arm (Se = 0.19/PPV = 0.97), Neer’s sign (Se = 0.78/PPV = 0.93) and Hawkins’ (Se = 0.80/PPV = 0.88). MRI had the highest PPV (0.99). The Hawkin’s test had the highest false positive rate in patients with intact tendons (0.36). The Sp of the empty can and full can (both tests positive for pain and weakness), drop arm and MRI were: 0.93, 0.91, 0.98 and 0.96, respectively. For partial and full-thickness tears, the empty can test (positive for pain and weakness) had a Sp of 0.93, and the drop arm and MRI had the same Sp (0.98).

CONCLUSION

Physical examination demonstrated good diagnostic value, the drop arm test had a Sp as good as MRI for supraspinatus tears; however, MRI was more accurate in ruling out tears. The Hawkins’ test had high false-positive findings in patients with intact tendons.

Evidence-Based Examination Techniques for the Shoulder Joint

OBJECTIVE

Digitalisation now almost covers all areas of medical student teaching. Teaching videos are a good way to help students learn practical skills. The existing evidence is a recognised aid for the classification of the respective technology.

METHOD

This video presents the usual examination techniques of the shoulder joint on a patient with an unstable shoulder. The respective techniques, if available, were backed up with appropriate evidence.

CONCLUSION

The examination techniques presented allow students to view them in a standardized manner on a patient. The evidence for the examination techniques can help with the classification of the respective technique.

Interrater and Test-Retest Reliability of Performance-Based Clinical Tests Administered to Established Users of Lower Limb Prostheses

OBJECTIVE

A major barrier to reducing falls among users of lower limb prostheses (LLP) has been an absence of statistical indices required for clinicians to select and interpret scores from performance-based clinical tests. The study aimed to derive estimates of reliability, measurement error, and minimal detectable change values in performance-based clinical tests administered to unilateral LLP users.

METHODS

A total of 60 unilateral LLP users were administered the Narrowing Beam Walking Test, Timed ``Up and Go'' (TUG), Four Square Step Test (FSST), and 10-Meter Walk Test on 2 occasions, 3 to 9 days apart. Intraclass correlation coefficients (ICCs) were calculated to assess interrater and test-retest reliability, while standard error of measurement (SEM) and minimal detectable change (MDC90) were derived to establish estimates of measurement error in individual scores or changes in score for each test.

RESULTS

Interrater reliability ICCs (1,1) were high for all tests (ie, ≥0.98). Test-retest ICCs (2,1) varied by test, ranging from .88 for the TUG to .97 for the FSST. SEM and MDC90 varied between .39 and .96 and between .91 seconds and 2.2 seconds for the time-based tests (FSST, TUG, 10-Meter Walk Test). SEM and MDC90 for the Narrowing Beam Walking Test were .07 and .16, respectively.

CONCLUSION

With the exception of the TUG, studied tests had test-retest ICCs (2,1) that exceeded the minimum required threshold to be considered suitable for group- and individual-level applications (ie, ICC ≥ 0.70 and ≥ 0.90, respectively). Future research on individuals with dysvascular and transfemoral amputations or in specific age categories is required.

IMPACT

Along with published validity indices, these reliability, error, and change indices can help clinicians select balance tests suitable for LLP users. They can also help clinicians interpret test scores to make informed, evidence-based clinical decisions.

Interrater agreement and reliability of clinical tests for assessment of patients with shoulder pain in primary care

Background: There is limited information about the agreement and reliability of clinical shoulder tests. Objectives: To assess the interrater agreement and reliability of clinical shoulder tests in patients with shoulder pain treated in primary care. Methods: Patients with a primary report of shoulder pain underwent a set of 21 clinical shoulder tests twice on the same day, by pairs of independent physical therapists. The outcome parameters were observed and specific interrater agreement for positive and negative scores, and interrater reliability (Cohen's kappa (κ)). Positive and negative interrater agreement values of ≥0.75 were regarded as sufficient for clinical use. For Cohen's κ, the following classification was used: <0.20 poor, 0.21-0.40 fair, 0.41-0.60 moderate, 0.61-0.80 good, 0.81-1.00 very good reliability. Participating clinics were randomized in two groups; with or without a brief practical session on how to conduct the tests. Results: A total of 113 patients were assessed in 12 physical therapy practices by 36 physical therapists. Positive and negative interrater agreement values were both sufficient for 1 test (the Full Can Test), neither sufficient for 5 tests, and only sufficient for either positive or negative agreement for 15 tests. Interrater reliability was fair for 11 tests, moderate for 9 tests, and good for 1 test (the Full Can Test). An additional brief practical session did not result in better agreement or reliability. Conclusion: Clinicians should be aware that interrater agreement and reliability for most shoulder tests is questionable and their value in clinical practice limited.

Validity and reliability of the Bristol Stool Form Scale in healthy adults and patients with diarrhoea-predominant irritable bowel syndrome

BACKGROUND

The Bristol Stool Form Scale (BSFS) is a 7-point scale used extensively in clinical practice and research for stool form measurement, which has undergone limited validity and reliability testing.

AIM

To determine the validity and reliability of the BSFS in measuring stool form in healthy adults and patients with diarrhoea-predominant irritable bowel syndrome (IBS-D).

METHODS

One hundred and sixty-nine healthy volunteers provided a stool sample and used the BSFS to classify stool form, which was compared with measured stool water content and with values from 19 patients with IBS-D. Eighty-six volunteers used the BSFS to classify 26 stool models to determine accuracy and reliability.

RESULTS

Volunteers' classifications of stool type correlated with stool water (Spearman's rho = 0.491, P < 0.001), which increased in hard (Types 1-2), normal (Types 3-5) and loose stools (Types 6-7) (P < 0.001). The BSFS detected differences in stool form between healthy volunteers (mean 3.7, s.d. 1.5) and IBS-D patients (mean 5.0, s.d. 1.2) (P < 0.001). Overall, 977/1204 (81%) stool models were correctly classified (substantial accuracy, κ = 0.78), although <80% of Types 2, 3, 5 and 6 were classified correctly. On 852/1118 (76%) occasions, volunteers classified covert duplicate models to the same stool type (substantial reliability, κ = 0.72), but with only moderate reliability for Types 2 (63%, κ = 0.57) and 3 (62%, κ = 0.55).

CONCLUSIONS

The BSFS demonstrated substantial validity and reliability, although difficulties arose around clinical decision points (Types 2, 3, 5, 6) that warrant investigation in larger clinical populations. Potential for improving validity and reliability through modifications to the BSFS or training in its use should be explored.

Treatment of shoulder pain utilizing mechanical diagnosis and therapy principles

This case report describes the effectiveness of mechanical diagnosis and therapy (MDT) in the management of a patient referred with a diagnosis of shoulder tendonitis. The patient was a 56-year-old male with a 3-month history of left anterior shoulder pain. Upon initial assessment, he presented with a positive open-can test, lift-off test, and Hawkins-Kennedy impingement test. A MDT assessment quickly ruled out cervical involvement and identified a loss of end-range shoulder mobility and pain during active shoulder movement. After the patient underwent a repeated movement examination and treatment based on responses to end-range movements over three visits, his shoulder pain was abolished and motion was fully restored. Despite having positive rotator cuff and impingement signs, this patient was effectively treated with repeated end-range movements over a short period of 2 weeks. This case demonstrates that treatment based on MDT sub-classification principles may be an effective way to manage shoulder pain as it is in the spine.

Physical tests for shoulder impingements and local lesions of bursa, tendon or labrum that may accompany impingement

BACKGROUND

Impingement is a common cause of shoulder pain. Impingement mechanisms may occur subacromially (under the coraco-acromial arch) or internally (within the shoulder joint), and a number of secondary pathologies may be associated. These include subacromial-subdeltoid bursitis (inflammation of the subacromial portion of the bursa, the subdeltoid portion, or both), tendinopathy or tears affecting the rotator cuff or the long head of biceps tendon, and glenoid labral damage. Accurate diagnosis based on physical tests would facilitate early optimisation of the clinical management approach. Most people with shoulder pain are diagnosed and managed in the primary care setting.

OBJECTIVES

To evaluate the diagnostic accuracy of physical tests for shoulder impingements (subacromial or internal) or local lesions of bursa, rotator cuff or labrum that may accompany impingement, in people whose symptoms and/or history suggest any of these disorders.

SEARCH METHODS

We searched electronic databases for primary studies in two stages. In the first stage, we searched MEDLINE, EMBASE, CINAHL, AMED and DARE (all from inception to November 2005). In the second stage, we searched MEDLINE, EMBASE and AMED (2005 to 15 February 2010). Searches were delimited to articles written in English.

SELECTION CRITERIA

We considered for inclusion diagnostic test accuracy studies that directly compared the accuracy of one or more physical index tests for shoulder impingement against a reference test in any clinical setting. We considered diagnostic test accuracy studies with cross-sectional or cohort designs (retrospective or prospective), case-control studies and randomised controlled trials.

DATA COLLECTION AND ANALYSIS

Two pairs of review authors independently performed study selection, assessed the study quality using QUADAS, and extracted data onto a purpose-designed form, noting patient characteristics (including care setting), study design, index tests and reference standard, and the diagnostic 2 x 2 table. We presented information on sensitivities and specificities with 95% confidence intervals (95% CI) for the index tests. Meta-analysis was not performed.

MAIN RESULTS

We included 33 studies involving 4002 shoulders in 3852 patients. Although 28 studies were prospective, study quality was still generally poor. Mainly reflecting the use of surgery as a reference test in most studies, all but two studies were judged as not meeting the criteria for having a representative spectrum of patients. However, even these two studies only partly recruited from primary care.The target conditions assessed in the 33 studies were grouped under five main categories: subacromial or internal impingement, rotator cuff tendinopathy or tears, long head of biceps tendinopathy or tears, glenoid labral lesions and multiple undifferentiated target conditions. The majority of studies used arthroscopic surgery as the reference standard. Eight studies utilised reference standards which were potentially applicable to primary care (local anaesthesia, one study; ultrasound, three studies) or the hospital outpatient setting (magnetic resonance imaging, four studies). One study used a variety of reference standards, some applicable to primary care or the hospital outpatient setting. In two of these studies the reference standard used was acceptable for identifying the target condition, but in six it was only partially so. The studies evaluated numerous standard, modified, or combination index tests and 14 novel index tests. There were 170 target condition/index test combinations, but only six instances of any index test being performed and interpreted similarly in two studies. Only two studies of a modified empty can test for full thickness tear of the rotator cuff, and two studies of a modified anterior slide test for type II superior labrum anterior to posterior (SLAP) lesions, were clinically homogenous. Due to the limited number of studies, meta-analyses were considered inappropriate. Sensitivity and specificity estimates from each study are presented on forest plots for the 170 target condition/index test combinations grouped according to target condition.

AUTHORS' CONCLUSIONS

There is insufficient evidence upon which to base selection of physical tests for shoulder impingements, and local lesions of bursa, tendon or labrum that may accompany impingement, in primary care. The large body of literature revealed extreme diversity in the performance and interpretation of tests, which hinders synthesis of the evidence and/or clinical applicability.

Diagnostic accuracy of clinical tests for subacromial impingement syndrome: a systematic review and meta-analysis

OBJECTIVE

To examine the accuracy of clinical tests for diagnosing subacromial impingement syndrome (SIS).

DATA SOURCES

A systematic literature search was conducted in January 2011 to identify all studies that examined the diagnostic accuracy of clinical tests for SIS. The following search engines were used: Cochrane Library, EMBASE, Science Direct, and PubMed.

STUDY SELECTION

Two reviewers screened all articles. We included prospective or retrospective cohort studies that examined individuals with a painful shoulder, reported any clinical test for SIS, and used arthroscopy or open surgery as the reference standard. The search strategy yielded 1338 articles of which 1307 publications were excluded based on title/abstract. Sixteen of the remaining 31 articles were included. The PRISMA (preferred reporting items for systematic reviews and meta-analyses) guidelines were followed to conduct this review.

DATA EXTRACTION

The number of true positives, false positives, true negatives, and false negatives for each clinical test were extracted from relevant studies, and a 2×2 table was constructed. Studies were combined using a bivariate random-effects model. Heterogeneity was assessed using the variance of logit-transformed sensitivity and specificity.

DATA SYNTHESIS

Ten studies with 1684 patients are included in the meta-analysis. The Hawkins-Kennedy test, Neer's sign, and empty can test are shown to be more useful for ruling out rather than ruling in SIS, with greater pooled sensitivity estimates (range, .69-.78) than specificity (range, .57-.62). A negative Neer's sign reduces the probability of SIS from 45% to 14%. The drop arm test and lift-off test have higher pooled specificities (range, .92-.97) than sensitivities (range, .21-.42), indicating that they are more useful for ruling in SIS if the test is positive.

CONCLUSIONS

This systematic review quantifies the diagnostic accuracy of 5 clinical tests for SIS, in particular the lift-off test. Accurate diagnosis of SIS in clinical practice may serve to improve appropriate treatment and management of individuals with shoulder complaints.

Guidelines for Reporting Reliability and Agreement Studies (GRRAS) were proposed

OBJECTIVE

Results of reliability and agreement studies are intended to provide information about the amount of error inherent in any diagnosis, score, or measurement. The level of reliability and agreement among users of scales, instruments, or classifications is widely unknown. Therefore, there is a need for rigorously conducted interrater and intrarater reliability and agreement studies. Information about sample selection, study design, and statistical analysis is often incomplete. Because of inadequate reporting, interpretation and synthesis of study results are often difficult. Widely accepted criteria, standards, or guidelines for reporting reliability and agreement in the health care and medical field are lacking. The objective was to develop guidelines for reporting reliability and agreement studies.

STUDY DESIGN AND SETTING

Eight experts in reliability and agreement investigation developed guidelines for reporting.

RESULTS

Fifteen issues that should be addressed when reliability and agreement are reported are proposed. The issues correspond to the headings usually used in publications.

CONCLUSION

The proposed guidelines intend to improve the quality of reporting.