The reliability of a quality appraisal tool for studies of diagnostic reliability (QAREL)

Reliability of the Biomechanical Assessment of the Sagittal Lumbar Spine and Pelvis on Radiographs Used in Clinical Practice: A Systematic Review of the Literature

Background: Biomechanical analysis of the sagittal alignment of the lumbar spine and pelvis on radiographs is common in clinical practices including chiropractic, physical therapy, scoliosis-related thoraco-lumbo-sacral orthosis (TLSO) management, orthopedics, and neurosurgery. Of specific interest is the assessment of pelvic morphology and the relationship between angle of pelvic incidence, sacral slope, and lumbar lordosis to pain, disability, and clinical treatment of spine conditions. The current state of the literature on the reliability of common methods quantifying these parameters on radiographs is limited. Methods: The objective of this systematic review is to identify and review the available studies on the reliability of different methods of biomechanical analysis of sagittal lumbo-pelvic parameters used in clinical practice. Our review followed the recommendations of the preferred reporting items for systematic reviews and meta-analyses (PRISMA). The design of this systematic review was registered with PROSPERO (CRD42023379873). Results: The search strategy yielded a total of 2387 articles. A total of 1539 articles were screened after deduplication and exclusion by automation tools, leaving 473 full-text articles that were retrieved. After exclusion, 64 articles met the inclusion criteria. The preponderance of the evidence showed good to excellent reliability for biomechanical assessment of sagittal lumbo-pelvic spine alignment. Conclusions: The results of this systematic review of the literature show that sagittal radiographic analysis of spinal biomechanics and alignment of the human lumbo-pelvic spine is a reliable tool for aiding diagnosis and management in clinical settings.

Agreement and concurrent validity between telehealth and in-person diagnosis of musculoskeletal conditions: a systematic review

OBJECTIVES

To assess the concurrent validity and inter-rater agreement of the diagnosis of musculoskeletal (MSK) conditions using synchronous telehealth compared to standard in-person clinical diagnosis.

METHODS

We searched five electronic databases for cross-sectional studies published in English in peer-reviewed journals from inception to 28 September 2023. We included studies of participants presenting to a healthcare provider with an undiagnosed MSK complaint. Eligible studies were critically appraised using the QUADAS-2 and QAREL criteria. Studies rated as overall low risk of bias were synthesized descriptively following best-evidence synthesis principles.

RESULTS

We retrieved 6835 records and 16 full-text articles. Nine studies and 321 patients were included. Participants had MSK conditions involving the shoulder, elbow, low back, knee, lower limb, ankle, and multiple conditions. Comparing telehealth versus in-person clinical assessments, inter-rater agreement ranged from 40.7% agreement for people with shoulder pain to 100% agreement for people with lower limb MSK disorders. Concurrent validity ranged from 36% agreement for people with elbow pain to 95.1% agreement for people with lower limb MSK conditions.

DISCUSSION

In cases when access to in-person care is constrained, our study implies that telehealth might be a feasible approach for the diagnosis of MSK conditions. These conclusions are based on small cross-sectional studies carried out by similar research teams with similar participant demographics. Additional research is required to improve the diagnostic precision of telehealth evaluations across a larger range of patient groups, MSK conditions, and diagnostic accuracy statistics.

Reliability of Magnetic Resonance Imaging Criteria for the Preoperative Assessment of Rotator Cuff Tears: A Systematic Review

BACKGROUND

Magnetic resonance (MR) imaging is the most common modality for assessment of the rotator cuff before and after surgery. Several classifications have been described aiming to define main tear characteristics. However, there is still confusion when it comes to the reliability of those classifications.

PURPOSE

(1) To identify all MR classifications available in the literature for preoperative assessment of rotator cuff tears, (2) to summarize available data on the reliability of identified classifications, and (3) to assess the methodological quality of reliability studies.

STUDY DESIGN

Systematic review; Level of evidence, 4.

METHODS

This systematic review was conducted following the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. All studies reporting MR assessment in patients with a superior or posterosuperior rotator cuff tear were included. After identification of the available MR criteria, reliability studies were analyzed. Descriptive statistics were used to summarize findings. Methodological quality was assessed using the Quality Appraisal of Reliability Studies checklist.

RESULTS

A total of 75 studies were included in this review. Eight categories of outcomes could be identified. Of the total, 62 studies reported interobserver reliability whereas 32 reported intraobserver reliability of some of the identified criteria. Each category reflected a variety of reliability, ranging from poor to excellent agreement. MR proved to be a reliable imaging modality to detect the structural integrity of the posterosuperior cuff, especially in cases of full-thickness tear; it was also reliable in terms of tear width and length and muscle atrophy based on a tangent sign or Thomazeau classification. All other classifications did not prove acceptable reliability. Methodological quality was high for 23 articles and moderate for 14.

CONCLUSION

Preoperative MR is a reliable imaging modality to identify full-thickness tears, measure tear size and morphology, and identify muscle atrophy with tangent sign or Thomazeau classification. All other outcomes and classifications did not show acceptable reliability; therefore, caution is needed when using them for preoperative evaluation of a rotator cuff tear.

Inter-Rater Reliability of Thyroid Ultrasound Risk Criteria: A Systematic Review and Meta-Analysis

OBJECTIVE

The most commonly employed diagnostic criteria for identifying thyroid nodules include Thyroid Imaging and Reporting Data System (TI-RADS) and American Thyroid Association (ATA) guidelines. The purpose of this systematic review and meta-analysis is to determine the inter-rater reliability of thyroid ultrasound criteria.

METHODS

We performed a library search of MEDLINE (Ovid), EMBASE (Ovid), and Web of Science for full-text articles published from January 2005 to June 2022. We included full-text primary research articles that used TI-RADS and/or ATA guidelines to evaluate thyroid nodules in adults. These included studies must have calculated inter-rater reliability using any validated metric. The Quality Appraisal for Reliability Studies (QAREL) was used to assess study quality. We planned for a random-effects meta-analysis, in addition to covariate and publication bias analyses. This study was performed in accordance with Preferred Reporting Items for a Systematic Review and Meta-analysis guidelines and registered prior to conduction (International prospective register of systematic reviews-PROSPERO: CRD42021275072).

RESULTS

Of the 951 articles identified via the database search, 35 met eligibility criteria. All studies were observational. The most commonly utilized criteria were ACR Thyroid Imaging and Reporting Data System (TI-RADS) and/or ATA criteria, while the majority of studies employed Κ statistics. For ACR TI-RADS, the pooled Κ was 0.51 (95% confidence interval [CI]: 0.42, 0.57; n = 7) while for ATA, the pooled Κ was 0.52 (95% CI: 0.37, 0.67; n = 3). Due to the small number of studies, covariate or publication bias analyses were not performed.

CONCLUSION

Ultrasound criteria demonstrate moderate inter-rater reliability, but these findings are impacted by poor study quality and a lack of standardization. Laryngoscope, 133:485-493, 2023.

Synthetic CT in Musculoskeletal Disorders: A Systematic Review

ABSTRACT

Repeated computed tomography (CT) examinations increase patients' ionizing radiation exposure and health costs, making an alternative method desirable. Cortical and trabecular bone, however, have short T2 relaxation times, causing low signal intensity on conventional magnetic resonance (MR) sequences. Different techniques are available to create a "CT-like" contrast of bone, such as ultrashort echo time, zero echo time, gradient-echo, and susceptibility-weighted image MR sequences, and artificial intelligence. This systematic review summarizes the essential technical background and developments of ultrashort echo time, zero echo time, gradient-echo, susceptibility-weighted image MR imaging sequences and artificial intelligence; presents studies on research and clinical applications of "CT-like" MR imaging; and describes their main advantages and limitations. We also discuss future opportunities in research, which patients would benefit the most, the most appropriate situations for using the technique, and the potential to replace CT in the clinical workflow.

On understanding reliability for diagnostic tests

For professional practice to be responsible, any diagnostic tests used must be reliable. Therefore, the reliability of any diagnostic test needs to have been measured. The classical statistic for quantifying reliability is Kappa. Although Kappa can be promptly determined using a programmed calculator, using an algorithm to derive Kappa provides greater insight into what it is actually measuring and why. Kappa scores can be graded, with verbal descriptor applied to different grades. However, those descriptors do not necessarily reflect the degree of skill required to achieve different grades of Kappa. High levels of skill attract high Kappa scores, but Kappa scores described as fair or moderate are not necessarily flattering because they can be achieved with questionable levels of skill. Various corrections can be applied to the calculation of Kappa scores in order to raise their value, and to improve the verbal descriptors of their grade, but these may not be legitimate or necessary. Low Kappa scores do not condemn tests but they serve to raise questions about their reliability.

A clinical test to assess isometric cervical strength in chronic whiplash associated disorder (WAD): a reliability study

Background

Cervical spine muscle weakness is well demonstrated in individuals with chronic neck pain. There is a lack of literature evaluating clinically applicable means of assessing isometric cervical strength in chronic whiplash associated disorder (WAD). This study assessed the reliability of self-resisted isometric cervical strength testing using a handheld dynamometer. The relationship between strength and neck pain-related disability and kinesiophobia was also investigated.

Methods

Twenty subjects with chronic WAD performed maximum-effort isometric cervical flexion, extension, side flexion, and rotation against a hand held dynamometer. The dynamometer was held by the subject, who provided self-resistance. Subjects completed two sessions of testing on one day with two different examiners, and one session on a subsequent day with one of the original examiners. Subjects completed the Neck Disability Index (NDI) and Tampa Scale for Kinesiophobia (TSK) prior to the first testing session.

Results

Intraclass correlation coefficients (ICC) for directional strength measures were fair to high (0.71–0.88 for intra-rater and 0.79–0.91 for inter-rater). Total strength (sum of all directional strengths) ICCs were high for both intra-rater (ICC = 0.91) and inter-rater (ICC = 0.94) measures. All statistical tests for ICCs demonstrated significance (α < 0.05). Agreement was assessed using Bland Altman (BA) analysis with 95% limits of agreement. BA analysis demonstrated difference scores between the two testing sessions that ranged from 3.0—17.3% and 4.5—28.5% of the mean score for intra and inter-rater measures, respectively. Most measures did not meet the a priori standard for agreement. A moderate to good inverse relationship was demonstrated between kinesiophobia (TSK score) and six out of seven strength measures (α < .05). No significant correlation was found between neck disability (NDI) and cervical strength in any direction.

Conclusion

This study demonstrated fair to high reliability of self resisted isometric cervical strength testing in the chronic WAD population. All directional strength measures except flexion demonstrated a significant inverse relationship with kinesiophobia. No cervical strength measures were correlated with neck disability. These results support testing cervical strength in this manner to reliably assess change over time within individual patients. The value of such measurement requires further consideration given the lack of correlation between cervical strength and disability. Further research is required to establish normative values and enhance clinical utility.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12891-022-05703-0.

Reliability, Validity, and Responsiveness of the Craniocervical Flexion Test in People Who Are Asymptomatic and Patients With Nonspecific Neck Pain: A Systematic Review and Meta-Analysis

OBJECTIVE

Among the tests designed to evaluate neck neuromuscular function, the craniocervical flexion test (CCFT) assesses the function of the deep cervical flexor muscles (DCFs). The purpose of this study was to conduct a review and meta-analysis of published articles about all measurement properties of the different CCFT versions (CCFT Activation Score [CCFT-AS], CCFT Performance Index [CCFT-PI], CCFT Cumulative Performance Index [CCFT-CPI], and CCFT alternative procedures for measuring activation level (CCFT1) or endurance (CCFT2) in people who were asymptomatic and people with nonspecific neck pain.

METHODS

PubMed Central, MEDLINE, CINAHL, Scopus, Web of Science, and Google Scholar were searched from inception to June 30, 2020. Studies were selected if they reported data on reliability, validity, and/or responsiveness of the CCFT in adults who were asymptomatic or who had nonspecific neck pain. Two reviewers independently selected the studies, conducted quality assessment, and extracted the results. All meta-analyses used a random-effects model.

RESULTS

Twenty-one studies met the inclusion criteria. The rating of interrater reliability (assessed for CCFT-AS and CCFT-CPI) was positive only for using the test at a group level. The same rating was ascribed to the intrarater reliability of CCFT-AS, CCFT1, and CCFT2, whereas CCFT-PI and CCFT-CPI showed positive intrarater reliability for assessment of individuals as well. CCFT validity was rated as positive for expressly assessing DCF action when measuring DCF activation through electromyography-not through ultrasonography-or craniocervical flexion motion as well as for differentiating patients who were asymptomatic and patients who had nonspecific neck pain (only the AS version). CCFT validity was rated as negative for investigating the CCFT performance correlation with the severity of nonspecific neck pain. CCFT responsiveness was rated as negative.

CONCLUSIONS

The CCFT is a potentially useful tool for detecting impairment in DCF control and identifying patients who have nonspecific neck pain and who would benefit from a targeted intervention. However, the limited reliability affects its suitability for that purpose. Further research on the reliability of different CCFT versions in which the raters are thoroughly trained is strongly recommended.

IMPACT

The CCFT might help to detect impairment in DCF control and identify patients who have nonspecific neck pain and who would benefit from a targeted intervention. However, the poor reliability of most versions of the test greatly limits its application in clinical practice. Only CCFT-PI and CCFT-CPI seem reliable enough to help in clinical decision-making at the individual level.

Reliability of the straight leg raise test for suspected lumbar radicular pain: A systematic review with meta-analysis

BACKGROUND

The passive straight leg raise (SLR) and crossed SLR are recommended tests for lumbar radicular pain. There are no recent reviews of test reliability.

OBJECTIVES

To summarize SLR and crossed SLR reliability in patients with suspected lumbar radicular pain.

DESIGN

Systematic review with meta-analysis.

METHOD

MEDLINE and CINAHL were searched for studies published before April 2021 that reported SLR or crossed SLR reliability in patients with low back-related leg pain. Supplemental analyses also included patients with low back pain only. Study selection, risk of bias assessment (QAREL), and data extraction were performed in duplicate. Kappa, intraclass correlation coefficients, and smallest detectable difference (SDD₉₅) quantified reliability. Meta-analysis was performed when appropriate. Confidence in the evidence was determined by applying GRADE principles.

RESULTS/FINDINGS

Fifteen studies met selection criteria. One-hundred-eighty-nine participants had low back-related leg pain. Four-hundred-thirty-nine were included in supplemental analyses. Meta-analyses showed at least fair inter-rater reliability when a positive SLR required provocation of lower extremity symptoms or pain. SLR reliability was at least moderate when testing included structural differentiation (e.g., ankle dorsiflexion). A low prevalence of positive crossed SLR tests led to wide-ranging reliability estimates. Confidence in the evidence for identifying a positive SLR or crossed SLR was moderate to very low. SDD₉₅ values for different raters measuring SLR range of motion ranged from 13 to 20°.

CONCLUSIONS

Reliability data support testing SLR with structural differentiation manoeuvres. Crossed SLR reliability data are inconclusive. Measurement error likely prohibits using SLR range of motion for clinical decision-making.

Validity of range of motion, muscle strength, sensitivity, and Tinel sign tele-assessment in adults with traumatic brachial plexus injury

Background

The COVID-19 pandemic and the need for social distancing created challenges for accessing and providing health services. Telemedicine enables prompt evaluation of patients with traumatic brachial plexus injury, even at a distance, without prejudice to the prognosis. The present study aimed to verify the validity of range of motion, muscle strength, sensitivity, and Tinel sign tele-assessment in adults with traumatic brachial plexus injury (TBPI).

Methods

A cross-sectional study of twenty-one men and women with TBPI admitted for treatment at a Rehabilitation Hospital Network was conducted. The participants were assessed for range of motion, muscle strength, sensitivity, and Tinel sign at two moments: in-person assessment (IPA) and tele-assessment (TA).

Results

The TA muscle strength tests presented significant and excellent correlations with the IPA (the intra-rater intraclass correlation coefficient, ICC ranged between 0.79 and 1.00 depending on the muscle tested). The agreement between the TA and IPA range of motion tests ranged from substantial to moderate (weighted kappa coefficient of 0.47–0.76 (p < 0.05) depending on the joint), and the kappa coefficient did not indicate a statistically significant agreement in the range of motion tests of supination, wrist flexors, shoulder flexors, and shoulder external rotators. The agreement between the IPA andTA sensitivity tests of all innervations ranged from substantial to almost perfect (weighted kappa coefficient 0.61–0.83, p < 0.05) except for the C5 innervation, where the kappa coefficient did not indicate a statistically significant agreement. The IPA versus TA Tinel sign test showed a moderate agreement (weighted kappa coefficient of 0.57, p < 0.05).

Conclusions

The present study demonstrated that muscle strength tele-assessment is valid in adults with TBPI and presented a strong agreement for many components of TA range of motion, sensitivity, and Tinel sign tests.

Leg length discrepancy: A systematic review on the validity and reliability of clinical assessments and imaging diagnostics used in clinical practice

BACKGROUND

A variety of assessments to determine leg length discrepancy (LLD) is used in clinical practice and evidence about validity and reliability may differ.

OBJECTIVE

The objective of this systematic review was to identify and describe the validity and reliability of different assessments and imaging diagnostics for the determination of LLD.

MATERIALS AND METHODS

The review was conducted following the recommendations of Preferred Reporting Items for Systematic reviews and Meta-Analyses (PRISMA). The databases Medline (PubMed) and Index to Chiropractic Literature were systematically searched. Studies regarding clinical assessments and imaging diagnostics for the diagnosis of LLD, which reported the clinimetric properties for assessment of LLD, were included and screened for methodological quality using the Quality Assessment of Studies of Diagnostic Accuracy (QUADAS-2) tool for validity studies and the Quality Appraisal of Diagnostic Reliability (QAREL) tool for reliability studies.

RESULTS

Thirty-seven articles on clinical assessments and 15 studies on imaging diagnostics met the eligibility criteria. Thirteen studies on the validity of clinical assessments and six studies on the validity of imaging diagnostics had a low risk of bias and low concerns regarding applicability for all domains. One study on the reliability of clinical assessments and one study on the reliability of imaging diagnostics had a low risk of bias. Main limitations were, that an analysis of sensitivity and specificity was only performed in a few studies and that a valid reference standard was lacking in numerous studies on clinical assessments.

CONCLUSIONS

For the clinical assessment of LLD, the block test appears to be the most useful method. Full-length standing anteroposterior radiography seems to be the most valid and reliable method and may be used as global reference standard to measure the anatomic LLD when comparing clinical methods and imaging diagnostics.

Visual assessment of movement quality: a study on intra- and interrater reliability of a multi-segmental single leg squat test

Background

The Single Leg Squat test (SLS) is a common tool used in clinical examination to set and evaluate rehabilitation goals, but there is not one established SLS test used in the clinic. Based on previous scientific findings on the reliability of the SLS test and with a methodological rigorous setup, the aim of the present study was to investigate the intra- and interrater reliability of a standardised multi-segmental SLS test.

Methods

We performed a study of measurement properties to investigate the intra- and interrater reliability of a standardised multi-segmental SLS test including the assessment of the foot, knee, pelvis, and trunk. Novice and experienced physiotherapists rated 65 video recorded SLS tests from 34 test persons. We followed the Quality Appraisal for Reliability Studies checklist.

Results

Regardless of the raters experience, the interrater reliability varied between “moderate” for the knee variable (ĸ = 0.41, 95% CI 0.10–0.72) and “almost perfect” for the foot (ĸ = 1.00, 95% CI 1.00–1.00). The intrarater reliability varied between “slight” (pelvic variable; ĸ = 0.17, 95% CI -0.22-0.55) to “almost perfect” (foot variable; ĸ = 1.00, 95% CI 1.00–1.00; trunk variable; ĸ = 0.82, 95% CI 0.66–0.97). A generalised kappa coefficient including the values from all raters and segments reached “moderate” interrater reliability (ĸ = 0.52, 95% CI 0.43–0.61), the corresponding value for the intrarater reliability reached “almost perfect” (ĸ = 0.82, 95% CI 0.77–0.86).

Conclusions

The present study shows a “moderate” interrater reliability and an “almost perfect” intrarater reliability for the variable all segments regardless of the raters experience. Thus, we conclude that the proposed standardised multi-segmental SLS test is reliable enough to be used in an active population.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13102-021-00289-x.

The reliability of maternal audit instruments to assign cause of death in maternal deaths review process: a systematic review and meta-analysis

BACKGROUND

Maternal Death Reviews (MDR) can assist in formulating prevention strategies to reduce maternal mortality. To support MDR, an adequate MDR instrument is required to accurately identify the underlying causes of maternal deaths. We conducted a systematic review and meta-analysis to determine the reliability of maternal death instruments for conducting the MDR process.

METHOD

Three databases: PubMed, ProQuest and EBSCO were systematically searched to identify related research articles published between January 2004 and July 2019. The review and meta-analysis involved identification of measurement tools to conduct MDR in all or part of maternal audit. Eligibiliy and quality of studies were evaluated using the Modified Quality Appraisal of Diagnostic Reliability (QAREL) Checklist: Reliability Studies.

RESULTS

Overall, 242 articles were identified. Six articles examining the instrument used for MDR in 4 countries (4 articles on verbal autopsy (VA) and 2 articles on facility-based MDR) were included. None of studies identified reliability in evaluation instruments assessing maternal audit cycle as a comprehensive approach. The pooled kappa for the MDR instruments was 0.72 (95%CI:0.43-0.99; p < 0.001) with considerable heterogeneity (I² = 96.19%; p < 0.001). Subgroup analysis of MDR instruments showed pooled kappa in VA of 0.89 (95%CI:0.52-1.25) and facility-based MDR of 0.48 (95%CI:0.15-0.82). Meta-regression analysis tended to show the high heterogeneity was likely associated with sample sizes, regions, and year of publications.

CONCLUSIONS

The MDR instruments appear feasible. Variation of the instruments suggest the need for judicious selection of MDR instruments by considering the study population and assessment during the target periods.

Gross motor skill development is similar in children post Ponseti casting for congenital talipes equinovarus compared to typically developing children: a systematic review

This review aimed to investigate gross motor skill development in children with congenital talipes equinovarus (CTEV) following the Ponseti method of casting and bracing. Summary of evidence revealed through a systematic search of electronic databases completed in May 2019. A Preferred Reporting Items for Systematic Reviews and Meta-Analyses statement was used to report and conduct the study. The McMaster Critical Review Form was used to critically appraise included studies and a descriptive synthesis of the results is reported. Inclusion criteria for studies included participants aged above 4 years, with a diagnosis of CTEV, treated via the Ponseti method and followed up with valid gross motor outcome measures. The comparator was a control group of typically developing children, or reference data. The searches resulted in 619 unique articles. Eight studies (retrospective cohort/case control studies) met inclusion criteria. There were nine different outcome measures used with 29 domains being relevant to this review. Synthesis of the findings found no significant difference between the gross motor skills of children with CTEV treated with Ponseti and typically developing children. The balance domains of three measures were consistently lower for the CTEV group versus controls/normative data. Yet, it is still demonstrated that most gross motor skills are within the typically developing range. It must be considered, however, that there is a spectrum of severity of CTEV and overall gross motor function should be monitored.

Reliability and Validity of Patient-Reported, Rater-Based, and Hybrid Physical Activity Assessments in COPD: A Systematic Review

Selecting valid and reliable PA assessments in chronic obstructive pulmonary disease (COPD) is crucial to ensure that the information obtained is accurate, valuable, and meaningful. The purpose of this systematic review was to compare the validity and reliability among PA assessments in COPD. An electronic database search of PubMed and CINAHL was completed in December 2019 using MeSH terms on physical activity, COPD, validation, and questionnaires. Transparency in reporting was assessed with the STrengthening the Reporting of OBservational studies in Epidemiology (STROBE) checklist while methodological quality was assessed with the modified Quality Appraisal tool for Reliability studies (QAREL) for reliability studies and the Quality Appraisal of Validity Studies (QAVALS) for validity studies. The search yielded fifteen different measures. The Stanford 7-day recall (PAR) demonstrated the strongest correlations with SenseWear Armband on energy expenditure (r = 0.83; p < 0.001) and moderate correlations for time spent in activity over 3 METs (r = 0.54, p < 0.001). The Multimedia Activity Recall (MARCA) also demonstrated moderate to good correlations with both SenseWear and Actigraph GT3X + accelerometers (r = 0.66-0.74). Assisted and computerized PRO measures (PAR and MARCA) and hybrid measures (C-PPAC and D-PPAC) demonstrate better psychometric properties as compared to other subjective measures and may be considered for quantification of PA in COPD. However, observations drawn from single validation studies limit strength of recommendations and further research is needed to replicate the findings.

How has DSM-5 Affected Autism Diagnosis? A 5-Year Follow-Up Systematic Literature Review and Meta-analysis

We conducted a 5-year follow-up systematic review and meta-analysis to determine change in frequency of autism spectrum disorder (ASD) diagnosis since diagnostic and statistical manual 5 (DSM-5) publication and explore the impact of Social Communication Disorder (SCD). For 33 included studies, use of DSM-5 criteria suggests decreases in diagnosis for ASD [20.8% (16.0-26.7), p < 0.001], DSM-IV-TR Autistic Disorder [10.1% (6.2-16.0), p < 0.001], and Asperger's [23.3% (12.9-38.5), p = 0.001]; pervasive developmental disorder-not otherwise specified decrease was not significant [46.1% (34.6-58.0), p = 0.52]. Less than one-third [28.8% (13.9-50.5), p = 0.06] of individuals diagnosed with DSM-IV-TR but not DSM-5 ASD would qualify for SCD. Findings suggest smaller decreases in ASD diagnoses compared to earlier reviews. Future research is needed as concerns remain for impaired individuals without a diagnosis.

Through the quality kaleidoscope: reflections on research in dentomaxillofacial imaging

The REduce research Waste And Reward Diligence statement has highlighted how weaknesses in health research can produce misleading results and waste valuable resources. Research on diagnostic efficacy in the field of dentomaxillofacial radiology (DMFR) is no exception to these criticisms and could be strengthened by more robust study designs, consistent use of a core set of outcome measures and completeness in reporting. Furthermore, we advocate that everyone participating in collaborative research on clinical interventions subscribes to the importance of methodological quality in how imaging methods are used. The aim of this paper, therefore, is to present a guide to conducting high-quality research on diagnostic efficacy in DMFR.We initially propose a framework inspired by the hierarchical model of efficacy of Fryback and Thornbury, highlighting study designs, measures of analysis, completeness of reporting and established guidelines to assist in these aspects of research. Bias in research, and measures to prevent or limit it, are then described.It is desirable to climb the Fryback and Thornbury "ladder" from technical efficacy, via accuracy and clinical efficacy, to societal efficacy of imaging methods. Efficacy studies on the higher steps of the ladder may be difficult to perform, but we must strive to answer questions of how useful our methods are in patient management and assess benefits, risks, costs, ethical and social issues. With the framework of six efficacy levels as the structure and based on our experience, we present information that may facilitate quality enhancement of diagnostic efficacy research in DMFR.

The clinical utility of routine spinal radiographs by chiropractors: a rapid review of the literature

INTRODUCTION

When indicated by signs or symptoms of potentially serious underlying pathology (red flags), chiropractors can use radiographs to inform their diagnosis. In the absence of red flags, the clinical utility of routine or repeat radiographs to assess the structure and function of the spine is controversial.

OBJECTIVES

To determine the diagnostic and therapeutic utility of routine or repeat radiographs (in the absence of red flags) of the cervical, thoracic or lumbar spine for the functional or structural evaluation of the spine. Investigate whether functional or structural findings on repeat radiographs are valid markers of clinically meaningful outcomes. The research objectives required that we determine the validity, diagnostic accuracy and reliability of radiographs for the structural and functional evaluation of the spine.

EVIDENCE REVIEW

We searched MEDLINE, CINAHL, and Index to Chiropractic Literature from inception to November 25, 2019. We used rapid review methodology recommended by the World Health Organization. Eligible studies (cross-sectional, case-control, cohort, randomized controlled trials, diagnostic and reliability) were critically appraised. Studies of acceptable quality were included in our synthesis. The lead author extracted data and a second reviewer independently validated the data extraction. We conducted a qualitative synthesis of the evidence.

FINDINGS

We identified 959 citations, screened 176 full text articles and critically appraised 23. No relevant studies assessed the clinical utility of routine or repeat radiographs (in the absence of red flags) of the cervical, thoracic or lumbar spine for the functional or structural evaluation of the spine. No studies investigated whether functional or structural findings on repeat radiographs are valid markers of clinically meaningful outcomes. Nine low risk of bias studies investigated the validity (n = 2) and reliability (n = 8) of routine or repeat radiographs. These studies provide no evidence of clinical utility.

CONCLUSION

We found no evidence that the use of routine or repeat radiographs to assess the function or structure of the spine, in the absence of red flags, improves clinical outcomes and benefits patients. Given the inherent risks of ionizing radiation, we recommend that chiropractors do not use radiographs for the routine and repeat evaluation of the structure and function of the spine.

Reliability of the conditioned pain modulation paradigm across three anatomical sites

Background and aims Conditioned Pain Modulation (CPM) is a measure of pain inhibition-facilitation in humans that may elucidate pain mechanisms and potentially serve as a diagnostic test. In laboratory settings, the difference between two pain measures [painful test stimulus (TS) without and with the conditioning stimulus (CS) application] reflects the CPM magnitude. Before the CPM test can be used as a diagnostic tool, its reliability on the same day (intra-session) and across multiple days (inter-session) needs to be known. Furthermore, it is important to determine the most reliable anatomical sites for both the TS and the CS. This study aimed to measure the intra-session and inter-session reliability of the CPM test paradigm in healthy subjects with the TS (pressure pain threshold-PPT) applied to three test sites: the face, hand, and dorsum of the foot, and the CS (cold pressor test-CPT) applied to the contralateral hand. Methods Sixty healthy participants aged 18-65 were tested by the same examiner on 3 separate days, with an interval of 2-7 days. On each day, testing was comprised of two identical experimental sessions in which the PPT test was performed on each of the three dominant anatomical sites in randomized order followed by the CPM test (repeating the PPT with CPT on the non-dominant hand). CPM magnitude was calculated as the percent change in PPT. The Intraclass Correlation Coefficient (ICC), Coefficient of Variation (CV), and Bland-Altman analyses were used to assess reliability. Results PPT relative reliability ranged from good to excellent at all three sites; the hand showed an intra-session ICC of 0.90 (0.84, 0.94) before CPT and ICC of 0.89 (0.83, 0.92) during CPT. The PPT absolute reliability was also high, showing a low bias and small variability when performed on all three sites; for example, CV of the hand intra-session was 8.0 before CPT and 8.1 during CPT. The relative reliability of the CPM test, although only fair, was most reliable when performed during the intra-session visits on the hand; ICC of 0.57 (0.37, 0.71) vs. 0.20 (0.03, 0.39) for the face, and 0.22 (0.01, 0.46) for the foot. The inter-session reliability was lower in all three anatomical sites, with the best reliability on the hand with an ICC of 0.40 (0.23, 0.55). The pattern of absolute reliability of CPM was similar to the relative reliability findings, with the reliability best on the hand, showing lower intra-session and inter-session variability (CV% = 43.5 and 51.5, vs. 70.1 and 73.1 for the face, and 75.9 and 78.9 for the foot). The CPM test was more reliable in women than in men, and in older vs. younger participants. Discussion The CPM test was most reliable when the TS was applied to the dominant hand and CS performed on the contralateral hand. These data indicate that using the CS and TS in the same but contralateral dermatome in CPM testing may create the most reliable results.

Interobserver Reliability in Imaging-Based Fracture Union Assessment-Two Systematic Reviews

OBJECTIVES

(A) To investigate the specialty of observers involved in imaging-based assessment of bone fracture union in recent orthopaedic trials and (B) to provide a general overview of observer differences (in terms of interobserver reliability) in radiologic fracture union assessment that have been reported between surgeons and radiologists.

DATA SOURCES

Two separate systematic reviews (A, B) of English-, German-, and French-language articles in MEDLINE and Embase databases using the Preferred Reporting Items for Systematic Reviews and Meta-analyses (PRISMA) guidelines were done, with the following time frames: (A) January 2016-August 2017 and (B) through November 2017.

STUDY SELECTION

(A) Clinical trials of surgical fracture treatment evaluating radiologic (non) union. (B) Interobserver studies reporting kappa-values or intraclass correlation coefficients as reliability coefficient for radiologic fracture union assessment. Inclusion criteria for both reviews were fractures of the appendicular skeleton and the use of radiographs or computed tomography.

DATA EXTRACTION

Data were independently retrieved by 2 reviewers.

DATA SYNTHESIS

Descriptive statistics and percentages were reported.

RESULTS

(A) Forty-eight trials were included, whereof 33 (68%) did not report the observer's specialty. Six trials (13%) reported surgeon observers only, and 6 (13%) reported radiologist observers only. The median number of observers is 1 (interquartile range, 1-2). (B) Thirty-one interobserver studies were included, whereof 11 (35%) included at least 1 surgeon and 1 radiologist. Interobserver reliability varied considerably across the various fracture types studied and outcome scale used and was often unsatisfactory (kappa or intraclass correlation coefficients of <0.7).

CONCLUSIONS

In most trials providing observer's characteristics, radiologic fracture union was either rated by 1 surgeon or 1 radiologist. As interobserver reliability can be unsatisfactory, we recommend surgeons and radiologists to further intensify collaboration and trials to include at least 2 observers and associated reliability statistics.

Validity and Reliability of Accelerometers in Patients With COPD: A SYSTEMATIC REVIEW

PURPOSE

Reduced physical activity is associated with poor prognosis in chronic obstructive pulmonary disease (COPD). Accelerometers have greatly improved quantification of physical activity by providing information on step counts, body positions, energy expenditure, and magnitude of force. The purpose of this systematic review was to compare the validity and reliability of accelerometers used in patients with COPD.

METHODS

An electronic database search of MEDLINE and CINAHL was performed. Study quality was assessed with the Strengthening the Reporting of Observational Studies in Epidemiology checklist while methodological quality was assessed using the modified Quality Appraisal Tool for Reliability Studies.

RESULTS

The search yielded 5392 studies; 25 met inclusion criteria. The SenseWear Pro armband reported high criterion validity under controlled conditions (r = 0.75-0.93) and high reliability (ICC = 0.84-0.86) for step counts. The DynaPort MiniMod demonstrated highest concurrent validity for step count using both video and manual methods.

DISCUSSION

Validity of the SenseWear Pro armband varied between studies especially in free-living conditions, slower walking speeds, and with addition of weights during gait. A high degree of variability was found in the outcomes used and statistical analyses performed between studies, indicating a need for further studies to measure reliability and validity of accelerometers in COPD.

CONCLUSION

The SenseWear Pro armband is the most commonly used accelerometer in COPD, but measurement properties are limited by gait speed variability and assistive device use. DynaPort MiniMod and Stepwatch accelerometers demonstrated high validity in patients with COPD but lack reliability data.

THE RELIABILITY OF THE STAR EXCURSION BALANCE TEST AND LOWER QUARTER Y-BALANCE TEST IN HEALTHY ADULTS: A SYSTEMATIC REVIEW

BACKGROUND

Dynamic balance is often an important criterion used during lower extremity musculoskeletal injury prediction, prevention, and rehabilitation processes. Methods to assess lower extremity dynamic balance include the Star Excursion Balance Test (SEBT) and Lower Quarter Y-Balance Test (YBT). Due to the importance of dynamic balance it is imperative to establish reliable quantification techniques.

PURPOSE

To conduct a systematic review to assess the reliability and responsiveness of the SEBT/YBT.

STUDY DESIGN

Systematic Review.

METHODS

Electronic databases (PubMed, MEDLINE, CINAHL, and SPORTDiscus) were searched from inception to August 2018. Included studies examined the intra- and inter-rater reliability of the SEBT/YBT in healthy adults. Two investigators independently assessed methodological quality, level of evidence and strength of recommendation with the Qualtiy Appraisal of Reliability Studies (QAREL) scale. Relative intra and inter-rater reliability was examined through intraclass correlation coefficients (ICC) and responsiveness was evaluated through minimal detectable change (MDC). Data was analyzed based on reach direction (Anterior, Posteromedial, and Posterolateral) and normalization (normalized and non-normalized). Additionally, data were then synthesized using the strength of recommendation taxonomy to provide a grade of recommendation.

RESULTS

A total of nine studies were included in this review. Six studies examined the inter-rater reliability and seven assessed intra-rater reliability. The included studies had a median QAREL score of 66.89% (range = 55.56% to 75.00%) and 59.03% (range = 33.33 to 66.67%) for inter and intra-rater reliability respectively. Median ICC values for inter-rater reliability were 0.88 (Range = 0.83 - 0.96), 0.87 (range = 0.80 - 1.00), and 0.88 (range = 0.73 - 1.00) for the anterior, posteromedial, and posterolateral directions respectively. Median ICC values for intra-rater reliability were 0.88 (Range = 0.84 - 0.93), 0.88 (Range = 0.85 - 0.94), and 0.90 (Range = 0.68 - 0.94) for the anterior, posteromedial, and posterolateral directions, respectively.

CONCLUSIONS

There is grade A evidence to support that the SEBT/YBT have excellent inter and intra-rater reliability when used in healthy adults. Furthermore, minimal detectable change values have been provided that can be used in practice to aid clinical decision making. Future research is needed to assess the reliability, responsiveness, and validity of the SEBT/YBT in pathologic populations.

LEVEL OF EVIDENCE

1a.

Development and validation of a quality appraisal tool for validity studies (QAVALS)

Background: Appraisal of methodological quality of included studies is an important component of conducting systematic reviews. Although several quality appraisal tools are available for intervention studies, fewer tools are available for non-randomized designs, especially for studies of measurement properties.Objectives: The purpose of this study was to develop a quality appraisal tool specific to validity studies (QAVALS) and to examine its reliability and validity.Methods: Following identification of key concepts, an initial list of 34 possible items was developed. Content experts rated each item as either 'essential', 'useful but not essential', and 'not necessary'. The content validity ratio (CVR) and content validity index (CVI) were calculated to establish content validity following two rounds of review. Inter-rater and test-retest reliability were assessed by two external reviewers using weighted kappa coefficients.Results: Items below a CVR of 0.50 were eliminated resulting in the modified version with 27 items. Following the second round, the final tool with 24 items was developed. The content validity index of QAVALS was 0.90. QAVALS demonstrated excellent test-retest reliability (k = 0.80-0.84, 95% CI = 0.76-0.90) and good overall inter-rater reliability (k = 0.70, 95% CI = 0.61-0.79).Limitations: Individual item reliability was low for four items. Further research is warranted to examine reliability using larger number of studies and raters with different experience levels.Conclusion: QAVALS is the first quality appraisal tool specifically designed to address common types of validity. The QAVALS demonstrates strong content validity, good overall inter-rater and excellent test-retest reliability.

Visual assessment of movement quality in the single leg squat test: a review and meta-analysis of inter-rater and intrarater reliability

Single leg squat (SLS) is a common tool used in clinical examination to set and evaluate rehabilitation goals, but also to assess lower extremity function in active people.

Reliability and Validity of Measurement Tools for Residual Limb Volume in People With Limb Amputations: A Systematic Review

BACKGROUND

Measurements of residual limb volume often guide decisions on the type and timing of prosthetic prescription. To help inform these decisions, it is important that clinicians use measurement tools that are reliable and valid.

PURPOSE

The aim of this systematic review was to investigate the reliability and validity of measurement tools for residual limb volume in people with limb amputations.

DATA SOURCES

A comprehensive search on MEDLINE, EMBASE, CINAHL, Scopus, and Web of Science was performed on July 11, 2016.

STUDY SELECTION

Studies were included if they examined the reliability or validity of measurement tools for residual limb volume, were conducted on humans, and were published in English.

DATA EXTRACTION

Data were extracted from 11 reliability and 4 validity studies and included study characteristics, volumetric estimates, and reliability and validity estimates. The quality of the studies was also rated.

DATA SYNTHESIS

Data from 2 studies (38 participants) indicated good to excellent intrarater (intraclass correlation coefficient [ICC] ≥0.88) and interrater (ICC ≥0.88) reliability and high between-session reliability (coefficient of variation [CV] = 10%) for water displacement volumetry. One study (28 participants) reported excellent intrarater and interrater reliability (ICC ≥0.93) for the circumferential method, and data from 2 studies (19 participants) indicated high between-session reliability for the optical surface scanner (CV ≤9.8%). Three studies (26 participants) indicated good to excellent between-session reliability results for computed tomography (CV = 9.2%-10.9%). One study (7 participants) showed moderate within-session reliability (CV = 50%). Using water displacement volumetry as the gold standard, 2 studies (79 participants) indicated excellent validity for the circumferential method ( r ≥0.92; ICC ≥0.92). All studies reporting measures of reliability or validity were performed with people who had transtibial amputations.

LIMITATIONS

Only studies published in English and in which water displacement volumetry was used as the gold standard were included in this review. The reliability and validity of the quality rating scale used in this review have not been tested.

CONCLUSIONS

On the basis of a limited number of moderate- to high-quality studies with small sample sizes, circumferential and water displacement methods were found to be reliable, and the circumferential method was found to be valid in people with transtibial amputations. There are inadequate data for drawing conclusions about volume measurement methods in people with other types of limb amputations.

Reliability and validity of self-reported questionnaires to measure pain and disability in adults with neck pain and its associated disorders: part 3-a systematic review from the CADRE Collaboration

PURPOSE

To determine the reliability and validity of self-reported questionnaires to measure pain and disability in adults with grades I-IV neck pain and its associated disorders (NAD).

METHODS

We updated the systematic review of the 2000-2010 Bone and Joint Decade Task Force on Neck Pain and its Associated Disorders and systematically searched databases from 2005 to 2017. Independent reviewers screened and critically appraised studies using standardized tools. Evidence from low-risk-of-bias studies was synthesized according to best evidence synthesis principles. Validity studies were ranked according to the Sackett and Haynes classification.

RESULTS

We screened 2823 articles, and 26 were eligible for critical appraisal; 18 were low risk of bias. Preliminary evidence suggests that the Neck Disability Index (original and short versions), Whiplash Disability Questionnaire, Neck Pain Driving Index, and ProFitMap-Neck may be valid and reliable to measure disability in patients with NAD. We found preliminary evidence for the validity and reliability of pain measurements including the Body Pain Diagram, Visual Analogue Scale, the Numeric Rating Scale and the Pain-DETECT Questionnaire.

CONCLUSION

The evidence supporting the validity and reliability of instruments used to measure pain and disability is preliminary. Further validity studies are needed to confirm the clinical utility of self-reported questionnaires to assess pain and disability in patients with NAD. These slides can be retrieved under Electronic Supplementary Material.

Reliability and validity of clinical tests to assess posture, pain location, and cervical spine mobility in adults with neck pain and its associated disorders: Part 4. A systematic review from the cervical assessment and diagnosis research evaluation (CADRE) collaboration

PURPOSE

To determine the reliability and validity of clinical tests to assess posture, pain location, and cervical spine mobility in adults with grades I-IV neck pain and associated disorders (NAD).

METHODS

We systematically searched electronic databases to update the systematic review of the Bone and Joint Decade 2000-2010 Task Force on Neck Pain and Its Associated Disorders. Eligible reliability and validity studies were critically appraised using modified versions of the QAREL and QUADAS-2 instruments, respectively. Evidence from low risk of bias studies were synthesized following best evidence synthesis principles.

RESULTS

We screened 14302 articles, critically appraised 46 studies, and found 32 low risk of bias articles (14 reliability and 18 validity studies). We found preliminary evidence of: 1) reliability of visual inspection, aided with devices (CROM and digital caliper) to assess head posture; 2) reliability and validity of soft tissue palpation to locate tender/trigger points in muscles; 3) reliability and validity of joint motion palpation to assess stiffness and pain provocation in combination; and 4) range of motion tests using visual estimation (in cervical extension only) or devices (digital caliper, goniometer, inclinometer) to assess cervical mobility.

CONCLUSIONS

We found little evidence to support the reliability and validity of clinical tests to assess head posture, pain location and cervical mobility in adults with NAD grades I-III. More advanced validity studies are needed to inform the clinical utility of tests used to evaluate patients with NAD.

Are Ultrasound Measurements of Achilles Tendon Size Reliable? A Systematic Review of Rater Reliability

Ultrasound measurements of Achilles tendon size are used to assess the tendon's response to exercise, aging, rehabilitation, tendon loading and healing. It is important to understand and minimise the measurement error that occurs with these measurements. This review identified and synthesised studies reporting on intra- and inter-rater reliability of ultrasound measurements of Achilles tendon size. Analysis of 21 studies revealed that good to excellent intra- and inter-rater reliability can be achieved for ultrasound measurements of Achilles tendon size. Reliability can be optimised by using one experienced operator, standardising transducer pressure and orientation and averaging two or three measurements. There was a high risk of methodological bias across the included studies. Reporting of reliability studies needs to be improved by the use of existing reporting guidelines and expansion of these guidelines to include important elements of ultrasound imaging.

Reliability of the Mechanical Diagnosis and Therapy System in Patients With Spinal Pain: A Systematic Review

BACKGROUND

An updated summary of the evidence for the reliability of the Mechanical Diagnosis and Therapy (MDT) system in patients with spinal pain is needed.

OBJECTIVE

To investigate the evidence on the intrarater and interrater reliability of MDT in patients with spinal pain.

METHODS

Searches in MEDLINE, CINAHL, Embase, PEDro, and Scopus were conducted for this systematic review. We included any study design as long as reliability of the MDT method was tested in patients with spinal pain. We collected data on the reliability of MDT to identify main and subsyndromes, directional preference, the centralization phenomenon, and lateral shift. The methodological quality of studies was assessed using the Quality Appraisal of Diagnostic Reliability and the Guidelines for Reporting Reliability and Agreement Studies checklists.

RESULTS

Twelve studies were included (8 studies on back pain, pooled n = 2160 patients; 3 studies on neck pain, pooled n = 45 patients; and 3 studies recruited mixed spinal conditions, pooled n = 389 patients). Studies investigating patients with back pain reported kappa estimates ranging from 0.26 to 1.00 (main and subsyndromes), 0.27 to 0.90 (directional preference), and 0.11 to 0.70 (centralization phenomenon). Kappa estimates for studies investigating neck pain ranged from 0.47 to 0.84 (main and subsyndromes) and 0.46 (directional preference). In mixed populations, kappa estimates ranged from 0.56 to 0.96 (main and subsyndromes).

CONCLUSION

The MDT system appears to have acceptable interrater reliability for classifying patients with back pain into main and subsyndromes when applied by therapists who have completed the credentialing examination, but unacceptable reliability in other therapists. We found conflicting evidence regarding the reliability of the MDT system in patients with neck pain or mixed pain locations. J Orthop Sports Phys Ther 2018;48(12):923-933. Epub 22 Jun 2018. doi:10.2519/jospt.2018.7876.

The reliability and validity of goniometric elbow measurements in adults: A systematic review of the literature

BACKGROUND

The universal goniometer is a simple measuring tool. With this review we aimed to investigate the reliability and validity of the universal goniometer in measurements of the adults' elbow.

METHODS

Preferred Reporting Items for Systematic reviews and Meta-Analysis guidelines were followed and our study protocol was published online at PROSPERO. A literature search was conducted on relevant studies. Methodological quality was assessed using the Quality Appraisal of Diagnostic Reliability (QAREL) scoring system.

RESULTS

Out of 697 studies yielded from our literature search, 12 were included. Six studies were rated as high quality. The intrarater reliability intraclass correlation coefficient ranged from 0.45 to 0.99, the interrater reliability ranged from intraclass correlation coefficient 0.53-0.97. One study providing instructions on goniometric alignment did not find a difference in expert versus non-expert examiners. Another study in which examiners were not instructed found a higher interrater reliability in expert examiners. One study investigating the validity of the goniometer in elbow measurements found a maximum standard error of the mean of 11.5° for total range of motion.

DISCUSSION

Overall, the studies showed high intra- and interrater reliability of the universal goniometer. The reliability of the universal goniometer in non-expert examiners can be increased by clear instructions on goniometric alignment.

Reliability and Validity of Frontal Plane Kinematics of the Trunk and Lower Extremity Measured With 2-Dimensional Cameras During Athletic Tasks: A Systematic Review With Meta-analysis

BACKGROUND

Two-dimensional (2-D) analysis is commonly used to quantify frontal plane kinematics of the trunk and lower extremity. However, there are conflicting results regarding the reliability and validity of these measurements.

OBJECTIVE

To synthesize the current literature to determine whether 2-D analysis is a reliable and valid method of measuring frontal plane kinematics of the trunk and lower extremity during squatting, landing, and cutting tasks.

METHODS

For this systematic review with meta-analysis, MEDLINE, CINAHL, Embase, Scopus, and SPORTDiscus databases were searched from inception until March 2017. The authors included 16 studies that evaluated the reliability and/or validity of 2-D measurements of frontal plane trunk and/or lower extremity kinematics when compared to 3-D measurements during any of the following tasks: squatting, landing, or cutting.

RESULTS

Intrarater reliability (intraday and interday) and interrater reliability of the 2-D video measurements varied from moderate to excellent. In terms of validity, there was poor agreement between the 2-D and 3-D methods, with no correlation between 2-D knee frontal plane projection angle and 3-D knee frontal plane angles (r = 0.127, P = .094) for the single-leg squat, but a moderate to good relationship (r = 0.619, P<.001) for the landing task.

CONCLUSION

Two-dimensional video analysis of frontal plane trunk and lower extremity kinematics is reliable, but this appears to be dependent on the task and the type of reliability evaluated. The current evidence does not support the use of 2-D video analysis for measuring trunk and lower extremity frontal plane kinematics when accurate measures are required.

LEVEL OF EVIDENCE

Diagnosis, level 3. J Orthop Sports Phys Ther 2018;48(10):812-822. Epub 12 Jun 2018. doi:10.2519/jospt.2018.8006.

The reliability and measurement error of protractor-based goniometry of the fingers: A systematic review

STUDY DESIGN

Systematic review PURPOSE OF THE STUDY: The purpose was to review the available literature for evidence on the reliability and measurement error of protractor-based goniometry assessment of the finger joints.

METHODS

Databases were searched for articles with key words "hand," "goniometry," "reliability," and derivatives of these terms. Assessment of the methodological quality was carried out using the Consensus-Based Standards for the Selection of Health Measurement Instruments checklist. Two independent reviewers performed a best evidence synthesis based on criteria proposed by Terwee et al (2007).

RESULTS

Fifteen articles were included. One article was of fair methodological quality, and 14 articles were of poor methodological quality. An acceptable level for reliability (intraclass correlation coefficient > 0.70 or Pearson's correlation > 0.80) was reported in 1 study of fair methodological quality and in 8 articles of low methodological quality. Because the minimal important change was not calculated in the articles, there was an unknown level of evidence for the measurement error.

DISCUSSION

Further research with adequate sample sizes should focus on reference outcomes for different patient groups. For valid therapy evaluation, it is important to know if the change in range of motion reflects a real change of the patient or if this is due to the measurement error of the goniometer. Until now, there is insufficient evidence to establish this cut-off point (the smallest detectable change).

CONCLUSION

Following the Consensus-Based Standards for the Selection of Health Measurement Instruments criteria, there was limited level of evidence for an acceptable reliability in the dorsal measurement method and unknown level of evidence for the measurement error.

LEVEL OF EVIDENCE

2a.

Paediatric flexible flat foot: how are we measuring it and are we getting it right? A systematic review

BACKGROUND

Flexible flat foot is a normal observation in typically developing children, however, some children with flat feet present with pain and impaired lower limb function. The challenge for health professionals is to identify when foot posture is outside of expected findings and may warrant intervention. Diagnoses of flexible flat foot is often based on radiographic or clinical measures, yet the validity and reliability of these measures for a paediatric population is not clearly understood. The aim of this systematic review was to investigate how paediatric foot posture is defined and measured within the literature, and if the psychometric properties of these measures support any given diagnoses.

METHODS

Electronic databases (MEDLINE, CINAHL, EMBASE, Cochrane, AMED, SportDiscus, PsycINFO, and Web of Science) were systematically searched in January 2017 for empirical studies where participants had diagnosed flexible flat foot and were aged 18 years or younger. Outcomes of interest were the foot posture measures and definitions used. Further articles were sought where cited in relation to the psychometric properties of the measures used.

RESULTS

Of the 1101 unique records identified by the searches, 27 studies met the inclusion criteria involving 20 foot posture measures and 40 definitions of paediatric flexible flat foot. A further 18 citations were sought in relation to the psychometric properties of these measures. Three measures were deemed valid and reliable, the FPI-6 > + 6 for children aged three to 15 years, a Staheli arch index of > 1.07 for children aged three to six and ≥ 1.28 for children six to nine, and a Chippaux-Smirak index of > 62.7% in three to seven year olds, > 59% in six to nine year olds and ≥ 40% for children aged nine to 16 years. No further measures were found to be valid for the paediatric population.

CONCLUSION

No universally accepted criteria for diagnosing paediatric flat foot was found within existing literature, and psychometric data for foot posture measures and definitions used was limited. The outcomes of this review indicate that the FPI - 6, Staheli arch index or Chippaux-Smirak index should be the preferred method of paediatric foot posture measurement in future research.

Test Procedures to Assess Somatosensory Abnormalities in Individuals with Peripheral Joint Pain: A Systematic Review of Psychometric Properties

BACKGROUND

Test procedures that were developed to assess somatosensory abnormalities should possess optimal psychometric properties (PMPs) to be used in clinical practice. The aim of this systematic review was to evaluate the literature to assess the level of evidence for PMPs of test procedures investigated in individuals with peripheral joint pain (PJP).

METHODS

A comprehensive electronic literature search was conducted in 7 databases from inception to March 2016. The Quality Appraisal for Reliability Studies (QAREL) checklist and the Consensus-based Standards for the Selection of Health Status Measurement Instruments (COSMIN) tool were used to assess risk for bias of the included studies. Level of evidence was evaluated based on the methodological quality and the quality of the measurement properties.

RESULTS

Forty-one studies related to PJP were included. The majority of included studies were considered to be of insufficient methodological quality, and the level of evidence for PMPs varied across different test procedures. The level of evidence for PMPs varied across different test procedures in different types of PJP. Hand-held pressure algometry is the only test procedure that showed moderate positive evidence of intrarater reliability, agreement, and responsiveness, simultaneously, when it was investigated in patients with chronic knee osteoarthritis.

CONCLUSIONS

This systematic review identified that the level of evidence for PMPs varied across different testing procedures to assess somatosensory abnormalities for different PJP populations. Further research with standardized protocols is recommended to further investigate the predictive ability and responsiveness of reported test procedures in order to warrant their extended utility in clinical practice.

Adaptation of a MR imaging protocol into a real-time clinical biometric ultrasound protocol for persons with spinal cord injury at risk for deep tissue injury: A reliability study

BACKGROUND

High strain in soft tissues that overly bony prominences are considered a risk factor for pressure ulcers (PUs) following spinal cord impairment (SCI) and have been computed using Finite Element methods (FEM). The aim of this study was to translate a MRI protocol into ultrasound (US) and determine between-operator reliability of expert sonographers measuring diameter of the inferior curvature of the ischial tuberosity (IT) and the thickness of the overlying soft tissue layers on able-bodied (AB) and SCI using real-time ultrasound.

MATERIAL AND METHODS

Part 1: Fourteen AB participants with a mean age of 36.7 ± 12.09 years with 7 males and 7 females had their 3 soft tissue layers in loaded and unloaded sitting measured independently by 2 sonographers: tendon/muscle, skin/fat and total soft tissue and the diameter of the IT in its short and long axis. Part 2: Nineteen participants with SCI were screened, three were excluded due to abnormal skin signs, and eight participants (42%) were excluded for abnormal US signs with normal skin. Eight SCI participants with a mean age of 31.6 ± 13.6 years and all male with 4 paraplegics and 4 tetraplegics were measured by the same sonographers for skin, fat, tendon, muscle and total. Skin/fat and tendon/muscle were computed.

RESULTS

AB between-operator reliability was good (ICC = 0.81-0.90) for 3 soft tissues layers in unloaded and loaded sitting and poor for both IT short and long axis (ICC = -0.028 and -0.01). SCI between-operator reliability was good in unloaded and loaded for total, muscle, fat, skin/fat, tendon/muscle (ICC = 0.75-0.97) and poor for tendon (ICC = 0.26 unloaded and ICC = -0.71 loaded) and skin (ICC = 0.37 unloaded and ICC = 0.10).

CONCLUSION

A MRI protocol was successfully adapted for a reliable 3 soft tissue layer model and could be used in a 2-D FEM model designed to estimate soft tissue strain as a novel risk factor for the development of a PU.

Diagnosis of Upper Quadrant Lymphedema Secondary to Cancer: Clinical Practice Guideline From the Oncology Section of the American Physical Therapy Association

The Oncology Section of the American Physical Therapy Association (APTA) developed a clinical practice guideline to aid the clinician in diagnosing secondary upper quadrant cancer-related lymphedema. Following a systematic review of published studies and a structured appraisal process, recommendations were written to guide the physical therapist and other health care clinicians in the diagnostic process. Overall clinical practice recommendations were formulated based on the evidence for each diagnostic method and were assigned a grade based on the strength of the evidence for different patient presentations and clinical utility. In an effort to maximize clinical applicability, recommendations were based on the characteristics as to the location and stage of a patient's upper quadrant lymphedema.

Diagnosis of Upper-Quadrant Lymphedema Secondary to Cancer: Clinical Practice Guideline From the Oncology Section of APTA

INTRODUCTION

The Oncology Section of APTA developed a clinical practice guideline to aid the clinician in diagnosing secondary upper-quadrant cancer-related lymphedema.

METHODS

Following a systematic review of published studies and a structured appraisal process, recommendations were written to guide the physical therapist and other health care clinicians in their diagnostic process. Overall, clinical practice recommendations were formulated on the basis of the evidence for each diagnostic method and were assigned a grade based on the strength of the evidence for different patient presentations and clinical utility.

RECOMMENDATIONS

In an effort to make these clinically applicable, recommendations were based on the characteristics as to the location and stage of a patient's upper-quadrant lymphedema.

Reliability and validity of clinical tests to assess the anatomical integrity of the cervical spine in adults with neck pain and its associated disorders: Part 1-A systematic review from the Cervical Assessment and Diagnosis Research Evaluation (CADRE) Collaboration

OBJECTIVE

To determine the reliability and validity of clinical tests to assess the anatomical integrity of the cervical spine in adults with neck pain and its associated disorders.

METHODS

We updated the systematic review of the 2000-2010 Bone and Joint Decade Task Force on Neck Pain and its Associated Disorders. We also searched the literature to identify studies on the reliability and validity of Doppler velocimetry for the evaluation of cervical arteries. Two independent reviewers screened and critically appraised studies. We conducted a best evidence synthesis of low risk of bias studies and ranked the phases of investigations using the classification proposed by Sackett and Haynes.

RESULTS

We screened 9022 articles and critically appraised 8 studies; all 8 studies had low risk of bias (three reliability and five validity Phase II-III studies). Preliminary evidence suggests that the extension-rotation test may be reliable and has adequate validity to rule out pain arising from facet joints. The evidence suggests variable reliability and preliminary validity for the evaluation of cervical radiculopathy including neurological examination (manual motor testing, dermatomal sensory testing, deep tendon reflexes, and pathological reflex testing), Spurling's and the upper limb neurodynamic tests. No evidence was found for doppler velocimetry.

CONCLUSIONS

Little evidence exists to support the use of clinical tests to evaluate the anatomical integrity of the cervical spine in adults with neck pain and its associated disorders. We found preliminary evidence to support the use of the extension-rotation test, neurological examination, Spurling's and the upper limb neurodynamic tests.

The number of stimuli required to reliably assess corticomotor excitability and primary motor cortical representations using transcranial magnetic stimulation (TMS): a systematic review and meta-analysis

BACKGROUND

Transcranial magnetic stimulation (TMS) is a non-invasive means by which to assess the structure and function of the central nervous system. Current practices involve the administration of multiple stimuli over target areas of a participant's scalp. Decreasing the number of stimuli delivered during TMS assessments would improve time efficiency and decrease participant demand. However, doing so may also compromise the within- or between-session reliability of the technique. The aim of this review was therefore to determine the minimum number of TMS stimuli required to reliably measure (i) corticomotor excitability of a target muscle at a single cranial site and (ii) topography of the primary motor cortical representation of a target muscle across multiple cranial sites.

METHODS

Database searches were performed to identify diagnostic reliability studies published before May 2015. Two independent reviewers extracted data from studies employing single-pulse TMS to measure (i) the corticomotor excitability at a single cranial site or (ii) the topographic cortical organisation of a target muscle across a number of cranial sites. Outcome measures included motor evoked potential amplitude, map volume, number of active map sites and location of the map centre of gravity.

RESULTS

Only studies comparing the reliability of varying numbers of stimuli delivered to a single cranial site were identified. Five was the lowest number of stimuli that could be delivered to produce excellent within-session motor evoked potential (MEP) amplitude reliability (intraclass correlation coefficient (ICC) = 0.92, 95% CI 0.87 to 0.95). Ten stimuli were required to achieve consistent between-session MEP amplitudes among healthy participants (ICC = 0.89, 95% CI 0.76 to 0.95). However, between-session reliability was influenced by participant characteristics, intersession intervals and target musculature.

CONCLUSIONS

Further exploration of the reliability of multi-site TMS mapping is required. Five stimuli produce reliable MEP recordings during single-site TMS investigations involving one session. For single-site analyses involving multiple sessions, ten stimuli are recommended when investigating corticomotor excitability in healthy participants or the upper limb musculature. However, greater numbers of stimuli may be required for clinical populations or assessments involving the lower limb.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42015024579.

Serum tumor-associated autoantibodies as diagnostic biomarkers for lung cancer: A systematic review and meta-analysis

OBJECTIVE

We performed a comprehensive review and meta-analysis to evaluate the diagnostic values of serum single and multiplex tumor-associated autoantibodies (TAAbs) in patients with lung cancer (LC).

METHODS

We searched the MEDLINE and EMBASE databases for relevant studies investigating serum TAAbs for the diagnosis of LC. The primary outcomes included sensitivity, specificity and accuracy of the test.

RESULTS

The systematic review and meta-analysis included 31 articles with single autoantibody and 39 with multiplex autoantibodies. Enzyme-linked immunosorbent assay (ELISA) was the most common detection method. For the diagnosis of patients with all stages and early-stage LC, different single or combinations of TAAbs demonstrated different diagnostic values. Although individual TAAbs showed low diagnostic sensitivity, the combination of multiplex autoantibodies offered relatively high sensitivity. For the meta-analysis of a same panel of autoantibodies in patients at all stages of LC, the pooled results of the panel of 6 TAAbs (p53, NY-ESO-1, CAGE, GBU4-5, Annexin 1 and SOX2) were: sensitivity 38% (95% CI 0.35-0.40), specificity 89% (95% CI 0.86-0.91), diagnostic accuracy 65.9% (range 62.5-81.8%), AUC 0.52 (0.48-0.57), while the summary estimates of 7 TAAbs (p53, CAGE, NY-ESO-1, GBU4-5, SOX2, MAGE A4 and Hu-D) were: sensitivity 47% (95% CI 0.34-0.60), specificity 90% (95% CI 0.89-0.92), diagnostic accuracy 78.4% (range 67.5-88.8%), AUC 0.90 (0.87-0.93). For the meta-analysis of the same panel of autoantibodies in patients at early-stage of LC, the sensitivities of both panels of 7 TAAbs and 6 TAAbs were 40% and 29.7%, while their specificities were 91% and 87%, respectively.

CONCLUSIONS

Serum single or combinations of multiplex autoantibodies can be used as a tool for the diagnosis of LC patients at all stages or early-stage, but the combination of multiplex autoantibodies shows a higher detection capacity; the diagnostic value of the panel of 7 TAAbs is higher than the panel of 6 TAAbs, which may be used as potential biomarkers for the early detection of LC.

Substitution of doctors with physiotherapists in the management of common musculoskeletal disorders: a systematic review

BACKGROUND

There is large variation in models-of-care involving the professional substitution of doctors with physiotherapists.

OBJECTIVE

To establish the impact upon patients and health services, of substituting doctors with physiotherapists in the management of common musculoskeletal disorders.

DATA SOURCES

Medline, CINAHL and ABI Complete databases, and hand-searching of related studies.

STUDY SELECTION

Randomised and non-randomised clinical trials, inter-rater reliability and comparative studies comparing the outcomes of usual care from doctors, with outcomes when the doctor was substituted with a physiotherapist.

STUDY APPRAISAL AND SYNTHESIS METHODS

Two reviewers evaluated all studies using the Downs and Black Instrument. Meta-analysis was not possible due to study heterogeneity. A descriptive review was undertaken.

RESULTS

14 studies of moderate to low quality met the inclusion criteria. Professional substitution with a physiotherapist causes no significant change to health outcomes and inconsistent variation in the use of healthcare resources. There is insufficient health economic data to determine overall efficiency. In the selected presentations studied, physiotherapists made similar diagnostic and management decisions to orthopaedic surgeons and patients are as, or more satisfied with a physiotherapist.

LIMITATIONS

Further high quality health and economic research is needed, in less selective patient populations, to determine the optimal role for physiotherapists.

CONCLUSION AND IMPLICATIONS OF KEY FINDINGS

Physiotherapists provide a professional alternative to doctors for musculoskeletal disorders but the health economic implications of this model are presently unclear. Systematic Review Registration Number PROSPERO (Registration number CRD42015027671).

Reliability of physical examination tests for the diagnosis of knee disorders: Evidence from a systematic review

Clinicians often rely on physical examination tests to guide them in the diagnostic process of knee disorders. However, reliability of these tests is often overlooked and may influence the consistency of results and overall diagnostic validity. Therefore, the objective of this study was to systematically review evidence on the reliability of physical examination tests for the diagnosis of knee disorders. A structured literature search was conducted in databases up to January 2016. Included studies needed to report reliability measures of at least one physical test for any knee disorder. Methodological quality was evaluated using the QAREL checklist. A qualitative synthesis of the evidence was performed. Thirty-three studies were included with a mean QAREL score of 5.5 ± 0.5. Based on low to moderate quality evidence, the Thessaly test for meniscal injuries reached moderate inter-rater reliability (k = 0.54). Based on moderate to excellent quality evidence, the Lachman for anterior cruciate ligament injuries reached moderate to excellent inter-rater reliability (k = 0.42 to 0.81). Based on low to moderate quality evidence, the Tibiofemoral Crepitus, Joint Line and Patellofemoral Pain/Tenderness, Bony Enlargement and Joint Pain on Movement tests for knee osteoarthritis reached fair to excellent inter-rater reliability (k = 0.29 to 0.93). Based on low to moderate quality evidence, the Lateral Glide, Lateral Tilt, Lateral Pull and Quality of Movement tests for patellofemoral pain reached moderate to good inter-rater reliability (k = 0.49 to 0.73). Many physical tests appear to reach good inter-rater reliability, but this is based on low-quality and conflicting evidence. High-quality research is required to evaluate the reliability of knee physical examination tests.

Validity and reliability of Internet-based physiotherapy assessment for musculoskeletal disorders: a systematic review

Purpose The purpose of this review is to systematically explore and summarise the validity and reliability of telerehabilitation (TR)-based physiotherapy assessment for musculoskeletal disorders. Method A comprehensive systematic literature review was conducted using a number of electronic databases: PubMed, EMBASE, PsycINFO, Cochrane Library and CINAHL, published between January 2000 and May 2015. The studies examined the validity, inter- and intra-rater reliabilities of TR-based physiotherapy assessment for musculoskeletal conditions were included. Two independent reviewers used the Quality Appraisal Tool for studies of diagnostic Reliability (QAREL) and the Quality Assessment of Diagnostic Accuracy Studies (QUADAS) tool to assess the methodological quality of reliability and validity studies respectively. Results A total of 898 hits were achieved, of which 11 articles based on inclusion criteria were reviewed. Nine studies explored the concurrent validity, inter- and intra-rater reliabilities, while two studies examined only the concurrent validity. Reviewed studies were moderate to good in methodological quality. The physiotherapy assessments such as pain, swelling, range of motion, muscle strength, balance, gait and functional assessment demonstrated good concurrent validity. However, the reported concurrent validity of lumbar spine posture, special orthopaedic tests, neurodynamic tests and scar assessments ranged from low to moderate. Conclusion TR-based physiotherapy assessment was technically feasible with overall good concurrent validity and excellent reliability, except for lumbar spine posture, orthopaedic special tests, neurodynamic testa and scar assessment.