COSMIN Risk of Bias tool to assess the quality of studies on reliability or measurement error of outcome measurement instruments: a Delphi study

Guidelines for the development and validation of patient-reported outcome measures: a scoping review

OBJECTIVE

The objectives of this scoping review were to provide an overview of existing guidelines for the development and validation of patient-reported outcome measures (PROMs), review them for comprehensiveness and clarity and provide recommendations for their use based on the goals of the instrument developers.

DESIGN

Scoping review.

METHODS

A literature search was performed in PubMed, Scopus, PsycInfo and Google Scholar up to 2 June 2023 to identify guidelines for the development and validation of PROMs. Screening of records and reports as well as data extraction were performed by two reviewers. To assess the comprehensiveness of the included guidelines, a mapping synthesis was performed and steps to develop and validate a measurement instrument outlined in the included guidelines were mapped to an a priori framework including 20 steps, which was based on the guideline by de Vet et al.

RESULTS

A total of 40 guidelines were included. Statistical advice (at least partially) was provided in 98% of the guidelines (39/40) and 88% (35/40) of the guidelines included examples for steps required to develop and validate PROMs. However, 78% (31/40) of the guidelines were not comprehensive and two essential steps in PROM development ('consideration and elaboration of the measurement model' and 'responsiveness') were not included in 80% and 72% of the guidelines, respectively. Three guidelines included all 20 steps and six included almost all steps (≥90% of steps) for developing and validating a PROM.

DISCUSSION

Most guidelines on PROM development and validation do not appear to be comprehensive, and some crucial steps are missing in most guidelines. Nevertheless, for some purposes of PROMs, many guidelines provide helpful advice and support.

CONCLUSION

At least 15 guidelines may be recommended, including three comprehensive guidelines that can be recommended for the development and validation of PROMs for most purposes (eg, to discriminate between subjects with a particular condition and subjects without that condition, to evaluate the effects of treatments (between a pre and post time-points) or to evaluate a status quo).

Validation of the Hungarian version of the General Oral Health Assessment Index (GOHAI) in clinical and general populations

BACKGROUND

COSMIN (Consensus-based Standards for the selection of health Measurement INstruments) provides a framework for selecting and validating patient-reported outcome measurements (PROMs). This study aims to validate the Hungarian version of the GOHAI and, for the first time, to assess its Standard Error of Measurement (SEM), Smallest Detectable Change (SDC), and Measurement Invariance (MI) across general and clinical populations as well as different age groups, following COSMIN guidelines.

MATERIALS AND METHODS

The translation was performed using a forward-backward process. A mixed sample (n = 306) was recruited in Budapest from May 2023 to February 2024, consisting of the general population (45.1%), recruited from health kiosks and a nursing home, and the clinical population (54.9%), sourced from Semmelweis University's care units. The sample was further divided into two age groups: 18-64 years old (54.9%) and 65 + years old (45.1%). GOHAI was administered twice to 108 stable participants. For both the additive score (ADD-GOHAI) and simple count (SC-GOHAI), structural validity and measurement invariance by subgroups were assessed via Confirmatory Factor Analysis (CFA). Internal consistency was evaluated using Cronbach's alpha, and test-retest reliability was measured using the intraclass correlation coefficient (ICC). SEM was calculated using the SEM agreement formula, and SDC using: [Formula: see text]. Convergent and known-group validity were tested against predefined hypotheses for structural validity.

RESULTS

Contrary to a three factor model, a single-factor model showed good fit in all subgroups for both scoring methods, with adequate internal consistency (Cronbach 𝛼: 0.76-0.85). Four of the six hypotheses for convergent validity and all ten hypotheses for known-groups validity supported the predefined criteria. Measurement invariance between clinical and general populations, or by age, was not demonstrated, so GOHAI's different measurement properties should be considered when comparing subpopulations. Test-retest reliability was adequate (ICC: 0.87-0.96). SDC was ≈5 points using ADD-GOHAI and 2-3 points using SC-GOHAI.

CONCLUSION

The Hungarian version of GOHAI demonstrates satisfactory psychometric properties across both general and clinical populations, as well as among both younger and older age groups. While the measurement properties of SC-GOHAI may be more stable between populations, ADD-GOHAI seems more suitable for individual follow-up. However, observed changes must be considered in relation to the measurement error associated with GOHAI.

Reliability of inter-recti distance measurement on ultrasound images captured by novice examiners

BACKGROUND

With the increased interest in inter-recti distance measurement using ultrasound imaging in physiotherapy, there is a question of measurement reliability, and the importance of the examiner's experience.

PURPOSE

The study aimed to investigate the reliability of inter-recti distance measurement in a DICOM viewer software by an experienced radiologist. For the measurement, the radiologist used linea alba images captured by two physiotherapists who were novice examiners.

METHODS

Ultrasound images were acquired by two novice examiners on repeated occasions 7 days apart (sessions A and B) in 28 nulliparous women at supraumbilical, umbilical, and infraumbilical locations along linea alba.

RESULTS

Excellent intra-examiner reliability of inter-recti distance measurements was shown at the supraumbilical and umbilical levels (ICC2,k = 0.941-0.983) with minimal detectable change (MDC95) ranging from 1.31 mm to 2.29 mm. Infraumbilical measurements had good to excellent reliability (ICC2,k = 0.894-0.972) with MDC95 ranging from 0.33 mm to 0.72 mm. Session A inter-examiner reliability was excellent for the mean measurements of two, three, four, and five images taken at each location (ICC2,k = 0.913-0.954) with MDC95 ranging from 0.47 mm to 2.96 mm. Session B inter-examiner reliability was excellent for the mean measurements of two, three, four, and five images taken at the supraumbilical and umbilical (ICC2,k = 0.94-0.98), MDC95 ranging from 1.38 mm to 2.58 mm and good (ICC2,k ≥ 0.81) with MDC95 ranging from 0.72 mm to 0.80 mm at the infraumbilical locations.

CONCLUSION

Novice examiners were able to capture good-quality ultrasound images of the linea alba that allowed for good to excellent intra- and inter-examiner reliability.

Within-subject variation of C-reactive protein and high-sensitivity C-reactive protein: A systematic review and meta-analysis

BACKGROUND

C-reactive protein (CRP) and high-sensitivity C-reactive protein (hsCRP) are measures of inflammation used in diagnosis, to guide treatment decisions, and in disease prediction. Variability in measured CRP and hsCRP may affect their clinical utility but estimates of within-subject variability are based on limited data.

METHODS

A systematic review and meta-analysis was performed to estimate longitudinal within-subject variability of CRP and hsCRP over any time period. Follow-up studies of any design in adults or children, with repeated measures of CRP or hsCRP were sought. Multiple databases were searched from inception to November 2022. Titles and abstracts were screened in duplicate. Full text screening and data extraction were performed by one reviewer and verified by a second. Risk of bias was assessed with a modified Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) tool. Intraclass correlation coefficient (ICC) results were pooled with a meta-analysis and coefficient of variation (CV) results were described by median and range.

RESULTS

Of 2675 studies identified, 60 met the inclusion criteria: 34 reported CRP and 26 reported hsCRP. For CRP, median CV was 0.41 (range 0.11 to 0.89), and the pooled estimate of ICC was 0.55 (95% CI 0.35 to 0.74). For hsCRP, median CV was 0.44 (range 0.27 to 0.76) and the pooled estimate of ICC was 0.62 (95% CI 0.58 to 0.67).

LIMITATIONS

Assessment of variability was not the main aim of many of the included papers, and it is possible that some relevant papers have been missed. Many of the papers included had low numbers of participants and/or low numbers of repeated measurements.

CONCLUSIONS

Estimated within-subject variability is high for both CRP and hsCRP, but estimates are based on small numbers of participants and measurements. There is a need for better estimates of within-subject variability from analysis of larger numbers of repeated measurements in larger numbers of subjects.

COSMIN guideline for systematic reviews of patient-reported outcome measures version 2.0

PURPOSE

Systematic reviews of patient-reported outcome measures (PROMs) are important tools to select the most suitable PROM for a study or clinical application. Conducting these reviews is challenging, and the quality of these reviews needs to be improved. We updated the COSMIN guideline for systematic reviews of PROMs, including the COSMIN Risk of Bias checklist, and the COSMIN criteria for good measurement properties.

METHODS

Adaptations to the methodology were based on our experience with applying the COSMIN guideline, through discussions among the authors, and results from two related Delphi studies.

RESULTS

The updated guideline places more emphasis on key aspects that are often missing or sub optimally conducted in published systematic reviews of PROMs, such as formulating a well-defined research question and developing a comprehensive search strategy, assessing risk of bias, applying criteria for good measurement properties, summarizing results, and grading the quality of the evidence. We also stress the importance of evaluating the measurement properties of each subscale of a PROM separately and evaluating content validity of all included PROMs.

CONCLUSION

The quality of systematic reviews of PROMs can be improved by using this updated version of the COSMIN guideline for systematic reviews of PROMs. Improved quality will lead to better PROM selection and increased standardization of PROM use.

Clinimetric Properties of the Steep Ramp Test to Assess Cardiorespiratory Fitness, Its Underlying Physiological Responses, and Its Current Applications: A Scoping Review

OBJECTIVE

Providing an overview of the clinimetric properties of the steep ramp test (SRT)-a short-term maximal exercise test-to assess cardiorespiratory fitness (CRF), describing its underlying physiological responses, and summarizing its applications in current clinical and research practice.

DATA SOURCES

MEDLINE (through PubMed), CINAHL Complete, Cochrane Library, EMBASE, and PsycINFO were searched for studies published up to July 2023, using keywords for SRT and CRF.

STUDY SELECTION

Eligible studies involved the SRT as research subject or measurement instrument and were available as full text articles in English or Dutch.

DATA EXTRACTION

Two independent assessors performed data extraction. Data addressing clinimetric properties, physiological responses, and applications of the SRT were tabulated.

DATA SYNTHESIS

In total, 370 studies were found, of which 39 were included in this study. In several healthy and patient populations, correlation coefficients between the work rate at peak exercise (WRpeak) attained at the SRT and oxygen uptake at peak exercise during cardiopulmonary exercise testing (CPET) ranged from .771-.958 (criterion validity). Repeated measurements showed intraclass correlation coefficients ranging from .908-.996 for WRpeak attained with the first and second SRT (test-retest reliability). Physiological parameters, like heart rate and minute ventilation at peak exercise, indicated that the SRT puts a lower burden on the cardiopulmonary system compared to CPET. The SRT is mostly used to assess CRF, among others as part of preoperative risk assessment, and to personalize interval training intensity.

CONCLUSIONS

The SRT is a practical short-term maximal exercise test that is valid for CRF assessment and to monitor changes in CRF over time in various healthy and patient populations. Its clinimetric properties and potential applications make the SRT of interest for a widespread implementation of CRF assessment in clinical and research practice and for personalizing training intensity and monitoring longitudinal changes in CRF.

Diagnostic and treatment recommendations for recurrent or persistent symptoms after trapeziectomy: a Delphi study

The aim of this Delphi study was to provide a diagnostic and treatment algorithm for patients with persistent or recurrent symptoms after trapeziometacarpal joint resection arthroplasty. Three Delphi rounds were conducted in which surveys were sent to 182 experienced hand surgeons worldwide. Responses were received from 140 participants. A consensus threshold was set at 67% agreement. Diagnostic tools and treatment approaches for six common revision scenarios achieved consensus. Radiographs are appropriate as primary (97%) and CT scans as secondary (76%) diagnostic tools. For scaphometacarpal impingement, 67% of respondents agreed that revision interposition is appropriate, with 93% recommending autologous tendon for the interposition. Additional suspension was considered appropriate by 68% of the participants. The diagnostic and treatment algorithm can help the surgeon to identify the reason for persistent symptoms after trapeziometacarpal joint resection arthroplasty and to choose an appropriate treatment strategy.Level of evidence: V.

Psychometric validation of a patient-reported experience measure for older adults attending the emergency department: the PREM-ED 65 study

INTRODUCTION

Optimising emergency department (ED) patient experience is vital to ensure care quality. However, there are few validated instruments to measure the experiences of specific patient groups, including older adults. We previously developed a draft 82-item Patient Reported Experience Measure (PREM-ED 65) for adults ≥65 attending the ED. This study aimed to derive a final item list and provide initial validation of the PREM-ED 65 survey.

METHODS

A cross-sectional study involving patients in 18 EDs in England. Adults aged 65 years or over, deemed eligible for ED discharge, were recruited between May and August 2021 and asked to complete the 82-item PREM at the end of the ED visit and 7-10 days post discharge. Test-retest reliability was assessed 7-10 days following initial attendance. Analysis included descriptive statistics, including per-item proportions of responses, hierarchical item reduction, exploratory factor analysis (EFA), reliability testing and assessment of criterion validity.

RESULTS

Five hundred and ten initial surveys and 52 retest surveys were completed. The median respondent age was 76. A similar gender mix (men 47.5% vs women 50.7%) and reason for attendance (40.3% injury vs 49.0% illness) was observed. Most participants self-reported their ethnicity as white (88.6%).Hierarchical item reduction identified 53/82 (64.6%) items for exclusion, due to inadequate engagement (n=33), ceiling effects (n=5), excessive inter-item correlation (n=12) or significant differential validity (n=3). Twenty-nine items were retained.EFA revealed 25 out of the 29 items demonstrating high factor loadings (>0.4) across four scales with an Eigenvalue >1. These scales were interpreted as measuring 'relational care', 'the ED environment', 'staying informed' and 'pain assessment'. Cronbach alpha for the scales ranged from 0.786 to 0.944, indicating good internal consistency. Test-retest reliability was adequate (intraclass correlation coefficient 0.67). Criterion validity was fair (r=0.397) when measured against the Friends and Families Test question.

CONCLUSIONS

Psychometric testing demonstrates that the 25-item PREM-ED 65 is suitable for administration to adults ≥65 years old up to 10 days following ED discharge.

Test-retest and inter-rater reliability and construct validity of the 2-minute step test in individuals with Parkinson's disease

OBJECTIVE

To evaluate the test-retest and inter-rater reliability and construct validity of the 2-min step test (2MST) in individuals with Parkinson's disease (PD).

METHODS

Two previously trained examiners applied the 2MST in two moments. Clinical measurements of PD were obtained using the following instruments: Berg Balance Scale (BBS), Unified Parkinson's Disease Rating Scale (UPDRS), modified Hoehn and Yahr Scale (H&Y), gait speed and cadence, 5-time Sit-to-Stand Test (5TSST) and Timed Up and Go (TUG). For reliability, the intraclass correlation coefficient (ICC), standard error of measurement (SEM) and minimal detectable change (MDC) were calculated. For construct validity, Pearson's and Spearman's correlation coefficient were used. The agreement between the measurement in person and via recorded video was assessed by means of Bland-Altman plots.

RESULTS

The 2MST showed adequate test-retest reliability (ICC = 0.80, SEM = 10.59, MDC = 29.35) and excellent inter-rater reliability (ICC = 0.93, SEM = 4.49, MDC = 12.46). There was acceptable agreement between assessments made with in person and via video. A correlation magnitude above 0.50 was found between 2MST and gait speed, and a correlation magnitude between 0.30 and 0.50 with BBS, gait cadence, UPDRS and TUG.

CONCLUSION

The 2MST presents adequate test-retest and inter-rater reliability and a valid construct to evaluate the aerobic endurance of individuals with PD.

Psychometric properties of the modified reaching performance scale in persons with multiple sclerosis

BACKGROUND

A valid and reliable assessment tool to describe the quality of the movement pattern of reaching can provide valuable insights into motor performance deficits in persons with MS (pwMS). The Reaching Performance Scale, developed for stroke, is a promising scale to assess movement patterns in pwMS. However, psychometric properties of the scale are lacking in pwMS.

OBJECTIVES

Firstly, to investigate the content validity of the modified Reaching Performance Scale for application in patients with MS (mRPS). Secondly, to investigate the psychometric properties (within- and between-session reliability and concurrent validity) of the mRPS for pwMS.

METHODS

Forty-five pwMS (mean EDSS 6.6 pt, IQR 6-7.5) executed the mRPS that rates the quality of movement patterns and compensations during reach to grasp tasks. The content validity was determined by an expert panel based on observations of subjects performing the RPS. The reliability was based on five repetitions within one day, and between two days. For the concurrent validity, outcome measures at two levels of the International Classification of Functioning were correlated with the mRPS: Body Structure and Function level: Fugl-Meyer Assessment of the Upper Limb (FMA-UL), maximal isometric hand grip strength (HGS; Activity level: Action Research Arm Test (ARAT), Box and Blocks Test (BBT), Nine Hole Peg Test (NHPT) and Trunk Impairment Scale 2.0 (TIS 2.0) as well as perceived performance by the Manual Ability Measure-36 (MAM-36).

RESULTS

Scale modifications were made only on the ratings of the trunk displacement subscale. The mRPS had excellent agreement scores for within-session reliability (range of Kappa between 0.85 and 0.98) and moderate-to-excellent agreement scores for between-session reliability (K: 0.66-1.00). Regarding validity, the mRPS was highly correlated with the ARAT (rho=0.74, p < 0.001), followed by moderate correlations with trunk performance (TIS 2.0, rho= 0.61, p < 0.001), hand function (BBT: rho=0.64, p < 0.001; NHPT: rho=-0.61, p < 0.001) and perceived performance (MAM36 rho= 0.53, p < 0.001).

CONCLUSION

The mRPS is a reliable measurement tool to describe the movement pattern quality and motor compensations used during reaching in pwMS. Concerning concurrent validity, the mRPS is partially related to other measures of upper limb and trunk performance.

Methodological quality of 100 recent systematic reviews of health-related outcome measurement instruments: an overview of reviews

PURPOSE

Systematic reviews evaluating and comparing the measurement properties of outcome measurement instruments (OMIs) play an important role in OMI selection. Earlier overviews of review quality (2007, 2014) evidenced substantial concerns with regards to alignment to scientific standards. This overview aimed to investigate whether the quality of recent systematic reviews of OMIs lives up to the current scientific standards.

METHODS

One hundred systematic reviews of OMIs published from June 1, 2021 onwards were randomly selected through a systematic literature search performed on March 17, 2022 in MEDLINE and EMBASE. The quality of systematic reviews was appraised by two independent reviewers. An updated data extraction form was informed by the earlier studies, and results were compared to these earlier studies' findings.

RESULTS

A quarter of the reviews had an unclear research question or aim, and in 22% of the reviews the search strategy did not match the aim. Half of the reviews had an incomprehensive search strategy, because relevant search terms were not included. In 63% of the reviews (compared to 41% in 2014 and 30% in 2007) a risk of bias assessment was conducted. In 73% of the reviews (some) measurement properties were evaluated (58% in 2014 and 55% in 2007). In 60% of the reviews the data were (partly) synthesized (42% in 2014 and 7% in 2007); evaluation of measurement properties and data syntheses was not conducted separately for subscales in the majority. Certainty assessments of the quality of the total body of evidence were conducted in only 33% of reviews (not assessed in 2014 and 2007). The majority (58%) did not make any recommendations on which OMI (not) to use.

CONCLUSION

Despite clear improvements in risk of bias assessments, measurement property evaluation and data synthesis, specifying the research question, conducting the search strategy and performing a certainty assessment remain poor. To ensure that systematic reviews of OMIs meet current scientific standards, more consistent conduct and reporting of systematic reviews of OMIs is needed.

PROs for RARE: protocol for development of a core patient reported outcome set for individuals with genetic intellectual disability

INTRODUCTION

Rare genetic neurodevelopmental disorders and intellectual disability (ID), collectively called genetic ID (GID), can profoundly impact daily functioning and overall well-being of affected individuals. To improve our understanding of the impact of GID and advancing both care and research, measuring relevant patient reported outcomes (PROs) is crucial. Currently, various PROs are measured for GID. Given the shared comorbidities across disorders, we aim to develop a generic core PRO set for children and adults with GID.

METHODS AND RESULTS

Developing the generic core PRO set entails the following steps: 1) providing an overview of potentially relevant PROs by scoping reviews and qualitative research; 2) integrating and conceptualizing these PROs (i.e., describing the content of the PROs in detail) into a pilot generic core PRO set; and 3) prioritizing relevant PROs by a European Delphi survey and consensus meetings.

CONCLUSIONS

This protocol presents the steps for developing a generic core PRO set for children and adults with GID. The next step involves selecting suitable patient reported outcome measures (PROMs) to adequately measure these PROs: the generic core PROM set. This generic core PROM set needs validation in the GID population, and eventually implementation in care and research, facilitating the aggregation and analysis of PRO data and guaranteeing continuous integration of the patient perspective in both care and research.

The psychometric properties of the Quality of Life in Neurological Disorders (Neuro-QoL) measurement system in neurorehabilitation populations: a systematic review

OBJECTIVE

To systematically review the literature of existing evidence on the measurement properties of the Quality of Life in Neurological Disorders (Neuro-QoL) measurement system among neurorehabilitation populations.

DATA SOURCES

The Consensus-based Standards for the selection of health Measurement Instruments (COSMIN) guided this systematic review in which we searched nine electronic databases and registries, and hand-searched reference lists of included articles.

STUDY SELECTION

Two independent reviewers screened selected articles and extracted data from 28 included studies.

DATA EXTRACTION

COSMIN's approach guided extraction and synthesizing measurement properties evidence (insufficient, sufficient), and the modified GRADE approach guided synthesizing evidence quality (very-low, low, moderate, high) by diagnosis.

DATA SYNTHESIS

Neuro-QoL has sufficient measurement properties when used by individuals with Huntington's disease, Multiple Sclerosis, Parkinson's disease, stroke, lupus, cognitive decline, and amyotrophic lateral sclerosis. The strongest evidence is for the first four conditions, where test-retest reliability, construct validity, and responsiveness are nearly always sufficient (GRADE: moderate-high). Structural validity is assessed only in multiple sclerosis and stroke but is often insufficient (GRADE: moderate-high). Criterion validity is sufficient in some stroke and Huntington's disease domains (GRADE: high). Item response theory analyses were reported for some stroke domains only. There is limited, mixed evidence for responsiveness and measurement error (GRADE: moderate-high), and no cross-cultural validity evidence CONCLUSIONS: Neuro-QoL domains can describe and evaluate patients with Huntington's disease, multiple sclerosis, Parkinson's disease, and stroke, but predictive validity evidence would be beneficial. In the other conditions captured in this review, a limited number of Neuro-QoL domains have evidence for descriptive use only. For these conditions, further evidence of structural validity, measurement error, cross-cultural validity and predictive validity would enhance the use and interpretation of Neuro-QoL.

Cross-Cultural Adaptation and Validation of the Listening Inventory for Education-Revised in Italian

BACKGROUND

Listening difficulties may frequently occur in school settings, but so far there were no tools to identify them for both hearing and hearing-impaired Italian students. This study performed cross-cultural adaptation and validation of the Listening Inventory for Education-Revised for Italian students (LIFE-R-ITA).

METHODS

The study procedure followed the stages suggested by the Guidelines for the Process of Cross-cultural Adaptation of Self-Report Measures. For the content validation, six cochlear implanted students (8-18 years old) pre-tested the initial version. Whenever any situation did not occur in Italy, the item was adapted to more typical listening situations in Italy. The final version of LIFE-R-ITA was administered to a sample of 223 hearing students from different school settings and educational degrees in order to collect normative data.

RESULTS

For the LIFE-R-ITA, hearing students showed an average score of 72.26% (SD = 11.93), reflecting some listening difficulties. The subscales (LIFE total, LIFE class, and LIFE social) indicated good internal consistency. All items were shown to be relevant. Most challenging situations happened when listening in large rooms, especially when other students made noise. LIFE social scores were significantly worse than those of LIFE class (p < 0.001).

CONCLUSIONS

The present study provides cross-cultural adaptation and validation for the LIFE-R-ITA along with the normative data useful to interpret the results of students with hearing loss. The LIFE-R-ITA may support teachers and clinicians in assessing students' self-perception of listening at school. Such understanding may help students overcome their listening difficulties, by planning and selecting the most effective strategies among classroom interventions.

Instruments for Assessing Family Functioning in Adults Patients with Cancer: A Systematic Review of Measurement Properties

OBJECTIVES

To identify instruments for assessing family functioning in adults patients with cancer and summarize their psychometric properties.

METHODS

Psychometric systematic literature review was conducted to June 2023 using four databases: PubMed, CINAHL, Psych INFO, and Web of Science. The psychometric properties of the instruments and the methodological quality of the studies were evaluated using the Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) checklist. The Grading of Recommendations, Assessment, Development and Evaluation (GRADE) was used to rate the best available evidence.

RESULTS

Forty-four studies reporting 13 instruments were included. The instruments measured varied attributes of family functioning and the dimensions were heterogeneous. The Cancer Communication Assessment Tool for Patients and Families (CCAT-PF) was rated the highest in terms of both methodological rigor and instrument quality. However, the Family Adaptability and Cohesion Evaluation Scale (FACES) and the Ice-Expressive Family Functioning Questionnaire (ICE-EFFQ) offer a more comprehensive measure of family functioning, since they assess multiple dimensions of family functioning and demonstrate high-quality measurement properties.

CONCLUSIONS

Instruments to assess family functioning were heterogeneous and exhibited limited reliability and validity. The FACES and the ICE-EFFQ seem to be the most suitable measures for adult cancer patients and their families. Future research should aim to refine the content of existing instruments and rigorously assess their psychometric properties.

IMPLICATIONS FOR NURSING PRACTICE

Given the profound impact of cancer on family functioning, the initial step in crafting effective interventions is providing valid and reliable instruments to measure the impact of these interventions. This paper could assist nursing professionals in making informed decisions regarding the most suitable instrument for assessing family functioning in adults patients living with life-threatening illness as is the case with cancer.

European Portuguese version of the Mini-BESTest: a cross-cultural adaptation and psychometric measurements in individuals with sensorimotor impairments

PURPOSE

This study aimed to translate and cross-culturally adapt the Mini-BESTest into European Portuguese and to evaluate its psychometric properties in individuals with sensorimotor impairments.

MATERIAL AND METHODS

A cross-sectional cross-cultural adaptation and validation study was conducted according to the COSMIN guidelines and the STROBE statement. The study included 100 participants with sensorimotor impairments who were able to walk 6 m. Cronbach's alpha and item-total correlations were used to assess internal consistency. Interpretability was assessed by examining floor and ceiling effects and skewness. To investigate construct validity, Spearman correlation coefficients and Bland-Altman analysis were performed to compare the Berg Balance Scale and the Mini-BESTest Inter- and intra-rater reliability were assessed by calculating the ICC, SEM and MDC based on video recordings of the participants during the Mini-BESTest assessments.

RESULTS

The European Portuguese Mini-BESTest showed good internal consistency (Cronbach's α = 0.892) and no significant floor or ceiling effects. Excellent inter- and intra-rater reliability (ICC = 0.97) were also demonstrated, with MDC of 2.58 and 2.57, respectively. Furthermore, this instrument showed a significant correlation with the BBS (r = 0.902). Bland-Altman analysis showed small absolute differences.

CONCLUSION

The European Portuguese Mini-BESTest is comparable to the original English version in terms of validity and reliability and is therefore highly recommended for use by Portuguese-speaking professionals to assess postural control.

A systematic review of post-stroke fatigue measurement scale based on COSMIN guidelines

Objective

This study aimed to evaluate the methodological quality and measurement attribute quality of the post-stroke fatigue measurement scale, so as to provide some basis for the clinical application and promotion of related scales.

Methods

The Chinese National Knowledge Infrastructure, the Wanfang Data Knowledge Service Platform, the China Science and Technology Journal Database, the Chinese Medical Journal Full-text Database, the Chinese Biology Medicine, PubMed, Embase, Medline, the Cochrane Library, the Web of Science, CINAHL, and PsycINFO databases were searched for literature on the post-stroke fatigue measurement scale up to June 2022. Literature screening and data extraction were carried out independently by two researchers, and in the case of disagreement, discussions were held with a third investigator to reach an agreement, and the COSMIN checklist and criteria were used to systematically evaluate the attributes of the measurement scale.

Results

A total of 17 studies were included, involving 10 post-stroke fatigue measurement scales. The content validity of FSS-7, FACIT-F, NRS-FRS, and MFI-20 was "not mentioned," and the remaining scales were "uncertain." In terms of construct validity, MFS was "adequate"; FSS-7, FACIT-F, and NRS-FRS were "not mentioned"; and the remaining scales were "uncertain." In terms of internal consistency, NRS-FRS was "not mentioned"; FSS and MFS were "adequate"; and the remaining scales were "uncertain." In terms of hypothesis testing, CIS and FACIT-F were "not mentioned," NRS-FRS was "adequate," and the remaining scales were "uncertain." The stability of FSS-7, CIS, FACIT-F, and MFI-20 was "not mentioned," and the remaining scales were "adequate." The cross-cultural validity of FSS-7 was "adequate," and the remaining scales were "not mentioned." All 10 scales were given a recommendation grade of "B".

Conclusion

For the time being, the FSS can be recommended to measure post-stroke fatigue, but it still needs to be tested for more relevant measurement properties in order to gain more support from high-quality evidence. For a more comprehensive assessment of post-stroke fatigue, the FIS, FAS, and NFI-stroke should perhaps be considered, as the FSS is a one-dimensional scale that can only measure physical fatigue in patients; however, these scales also need to be tested for more relevant measurement properties to verify their clinical applicability.

Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024

BACKGROUND AND OBJECTIVE

Although comprehensive and widespread guidelines on how to conduct systematic reviews of outcome measurement instruments (OMIs) exist, for example from the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) initiative, key information is often missing in published reports. This article describes the development of an extension of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline: PRISMA-COSMIN for OMIs 2024.

METHODS

The development process followed the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) guidelines and included a literature search, expert consultations, a Delphi study, a hybrid workgroup meeting, pilot testing, and an end-of-project meeting, with integrated patient/public involvement.

RESULTS

From the literature and expert consultation, 49 potentially relevant reporting items were identified. Round 1 of the Delphi study was completed by 103 panelists, whereas round 2 and 3 were completed by 78 panelists. After 3 rounds, agreement (≥67%) on inclusion and wording was reached for 44 items. Eleven items without consensus for inclusion and/or wording were discussed at a workgroup meeting attended by 24 participants. Agreement was reached for the inclusion and wording of 10 items, and the deletion of 1 item. Pilot testing with 65 authors of OMI systematic reviews further improved the guideline through minor changes in wording and structure, finalized during the end-of-project meeting. The final checklist to facilitate the reporting of full systematic review reports contains 54 (sub)items addressing the review's title, abstract, plain language summary, open science, introduction, methods, results, and discussion. Thirteen items pertaining to the title and abstract are also included in a separate abstract checklist, guiding authors in reporting for example conference abstracts.

CONCLUSION

PRISMA-COSMIN for OMIs 2024 consists of two checklists (full reports; abstracts), their corresponding explanation and elaboration documents detailing the rationale and examples for each item, and a data flow diagram. PRISMA-COSMIN for OMIs 2024 can improve the reporting of systematic reviews of OMIs, fostering their reproducibility and allowing end-users to appraise the quality of OMIs and select the most appropriate OMI for a specific application. NOTE: This paper was jointly developed by Journal of Clinical Epidemiology, Quality of Life Research, Journal of Patient Reported Outcomes, Health and Quality of Life Outcomes and jointly published by Elsevier Inc, Springer Nature Switzerland AG, and BioMed Central Ltd., part of Springer Nature. The articles are identical except for minor stylistic and spelling differences in keeping with each journal's style. Either citation can be used when citing this article.

Psychometric properties of wearable technologies to assess post-stroke gait parameters: A systematic review

BACKGROUND

Wearable technologies using inertial sensors are an alternative for gait assessment. However, their psychometric properties in evaluating post-stroke patients are still being determined. This systematic review aimed to evaluate the psychometric properties of wearable technologies used to assess post-stroke gait and analyze their reliability and measurement error. The review also investigated which wearable technologies have been used to assess angular changes in post-stroke gait.

METHODS

The present review included studies in English with no publication date restrictions that evaluated the psychometric properties (e.g., validity, reliability, responsiveness, and measurement error) of wearable technologies used to assess post-stroke gait. Searches were conducted from February to March 2023 in the following databases: Cochrane Central Registry of Controlled Trials (CENTRAL), Medline/PubMed, EMBASE Ovid, CINAHL EBSCO, PsycINFO Ovid, IEEE Xplore Digital Library (IEEE), and Physiotherapy Evidence Database (PEDro); the gray literature was also verified. The Consensus-based Standards for the Selection of Health Measurement Instruments (COSMIN) risk-of-bias tool was used to assess the quality of the studies that analyzed reliability and measurement error.

RESULTS

Forty-two studies investigating validity (37 studies), reliability (16 studies), and measurement error (6 studies) of wearable technologies were included. Devices presented good reliability in measuring gait speed and step count; however, the quality of the evidence supporting this was low. The evidence of measurement error in step counts was indeterminate. Moreover, only two studies obtained angular results using wearable technology.

SIGNIFICANCE

Wearable technologies have demonstrated reliability in analyzing gait parameters (gait speed and step count) among post-stroke patients. However, higher-quality studies should be conducted to improve the quality of evidence and to address the measurement error assessment. Also, few studies used wearable technology to analyze angular changes during post-stroke gait.

Physical functioning in the lumbar spinal surgery population: A systematic review and narrative synthesis of outcome measures and measurement properties of the physical measures

BACKGROUND

International agreement supports physical functioning as a key domain to measure interventions effectiveness for low back pain. Patient reported outcome measures (PROMs) are commonly used in the lumbar spinal surgery population but physical functioning is multidimensional and necessitates evaluation also with physical measures.

OBJECTIVE

1) To identify outcome measures (PROMs and physical) used to evaluate physical functioning in the lumbar spinal surgery population. 2) To assess measurement properties and describe the feasibility and interpretability of physical measures of physical functioning in this population.

STUDY DESIGN

Two-staged systematic review and narrative synthesis.

METHODS

This systematic review was conducted according to a registered and published protocol. Two stages of searching were conducted in MEDLINE, EMBASE, Health & Psychosocial Instruments, CINAHL, Web of Science, PEDro and ProQuest Dissertations & Theses. Stage one included studies to identify physical functioning outcome measures (PROMs and physical) in the lumbar spinal surgery population. Stage two (inception to 10 July 2023) included studies assessing measurement properties of stage one physical measures. Two independent reviewers determined study eligibility, extracted data and assessed risk of bias (RoB) according to COSMIN guidelines. Measurement properties were rated according to COSMIN criteria. Level of evidence was determined using a modified GRADE approach.

RESULTS

Stage one included 1,101 reports using PROMs (n = 70 established in literature, n = 67 developed by study authors) and physical measures (n = 134). Stage two included 43 articles assessing measurement properties of 34 physical measures. Moderate-level evidence supported sufficient responsiveness of 1-minute stair climb and 50-foot walk tests, insufficient responsiveness of 5-minute walk and sufficient reliability of distance walked during the 6-minute walk. Very low/low-level evidence limits further understanding.

CONCLUSIONS

Many physical measures of physical functioning are used in lumbar spinal surgery populations. Few have investigations of measurement properties. Strongest evidence supports responsiveness of 1-minute stair climb and 50-foot walk tests and reliability of distance walked during the 6-minute walk. Further recommendations cannot be made because of very low/low-level evidence. Results highlight promise for a range of measures, but prospective, low RoB studies are required.

Evidence on psychometric properties of self-report questionnaires in evaluating blended learning in health sciences university students: research protocol for systematic review and meta-analysis

INTRODUCTION

Due to the COVID-19 outbreak, schools had to switch online. As universities ease face-to-face (F2F) schooling, blended teaching and learning (BTL) enables the continuous delivery of education. However, the sudden transition to BTL poses challenges for students and teachers, especially for health sciences programmes that require hands-on practical experience. Several studies have evaluated F2F teaching and learning contexts through student feedback and evaluations. However, there needs to be more reliable and valid self-report questionnaires that focus on the perceptions and experiences of students experiencing BTL. This study will critically appraise, compare and summarise the quality of self-report questionnaires evaluating BTL among health science university students based on their psychometric properties.

METHODS AND ANALYSIS

A systematic review and meta-analysis design will be used. This review will adhere to the Preferred Reporting Items for Systematic Reviews and Meta-Analysis Protocols and follow the COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) standardised guidelines. 13 databases will be searched for studies reporting BTL self-report questionnaires as evaluation tools with their respective psychometric properties. Two independent reviewers will appraise the paper using the COSMIN risk of bias checklist and the quality of evidence of the psychometric properties of the relevant questionnaires will be assessed using the modified Grading of Recommendations Assessment, Development and Evaluation approach. Based on their psychometric properties, these assessments will comprehensively summarise and present the best recommendations for the most appropriate self-report questionnaires for BTL evaluation.

ETHICS AND DISSEMINATION

The University of the Philippines' Research Grants Administration Office exempted this research protocol from ethics review evaluation (protocol number UPMREB 2022-0259-EX) since this study will not collect individual data. The research protocol was registered with PROSPERO. The results will be disseminated through peer-reviewed journals and conferences to aid researchers and professionals in the field of health education to prudently choose effective self-report questionnaires evaluating blended learning.CRD42022372362.

KOJI AWARENESS, a self-rating whole-body movement assessment system, has intersession reliability and comparability to external examiner rating

KOJI AWARENESS is a newly developed self-rating whole-body movement assessment system that includes 11 domains and 22 tests. The primary aim of this study was to investigate the intersession reliability of KOJI AWARENESS, and the secondary aim was to determine whether a fixed bias existed between self-rating and external examiner rating. Fifty university students rated their movement ability in two separate sessions; an external examiner also rated the students' movement ability. Participants were blinded to their scores at the first session as well as the external examiner's rating scores. The primary analysis included examining the intersession reliability of the total score with intraclass correlation coefficients (ICCs). ICC values were interpreted as follows: insufficient, < .7 and sufficient, ≥ .7. To achieve the secondary aim, Bland-Altman analysis was performed. ICC for the intersession reliability was .86 with a 95% confidence interval (CI) of .77 to .92 and a minimum detectable change (MDC) of 5.15. Bland-Altman analysis revealed fixed bias as the 95% CIs of the mean difference between the two different rating scores (-3.49 to -2.43 and -3.94 to -2.98 in the first and second sessions, respectively) did not include 0 in the data of each session. However, no proportional bias was identified because no statistically significant Pearson's correlation (P > .05) was noted between the means of the two methods and the mean difference between the two different methods in each session. This study identified that KOJI AWARENESS has sufficient intersession reliability among relatively young and healthy participants. External examiner rating tended to have lower total scores than self-rating; however, the bias was below the MDC and seemed not to be clinically significant.

Identification of unmet palliative care needs of nursing home residents: A scoping review protocol

INTRODUCTION

Nursing home residents often have life limiting illnesses in combination with multiple comorbidities, cognitive deficits, and frailty. Due to these complex characteristics, a high proportion of nursing home residents require palliative care. However, many do not receive palliative care relative to this need resulting in unmet care needs. To the best of our knowledge, there have been no literature reviews to synthesise the evidence on how nursing home staff identify unmet palliative care needs and to determine what guidelines, policies, and frameworks on identifying unmet palliative care needs of nursing home residents are available.

AIM

The aim of this scoping review is to map and summarise the evidence on identifying unmet palliative care needs of residents in nursing homes.

METHODS

This scoping review will be guided by the JBI Manual for Evidence Synthesis. The search will be conducted in CINAHL, MEDLINE, Embase, Web of Science, APA PsycINFO, and APA PsycArticles. A search of grey literature will also be conducted in databases such as CareSearch, Trip, GuidelineCentral, ClinicalTrials.gov, and the National Institute for Health and Care and Excellence website. The search strategy will be developed in conjunction with an academic librarian. Piloting of the screening process will be conducted to ensure agreement among the team on the eligibility criteria. Covidence software will be used to facilitate deduplication, screening, and blind reviewing. Four reviewers will conduct title and abstract screening. Six reviewers will conduct full text screening. Any conflicts will be resolved by a reviewer not involved in the conflict. One reviewer will conduct data extraction using pre-established data extraction tables. Results will be synthesised, and a narrative synthesis will be used to illustrate the findings of this review. Data will be presented visually using tables, figures, and word clouds, as appropriate.

A systematic review of AI literacy scales

With the opportunities and challenges stemming from the artificial intelligence developments and its integration into society, AI literacy becomes a key concern. Utilizing quality AI literacy instruments is crucial for understanding and promoting AI literacy development. This systematic review assessed the quality of AI literacy scales using the COSMIN tool aiming to aid researchers in choosing instruments for AI literacy assessment. This review identified 22 studies validating 16 scales targeting various populations including general population, higher education students, secondary education students, and teachers. Overall, the scales demonstrated good structural validity and internal consistency. On the other hand, only a few have been tested for content validity, reliability, construct validity, and responsiveness. None of the scales have been tested for cross-cultural validity and measurement error. Most studies did not report any interpretability indicators and almost none had raw data available. There are 3 performance-based scale available, compared to 13 self-report scales.

Cross-cultural adaptation, validation and psychometric properties of the Arabic version of the Nordic Musculoskeletal Questionnaire in office working population from Saudi Arabia

BACKGROUND

Office-workers who suffer from musculoskeletal pain/disability may experience reduced productivity and absenteeism from work. The Nordic Musculoskeletal Questionnaire (NMQ) is a valid, simple screening tool for the history and presence of self-perceived musculoskeletal symptoms in both general public and occupational settings.

OBJECTIVE

To translate and culturally adapt the NMQ into Arabic language and examine its psychometric properties.

METHODS

The published guidelines were followed to translate and adapt the NMQ into Arabic using a forward-backward process. Construct validity involved comparing NMQ responses with disability-related musculoskeletal questionnaires in different body regions, including the Neck Disability Index (NDI), Oswestry Disability Index (ODI), Quick-Disability of the Arm, Shoulder, and Hand (Quick-DASH), and Reduced Western Ontario and McMaster Universities Osteoarthritis Index (ArWOMAC). The reliability was evaluated using Cronbach's alpha for internal consistency and prevalence-adjusted bias-adjusted kappa (PABAK) for test-retest reliability.

RESULTS

The Arabic NMQ (Ar-NMQ) revealed excellent internal consistency (Cronbach's alpha = 0.85). For the test-retest reliability, the PABAK coefficient ranged between 0.50 and 1. The Ar-NMQ demonstrated strong construct validity. Participants reporting neck pain showed significantly elevated disability scores on the NDI (p < 0.05), while those with back pain exhibited higher ODI scores (p < 0.05). Moreover, individuals reporting shoulder, elbow, and wrist pain and disability displayed elevated Quick-DASH scores (p < 0.05). Similarly, participants reporting hip/thighs, knees, and ankle/feet pain/disability demonstrated significantly higher disability in ArWOMAC (p < 0.05).

CONCLUSION

The NMQ was successfully translated and adapted into Arabic language, providing a reliable and valid instrument for assessing pain in specific body regions in the Arabic-speaking population.

Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024

PURPOSE

Although comprehensive and widespread guidelines on how to conduct systematic reviews of outcome measurement instruments (OMIs) exist, for example from the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) initiative, key information is often missing in published reports. This article describes the development of an extension of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline: PRISMA-COSMIN for OMIs 2024.

METHODS

The development process followed the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) guidelines and included a literature search, expert consultations, a Delphi study, a hybrid workgroup meeting, pilot testing, and an end-of-project meeting, with integrated patient/public involvement.

RESULTS

From the literature and expert consultation, 49 potentially relevant reporting items were identified. Round 1 of the Delphi study was completed by 103 panelists, whereas round 2 and 3 were completed by 78 panelists. After 3 rounds, agreement (≥ 67%) on inclusion and wording was reached for 44 items. Eleven items without consensus for inclusion and/or wording were discussed at a workgroup meeting attended by 24 participants. Agreement was reached for the inclusion and wording of 10 items, and the deletion of 1 item. Pilot testing with 65 authors of OMI systematic reviews further improved the guideline through minor changes in wording and structure, finalized during the end-of-project meeting. The final checklist to facilitate the reporting of full systematic review reports contains 54 (sub)items addressing the review's title, abstract, plain language summary, open science, introduction, methods, results, and discussion. Thirteen items pertaining to the title and abstract are also included in a separate abstract checklist, guiding authors in reporting for example conference abstracts.

CONCLUSION

PRISMA-COSMIN for OMIs 2024 consists of two checklists (full reports; abstracts), their corresponding explanation and elaboration documents detailing the rationale and examples for each item, and a data flow diagram. PRISMA-COSMIN for OMIs 2024 can improve the reporting of systematic reviews of OMIs, fostering their reproducibility and allowing end-users to appraise the quality of OMIs and select the most appropriate OMI for a specific application. NOTE: In order to encourage its wide dissemination this article is freely accessible on the web sites of the journals: Health and Quality of Life Outcomes; Journal of Clinical Epidemiology; Journal of Patient-Reported Outcomes; Quality of Life Research.

Measuring Signs of Atopic Dermatitis in Clinical Practice: A HOME-CP Consensus Statement

Importance

Outcome measurement is an essential component of value-based health care and can aid patient care, quality improvement, and clinical effectiveness evidence generation. The Harmonising Outcome Measures for Eczema Clinical Practice initiative aims to identify a list of validated, feasible, outcome measurement instruments recommended to measure atopic dermatitis (AD) in the clinical practice setting. The clinical practice set is a list of instruments that clinicians can pick and choose from to suit their needs in the context of clinical care.

Objective

To recommend instruments to measure clinical signs of AD in clinical practice.

Evidence Review

Following the predefined roadmap, a mixed methods design was implemented and incorporated systematic reviews and qualitative consensus methods. Previous systematic reviews identified few clinical signs instruments with sufficient validation for recommendation. An updated systematic review evaluating the validity of clinical signs instruments informed an international meeting to reach consensus on recommended instruments to measure AD clinical signs in clinical practice. Consensus was defined as less than 30% disagreement. An in-person consensus exercise was held in Montreal, Canada, on October 16, 2022. The 34 attendees included patient and patient advocate research partners, health care professionals, researchers, methodologists, and industry representatives.

Findings

The updated systematic review found that the Eczema Area and Severity Index (EASI), Scoring Atopic Dermatitis, and objective Scoring Atopic Dermatitis were the only instruments that demonstrated sufficient performance in all assessed measurement properties. The modified EASI and Signs Global Assessment × Body Surface Area instruments were also recommended. The EASI, Validated Investigator Global Assessment, and Investigator's Global Assessment multiplied by or measured concurrently with a body surface area measure achieved consensus in criteria and were adopted.

Conclusions and Relevance

This consensus statement by the Harmonising Outcome Measures for Eczema initiative suggests that when assessing and documenting clinical signs of AD, there are several valid and feasible instruments that can best fit a clinician's specific practice needs. These instruments should improve and standardize the documentation of signs severity, help determine the effect of treatment, facilitate the generation of clinical effectiveness evidence, and enhance the implementation of value-based health care.

The Long COVID Symptoms and Severity Score: Development, Validation, and Application

OBJECTIVES

The primary focus of this research is the proposition of a methodological framework for the clinical application of the long COVID symptoms and severity score (LC-SSS). This tool is not just a self-reported assessment instrument developed and validated but serves as a standardized, quantifiable means to monitor the diverse and persistent symptoms frequently observed in individuals with long COVID.

METHODS

A 3-stage process was used to develop, validate, and establish scoring standards for the LC-SSS. Validation measures included correlations with other patient-reported measures, confirmatory factor analysis, Cronbach's α for internal consistency, and test-retest reliability. Scoring standards were determined using K-means clustering, with comparative assessments made against hierarchical clustering and the Gaussian Mixture Model.

RESULTS

The LC-SSS showed correlations with EuroQol 5-Dimension 5-Level (rs = -0.55), EuroQol visual analog scale (rs = -0.368), Patient Health Questionnaire-9 (rs = 0.538), Beck Anxiety Inventory (rs = 0.689), and Insomnia Severity Index (rs = 0.516), confirming its construct validity. Structural validity was good with a comparative fit index of 0.969, with Cronbach's α of 0.93 indicating excellent internal consistency. Test-retest reliability was also satisfactory (intraclass correlation coefficient 0.732). K-means clustering identified 3 distinct severity categories in individuals living with long COVID, providing a basis for personalized treatment strategies.

CONCLUSIONS

The LC-SSS provides a robust and valid tool for assessing long COVID. The severity categories established via K-means clustering demonstrate significant variation in symptom severity, informing personalized treatment and improving care quality for patients with long COVID.

Interpreting Change in Disorders of Consciousness Using the Coma Recovery Scale-Revised

The purpose of this study was to differentiate clinically meaningful improvement or deterioration from normal fluctuations in patients with disorders of consciousness (DoC) following severe brain injury. We computed indices of responsiveness for the Coma Recovery Scale-Revised (CRS-R) using data from a clinical trial of 180 participants with DoC. We used CRS-R scores from baseline (enrollment in a clinical trial) and a 4-week follow-up assessment period for these calculations. To improve precision, we transformed ordinal CRS-R total scores (0-23 points) to equal-interval measures on a 0-100 unit scale using Rasch Measurement theory. Using the 0-100 unit total Rasch measures, we calculated distribution-based 0.5 standard deviation (SD) minimal clinically important difference, minimal detectable change using 95% confidence intervals, and conditional minimal detectable change using 95% confidence intervals. The distribution-based minimal clinically important difference evaluates group-level changes, whereas the minimal detectable change values evaluate individual-level changes. The minimal clinically important difference and minimal detectable change are derived using the overall variability across total measures at baseline and 4 weeks. The conditional minimal detectable change is generated for each possible pair of CRS-R Rasch person measures and accounts for variation in standard error across the scale. We applied these indices to determine the proportions of participants who made a change beyond measurement error within each of the two subgroups, based on treatment arm (amantadine hydrochloride or placebo) or categorization of baseline Rasch person measure to states of consciousness (i.e., unresponsive wakefulness syndrome and minimally conscious state). We compared the proportion of participants in each treatment arm who made a change according to the minimal detectable change and determined whether they also changed to another state of consciousness. CRS-R indices of responsiveness (using the 0-100 transformed scale) were as follows: 0.5SD minimal clinically important difference = 9 units, minimal detectable change = 11 units, and the conditional minimal detectable change ranged from 11 to 42 units. For the amantadine and placebo groups, 70% and 58% of participants showed change beyond measurement error using the minimal detectable change, respectively. For the unresponsive wakefulness syndrome and minimally conscious state groups, 54% and 69% of participants changed beyond measurement error using the minimal detectable change, respectively. Among 115 participants (64% of the total sample) who made a change beyond measurement error, 29 participants (25%) did not change state of consciousness. CRS-R indices of responsiveness can support clinicians and researchers in discerning when behavioral changes in patients with DoC exceed measurement error. Notably, the minimal detectable change can support the detection of patients who make a "true" change within or across states of consciousness. Our findings highlight that the continued use of ordinal scores may result in incorrect inferences about the degree and relevance of a change score.

Experimental Comparison between 4D Stereophotogrammetry and Inertial Measurement Unit Systems for Gait Spatiotemporal Parameters and Joint Kinematics

(1) Background: Traditional gait assessment methods have limitations like time-consuming procedures, the requirement of skilled personnel, soft tissue artifacts, and high costs. Various 3D time scanning techniques are emerging to overcome these issues. This study compares a 3D temporal scanning system (Move4D) with an inertial motion capture system (Xsens) to evaluate their reliability and accuracy in assessing gait spatiotemporal parameters and joint kinematics. (2) Methods: This study included 13 healthy people and one hemiplegic patient, and it examined stance time, swing time, cycle time, and stride length. Statistical analysis included paired samples t-test, Bland-Altman plot, and the intraclass correlation coefficient (ICC). (3) Results: A high degree of agreement and no significant difference (p > 0.05) between the two measurement systems have been found for stance time, swing time, and cycle time. Evaluation of stride length shows a significant difference (p < 0.05) between Xsens and Move4D. The highest root-mean-square error (RMSE) was found in hip flexion/extension (RMSE = 10.99°); (4) Conclusions: The present work demonstrated that the system Move4D can estimate gait spatiotemporal parameters (gait phases duration and cycle time) and joint angles with reliability and accuracy comparable to Xsens. This study allows further innovative research using 4D (3D over time) scanning for quantitative gait assessment in clinical practice.

A practical guide for selecting continuous monitoring wearable devices for community-dwelling adults

Importance

The burgeoning landscape of wearable devices warrants a guide for the selection of devices. Existing guidelines and recommendations provide evaluation frameworks with theoretical principles but tend to lack a pragmatic application and systematic approach for device selection. While fitness trackers exemplify the convenience of wearable technologies, their selection for specific health monitoring purposes demands a nuanced understanding of varying functionalities and user compatibilities.

Objective

The objective is to develop and present a practical guide for researchers, healthcare professionals, and device users to systematically select wearable devices for continuous monitoring in community-dwelling adults.

Methods & results

Based on diverse sources, such as the United States Food and Drug Administration (FDA), the Clinical Trials Transformation Initiative (CTTI), the Electronic Patient-Reported Outcome (ePRO) Consortium, and comparative analyses of wearable technology performances from feasibility and usability studies, the guide incorporates five core criteria: continuous monitoring capability, device availability and suitability, technical performance (accuracy and precision), feasibility of use, and cost evaluation. The structured criteria can be applied in device selection as well as device evaluation.

Conclusions

This practical guide provides a step-by-step solution for researchers, healthcare professionals, and device users to choose suitable wearable devices for continuous monitoring. It provides a comprehensive starting point, outlining how to effectively navigate the selection process for wearable devices amidst a plethora of similar options.

Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024

PURPOSE

Although comprehensive and widespread guidelines on how to conduct systematic reviews of outcome measurement instruments (OMIs) exist, for example from the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) initiative, key information is often missing in published reports. This article describes the development of an extension of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline: PRISMA-COSMIN for OMIs 2024.

METHODS

The development process followed the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) guidelines and included a literature search, expert consultations, a Delphi study, a hybrid workgroup meeting, pilot testing, and an end-of-project meeting, with integrated patient/public involvement.

RESULTS

From the literature and expert consultation, 49 potentially relevant reporting items were identified. Round 1 of the Delphi study was completed by 103 panelists, whereas round 2 and 3 were completed by 78 panelists. After 3 rounds, agreement (≥ 67%) on inclusion and wording was reached for 44 items. Eleven items without consensus for inclusion and/or wording were discussed at a workgroup meeting attended by 24 participants. Agreement was reached for the inclusion and wording of 10 items, and the deletion of 1 item. Pilot testing with 65 authors of OMI systematic reviews further improved the guideline through minor changes in wording and structure, finalized during the end-of-project meeting. The final checklist to facilitate the reporting of full systematic review reports contains 54 (sub)items addressing the review's title, abstract, plain language summary, open science, introduction, methods, results, and discussion. Thirteen items pertaining to the title and abstract are also included in a separate abstract checklist, guiding authors in reporting for example conference abstracts.

CONCLUSION

PRISMA-COSMIN for OMIs 2024 consists of two checklists (full reports; abstracts), their corresponding explanation and elaboration documents detailing the rationale and examples for each item, and a data flow diagram. PRISMA-COSMIN for OMIs 2024 can improve the reporting of systematic reviews of OMIs, fostering their reproducibility and allowing end-users to appraise the quality of OMIs and select the most appropriate OMI for a specific application. NOTE: In order to encourage its wide dissemination this article is freely accessible on the web sites of the journals: Health and Quality of Life Outcomes; Journal of Clinical Epidemiology; Journal of Patient-Reported Outcomes; Quality of Life Research.

Guideline for reporting systematic reviews of outcome measurement instruments (OMIs): PRISMA-COSMIN for OMIs 2024

PURPOSE

Although comprehensive and widespread guidelines on how to conduct systematic reviews of outcome measurement instruments (OMIs) exist, for example from the COSMIN (COnsensus-based Standards for the selection of health Measurement INstruments) initiative, key information is often missing in published reports. This article describes the development of an extension of the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) 2020 guideline: PRISMA-COSMIN for OMIs 2024.

METHODS

The development process followed the Enhancing the QUAlity and Transparency Of health Research (EQUATOR) guidelines and included a literature search, expert consultations, a Delphi study, a hybrid workgroup meeting, pilot testing, and an end-of-project meeting, with integrated patient/public involvement.

RESULTS

From the literature and expert consultation, 49 potentially relevant reporting items were identified. Round 1 of the Delphi study was completed by 103 panelists, whereas round 2 and 3 were completed by 78 panelists. After 3 rounds, agreement (≥67%) on inclusion and wording was reached for 44 items. Eleven items without consensus for inclusion and/or wording were discussed at a workgroup meeting attended by 24 participants. Agreement was reached for the inclusion and wording of 10 items, and the deletion of 1 item. Pilot testing with 65 authors of OMI systematic reviews further improved the guideline through minor changes in wording and structure, finalized during the end-of-project meeting. The final checklist to facilitate the reporting of full systematic review reports contains 54 (sub)items addressing the review's title, abstract, plain language summary, open science, introduction, methods, results, and discussion. Thirteen items pertaining to the title and abstract are also included in a separate abstract checklist, guiding authors in reporting for example conference abstracts.

CONCLUSION

PRISMA-COSMIN for OMIs 2024 consists of two checklists (full reports; abstracts), their corresponding explanation and elaboration documents detailing the rationale and examples for each item, and a data flow diagram. PRISMA-COSMIN for OMIs 2024 can improve the reporting of systematic reviews of OMIs, fostering their reproducibility and allowing end-users to appraise the quality of OMIs and select the most appropriate OMI for a specific application. NOTE: In order to encourage its wide dissemination this article is freely accessible on the web sites of the journals: Health and Quality of Life Outcomes; Journal of Clinical Epidemiology; Journal of Patient-Reported Outcomes; Quality of Life Research.

Psychometric Properties of Jebsen Taylor Hand Function Test in an Italian Population with Parkinson's Disease

BACKGROUND

Assessment of upper limb function is critical in the rehabilitation process of people with Parkinson's Disease (PD), and universally validated outcome measures are needed to allow comparisons across the practice. Moreover, the study of psychometric properties of the same tool on different clinical populations guarantees the possibility of reliably evaluating the same rehabilitation treatment in people with different clinical conditions.

AIM OF THE STUDY

The aim of this research was to evaluate the psychometric characteristics of the Italian adaptation of the Jebsen Taylor Hand Function Test (JTHFT) in individuals with PD.

METHODS

The reliability and validity of the test were assessed in accordance with international standards. Internal consistency was measured using Cronbach's alpha, and test-retest reliability was determined via the intraclass correlation coefficient (ICC). The construct validity and cross-cultural validity of the test were evaluated using Pearson's correlation coefficient with three assessment tools on upper limb function, independence, and quality of life, with hand grip power measured by a dynamometer and an Italian pangram. Finally, responsiveness after a one month of rehabilitation treatment was measured using the Wilcoxon rank test.

RESULTS

Fifty-two Italian people with PD were recruited. Cronbach's alpha values ranged from 0.556 (non-dominant hand) to 0.668 (dominant hand); ICC values ranged from 0.754 to 0.988. Construct validity showed that several statistically significant correlations were detected. Wilcoxon's test showed that the assessment tool can detect a change in this population after treatment.

CONCLUSIONS

The JTHFT is a reliable, valid, and respondent tool to evaluate the upper limb and hand functionalities in PD patients. It should be added to the toolkit for measuring upper limb performance in this population, adding value to clinical evaluation and ensuring comparable results for different clinical populations and different countries.

Reliability and responsiveness of the Swedish short Hip-RSI

Purpose

The aim of this study was to examine test-retest reliability and responsiveness of the short version (6-item) Hip Return to Sport after Injury (Hip-RSI) scale in patients following hip arthroscopy.

Methods

The study included 100 hip arthroscopy patients responding to a digital survey including the short version (6-item) Hip-RSI, International Hip Outcome Tool (short version) (iHOT-12) and RTS status 3, 6 and 9 months following surgery. The Hip-RSI was administered twice at 3-month follow-up. Test-retest reliability was evaluated using intraclass correlation coefficients. Responsiveness was tested by correlations between changes in Hip-RSI and iHOT-12 scores and by comparing change in Hip-RSI scores of patients who progressed on the return to sport (RTS) continuum (from return to any sport to return to performance) to patients who did not, using independent samples t-tests.

Results

Hip-RSI was found to have excellent test-retest reliability on the individual (intraclass correlation coefficient, ICC [95% confidence interval, CI]: 0.90 [0.83-0.94]) and group level (ICC [95% CI]: 0.95 [0.91-0.97]) with a standard error of measurement of 5.53 and smallest detectable change of 15.3 on the individual and 2.2 on the group level. Hip-RSI was found responsive to change through positive correlations of changes in scores with changes in iHOT-12 scores from 3 to 6 months (r [95% CI]: 0.51 [0.35-0.65]; p < 0.001) and from 3 to 9 months following arthroscopy (r [95% CI]: 0.61 [0.57-0.79); p < 0.001). Further responsiveness was shown by significant mean changes in scores among patients that progressed on the RTS-continuum (3-6 months: 8.6 [95% CI: 3.8- 13.5); 3-9 months: 12.6 [5.6-19.7]).

Conclusion

The short version (6-item) Hip-RSI demonstrated excellent test-retest reliability and responsiveness to change in the evaluation of psychological readiness to RTS following hip arthroscopy.

Level of Evidence

Level II.

The psychometric properties of the Six-Spot Step Test - a systematic review using the COSMIN guidelines

OBJECTIVE

Accurate and reliable balance measures are important for prescribing fall prevention treatments and monitoring their effectiveness. Thus, we aimed to systematically review the psychometric properties of the Six-Spot Step Test, an increasingly used measure of dynamic balance.

DATA SOURCES

A literature search using the free-text term "Six-Spot Step Test" was performed on 12 February 2024, in Medline, Embase, Rehabilitation & Sports Medicine and SPORTDiscus. Eligibility criteria were adults aged 18 or more, trials evaluating the psychometric properties of the Six-Spot Step Test, and English-language articles. Conference abstracts were excluded.

REVIEW METHODS

Two investigators screened and selected data independently and assessed the methodological quality and evidence using the COSMIN Risk of Bias checklist and modified GRADE approach. One investigator extracted study characteristics such as design, population and psychometric properties.

RESULTS

Of the 159 articles identified, 16, evaluating multiple measurement properties, were included in the final analysis. A total of 1319 people participated, including people affected by Stroke, multiple sclerosis, Parkison's disease, chronic inflammatory polyneuropathy and older adults with balance problems. Eight articles assessing reliability (n = 618, intraclass correlations coefficient ≥0.7, minimal detectable change = 22%) and 12 construct validity (n = 1082, 83% true hypothesis, area under the curve >0.7) exhibited sufficient methodological quality with high-level evidence, while two studies (n = 167) examining responsiveness showed very low evidence.

CONCLUSION

Apart from responsiveness, robust evidence supports the reliability and validity of the Six-Spot Step Test for assessing dynamic balance in a specific group of individuals with neurological diseases and older adults. Further, it is considered feasible for clinical use.

Modifying the Mobility Scale for Acute Stroke (MSAS) for All Stroke Phases (MSAllS): Measurement Properties and Clinical Application

OBJECTIVE

To develop and examine the measurement properties and interpretability of the Mobility Scale for "All" Stroke Phases (MSAllS) as a potential single outcome measure to capture improvements in physical function throughout the stroke continuum.

DESIGN

Retrospective cross-sectional study.

SETTING

Inpatient rehabilitation unit.

PARTICIPANTS

People after stroke at discharge from rehabilitation (N=309).

INTERVENTION

Not applicable.

MAIN OUTCOME MEASURE(S)

We developed MSAllS by extending the highest MSAS level (walk 10 m independently) with 4 gait speed levels. To establish a clinical anchor, we extracted a 4-level discharge outcome. To assess the distributional properties and internal consistency of MSAllS, we evaluated its ceiling effects and calculated the Cronbach alpha, respectively. To assess structural validity, we performed a confirmatory factor analysis. To assess (i) its convergent validity with the FIM and (ii) its predictive validity with the clinical anchor, we used Spearman's rank correlations. To evaluate the clinical interpretability of MSAllS, we used an item-response theory-based method to estimate MSAllS thresholds associated with the clinical anchor.

RESULTS

The MSAllS had lower ceiling effects compared with MSAS (0% vs 25%). Internal consistency of MSAllS was excellent (α=0.94). Structural validity of MSAllS demonstrated a good fit (Comparative Fit Index=0.95; Tucker-Lewis Index=0.92; Root Means Square Error of Approximation=0.17). MSAllS demonstrated a moderate correlation (rho=0.66) with FIM score and with the clinical anchor (rho=0.75). MSAllS thresholds for increasing levels of the clinical anchor were 22 (20.8 to 23.6) - at least moderate assistance with walking/transfers, 28 (27.5 to 29.4) - at most supervision with walking, and 33 (32.5 to 33.4) - able to walk unassisted.

CONCLUSION

The MSAllS showed adequate measurement properties and clinical interpretability. MSAllS has the potential to be a single universal measure to evaluate physical function after stroke but further evaluation of clinical interpretability is required.

How do digital range of motion measurement devices 'measure-up' to traditional goniometry in assessing shoulder range of motion? A systematic review and meta-analysis

Background

Shoulder range of motion (ROM) is traditionally measured using universal goniometry. However, novel devices to measure shoulder ROM digitally are becoming increasingly available. We aimed to synthesise the current evidence to answer: 1) what technologies are currently in use? 2) Are they reliable? 3) How do they compare to goniometry?

Methods

Systematic review of the literature was conducted according to PRISMA guidelines. MEDLINE, Embase, CINAHL, Emcare and Cochrane databases were searched to identify studies comparing a digital device measuring shoulder ROM to goniometry in participants > = 18years. Quality of studies was assessed using COSMIN risk of bias tool. End points included device validity compared to goniometry and intra-rater reliability.

Results

15 articles were included, representing 372 participants and 608 shoulders, and reporting data for five device categories; infrared/RGB-D, 3D-motion-analysis, combined 3D/infra-red, 2D-video-analysis and virtual-reality. Nine studies reported mean bias and 95% limits of agreement (LOA) compared to goniometry. Pooled mean bias was -0.25 degrees (-1.25, 0.75 95% LOA, random effects model) overall. This did not differ by device type (p = 0.83), sensor or non-sensor-based devices (p = 0.62) or plane of movement (p = 0.91).

Conclusions

These devices compare well to goniometry and represent a possible means of increasing efficiency and facilitating telemedicine.

Asymmetric involvement of hands: Psychometric properties of the Turkish version of the Bimanual Fine Motor Function 2.0 classification in children with cerebral palsy

BACKGROUND

Manual functions affect more than a half of children with Cerebral palsy (CP). Asymmetric involvement of hands may also affect unilateral and bilateral activities of daily life. The Bimanual Fine Motor Function version 2.0 (BFMF-2.0) is a unique functional classification that categorizes the capacity of each hand (what the child can do) during bimanual functions.

PURPOSE

The aim of this study was to investigate the validity and reliability of the Turkish version of the BFMF-2.0 in children with CP.

STUDY DESIGN

Clinical measurement and cross-sectional study.

METHODS

The study included 91 children with CP (56 girls, mean age; 7.41 ± 4.23 years [4-18 years]) and their parents. The Manual Ability Classification System (MACS), the Quality of Upper Extremity Skills Test (QUEST), and the Box and Block Test (BBT) were used for construct and concurrent validity. Experienced/inexperienced therapists and parents classified fine motor capacities of the children via live or video-based observation to assess inter-rater reliability. Three weeks later, the children were reclassified for intra-rater reliability.

RESULTS

The Turkish version of the BFMF-2.0 classification was strongly correlated with the MACS (rho = -0.88, p < 0.001), the QUEST (rho = 0.80, p < 0.001), and the BBT (rho = -0.77, p < 0.001). The inter-rater reliability scores were weak to excellent between the parents and the therapists (via live observation, κw = 0.57) and also between experienced/inexperienced therapists (via live or video-based observation, κw = 0.66-0.79). Intra-rater reliability scores were good to excellent (Intraclass Correlation Coefficient [ICC] = 0.87-0.95).

CONCLUSIONS

The Turkish version of the BFMF-2.0 classification is valid and reliable and could be applied by experienced and inexperienced therapists via live or video-based observation and by parents via live observation.

What is the most appropriate handgrip strength testing protocol for sarcopenia screening in older adults with cognitive impairment?

BACKGROUND

Handgrip strength (HGS) testing is a highly recommended method for screening for sarcopenia in older adults. However, there is no consensus on the optimal protocol and number of trials for screening sarcopenia in older adults with cognitive impairment.

OBJECTIVE

To investigate the use of the first trial (FT), the mean of three trials (MT), and the highest value (HT) from three trials of the HGS test to screen for sarcopenia in older adults with cognitive impairment. Additionally, to analyze the consistency, agreement, and measurement error in the diagnosis of muscle weakness.

METHODS

176 older adults with cognitive impairment were evaluated. The HGS test was repeated three times. Analyses were performed using the Friedman repeated measures test with Wilcoxon post-hoc, intraclass correlation coefficient (ICC), Standard Error of Measurement (SEM), Minimal Detectable Change (MDC95), and Kappa index tests.

RESULTS

There was no significant difference between the first trial (FT) and the mean of three trials (MT) (d = 0.17 [95 % CI: -0.08, 0.42]), but both differed significantly from the highest value (HT) (p < 0.001). The ICC indicated a reliability of 0.97 (95 % CI: 0.95, 0.98) across all participants, while the kappa index demonstrated over 80 % agreement. The SEM for the first measure of HGS ranged from 0.59 to 2.12 kgf. The MDC95 ranged from 1.64 to 5.87 kgf.

CONCLUSION

For HGS testing, there was excellent consistency between the FM and MT. All three testing methods demonstrated excellent agreement in diagnosing muscle weakness. The measurement errors confirm that FT can be reliably used to monitor changes during rehabilitation.

Translation and validation of the French version of the child perceptions questionnaire for children aged 11 to 14 years old (CPQ11-14) short-form

OBJECTIVES

The COHQoL is a set of questionnaires used to evaluate the impact of oral health on children's quality of life. Although the CPQ8-10 and the P-CPQ have been translated and validated in French, the CPQ11-14 14 has not yet been validated. The aim was to develop a French version of the CPQ11-14 16-items.

MATERIALS AND METHODS

The French version of CPQ11-14 was obtained by a forward-backward translation process and pretested. The final version was tested on children aged 11-14 and divided into three groups: children with orofacial clefts, children with rare dental diseases other than clefts, and children without anomalies. We conducted a cross-sectional study and evaluated the reliability with test-retest and internal consistency, and the questionnaire validity with construct validity and discriminant validity. We performed an Exploratory Factory Analysis (EFA).

RESULTS

187 children tested the questionnaire. The ICC of the test-retest was 0.76 and the Cronbach's alpha was 0.77. The correlation between the CPQ11-14 and self-assessment of oral health and general well-being was > 0.2. Patients with orofacial clefts and rare diseases had significantly higher scores for overall short-form CPQ11-14. The EFA revealed six factors.

CONCLUSION

The French CPQ11-14 is valid to assess the impact of oral health on children's quality of life.

CLINICAL RELEVANCE

The translation of this questionnaire into French will enable us to assess the impact of oral health on the quality of life of adolescents. This questionnaire complements the 8-10 years version of the CPQ, as well as the parental version that can be used in conjunction with the questionnaire.

School Participation Questionnaire (SPQ): Italian Translation, Cultural Adaptation, and Pilot Testing in Children with Neurodevelopmental Disorders

INTRODUCTION

According to leading occupational therapy models, the environment appears to be a key element in fostering occupational performance and participation. There is an emerging need to identify an instrument that can assess these aspects in the school environment. Currently, there are no rating scales in Italy for the school participation of children with neurodevelopmental disorders. For this reason, this study aims to culturally adapt and translate the School Participation Questionnaire (SPQ) to Italian and to pilot test the translated Italian version on children with neurodevelopmental disorders.

METHODS

The original scale was translated from English to Italian using the guidelines "Translation and Cultural Adaptation of Patient Reported Outcomes Measures-Principles of Good Practice". The psychometric properties analyzed were the following: content validity, construct validity, cross-cultural validity, and internal consistency. Construct validity was assessed using the Italian version of the Sensory Processing Measure (SPM).

RESULTS

The Italian version of the SPQ was administered to 22 children. The mean ± SD of the score was 9.32 ± 1.36; Cronbach's α was 0.935 (p < 0.01). The Pearson's correlation coefficient with the SPM scores was -0.622 (p < 0.01).

CONCLUSIONS

This pilot testing study for the validation of the Italian version of the SPQ showed good validity and reliability results. Thanks to this study, it would be possible to further analyze the tool for the evaluation of the environment and school participation of children with neurodevelopmental disorders, in particular autism spectrum disorder. It is a quick and easy instrument that focuses on the environment as an active variable in the child's occupational performance.

Accuracy, Validity, and Reliability of Markerless Camera-Based 3D Motion Capture Systems versus Marker-Based 3D Motion Capture Systems in Gait Analysis: A Systematic Review and Meta-Analysis

(1) Background: Marker-based 3D motion capture systems (MBS) are considered the gold standard in gait analysis. However, they have limitations for which markerless camera-based 3D motion capture systems (MCBS) could provide a solution. The aim of this systematic review and meta-analysis is to compare the accuracy, validity, and reliability of MCBS and MBS. (2) Methods: A total of 2047 papers were systematically searched according to PRISMA guidelines on 7 February 2024, in two different databases: Pubmed (1339) and WoS (708). The COSMIN-tool and EBRO guidelines were used to assess risk of bias and level of evidence. (3) Results: After full text screening, 22 papers were included. Spatiotemporal parameters showed overall good to excellent accuracy, validity, and reliability. For kinematic variables, hip and knee showed moderate to excellent agreement between the systems, while for the ankle joint, poor concurrent validity and reliability were measured. The accuracy and concurrent validity of walking speed were considered excellent in all cases, with only a small bias. The meta-analysis of the inter-rater reliability and concurrent validity of walking speed, step time, and step length resulted in a good-to-excellent intraclass correlation coefficient (ICC) (0.81; 0.98). (4) Discussion and conclusions: MCBS are comparable in terms of accuracy, concurrent validity, and reliability to MBS in spatiotemporal parameters. Additionally, kinematic parameters for hip and knee in the sagittal plane are considered most valid and reliable but lack valid and accurate measurement outcomes in transverse and frontal planes. Customization and standardization of methodological procedures are necessary for future research to adequately compare protocols in clinical settings, with more attention to patient populations.

Measures of financial toxicity in cancer survivors: a systematic review

PURPOSE

Comprehensive cancer-related financial toxicity (FT) measures as a multidimensional construct are lacking. The aims of this systematic review were to (1) identify full measures designed explicitly for assessing FT and evaluate their psychometric properties (content validity, structural validity, reliability, and other measurement properties) using Consensus-Based Standards for the Selection of Health Measurement Instruments (COSMIN), and (2) provide an analysis of the domains of FT covered in these measures.

METHODS

MEDLINE, CINAHL, Web of Science, and Cochrane CENTRAL were searched for quantitative studies published from January 2000 to July 2023 that reported psychometric properties of FT measures in cancer survivors. The psychometric properties of FT measures and study risk of bias were analysed using COSMIN. Each FT measure was compared against the six domains of FT recommended by Witte and colleagues. Results were synthesized narratively. The detailed search strategies are available in Table S1.

RESULTS

Six FT tools including the COST-FACIT, PROFFIT, FIT, SFDQ, HARDS, and ENRICh-Spanish were identified. The COST-FACIT measure had good measurement properties. No measure reached an excellent level for overall quality but was mostly rated as sufficient. The SFDQ, HARDS, and ENRICh-Spanish were the most comprehensive in the inclusion of the six domains of FT.

CONCLUSION

This review emphasizes the need for validated multidimensional FT measures that can be applied across various cancer types, healthcare settings, and cultural backgrounds. Furthermore, a need to develop practical screening tools with high predictive ability for FT is highly important, considering the significant consequences of FT. Addressing these gaps in future research will further enhance the understanding of FT.

Classification of short and long term mild traumatic brain injury using computerized eye tracking

Accurate, and objective diagnosis of brain injury remains challenging. This study evaluated useability and reliability of computerized eye-tracker assessments (CEAs) designed to assess oculomotor function, visual attention/processing, and selective attention in recent mild traumatic brain injury (mTBI), persistent post-concussion syndrome (PPCS), and controls. Tests included egocentric localisation, fixation-stability, smooth-pursuit, saccades, Stroop, and the vestibulo-ocular reflex (VOR). Thirty-five healthy adults performed the CEA battery twice to assess useability and test-retest reliability. In separate experiments, CEA data from 55 healthy, 20 mTBI, and 40 PPCS adults were used to train a machine learning model to categorize participants into control, mTBI, or PPCS classes. Intraclass correlation coefficients demonstrated moderate (ICC > .50) to excellent (ICC > .98) reliability (p < .05) and satisfactory CEA compliance. Machine learning modelling categorizing participants into groups of control, mTBI, and PPCS performed reasonably (balanced accuracy control: 0.83, mTBI: 0.66, and PPCS: 0.76, AUC-ROC: 0.82). Key outcomes were the VOR (gaze stability), fixation (vertical error), and pursuit (total error, vertical gain, and number of saccades). The CEA battery was reliable and able to differentiate healthy, mTBI, and PPCS patients reasonably well. While promising, the diagnostic model accuracy should be improved with a larger training dataset before use in clinical environments.

Agreement Between Maximal Lactate Steady State and Critical Power in Different Sports: A Systematic Review and Bayesian's Meta-Regression

ABSTRACT

Borszcz, FK, de Aguiar, RA, Costa, VP, Denadai, BS, and de Lucas, RD. Agreement between maximal lactate steady state and critical power in different sports: A systematic review and Bayesian's meta-regression. J Strength Cond Res 38(6): e320-e339, 2024-This study aimed to systematically review the literature and perform a meta-regression to determine the level of agreement between maximal lactate steady state (MLSS) and critical power (CP). Considered eligible to include were peer-reviewed and "gray literature" studies in English, Spanish, and Portuguese languages in cyclical exercises. The last search was made on March 24, 2022, on PubMed, ScienceDirect, SciELO, and Google Scholar. The study's quality was evaluated using 4 criteria adapted from the COSMIN tool. The level of agreement was examined by 2 separate meta-regressions modeled under Bayesian's methods, the first for the mean differences and the second for the SD of differences. The searches yielded 455 studies, of which 36 studies were included. Quality scale revealed detailed methods and small samples used and that some studies lacked inclusion/exclusion criteria reporting. For MLSS and CP comparison, likely (i.e., coefficients with high probabilities) covariates that change the mean difference were the MLSS time frame and delta criteria of blood lactate concentration, MLSS number and duration of pauses, CP longest predictive trial duration, CP type of predictive trials, CP model fitting parameters, and exercise modality. Covariates for SD of the differences were the subject's maximal oxygen uptake, CP's longest predictive trial duration, and exercise modality. Traditional MLSS protocol and CP from 2- to 15-minute trials do not reflect equivalent exercise intensity levels; the proximity between MLSS and CP measures can differ depending on test design, and both MLSS and CP have inherent limitations. Therefore, comparisons between them should always consider these aspects.

Outcome Measurement Instruments Used to Evaluate Dermatologic Adverse Events in Cancer Trials: A Systematic Review

Importance

Assessment of type, severity, and impact of dermatologic adverse events (DAEs) necessitates well-developed and validated clinician-reported outcome measures (ClinROMs) and patient-reported outcome measures (PROMs) that evaluate concepts specific to mucocutaneous toxic effects and that allow appropriate interpretation and comparison of DAEs across trials.

Objective

To evaluate heterogeneity and quality of ClinROMs and PROMs used to assess DAEs from systemic cancer therapy.

Evidence Review

Two systematic reviews were conducted by searching PubMed and Embase databases from inception through March 7, 2023, and April 12, 2023. The first search included randomized clinical trials and observational studies reporting systemic cancer treatment-induced DAEs assessed by a ClinROM or PROM. The second included studies evaluating measurement properties of frequently used ClinROM and PROM instruments. The Consensus-Based Standards for the Selection of Health Measurement Instruments risk of bias tool was used to evaluate methodologic quality of validation assessments.

Findings

A total of 395 studies were included. The Common Terminology Criteria for Adverse Events (CTCAE) was utilized in 331 studies meeting inclusion criteria (83.8%). At least 1 skin-related PROM was infrequently utilized in systemic chemotherapy clinical trials (79 studies [20.0%]). Most frequently utilized PROMs were the Dermatology Life Quality Index (DLQI; 34 studies [8.6%]) and Skindex-16 (20 studies [5.1%]). Among studies capturing DAEs, 115 (29.1%) reported a nondescript term (ie, rash) as the only DAE. Eight studies described 44 property assessments of the CTCAE, DLQI, and Skindex. There were no studies evaluating content validity, intrarater reliability, or measurement error for the CTCAE, DLQI, or Skindex. There were no studies evaluating structural validity, internal consistency, and responsiveness of DLQI or Skindex. Interrater reliability and responsiveness were each assessed for 1 DAE-related component of the CTCAE. Construct validity for CTCAE, DLQI, and Skindex was evaluated in 29 (65.9%), 3 (6.8%), and 9 (20.5%) assessments, respectively.

Conclusions and Relevance

In this systematic review, there was a narrow spectrum of ClinROMs and PROMs with limited validity for the measurement of DAEs in the context of systemic chemotherapy interventions in clinical trials. Report of trial DAEs often had low morphologic specificity and meaning. Based on existing gaps in measurement and report of DAEs, a frequent and impactful adverse event to chemotherapy, the framework for evaluating cutaneous toxic effects in oncology trials may need collaborative reevaluation.