Evaluating Physical Functioning in Survivors of Critical Illness: Development of a New Continuum Measure for Acute Care

A systematic review and meta-analysis of the clinimetric properties of the core outcome measurement instruments for clinical effectiveness trials of nutritional and metabolic interventions in critical illness (CONCISE)

BACKGROUND

CONCISE is an internationally agreed minimum set of outcomes for use in nutritional and metabolic clinical research in critically ill adults. Clinicians and researchers need to be aware of the clinimetric properties of these instruments and understand any limitations to ensure valid and reliable research. This systematic review and meta-analysis were undertaken to evaluate the clinimetric properties of the measurement instruments identified in CONCISE.

METHODS

Four electronic databases were searched from inception to December 2022 (MEDLINE via Ovid, EMBASE via Ovid, CINAHL via Healthcare Databases Advanced Search, CENTRAL via Cochrane). Studies were included if they examined at least one clinimetric property of a CONCISE measurement instrument or recognised variation in adults ≥ 18 years with critical illness or recovering from critical illness in any language. The COnsensus-based Standards for the selection of health Measurement INstruments (COSMIN) checklist for systematic reviews of Patient-Reported Outcome Measures was used. The Preferred Reporting Items for Systematic Reviews and Meta-Analyses were used in line with COSMIN guidance. The COSMIN checklist was used to evaluate the risk of bias and the quality of clinimetric properties. Overall certainty of the evidence was rated using a modified Grading of Recommendations, Assessment, Development and Evaluation approach. Narrative synthesis was performed and where possible, meta-analysis was conducted.

RESULTS

A total of 4316 studies were screened. Forty-seven were included in the review, reporting data for 12308 participants. The Short Form-36 Questionnaire (Physical Component Score and Physical Functioning), sit-to-stand test, 6-m walk test and Barthel Index had the strongest clinimetric properties and certainty of evidence. The Short Physical Performance Battery, Katz Index and handgrip strength had less favourable results. There was limited data for Lawson Instrumental Activities of Daily Living and the Global Leadership Initiative on Malnutrition criteria. The risk of bias ranged from inadequate to very good. The certainty of the evidence ranged from very low to high.

CONCLUSIONS

Variable evidence exists to support the clinimetric properties of the CONCISE measurement instruments. We suggest using this review alongside CONCISE to guide outcome selection for future trials of nutrition and metabolic interventions in critical illness.

TRIAL REGISTRATION

PROSPERO (CRD42023438187). Registered 21/06/2023.

Clinimetric properties of the Perme Intensive Care Unit Mobility Score -a multicenter study for minimum important difference and responsiveness analysis

Background

The use of instruments in clinical practice with measurement properties tested is highly recommended, in order to provide adequate assessment and measurement of outcomes.

Objective

To calculate the minimum clinically important difference (MCID) and responsiveness of the Perme Intensive Care Unit Mobility Score (Perme Score).

Methods

This retrospective, multicentric study investigated the clinimetric properties of MCID, estimated by constructing the Receiver Operating Characteristic (ROC). Maximizing sensitivity and specificity by Youden's, the ROC curve calibration was performed by the Hosmer and Lemeshow goodness-of-fit test. Additionally, we established the responsiveness, floor and ceiling effects, internal consistency, and predictive validity of the Perme Score.

Results

A total of 1.200 adult patients records from four mixed general intensive care units (ICUs) were included. To analyze which difference clinically reflects a relevant evolution we calculated the area under the curve (AUC) of 0.96 (95% CI: 0.95-0.98), and the optimal cut-off value of 7.0 points was established. No substantial floor (8.8%) or ceiling effects (4.9%) were observed at ICU discharge. However, a moderate floor effect was observed at ICU admission (19.3%), in contrast to a very low incidence of ceiling effect (0.6%). The Perme Score at ICU admission was associated with hospital mortality, OR 0.86 (95% CI: 0.82-0.91), and the predictive validity for ICU stay presented a mean ratio of 0.97 (95% CI: 0.96-0.98).

Conclusion

Our findings support the establishment of the minimum clinically important difference and responsiveness of the Perme Score as a measure of mobility status in the ICU.

The sit-to-stand test as a patient-centered functional outcome for critical care research: a pooled analysis of five international rehabilitation studies

Background

With ICU mortality rates decreasing, it is increasingly important to identify interventions to minimize functional impairments and improve outcomes for survivors. Simultaneously, we must identify robust patient-centered functional outcomes for our trials. Our objective was to investigate the clinimetric properties of a progression of three outcome measures, from strength to function.

Methods

Adults (≥ 18 years) enrolled in five international ICU rehabilitation studies. Participants required ICU admission were mechanically ventilated and previously independent. Outcomes included two components of the Physical Function in ICU Test-scored (PFIT-s): knee extensor strength and assistance required to move from sit to stand (STS); the 30-s STS (30 s STS) test was the third outcome. We analyzed survivors at ICU and hospital discharge. We report participant demographics, baseline characteristics, and outcome data using descriptive statistics. Floor effects represented ≥ 15% of participants with minimum score and ceiling effects ≥ 15% with maximum score. We calculated the overall group difference score (hospital discharge score minus ICU discharge) for participants with paired assessments.

Results

Of 451 participants, most were male (n = 278, 61.6%) with a median age between 60 and 66 years, a mean APACHE II score between 19 and 24, a median duration of mechanical ventilation between 4 and 8 days, ICU length of stay (LOS) between 7 and 11 days, and hospital LOS between 22 and 31 days. For knee extension, we observed a ceiling effect in 48.5% (160/330) of participants at ICU discharge and in 74.7% (115/154) at hospital discharge; the median [1st, 3rd quartile] PFIT-s difference score (n = 139) was 0 [0,1] (p < 0.05). For STS assistance, we observed a ceiling effect in 45.9% (150/327) at ICU discharge and in 77.5% (79/102) at hospital discharge; the median PFIT-s difference score (n = 87) was 1 [0, 2] (p < 0.05). For 30 s STS, we observed a floor effect in 15.0% (12/80) at ICU discharge but did not observe a floor or ceiling effect at hospital discharge. The median 30 s STS difference score (n = 54) was 3 [1, 6] (p < 0.05).

Conclusion

Among three progressive outcome measures evaluated in this study, the 30 s STS test appears to have the most favorable clinimetric properties to assess function at ICU and hospital discharge in moderate to severely ill participants.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13054-022-04048-3.