Systematic Review of the Effect of a One-Day Versus Seven-Day Recall Duration on Patient Reported Outcome Measures (PROMs)

Can prediction models for hospital readmission be improved by incorporating patient-reported outcome measures? A systematic review and narrative synthesis

PURPOSE

To investigate the roles, challenges, and implications of using patient-reported outcome measures (PROMs) in predicting the risk of hospital readmissions.

METHODS

We systematically searched four bibliometric databases for peer-reviewed studies published in English between 1 January 2000 and 15 June 2023 and used validated PROMs to predict readmission risks for adult populations. Reported studies were analysed and narratively synthesised in accordance with the CHARMS and PRISMA guidelines.

RESULTS

Of the 2858 abstracts reviewed, 23 studies met predefined eligibility criteria, representing diverse geographic regions and medical specialties. Among those, 19 identified the positive contributions of PROMs in predicting readmission risks. Seven studies utilised generic PROMs exclusively, eleven used generic and condition-specific PROMs, while 5 focussed solely on condition-specific PROMs. Logistic regression was the most used modelling approach, with 13 studies aiming at predicting 30-day all-cause readmission risks. The c-statistic, ranging from 0.54 to 0.84, was reported in 22/23 studies as a measure of model discrimination. Nine studies reported model calibration in addition to c-statistic. Thirteen studies detailed their approaches to dealing with missing data.

CONCLUSION

Our study highlights the potential of PROMs to enhance predictive accuracy in readmission models, while acknowledging the diversity in data collection methods, readmission definitions, and model evaluation approaches. Recognizing that PROMs serve various purposes beyond readmission reduction, our study supports routine data collection and strategic integration of PROMs in healthcare practices to improve patient outcomes. To facilitate comparative analysis and broaden the use of PROMs in the prediction framework, it is imperative to consider the methodological aspects involved.

Psychometric Performance of the EQ Health and Wellbeing Short in a United Kingdom Population Sample

OBJECTIVES

This study assessed the psychometric performance and construct validity of the EQ Health and Wellbeing Short (EQ-HWB-S), using a validated measure, the EQ-5D-5L, as a comparator.

METHODS

The experimental version of the EQ-HWB-S was compared with the EQ-5D-5L to assess the psychometric performance of the measures. Data were drawn from the valuation stages of the Extending the Quality-Adjusted Life-Year project (UK general population, n = 429) and the EQ-5D-5L UK valuation pilot study (UK general population, n = 248). Construct validity was assessed based on convergent validity, using Spearman correlations and Pearson correlations. Known-group validity was assessed by estimating effect sizes to assess the ability of the EQ-HWB-S and EQ-5D-5L to discriminate between known groups based on "healthy" status, presence of a long-term condition, health and life satisfaction, age, and employment status. The degree of agreement in utility values across instruments was also evaluated using Bland-Altman plots.

RESULTS

Strong associations (rs ≥ 0.5, P < .001) were found between conceptually overlapping dimensions and the utility scores of the EQ-HWB-S and EQ-5D-5L. The instruments performed comparably in discriminating between known groups including healthy versus unhealthy groups (based on the visual analog scale ≥ 80), long-term condition (vs no long-term condition), and above versus below average health and life satisfaction and employed (vs unemployed and long-term sick).

CONCLUSIONS

The EQ-HWB-S performs favorably with utility values successfully discriminating between groups in which differences are expected. Convergence between the EQ-HWB-S and EQ-5D-5L is evident, especially between conceptually overlapping dimensions.

Population Norms for the EQ-5D-5L, PROPr and SF-6D in Hungary

OBJECTIVES

This study aimed to develop population norms for three preference-accompanied measures [EQ-5D-5L, Patient-Reported Outcomes Measurement Information System (PROMIS)-preference scoring system (PROPr) and Short-Form Six-Dimension (SF-6D)] in Hungary.

METHODS

In November 2020, an online cross-sectional survey was conducted among a representative sample of the Hungarian adult general population (n = 1631). Respondents completed the Hungarian versions of the EQ-5D-5L, PROMIS-29+2 version 2.1 and 36-item Short Form Survey version 1 (SF-36v1). The association of utilities with sociodemographic and health-related characteristics of respondents was analysed using multivariate regressions.

RESULTS

The proportion of respondents reporting problems ranged from 8 to 44% (self-care to pain/discomfort) on the EQ-5D-5L, 39-94% (physical function to sleep) on PROPr and 38-87% (role limitations to vitality) on the SF-6D. Problems related to physical function, self-care, usual activities/role limitations and pain increased with age, while mental health problems decreased in all three measures. In almost all corresponding domains, respondents indicated the fewest problems on the EQ-5D-5L and the most problems on the SF-6D. The mean EQ-5D-5L, PROPr and SF-6D utilities were 0.900, 0.535 and 0.755, respectively. Female gender (PROPr, SF-6D), a lower level of education (EQ-5D-5L, PROPr), being unemployed or a disability pensioner (EQ-5D-5L), being underweight or obese (SF-6D), lack of physical exercise (all) and polypharmacy (all) were associated with significantly lower utilities. PROPr yielded the lowest and EQ-5D-5L the highest mean utilities in 28 of 30 chronic health conditions.

CONCLUSIONS

This study presents the first set of Hungarian population norms for the EQ-5D-5L, PROPr and SF-6D. Our findings can serve as reference values in clinical trials and observational studies and contribute to the monitoring of population health and the assessment of disease burden in Hungary.

Evaluation of measurement errors in the Patient-Oriented Eczema Measure (POEM) outcome

BACKGROUND

The Patient-Oriented Eczema Measure (POEM) is the recommended core outcome instrument for atopic dermatitis (AD) symptoms. POEM is reported by recalling the presence/absence of seven symptoms in the last 7 days.

OBJECTIVE

To evaluate measurement errors in POEM recordings due to imperfect recall.

METHODS

Using data from a clinical trial of 247 AD patients aged 12-65 years, we analysed the reported POEM score (r-POEM) and the POEM derived from the corresponding daily scores for the same seven symptoms without weekly recall (d-POEM). We quantified recall error by comparing the r-POEM and d-POEM for 777 patient-weeks collected from 207 patients, and estimated two components of recall error: (1) recall bias due to systematic errors in measurements and (2) recall noise due to random errors in measurements, using a bespoke statistical model.

RESULTS

POEM scores have a relatively low recall bias, but a high recall noise. Recall bias was estimated at 1.2 points lower for the r-POEM on average than the d-POEM, with a recall noise of 5.7 points. For example, a patient with a recall-free POEM of 11 (moderate) could report their POEM score anywhere from 5 to 14 (with 95% probability) because of recall error. Model estimates suggested that patients tend to recall itch and dryness more often than experienced (positive bias of less than 1 day), but less often for the other symptoms (bleeding, cracking, flaking, oozing/weeping and sleep disturbance; negative bias ranging 1-4 days).

CONCLUSIONS

In this clinical trial data set, we found that patients tended to slightly underestimate their symptoms when reporting POEM, with significant variation in how well they were able to recall the frequency of their symptoms every time they reported POEM. A large recall noise should be taken into consideration when interpreting POEM scores.

Choosing the right questions - A systematic review of patient reported outcome measures used in radiotherapy and proton beam therapy

The implementation of PROMs into clinical practice has been shown to improve quality of care. This systematic review aims to identify which PROMs are suitable for implementation within routine clinical practice in a radiotherapy or PBT service.The bibliographic databases MEDLINE, EMBASE and EMCARE were searched. Articles published between 1st January 2008 to 1st June 2023, that reported PROMs being utilised as an outcome measure were included. Inclusion criteria also included being written in English, involving human patients, aged 16 and above, receiving external beam radiotherapy or PBT for six defined tumour sites. PROMs identified within the included articles were subjected to quality assessment using the COSMIN reporting guidelines. Results are reported as per PRISMA guidelines. A total of 268 studies were identified in the search, of which 52 fulfilled the inclusion criteria. The use of 39 different PROMs was reported. The PROMs identified were mostly tumour or site-specific quality of life (n = 23) measures but also included generic cancer (n = 3), health-related quality-of-life (n = 6), and symptom specific (n = 7) measures.None of the PROMs identified received a high GRADE score for good content. There were 13 PROMs that received a moderate GRADE score. The remaining PROMs either had limited evidence of development and validation within the patient cohorts investigated, or lacked relevance or comprehensiveness needed for routine PROMs collection in a radiotherapy or PBT service.This review highlights that there are a wide variety of PROMs being utilised within radiotherapy research, but most lack specificity to radiotherapy side-effects. There is a risk that by using non-specific PROMs in clinical practice, patients might not receive the supportive care that they need.

Hungarian population norms for the 15D generic preference-accompanied health status measure

OBJECTIVES

15D is a generic preference-accompanied health status measure covering a wide range of health areas, including sensory functions. The aim of this study was to establish population norms for the 15D instrument in Hungary.

METHODS

2000 members of the Hungarian adult general population participated in an online cross-sectional survey in August 2021. The sample was broadly representative in terms of gender, age groups, highest level of education, geographical region, and settlement type. Index values were derived using the Norwegian 15D value set. In addition to providing population norms, mean index values were computed for 32 physical and 24 mental health condition groups.

RESULTS

Most respondents (78.7%) reported problems in at least one 15D domain. The most problems were reported with sleeping (50.7%), followed by vitality (49.2%), distress (43.6%), discomfort and symptoms (31.2%), depression (31.1%), sexual activities (29.6%), breathing (28.1%), and vision (27.8%). The mean 15D index value was 0.810. With advancing age categories, the 15D index values showed an inverse U-shaped curve. Generally, mean index values in respondents with mental health conditions were lower [range 0.299 (post-traumatic stress disorder) to 0.757 (smoking addiction)] than those of respondents with physical conditions [range 0.557 (liver cirrhosis) to 0.764 (allergies)].

CONCLUSIONS

This study provided 15D population norms of the Hungarian general population; furthermore, this is the first study to provide population norms for the 15D in any country. The values established in this study can serve as benchmarks for evaluating efficacy outcomes in clinical trials, quantifying disease burden and identifying unmet needs.