An item response theory analysis of an item pool for the recovering quality of life (ReQoL) measure

A scoping review to create a framework for the steps in developing condition-specific preference-based instruments de novo or from an existing non-preference-based instrument: use of item response theory or Rasch analysis

BACKGROUND

There is no widely accepted framework to guide the development of condition-specific preference-based instruments (CSPBIs) that includes both de novo and from existing non-preference-based instruments. The purpose of this study was to address this gap by reviewing the published literature on CSPBIs, with particular attention to the application of item response theory (IRT) and Rasch analysis in their development.

METHODS

A scoping review of the literature covering the concepts of all phases of CSPBI development and evaluation was performed from MEDLINE, Embase, PsychInfo, CINAHL, and the Cochrane Library, from inception to December 30, 2022.

RESULTS

The titles and abstracts of 1,967 unique references were reviewed. After retrieving and reviewing 154 full-text articles, data were extracted from 109 articles, representing 41 CSPBIs covering 21 diseases or conditions. The development of CSPBIs was conceptualized as a 15-step framework, covering four phases: 1) develop initial questionnaire items (when no suitable non-preference-based instrument exists), 2) establish the dimensional structure, 3) reduce items per dimension, 4) value and model health state utilities. Thirty-nine instruments used a type of Rasch model and two instruments used IRT models in phase 3.

CONCLUSION

We present an expanded framework that outlines the development of CSPBIs, both from existing non-preference-based instruments and de novo when no suitable non-preference-based instrument exists, using IRT and Rasch analysis. For items that fit the Rasch model, developers selected one item per dimension and explored item response level reduction. This framework will guide researchers who are developing or assessing CSPBIs.

OUTdoor Swimming as a nature-based Intervention for DEpression (OUTSIDE): study protocol for a feasibility randomised control trial comparing an outdoor swimming intervention to usual care for adults experiencing mild to moderate symptoms of depression

BACKGROUND

Depression is common and the prevalence increasing worldwide; at least 1 in 10 people will experience depression in their lifetime. It is associated with economic costs at the individual, healthcare and societal level. Recommended treatments include medication and psychological therapies. However, given the long waiting times, and sometimes poor concordance and engagement with these treatments, a greater range of approaches are needed. Evidence for the potential of outdoor swimming as an intervention to support recovery from depression is emerging, but randomised controlled trials (RCTs) evaluating clinical and cost-effectiveness are lacking. This study seeks to investigate the feasibility of conducting a definitive superiority RCT, comparing an 8-session outdoor swimming course offered in addition to usual care compared to usual care only, in adults who are experiencing mild to moderate symptoms of depression. Feasibility questions will examine recruitment and retention rates, acceptability of randomisation and measures, and identify the primary outcome measure that will inform the sample size calculation for a definitive full-scale RCT. This study will also explore potential facilitators and barriers of participation through evaluation questionnaires, focus-group discussions and interviews.

METHODS/DESIGN

To address these aims and objectives, a feasibility superiority RCT with 1:1 allocation will be undertaken. We will recruit 88 participants with mild to moderate symptoms of depression through social prescribing organisations and social media in three sites in England. Participants will be randomised to either (1) intervention (8-session outdoor swimming course) plus usual care or (2) usual care only. Both groups will be followed up for a further 8 weeks.

DISCUSSION

If findings from this feasibility RCT are favourable, a fully powered RCT will be conducted to investigate the clinical- and cost-effectiveness of the intervention. Findings from the definitive trial will provide evidence about outdoor swimming for depression for policymakers and has the potential to lead to greater choice of interventions for adults experiencing symptoms of depression.

TRIAL REGISTRATION

Current controlled trial registration number is ISRCTN 90851983 registered on 19 May 2022.

Translation and linguistic validation of the Swedish recovering quality of life (ReQoL) - A brief research report

In research and among clinicians, the focus has shifted from mainly symptom reduction and increasing functionality to a more recovery-oriented focus. Although there are instruments measuring recovery, there has been a lack of instruments sensitive enough to measure the quality of life for people with severe mental health disorders. Therefore, this study aimed to obtain a Swedish version of the Recovering Quality of Life (ReQoL) questionnaire adhering to best practice guidelines using various steps of translation, linguistic validation, and cognitive debriefing. The cognitive debriefing was conducted with seven participants, and all felt the items in the questionnaire were relevant to their health, apprehensible, and easy to complete. However, some issues were raised regarding wording and the concepts behind certain items. All feedback was considered, and some items were revised in response to criticism after continuous discussions. A Swedish version of ReQoL now exists, and although there is a need for ReQoL in different clinical research settings in Sweden, further research is required to psychometrically test the construct validity as well as reliability of the Swedish version in Sweden.

An Investigation of Age-Related Differential Item Functioning in the EQ-5D-5L Using Item Response Theory and Logistic Regression

OBJECTIVES

In economic evaluations, quality of life is measured using patient-reported outcome measures (PROMs), such as the EQ-5D-5L. A key assumption for the validity of PROMs data is measurement invariance, which requires that PROM items and response options are interpreted the same across respondents. If measurement invariance is violated, PROMs exhibit differential item functioning (DIF), whereby individuals from different groups with the same underlying health respond differently, potentially biasing scores. One important group of healthcare consumers who have been shown to have different views or priorities over health is older adults. This study investigates age-related DIF in the EQ-5D-5L using item response theory (IRT) and ordinal logistic regression approaches.

METHODS

Multiple-group IRT models were used to investigate DIF, by assessing whether older adults aged 65+ years and younger adults aged 18 to 64 years with the same underlying health had different IRT parameter estimates and expected item and EQ-5D-5L level sum scores. Ordinal logistic regression was also used to examine whether DIF resulted in meaningful differences in expected EQ level sum scores. Effect sizes examined whether DIF indicated meaningful score differences.

RESULTS

The anxiety/depression item exhibited meaningful DIF in both approaches, with older adults less likely to report problems. Pain/discomfort and mobility exhibited DIF to a lesser extent.

CONCLUSIONS

When using the EQ-5D-5L to evaluate interventions and make resource allocation decisions, scoring bias due to DIF should be controlled for to prevent inefficient service provision, where the most cost-effective services are not provided, which could be detrimental to patients and the efficiency of health budgets.

Investigation of physical activity, sleep, and mental health recovery in treatment resistant depression (TRD) patients receiving repetitive transcranial magnetic stimulation (rTMS) treatment

Background

Repetitive transcranial magnetic stimulation (rTMS) is effective in treating depression; however, the effect on physical activity, sleep and recovery is unclear. This study investigated rTMS effect on physical activity and sleep through providing patients with a Fitbit and software apps; and reports the impact of rTMS on depression, anxiety and mental health recovery.

Methods

Study design was a pre and post data collection without a control, with twenty-four participants with treatment-resistant depression (TRD). Measures used were Fitbit activity and sleep data, and patient-rated Recovering Quality of Life (ReQoL-20), Patient Health Questionnaire (PHQ-9) and Generalised Anxiety Disorder (GAD-7).

Results

Response and remission rates were, respectively: 34.8% and 39% for PHQ-9; 34.8% and 47.8% for GAD-7. ReQoL-20 response and reliable improvement were 29.4% and 53%. PHQ-9, GAD-7 and ReQol-20 scores significantly improved, with large effect sizes. Analysis of Fitbit activity and sleep data yielded non-significant results. The Fitbit data machine learning model classified two levels of depression to 82% accuracy.

Limitations

rTMS treatment was open-label and adjunct to existing antidepressant medication. No control group. Female patients were overrepresented.

Conclusions

Improvements on the ReQoL-20 and aspects of sleep and activity indicate the positive impact of rTMS on the individual's real world functioning and quality of life. A wearable activity tracker can provide feedback to patients and clinicians on sleep, physical activity and depression levels. Further research could be undertaken through a sufficiently powered RCT comparing rTMS versus rTMS with use of a Fitbit, its software applications, and sleep and physical activity advice.

Estimating a Preference-Based Index for Mental Health From the Recovering Quality of Life Measure: Valuation of Recovering Quality of Life Utility Index

BACKGROUND

There are increasing concerns about the appropriateness of generic preference-based measures to capture health benefits in the area of mental health.

OBJECTIVES

The aim of this study is to estimate preference weights for a new measure, Recovering Quality of Life (ReQoL-10), to better capture the benefits of mental healthcare.

METHODS

Psychometric analyses of a larger sample of mental health service users (n = 4266) using confirmatory factor analyses and item response theory were used to derive a health state classification system and inform the selection of health states for utility assessment. A valuation survey with members of the UK public representative in terms of age, sex, and region was conducted using face-to-face interviewer administered time-trade-off with props. A series of regression models were fitted to the data and the best performing model selected for the scoring algorithm.

RESULTS

The ReQoL-Utility Index (UI) classification system comprises 6 mental health items and 1 physical health item. Sixty-four health states were valued by 305 participants. The preferred model was a random effects model, with significant and consistent coefficients and best model fit. Estimated utilities modeled for all health states ranged from -0.195 (state worse than dead) to 1 (best possible state).

CONCLUSIONS

The development of the ReQoL-UI is based on a novel application of item response theory methods for generating the classification system and selecting health states for valuation. Conventional time-trade-off was used to elicit utility values that are modeled to enable the generation of QALYs for use in cost-utility analysis of mental health interventions.