Response shift effects in the assessment of urologic cancer patients' quality of life

Androgen deprivation therapy in advanced prostate cancer: insights from a real-world patient survey on health-related quality of life and information and communication sources

PURPOSE

Androgen deprivation therapy (ADT) is a cornerstone treatment for advanced and metastatic prostate cancer. Real-world and patient-reported insights into ADT's impact on health-related quality of life (HRQoL) and communication experiences in healthcare settings remain underexplored. This patient organisation-initiated online survey aimed to assess these aspects.

METHODS

Between December 2022 and August 2023, the patient organisation Think Blue Vlaanderen and the AZ Sint-Jan Hospital (Bruges, Belgium) invited ADT-treated patients to participate in a prospective, online, cross-sectional, patient-reported outcome survey. Demographic, clinical, HRQoL (FACT and EPIC-26), communication sources and information modality data were collected. Descriptive statistics and comparative analyses were applied.

RESULTS

A total of 276/312 (88.5%) participating patients were on ADT at time of survey administration and completion, with the majority receiving a 3-monthly regimen. Sexual HRQoL was low and narrowly distributed (median (IQR): 16.7 (16.7-16.7)), with 84% of patients having erectile dysfunction (ED). Patients finding their ED problematic were more likely to seek pharmaceutical treatment. Hormonal HRQoL was widely distributed (median (IQR): 65 (45-85)), which improved with prolonged ADT duration. Physically active patients reported less lack of energy, but increased hot flashes. Within consistent FACT-G summary scores (median (IQR): 64.50 (54.75-77.00)), improved emotional wellbeing with prolonged ADT was noted. Multidisciplinary communication and multimodal information provision improved patient satisfaction.

CONCLUSION

Patient organisation-initiated surveys offer real-world and patient-reported insights. Patient-tailored HRQoL assessments and longitudinal follow-up, physical activity, and multidisciplinary and multimodal communication approaches are warranted to improve patient-centred care in patients receiving ADT.

Health-related quality of life in men with oligometastatic prostate cancer following metastases-directed stereotactic body radiotherapy: Real-world data from the E2-RADIatE OligoCare cohort

Objective

To evaluate the impact of metastases-directed stereotactic body radiotherapy (SBRT) on health-related quality of life (HRQoL) in men with oligometastatic prostate cancer (PCa) using real-world data from the OligoCare cohort.

Materials and methods

OligoCare is a pragmatic, observational cohort designed to assess the impact of metastases-directed SBRT on patients with oligometastatic disease (OMD). We report an interim analyses of the secondary endpoint HRQoL, assessed using the EORTC QLQ-C30, within six months of metastases-directed SBRT for oligometastatic disease in men with PCa among the first 1600 registered patients. HRQoL data collection was optional within the OligoCare cohort. To compare HRQoL between baseline and first follow-up assessment, a Wilcoxon signed-rank test was used. A multiple linear regression model was used to explore the HRQoL associations with predefined factors.

Results

Out of the 1600 registered patients, 658 were treated for oligometastatic PCa, of which 233 had baseline QoL data and 132 patients had both baseline and follow-up HRQoL data. At baseline, most patients had a WHO performance status of 0 or 1 (87 %), were de-novo oligometastatic (79 %), had one metastasis (90 %), and had a good overall global health status (mean 80.81, SD16.11, IQR 75-92). 51 % received hormonal therapy as concomitant systemic treatment. Patients with comorbidities as assessed by the Charlson Comorbidity index had a worse global health status at baseline (-4.88, 95 % CI:-9.35, -0.42). No clinically meaningful significant difference in global health status was observed at first assessment following SBRT (median 3.0 months) compared with baseline (mean difference 2.27, 95 % CI:-1.54, 6.08). Upon evaluating the proportions, meaningful clinically important differences (a 10-point or more difference) was observed in, 17 % and 11 % of the patients reporting deterioration and improvement of global health status, respectively.

Conclusion

Metastases-directed stereotactic body radiotherapy had no negative impact on global HRQoL within the first six months after treatment.

Response shift results of quantitative research using patient-reported outcome measures: a descriptive systematic review

PURPOSE

The objective of this systematic review was to describe the prevalence and magnitude of response shift effects, for different response shift methods, populations, study designs, and patient-reported outcome measures (PROM)s.

METHODS

A literature search was performed in MEDLINE, PSYCINFO, CINAHL, EMBASE, Social Science Citation Index, and Dissertations & Theses Global to identify longitudinal quantitative studies that examined response shift using PROMs, published before 2021. The magnitude of each response shift effect (effect sizes, R-squared or percentage of respondents with response shift) was ascertained based on reported statistical information or as stated in the manuscript. Prevalence and magnitudes of response shift effects were summarized at two levels of analysis (study and effect levels), for recalibration and reprioritization/reconceptualization separately, and for different response shift methods, and population, study design, and PROM characteristics. Analyses were conducted twice: (a) including all studies and samples, and (b) including only unrelated studies and independent samples.

RESULTS

Of the 150 included studies, 130 (86.7%) detected response shift effects. Of the 4868 effects investigated, 793 (16.3%) revealed response shift. Effect sizes could be determined for 105 (70.0%) of the studies for a total of 1130 effects, of which 537 (47.5%) resulted in detection of response shift. Whereas effect sizes varied widely, most median recalibration effect sizes (Cohen's d) were between 0.20 and 0.30 and median reprioritization/reconceptualization effect sizes rarely exceeded 0.15, across the characteristics. Similar results were obtained from unrelated studies.

CONCLUSION

The results draw attention to the need to focus on understanding variability in response shift results: Who experience response shifts, to what extent, and under which circumstances?

STATIS multivariate three-way method for evaluating quality of life after corneal surgery: Methodology and case study in Costa Rica

Vision-related quality of life (QoL) analyzes the visual function concerning individual well-being based on activity and social participation. Because QoL is a multivariate construct, a multivariate statistical method must be used to analyze this construct. In this paper, we present a methodology based on STATIS multivariate three-way methods to assess the real change in vision-related QoL for myopic patients by comparing their conditions before and after corneal surgery. We conduct a case study in Costa Rica to detect the outcomes of patients referred for myopia that underwent refractive surgery. We consider a descriptive, observational and prospective study. We utilize the NEI VFQ-25 instrument to measure the vision-related QoL in five different stages over three months. After applying this instrument/questionnaire, a statistically significant difference was detected between the perceived QoL levels. In addition, strong correlations were identified with highly similar structures ranging from 0.857 to 0.940. The application of the dual STATIS method found the non-existence of reconceptualization in myopic patients, but a statistically significant recalibration was identified. Furthermore, a real change was observed in all patients after surgery. This finding has not been stated previously due to the limitations of the existing statistical tools. We demonstrated that dual STATIS is a multivariate method capable of evaluating vision-related QoL data and detecting changes in recalibration and reconceptualization.

Detection of response shift in health-related quality of life studies: a systematic review

Background

Response Shift (RS) refers to the idea that an individual may undergo changes in its health-related quality of life (HRQOL). If internal standard, values, or reconceptualization of HRQOL change over time, then answer to the same items by the same individuals may not be comparable over time. Traditional measures to evaluate RS is prone to bias and strong methodologies to study the existence of this phenomenon is required. The objective is to systematically identify, analyze, and synthesize the existing and recent evidence of statistical methods used for RS detection in HRQOL studies.

Methods

The analysis of selected studies between January 2010 and July 2020 was performed through a systematic review in MEDLINE/PubMed, Scopus, Web of Science, PsycINFO and Google Scholar databases. The search strategy used the terms “Health-Related Quality of Life” and “Response Shift” using the filters “Humans”, “Journal Article”, “English” and “2010/01/01–2020/07/31”. The search was made in August 2020.

Results

After considering the inclusion and exclusion criteria, from the total selected articles (675), 107 (15.9%) of the publications were included in the analysis. From these, 79 (71.0%) detected the existence of RS and 86 (80.4%) only used one detection method. The most used methods were Then Test (n = 41) and Oort’s Structural Equation Models (SEM) (n = 35). Other method used were Multiple Lineal Regression (n = 7), Mixed-Effect Regression (n = 6), Latent Trajectory Analysis (n = 6), Item Response Theory (n = 6), Logistics Regression (n = 5), Regression and Classification Trees (n = 4) and Relative Importance Method (n = 4). Most of these detected recalibration, including Then Test (n = 27), followed by Oort’s SEM that detected the higher combination of RS types: recalibration (n = 24), reprioritization (n = 13) and reconceptualization (n = 7).

Conclusions

There is a continuous interest of studying RS detection. Oort’s SEM becomes the most versatile method in its capability for detecting RS in all different types. Despite results from previous systematic reviews, same methods have been used during the last years. We observed the need to explore other alternative methods allowing same detection capacity with robust and highly precise methodology. The investigation on RS detection and types requires more study, therefore new opportunity grows to continue attending this phenomenon through a multidisciplinary perspective.

Longitudinal validity of self-rated health: the presence and impact of response shift

Objective: This paper aimed to examine the longitudinal validity of self-rated health (SRH) and whether it would be affected by possible changes in evaluation standards (i.e., response shift) over time.Design: Data are from a longitudinal survey of a nationally representative sample in China. Analytical sample was restricted to respondents aged 45 and above (n = 15,893). Individual fixed effects models were used to analyze changes in ratings on health anchoring vignettes and self-rated health over time.Main outcome measures: SRH at two time points with a -two-year span.Results: Both SRH and anchoring vignettes ratings displayed changes over a two-year span for all the studied age groups. Compared with the self-assessed change in health ("How would you rate your health as compared to that of last year?"), changes in SRH reported over time displayed a more stable and optimistic pattern. SRH responded to doctor diagnosed chronic disease and changes in functional limitation, before and after adjusting for evaluation standards.Conclusion: SRH is responsive to the newly diagnosed chronic disease and functional limitation, regardless of whether we consider response shift within the same respondents over time.

Do patients suffering from chronic diseases retrospectively overestimate how healthy they were before they fell ill?

Background/Objective: To examine the impact of a disease on a person's subjective health state, patients are often asked to assess their current health state and to retrospectively assess how healthy they were before they fell ill. The objective of this study was to test whether patients generally overestimated the quality of their pre-disease health. Method: Six samples of patients with chronic diseases (cancer patients, cardiovascular patients, and patients diagnosed with sarcoidosis, N between 197 and 1,197) were analyzed. The patients assessed their current health states and their health states at the time before diagnosis. The retrospective scores were compared with matched data from general population studies. Results: In three of the six studies, the retrospective health ratings of the patients were significantly higher than the general population norms (effect sizes between 0.24 and 0.46), two studies yielded nonsignificant effects, and in one study there was an opposite trend. The general overestimation of pre-disease health was more pronounced in older patients as compared with younger ones, and it was more pronounced when global health/quality of life was to be assessed. Conclusions: Retrospective assessments of pre-disease health states are not appropriate for assessing disease-related changes in a person's health state.

Critical examination of current response shift methods and proposal for advancing new methods

Purpose

This work is part of an international, interdisciplinary initiative to synthesize research on response shift in results of patient-reported outcome measures. The objective is to critically examine current response shift methods. We additionally propose advancing new methods that address the limitations of extant methods.

Methods

Based on literature reviews, this critical examination comprises design-based, qualitative, individualized, and preference-based methods, latent variable models, and other statistical methods. We critically appraised their definition, operationalization, the type of response shift they can detect, whether they can adjust for and explain response shift, their assumptions, and alternative explanations. Overall limitations requiring new methods were identified.

Results

We examined 11 methods that aim to operationalize response shift, by assessing change in the meaning of one’s self-evaluation. Six of these methods distinguish between change in observed measurements (observed change) and change in the construct that was intended to be measured (target change). The methods use either (sub)group-based or individual-level analysis, or a combination. All methods have underlying assumptions to be met and alternative explanations for the inferred response shift effects. We highlighted the need to address the interpretation of the results as response shift and proposed advancing new methods handling individual variation in change over time and multiple time points.

Conclusion

No single response shift method is optimal; each method has strengths and limitations. Additionally, extra steps need to be taken to correctly interpret the results. Advancing new methods and conducting computer simulation studies that compare methods are recommended to move response shift research forward.

Supplementary Information

The online version of this article (10.1007/s11136-020-02755-4) contains supplementary material, which is available to authorized users.

Associations between self-rated health and the assessments of anchoring vignettes in cardiovascular patients

Background/Objective

Assessments of health can be biased by response shift effects. One method for detecting such effects is the use of anchoring vignettes. The aim of this study was to analyze the relationship between participants' self-assessed health state and their assessments of these vignettes.

Method

A total of 342 cardiovascular patients assessed their own state of health on a 0-100 visual analogue scale. The patients additionally assessed two vignettes featuring fictional persons suffering from specific complaints. A sample of the general population (N = 1,236) served as controls.

Results

The participants rated the health state of the vignette character featuring physical problems as being significantly better than the general population did (effect size: d = 0.53). The group difference in the assessment of the vignette featuring primarily mental health problems was lower (d = -0.17). Participants' assessments of the vignettes were positively correlated with their assessments of their own health state (r = .26 and r = .10) and with several quality of life variables.

Conclusions

Anchoring vignettes are a useful tool for detecting response shift effects.