Advancing quality-of-life research by deepening our understanding of response shift: a unifying theory of appraisal

Evaluation of the Oral Hygiene Ability Instrument (OHAI): Test of reliability

OBJECTIVES

To evaluate the reliability of the new Oral Hygiene Ability Instrument (OHAI) developed to assess the cause of any inability for older adults to manage oral hygiene self-care. Oral hygiene is an important part of oral health. The inability to manage oral hygiene, combined with other risk factors, often results in poor oral health and impaired quality of life. A reliable OHAI could benefit preventive oral health care.

METHODS

The preliminary OHAI uses 33 items in three parts: (I) interview, (II) clinical examination and (III) observation of oral hygiene activities. A total of 37 older adults participated in a test-retest study of Part I. Inclusion criteria were age ≥ 65 years, have at least one tooth and be able to oral hygiene self-care. The intra- and inter-rater reliability of parts II and III used films and photographs of OHAI assessments of 15 different individuals. These films/photographs were assessed twice by four dental professionals who had participated in the OHAI data collection. For statistical analyses of the reliability, per cent agreement, Krippendorff's alpha and E. Svensson's method were used.

RESULTS

The test-retest for Part I items showed acceptable-to-good agreement and no systematic disagreement. In Part II, two items showed somewhat limited reliability. Part III showed good intra- and inter-rater reliability.

CONCLUSION

The OHAI items seem stable and reliable for the intended sample, and the instrument may be a valuable tool to identify older adults at risk of impaired oral health. However, two items may need to be reformulated.

Mental health after lumbar spine surgery: cognitive appraisal processes and outcome in a longitudinal cohort study

BACKGROUND CONTEXT

A not uncommon finding following spine surgery is that many patients do not achieve mental health improvement up to population norms for their age cohort, despite improvement in pain and functioning.

PURPOSE

This study examined how patients who were categorized as depressed versus not depressed think about health-related quality of life as assessed by cognitive-appraisal processes. It examined cross-sectional and longitudinal differences over 12 months postsurgery.

DESIGN

Prospective longitudinal cohort study with data collected at presurgery and at ∼3- and ∼12-months postsurgery from August 2013 to August 2023.

PATIENT SAMPLE

We included 173 adults undergoing lumbar spine surgery for degenerative spinal conditions at an academic medical center. The study sample was 47% female, with a mean age of 61 (SD=15.0), and a median level of education of college graduate.

OUTCOME MEASURES

Depression was defined as a Mental Component Score (MCS)≤38 on the Rand-36, building on studies that equated MCS scores with significant depression as assessed by clinically validated depression scales. The Quality-of-Life Appraisal Profile assessed the cognitive-appraisal domains of Experience Sampling and Standards of Comparison.

METHODS

The analysis focused on two comparisons: cross-sectionally comparing those who were not depressed (n=82) to those who were depressed (n=77) at baseline; and comparing longitudinal trajectories among those depressed before surgery and improved (n=54) versus did not improve (n=23). T-tests characterized group differences in appraisal endorsement; analysis of variance evaluated appraisal items in terms of explained variance; and Pearson correlation coefficients assessed direction of association in predicting mental health.

RESULTS

There were presurgical and longitudinal differences in both cognitive appraisal domains. Before surgery, depressed patients were less likely than nondepressed patients to endorse emphasizing the positive; more likely to focus on worst moments, recent flare-ups, their spinal condition, and the future; and more likely to compare themselves to high aspirations (eg, perfect health). Over time, among those who were depressed before surgery, those who improved focused decreasingly on worst moments and on the time before their spinal condition, and increasingly on emphasizing the positive and balancing the positives/negatives. Appraisal explained more variance in mental health among those who did not improve as compared to those who did, at all timepoints. All appraisal items were more highly correlated with mental health among those who remained depressed as compared to those who improved, particularly over time.

CONCLUSIONS

Endorsement of cognitive appraisal processes was different for depressed versus nondepressed spine-surgery patients before surgery and distinguished those who were depressed before surgery and improved versus those who did not improve. These findings suggest that targeted interventions could be beneficial for addressing mental health concerns during the spine surgery recovery trajectory. These interventions might use appraisal measures to identify patients likely to remain depressed after surgery, and then focus on helping these patients shift their focus and standards of comparison.

Differential Utility Losses in Herpes Zoster Cases Between Vaccinated and Unvaccinated Subjects: A Meta-analysis of Three Clinical Trials

BACKGROUND AND OBJECTIVE

Recombinant zoster vaccine (RZV) is approved in adults for the prevention of herpes zoster. The effect of RZV in moderating the severity of breakthrough cases of herpes zoster has been noted but not explicitly quantified before. In this study, a meta-analysis was undertaken to estimate differential utility losses between unvaccinated (Placebo) and vaccinated (RZV) subjects in breakthrough cases of herpes zoster from three RZV clinical trials.

METHODS

Differential utility losses between the two groups were estimated in units of quality-adjusted life-years (QALYs), leveraging aggregate patient data from the ZOE-50 (NCT01165177), ZOE-70 (NCT01165229), and ZOE-HSCT (NCT01610414) clinical trials. Differential utility losses and the ratio of mean utility losses were analyzed using random-effects and fixed-effects meta-regression models.

RESULTS

The mean QALY loss differences between the unvaccinated (Placebo) and vaccinated (RZV) groups were 0.008, 0.004, and 0.011 in the ZOE-50, ZOE-70, and ZOE-HSCT studies, respectively, yielding an overall estimated difference of 0.007 (95% confidence interval 0.002-0.012) QALYs. Quality-adjusted life-year loss in the vaccinated group was estimated to be 35.5% of the value in the placebo group. A sensitivity analysis estimated an overall difference of 0.005 (95% confidence interval 0.001-0.009) QALYs, corresponding to 48.6% of the QALY loss value in the placebo group.

CONCLUSIONS

Recombinant zoster vaccine is effective in alleviating disease severity in breakthrough cases of herpes zoster. The results may be useful in distinguishing QALY losses between vaccinated and unvaccinated cohorts in health economics studies, particularly cost-effectiveness analyses.

Measuring reconceptualization and reprioritization during France's first COVID-19-related lockdown in women with and without a history of cancer: an adaptation of the SeiQol-DW and PGI

PURPOSE

This study aimed to provide a better understanding of the patient-perceived effects of France's first COVID-19-related lockdown on the quality of life (QoL) of women affected by cancer, and to test an ad hoc measurement scale for evaluating quasi-individualized QoL. QoL was measured for both during (i.e., current) and before (i.e., retrospectively) the lockdown. Respondents were women registered on the research platform Seintinelles.

METHODS

A tool for measuring quasi-individualized QoL was adapted from the SeiQol-DW and PGI. It was distributed as part of a larger online self-questionnaire to a sample of 1303 women with a history of cancer (i.e., former or current) and with no such history.

RESULTS

Current and retrospective QoL scores were not significantly different between the two respondent groups. An analysis of reconceptualization and reprioritization revealed a cancer-specific effect: women with a history of cancer reconceptualized more, while women with no such history reprioritized more.

CONCLUSION

Our novel ad hoc quasi-qualitative tool made it possible to assess the QoL of women with a history of cancer, a particularly vulnerable population in the context of the COVID-19 pandemic. Furthermore, it highlighted a difference in reconceptualization and reprioritization between this population and women with no such history.

Individual differences in the long-term impact of the pandemic: moderators of COVID-related hardship, worry, and social support

PURPOSE

Understanding people's response to the pandemic needs to consider individual differences in priorities and concerns. The present study sought to understand how individual differences in cognitive-appraisal processes might moderate the impact of three COVID-specific factors-hardship, worry, and social support-on reported depression.

METHODS

This longitudinal study of the psychosocial impact of the COVID-19 pandemic included 771 people with data at three timepoints over 15.5 months. Participants were recruited from panels of chronically ill or general population samples. Depression was measured by an item response theory validated depression index created using items from existing measures that reflected similar content to the Patient Health Questionnaire-8. COVID-specific factors of hardship, worry, and social support were assessed with items compiled by the National Institutes of Health. The Quality of Life Appraisal Profilev2 Short-Form assessed cognitive appraisal processes. A series of random effects models examined whether appraisal moderated the effects of hardship, worry, and social support on depression over time.

RESULTS

Over time the association between low social support and depression was greater (p = 0.0181). Emphasizing the negative was associated with exacerbated depression, in particular for those with low social support (p = 0.0007). Focusing on demands and habituation was associated with exacerbated depression unless one experienced greater hardship (p = 0.0074). There was a stronger positive connection between recent changes and depression for those people with higher worry scores early in the pandemic as compared to later, but a stronger positive correlation for those with lower worry scores later in the pandemic (p = 0.0015). Increased endorsement of standards of comparison, emphasizing the negative, problem goals, and health goals was associated with worse depression scores (all p < 0.0001). People who were younger, disabled, or had greater difficulty paying bills also reported worse depression (p < 0.0001, 0.0001, and 0.002, respectively).

CONCLUSION

At the aggregate level, COVID-specific stressors changed over the course of the pandemic, whereas depression and social-support resources seemed stable. However, deeper analysis revealed substantial individual differences. Cognitive-appraisal processes showed considerable variability across individuals and moderated the impact of COVID-specific stressors and resources over time. Future work is needed to investigate whether coaching individuals away from maladaptive cognitive-appraisal processes can reduce depression and lead to better overall well-being.

Depression trajectories during the COVID-19 pandemic: a secondary analysis of the impact of cognitive-appraisal processes

PURPOSE

This study characterized depression trajectories during the COVID pandemic and investigated how appraisal and changes in appraisal over time related to these depression trajectories.

METHODS

This longitudinal study of the psychosocial impact of the COVID-19 pandemic included 771 people with data at three timepoints over 15.5 months. The depression index was validated using item-response-theory methods and receiver-operating-characteristic curve analysis. The Quality of Life (QOL) Appraisal Profile_v2 Short-Form assessed cognitive-appraisal processes. Sequence analysis characterized depression-trajectory groups, and random effects models examined appraisal main effects, appraisal-by-group, and appraisal-by-group-by-time interactions.

RESULTS

Sequence analysis generated six trajectory groups: Stably Well (n = 241), Stably Depressed (n = 299), Worsening (n = 79), Improving (n = 83), Fluctuating Pattern 1 (No-Yes-No; n = 41), and Fluctuating Pattern 2 (Yes-No-Yes; n = 28). While all groups engaged in negative appraisal processes when they were depressed, the Stably Depressed group consistently focused on negative aspects of their life. Response-shift effects were revealed such that there were differences in the appraisal-depression relationship over time for standards of comparison and recent changes for the Stably Depressed, and in health goals for those Getting Better.

CONCLUSION

The present work is, to our knowledge, the first study of response-shift effects in depression. During these first 15.5 pandemic months, group differences highlighted the connection between negative appraisals and depression, and response-shift effects in these relationships over time. Egregious life circumstances may play a lesser role for the Stably Depressed but a greater role for people who have transient periods of depression as well as for those with improving trajectories (i.e., endogenous vs. reactive depression). How one thinks about QOL is intrinsically linked to mental health, with clear clinical implications.

Quality of life and ability to work of patients with Post-COVID syndrome in relation to the number of existing symptoms and the duration since infection up to 12 months: a cross-sectional study

PURPOSE

Following SARS-CoV-2 virus infection, patients may suffer from long-lasting symptoms regardless of disease severity. Preliminary results show limitations in health-related quality of life (HRQoL). The aim of this study is to show a possible change depending on the duration since infection and the accumulation of symptoms. Additionally, other possible influencing factors will be analyzed.

METHODS

The study population consisted of patients (18-65 years) presenting to the Post-COVID outpatient clinic of the University Hospital Jena, Germany, between March and October 2021. The HRQoL was assessed by the use of the RehabNeQ and the SF-36. Data analysis was descriptive with frequencies, means, and/or percentages. In addition, a univariate analysis of variance was performed to show the dependence of physical and psychological HRQoL on specific factors. This was finally tested for significance at an alpha level of 5%.

RESULTS

Data from 318 patients were analyzed, most of whom had 3-6 months of infection (56%) and 5-10 symptoms persisted (60.4%). Both mental (MCS) and physical sum score (PCS) of HRQoL were significantly lower than those of the German normal population (p < .001). The number of remaining symptoms (MCS p = .0034, PCS p = .000) as well as the perceived ability to work (MCS p = .007, PCS p = .000) influenced the HRQoL.

CONCLUSION

The HRQoL of patients with Post-COVID-syndrome is still reduced months after infection and so is their occupational performance. In particular, the number of symptoms could have an influence on this deficit, which would need to be further investigated. Further research is needed to detect other factors influencing HRQoL and to implement appropriate therapeutic interventions.

Impact of comorbidities on people with and without cancer early in the COVID-19 pandemic: An observational study

BACKGROUND

The present study sought to investigate how comorbidity burden influences cancer survivors' quality of life (QoL) and the challenges/adaptations during the coronavirus disease 2019 (COVID) pandemic, and to examine how appraisal processes are related to this impact.

METHODS

This cross-sectional study, administered in spring/summer 2020, compared cancer survivors to a general-population comparison sample. QoL was assessed with standardized tools. COVID-specific questions included selected items compiled by the US National Institutes of Health, and cognitive appraisal processes were assessed using the QoL Appraisal Profilev2 Short-Form. Principal components analysis reduced the number of comparisons. Multivariate analysis of covariance investigated group differences in QoL, COVID-specific variables, and cognitive-appraisal processes. Linear regression investigated group differences in COVID-specific variables as a function of cognitive-appraisal processes, QoL, demographic covariates, and their interactions.

RESULTS

Cancer survivors fared substantially better than non-cancer participants in QoL and cognitive functioning when they had no other comorbidities, but substantially worse on QoL when they had three or more comorbidities. Cancer survivors with no comorbidities were less likely to feel worried about COVID, less likely to engage in self-protection, and prioritized engaging in problem-focused and prosocial actions compared to non-cancer participants. Conversely, cancer survivors confronted with multiple comorbidities exhibited more proactive self-protection and experienced more anxiety about the pandemic.

CONCLUSION

The impact of having multiple comorbidities in the context of cancer is associated with notable differences in social determinants of health, QoL outcomes, COVID-specific challenges/adaptations, and appraisal of QoL. These findings provide an empirical basis for implementing appraisal-based coping interventions.

Increased Effect Sizes in a Mindfulness- and Yoga-Based Intervention After Adjusting for Response Shift with Then-Test

Objectives

Response shift refers to variations in self-reported evaluations at different times from changes in one’s internal standards, values, and meanings. The current study explored the utility of the then-test to detect a potential mindfulness-based response shift occurrence during a mindfulness- and yoga-based intervention for student musicians, and to ascertain to what extent effect sizes could differ when adjusting for it.

Method

Participants (n = 31) completed the Five Facet Mindfulness Questionnaire (FFMQ) halfway through the intervention (Time 1-FFMQ), post-intervention (Time 2-FFMQ), and immediately after Time 2-FFMQ with a then-test approach that asked participants to rate the FFMQ based on retrospective reflections on their mindfulness at Time 1 (then-test-FFMQ). Paired t-tests and Hedges’ g effect sizes were computed to estimate three potential effects: response shift (Time 1-FFMQ minus then-test-FFMQ), the conventional intervention effect (Time 2-FFMQ minus Time 1-FFMQ), and the effect after adjusting for response shift (i.e., actual intervention effect = Time 2-FFMQ minus then-test-FFMQ).

Results

Response shift was significant for the FFMQ Observe subscale (g = 0.41) and total scale (g = 0.37). The adjusted scores in all subscales (Observe, g = 0.47; Describe, g = 0.25; Act Aware, g = 0.40; Non-judge, g = 0.28; Non-react, g = 0.57) and total scale (g = 0.60) achieved significance and yielded larger effect sizes than the conventional results, for which only Act Aware (g = 0.28), Non-react (g = 0.36), and total scale (g = 0.28) were significant.

Conclusions

Notwithstanding some methodological limitations, this study lends support to the utility of the then-test to quantify response shift. When adjusting for it, effect sizes from a mindfulness- and yoga-based intervention were generally amplified.

Preregistration

This study was not preregistered.

Implications of the syntheses on definition, theory, and methods conducted by the Response Shift - in Sync Working Group

PURPOSE

Our aim is to advance response shift research by explicating the implications of published syntheses by the Response Shift - in Sync Working Group in an integrative way and suggesting ways for improving the quality of future response shift studies.

METHODS

Members of the Working Group further discussed the syntheses of the literature on definitions, theoretical underpinnings, operationalizations, and response shift methods. They outlined areas in need of further explication and refinement, and delineated additional implications for future research.

RESULTS

First, the proposed response shift definition was further specified and its implications for the interpretation of results explicated in relation to former, published definitions. Second, the proposed theoretical model was further explained in relation to previous theoretical models and its implications for formulating research objectives highlighted. Third, ways to explore alternative explanations per response shift method and their implications for response shift detection and explanation were delineated. The implications of the diversity of the response shift methods for response shift research were presented. Fourth, the implications of the need to enhance the quality and reporting of the response shift studies for future research were sketched.

CONCLUSION

With our work, we intend to contribute to a common language regarding response shift definitions, theory, and methods. By elucidating some of the major implications of earlier work, we hope to advance response shift research.

Measurement invariance in the social sciences: Historical development, methodological challenges, state of the art, and future perspectives

This review summarizes the current state of the art of statistical and (survey) methodological research on measurement (non)invariance, which is considered a core challenge for the comparative social sciences. After outlining the historical roots, conceptual details, and standard procedures for measurement invariance testing, the paper focuses in particular on the statistical developments that have been achieved in the last 10 years. These include Bayesian approximate measurement invariance, the alignment method, measurement invariance testing within the multilevel modeling framework, mixture multigroup factor analysis, the measurement invariance explorer, and the response shift-true change decomposition approach. Furthermore, the contribution of survey methodological research to the construction of invariant measurement instruments is explicitly addressed and highlighted, including the issues of design decisions, pretesting, scale adoption, and translation. The paper ends with an outlook on future research perspectives.

The Functional External Memory Aid Tool Version 2.0: A How-To Clinical Guide

PURPOSE

Although compensatory cognitive rehabilitation is a common treatment approach for adults with cognitive-communication disorders, there are few assessment tools available to support clinicians in developing person-centered treatment plans. In addition to understanding a client's cognitive and functional abilities, it is also important to understand how they compensate for their weaknesses, specifically with external aids (e.g., calendars, notes), in everyday life. The Functional External Memory Aid Tool (FEMAT) is a performance-based measure that quantifies and describes external aid use during task completion.

METHOD

The purpose of this clinical focus article is to educate and equip clinicians to administer and interpretate the FEMAT with adult clients with cognitive-communication disorders. This clinical focus article describes the theoretical motivation for the FEMAT as well as the administration, scoring, and interpretation procedures for Version 2.0 of the measure. A hypothetical case example is included to illustrate how to use the FEMAT to develop person-centered goals and treatment plans.

CONCLUSIONS

The FEMAT is psychometrically sound, clinically relevant, free, easily accessible, and quick to administer and provides data that are complementary to data obtained from traditional performance-based and/or patient-reported measures. This clinical focus article describes new resources that are available to help clinicians administer and interpret Version 2.0 of the FEMAT when serving adults with cognitive-communication disorders.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21651311.

Listening to the elephant in the room: response-shift effects in clinical trials research

Background

While a substantial body of work postulates that adaptation (response-shift effects) may serve to hide intervention benefits, much of the research was conducted in observational studies, not randomized-controlled trials. This scoping review identified all clinical trials that addressed response shift phenomena, and characterized how response-shift effects impacted trial findings.

Methods

A scoping review was done of the medical literature from 1968 to 2021 using as keywords “response shift” and “clinical trial.” Articles were included if they were a clinical trial that explicitly examined response-shift effects; and excluded if they were not a clinical trial, a full report, or if response shift was mentioned only in the discussion. Clinical-trials papers were then reviewed and retained in the scoping review if they focused on randomized participants, showed clear examples of response shift, and used reliable and valid response-shift detection methods. A synthesis of review results further characterized the articles’ design characteristics, samples, interventions, statistical power, and impact of response-shift adjustment on treatment effect.

Results

The search yielded 2148 unique references, 25 of which were randomized-controlled clinical trials that addressed response-shift effects; 17 of which were retained after applying exclusion criteria; 10 of which were adequately powered; and 7 of which revealed clinically-important response-shift effects that made the intervention look significantly better.

Conclusions

These findings supported the presumption that response shift phenomena obfuscate treatment benefits, and revealed a greater intervention effect after integrating response-shift related changes. The formal consideration of response-shift effects in clinical trials research will thus not only improve estimation of treatment effects, but will also integrate the inherent healing process of treatments.

Key points

This scoping review supported the presumption that response shift phenomena obfuscate treatment benefits and revealed a greater intervention effect after integrating response-shift related changes.

The formal consideration of response-shift effects in clinical trials research will not only improve estimation of treatment effects but will also integrate the inherent healing process of treatments.

Cognitive Processes during Recovery: Moving toward Personalized Spine Surgery Outcomes

This paper focuses on a novel application of personalized medicine: the ways one thinks about health (i.e., appraisal processes) as relevant predictors of spine-surgery response. This prospective longitudinal cohort study (n = 235) investigated how appraisal processes relate to outcomes of spinal decompression and/or fusion surgery, from pre-surgery through one-year post-surgery. Patient-reported outcomes assessed spine-specific disability (Oswestry Disability Index (ODI)), mental health functioning (Rand-36 Mental Component Score (MCS)), and cognitive appraisal processes (how people recall past experiences and to whom they compare themselves). Analysis of Variance examined the appraisal-outcomes association in separate models at pre-surgery, 3 months, and 12 months. We found that appraisal processes explained less variance at pre-surgery than later and were differentially relevant to health outcomes at different times in the spine-surgery recovery trajectory. For the ODI, recall of the seriousness of their condition was most prominent early in recovery, and comparing themselves to positive standards was most prominent later. For the MCS, not focusing on the negative aspects of their condition and/or on how others see them was associated with steady improvement and higher scores at 12 months. Appraisal processes are relevant to both spine-specific disability and mental-health functioning. Such processes are modifiable objects of attention for personalizing spine-surgery outcomes.

Appraisal and patient-reported outcomes following total hip arthroplasty: a longitudinal cohort study

Background

Total hip arthroplasty (THA) is a successful procedure that provides pain relief, restores function, and improves quality of life (QOL) for patients with advanced arthritis in their hip joint. To date, little research has examined the role of cognitive appraisal processes in THA outcomes. This study examined the role of cognitive appraisal processes in THA outcomes in the first year post-surgery.

Methods

This longitudinal cohort study collected data at pre-surgery, 6 weeks post-surgery, 3 months post-surgery, and 12 months post-surgery. Adults (n = 189) with a primary diagnosis of osteoarthritis were consecutively recruited from an active THA practice at a Canadian academic teaching hospital. Measures included the Hip Disability and Osteoarthritis Outcome Score (HOOS), the Mental Component Score (MCS) of the Rand-36, and the Brief Appraisal Inventory (BAI). Analysis of Variance examined the association between BAI items and the HOOS or MCS scores. Random effects models investigated appraisal main effects and appraisal-by-time interactions for selected BAI items.

Results

HOOS showed great improvement over the first 12 months after THA, and was mitigated by three appraisal processes in particular: focusing on problems with healthcare or living situation, and preparing one’s family for health changes. MCS was stable and low over time, and the following appraisal processes were implicated by very large effect sizes: not comparing themselves to healthier people, focusing on money problems, preparing their family for their health changes, or trying to shed responsibilities.

Conclusions

Appraisal processes are relevant to health outcomes after THA, with different processes coming into play at different points in the recovery trajectory.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41687-022-00498-z.

The Effect of Noninvariance on the Estimation of the Mediated Effect in the Two-Wave Mediation Model

The two-wave mediation model is the most suitable model for examining mediation effects in a randomized intervention and includes measures taken at pretest and posttest. When using self-report measures, the meaning of responses may change for the treatment group over the course of the intervention and result in noninvariance across groups at posttest, a phenomenon referred to as response shift. We investigate how the mediated effect would be impacted by noninvariance when using sum scores (i.e., assuming invariance). In a Monte Carlo simulation study, the magnitude and proportion of items that had noninvariant intercepts, the direction of noninvariance, number of items, effect size of the mediated effect and sample size were varied. Results showed increased Type I and Type II errors due to a biased estimate of the intervention effect on the mediator resulting from noninvariance. Thus, measurement noninvariance could lead to erroneous conclusions about the process underlying the intervention.

Quality of life in a randomized trial comparing two neoadjuvant regimens for locally advanced rectal cancer-INCAGI004

BACKGROUND

Neoadjuvant chemoradiotherapy (neoCRT) followed by surgery is the standard of care for locally advanced rectal cancer (LARC), but the emergence of different drug regimens may result in different response rates. Good clinical response translates into greater sphincter preservation, but quality of life (QOL) may be impaired after treatment due to chemoradiotherapy and surgical side effects.

OBJECTIVE

To prospectively evaluate the impact of clinical response and surgical resection on QOL in a randomized trial comparing two different neoCRT regimens.

METHODS

Stage II and III rectal cancer patients were randomized to receive neoCRT with either capecitabine (group 1) or 5-Fu and leucovorin (group 2) concomitant to long-course radiotherapy. Clinical downstaging was accessed using MRI 6-8 weeks after treatment. EORTCs QLQ-C30 and CR38 were applied before treatment (T0), after neoCRT (T1), after rectal resection (T2), early after adjuvant chemotherapy (T3), and 1 year after the end of treatment or stoma closure (T4). The Wexner scale was used for fecal incontinence evaluation at T4. A C30SummaryScore (Geisinger and cols.) was calculated to compare QOL results.

RESULTS

Thirty-two patients were assigned to group 1 and 31 to group 2. Clinical downstaging occurred in 70.0% of group 1 and 53.3% of group 2 (p = 0.288), and sphincter preservation was 83.3% in group 1 and 80.0% in group 2 (p = 0.111). No significant difference in QOL was detected when comparing the two treatment groups after neoCRT using QLQ-C30. However, the CR38 module detected differences in micturition problems (15.3 points), gastrointestinal problems (15.3 points), defecation problems (11.8 points), and sexual satisfaction (13.3 points) favoring the capecitabine group. C30SummaryScore detected significant improvement comparing T0 to T1 and deterioration comparing T1 to T2 (p = 0.025). The mean Wexner scale score was 9.2, and a high score correlated with symptoms of diarrhea and defecation problems at T4.

CONCLUSIONS

QOL was equivalent between groups after neoCRT except for micturition problems, gastrointestinal problems, defecation problems, and sexual satisfaction favoring the capecitabine arm after. The overall QOL using the C30SummaryScore was improved after neoCRT, but decreased following rectal resection, returning to basal levels at late evaluation. Fecal incontinence was high after sphincter preservation.

TRIAL REGISTRATION

ClinicalTrials.gov Identifier: NCT03428529.

Drivers of caregiver impact in Duchenne muscular dystrophy: a cohort study

Background

In our companion paper, we addressed the interplay between caregiver impact, out-of-pocket expenditures, and Duchenne Muscular Dystrophy (DMD) disability. We found that DMD caregiver impact could be characterized by four Latent Profile Analysis impact profiles: lowest, lower middle, upper middle, and highest impact. The impact on caregivers was often but not always worse with greater out-of-pocket expenditures. Further, while the lowest-, lower-middle, and highest-impact profiles reflected low, moderate and high disability-related caregiver burden, respectively, the upper-middle profile group was quite variable in level of disability across domains. To better understand the four caregiver-impact profiles, we examine how a comprehensive set of psychosocial factors differentiate the four profile groups.

Methods

Psychosocial factors assessed included demographic characteristics, quality of life (QOL), stress, cognitive appraisal, reserve-building, and general and COVID-specific resilience. Linear modeling examined relationships between impact profiles and psychosocial factors. We used effect size rather than p-value as the criterion for determining relevance of the broad range of characteristics examined.

Results

Multivariate analyses implicated stress and environmental mastery, appraisal sampling of experience, COVID-specific variables, appraisal standards of comparison, appraisal goals, demographics, appraisal combinatory algorithm, reserve-building, and resilience, in order of prominence (average eta² = 0.29, 0.29, 0.16, 0.15, 0.09, 0.07, 0.07, 0.06, 0.05, and 0.02, respectively). On the whole, comparisons of highest-versus-lowest impact profiles revealed more and larger differences than comparisons of upper-middle versus lower-middle impact profiles. Life stress, goals, and reserve-building activities had a smaller differentiating effect in the middle groups.

Conclusion

A more comprehensive ‘story’ about DMD caregiver impact involves life stress, environmental mastery, COVID-specific variables, and cognitive and behavioral factors. Implications are discussed for coaching interventions to support DMD caregivers.

If it's information, it's not "bias": a scoping review and proposed nomenclature for future response-shift research

BACKGROUND

The growth in response-shift methods has enabled a stronger empirical foundation to investigate response-shift phenomena in quality-of-life (QOL) research; but many of these methods utilize certain language in framing the research question(s) and interpreting results that treats response-shift effects as "bias," "noise," "nuisance," or otherwise warranting removal from the results rather than as information that matters. The present project will describe the various ways in which researchers have framed the questions for investigating response-shift issues and interpreted the findings, and will develop a nomenclature for such that highlights the important information about resilience reflected by response-shift findings.

METHODS

A scoping review was done of the QOL and response-shift literature (n = 1100 articles) from 1963 to 2020. After culling only empirical response-shift articles, raters characterized how investigators framed and interpreted study research questions (n = 164 articles).

RESULTS

Of 10 methods used, papers using four of them utilized terms like "bias" and aimed to remove response-shift effects to reveal "true change." Yet, the investigators' reflections on their own conclusions suggested that they do not truly believe that response shift is error to be removed. A structured nomenclature is proposed for discussing response-shift results in a range of research contexts and response-shift detection methods.

CONCLUSIONS

It is time for a concerted and focused effort to change the nomenclature of those methods that demonstrated this misinterpretation. Only by framing and interpreting response shift as information, not bias, can we improve our understanding and methods to help to distill outcomes with and without response-shift effects.

Norm-based comparison of the quality-of-life impact of ravulizumab and eculizumab in paroxysmal nocturnal hemoglobinuria

Aims

Paroxysmal nocturnal hemoglobinuria (PNH) is a rare and life-threatening intravascular hematologic disorder with significant morbidity and premature mortality. Clinical trials (NCT02946463 and NCT03056040) comparing ravulizumab with eculizumab for PNH have supported the non-inferiority of the former and similar safety and tolerability. This secondary analysis compared PNH trial participants after 26 weeks on either treatment (n = 438) to a general-population sample (GenPop) (n = 15,386) and investigated response-shift effects.

Methods

Multivariate analysis of covariance (MANCOVA) investigated function and symptom scores on the European Organisation for Research and Treatment of Cancer (EORTC) QLQ-C30 of people with PNH as compared to GenPop, after covariate adjustment. Risk-factor groups were created based on clinical indicators known to be associated with worse PNH outcomes, and separate MANCOVAs were computed for lower- and higher-risk-factor groups. Differential item functioning (DIF) analyses examined whether item response varied systematically (1) by treatment, (2) compared to GenPop, and (3) over time, the latter two suggesting and reflecting response-shift effects, respectively. DIF analyses examined 24 items from scales with at least two items. Recalibration response shift was operationalized as uniform DIF over time, reflecting the idea that, for a given group, the difficulty of endorsing an item changes over time, after adjusting for the total subscale score. Reprioritization response shift was operationalized as non-uniform DIF over time, i.e., the relative difficulty of endorsing an item over time changes across the total domain score.

Results

Across PNH risk-factor levels, people who had been on either treatment for 26 weeks reported better-than-expected functioning and lower symptom burden compared to GenPop. Ravulizumab generally showed larger effect sizes. Results were similar for lower and higher PNH risk factors, with slightly stronger effects in the former. DIF analyses revealed no treatment DIF, but did uncover group DIF (9 items with uniform DIF, and 11 with non-uniform) and DIF over time (7 items with uniform DIF, and 3 with non-uniform).

Conclusions

This study revealed that people with PNH on ravulizumab or eculizumab for 26 weeks reported QOL levels better than those of the general population. Significant effects of DIF by group and DIF over time support recalibration and reprioritization response-shift effects. These findings suggest that the treatments enabled adaptive changes.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13023-021-02016-8.

Creating idiometric short-form measures of cognitive appraisal: balancing theory and pragmatics

BACKGROUND

The Rapkin and Schwartz appraisal theory and measure provided a path toward documenting response-shift effects and describing individual differences in ways of thinking about quality of life (QOL) that distinguished people in different circumstances. Recent work developed and validated the QOL Appraisal Profile_{version 2} (QOLAP_v2), an 85-item measure that taps response-shift-detection domains of Frame of Reference, Standards of Comparison, Sampling of Experience, and Combinatory Algorithm. Recent theoretical work proposed that appraisal measurement constitutes a new class of measurement (idiometric), distinct from psychometric and clinimetric. To validate an idiometric measure, one would document that its items reflect different circumstances and population characteristics, and explain variance in QOL. The present work sought to develop idiometric short-forms of the QOLAP_v2 item bank by examining which items were most informative, retaining the appraisal-domain structure.

METHODS

This secondary analysis (n = 1481) included chronically-ill patients and their caregivers from a longitudinal web-based survey (mean follow-up 16.6 months). Data included the QOLAP_v2, the Center for Disease Control Healthy Days Core Module, the PROMIS-10 Global Health, and demographic/medical variables. Appraisal items were measured at baseline (relevant to understanding cognitive appraisal processes); and with change scores (sensitive to response-shift effects). Multivariate analysis of covariance examined what demographic and health-status change variables were reflected by each of 85 appraisal items (in five sets), as dependent variables, and other demographic/medical variables. Multiple linear regression examined how appraisal items explained variance in global physical- and mental-health change, after covariate adjustment. A tally summarized item performance across all five sets of cross-sectional and longitudinal analyses.

RESULTS

The vast majority (i.e., 80%) of the QOLAP_v2 items performed well across the analyses presented. Using a relatively strict criterion of explaining meaningful variance across 60% of analyses, one would retain 68 items. A more lenient criterion (40%) would retain 71.

CONCLUSIONS

The present study provides heuristics to support investigators' creating 'discretionary' QOLAP_v2 short-forms to fit their study aim and amplifying individual differences in the cognitive processes underlying QOL. This approach enables adapting the measure to the study population, as per the expectation that respondent populations differ in the predominant cognitive processes used.

"Looking Under the Hood" of Anchor-Based Assessment of Clinically Important Change: A Machine Learning Approach

OBJECTIVES

The Global Assessment of Change (GAC) item has facilitated the interpretation of change in patient-reported outcomes, providing an anchor for computing minimally important differences. Construct validity has been documented via disease-specific patient-reported outcomes change. We examined what domains, sociodemographic characteristics, attributions of change, and cognitive-appraisal processes are reflected in GAC ratings.

METHODS

This secondary analysis examined data from 1,481 chronically ill patients and caregivers surveyed at baseline and 17 months. Items queried change since baseline in overall disease symptoms (GAC) and in physical, emotional, and social functioning. Candidate predictors included sociodemographic factors, health-related quality-of-life domains, change attributions, and quality-of-life appraisal processes. Least absolute shrinkage and selection operator and bootstrapping tested 77 predictors' effectiveness and stability.

RESULTS

GAC worsening was notably associated with being disabled (β = -0.24) and having difficulty paying bills (β = -0.13). GAC was better explained by the physical domain than the emotional or social (β = 0.67, 0.10, and 0.03, respectively; R²_adj = 0.63) after sociodemographic-covariate adjustment. In a separate model (R²_adj = 0.18), GAC variance was explained by attributions about changing health and changing response of one's health team, goals related to solving healthcare problems and maintaining activities, and appraisal about things getting better (β = -0.14, 0.08, -0.07, 0.05, 0.21, respectively; p_range ~0.0005-0.05) after adjustment.

CONCLUSIONS

The GAC primarily reflects the physical domain, and the GAC reflects attributions, goals, and patterns of emphasis related to change in health and healthcare. Commonly unmeasured factors have some bearing on GAC scores and can facilitate the interpretation of change.

Patient factors that matter in predicting spine surgery outcomes: a machine learning approach

OBJECTIVE

There is an increasing recognition of the importance of predictive analytics in spine surgery. This, along with the addition of personalized treatment, can optimize treatment outcomes. The goal of this study was to examine the value of clinical, demographic, expectation, and cognitive appraisal variables in predicting outcomes after surgery.

METHODS

This prospective longitudinal cohort study followed adult patients undergoing spinal decompression and/or fusion surgery for degenerative spinal conditions. The authors focused on predicting the numeric rating scale (NRS) for pain, based on past research finding it to be the most responsive of the spine patient-reported outcomes. Clinical data included type of surgery, adverse events, comorbidities, and use of pain medications. Demographics included age, sex, employment status, education, and smoking status. Data on expectations related to pain relief, ability to do household and exercise/recreational activities without pain, preventing future disability, and sleeping comfort. Appraisal items addressed 22 cognitive processes related to quality of life (QOL). LASSO (least absolute shrinkage and selection operator) and bootstrapping tested predictors hierarchically to determine effective predictive subsets at approximately 10 months postsurgery, based on data either at baseline (model 1) or at approximately 3 months (model 2).

RESULTS

The sample included 122 patients (mean age 61 years, with 53% being female). For model 1, analysis revealed better outcomes with patients expecting to be able to exercise or do recreational activities, focusing on recent events, and not focusing on how others see them (mean bootstrapped R2 [R2boot] = 0.12). For model 2, better outcomes were predicted by expecting symptom relief, focusing on the positive and on one's spinal condition (mean R2boot = 0.38). Bootstrapped analyses documented the stability of parameter estimates despite the small sample.

CONCLUSIONS

Nearly 40% of the variance in spine outcomes was accounted for by cognitive factors, after adjusting for clinical and demographic factors. Different expectations and appraisal processes played a role in long- versus short-range predictions, suggesting that cognitive adaptation is important and relevant to pain relief outcomes after spine surgery. These results underscore the importance of addressing how people think about QOL and surgery outcomes to maximize the benefits of surgery.

Development of a Pediatric Dermatology Screening Tool Based on Two Parent-Reported Skin Symptoms: Comparison of Parental Recognition and Physician Diagnosis of Skin Symptoms of Infants and Toddlers

Aim

The objective of the present study was to develop a tool for mothers to assess their children’s skin condition with the ultimate goal of its wider use in general health checkups for infants and toddlers.

Methods

This was a single-institution, cross-sectional study in Japan, targeting parents of 200 infants and toddlers who visited a dermatology clinic between December 2018 and March 2019. The parents completed a self-administered survey of the mother’s perception of her child’s dermatological symptoms, itchiness, and sleep status, and a quality-oflife assessment, using a nine-question version of the Quality of life in Primary Caregivers of children with Atopic Dermatitis questionnaire (QP9). The attending physician was asked to complete a form about the child’s dermatological condition and the treatment prescribed. The severity of the dermatological condition noted by the physician was compared with the combined response to the 3 perception items (dermatological condition, itchiness, and sleep) reported by the parents, in order to identify the optimal cutoff score.

Results

Of 200 parent questionnaires distributed, 198 (99% response rate) were returned and analyzed, along with the responses from 198 physician records (100% response rate). The optimal cutoff score was 2/3 for the total score (range 0-6) for 2 items, itchiness and sleep status (sensitivity 73%, specificity 64%). There was a significant difference in QP9 scores between the 2 groups categorized by the cutoff score

Conclusions

A pediatric dermatological screening tool based on 2 symptoms reported by the parents of children with atopic dermatitis was developed, and its precision and criterion-related validity were confirmed. This simple tool could help parents become better aware of their children’s skin condition and allow healthcare workers to provide adequate skin care advice. This practical tool could be widely applicable in primary child care and public health service settings.

Quality of life in patients with nonvalvular atrial fibrillation treated with oral anticoagulants

OBJECTIVES

Health-related quality of life (HRQL) is a key factor in making anticoagulant treatment decisions. The objective of this study was to assess the HRQL of patients with nonvalvular atrial fibrillation by treatment type: direct oral anticoagulants (DOACs) or vitamin K antagonists (VKAs).

METHODS

We carried out a cross-sectional observational study with clinical practice data, gathering demographic and clinical variables. HRQL was measured using the 5-level 5-dimension EuroQol questionnaire (EQ-5D-5L). Differences between the study groups in HRQL as measured by the EQ-5D-5L were analyzed using two-part multivariate regression models. First, using logistic regression, the adjusted probability, p(x), of having perfect health was estimated in each subgroup. Secondly, generalized linear models were used to estimate mean disutility values, w(x), in a population that does not have perfect health, i.e. utility less than 1 or 1-w(x).

RESULTS

We recruited 333 patients, of whom 126 were on DOACs and 207 on VKAs. A significant difference was observed in the EQ-5D-5L anxiety/depression dimension, with a higher percentage of patients classified in the 'no problems' category in the DOAC group. The same type of analysis did not identify significant differences in any of the other dimensions (mobility, self-care, usual activities or pain/discomfort).

DISCUSSION

In the multivariate model, utility was significantly higher in the DOAC group than in the VKA group, although the difference was small (0.0121). This difference is attributable to patients on DOACs having less anxiety/depression.

CONCLUSION

Patients treated with DOACs report a slightly better quality of life than those treated with VKAs.

Response shift in patient-reported outcomes: definition, theory, and a revised model

Purpose

The extant response shift definitions and theoretical response shift models, while helpful, also introduce predicaments and theoretical debates continue. To address these predicaments and stimulate empirical research, we propose a more specific formal definition of response shift and a revised theoretical model.

Methods

This work is an international collaborative effort and involved a critical assessment of the literature.

Results

Three main predicaments were identified. First, the formal definitions of response shift need further specification and clarification. Second, previous models were focused on explaining change in the construct intended to be measured rather than explaining the construct at multiple time points and neglected the importance of using at least two time points to investigate response shift. Third, extant models do not explicitly distinguish the measure from the construct. Here we define response shift as an effect occurring whenever observed change (e.g., change in patient-reported outcome measures (PROM) scores) is not fully explained by target change (i.e., change in the construct intended to be measured). The revised model distinguishes the measure (e.g., PROM) from the underlying target construct (e.g., quality of life) at two time points. The major plausible paths are delineated, and the underlying assumptions of this model are explicated.

Conclusion

It is our hope that this refined definition and model are useful in the further development of response shift theory. The model with its explicit list of assumptions and hypothesized relationships lends itself for critical, empirical examination. Future studies are needed to empirically test the assumptions and hypothesized relationships.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-021-02846-w.

Detecting response shift in health-related quality of life measurement among patients with hypertension using structural equation modeling

BACKGROUND

Outcomes derived from longitudinal self-reported health-related quality of life measures can be confounded by response shift. This study was aimed to detect response shift among patients with hypertension attending a community-based disease management program.

METHODS

240 consecutive consulting or follow-up patients with diagnosed hypertension were recruited. The Short Form 36-item Health Survey was self-administered at 12 community health service stations at baseline and four weeks after attending the program. The 4-step structural equation modeling approach assessed response shift.

RESULTS

Data from 203 (84.6%) patients were eligible for analyses (mean age 65.9 ± 10.8 years, 46.3% female). The results showed uniform recalibration of social functioning ([Formula: see text](1) = 22.98, P < 0.001), and non-uniform recalibration of role limitations due to physical problems ([Formula: see text](1) = 8.84, P = 0.003), and bodily pain ([Formula: see text](1) = 17.41, P < 0.001). The effects of response shift on social functioning were calculated as "small" (effect-size = 0.35), but changed the observed changes from improvement (effect-size = 0.25) to slight deterioration (effect-size = -0.10). After accounting for the response shift effect, the general physical health of participants was improved (effect-size = 0.37), while deterioration (effect-size = -0.21) in the general mental health was also found.

CONCLUSIONS

Recalibration existed among patients with hypertension attending the disease management program. The interventions in the program might act as a catalyst that induced the response shift. We conclude that response shift should be considered in hypertension research with longitudinal health-related quality of life data.

Psycholinguistic features, design attributes, and respondent-reported cognition predict response time to patient-reported outcome measure items

Purpose

Patient-reported outcome measures (PROMs) vary in their psycholinguistic complexity. This study examined whether response time to PROM items is related to psycholinguistic attributes of the item and/or the self-reported cognitive ability of the respondent.

Methods

Baseline data from Wave 2 of the Quality of Life in Neurological Disorders (Neuro-QoL) development study were reanalyzed. That sample contained 581 adults with neurological disorders and whose self-reported cognitive abilities were quantified by the Neuro-QoL v2.0 Cognitive Function Item Bank. 185 Neuro-QoL items were coded for several psycholinguistic variables and design attributes: number of words and syllables, mean imageability of words, mean word frequency, mean age of word acquisition, and response format (e.g., about symptom frequency or task difficulty). Data were analyzed with linear and generalized linear mixed models.

Results

Main effects models revealed that slower response times were associated with respondents with lower self-reported cognitive abilities and with PROM items that contained more syllables, less imageable (e.g., more abstract) words, and that asked about task difficulty rather than symptom frequency. Interaction effects were found between self-reported cognition and those same PROM attributes such that people with worse self-reported cognitive abilities were disproportionately slow when responding to items that were longer (more syllables), contained less imageable words, and asked about task difficulty.

Conclusion

Completing a PROM requires multiple cognitive skills (e.g., memory, executive functioning) and appraisal processes. Response time is a means of operationalizing the amount or difficulty of cognitive processing, and this report indicates several aspects of PROM design that relate to a measure’s cognitive burden. However, future research with better experimental control is needed.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-021-02778-5.

Using structural equation modeling to investigate change and response shift in patient-reported outcomes: practical considerations and recommendations

BACKGROUND

Patient-reported outcomes (PROs) are of increasing importance for health-care evaluations. However, the interpretation of change in PROs may be obfuscated due to changes in the meaning of the self-evaluation, i.e., response shift. Structural equation modeling (SEM) is the most widely used statistical approach for the investigation of response shift. Yet, non-technical descriptions of SEM for response shift investigation are lacking. Moreover, application of SEM is not straightforward and requires sequential decision-making practices that have not received much attention in the literature.

AIMS

To stimulate appropriate applications and interpretations of SEM for the investigation of response shift, the current paper aims to (1) provide an accessible description of the SEM operationalizations of change that are relevant for response shift investigation; (2) discuss practical considerations in applying SEM; and (3) provide guidelines and recommendations for researchers who want to use SEM for the investigation and interpretation of change and response shift in PROs.

CONCLUSION

Appropriate applications and interpretations of SEM for the detection of response shift will help to improve our understanding of response shift phenomena and thus change in PROs. Better understanding of patients' perceived health trajectories will ultimately help to adopt more effective treatments and thus enhance patients' wellbeing.

Response shift in results of patient-reported outcome measures: a commentary to The Response Shift-in Sync Working Group initiative

PURPOSE

The Working Group undertook a critical, comprehensive synthesis of the response shift work to date. We aimed to (1) describe the rationale for this initiative; (2) outline how the Working Group operated; (3) summarize the papers that comprise this initiative; and (4) discuss the way forward.

METHODS

Four interdisciplinary teams, consisting of response shift experts, external experts, and new investigators, prepared papers on (1) definitions and theoretical underpinnings, (2) operationalizations and response shift methods, (3) implications for healthcare decision-making, and (4) on the published magnitudes of response shift effects. Draft documents were discussed during a two-day meeting. Papers were reviewed by all members.

RESULTS

Vanier and colleagues revised the formal definition and theory of response shift, and applied these in an amended, explanatory model of response shift. Sébille and colleagues conducted a critical examination of eleven response shift methods and concluded that for each method extra steps are required to make the response shift interpretation plausible. Sawatzky and colleagues created a framework for considering the impact of response shift on healthcare decision-making at the level of the individual patient (micro), the organization (meso), and policy (macro). Sajobi and colleagues are conducting a meta-analysis of published response shift effects. Preliminary findings indicate that the mean effect sizes are often small and variable across studies that measure different outcomes and use different methods.

CONCLUSION

Future response shift research will benefit from collaboration among diverse people, formulating alternative hypotheses of response shift, and conducting the most conclusive studies aimed at testing these (falsification).

Response shift in health-related quality of life measures in the presence of formative indicators

Background

Response shift (RS) has been defined as a change in the meaning of an individual’s self-evaluation that needs to be accounted for when assessing longitudinal changes in health-related quality of life (HRQoL). RS detection through structural equation modeling is accomplished by adopting Oort’s procedure based on a measurement model in which the observed variables are defined as reflective indicators of the HRQoL latent variable; that is, the latent variable causes the variation in the reflective indicators. This study aims to propose a procedure that assesses RS when formative indicators are used in measuring HRQoL; in this last case, the latent variable is considered to be a function of some formative indicators. A secondary aim is to compare the new procedure with Oort’s procedure to highlight similarities and differences.

Methods

The data were retrieved from a consecutive series of 258 patients newly diagnosed with colorectal cancer and undergoing chemotherapy and/or surgery. The European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QOL-C30) was administered twice, once before and once six months after treatment. Structural equation modeling was used to evaluate RS and true change with the newly proposed method (in which fatigue and pain were defined as formative indicators) and with Oort’s procedure (in which fatigue and pain were defined as reflective indicators).

Results

According to the new procedure, there was no measurement bias, and on average, patients’ quality of life improved by 3.53 points (on a scale ranging from 0 to 100) at the 6-month follow-up. With Oort’s procedure, the loading of the pain indicator was not invariant across the two time points, suggesting the presence of reprioritization, whereas the estimation of true change was very similar to the previous one: 3.87.

Conclusions

RS and true change in HRQoL can be evaluated in the presence of formative indicators. Defining a measurement model by formative or reflective indicators can lead to different results.

Response-shift effects in neuromyelitis optica spectrum disorder: estimating response-shift-adjusted scores using equating

Background

In our companion paper, random intercept models (RIMs) investigated response-shift effects in a clinical trial comparing Eculizumab to Placebo for people with neuromyelitis optica spectrum disorder (NMOSD). RIMs predicted Global Health using the EQ-5D Visual Analogue Scale item (VAS) to encompass broad criteria that people might consider. The SF36™v2 mental and physical component scores (MCS and PCS) helped us detect response shift in VAS. Here, we sought to “back-translate” the VAS into the MCS/PCS scores that would have been observed if response shift had not been present.

Methods

This secondary analysis utilized NMOSD clinical trial data evaluating the impact of Eculizumab in preventing relapses (n = 143). Analyses began by equating raw scores from the VAS, MCS, and PCS, and computing scores that removed response-shift effects. Correlation analysis and descriptive displays provided a more comprehensive examination of response-shift effects.

Results

MCS and PCS crosswalks with VAS equated the scores that include and exclude response-shift effects. These two sets of scores had low shared variance for MCS for both groups, suggesting that corresponding mental health constructs were substantially different. The shared variance contrast for physical health was distinct only for the Placebo group. The larger MCS response-shift effects were found at end of study for Placebo only and were more prominent at extremes of the MCS score distribution.

Conclusions

Our results reveal notable treatment group differences in MCS but not PCS response shifts, which can explain null results detected in previous work. The method introduced herein provides a way to provide further information about response-shift effects in clinical trial data.

Does oral health-related quality of life of patients after solid organ transplantation indicate a response shift? Results of a systematic review

BACKGROUND

The physical oral health and dental behaviour of patients after solid organ transplantation (SOT) has repeatedly been reported as insufficient. The objective of this systematic review was to detect whether the oral health-related quality of life (OHRQoL) of patients after SOT is reduced compared to that of healthy individuals.

METHODS

A systematic literature search was performed by two independent individuals based on the PubMed, Web of Science and Scopus databases by using the following search terms: "transplantation" AND "oral health-related quality of life". The findings were checked to determine eligibility, whereby publication prior to 31 October 2020, examination of adult patients (age at least 18 years) with SOT, reporting of an OHRQoL outcome and full text in English language were the prerequisites for inclusion in the qualitative analysis. Quality appraisal of the included studies was performed using the Agency for Healthcare Research and Quality methodology checklist.

RESULTS

Seven of 25 studies that examined patients after kidney (3), heart (2), liver (1) and lung transplantation (1) were included. Four studies included healthy controls, and five studies included a cohort of patients before transplantation for comparison. Clinical oral health examinations were heterogeneous between groups. The majority of studies (5/7) applied the short form of the "Oral Health Impact Profile" (OHIP 14) to assess OHRQoL. The OHIP 14 values ranged between 1.7 and 8.9 across studies, indicating an unaffected or just slightly reduced OHRQoL. Only one study found better OHRQoL in patients after SOT compared to a group before SOT, and one study confirmed worse OHRQoL of SOT recipients compared to a healthy control. Only two studies revealed an association between OHRQoL and oral health parameters. Furthermore, two studies each found a relationship between OHRQoL and general health-related quality of life or disease-related parameters.

CONCLUSIONS

Patients after SOT show an unaffected or only slightly reduced OHRQoL, which was mainly independent of the insufficient oral status. This might indicate a shift in the perception threshold for oral diseases and conditions caused by the general health burden related to the SOT.

Response-shift effects in neuromyelitis optica spectrum disorder: a secondary analysis of clinical trial data

Background

Researchers have long posited that response-shift effects may obfuscate treatment effects. The present work investigated possible response-shift effects in a recent clinical trial testing a new treatment for Neuromyelitis Optica Spectrum Disorder (NMOSD). This pivotal trial provided impressive support for the drug Eculizumab in preventing relapse, but less strong or null results as the indicators became more subjective or evaluative. This pattern of results suggests that response-shift effects are present.

Methods

This secondary analysis utilized data from a randomized, double-blind trial evaluating the impact of Eculizumab in preventing relapses in 143 people with NMOSD. Treatment arm and then relapse status were hypothesized ‘catalysts’ of response shift in two series of analyses. We devised a “de-constructed” version of Oort structural-equation modeling using random-effects modeling for use in small samples. This method begins by testing an omnibus response-shift hypothesis and then, pending a positive result, implements a series of random-effects models to elucidate specific response-shift effects.

Results

In the omnibus test, the ‘standard quality-of-life (QOL) model’ captured substantially less well the experience of placebo as compared to Eculizumab group. Recalibration and reconceptualization response-shift effects were detected. Detected relapse-related response shifts included recalibration, reprioritization, and reconceptualization.

Conclusions

Trial patients experienced response shifts related to treatment- and relapse-related experiences. Published trial results likely under-estimated Eculizumab vs. Placebo differences due to recalibration and reconceptualization, and relapse effects due to recalibration, reprioritization, and reconceptualization. This novel random-effects- model application builds on response-shift theory and provides a small-sample method for better estimating treatment effects in clinical trials.

Electronic supplementary material

The online version of this article (10.1007/s11136-020-02707-y) contains supplementary material, which is available to authorized users.

Capturing patient experience: does quality-of-life appraisal entail a new class of measurement?

Background

Two decades of research on quality-of-life (QOL) appraisal have demonstrated links between patient experience and health outcomes and have accounted for both intra-individual change and inter-individual differences in a wide range of research contexts. The present work investigates patterns across diagnostic and demographic groupings to demonstrate how population-specific circumstances drive the structure of QOL appraisal.

Methods

This secondary analysis (N = 6448) utilized data from six patient groups: spine surgery, multiple sclerosis, heterogeneous chronically ill, heterogeneous cancer, bladder cancer, and human immunodeficiency virus (HIV). We explored patterns of inter-item correlation across patient samples, using items from the Standards of Comparison and Sampling of Experience subsections of the QOL Appraisal Profile v1 and v2. Similar matrices were compared by demographic characteristics.

Results

Patterns of inter-item correlations for Standards of Comparison items varied sharply across disease groups and racial groups while being similar across age, gender, and education levels. Inter-item correlation matrices for Sampling of Experience items revealed marked differences among disease groups and educational and racial categories but were similar across age and gender groups.

Conclusions

Appraisal parameters showed evidence of shared and unique aspects across samples and circumstances, findings which make sense in light of sample differences in health status and demographic influences. Tools to assess patient experience and meaning may be best understood as idiometric instruments. We discuss their distinctions from psychometric and clinimetric tools at theoretical, statistical, and applied levels.

Supplementary information

Supplementary information accompanies this paper at 10.1186/s41687-020-00254-1.

Understanding haemophilia caregiver burden: does appraisal buffer the impact of haemophilia on caregivers over time?

Objective: The present work investigated haemophilia caregiver and patient characteristics associated with change in negative and positive aspects of caregiving. Design: Web-based survey data were collected from haemophilia A or B caregivers at baseline and two years later. Main Outcome Measures: Outcomes included Burden Summary and Positive Emotions change scores from the Haemophilia Caregiver Impact measure. Results: The sample included 323 caregivers (71% response rate; mean age 40, 90% female). Brief Appraisal Inventory Principal Components Analysis with varimax rotation yielded five scores: Awareness of Challenges, Fulfillment and Growth, Stay Positive, Social Comparison, and Interpersonal Problem-Solving. Regression analyses revealed that caregivers with more health conditions, who care for patients with increased bleeds and worse pain, and who focused more on Awareness of Challenges, Social Comparisons, and Interpersonal Problem-Solving reported worsened burden over follow-up (Adj. R² = 0.37). Prioritisation of Stay[ing] Positive and reduced emphasis on Interpersonal Problem-Solving were associated with increased Positive Emotions (Adj. R² = 0.32). Conclusion: Caregivers who focused less on a life unfettered by caregiving, comparing themselves to others, and interpersonal problem-solving and more on staying positive reported reductions in burden and improvements in positive emotions. These findings could translate to multicomponent psychoeducational interventions to help caregivers buffer haemophilia's impact.

Social inequalities in health-related quality of life among people aging with HIV/AIDS: the role of comorbidities and disease severity

PURPOSE

While socioeconomic inequalities in health-related quality of life are well documented in the scientific literature, research has neglected to look into the reasons for these inequalities. The purpose of this study is to determine in what way social inequalities in health-related quality of life among patients with the same chronic disease could be explained by variations in disease severity.

METHODS

We used the data of 748 people aging with HIV in Germany who took part in the nationwide study 50plushiv and provided self-report data on socioeconomic status, health-related quality of life (SF-12) and various markers of disease severity (comorbidity, falls, late presentation and AIDS diagnosis). Regression analyses were applied to determine the impact of SES on HRQOL after adjusting for disease severity variables.

RESULTS

The mental and physical subscales of the SF-12, comorbidity burden and falls were significantly related to SES. SES explained 7% of the variance in PCS scores and 3% of the variance in MCS scores after adjusting for age and time since diagnosis. Markers of disease severity explained 33% of the variance in PCS scores and 14% of the variance in MCS scores. After adjusting for disease severity SES was still significantly related to PCS and MCS scores.

CONCLUSIONS

The diverse sample of people aging with HIV showed social inequalities regarding HRQOL and most of the disease severity markers. SES was significantly related to mental and physical HRQOL after adjusting for disease severity. Possible explanations for this phenomenon are discussed.