Implications of the syntheses on definition, theory, and methods conducted by the Response Shift - in Sync Working Group

PURPOSE

Our aim is to advance response shift research by explicating the implications of published syntheses by the Response Shift - in Sync Working Group in an integrative way and suggesting ways for improving the quality of future response shift studies.

METHODS

Members of the Working Group further discussed the syntheses of the literature on definitions, theoretical underpinnings, operationalizations, and response shift methods. They outlined areas in need of further explication and refinement, and delineated additional implications for future research.

RESULTS

First, the proposed response shift definition was further specified and its implications for the interpretation of results explicated in relation to former, published definitions. Second, the proposed theoretical model was further explained in relation to previous theoretical models and its implications for formulating research objectives highlighted. Third, ways to explore alternative explanations per response shift method and their implications for response shift detection and explanation were delineated. The implications of the diversity of the response shift methods for response shift research were presented. Fourth, the implications of the need to enhance the quality and reporting of the response shift studies for future research were sketched.

CONCLUSION

With our work, we intend to contribute to a common language regarding response shift definitions, theory, and methods. By elucidating some of the major implications of earlier work, we hope to advance response shift research.

Housing First for homeless people with severe mental illness: extended 4-year follow-up and analysis of recovery and housing stability from the randomized Un Chez Soi d'Abord trial

AIMS

Housing First (HF), a recovery-oriented approach, was proven effective in stabilising housing situations of homeless individuals with severe mental disorders, yet had limited effectiveness on recovery outcomes on a short-term basis compared to standard treatment. The objective was to assess the effects of the HF model among homeless people with high support needs for mental and physical health services on recovery, housing stability, quality of life, health care use, mental symptoms and addiction issues on 4 years of data from the Un Chez Soi d'Abord trial.

METHODS

A multicentre randomised controlled trial was conducted from August 2011 to April 2018 with intent-to-treat analysis in four French cities: Lille, Marseille, Paris and Toulouse. Participants were homeless or precariously-housed patients with a DSM-IV-TR diagnosis of bipolar disorder or schizophrenia. Two groups were compared: the HF group (n = 353) had immediate access to independent housing and support from the assertive community treatment team; the Treatment-As-Usual (TAU) group (n = 350) had access to existing support and services. Main outcomes were personal recovery (Recovery Assessment Scale (RAS) scale), housing stability, quality of life (S-QoL), global physical and mental status (Medical Outcomes Study 36-item Short Form Health Survey (SF-36)), inpatient days, mental symptoms (Modified Colorado Symptom Index (MCSI)) and addictions (Mini International Neuropsychiatric Interview (MINI) and Alcohol Use Disorders Identification Test (AUDIT)). Mixed models using longitudinal and cluster designs were performed and adjusted to first age on the street, gender and mental disorder diagnosis. Models were tested for time × group and site × time interactions.

RESULTS

The 703 participants [123 (18%) female] had a mean age of 39 years (95% CI 38.0-39.5 years). Both groups improved RAS index from baseline to 48 months, with no statistically significant changes found between the HF and TAU groups over time. HF patients exhibited better autonomy (adjusted β = 2.6, 95% CI 1.2-4.1) and sentimental life (2.3, 95% CI 0.5-4.1), higher housing stability (28.6, 95% CI 25.1-32.1), lower inpatient days (-3.14, 95% CI -5.2 to -1.1) and improved SF-36 mental composite score (-0.8, 95% CI -1.6 to -0.1) over the 4-year follow-up. HF participants experienced higher alcohol consumption between baseline and 48 months. No significant differences were observed for self-reported mental symptoms or substance dependence.

CONCLUSION

Data at 4 years were consistent with 2-year follow-up data: similar improvement in personal recovery outcomes but higher housing stability, autonomy and lower use of hospital services in the HF group compared to the TAU group, with the exception of an ongoing alcohol issue. These sustained benefits support HF as a valuable intervention for the homeless patients with severe mental illness.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT01570712.

If it's information, it's not "bias": a scoping review and proposed nomenclature for future response-shift research

BACKGROUND

The growth in response-shift methods has enabled a stronger empirical foundation to investigate response-shift phenomena in quality-of-life (QOL) research; but many of these methods utilize certain language in framing the research question(s) and interpreting results that treats response-shift effects as "bias," "noise," "nuisance," or otherwise warranting removal from the results rather than as information that matters. The present project will describe the various ways in which researchers have framed the questions for investigating response-shift issues and interpreted the findings, and will develop a nomenclature for such that highlights the important information about resilience reflected by response-shift findings.

METHODS

A scoping review was done of the QOL and response-shift literature (n = 1100 articles) from 1963 to 2020. After culling only empirical response-shift articles, raters characterized how investigators framed and interpreted study research questions (n = 164 articles).

RESULTS

Of 10 methods used, papers using four of them utilized terms like "bias" and aimed to remove response-shift effects to reveal "true change." Yet, the investigators' reflections on their own conclusions suggested that they do not truly believe that response shift is error to be removed. A structured nomenclature is proposed for discussing response-shift results in a range of research contexts and response-shift detection methods.

CONCLUSIONS

It is time for a concerted and focused effort to change the nomenclature of those methods that demonstrated this misinterpretation. Only by framing and interpreting response shift as information, not bias, can we improve our understanding and methods to help to distill outcomes with and without response-shift effects.

Quality of life of transplanted children and their parents: a cross-sectional study

BACKGROUND

Transplantation is a saving therapeutic that has heavy consequences. The quality of life (QoL) of transplanted children and their parents has been little studied and should help physicians better manage these patients. The objectives of the study were to assess: (1) the QoL of transplanted children and parents and compare it with that of children with other chronic conditions associated with long-term consequences, and (2) potential variables modulating the QoL.

METHODS

This cross-sectional study was performed in a multidisciplinary paediatric unit (Timone Hospital, Marseille, France). Children were less than 18 years old; had a liver, kidney or heart transplant; and had a time since transplantation of 1-10 years. Socio-demographics and clinical data were recorded from medical forms. The QoL was assessed using the VSP-A (Vécu et Santé Perçue de l'Adolescent et de l'Enfant) and the WhoQoL self-reported questionnaires.

RESULTS

Forty-five families were included (response rate: 76%). The transplanted organs were the liver for 20 children, the kidney for 15 children, and the heart for 10 children. The QoL of transplanted children reported by their parents was better than that of children with inborn errors of metabolism and similar to that of childhood leukaemia survivors. The QoL of parents of transplanted children was better than that of parents of children with inborn errors of metabolism and did not differ from French norms. The QoL did not differ according to the nature of the transplanted organ, sex or the main sociodemographic data. The main modulators decreasing QoL were residual treatment level, medications switch and the presence of another regular treatment.

CONCLUSION

Transplanted children and their families reported a fairly preserved QoL compared to children with other chronic health conditions. Special attention should be given to QoL modulators related to therapeutic management (medication switches, regular treatments) that might be amenable to improve the QoL. Trial registration Ethics committee of Aix-Marseille University, France (reference number: 2014-08-04-03, 24/4/2015; https://www.univ-amu.fr/fr/public/comite-dethique ).

Critical examination of current response shift methods and proposal for advancing new methods

Purpose

This work is part of an international, interdisciplinary initiative to synthesize research on response shift in results of patient-reported outcome measures. The objective is to critically examine current response shift methods. We additionally propose advancing new methods that address the limitations of extant methods.

Methods

Based on literature reviews, this critical examination comprises design-based, qualitative, individualized, and preference-based methods, latent variable models, and other statistical methods. We critically appraised their definition, operationalization, the type of response shift they can detect, whether they can adjust for and explain response shift, their assumptions, and alternative explanations. Overall limitations requiring new methods were identified.

Results

We examined 11 methods that aim to operationalize response shift, by assessing change in the meaning of one’s self-evaluation. Six of these methods distinguish between change in observed measurements (observed change) and change in the construct that was intended to be measured (target change). The methods use either (sub)group-based or individual-level analysis, or a combination. All methods have underlying assumptions to be met and alternative explanations for the inferred response shift effects. We highlighted the need to address the interpretation of the results as response shift and proposed advancing new methods handling individual variation in change over time and multiple time points.

Conclusion

No single response shift method is optimal; each method has strengths and limitations. Additionally, extra steps need to be taken to correctly interpret the results. Advancing new methods and conducting computer simulation studies that compare methods are recommended to move response shift research forward.

Supplementary Information

The online version of this article (10.1007/s11136-020-02755-4) contains supplementary material, which is available to authorized users.

Cross-Cultural Adaptation and Validation of the Quality of Life Questionnaire for Caregivers of Patients with Schizophrenia (S-CGQoL) in Latin America

OBJECTIVES

The aim of this study was to adapt and validate the Schizophrenia Caregiver's Quality of Life Questionnaire (S-CGQoL) for use in the Hispanic-American population from the caregiver's perspective.

METHODS

A cross-sectional instrumental model was used, with a sample of 253 caregivers of patients suffering of Schizophrenia in Bolivia, Peru and Chile. The psychometric properties of the S-CGQoL were tested through construct validity, reliability and some aspects of external validity. In addition, in order to assess the nature of the different items across the three countries, a Differential Performance Analysis (DPA) was conducted.

RESULTS

A confirmatory factor analysis showed that the scale structure was well correlated to the initial structure of the QoL-MDS. The results confirmed the existence of adequate reliability indicators (α>.70 and ω>.80) and the absence of FIDs supporting the invariance of item calibrations among the three Latin American countries.

CONCLUSIONS

The adaptation and validation of the S-CGQoL questionnaire demonstrate adequate psychometric properties to assess the quality of life of caregivers in samples of middle-income countries in Latin America.

Response shift in results of patient-reported outcome measures: a commentary to The Response Shift-in Sync Working Group initiative

PURPOSE

The Working Group undertook a critical, comprehensive synthesis of the response shift work to date. We aimed to (1) describe the rationale for this initiative; (2) outline how the Working Group operated; (3) summarize the papers that comprise this initiative; and (4) discuss the way forward.

METHODS

Four interdisciplinary teams, consisting of response shift experts, external experts, and new investigators, prepared papers on (1) definitions and theoretical underpinnings, (2) operationalizations and response shift methods, (3) implications for healthcare decision-making, and (4) on the published magnitudes of response shift effects. Draft documents were discussed during a two-day meeting. Papers were reviewed by all members.

RESULTS

Vanier and colleagues revised the formal definition and theory of response shift, and applied these in an amended, explanatory model of response shift. Sébille and colleagues conducted a critical examination of eleven response shift methods and concluded that for each method extra steps are required to make the response shift interpretation plausible. Sawatzky and colleagues created a framework for considering the impact of response shift on healthcare decision-making at the level of the individual patient (micro), the organization (meso), and policy (macro). Sajobi and colleagues are conducting a meta-analysis of published response shift effects. Preliminary findings indicate that the mean effect sizes are often small and variable across studies that measure different outcomes and use different methods.

CONCLUSION

Future response shift research will benefit from collaboration among diverse people, formulating alternative hypotheses of response shift, and conducting the most conclusive studies aimed at testing these (falsification).

A population-based study of the humanistic burden among cancer patients in Japan

Aims: Understanding the burden of cancer in Japan is becoming increasingly important to address the socio-economic consequences of the disease. This study broadly examined the cancer burden in terms of: Health-Related Quality of Life (HRQoL), work productivity and activity impairment (WPAI), stress-related comorbidities, and indirect costs in patients diagnosed with (i) any type of cancer, (ii) breast cancer, (iii) colorectal cancer, compared to controls without cancer.Materials and methods: This cross-sectional study used data from the 2017 Japan National Health and Wellness Survey (NHWS). Patient outcomes included self-reported stress-related comorbidities, HRQoL assessed by Short Form 12-item Health Survey and EuroQoL 5-dimension scale (EQ-5D), and work productivity and indirect costs assessed by WPAI questionnaire. Multivariate analysis was performed to compare outcomes across groups. An ad-hoc analysis compared respondents currently and currently not receiving prescription medication (Rx).Results: A total of 1,540 patients with any type of cancer, 254 with breast cancer, 144 with colorectal cancer were included in the analyses and compared to 28,070 controls without cancer. After adjusting for potential confounding effects patients with any type of cancer had significantly lower mental component summary scores (45.70 vs. 46.45, p = .003), physical component summary scores (48.95 vs. 50.02, p < .001) and EQ-5D index (0.77 vs. 0.79, p < .001), and significantly increased absenteeism (5.13% vs. 2.68% p < .001) compared to controls. No significant differences were detected for indirect costs. Breast cancer patients had significantly increased odds of anxiety and migraine. Colorectal cancer patients had significantly increased odds of insomnia. Patients currently receiving Rx had significantly lower HRQoL and higher WPAI than both controls and cancer patients not receiving Rx.Conclusions: Japanese cancer patients experience a significantly decreased HRQoL, increased absenteeism and higher odds ratio for stress-related comorbidities. This has implications for future policy making and Health Technology Assessment in Japan.

Predictive Modeling of ICU Healthcare-Associated Infections from Imbalanced Data. Using Ensembles and a Clustering-Based Undersampling Approach

Early detection of patients vulnerable to infections acquired in the hospital environment is a challenge in current health systems given the impact that such infections have on patient mortality and healthcare costs. This work is focused on both the identification of risk factors and the prediction of healthcare-associated infections in intensive-care units by means of machine-learning methods. The aim is to support decision making addressed at reducing the incidence rate of infections. In this field, it is necessary to deal with the problem of building reliable classifiers from imbalanced datasets. We propose a clustering-based undersampling strategy to be used in combination with ensemble classifiers. A comparative study with data from 4616 patients was conducted in order to validate our proposal. We applied several single and ensemble classifiers both to the original dataset and to data preprocessed by means of different resampling methods. The results were analyzed by means of classic and recent metrics specifically designed for imbalanced data classification. They revealed that the proposal is more efficient in comparison with other approaches.

Testing for response shift in treatment evaluation of change in self-reported psychopathology amongst secondary psychiatric care outpatients

OBJECTIVES

If patients change their perspective due to treatment, this may alter the way they conceptualize, prioritize, or calibrate questionnaire items. These psychological changes, also called "response shifts," may pose a threat to the measurement of therapeutic change in patients. Therefore, it is important to test the occurrence of response shift in patients across their treatment.

METHODS

This study focused on self-reported psychological distress/psychopathology in a naturalistic sample of 206 psychiatric outpatients. Longitudinal measurement invariance tests were computed across treatment in order to detect response shifts.

RESULTS

Compared with before treatment, post-treatment psychopathology scores showed an increase in model fit and factor loading, suggesting that symptoms became more coherently interrelated within their psychopathology domains. Reconceptualization (depression/mood) and reprioritization (somatic and cognitive problems) response shift types were found in several items. We found no recalibration response shift.

CONCLUSION

This study provides further evidence that response shift can occur in adult psychiatric patients across their mental health treatment. Future research is needed to determine whether response shift implies an unwanted potential bias in treatment evaluation or a desired cognitive change intended by treatment.

Stability and mutual prospective relationships of stereotyped beliefs about mental illness, hope and depressive symptoms among people with schizophrenia spectrum disorders

Internalized stigma, hope and depressive symptoms are important variables in the recovery process of people with schizophrenia spectrum disorders, but little is known about their stability or relationship among each other over time. This study aims to unravel the longitudinal stability and relationships of these variables. 99 participants were included in this prospective study assessing internalized stigma, hope and depressive symptoms at baseline, with a first follow-up after three months and a second follow-up after six months. Multilevel models examined if the variables changed over time and a correlation coefficient was conducted to show their relationship to each other. Hope stayed stable over time, whereas internalized stigma and depressive symptoms significantly decreased over the study period. The correlation coefficient showed that internalized stigma and depressive symptoms influenced each other moderately over time. Thus, while hope was a stable construct over time, internalized stigma and depressive symptoms changed significantly and were correlated to each other positively. This implies that participants may adjust to their chronic condition over time, and recovery focused interventions should target both psychological dimensions at the same time.

Subjectively different but objectively the same? Three profiles of QoL in people with severe mental health problems

Purpose

Quality of life (QoL) is a broad outcome that is often used to assess the impact of treatment and care interventions in mental health services. QoL, however, is known to be influenced by individual values and preferences. To investigate this heterogeneity on the individual level, this study aimed to distinguish classes with distinct QoL profiles in a broad group of people with severe mental health problems and to identify the QoL domains that are most strongly related to the classes.

Methods

QoL data of seven studies that used the Lancashire quality of life profile (LQoLP) were used in a latent class analysis. Sociodemographic variables, health-related variables, and measures of well-being were used to characterise the classes. Additionally, univariate entropy scores were used to assess the strength of the association between the ten LQoLP domains and the latent classes.

Results

Two of the three indices of fit pointed towards a three-class model. The three classes differed significantly on all of the LQoLP domains, on well-being, and on ‘being in an intimate relationship’. No differences were found for the majority of the health-related and sociodemographic variables. The LQoLP domains ‘family relations’, ‘positive self-esteem’, and ‘negative self-esteem’ were most strongly related to the latent classes.

Conclusions

The identification of three distinct classes of QoL scores re-emphasises the heterogenic nature of QoL. The lack of differences in sociodemographic or health-related characteristics between the three classes suggests that QoL is primarily determined by subjective, personal evaluations, rather than by objective characteristics and circumstances.

Depression, anxiety, quality of life, and predictors of depressive disorders in caregivers of patients with head and neck cancer: A six-month follow-up study

OBJECTIVE

Caregivers of patients with cancer experience a variety of psychological distress. This study aimed to investigate the mental health status and depressive disorder predictors in caregivers of patients with head and neck cancer (HNC) over a six-month follow-up.

METHODS

We recruited the participants for this study from a HNC outpatient clinic in a medical center from February 2012 to January 2013. Caregivers of HNC patients were evaluated with the Structured Clinical Interview for the DSM-IV, Clinician Version, the Hospital Anxiety and Depression Scale, the Short Form 36 Health Survey (SF-36), and the Family APGAR index. Baseline evaluations were performed, and additional evaluations were performed again 3months and 6months later.

RESULTS

We assessed a total of 132 caregivers in this study. Over the 6-month follow-up period, the severity of the caregivers' depression and anxiety significantly decreased, while their quality of life improved significantly. At the 6-month assessment, the most prevalent psychiatric disorders were depressive disorders (12.9%), followed by alcohol abuse (1.5%) and primary insomnia (1.5%). Older age, hypnotics use, pre-existing depressive disorders at baseline, and a lower mental component of SF-36 score at baseline were found to significantly predict depressive disorders after 6months.

CONCLUSION

Our findings show that the mental health of caregivers of HNC patients improves during the 6-month follow-up, as well as that depressive disorders were the most prevalent psychiatric diagnosis. Clinicians need to be alert to and manage any emerging mental health problems in caregivers during patient care, especially depressive disorders.

Using classification and regression tree modelling to investigate response shift patterns in dentine hypersensitivity

Background

Dentine hypersensitivity (DH) affects people’s quality of life (QoL). However changes in the internal meaning of QoL, known as Response shift (RS) may undermine longitudinal assessment of QoL. This study aimed to describe patterns of RS in people with DH using Classification and Regression Trees (CRT) and to explore the convergent validity of CRT with the then-test and ideals approaches.

Methods

Data from an 8-week clinical trial of mouthwashes for dentine hypersensitivity (n = 75) using the Dentine Hypersensitivity Experience Questionnaire (DHEQ) as the outcome measure, were analysed. CRT was used to examine 8-week changes in DHEQ total score as a dependent variable with clinical status for DH and each DHEQ subscale score (restrictions, coping, social, emotional and identity) as independent variables. Recalibration was inferred when the clinical change was not consistent with the DHEQ change score using a minimally important difference for DHEQ of 22 points. Reprioritization was inferred by changes in the relative importance of each subscale to the model over time.

Results

Overall, 50.7% of participants experienced a clinical improvement in their DH after treatment and 22.7% experienced an important improvement in their quality of life. Thirty-six per cent shifted their internal standards downward and 14.7% upwards, suggesting recalibration. Reprioritization occurred over time among the social and emotional impacts of DH.

Conclusions

CRT was a useful method to reveal both, the types and nature of RS in people with a mild health condition and demonstrated convergent validity with design based approaches to detect RS.

Religion involvement and quality of life in caregivers of patients with schizophrenia in Latin-America

The aim of the study was to explore the relationship between religious involvement (RI) and quality of life (QoL) in caregivers of patients with schizophrenia, while adjusting for key confounding factors such as socio-demographic and clinical characteristics. This study was conducted in the public mental health services in Bolivia, Peru and Chile. The data collected included RI, socio-demographic information, clinical characteristic of the patients and caregiver's QoL using the S-CGQoL questionnaire. A multivariate analysis using multiple linear regressions was performed to determine variables potentially associated with QoL levels. Two hundred and fifty-three patients with their caregivers participated in the study. Caregivers' RI was not significantly associated with overall QoL nor its individual components. The only exception was an unexpected modest inverse association between RI and one QoL dimension (psychological and physical well-being). In contrast, the following caregivers' socio-cultural and economic factors were significantly associated with low QoL level of caregivers: being a mother, identifying with Aymara ethnicity and having lower family income. Among patients, the clinical characteristics of being woman, younger, and having lower age of onset and more severe symptoms was associated with lower QoL. Our study found that socio-cultural, economic and clinical factors were associated with caregivers' QoL.

Using CART to Identify Thresholds and Hierarchies in the Determinants of Funding Decisions

There is much interest in understanding decision-making processes that determine funding outcomes for health interventions. We use classification and regression trees (CART) to identify cost-effectiveness thresholds and hierarchies in the determinants of funding decisions. The hierarchical structure of CART is suited to analyzing complex conditional and nonlinear relationships. Our analysis uncovered hierarchies where interventions were grouped according to their type and objective. Cost-effectiveness thresholds varied markedly depending on which group the intervention belonged to: lifestyle-type interventions with a prevention objective had an incremental cost-effectiveness threshold of $2356, suggesting that such interventions need to be close to cost saving or dominant to be funded. For lifestyle-type interventions with a treatment objective, the threshold was much higher at $37,024. Lower down the tree, intervention attributes such as the level of patient contribution and the eligibility for government reimbursement influenced the likelihood of funding within groups of similar interventions. Comparison between our CART models and previously published results demonstrated concurrence with standard regression techniques while providing additional insights regarding the role of the funding environment and the structure of decision-maker preferences.