Semantic primes theory may be helpful in designing questionnaires such as to prevent response shift

Anterior Cruciate Ligament Reconstruction Plus Lateral Extra-articular Tenodesis Has a Similar Return-to-Sport Rate to Anterior Cruciate Ligament Reconstruction Alone but a Lower Failure Rate

PURPOSE

To determine whether the addition of lateral extra-articular tenodesis (LET) to anterior cruciate ligament reconstruction (ACLR) would improve return-to-sport (RTS) rates in young, active patients who play high-risk sports.

METHODS

This multicenter randomized controlled trial compared standard hamstring tendon ACLR with combined ACLR and LET using a strip of the iliotibial band (modified Lemaire technique). Patients aged 25 years or younger with an anterior cruciate ligament-deficient knee were included. Patients also had to meet 2 of the following criteria: (1) pivot-shift grade 2 or greater, (2) participation in a high-risk or pivoting sport, and (3) generalized ligamentous laxity. Time to return and level of RTS were determined via administration of a questionnaire at 24 months postoperatively.

RESULTS

We randomized 618 patients in this study, 553 of whom played high-risk sports preoperatively. The proportion of patients who did not RTS was similar between the ACLR (11%) and ACLR-LET (14%) groups; however, the graft rupture rate was significantly different (11.2% in ACLR group vs 4.1% in ACLR-LET group, P = .004). The most cited reason for no RTS was lack of confidence and/or fear of reinjury. A stable knee was associated with nearly 2 times greater odds of returning to a high-level high-risk sport postoperatively (odds ratio, 1.92; 95% confidence interval, 1.11-3.35; P = .02). There were no significant differences in patient-reported functional outcomes or hop test results between groups (P > .05). Patients who returned to high-risk sports had better hamstring symmetry than those who did not RTS (P = .001).

CONCLUSIONS

At 24 months postoperatively, patients who underwent ACLR plus LET had a similar RTS rate to those who underwent ACLR alone. Although the subgroup analysis did not show a statistically significant increase in RTS with the addition of LET, on returning, the addition of LET kept subjects playing longer by reducing graft failure rates.

LEVEL OF EVIDENCE

Level I, randomized controlled trial.

If it's information, it's not "bias": a scoping review and proposed nomenclature for future response-shift research

BACKGROUND

The growth in response-shift methods has enabled a stronger empirical foundation to investigate response-shift phenomena in quality-of-life (QOL) research; but many of these methods utilize certain language in framing the research question(s) and interpreting results that treats response-shift effects as "bias," "noise," "nuisance," or otherwise warranting removal from the results rather than as information that matters. The present project will describe the various ways in which researchers have framed the questions for investigating response-shift issues and interpreted the findings, and will develop a nomenclature for such that highlights the important information about resilience reflected by response-shift findings.

METHODS

A scoping review was done of the QOL and response-shift literature (n = 1100 articles) from 1963 to 2020. After culling only empirical response-shift articles, raters characterized how investigators framed and interpreted study research questions (n = 164 articles).

RESULTS

Of 10 methods used, papers using four of them utilized terms like "bias" and aimed to remove response-shift effects to reveal "true change." Yet, the investigators' reflections on their own conclusions suggested that they do not truly believe that response shift is error to be removed. A structured nomenclature is proposed for discussing response-shift results in a range of research contexts and response-shift detection methods.

CONCLUSIONS

It is time for a concerted and focused effort to change the nomenclature of those methods that demonstrated this misinterpretation. Only by framing and interpreting response shift as information, not bias, can we improve our understanding and methods to help to distill outcomes with and without response-shift effects.

Investigation of measurement invariance in longitudinal health-related quality of life in preemptive or previously dialyzed kidney transplant recipients

PURPOSE

Kidney transplantation (KT) can impact patients' evaluation of health-related quality of life (HRQoL) as they adapt to their new life with a graft and its changes. Patients may adapt to KT in a different way, depending on whether they were on dialysis prior to transplantation or not (i.e. preemptive group). This may result in lack of measurement invariance between these patients' groups and/or over time (i.e. response shift, RS) which may invalidate the between-group comparison of HRQoL change scores. The aim of this study was to investigate and compare RS before and after KT between these two patients' groups. Measurement invariance was investigated between groups and over time with three measurement occasions.

METHODS

Adult patients completed the SF-36 at the last visit before KT, and 3, 6 months after. A structural equation model-based procedure was used to (i) detect and take into account measurement non-invariance between groups and RS, if appropriate, (ii) identify the period of occurrence of RS, (iii) study the heterogeneity of RS between the two groups.

RESULTS

Before KT (i.e. baseline), measurement invariance was not rejected between dialyzed (n = 196) and preemptive (n = 178) patients' groups. Between baseline and 3 months after KT, similar uniform recalibration was detected on the general health domain in both groups. Uniform recalibration was found between 3- and 6 months after KT on the vitality domain for preemptive patients only.

CONCLUSION

HRQoL, adjusted for RS, increased overall for preemptive and dialyzed kidney transplant patients after transplantation. RS may reflect differing adaptation processes following KT.

The minimal perceived change: a formal model of the responder definition according to the patient's meaning of change for patient-reported outcome data analysis and interpretation

Background

Patient-Reported Outcomes (PROs) are standardized questionnaires used to measure subjective outcomes such as quality of life in healthcare. They are considered paramount to assess the results of therapeutic interventions. However, because their calibration is relative to internal standards in people’s mind, changes in PRO scores are difficult to interpret.

Knowing the smallest value in the score that the patient perceives as change can help. An estimator linking the answers to a Patient Global Rating of Change (PGRC: a question measuring the overall feeling of change) with change in PRO scores is frequently used to obtain this value. In the last 30 years, a plethora of methods have been used to obtain these estimates, but there is no consensus on the appropriate method and no formal definition of this value.

Methods

We propose a model to explain changes in PRO scores and PGRC answers.

Results

A PGRC measures a construct called the Perceived Change (PC), whose determinants are elicited. Answering a PGRC requires discretizing a continuous PC into a category using threshold values that are random variables. Therefore, the populational value of the Minimal Perceived Change (MPC) is the location parameter value of the threshold on the PC continuum defining the switch from the absence of change to change.

Conclusions

We show how this model can help to hypothesize what are the appropriate methods to estimate the MPC and its potential to be a rigorous theoretical basis for future work on the interpretation of change in PRO scores.

Response shift in patient-reported outcomes: definition, theory, and a revised model

Purpose

The extant response shift definitions and theoretical response shift models, while helpful, also introduce predicaments and theoretical debates continue. To address these predicaments and stimulate empirical research, we propose a more specific formal definition of response shift and a revised theoretical model.

Methods

This work is an international collaborative effort and involved a critical assessment of the literature.

Results

Three main predicaments were identified. First, the formal definitions of response shift need further specification and clarification. Second, previous models were focused on explaining change in the construct intended to be measured rather than explaining the construct at multiple time points and neglected the importance of using at least two time points to investigate response shift. Third, extant models do not explicitly distinguish the measure from the construct. Here we define response shift as an effect occurring whenever observed change (e.g., change in patient-reported outcome measures (PROM) scores) is not fully explained by target change (i.e., change in the construct intended to be measured). The revised model distinguishes the measure (e.g., PROM) from the underlying target construct (e.g., quality of life) at two time points. The major plausible paths are delineated, and the underlying assumptions of this model are explicated.

Conclusion

It is our hope that this refined definition and model are useful in the further development of response shift theory. The model with its explicit list of assumptions and hypothesized relationships lends itself for critical, empirical examination. Future studies are needed to empirically test the assumptions and hypothesized relationships.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-021-02846-w.

Testing for response shift in treatment evaluation of change in self-reported psychopathology amongst secondary psychiatric care outpatients

OBJECTIVES

If patients change their perspective due to treatment, this may alter the way they conceptualize, prioritize, or calibrate questionnaire items. These psychological changes, also called "response shifts," may pose a threat to the measurement of therapeutic change in patients. Therefore, it is important to test the occurrence of response shift in patients across their treatment.

METHODS

This study focused on self-reported psychological distress/psychopathology in a naturalistic sample of 206 psychiatric outpatients. Longitudinal measurement invariance tests were computed across treatment in order to detect response shifts.

RESULTS

Compared with before treatment, post-treatment psychopathology scores showed an increase in model fit and factor loading, suggesting that symptoms became more coherently interrelated within their psychopathology domains. Reconceptualization (depression/mood) and reprioritization (somatic and cognitive problems) response shift types were found in several items. We found no recalibration response shift.

CONCLUSION

This study provides further evidence that response shift can occur in adult psychiatric patients across their mental health treatment. Future research is needed to determine whether response shift implies an unwanted potential bias in treatment evaluation or a desired cognitive change intended by treatment.

Montreal Accord on Patient-Reported Outcomes (PROs) use series - Paper 2: terminology proposed to measure what matters in health

BACKGROUND

We outline different health outcomes and describe how multiple perspectives can be harnessed to optimize accuracy of key data collected about patients with chronic conditions. The terms health status, health-related quality of life, and quality of life are often used interchangeably without recognizing that they have different meanings, as are the terms used to refer to the different components of function. Although the advantages and limitations of existing frameworks and perspectives are largely understood, greater precision is needed when using health outcome terminology and identifying optimal sources of information.

OBJECTIVE

A refinement of the current taxonomy is proposed to distinguish between patient-reported outcomes and self-report outcomes and expand the concept of clinically reported outcomes to include those assessed by performance and emerging technologies.

DISCUSSION

Health outcomes yield important information that can be used to improve the lives of many people. Now is the time to "talk the talk" as part of larger coordinated efforts within and across countries to identify and measure what matters most in health.