Appraisal assessment in patient-reported outcome research: methods for uncovering the personal context and meaning of quality of life

Impact of comorbidities on people with and without cancer early in the COVID-19 pandemic: An observational study

BACKGROUND

The present study sought to investigate how comorbidity burden influences cancer survivors' quality of life (QoL) and the challenges/adaptations during the coronavirus disease 2019 (COVID) pandemic, and to examine how appraisal processes are related to this impact.

METHODS

This cross-sectional study, administered in spring/summer 2020, compared cancer survivors to a general-population comparison sample. QoL was assessed with standardized tools. COVID-specific questions included selected items compiled by the US National Institutes of Health, and cognitive appraisal processes were assessed using the QoL Appraisal Profilev2 Short-Form. Principal components analysis reduced the number of comparisons. Multivariate analysis of covariance investigated group differences in QoL, COVID-specific variables, and cognitive-appraisal processes. Linear regression investigated group differences in COVID-specific variables as a function of cognitive-appraisal processes, QoL, demographic covariates, and their interactions.

RESULTS

Cancer survivors fared substantially better than non-cancer participants in QoL and cognitive functioning when they had no other comorbidities, but substantially worse on QoL when they had three or more comorbidities. Cancer survivors with no comorbidities were less likely to feel worried about COVID, less likely to engage in self-protection, and prioritized engaging in problem-focused and prosocial actions compared to non-cancer participants. Conversely, cancer survivors confronted with multiple comorbidities exhibited more proactive self-protection and experienced more anxiety about the pandemic.

CONCLUSION

The impact of having multiple comorbidities in the context of cancer is associated with notable differences in social determinants of health, QoL outcomes, COVID-specific challenges/adaptations, and appraisal of QoL. These findings provide an empirical basis for implementing appraisal-based coping interventions.

Toward patient-centered treatment goals for duchenne muscular dystrophy: insights from the "Your Voice" study

BACKGROUND

Patient-centered research has emerged as critically important for understanding the impact of treatments on key stakeholders. The subjective experience of quality of life (QOL) is increasingly recognized as fundamental to delineating treatment goals. The present study utilized content analysis of qualitative data and quantitative analysis to highlight important domains of disease burden and underlying reasons for their importance, and to characterize goals for new treatments for Duchenne Muscular Dystrophy (DMD).

RESULTS

The study sample reflected the perspectives of DMD patients and caregivers representing ambulatory, transitional, and non-ambulatory stages of disability progression (n = 20 per category). Open-ended interviews were content-analyzed and non-parametric statistical tests were used to compare ambulation groups. As patients progressed in disability, the noted DMD burdens reflected some differences in functional areas. While daily functioning and sports/recreation remained the most important priority areas across ambulation groups, "health" became less prominent as the disability progressed from ambulatory to transitional to non-ambulatory phases of disability; whereas relationships became more prominent as one progressed to the non-ambulatory phase from the ambulatory or transitional phases (Kruskall Wallis H = 12.24 and 5.28, p = 0.002 and 0.02, respectively). When asked why their burdens were important to them and how it impacted their or their child's life, self-esteem/confidence was most important for ambulatory patients, and became less prominent for patients in the transitional and non-ambulatory phases of disability (Kruskall Wallis H = 9.46, p = 0.009). In contrast, independence was less important for ambulatory patients, and became increasing prominent for patients in the transitional and non-ambulatory phases of disability (Kruskall Wallis H = 7.35, p = 0.025). Emotional functioning was most prominent for all ambulation groups on their best and worst days. Goals for new DMD treatments focused on functional goals, general QOL goals, and concerns about safety, ease of use, and effectiveness.

CONCLUSION

This study provides useful information about treatment goals for DMD from the perspective of patients and their caregivers. It highlights some consistent values across the disability trajectory, as well as introducing an evolution of priorities as the person with DMD becomes more disabled. Results provide a roadmap for patient-centered DMD drug development.

Cognitive Processes during Recovery: Moving toward Personalized Spine Surgery Outcomes

This paper focuses on a novel application of personalized medicine: the ways one thinks about health (i.e., appraisal processes) as relevant predictors of spine-surgery response. This prospective longitudinal cohort study (n = 235) investigated how appraisal processes relate to outcomes of spinal decompression and/or fusion surgery, from pre-surgery through one-year post-surgery. Patient-reported outcomes assessed spine-specific disability (Oswestry Disability Index (ODI)), mental health functioning (Rand-36 Mental Component Score (MCS)), and cognitive appraisal processes (how people recall past experiences and to whom they compare themselves). Analysis of Variance examined the appraisal-outcomes association in separate models at pre-surgery, 3 months, and 12 months. We found that appraisal processes explained less variance at pre-surgery than later and were differentially relevant to health outcomes at different times in the spine-surgery recovery trajectory. For the ODI, recall of the seriousness of their condition was most prominent early in recovery, and comparing themselves to positive standards was most prominent later. For the MCS, not focusing on the negative aspects of their condition and/or on how others see them was associated with steady improvement and higher scores at 12 months. Appraisal processes are relevant to both spine-specific disability and mental-health functioning. Such processes are modifiable objects of attention for personalizing spine-surgery outcomes.

Appraisal and patient-reported outcomes following total hip arthroplasty: a longitudinal cohort study

Background

Total hip arthroplasty (THA) is a successful procedure that provides pain relief, restores function, and improves quality of life (QOL) for patients with advanced arthritis in their hip joint. To date, little research has examined the role of cognitive appraisal processes in THA outcomes. This study examined the role of cognitive appraisal processes in THA outcomes in the first year post-surgery.

Methods

This longitudinal cohort study collected data at pre-surgery, 6 weeks post-surgery, 3 months post-surgery, and 12 months post-surgery. Adults (n = 189) with a primary diagnosis of osteoarthritis were consecutively recruited from an active THA practice at a Canadian academic teaching hospital. Measures included the Hip Disability and Osteoarthritis Outcome Score (HOOS), the Mental Component Score (MCS) of the Rand-36, and the Brief Appraisal Inventory (BAI). Analysis of Variance examined the association between BAI items and the HOOS or MCS scores. Random effects models investigated appraisal main effects and appraisal-by-time interactions for selected BAI items.

Results

HOOS showed great improvement over the first 12 months after THA, and was mitigated by three appraisal processes in particular: focusing on problems with healthcare or living situation, and preparing one’s family for health changes. MCS was stable and low over time, and the following appraisal processes were implicated by very large effect sizes: not comparing themselves to healthier people, focusing on money problems, preparing their family for their health changes, or trying to shed responsibilities.

Conclusions

Appraisal processes are relevant to health outcomes after THA, with different processes coming into play at different points in the recovery trajectory.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41687-022-00498-z.

Short quality of life scale: A cross-cultural validation in Iranian patients with multiple sclerosis

Health-related quality of life (HRQoL) is the prioritized measure in multiple sclerosis (MS) patients. The short quality of life scale (SQoL) developed by Devy et al. (2013) is an MS-specific and abbreviated scale with ten items suitable for routine medical care settings. The current study reported the cross-cultural validation of the scale in the Persian language. A total of 455 convenient MS patients with a mean age of 38.39 (9.28) ranged from 18 to 64 filled out the primary measure and the validating measures, including hospital anxiety and depression scale, visual analogue scale - quality of life, and a single index of the number of past-year MS relapse. The confirmatory factor analysis on original structure indicated an acceptable model fit. However, a modestly modified structure composing of physical-functional dimension (items #1-3), mental dimension (items #5-8), and pain & energy dimension (items 4 & 9,10) was also exposed with a sound fit and a meaningful structure. The overall internal consistency reliability was sound (0.88), and the concurrent validity was confirmed. The Persian short quality of life scale (P-SQoL) is the first translated and validated version of the scale, surfacing significant implications. Further cross-cultural investigations are recommended to re-examine current findings. The classic and recent suggestions concerning the close interplay between the immunity system and the psychological system and the implications based on Iran's context are discussed.

Evaluation of the link between the Guttman errors and response shift at the individual level

PURPOSE

Methods for response shift (RS) detection at the individual level could be of great interest when analyzing changes in patient-reported outcome data. Guttman errors (GEs), which measure discrepancies in respondents' answers compared to the average sample responses, might be useful for detecting RS at the individual level between two time points, as RS may induce an increase in the number of discrepancies over time. This study aims to establish the link between recalibration RS and the change in the number of GEs over time (denoted index [Formula: see text]) via simulations and explores the discriminating ability of this index.

METHODS

We simulated the responses of individuals affected or not affected by recalibration RS (defined as changes in the patients' standard of measurement) to determine whether simulated individuals with recalibration had a greater change in the number of GEs over time than individuals without recalibration. The effects of factors related to the sample, the questionnaire structure and recalibration were investigated. As an illustrative example, the change in the number of GEs was computed in patients suffering from eating disorders.

RESULTS

Within simulations, simulated individuals affected by recalibration had, on average, a greater change in the number of GEs over time than did individuals without RS. Some of the parameters related to the questionnaire structure and recalibration magnitude appeared to have substantial effects on the values of [Formula: see text]. Discriminating abilities appeared, however, globally low.

CONCLUSION

Some evidence of the link between recalibration and the change in GEs was found in this study. GEs could be a valuable nonparametric tool for RS detection at a more individual level, but further investigation is needed.

Creating idiometric short-form measures of cognitive appraisal: balancing theory and pragmatics

BACKGROUND

The Rapkin and Schwartz appraisal theory and measure provided a path toward documenting response-shift effects and describing individual differences in ways of thinking about quality of life (QOL) that distinguished people in different circumstances. Recent work developed and validated the QOL Appraisal Profile_{version 2} (QOLAP_v2), an 85-item measure that taps response-shift-detection domains of Frame of Reference, Standards of Comparison, Sampling of Experience, and Combinatory Algorithm. Recent theoretical work proposed that appraisal measurement constitutes a new class of measurement (idiometric), distinct from psychometric and clinimetric. To validate an idiometric measure, one would document that its items reflect different circumstances and population characteristics, and explain variance in QOL. The present work sought to develop idiometric short-forms of the QOLAP_v2 item bank by examining which items were most informative, retaining the appraisal-domain structure.

METHODS

This secondary analysis (n = 1481) included chronically-ill patients and their caregivers from a longitudinal web-based survey (mean follow-up 16.6 months). Data included the QOLAP_v2, the Center for Disease Control Healthy Days Core Module, the PROMIS-10 Global Health, and demographic/medical variables. Appraisal items were measured at baseline (relevant to understanding cognitive appraisal processes); and with change scores (sensitive to response-shift effects). Multivariate analysis of covariance examined what demographic and health-status change variables were reflected by each of 85 appraisal items (in five sets), as dependent variables, and other demographic/medical variables. Multiple linear regression examined how appraisal items explained variance in global physical- and mental-health change, after covariate adjustment. A tally summarized item performance across all five sets of cross-sectional and longitudinal analyses.

RESULTS

The vast majority (i.e., 80%) of the QOLAP_v2 items performed well across the analyses presented. Using a relatively strict criterion of explaining meaningful variance across 60% of analyses, one would retain 68 items. A more lenient criterion (40%) would retain 71.

CONCLUSIONS

The present study provides heuristics to support investigators' creating 'discretionary' QOLAP_v2 short-forms to fit their study aim and amplifying individual differences in the cognitive processes underlying QOL. This approach enables adapting the measure to the study population, as per the expectation that respondent populations differ in the predominant cognitive processes used.

Risk factors for postoperative dysphagia and dysphonia following anterior cervical spine surgery: a comprehensive study utilizing the hospital for special surgery dysphagia and dysphonia inventory (HSS-DDI)

BACKGROUND CONTEXT

Postoperative dysphagia and dysphonia (PDD) are prevalent complications after anterior cervical discectomy and fusion (ACDF). Identification of risk factors for these complications is necessary for effective prevention. Recently, patient reported outcome measures (PROM) have been used to determine PDD after ACDF. The Hospital for Special Surgery Dysphagia and Dysphonia Inventory (HSS-DDI) is a validated PROM that specifically assesses dysphagia and dysphonia after anterior cervical spine surgery.

PURPOSE

To identify the perioperative risk factors for PDD utilizing the HSS-DDI.

STUDY DESIGN/SETTING

Observational study of prospectively collected data at a single academic institution.

PATIENT SAMPLE

Patients undergoing anterior cervical discectomy and fusion from 2015 to 2019 who enrolled in the prospective data collection.

OUTCOME MEASURE

The HSS-DDI administered 4 weeks, 8 weeks, and 4-6 months after surgery.

METHODS

As potential risk factors, the data on demographic factors, analgesic medications, history of psychiatric illness, preoperative sagittal alignment, surgical factors, preoperative diagnoses, and preoperative Neck Disability Index (NDI) scores were collected. Bivariate and multivariable regression analyses utilizing the Tobit model were conducted.

RESULTS

291 patients were included in the final analysis. The median HSS-DDI at 4-weeks, 8 weeks, and 4-6 months postoperatively, were 80.7, 92.7, and 98.4, respectively. Multivariable analysis demonstrated that current smoking, previous cervical spine surgery, preoperative C2-7 angle, upper level surgery, multilevel surgery, opioid use, and a high preoperative NDI score, were independent contributing factors to a low HSS-DDI score at 4-weeks follow-up. Intraoperative topical steroid use was an independent protective factor for a low HSS-DDI score. Opioid use and high NDI score remained independent factors at 4-6 months. Sub-domain analysis demonstrated that prior cervical surgery, preoperative C2-7 angle, multilevel surgery, and intraoperative topical steroid use were significant for dysphagia only. Current smoking was significant for dysphonia only.

CONCLUSIONS

Our results showed that preoperative opioid use and a high preoperative NDI score are novel independent risk factors for postoperative dysphagia and dysphonia in addition to other known factors.

"Looking Under the Hood" of Anchor-Based Assessment of Clinically Important Change: A Machine Learning Approach

OBJECTIVES

The Global Assessment of Change (GAC) item has facilitated the interpretation of change in patient-reported outcomes, providing an anchor for computing minimally important differences. Construct validity has been documented via disease-specific patient-reported outcomes change. We examined what domains, sociodemographic characteristics, attributions of change, and cognitive-appraisal processes are reflected in GAC ratings.

METHODS

This secondary analysis examined data from 1,481 chronically ill patients and caregivers surveyed at baseline and 17 months. Items queried change since baseline in overall disease symptoms (GAC) and in physical, emotional, and social functioning. Candidate predictors included sociodemographic factors, health-related quality-of-life domains, change attributions, and quality-of-life appraisal processes. Least absolute shrinkage and selection operator and bootstrapping tested 77 predictors' effectiveness and stability.

RESULTS

GAC worsening was notably associated with being disabled (β = -0.24) and having difficulty paying bills (β = -0.13). GAC was better explained by the physical domain than the emotional or social (β = 0.67, 0.10, and 0.03, respectively; R²_adj = 0.63) after sociodemographic-covariate adjustment. In a separate model (R²_adj = 0.18), GAC variance was explained by attributions about changing health and changing response of one's health team, goals related to solving healthcare problems and maintaining activities, and appraisal about things getting better (β = -0.14, 0.08, -0.07, 0.05, 0.21, respectively; p_range ~0.0005-0.05) after adjustment.

CONCLUSIONS

The GAC primarily reflects the physical domain, and the GAC reflects attributions, goals, and patterns of emphasis related to change in health and healthcare. Commonly unmeasured factors have some bearing on GAC scores and can facilitate the interpretation of change.

The minimal perceived change: a formal model of the responder definition according to the patient's meaning of change for patient-reported outcome data analysis and interpretation

Background

Patient-Reported Outcomes (PROs) are standardized questionnaires used to measure subjective outcomes such as quality of life in healthcare. They are considered paramount to assess the results of therapeutic interventions. However, because their calibration is relative to internal standards in people’s mind, changes in PRO scores are difficult to interpret.

Knowing the smallest value in the score that the patient perceives as change can help. An estimator linking the answers to a Patient Global Rating of Change (PGRC: a question measuring the overall feeling of change) with change in PRO scores is frequently used to obtain this value. In the last 30 years, a plethora of methods have been used to obtain these estimates, but there is no consensus on the appropriate method and no formal definition of this value.

Methods

We propose a model to explain changes in PRO scores and PGRC answers.

Results

A PGRC measures a construct called the Perceived Change (PC), whose determinants are elicited. Answering a PGRC requires discretizing a continuous PC into a category using threshold values that are random variables. Therefore, the populational value of the Minimal Perceived Change (MPC) is the location parameter value of the threshold on the PC continuum defining the switch from the absence of change to change.

Conclusions

We show how this model can help to hypothesize what are the appropriate methods to estimate the MPC and its potential to be a rigorous theoretical basis for future work on the interpretation of change in PRO scores.

Response-shift effects in neuromyelitis optica spectrum disorder: a secondary analysis of clinical trial data

Background

Researchers have long posited that response-shift effects may obfuscate treatment effects. The present work investigated possible response-shift effects in a recent clinical trial testing a new treatment for Neuromyelitis Optica Spectrum Disorder (NMOSD). This pivotal trial provided impressive support for the drug Eculizumab in preventing relapse, but less strong or null results as the indicators became more subjective or evaluative. This pattern of results suggests that response-shift effects are present.

Methods

This secondary analysis utilized data from a randomized, double-blind trial evaluating the impact of Eculizumab in preventing relapses in 143 people with NMOSD. Treatment arm and then relapse status were hypothesized ‘catalysts’ of response shift in two series of analyses. We devised a “de-constructed” version of Oort structural-equation modeling using random-effects modeling for use in small samples. This method begins by testing an omnibus response-shift hypothesis and then, pending a positive result, implements a series of random-effects models to elucidate specific response-shift effects.

Results

In the omnibus test, the ‘standard quality-of-life (QOL) model’ captured substantially less well the experience of placebo as compared to Eculizumab group. Recalibration and reconceptualization response-shift effects were detected. Detected relapse-related response shifts included recalibration, reprioritization, and reconceptualization.

Conclusions

Trial patients experienced response shifts related to treatment- and relapse-related experiences. Published trial results likely under-estimated Eculizumab vs. Placebo differences due to recalibration and reconceptualization, and relapse effects due to recalibration, reprioritization, and reconceptualization. This novel random-effects- model application builds on response-shift theory and provides a small-sample method for better estimating treatment effects in clinical trials.

Electronic supplementary material

The online version of this article (10.1007/s11136-020-02707-y) contains supplementary material, which is available to authorized users.

Capturing patient experience: does quality-of-life appraisal entail a new class of measurement?

Background

Two decades of research on quality-of-life (QOL) appraisal have demonstrated links between patient experience and health outcomes and have accounted for both intra-individual change and inter-individual differences in a wide range of research contexts. The present work investigates patterns across diagnostic and demographic groupings to demonstrate how population-specific circumstances drive the structure of QOL appraisal.

Methods

This secondary analysis (N = 6448) utilized data from six patient groups: spine surgery, multiple sclerosis, heterogeneous chronically ill, heterogeneous cancer, bladder cancer, and human immunodeficiency virus (HIV). We explored patterns of inter-item correlation across patient samples, using items from the Standards of Comparison and Sampling of Experience subsections of the QOL Appraisal Profile v1 and v2. Similar matrices were compared by demographic characteristics.

Results

Patterns of inter-item correlations for Standards of Comparison items varied sharply across disease groups and racial groups while being similar across age, gender, and education levels. Inter-item correlation matrices for Sampling of Experience items revealed marked differences among disease groups and educational and racial categories but were similar across age and gender groups.

Conclusions

Appraisal parameters showed evidence of shared and unique aspects across samples and circumstances, findings which make sense in light of sample differences in health status and demographic influences. Tools to assess patient experience and meaning may be best understood as idiometric instruments. We discuss their distinctions from psychometric and clinimetric tools at theoretical, statistical, and applied levels.

Supplementary information

Supplementary information accompanies this paper at 10.1186/s41687-020-00254-1.

Minimum Clinically Important Differences of the Hospital for Special Surgery Dysphagia and Dysphonia Inventory and Other Dysphagia Measurements in Patients Undergoing ACDF

BACKGROUND

Postoperative dysphagia is a common complication after anterior cervical surgery, and it can be measured using patient-reported outcome measures (PROMs). The Hospital for Special Surgery Dysphagia and Dysphonia Inventory (HSS-DDI) is a condition-specific PROM to evaluate dysphagia and dysphonia after anterior cervical discectomy and fusion (ACDF). The minimum clinically important difference (MCID) of the HSS-DDI has not, to our knowledge, been established. Other PROMs have been used to assess dysphagia (SWAL-QOL and MD Anderson Dysphagia Inventory [MDADI]) in ACDF. Currently, few studies have addressed the MCIDs of these PROMs.

QUESTIONS/PURPOSES

To determine (1) the minimum detectable changes (MDC) of the HSS-DDI, SWAL-QOL, and MDADI using a distribution-based approach, and (2) the MCID of the HSS-DDI, SWAL-QOL, and MDADI, using an anchor-based approach.

METHODS

We used a longitudinally maintained database that was originally established for the HSS-DDI development and validation study. In all, 323 patients who underwent elective ACDF were assessed for enrollment eligibility; 83% (268 of 323) met the inclusion criteria and completed the HSS-DDI Week 4 survey. We set six outcomes: distribution-based MDCs for the (1) HSS-DDI, (2) SWAL-QOL, (3) MDADI, in addition to anchor-based MCIDs for the (4) HSS-DDI, (5) SWAL-QOL, and (6) MDADI. The HSS-DDI consists of 31 questions and ranges 0 (worst) to 100 (normal). We used the focused SWAL-QOL, which consists of 14 selected items from the original SWAL-QOL and ranges from 0 (worst) to 100 (normal). The MDADI is a 20-item survey and ranges from 20 (worst) to 100 (normal). A distribution-based approach is used to calculate values defined as the smallest difference above the measurement error. An anchor-based approach is used to determine the MCIDs based on an external scale, called an anchor, which indicates the minimal symptom change that is considered clinically important. All 268 patients were used for the distribution-based (0.5 SD) HSS-DDI MDC analysis. The first 16% (44 of 268) of patients completed retesting of the HSS-DDI via a telephone interview and were used for another distribution-based (standard error of measurement: SEM) MDC analysis. The number of patients for the test-retest group was determined based on the previously reported minimum required sample size of reliability studies. The first 63% (169 of 268, SWAL-QOL and 168 of 268, MDADI) of patients completed two other surveys for the external validation of the HSS-DDI, and were used for the SWAL-QOL and MDADI 0.5 SD analyses. Among the patients, 86% (230 of 268) completed the Week 8 HSS-DDI survey that was used for the anchor-based HSS-DDI MCID analysis, and 56% (SWAL-QOL, 150 of 268 and MDADI, 151 of 268) of patients completed the Week 8 surveys that were used for the SWAL-QOL and MDADI MCID analyses. Subjective improvement grades from the previous assessment were used as the anchor. The MCIDs were calculated as the mean score changes among those who reported little better or greater in the improvement assessment and receiver operating characteristic (ROC) curve analyses. We adopted the higher value of these two as the MCID for each PROM.

RESULTS

The distribution-based MDCs for the HSS-DDI total score, SWAL-QOL, and MDADI were 11 of 100, 9 of 100, and 8 of 80 points, respectively, using the 0.5 SD method. Using the SEM-based method, the MDC for the HSS-DDI total score was 9 of 100 points. Regarding the anchor-based MCIDs, the values calculated with the mean score change method were consistently higher than those of ROC analysis and were adopted as the MCIDs. The MCIDs were 10 for the total HSS-DDI total score, 8 for the SWAL-QOL, and 6 for the MDADI.

CONCLUSIONS

Improvements of less than 10 points for the HSS-DDI score, 9 points for the SWAL-QOL, and 6 points for the MDADI are unlikely to be perceived by patients to be clinically important. Future studies on dysphagia after anterior cervical surgery should report between-group differences in light of this, rather than focusing on p values and statistical significance.

LEVEL OF EVIDENCE

Level III, therapeutic study.

Understanding haemophilia caregiver burden: does appraisal buffer the impact of haemophilia on caregivers over time?

Objective: The present work investigated haemophilia caregiver and patient characteristics associated with change in negative and positive aspects of caregiving. Design: Web-based survey data were collected from haemophilia A or B caregivers at baseline and two years later. Main Outcome Measures: Outcomes included Burden Summary and Positive Emotions change scores from the Haemophilia Caregiver Impact measure. Results: The sample included 323 caregivers (71% response rate; mean age 40, 90% female). Brief Appraisal Inventory Principal Components Analysis with varimax rotation yielded five scores: Awareness of Challenges, Fulfillment and Growth, Stay Positive, Social Comparison, and Interpersonal Problem-Solving. Regression analyses revealed that caregivers with more health conditions, who care for patients with increased bleeds and worse pain, and who focused more on Awareness of Challenges, Social Comparisons, and Interpersonal Problem-Solving reported worsened burden over follow-up (Adj. R² = 0.37). Prioritisation of Stay[ing] Positive and reduced emphasis on Interpersonal Problem-Solving were associated with increased Positive Emotions (Adj. R² = 0.32). Conclusion: Caregivers who focused less on a life unfettered by caregiving, comparing themselves to others, and interpersonal problem-solving and more on staying positive reported reductions in burden and improvements in positive emotions. These findings could translate to multicomponent psychoeducational interventions to help caregivers buffer haemophilia's impact.

Responsiveness of standard spine outcome tools: do they measure up?

OBJECTIVE

Over the past 2 decades, spine outcome research has become more standardized in response to recommendations from Deyo and others. By using the same generic and condition-specific patient-reported outcome (PRO) measures across studies, results are more easily compared. Given the challenges of maintaining high-quality data in clinical research studies, it would be important to evaluate the contribution of each PRO to confirm that it merits the respondent burden. This study aimed to examine the spine PROs' association with clinically important change and relative responsiveness in explaining variance in patients' global assessment of change (GAC).

METHODS

This prospective longitudinal cohort study included adults recruited from 4 active spine surgery practices at a Toronto-based hospital. Patients were diagnosed with a degenerative lumbar spinal condition and underwent spinal decompression and/or fusion surgery. Participants completed the RAND-36 (to generate the physical component score [PCS] and mental component score [MCS]), Oswestry Disability Index (ODI), the numeric rating scale (NRS) for pain, Patient-Reported Outcomes Measurement Information System (PROMIS) pain interference, and a GAC item. Random-effects models were used to investigate the sensitivity of PROs to the GAC and their responsiveness over time (i.e., PRO main effects and PRO-by-time interactions, respectively).

RESULTS

The study sample included 168 patients (mean age 61 years, 50% female) with preoperative and up to 12 months of postoperative data. Random-effects models revealed significant main effects for all PROs. Significant time-by-PRO interactions were detected for the PCS, PROMIS, ODI, and NRS (p < 0.0005 in all cases), but not for the MCS. Further examination revealed different sensitivity of the PROs to the GAC at different times. The NRS, PROMIS, and PCS showed higher sensitivity early after surgery, and the PCS evinced a marked drop in sensitivity to the GAC at about 8 months postsurgery.

CONCLUSIONS

All PROs currently included in the spine outcome core measures are associated with patients' subjective assessment of a clinically important change, and all but the MCS scores are responsive to such change. Based on these findings, the core spine PROs could be reduced to include fewer estimates of pain. The authors suggest replacing the less responsive measures with tools that help to characterize factors that are driving the patients' subjective assessment of change and that meaningfully address some of the higher levels in the hierarchy of quality-of-life outcomes.

Does response shift impact interpretation of change even among scales developed using item response theory?

Background

Response-shift effects impact the interpretation of change in quality-of-life (QOL) measures developed with classical test theory (CTT) methods. This study evaluated the impact of response shift on measures developed using Item Response Theory (IRT), as compared to CTT.

Methods

Chronically ill patients and caregivers (n = 1481) participated in a web-based survey at baseline and 17 months later. Patients completed the IRT-based PROMIS-10; NeuroQOL Applied Cognition, Positive Affect & Well-Being short-forms; and the CTT-based Ryff Environmental Mastery subscale. Response-shift effects were evaluated using regression residual modeling and the QOL Appraisal Profile-v2. The sample was divided into positive and negative catalyst groups on the basis of marital, work, job-status, and comorbidity change. Regression models predicted residualized QOL change scores as a function of catalysts and appraisal changes.

Results

In this sample 859 (58%) reported a catalyst. No catalyst was associated with change in scales developed using IRT, but positive work change was associated with the CTT-based measure. Catalyst variables were associated with changes in appraisal, which in turn were related to all outcomes, particularly for global mental health after a positive work-change.

Conclusions

Appraisal processes are relevant to interpreting IRT measures, particularly for global mental health in the face of life changes.

Patient-reported outcomes in spine surgery: past, current, and future directions

The purpose of this article is to review the current state of outcome measurement in spine surgery, with an emphasis on patient-reported outcome measures (PROMs). The commonly used generic and disease-specific outcome measures used in spinal surgery and research will be discussed. The authors will introduce the concepts of response shift and appraisal processes, which may affect the face validity of PROMs, as well as their interpretation over time. It is not uncommon for there to be a discrepancy between the observed and expected outcome, which is not wholly explainable by objective measures. Current work on understanding how appraisal affects outcome measurement will be discussed, and future directions will be suggested to facilitate the continued evolution of PROMs.There has been an evolution in the way clinicians measure outcomes following spinal surgery. In moving from purely physical, objective measures to a growing emphasis on the patient's perspective, spine surgery outcomes are better able to integrate the impact at multiple levels of relevant change. Appraisal concepts and methods are gaining traction as ways to understand the cognitive processes underlying PROMs over time. Measurement of appraisal is a valuable adjunct to the current spine outcome tools.

Reconsidering the minimally important difference: evidence of instability over time and across groups

BACKGROUND CONTEXT

Underlying cognitive factors have been found to influence patients' symptom experience. Current evidence suggests that concomitant changes in appraisal must be taken into account to accurately interpret change as measured by standard spine patient-reported outcomes (PROs).

PURPOSE

To investigate changes in patients' minimally important differences (MID) over recovery from spinal surgery; whether and how cognitive appraisal processes are implicated in the change trajectories.

STUDY DESIGN/SETTING

Longitudinal cohort study with up to 12 months follow-up.

PATIENT SAMPLE

Surgical patients (n = 167) with a diagnosis of disc herniation or spinal stenosis.

OUTCOME MEASURES

Standard spine patient-reported PROs were used (Rand-36, Oswestry Disability Index, Numerical Rating Scale for pain, PROMIS Pain Impact).

METHODS

This study was funded by the Feldberg Chair in Spinal Research, Sunnybrook Health Sciences Centre and the authors have no conflicts of interest. MID used an anchor technique and was computed by global assessment of change (GAC) grouping. Participants were binned into groups based on their GAC response patterns at all time points: Consistently better post-surgery, consistently worse post-surgery, and bouncers, whose GAC ratings fluctuate (ie, better-then-worse-then-better; or vice versa). Individuals' longitudinal quality of life (QOL) and appraisal slope scores were computed. QOL-appraisal slopes' correlations were computed by GAC group. Fisher's Z transformation tested the hypothesis that GAC groups differed in the QOL-appraisal relationship over time.

RESULTS

Moderate to large changes are recognized as clinically important in the early stages of recovery (ie, 6 weeks post-surgery), and over time smaller and smaller changes become important. The three pattern groups emphasized and deemphasized different standards of comparison over time, with the Better group emphasizing personal goals and the Worse and Bouncers deemphasizing doctors' input. These group differences translated to differential relationships between PRO change and appraisal changes over time.

CONCLUSIONS

The MID reflects increasingly subtle change over time in PROs. Appraisal may influence how patients experience the same (MID) change over time, with better outcomes associated with emphasizing long-term goals. PRO change seems to be driven by different standards of comparison. Potential avenues for clinical intervention are discussed.

Are extra-spinal symptoms associated with quality of life in patients with axial spondyloarthritis? A 1-year follow-up study

To assess the extent to which a history of extra-spinal symptoms (including peripheral arthritis, heel enthesitis, or dactylitis) (HPED) is associated with quality of life (QoL) in patients with axial spondyloarthritis (axSpA) at baseline and 1-year follow-up. We analyzed data from 138 patients with axSpA from a tertiary referral center in Singapore, seen between 2011 and 2015. Demographic, clinical variables, and patient-reported outcomes [Ankylosing Spondylitis Quality of Life (ASQoL) and SF-36] at baseline and 1-year follow-up were collected. We used linear mixed models to assess the association of HPED with QoL at baseline and 1 year post-baseline. Among 138 patients (mean age 39.3 years, 74.6% males, 87.6% Chinese, disease duration 7.4 years), at baseline, HPED was associated with poorer QoL for 3 of 8 SF-36 domains [role physical (RP) scores β - 8.38, p < 0.05; social functioning (SF) scores β - 6.74, p < 0.05; role emotional (RE) scores β - 9.37, p < 0.01] and SF-36 Physical Component Summary (PCS) (β - 4.52, p < 0.01) scores, but not ASQoL scores. At 1 year post-baseline, HPED was associated with poorer ASQoL (β 1.61, p < 0.05) scores, SF-36 PCS (β - 5.61, p < 0.01) scores, and three out of eight SF-36 domains (physical functioning (PF) β - 9.60, p < 0.01; RP β - 12.17, p < 0.01; RE β - 7.87, p < 0.05) scores. HPED was associated with QoL in patients with axSpA. After 1-year, patients with HPED have poorer QoL especially for physical health domains than patients without HPED.

Leveraging Latent Dirichlet Allocation in processing free-text personal goals among patients undergoing bladder cancer surgery

PURPOSE

As we begin to leverage Big Data in health care settings and particularly in assessing patient-reported outcomes, there is a need for novel analytics to address unique challenges. One such challenge is in coding transcribed interview data, typically free-text entries of statements made during a face-to-face interview. Latent Dirichlet Allocation (LDA) offers statistical rigor and consistency in automating the interpretation of patients' expressed concerns and coping strategies.

METHODS

LDA was applied to interview data collected as part of a prospective, longitudinal study of QOL in N = 211 patients undergoing radical cystectomy and urinary diversion for bladder cancer. LDA analyzed personal goal statements to extract the latent topics and themes, stratified by time, and on things patients wanted to accomplish and prevent. Model comparison metrics determined the number of topics to extract.

RESULTS

LDA extracted seven latent topics. Prior to surgery, patients' priorities were primarily in cancer surgery and recovery. Six months after the surgery, they were replaced by goals on regaining a sense of normalcy, to resume work, to enjoy life more fully, and to appreciate friends and family more. LDA model parameters showed changing priorities, e.g., immediate concerns on surgery and resuming employment decreased post-surgery and were replaced by concerns over cancer recurrence and a desire to remain healthy and strong.

CONCLUSIONS

Novel Big Data analytics such as LDA offer the possibility of summarizing personal goals without the need for conventional fixed-length measures and resource-intensive qualitative data coding.

Comparing assessment of diabetes-related quality of life between patients and their physicians

Background

Health-related quality of life (QoL) is a comprehensive, multidimensional construct encompassing physical and psychosocial wellbeing. Physicians frequently assess QoL as part of their decision making process without specifically asking their patients. This study examined the degree and predictors of concordance between physician and patient assessments of QoL among patients with diabetes in primary care and in multi-disciplinary diabetes clinics.

Methods

Patients completed a questionnaire regarding overall and diabetes-specific QoL before entering their physician’s office. After the visit, the physician completed the same questionnaire in order to evaluate how he/she perceived that patient’s QoL. In addition, medical data relating to the patient’s health status were collected from the medical records. The concordance between patient-reported QoL and physician-estimated QoL was evaluated. Stepwise regression analysis was conducted to determine which factors contributed to the difference between physicians’ and patients’ assessment of QoL.

Results

A total of 136 patients and 39 treating physicians were surveyed. Patients’ response rate was 95%. A strong concordance was found between patients’ and physicians’ ratings of current health status (r = 0.79, p < 0. 01); however, physicians perceived their patients’ QoL as worse than the QoL assessed by the patients themselves. Primary care physicians were better at assessing their patients’ overall wellbeing while diabetes-specialists were better at assessing their patients’ diabetes-specific QoL. In addition, the longer the duration of diabetes, the more difficult is was for the physicians to accurately assess QoL. When entered in the regression analysis, familiarity did not explain physicians’ ability to assess health-related QoL or diabetes-specific QoL.

Conclusions

Physicians make reasonable assessments of their patients’ QoL, however as the patients’ disease progresses, it becomes harder for physicians to assess QoL. Primary care physicians are better at assessing overall well-being whereas diabetes specialists are better at assessing diabetes-specific QoL.

Trial registration number

Not registered. Assuta Medical Center institutional review board approval number 2009103.

Reserve-building activities attenuate treatment burden in chronic illness: The mediating role of appraisal and social support

This study examines the importance of four psychosocial factors—personality, cognitive appraisal of quality of life, social support, and current reserve-building—in predicting treatment burden in chronically ill patients. Chronically ill patients (n = 446) completed web-based measures. Structural equation modeling was used to investigate psychosocial factors predicting treatment burden. Reserve-building activities indirectly reduced treatment burden by: (1) reducing health worries appraisals, (2) reducing financial difficulties, (3) increasing calm and peaceful appraisals, and (4) increasing perceived social support. These findings point to key behaviors that chronically ill people can use to attenuate their treatment burden.

Quality of Life and Adaptation in People With Spinal Cord Injury: Response Shift Effects From 1 to 5 Years Postinjury

OBJECTIVE

To investigate response shift effects in spinal cord injury (SCI) over 5 years postinjury.

DESIGN

Prospective cohort study observed at 1, 2, and 5 years post-SCI.

SETTING

Specialized SCI centers.

PARTICIPANTS

Sample included 1125, 760, and 219 participants at 1, 2, and 5 years post-SCI (N = 2104). The study sample was 79% men; 39% were motor/sensory complete (mean age, 44.6±18.3y).

INTERVENTIONS

Not applicable.

MAIN OUTCOME MEASURES

Patient-reported outcomes included the Medical Outcomes Study 36-Item Short-Form Health Survey version 2 and the Life Satisfaction-11 Questionnaire. Participant latent variable scores were adjusted for (1) potential attrition bias and (2) propensity scores reflecting risk of worse outcomes. The Oort structural equation modeling approach for detecting and accounting for response shift effects was used to test the hypothesis that people with SCI would undergo response shifts over follow-up.

RESULTS

The study data comprised the time after FIM scores, an objective measure of motor and cognitive function, had improved and stabilized. Three latent variables (Physical, Mental, and Symptoms) were modeled over time. The response shift model indicated uniform recalibration and reconceptualization response shift effects over time. When adjusted for these response shift effects, Physical showed small true change improvements at 2- and 5-year follow-up, despite FIM stability.

CONCLUSIONS

We detected recalibration and reconceptualization response shift effects in 1- to 5-year follow-up of people with SCI. Despite stable motor and cognitive function, people with SCI are adapting to their condition. This adaptation reflects a progressive disconnection between symptoms and physical or mental health, and a real improvement in the Physical latent variable.

Development of a practical outcome measure to account for individual differences in quality-of-life appraisal: the Brief Appraisal Inventory

BACKGROUND

The present study evaluated the distributional and structural characteristics and explanatory power of the 23-item Brief Appraisal Inventory (BAI), a more practical appraisal measure for use in clinical research and practice.

METHODS

A heterogeneous, online cohort of chronic disease patients and caregivers completed the BAI, along with demographics, comorbidities, PROMIS-10, and the Brief NEO Personality Inventory. Principal components, bivariate, and linear and logistic regression analyses addressed BAI item distributions, structure, and construct validity.

RESULTS

The study sample (n = 592) had a mean age of 43.8 (SD = 18.5), and was 79% female. The BAI items exhibited good distributions, and principal component analysis yielded five composite scores: (1) Health Worries; (2) Interpersonal and Independence concerns; (3) Accomplishing Goals and Problem-Solving; (4) Calm, Peaceful, and Active; (5) Spiritual Growth and Altruism. The construct validity of appraisal factors is supported by their zero-order correlations with demographic, health, personality, and health-related QOL measures. Comparisons of appraisal-correlates among comorbidity-burden subgroups shed light on the mediating role that appraisal may play in adapting to chronic illness. Appraisal moderated the influence of comorbidities on emotional but not physical functioning. The performance of the BAI in explaining unique variance in physical and emotional functioning is comparable to results obtained with earlier measures.

CONCLUSIONS

The BAI provides a practical, short tool for evaluating appraisal in a wide range of assessment situations. Future research might utilize the BAI in longitudinal research aimed at detecting response-shift effects over time, and in clinical settings to improve patient-provider communication about concerns related to health, health care, or QOL.

Distinguishing appraisal and personality influences on quality of life in chronic illness: introducing the quality-of-life Appraisal Profile version 2

BACKGROUND

Cognitive appraisal of quality of life (QOL) differs across individuals in ways that explain otherwise paradoxical findings, such as similar QOL ratings among individuals in highly divergent health states. Although warranted by a growing body of evidence, routine assessment of appraisal in QOL research has been impeded by measurement challenges. This study describes the QOL Appraisal Profile-version 2 (QOLAPv2), a new measure that addresses these challenges.

METHODS

A heterogeneous, on-line cohort of chronic disease patients and caregivers completed the QOLAPv2, along with demographics, PROMIS10 and Brief NEO Personality Inventory (NEO-PI). Analyses address the psychometric properties and construct validity of this new measure using principal components, bivariate, canonical correlation, and linear regression analyses.

RESULTS

Analysis including 4173 respondents yielded 12 second-order QOLAPv2 principal components. Appraisal components varied with age and disease duration. Appraisals involving "Wellness," "Health," and "Recent Challenges" were correlated with QOL and with NEO-PI scales of "Agreeableness" and "Conscientiousness." Canonical correlation analysis revealed that QOL scales were associated with appraisals involving "Spirituality," "Anticipating Decline," and "Lightness of Being." Appraisal dimensions of "Relationships," "Maintaining Roles," "Independence," "Pursuing Dreams," and "Lightness of Being" were also associated with personality scales. Appraisal measures accounted for significantly more variance in QOL than personality and demographics alone.

CONCLUSIONS

Findings corroborate the Rapkin and Schwartz QOL appraisal theory. QOL appraisal measures correlate as expected with personality scales, and explain more variance in QOL than does personality. The QOLAPv2 can be used across populations to provide insight into patients' concerns, salient experiences, and comparators.