Reconsidering the psychometrics of quality of life assessment in light of response shift and appraisal

Poststroke Communication Ability Predicts Patient-Informant Discrepancies in Reported Activities and Participation

BACKGROUND

Participation in life situations has been identified by people with aphasia (PWA) as an ultimate outcome of rehabilitation and is often measured with patient-reported outcome measures (PROMs) or informant-reported measures. It is known that PWA and informants do not always produce similar scores on measures of activities and participation. However, systematic differences between PWA and informants and the causes of these differences are not well understood. Here, we investigated these differences as a function of language impairment, perceived level of activity and participation success, and depressive symptoms.

METHOD

Participants were 29 PWA-informant dyads who completed a performance-based language assessment and three measures related to different aspects of activities and participation. Outcome variables were PWA-informant difference scores in the activities and participation measures.

RESULTS

PWA ratings of activities and participation were not statistically significantly associated with performance-based language severity. Hierarchical regression models with both language impairment and informant-reported scores as predictor variables explained 53%-71% of the variance in PWA-informant difference scores (all p < .05). In particular, mild communication challenges were associated with the PWA reporting significantly worse participation than the informant perceived. In contrast, more severe communication challenges were associated with the PWA reporting significantly better participation than the informant perceived.

DISCUSSION

These findings highlight the importance of measuring participation by PROM. The PWA's experience of participation is not related to their level of language impairment and is predictably different from their care partners' perspective. As others have also reported, "mild" aphasia is not so mild to the PWA. Similarly, "severe" may not be so severe to the PWA. Further research is needed to connect these findings with counseling and caregiver education. Research on response processes (e.g., response shift) is also warranted.

Measuring reconceptualization and reprioritization during France's first COVID-19-related lockdown in women with and without a history of cancer: an adaptation of the SeiQol-DW and PGI

PURPOSE

This study aimed to provide a better understanding of the patient-perceived effects of France's first COVID-19-related lockdown on the quality of life (QoL) of women affected by cancer, and to test an ad hoc measurement scale for evaluating quasi-individualized QoL. QoL was measured for both during (i.e., current) and before (i.e., retrospectively) the lockdown. Respondents were women registered on the research platform Seintinelles.

METHODS

A tool for measuring quasi-individualized QoL was adapted from the SeiQol-DW and PGI. It was distributed as part of a larger online self-questionnaire to a sample of 1303 women with a history of cancer (i.e., former or current) and with no such history.

RESULTS

Current and retrospective QoL scores were not significantly different between the two respondent groups. An analysis of reconceptualization and reprioritization revealed a cancer-specific effect: women with a history of cancer reconceptualized more, while women with no such history reprioritized more.

CONCLUSION

Our novel ad hoc quasi-qualitative tool made it possible to assess the QoL of women with a history of cancer, a particularly vulnerable population in the context of the COVID-19 pandemic. Furthermore, it highlighted a difference in reconceptualization and reprioritization between this population and women with no such history.

Individual differences in the long-term impact of the pandemic: moderators of COVID-related hardship, worry, and social support

PURPOSE

Understanding people's response to the pandemic needs to consider individual differences in priorities and concerns. The present study sought to understand how individual differences in cognitive-appraisal processes might moderate the impact of three COVID-specific factors-hardship, worry, and social support-on reported depression.

METHODS

This longitudinal study of the psychosocial impact of the COVID-19 pandemic included 771 people with data at three timepoints over 15.5 months. Participants were recruited from panels of chronically ill or general population samples. Depression was measured by an item response theory validated depression index created using items from existing measures that reflected similar content to the Patient Health Questionnaire-8. COVID-specific factors of hardship, worry, and social support were assessed with items compiled by the National Institutes of Health. The Quality of Life Appraisal Profilev2 Short-Form assessed cognitive appraisal processes. A series of random effects models examined whether appraisal moderated the effects of hardship, worry, and social support on depression over time.

RESULTS

Over time the association between low social support and depression was greater (p = 0.0181). Emphasizing the negative was associated with exacerbated depression, in particular for those with low social support (p = 0.0007). Focusing on demands and habituation was associated with exacerbated depression unless one experienced greater hardship (p = 0.0074). There was a stronger positive connection between recent changes and depression for those people with higher worry scores early in the pandemic as compared to later, but a stronger positive correlation for those with lower worry scores later in the pandemic (p = 0.0015). Increased endorsement of standards of comparison, emphasizing the negative, problem goals, and health goals was associated with worse depression scores (all p < 0.0001). People who were younger, disabled, or had greater difficulty paying bills also reported worse depression (p < 0.0001, 0.0001, and 0.002, respectively).

CONCLUSION

At the aggregate level, COVID-specific stressors changed over the course of the pandemic, whereas depression and social-support resources seemed stable. However, deeper analysis revealed substantial individual differences. Cognitive-appraisal processes showed considerable variability across individuals and moderated the impact of COVID-specific stressors and resources over time. Future work is needed to investigate whether coaching individuals away from maladaptive cognitive-appraisal processes can reduce depression and lead to better overall well-being.

Acoustic, Aerodynamic, Morphometric, and Perceptual Changes During and After Semi-Occluded Vocal Tract Exercise: An Integrative Review

OBJECTIVE

The body of literature discussing the acoustic, aerodynamic, perceptual, and morphometric changes that occur during and after semi-occluded vocal tract exercise (SOVTE) has dramatically expanded within the past 20 years. The current study integrates the literature on SOVTE from the 1990s onward, reviewing the technique's clinically relevant effects in vocally untrained adults both with and without dysphonia. The study aims to give clinicians actionable information on how SOVTEs alter vocal function in both normal and pathological states.

METHODS

The author queried the MEDLINE database for combinations of search terms related to semi-occluded vocal tract exercise. To improve article identification, the author also performed iterative citation webbing in which the reference lists of each article selected for full-text screening were cross-referenced against the articles returned in the initial MEDLINE search. Articles identified by iterative citation webbing that did not appear in the initial MEDLINE search were then screened individually. The second author independently verified adherence to the review's inclusion and exclusion criteria in both the initial search and data extraction phases.

RESULTS

The initial MEDLINE search returned 869 articles, 111 of which passed the title and abstract screening phase. Iterative citation webbing returned an additional 20 studies, resulting in a total of 131 articles that qualified for full-text screening. 53 articles passed full-text screening and were included in the current review.

DISCUSSION

Semi-occluded vocal tract exercise increases the inertive reactance of the glottis, vocal tract, and air column, as well as introducing flow resistance at the level of the lips or velopharyngeal port. Each of these mechanisms yields downstream acoustic, aerodynamic, morphometric, and perceptual changes, including reductions in phonation threshold pressure and perceived phonatory effort, improved spectral characteristics of the acoustic signal, attenuation of vocal fold impact stress as indexed by various metrics such as maximum area declination rate, and alterations to the physical dimensions of the vocal tract. Although few studies examined the duration of these changes post exercise, several RCTs support the assertion that SOVTE's effects can be sustained with regular practice over weeks or months, regardless of current vocal health status.

The minimal important difference for the Postural Assessment Scale for Stroke Patients in the subacute stage

BACKGROUND

The minimal important difference (MID) of the Postural Assessment Scale for Stroke Patients (PASS) remains unknown, limiting the interpretation of change scores.

OBJECTIVES

To estimate the MID of the PASS in patients with subacute stroke.

METHODS

Data at admission and discharge for 240 participants were retrieved from a longitudinal study. The "mobility" item of the Barthel Index was used as the anchor for indicating the improvement of posture control. Receiver operating characteristic (ROC) method was used to estimate the anchor-based MID of the PASS.

RESULTS

The ROC method identified a MID of 3.0 points, with a sensitivity of 81.0 % and a specificity of 75.6 %.

CONCLUSION

The MID of the PASS was 3.0 points, indicating that if a patient achieves an improvement of 3.0 or more points on the PASS, they have a clinically important improvement in posture control. Our results can help in interpreting change scores and aid in understanding the clinical values of treatment outcomes.

Self-care strategies for medical students: an uncontrolled mixed-methods evaluation of a mind-body-medicine group course

BACKGROUND

High stress during medical education and its detrimental effects on student health is well documented. This exploratory evaluation study assesses a 10-week Mind-Body-Medicine student course, created to promote student self-care at Charité Universitätsmedizin Berlin, Germany.

METHODS

During 2012-2019, uncontrolled quantitative and qualitative data were gathered from 112 student participants. Outcomes including changes in perceived stress (PSS), mindfulness (FMI/MAAS), self-reflection (GRAS), self-efficacy (GSE), empathy (SPF), and health-related quality of life (SF-12) were measured between the first (T0) and last sessions (T1). Qualitative data were obtained in focus groups at course completion and triangulated with quantitative data.

RESULTS

Quantitative outcomes showed decreases in perceived stress and increased self-efficacy, mindfulness, self-reflection, and empathy. In focus groups, students reported greater abilities to self-regulate stressful experiences, personal growth and new insights into integrative medicine. Triangulation grounded these effects of MBM practice in its social context, creating an interdependent dynamic between experiences of self and others.

CONCLUSION

After completing an MBM course, students reported reduced perceived stress, increased self-efficacy, mindfulness, empathy and positive engagement with integrative concepts of doctor-patient relationships. Further research with larger randomized confirmatory studies is needed to validate these benefits.

Depression trajectories during the COVID-19 pandemic: a secondary analysis of the impact of cognitive-appraisal processes

PURPOSE

This study characterized depression trajectories during the COVID pandemic and investigated how appraisal and changes in appraisal over time related to these depression trajectories.

METHODS

This longitudinal study of the psychosocial impact of the COVID-19 pandemic included 771 people with data at three timepoints over 15.5 months. The depression index was validated using item-response-theory methods and receiver-operating-characteristic curve analysis. The Quality of Life (QOL) Appraisal Profile_v2 Short-Form assessed cognitive-appraisal processes. Sequence analysis characterized depression-trajectory groups, and random effects models examined appraisal main effects, appraisal-by-group, and appraisal-by-group-by-time interactions.

RESULTS

Sequence analysis generated six trajectory groups: Stably Well (n = 241), Stably Depressed (n = 299), Worsening (n = 79), Improving (n = 83), Fluctuating Pattern 1 (No-Yes-No; n = 41), and Fluctuating Pattern 2 (Yes-No-Yes; n = 28). While all groups engaged in negative appraisal processes when they were depressed, the Stably Depressed group consistently focused on negative aspects of their life. Response-shift effects were revealed such that there were differences in the appraisal-depression relationship over time for standards of comparison and recent changes for the Stably Depressed, and in health goals for those Getting Better.

CONCLUSION

The present work is, to our knowledge, the first study of response-shift effects in depression. During these first 15.5 pandemic months, group differences highlighted the connection between negative appraisals and depression, and response-shift effects in these relationships over time. Egregious life circumstances may play a lesser role for the Stably Depressed but a greater role for people who have transient periods of depression as well as for those with improving trajectories (i.e., endogenous vs. reactive depression). How one thinks about QOL is intrinsically linked to mental health, with clear clinical implications.

Quality of life in adolescents with longstanding non-traumatic knee pain: An analysis of 316 adolescents with Patellofemoral Pain and Osgood-Schlatter Disease

OBJECTIVES

To describe the Quality of Life (QoL) among adolescents with Patellofemoral Pain (PFP) and Osgood-Schlatter Disease (OSD) and investigate characteristics associated with QoL.

STUDY DESIGN

Cross-sectional.

PARTICIPANTS

316 adolescents with PFP or OSD.

MAIN OUTCOME MEASURES

QoL subscale of The Knee injury and Osteoarthritis Outcome Score (KOOS) and the EuroQol 5-dimensions (EQ-5D).

RESULTS

The KOOS-QoL was 51 ± 18, and the total index score for the EQ5D was 0.67 ± 0.21. KOOS-QoL subscale showed that 60% reported being aware of their knee problems daily or constantly, 38% reported severe to extreme lack of confidence in their knees, 28% reported severe to extreme difficulty with their knees, and 20% reported severely or totally modifying their lifestyle to avoid potentially damaging activities to their knee. EQ-5D showed that 79% experienced problems with everyday activities, 48% reported mobility problems, 17% felt worried, sad, or unhappy, and 7% reported problems looking after themselves.

CONCLUSIONS

Many adolescents with longstanding non-traumatic knee pain experience low QoL. More than half were aware of their knee problems at least daily, one in three reported a severe lack of confidence in their knee, and one in six felt worried, sad, or unhappy.

The Functional External Memory Aid Tool Version 2.0: A How-To Clinical Guide

PURPOSE

Although compensatory cognitive rehabilitation is a common treatment approach for adults with cognitive-communication disorders, there are few assessment tools available to support clinicians in developing person-centered treatment plans. In addition to understanding a client's cognitive and functional abilities, it is also important to understand how they compensate for their weaknesses, specifically with external aids (e.g., calendars, notes), in everyday life. The Functional External Memory Aid Tool (FEMAT) is a performance-based measure that quantifies and describes external aid use during task completion.

METHOD

The purpose of this clinical focus article is to educate and equip clinicians to administer and interpretate the FEMAT with adult clients with cognitive-communication disorders. This clinical focus article describes the theoretical motivation for the FEMAT as well as the administration, scoring, and interpretation procedures for Version 2.0 of the measure. A hypothetical case example is included to illustrate how to use the FEMAT to develop person-centered goals and treatment plans.

CONCLUSIONS

The FEMAT is psychometrically sound, clinically relevant, free, easily accessible, and quick to administer and provides data that are complementary to data obtained from traditional performance-based and/or patient-reported measures. This clinical focus article describes new resources that are available to help clinicians administer and interpret Version 2.0 of the FEMAT when serving adults with cognitive-communication disorders.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21651311.

Appraisal and patient-reported outcomes following total hip arthroplasty: a longitudinal cohort study

Background

Total hip arthroplasty (THA) is a successful procedure that provides pain relief, restores function, and improves quality of life (QOL) for patients with advanced arthritis in their hip joint. To date, little research has examined the role of cognitive appraisal processes in THA outcomes. This study examined the role of cognitive appraisal processes in THA outcomes in the first year post-surgery.

Methods

This longitudinal cohort study collected data at pre-surgery, 6 weeks post-surgery, 3 months post-surgery, and 12 months post-surgery. Adults (n = 189) with a primary diagnosis of osteoarthritis were consecutively recruited from an active THA practice at a Canadian academic teaching hospital. Measures included the Hip Disability and Osteoarthritis Outcome Score (HOOS), the Mental Component Score (MCS) of the Rand-36, and the Brief Appraisal Inventory (BAI). Analysis of Variance examined the association between BAI items and the HOOS or MCS scores. Random effects models investigated appraisal main effects and appraisal-by-time interactions for selected BAI items.

Results

HOOS showed great improvement over the first 12 months after THA, and was mitigated by three appraisal processes in particular: focusing on problems with healthcare or living situation, and preparing one’s family for health changes. MCS was stable and low over time, and the following appraisal processes were implicated by very large effect sizes: not comparing themselves to healthier people, focusing on money problems, preparing their family for their health changes, or trying to shed responsibilities.

Conclusions

Appraisal processes are relevant to health outcomes after THA, with different processes coming into play at different points in the recovery trajectory.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41687-022-00498-z.

Drivers of caregiver impact in Duchenne muscular dystrophy: a cohort study

Background

In our companion paper, we addressed the interplay between caregiver impact, out-of-pocket expenditures, and Duchenne Muscular Dystrophy (DMD) disability. We found that DMD caregiver impact could be characterized by four Latent Profile Analysis impact profiles: lowest, lower middle, upper middle, and highest impact. The impact on caregivers was often but not always worse with greater out-of-pocket expenditures. Further, while the lowest-, lower-middle, and highest-impact profiles reflected low, moderate and high disability-related caregiver burden, respectively, the upper-middle profile group was quite variable in level of disability across domains. To better understand the four caregiver-impact profiles, we examine how a comprehensive set of psychosocial factors differentiate the four profile groups.

Methods

Psychosocial factors assessed included demographic characteristics, quality of life (QOL), stress, cognitive appraisal, reserve-building, and general and COVID-specific resilience. Linear modeling examined relationships between impact profiles and psychosocial factors. We used effect size rather than p-value as the criterion for determining relevance of the broad range of characteristics examined.

Results

Multivariate analyses implicated stress and environmental mastery, appraisal sampling of experience, COVID-specific variables, appraisal standards of comparison, appraisal goals, demographics, appraisal combinatory algorithm, reserve-building, and resilience, in order of prominence (average eta² = 0.29, 0.29, 0.16, 0.15, 0.09, 0.07, 0.07, 0.06, 0.05, and 0.02, respectively). On the whole, comparisons of highest-versus-lowest impact profiles revealed more and larger differences than comparisons of upper-middle versus lower-middle impact profiles. Life stress, goals, and reserve-building activities had a smaller differentiating effect in the middle groups.

Conclusion

A more comprehensive ‘story’ about DMD caregiver impact involves life stress, environmental mastery, COVID-specific variables, and cognitive and behavioral factors. Implications are discussed for coaching interventions to support DMD caregivers.

Toward a rigorous assessment of the statistical performances of methods to estimate the Minimal Important Difference of Patient-Reported Outcomes: a protocol for a large-scale simulation study

Interpreting observed changes over time in Patient-Reported Outcomes (PRO) measures is still considered a challenge. Indeed, concluding an observed change at group level is statistically significant does not necessarily equate this change is meaningful from the perspective of the patient. To help interpret within and/or between group changes in the measure over time, the estimation of the Minimal Important Difference (MID) of the instrument - the smallest value that patients consider as a perceived change - is useful. In the last 30 years, a plethora of methods and estimators have been proposed to derive this MID value using clinical data from sample of patients. MIDs for hundreds of PROs have been estimated, with frequently a substantial variability in the results depending on the method used. Nonetheless, a rigorous assessment of the statistical performances of numerous proposed methods for estimating MIDs by experimental design such as Monte-Carlo study has never been performed. The purpose of this paper is to thoroughly depict a protocol for a large-scale simulation study designed to investigate the statistical performances, especially bias against a true populational value, of the common proposed estimators for MID. This paper depicts how investigated methods and estimators were retained after the conduct of a systematic review, the design of a conceptual model that formally defines what is the true populational MID value and the translation of the conceptual model into a model allowing the simulation of responses of items to a hypothetical PRO at two times of measurement along with the response to a Patient Global Rating of Change at the second time under the constraint of a known true MID value. A statistical analysis plan is depicted in order to conclude if working hypotheses on what could be appropriate MID estimators will be verified. Strengths, assumptions, and limits of the simulation model are exposed. Finally, we show how this protocol could be the basis for fostering future methodological research on the issue of interpreting changes in PRO measures.

Understanding Patients' Perceived Health After Critical Illness: Analysis of Two Prospective, Longitudinal Studies of ARDS Survivors

BACKGROUND

Perceived health is one of the strongest determinants of subjective well-being, but it has received little attention among survivors of ARDS.

RESEARCH QUESTION

How well do self-reported measures of physical, emotional, and social functioning predict perceived overall health (measured using the EQ-5D visual analog scale [EQ-5D-VAS]) among adult survivors of ARDS? Are demographic features, comorbidity, or severity of illness correlated with perceived health after controlling for self-reported functioning?

STUDY DESIGN AND METHODS

We analyzed the ARDSNet Long Term Outcomes Study (ALTOS) and Improving Care of Acute Lung Injury Patients (ICAP) Study, two longitudinal cohorts with a total of 823 survivors from 44 US hospitals, which prospectively assessed survivors at 6 and 12 months after ARDS. Perceived health, evaluated using the EQ-5D-VAS, was predicted using ridge regression and self-reported measures of physical, emotional, and social functioning. The difference between observed and predicted perceived health was termed perspective deviation (PD). Correlations between PD and demographics, comorbidities, and severity of illness were explored.

RESULTS

The correlation between observed and predicted EQ-5D-VAS scores ranged from 0.68 to 0.73 across the two cohorts and time points. PD ranged from -80 to +34 and was more than the minimum clinically important difference for 52% to 55% of survivors. Neither demographic features, comorbidity, nor severity of illness were correlated strongly with PD, with |r| < 0.25 for all continuous variables in both cohorts and time points. The correlation between PD at 6- and 12-month assessments was weak (ALTOS: r = 0.22, P < .001; ICAP: r = 0.20, P = .02).

INTERPRETATION

About half of survivors of ARDS showed clinically important differences in actual perceived health vs predicted perceived health based on self-reported measures of functioning. Survivors of ARDS demographic features, comorbidities, and severity of illness were correlated only weakly with perceived health after controlling for measures of perceived functioning, highlighting the challenge of predicting how individual patients will respond psychologically to new impairments after critical illness.

Validation of the Sri Lankan Health-Related Quality-of-Life Index for pre-schoolers (SLHQL-P) and school age (SLHQL-S) children with epilepsy

INTRODUCTION

Health-related quality of life (HRQL) in children and adolescents remains an underappreciated problem in Asian region, due to lack of culturally sound HRQL measures. This paper describes the validation process of two age-specific, proxy-rated HRQL indexes namely Sri Lankan Health-Related Quality-of-Life Index for preschoolers (SLHQL-P) and school age children (SLHQL-S) with epilepsy.

METHODS

Primary caregivers of children and adolescents with epilepsy aged 1-18 years from three districts in Sri Lanka were invited to fill the SLHQL-P (for 1-5 years) and SLHQLS (for 6-18 years). It was re-administered to a subset of consenting primary caregivers after an interval of two weeks. Scientific soundness of SLHQL-P and SLHQL-S were established based on causal indicator model.

RESULTS

Total of 98 and 169 primary caregivers responded to SLHQL-P, SLHQL-S respectively. Final questionnaires of SLHQL-P and SLHQL-S consists of 26, 57 items respectively in three multi-item domains measuring the child's physical functioning (6, 9 items), psychological functioning (6, 31 items) and social functioning (14, 17 items) with higher scores reflecting better HRQL. Construct validity was established by several methods including strong relationship with seizure severity. Good test-retest reliability was also demonstrated for both SLHQL-P and SLHQL-S (r = 0.77, 0.938) CONCLUSIONS: Both SLHQL-P and SLHQL-S are feasible, reliable and valid instruments to measure HRQL in children and adolescents with epilepsy in clinical as well as research settings in Sri Lanka.

If it's information, it's not "bias": a scoping review and proposed nomenclature for future response-shift research

BACKGROUND

The growth in response-shift methods has enabled a stronger empirical foundation to investigate response-shift phenomena in quality-of-life (QOL) research; but many of these methods utilize certain language in framing the research question(s) and interpreting results that treats response-shift effects as "bias," "noise," "nuisance," or otherwise warranting removal from the results rather than as information that matters. The present project will describe the various ways in which researchers have framed the questions for investigating response-shift issues and interpreted the findings, and will develop a nomenclature for such that highlights the important information about resilience reflected by response-shift findings.

METHODS

A scoping review was done of the QOL and response-shift literature (n = 1100 articles) from 1963 to 2020. After culling only empirical response-shift articles, raters characterized how investigators framed and interpreted study research questions (n = 164 articles).

RESULTS

Of 10 methods used, papers using four of them utilized terms like "bias" and aimed to remove response-shift effects to reveal "true change." Yet, the investigators' reflections on their own conclusions suggested that they do not truly believe that response shift is error to be removed. A structured nomenclature is proposed for discussing response-shift results in a range of research contexts and response-shift detection methods.

CONCLUSIONS

It is time for a concerted and focused effort to change the nomenclature of those methods that demonstrated this misinterpretation. Only by framing and interpreting response shift as information, not bias, can we improve our understanding and methods to help to distill outcomes with and without response-shift effects.

Clinical Use of PROMIS, Neuro-QoL, TBI-QoL, and Other Patient-Reported Outcome Measures for Individual Adult Clients with Cognitive and Language Disorders

Patient-reported outcome measures (PROMs) assess health outcomes from the patient's perspective. The National Institutes of Health has invested in the creation of numerous PROMs that comprise the PROMIS, Neuro-QoL, and TBI-QoL measurement systems. Some of these PROMs are potentially useful as primary or secondary outcome measures, or as contextual variables for the treatment of adults with cognitive/language disorders. These PROMs were primarily created for clinical research and interpretation of group means. They also have potential for use with individual clients; however, at present there is only sparse evidence and direction for this application of PROMs. Previous research by Cohen and Hula (2020) described how PROMs could support evidence-based practices in speech-language pathology. This companion article extends upon that work to present clinicians with implementation information about obtaining, administering, scoring, and interpreting PROMs for individual clients with cognitive/language disorders. This includes considerations of the type and extent of communication support that is appropriate, implications of the relatively large measurement error that accompanies individual scores and pairs of scores, and recommendations for applying minimal detectable change values depending on the clinician's desired level of measurement precision. However, more research is needed to guide the interpretation of PROM scores for an individual client.

Creating idiometric short-form measures of cognitive appraisal: balancing theory and pragmatics

BACKGROUND

The Rapkin and Schwartz appraisal theory and measure provided a path toward documenting response-shift effects and describing individual differences in ways of thinking about quality of life (QOL) that distinguished people in different circumstances. Recent work developed and validated the QOL Appraisal Profile_{version 2} (QOLAP_v2), an 85-item measure that taps response-shift-detection domains of Frame of Reference, Standards of Comparison, Sampling of Experience, and Combinatory Algorithm. Recent theoretical work proposed that appraisal measurement constitutes a new class of measurement (idiometric), distinct from psychometric and clinimetric. To validate an idiometric measure, one would document that its items reflect different circumstances and population characteristics, and explain variance in QOL. The present work sought to develop idiometric short-forms of the QOLAP_v2 item bank by examining which items were most informative, retaining the appraisal-domain structure.

METHODS

This secondary analysis (n = 1481) included chronically-ill patients and their caregivers from a longitudinal web-based survey (mean follow-up 16.6 months). Data included the QOLAP_v2, the Center for Disease Control Healthy Days Core Module, the PROMIS-10 Global Health, and demographic/medical variables. Appraisal items were measured at baseline (relevant to understanding cognitive appraisal processes); and with change scores (sensitive to response-shift effects). Multivariate analysis of covariance examined what demographic and health-status change variables were reflected by each of 85 appraisal items (in five sets), as dependent variables, and other demographic/medical variables. Multiple linear regression examined how appraisal items explained variance in global physical- and mental-health change, after covariate adjustment. A tally summarized item performance across all five sets of cross-sectional and longitudinal analyses.

RESULTS

The vast majority (i.e., 80%) of the QOLAP_v2 items performed well across the analyses presented. Using a relatively strict criterion of explaining meaningful variance across 60% of analyses, one would retain 68 items. A more lenient criterion (40%) would retain 71.

CONCLUSIONS

The present study provides heuristics to support investigators' creating 'discretionary' QOLAP_v2 short-forms to fit their study aim and amplifying individual differences in the cognitive processes underlying QOL. This approach enables adapting the measure to the study population, as per the expectation that respondent populations differ in the predominant cognitive processes used.

The minimal perceived change: a formal model of the responder definition according to the patient's meaning of change for patient-reported outcome data analysis and interpretation

Background

Patient-Reported Outcomes (PROs) are standardized questionnaires used to measure subjective outcomes such as quality of life in healthcare. They are considered paramount to assess the results of therapeutic interventions. However, because their calibration is relative to internal standards in people’s mind, changes in PRO scores are difficult to interpret.

Knowing the smallest value in the score that the patient perceives as change can help. An estimator linking the answers to a Patient Global Rating of Change (PGRC: a question measuring the overall feeling of change) with change in PRO scores is frequently used to obtain this value. In the last 30 years, a plethora of methods have been used to obtain these estimates, but there is no consensus on the appropriate method and no formal definition of this value.

Methods

We propose a model to explain changes in PRO scores and PGRC answers.

Results

A PGRC measures a construct called the Perceived Change (PC), whose determinants are elicited. Answering a PGRC requires discretizing a continuous PC into a category using threshold values that are random variables. Therefore, the populational value of the Minimal Perceived Change (MPC) is the location parameter value of the threshold on the PC continuum defining the switch from the absence of change to change.

Conclusions

We show how this model can help to hypothesize what are the appropriate methods to estimate the MPC and its potential to be a rigorous theoretical basis for future work on the interpretation of change in PRO scores.

Was it worth it? Benefits of transcatheter aortic valve implantation from a patient's perspective

OBJECTIVES

Transcatheter aortic valve implantation (TAVI) is an important treatment option for patients with severe aortic stenosis. To improve patient selection, shared decision-making is recommended to elicit patients' treatment expectations and goals. We assessed patients' expectations and goals before TAVI treatment and whether these were met after treatment. Additionally, we evaluated how meeting these goals aligned with quality of life and functional recovery.

DESIGN

A mixed method study.

SETTING

An academic medical center.

PARTICIPANTS

Seventy-four patients undergoing TAVI between 2015 and 2017.

MEASUREMENTS

Patients' expectations and goals were assessed qualitatively before treatment. Six to twelve months post procedure, quality of life was measured with the EuroQuol-5D and any change in the number of dependencies in (instrumental) activities of daily living was assessed.

RESULTS

Mean age of patients was 81.5 years, and 37.8% were male. Regaining the ability to engage in a specific hobby or activity was the most important treatment goal (33 patients, 54.1%), followed by reducing symptoms (19 patients 31.1%). 66.2% of patients stated that their treatment goal was met. Quality of life was higher in this group, as compared with patients who had not met their treatment goal. Twenty-three patients (31.1%) showed functional improvement.

CONCLUSION

TAVI patients were quite capable of eliciting treatment goals and a majority stated, after treatment, that these had been met patients' experience of treatment benefits regarding these goals had poor alignment with functional outcomes. This raises questions regarding relevant outcome measurements in this population, and could aid in improving shared decision-making and patient selection for TAVI.

The use of Oral Health Impact on Daily Living (OHIDL) transition scale in measuring the change in oral health-related quality of life among older adults

Background

This longitudinal study aimed to evaluate the longitudinal validity and reliability of the Oral Health Impact on Daily Living (OHIDL) transition scale and measure the perceived change in oral health-related quality of life (OHRQoL) after dental treatments among older adults.

Methods

OHIDL was administered to older adults who sought dental treatments. Participants were asked to assess changes in impact for each OHIDL item retrospectively compared with that before the treatment. The responsiveness, minimal clinically important difference (MCID), internal consistency and test–retest reliability of the OHIDL transition scale were evaluated. Multiple linear regression was employed to predict the change in oral health impacts after dental treatment. Beta coefficients (β) and 95% confidence intervals (CI) were reported.

Results

One hundred and seventy-six participants were followed-up with upon completing their dental treatments. The follow-up rate was 70.4% (176/250). The OHIDL transition score strongly correlated with the global rating of change (r_s = 0.76, P < 0.01). MCID was determined by participants who reported “a little improved” in the perceived oral health impacts, and their mean transition score was 3.3. Cronbach’s alpha of the transition scale was 0.87, and many items had a test–retest correlation of at least 0.60. Patients who perceived more oral health impacts at baseline as measured by the total intensity score (β = 0.32, 95% CI: 0.20, 0.44, P < 0.001) and those who had received endodontic treatment (β = 8.04, 95% CI: 4.36, 11.71, P < 0.001) would have more improvement in perceived oral health impacts.

Conclusions

The OHIDL transition scale has good psychometric properties and is sensitive to change over time. After receiving dental treatment, most of the study’s older adults perceived a lower intensity of OHIDL.

Clinical relevance

The OHIDL transition scale is a valid and reliable instrument to measure the change in OHRQoL after dental treatments.

Response shift in patient-reported outcomes: definition, theory, and a revised model

Purpose

The extant response shift definitions and theoretical response shift models, while helpful, also introduce predicaments and theoretical debates continue. To address these predicaments and stimulate empirical research, we propose a more specific formal definition of response shift and a revised theoretical model.

Methods

This work is an international collaborative effort and involved a critical assessment of the literature.

Results

Three main predicaments were identified. First, the formal definitions of response shift need further specification and clarification. Second, previous models were focused on explaining change in the construct intended to be measured rather than explaining the construct at multiple time points and neglected the importance of using at least two time points to investigate response shift. Third, extant models do not explicitly distinguish the measure from the construct. Here we define response shift as an effect occurring whenever observed change (e.g., change in patient-reported outcome measures (PROM) scores) is not fully explained by target change (i.e., change in the construct intended to be measured). The revised model distinguishes the measure (e.g., PROM) from the underlying target construct (e.g., quality of life) at two time points. The major plausible paths are delineated, and the underlying assumptions of this model are explicated.

Conclusion

It is our hope that this refined definition and model are useful in the further development of response shift theory. The model with its explicit list of assumptions and hypothesized relationships lends itself for critical, empirical examination. Future studies are needed to empirically test the assumptions and hypothesized relationships.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-021-02846-w.

Evaluating quality of life in frailty: applicability and clinimetric properties of the SarQoL® questionnaire

BACKGROUND

The SarQoL® questionnaire was specifically designed to measure quality of life (QoL) in sarcopenia. Frailty and sarcopenia have areas of overlap, notably weak muscle strength and slow gait speed, which may mean that the SarQoL could provide a measure of QoL in frailty. This study aimed to evaluate the clinimetric properties of the SarQoL questionnaire in physical frailty using the Fried criteria.

METHODS

Analyses were carried out on data from the Sarcopenia and Physical impairment with advancing Age study. Frailty was assessed with the Fried criteria and QoL with the SarQoL, the Short-Form 36-Item, and the EuroQoL 5-Dimension (EQ-5D) questionnaires. We evaluated discriminative power (with the Kruskal-Wallis analysis of variance test), internal consistency (with Cronbach's alpha), construct validity (through hypotheses testing), test-retest reliability (with the intraclass correlation coefficient), measurement error (calculating standard error of measurement and smallest detectable change), and responsiveness (through hypotheses testing and standardized response mean).

RESULTS

In total, 382 participants were included for the validation and 117 for the responsiveness evaluation. They had a median age of 73 (69-79) years, took 5 (3-8) drugs, and had 4 (3-5) co-morbidities. There were more women (n = 223; 58.4%) than men and, in total, 172 (45%) robust, 167 (44%) pre-frail, and 43 (11%) frail participants. Discriminative power was confirmed when significantly lower (P < 0.001) overall SarQoL scores, and thus also worse QoL, were observed between robust [77.1 (64.35-85.90)], pre-frail [62.54 (53.33-69.57)], and frail [49.99 (40.45-56.06)] participants. Six of the SarQoL domains performed likewise, with significantly lower scores according to frailty status with Domain 7 (fears) being the exception. Internal consistency was good (α = 0.866). Convergent (using Short-Form 36-Item and EQ-5D) and divergent construct validity (using EQ-5D) was confirmed. Test-retest reliability was excellent [intraclass correlation coefficient = 0.918 (0.834-0.961)], with a standard error of measurement of 3.88 and a smallest detectable change of 10.76 points. We found moderate responsiveness when five of the nine hypotheses were confirmed, coupled with a large effect size for the overall SarQoL score (corrected standardized response mean of -1.44).

CONCLUSIONS

The SarQoL questionnaire has adequate clinimetric properties for use with frail patients in clinical practice and trials and could provide data that are more appropriate and detailed than the generic questionnaires currently used.

Implications of response shift for micro-, meso-, and macro-level healthcare decision-making using results of patient-reported outcome measures

PURPOSE

Results of patient-reported outcome measures (PROMs) are increasingly used to inform healthcare decision-making. Research has shown that response shift can impact PROM results. As part of an international collaboration, our goal is to provide a framework regarding the implications of response shift at the level of patient care (micro), healthcare institute (meso), and healthcare policy (macro).

METHODS

Empirical evidence of response shift that can influence patients' self-reported health and preferences provided the foundation for development of the framework. Measurement validity theory, hermeneutic philosophy, and micro-, meso-, and macro-level healthcare decision-making informed our theoretical analysis.

RESULTS

At the micro-level, patients' self-reported health needs to be interpreted via dialogue with the clinician to avoid misinterpretation of PROM data due to response shift. It is also important to consider the potential impact of response shift on study results, when these are used to support decisions. At the meso-level, individual-level data should be examined for response shift before aggregating PROM data for decision-making related to quality improvement, performance monitoring, and accreditation. At the macro-level, critical reflection on the conceptualization of health is required to know whether response shift needs to be controlled for when PROM data are used to inform healthcare coverage.

CONCLUSION

Given empirical evidence of response shift, there is a critical need for guidelines and knowledge translation to avoid potential misinterpretations of PROM results and consequential biases in decision-making. Our framework with guiding questions provides a structure for developing strategies to address potential impacts of response shift at micro-, meso-, and macro-levels.

Critical examination of current response shift methods and proposal for advancing new methods

Purpose

This work is part of an international, interdisciplinary initiative to synthesize research on response shift in results of patient-reported outcome measures. The objective is to critically examine current response shift methods. We additionally propose advancing new methods that address the limitations of extant methods.

Methods

Based on literature reviews, this critical examination comprises design-based, qualitative, individualized, and preference-based methods, latent variable models, and other statistical methods. We critically appraised their definition, operationalization, the type of response shift they can detect, whether they can adjust for and explain response shift, their assumptions, and alternative explanations. Overall limitations requiring new methods were identified.

Results

We examined 11 methods that aim to operationalize response shift, by assessing change in the meaning of one’s self-evaluation. Six of these methods distinguish between change in observed measurements (observed change) and change in the construct that was intended to be measured (target change). The methods use either (sub)group-based or individual-level analysis, or a combination. All methods have underlying assumptions to be met and alternative explanations for the inferred response shift effects. We highlighted the need to address the interpretation of the results as response shift and proposed advancing new methods handling individual variation in change over time and multiple time points.

Conclusion

No single response shift method is optimal; each method has strengths and limitations. Additionally, extra steps need to be taken to correctly interpret the results. Advancing new methods and conducting computer simulation studies that compare methods are recommended to move response shift research forward.

Supplementary Information

The online version of this article (10.1007/s11136-020-02755-4) contains supplementary material, which is available to authorized users.

Psycholinguistic features, design attributes, and respondent-reported cognition predict response time to patient-reported outcome measure items

Purpose

Patient-reported outcome measures (PROMs) vary in their psycholinguistic complexity. This study examined whether response time to PROM items is related to psycholinguistic attributes of the item and/or the self-reported cognitive ability of the respondent.

Methods

Baseline data from Wave 2 of the Quality of Life in Neurological Disorders (Neuro-QoL) development study were reanalyzed. That sample contained 581 adults with neurological disorders and whose self-reported cognitive abilities were quantified by the Neuro-QoL v2.0 Cognitive Function Item Bank. 185 Neuro-QoL items were coded for several psycholinguistic variables and design attributes: number of words and syllables, mean imageability of words, mean word frequency, mean age of word acquisition, and response format (e.g., about symptom frequency or task difficulty). Data were analyzed with linear and generalized linear mixed models.

Results

Main effects models revealed that slower response times were associated with respondents with lower self-reported cognitive abilities and with PROM items that contained more syllables, less imageable (e.g., more abstract) words, and that asked about task difficulty rather than symptom frequency. Interaction effects were found between self-reported cognition and those same PROM attributes such that people with worse self-reported cognitive abilities were disproportionately slow when responding to items that were longer (more syllables), contained less imageable words, and asked about task difficulty.

Conclusion

Completing a PROM requires multiple cognitive skills (e.g., memory, executive functioning) and appraisal processes. Response time is a means of operationalizing the amount or difficulty of cognitive processing, and this report indicates several aspects of PROM design that relate to a measure’s cognitive burden. However, future research with better experimental control is needed.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11136-021-02778-5.

Response-shift effects in neuromyelitis optica spectrum disorder: estimating response-shift-adjusted scores using equating

Background

In our companion paper, random intercept models (RIMs) investigated response-shift effects in a clinical trial comparing Eculizumab to Placebo for people with neuromyelitis optica spectrum disorder (NMOSD). RIMs predicted Global Health using the EQ-5D Visual Analogue Scale item (VAS) to encompass broad criteria that people might consider. The SF36™v2 mental and physical component scores (MCS and PCS) helped us detect response shift in VAS. Here, we sought to “back-translate” the VAS into the MCS/PCS scores that would have been observed if response shift had not been present.

Methods

This secondary analysis utilized NMOSD clinical trial data evaluating the impact of Eculizumab in preventing relapses (n = 143). Analyses began by equating raw scores from the VAS, MCS, and PCS, and computing scores that removed response-shift effects. Correlation analysis and descriptive displays provided a more comprehensive examination of response-shift effects.

Results

MCS and PCS crosswalks with VAS equated the scores that include and exclude response-shift effects. These two sets of scores had low shared variance for MCS for both groups, suggesting that corresponding mental health constructs were substantially different. The shared variance contrast for physical health was distinct only for the Placebo group. The larger MCS response-shift effects were found at end of study for Placebo only and were more prominent at extremes of the MCS score distribution.

Conclusions

Our results reveal notable treatment group differences in MCS but not PCS response shifts, which can explain null results detected in previous work. The method introduced herein provides a way to provide further information about response-shift effects in clinical trial data.

Response-shift effects in neuromyelitis optica spectrum disorder: a secondary analysis of clinical trial data

Background

Researchers have long posited that response-shift effects may obfuscate treatment effects. The present work investigated possible response-shift effects in a recent clinical trial testing a new treatment for Neuromyelitis Optica Spectrum Disorder (NMOSD). This pivotal trial provided impressive support for the drug Eculizumab in preventing relapse, but less strong or null results as the indicators became more subjective or evaluative. This pattern of results suggests that response-shift effects are present.

Methods

This secondary analysis utilized data from a randomized, double-blind trial evaluating the impact of Eculizumab in preventing relapses in 143 people with NMOSD. Treatment arm and then relapse status were hypothesized ‘catalysts’ of response shift in two series of analyses. We devised a “de-constructed” version of Oort structural-equation modeling using random-effects modeling for use in small samples. This method begins by testing an omnibus response-shift hypothesis and then, pending a positive result, implements a series of random-effects models to elucidate specific response-shift effects.

Results

In the omnibus test, the ‘standard quality-of-life (QOL) model’ captured substantially less well the experience of placebo as compared to Eculizumab group. Recalibration and reconceptualization response-shift effects were detected. Detected relapse-related response shifts included recalibration, reprioritization, and reconceptualization.

Conclusions

Trial patients experienced response shifts related to treatment- and relapse-related experiences. Published trial results likely under-estimated Eculizumab vs. Placebo differences due to recalibration and reconceptualization, and relapse effects due to recalibration, reprioritization, and reconceptualization. This novel random-effects- model application builds on response-shift theory and provides a small-sample method for better estimating treatment effects in clinical trials.

Electronic supplementary material

The online version of this article (10.1007/s11136-020-02707-y) contains supplementary material, which is available to authorized users.

Quality of Life and Value Assessment in Health Care

Proposals for health care cost containment emphasize high-value care as a way to control spending without compromising quality. When used in this context, 'value' refers to outcomes in relation to cost. To determine where health spending yields the most value, it is necessary to compare the benefits provided by different treatments. While many studies focus narrowly on health gains in assessing value, the notion of benefit is sometimes broadened to include overall quality of life. This paper explores the implications of using subjective quality of life measures for value assessment. This approach is claimed to be more respectful of patients and better capture the perspectival nature of quality of life. Even if this is correct, though, subjective measurement also raises challenging issues of interpersonal comparability when used to study health outcomes. Because such measures do not readily distinguish benefits due to medical interventions from benefits due to personal or other factors, they are not easily applied to the assessment of treatment value. I argue that when the outcome of interest in value assessment is broadened to include quality of life, the cost side of these measures should also be broadened. I show how one philosophical theory of well-being, Jason Raibley's "agential flourishing" theory, can be adapted for use in quality of life research to better fit the needs and aims of value assessment in health care. Finally, I briefly note some implications of this argument for debates about fairness in health care allocations.

Capturing patient experience: does quality-of-life appraisal entail a new class of measurement?

Background

Two decades of research on quality-of-life (QOL) appraisal have demonstrated links between patient experience and health outcomes and have accounted for both intra-individual change and inter-individual differences in a wide range of research contexts. The present work investigates patterns across diagnostic and demographic groupings to demonstrate how population-specific circumstances drive the structure of QOL appraisal.

Methods

This secondary analysis (N = 6448) utilized data from six patient groups: spine surgery, multiple sclerosis, heterogeneous chronically ill, heterogeneous cancer, bladder cancer, and human immunodeficiency virus (HIV). We explored patterns of inter-item correlation across patient samples, using items from the Standards of Comparison and Sampling of Experience subsections of the QOL Appraisal Profile v1 and v2. Similar matrices were compared by demographic characteristics.

Results

Patterns of inter-item correlations for Standards of Comparison items varied sharply across disease groups and racial groups while being similar across age, gender, and education levels. Inter-item correlation matrices for Sampling of Experience items revealed marked differences among disease groups and educational and racial categories but were similar across age and gender groups.

Conclusions

Appraisal parameters showed evidence of shared and unique aspects across samples and circumstances, findings which make sense in light of sample differences in health status and demographic influences. Tools to assess patient experience and meaning may be best understood as idiometric instruments. We discuss their distinctions from psychometric and clinimetric tools at theoretical, statistical, and applied levels.

Supplementary information

Supplementary information accompanies this paper at 10.1186/s41687-020-00254-1.

Selection of a quality of life instrument for polio survivors in Northwest Nigeria

BACKGROUND

To generate high-quality evidence, contextually relevant outcome measurement instruments are required. Quality of life evaluation among polio survivors typically involves the use of generic instruments, which are developed and validated among a different groups of people. There is no clear evidence whether these instruments are appropriate for the measurement of quality of life among polio survivors in northwest Nigeria. The purpose of this review is to identify and select a pre-existing instrument that is best suited for the measurement of quality of life among polio survivors in northwest Nigeria.

METHODS

Using the findings of a previous scoping review of the literature and qualitative descriptive study, we screened 11 quality of life instruments that are used in polio literature. We identified and selected the most appropriate instrument, which reflected the perspectives of polio survivors in northwest Nigeria and at the same time exhibited good measurement properties.

RESULTS

The Quality of Life Index, World Health Organization Quality of Life Brief, and Comprehensive Quality of Life Scale are consistent with the perspectives of polio survivors in northwest Nigeria and have satisfactory measurement properties. Among these instruments, the Quality of Life Index satisfied most of the screening criteria we employed and is suitable for cross-cultural adaptation in northwest Nigeria.

CONCLUSION

Most instruments that are employed to evaluate the quality of life of polio survivors were not primarily designed as a measure of quality of life. To select the appropriate instrument, there is a need to consider and reflect the perspectives of the individuals, to improve the validity of the measurement.

Beyond pain and disability: an explanatory mixed methods study exploring outcomes after physiotherapy intervention in patients with chronic low back pain

Purpose: The primary aim of this study was to explore relevant outcome domains for patients with chronic low back pain (CLBP) undergoing physiotherapy. A secondary aim was to examine potential discrepancies between meaningful changes in pain and disability and the global perception of improvement.Methods: An explanatory mixed methods design was employed. Twenty-two patients with CLBP completed self-reported measures before and after a physiotherapy programme. After the intervention, three focus groups were conducted with patients who perceived an overall improvement. Discussions were recorded, transcribed and analysed using thematic analysis.Results: Quantitative analysis showed an inconsistent relationship between changes in pain and disability measures and global improvements as perceived by patients. Two main themes emerged from the thematic analysis: "pain relief" (subthemes: reducing pain intensity and other symptoms; reducing medication intake; improving sleep quality) and "gaining control over the LBP condition" (subthemes: ability to self-manage; return to function; and sense of well-being and normality).Conclusion: Patients with CLBP perceived multiple outcomes from physiotherapy treatment that cover the domains of global, physical, mental and social health. These study findings suggest that the targets of measurement for physiotherapy need to be expanded in order to reflect outcome domains valued by patients.Implications for rehabilitationMinimum important changes in pain intensity and disability were not valid indicators of global improvements as perceived by patients.Patients with chronic low back pain undergoing physiotherapy perceived gains in multiple health domains that ranged beyond pain and disability domains.Physiotherapy outcome assessment needs to integrate other patient-relevant outcomes such as medication intake, sleep quality, ability to self-manage and sense of well-being.

Understanding haemophilia caregiver burden: does appraisal buffer the impact of haemophilia on caregivers over time?

Objective: The present work investigated haemophilia caregiver and patient characteristics associated with change in negative and positive aspects of caregiving. Design: Web-based survey data were collected from haemophilia A or B caregivers at baseline and two years later. Main Outcome Measures: Outcomes included Burden Summary and Positive Emotions change scores from the Haemophilia Caregiver Impact measure. Results: The sample included 323 caregivers (71% response rate; mean age 40, 90% female). Brief Appraisal Inventory Principal Components Analysis with varimax rotation yielded five scores: Awareness of Challenges, Fulfillment and Growth, Stay Positive, Social Comparison, and Interpersonal Problem-Solving. Regression analyses revealed that caregivers with more health conditions, who care for patients with increased bleeds and worse pain, and who focused more on Awareness of Challenges, Social Comparisons, and Interpersonal Problem-Solving reported worsened burden over follow-up (Adj. R² = 0.37). Prioritisation of Stay[ing] Positive and reduced emphasis on Interpersonal Problem-Solving were associated with increased Positive Emotions (Adj. R² = 0.32). Conclusion: Caregivers who focused less on a life unfettered by caregiving, comparing themselves to others, and interpersonal problem-solving and more on staying positive reported reductions in burden and improvements in positive emotions. These findings could translate to multicomponent psychoeducational interventions to help caregivers buffer haemophilia's impact.

Mood instability across the perinatal period: A cross-sectional and longitudinal study

BACKGROUND

As a trans-diagnostic concept, mood instability (MI) is significantly linked to a variety of psychiatric disorders in general and clinical samples. However, there is limited research on perinatal MI, even though perinatal women experience an elevated level of MI. In this study, we examined the relationship between perinatal MI and its risk factors, the association between antenatal MI and postpartum depression (PPD), and the trajectory of perinatal MI.

METHODS

A total of 648 women participated in this longitudinal study at three points: T1 (17.4 ± 4.9 weeks pregnant), T2 (30.6 ± 2.7 weeks pregnant), and T3 (4.2 ± 2.1 weeks postpartum). Linear regression was used to examine MI and its risk factors, hierarchical multiple regression was utilized to investigate the relationship between antenatal MI and PPD, and a linear mixed model was employed to examine the trajectory of perinatal MI over T1-T3.

RESULTS

Perinatal depression, history of depression, and stress at T1, T2, and T3, and labor/birth complications at T3 were significant risk factors for MI. MI at T1 was associated with PPD after controlling for important confounders at T1. The trajectory of perinatal MI had a declined trend from early pregnancy to postpartum.

LIMITATIONS

The participants were predominantly Caucasian and with post-secondary education, which may limit the generalization of our findings. A lack of research on perinatal MI limited our ability to discuss the topic in relation to existing literature.

CONCLUSIONS

This study expands our understanding of MI in perinatal women, and indicates that more research is needed.

Patient-Reported Outcomes and Evidence-Based Practice in Speech-Language Pathology

Purpose The patient's perspective of their health is a core component of evidence-based practice (EBP) and person-centered care. Patient-reported outcomes (PROs), captured with PRO measures (PROMs), are the main way of formally soliciting and measuring the patient's perspective. Currently, however, PROs play a relatively small role in mainstream speech-language pathology practice. The purpose of this article is to raise important questions about how PROs could be applied to EBP in speech-language pathology for individuals with communication disorders and to propose preliminary approaches to address some of these questions. Method Based on a narrative review of the literature, this article introduces relevant terminology and broadly describes PRO applications in other health care fields. The article also raises questions related to PRO-informed clinical practice in speech-language pathology. To address some of these questions, the article explores previous research to provide suggestions for clinical administration, interpretation, and future research. Conclusion More routine measurement of subjective health constructs via PROMs-for example, constructs such as effort, participation, self-efficacy, and psychosocial functioning-may improve EBP. More routine use of PROMs could significantly expand the information that is available to clinicians about individual clients and add to the evidence base for the profession of speech-language pathology. However, careful consideration and more research are needed on how to capture and interpret PROs from individuals with cognitive and language disorders.

Does response shift impact interpretation of change even among scales developed using item response theory?

Background

Response-shift effects impact the interpretation of change in quality-of-life (QOL) measures developed with classical test theory (CTT) methods. This study evaluated the impact of response shift on measures developed using Item Response Theory (IRT), as compared to CTT.

Methods

Chronically ill patients and caregivers (n = 1481) participated in a web-based survey at baseline and 17 months later. Patients completed the IRT-based PROMIS-10; NeuroQOL Applied Cognition, Positive Affect & Well-Being short-forms; and the CTT-based Ryff Environmental Mastery subscale. Response-shift effects were evaluated using regression residual modeling and the QOL Appraisal Profile-v2. The sample was divided into positive and negative catalyst groups on the basis of marital, work, job-status, and comorbidity change. Regression models predicted residualized QOL change scores as a function of catalysts and appraisal changes.

Results

In this sample 859 (58%) reported a catalyst. No catalyst was associated with change in scales developed using IRT, but positive work change was associated with the CTT-based measure. Catalyst variables were associated with changes in appraisal, which in turn were related to all outcomes, particularly for global mental health after a positive work-change.

Conclusions

Appraisal processes are relevant to interpreting IRT measures, particularly for global mental health in the face of life changes.

Patient-reported outcomes in spine surgery: past, current, and future directions

The purpose of this article is to review the current state of outcome measurement in spine surgery, with an emphasis on patient-reported outcome measures (PROMs). The commonly used generic and disease-specific outcome measures used in spinal surgery and research will be discussed. The authors will introduce the concepts of response shift and appraisal processes, which may affect the face validity of PROMs, as well as their interpretation over time. It is not uncommon for there to be a discrepancy between the observed and expected outcome, which is not wholly explainable by objective measures. Current work on understanding how appraisal affects outcome measurement will be discussed, and future directions will be suggested to facilitate the continued evolution of PROMs.There has been an evolution in the way clinicians measure outcomes following spinal surgery. In moving from purely physical, objective measures to a growing emphasis on the patient's perspective, spine surgery outcomes are better able to integrate the impact at multiple levels of relevant change. Appraisal concepts and methods are gaining traction as ways to understand the cognitive processes underlying PROMs over time. Measurement of appraisal is a valuable adjunct to the current spine outcome tools.

Advancing quality-of-life research by deepening our understanding of response shift: a unifying theory of appraisal

Studies of response-shift phenomena in quality-of-life (QOL) research have grown steadily in the more than two decades of research. As a field, we have been calling a lot of different approaches "response shift" over the years, but the only approach that fully embodies the foundational (Sprangers and Schwartz, Soc Sci Med 48(11):1507-1515, 1999) theoretical model is appraisal. According to the definition proposed in this model, response shift is about individual cognitive change. This paper presents the argument that all response-shift research models need to be grounded in an understanding of cognitive appraisal. We present a reasoned argument for why appraisal is fundamental to QOL response-shift research. We describe current measurement and analytic methods for working with appraisal, and how these methods can be integrated into the current response-shift statistical 'tool box.' We propose future research directions on theory, methods, and cross-calibration of group- and individual-level methods. There are currently three tools available in multiple languages for assessing QOL appraisal processes. They have been tested and used to assess response shift in empirical studies of ~ 7000 people with chronic illness. The study findings illustrate how appraisal theory and methods can facilitate methodological investigations of and to enhance other response-shift detection methods. Future research directions are proposed to enrich QOL theory, response-shift methods, and interpretation of QOL change over time. Appraisal theory and methods are the closest approximation to a response-shift 'gold standard.' They provide the foundation for understanding response shift and point to a unified theory of QOL.

Quality of life profile in three cohorts of community-dwelling Swiss older people

Background

Quality of life (QoL) is a subjective and dynamic concept resulting from an interplay between importance of and satisfaction with different aspects of life. However, it is unclear whether social contexts experienced by individuals born at specific times in history (cohort effects) may influence QoL in old age. This study aimed to compare among older persons born before, during, and at the end of World War II: a) satisfaction with QoL, overall and per domains; b) importance of QoL domains.

Methods

This repeated cross-sectional study included representative samples of community-dwelling adults born in 1934–1938 (pre-war), 1939–1943 (war), and 1944–1948 (baby-boom) from the Lausanne cohort 65+. QoL was assessed overall, and in seven domains in 2011 and 2016. Two-by-two cohort comparisons were performed at ages 68–72 (war versus baby-boom) and 73–77 years (pre-war versus war).

Results

Overall satisfaction with QoL did not differ between cohorts despite increased education level across cohorts and a shift between pre-war and war cohorts towards lower morbidity and higher proportion living alone. However, “Feeling of safety” consistently showed significant improvements from earlier to later-born cohorts. Furthermore, the war cohort reported higher satisfaction than pre-war cohort in “Autonomy”. Conversely, no significant difference was observed between cohorts in importance of QoL domains, except increased importance given to “Health and mobility” in the war compared to pre-war cohort.

Conclusions

Societal changes reflected in the profile of successive elders’ cohorts did not appear to modify the overall satisfaction with QoL.

Electronic supplementary material

The online version of this article (10.1186/s12877-019-1112-4) contains supplementary material, which is available to authorized users.

Reconsidering the minimally important difference: evidence of instability over time and across groups

BACKGROUND CONTEXT

Underlying cognitive factors have been found to influence patients' symptom experience. Current evidence suggests that concomitant changes in appraisal must be taken into account to accurately interpret change as measured by standard spine patient-reported outcomes (PROs).

PURPOSE

To investigate changes in patients' minimally important differences (MID) over recovery from spinal surgery; whether and how cognitive appraisal processes are implicated in the change trajectories.

STUDY DESIGN/SETTING

Longitudinal cohort study with up to 12 months follow-up.

PATIENT SAMPLE

Surgical patients (n = 167) with a diagnosis of disc herniation or spinal stenosis.

OUTCOME MEASURES

Standard spine patient-reported PROs were used (Rand-36, Oswestry Disability Index, Numerical Rating Scale for pain, PROMIS Pain Impact).

METHODS

This study was funded by the Feldberg Chair in Spinal Research, Sunnybrook Health Sciences Centre and the authors have no conflicts of interest. MID used an anchor technique and was computed by global assessment of change (GAC) grouping. Participants were binned into groups based on their GAC response patterns at all time points: Consistently better post-surgery, consistently worse post-surgery, and bouncers, whose GAC ratings fluctuate (ie, better-then-worse-then-better; or vice versa). Individuals' longitudinal quality of life (QOL) and appraisal slope scores were computed. QOL-appraisal slopes' correlations were computed by GAC group. Fisher's Z transformation tested the hypothesis that GAC groups differed in the QOL-appraisal relationship over time.

RESULTS

Moderate to large changes are recognized as clinically important in the early stages of recovery (ie, 6 weeks post-surgery), and over time smaller and smaller changes become important. The three pattern groups emphasized and deemphasized different standards of comparison over time, with the Better group emphasizing personal goals and the Worse and Bouncers deemphasizing doctors' input. These group differences translated to differential relationships between PRO change and appraisal changes over time.

CONCLUSIONS

The MID reflects increasingly subtle change over time in PROs. Appraisal may influence how patients experience the same (MID) change over time, with better outcomes associated with emphasizing long-term goals. PRO change seems to be driven by different standards of comparison. Potential avenues for clinical intervention are discussed.

Do people with arthritis differ from healthy controls in their internal comparison standards for self-reports of health, fatigue, and pain?

OBJECTIVE

Patient-reported outcomes are central for the assessment and treatment of people with chronic disease. The primary aim of this study was to determine if people with arthritis differed from healthy individuals in their use of internal comparison standards when answering questions about their health and symptomatology. A secondary aim was to determine if average levels of the patient-reported outcomes were associated with the use of internal comparison standards, regardless of whether a participant had arthritis or no chronic medical condition.

METHODS

People with a self-report diagnosis of any type of arthritis (n = 588) and healthy controls (n = 567) were recruited from an Internet panel and were randomly assigned to rate two of three outcomes: health, fatigue, and pain. After completing their rating, participants were presented with internal comparison standards and indicated which ones, if any, they used for the ratings they provided. The internal comparison standards were: Interpersonal (comparisons with other people); Historical (comparisons with the past); Imaginary comparisons (comparisons with a hypothetical scenario); or that none of the three were used.

RESULTS

After controlling for group differences in demographic characteristics and outcome levels by including them in the analyses as covariates, people with arthritis were more likely to make Historical comparisons than healthy controls when rating their health. No other group differences in the use of internal comparison standards were found. We further found that the use of internal comparison standards was associated with health and symptom levels, regardless of whether a participant had arthritis or no medical condition. Poorer self-rated health, greater fatigue, and higher pain were associated with a greater likelihood of making a Historical comparison. Furthermore, poorer self-rated health was associated with a greater likelihood of making an Interpersonal comparison, and higher fatigue and pain with a greater likelihood of making an Imaginary comparison.

CONCLUSION

People with arthritis differed in their use of Historical comparison standards compared to those with no chronic medical condition for health ratings. In addition, poorer health and more severe symptomatology were associated with the use of internal comparison standards in both groups of participants, people with arthritis and healthy controls.

Perceptions of Response Burden Associated with Completion of Patient-Reported Outcome Assessments in Oncology

BACKGROUND

Patient response burden is often raised as a human subject concern in consideration of the length or complexity of patient-reported outcome (PRO) instruments used in oncology.

OBJECTIVES

To quantify patient response burden and identify its predictive factors.

METHODS

Data were collected presurgically during a prospective trial that used a comprehensive symptom and health-related quality-of-life (HRQOL) PRO assessment. A subset of patients also completed HRQOL interviews. Response burden was captured using an internally developed six-item instrument. Demographic and clinical characteristics as well as HRQOL scores were examined as potential predictors using hierarchical regression. Response burden was used to predict participant dropout at the first follow-up interval.

RESULTS

A total of 275 patients (mean age 67.5 years; 23.6% female) completed surveys (n = 126) or surveys in addition to interviews (n = 149). Patients experienced low response burden (mean 12.19 ± 11.65). Repetitive questions were identified by 60 patients (21.8%), whereas 31.6% indicated that additional information should be gathered; 35 patients (12.7%) identified repetitive questions and expressed a desire for additional items. Low self-reported cognitive function was a significant predictor of higher response burden (β = -0.20; t(270) = -3.38; P = 0.01; model-adjusted R² = 0.04). Response burden was not a significant predictor of study dropout.

CONCLUSIONS

Despite completing a large battery of PRO measures and interviews, patients reported minimal response burden, with nearly one-third expressing that more questions should have been asked. Patients with lower cognitive function are more likely to report higher response burden when completing PRO measures. Further examination of patient characteristics related to response burden may reveal useful pathways for tailoring patient-centered interventions.

Defining the cut-off point of clinically significant postoperative fatigue in three common fatigue scales

PURPOSE

Postoperative fatigue (POF) is an often underestimated problem after surgery. Studies on POF often report fatigue scores without relating this to the clinical relevance for the patients. The aim of this study was to define the cut-off point for clinically significant POF in three commonly applied fatigue scales; the Postoperative Fatigue Scale, Christensen's Fatigue Scale, and the Chalder Fatigue Questionnaire. The identification of cut-off points will make it possible to indicate whether statistically significant findings of increased fatigue are of clinical relevance.

METHODS

We combined data from day 0 (pre-operatively) and day 1, 3, 6, and 30 after surgery in two fatigue-related studies with 442 patients. In order to define clinically significant fatigue, a key question was added in each questionnaire; "Given your current description of fatigue, would you say it has been of considerable significance to you?"; "Yes/No". We analysed each scale's ability to identify clinically significant fatigue, by performing receiver-operating characteristics (ROC) analyses, and calculated the optimal cut-off point between Sensitivity and Specificity.

RESULTS

The average weighted cut-off point for clinically significant POF when measured with the Postoperative Fatigue Scale was ≥ 50 (scale range 0-100), with Christensen's Fatigue Scale ≥ 6 (scale range 1-10) and with the Chalder Fatigue Questionnaire ≥ 16 (scale range 0-33).

CONCLUSION

In three commonly used fatigue scales, we have identified cut-off points for clinically significant fatigue among patients recovering from surgery. This can be particularly valuable for diagnostic purposes and in treatment evaluation. Further, it may be possible to analyse and review data from earlier studies in light of clinical relevance.

Quality of life in patients with adrenal disease: A systematic review

BACKGROUND

Evaluating the patient with adrenal disease is challenging due to the lack of precise clinical and biochemical parameters for disease control. Quality of life (QOL) evaluation aims to measure the patient's subjective experience.

OBJECTIVE

To describe how QOL is defined and measured in adrenal disease, critically appraise the use of QOL tools in published literature, discuss the implications of these findings and provide direction for further research in this field.

MATERIALS AND METHODS

We searched the Cochrane library, EMBASE, Google Scholar, PsycINFO, PubMed, Web of Science databases to identify only primary studies where self-reported QOL was measured as a parameter in adults with confirmed adrenal disease, and results presented in English. Key data were independently extracted from each study and adherence to reporting guidelines evaluated.

RESULTS

A total of 117 studies involving 13 717 subjects were included. The vast majority of studies did not define QOL. The most common approach was to combine generic and domain-specific tools, although disease-specific tools are increasingly being used. Adherence to reporting guidelines was variable. A narrative synthesis of the findings was performed.

CONCLUSION

We present the first systematic review of QOL in adrenal disease. Quality of life is reduced in patients with adrenal disease, irrespective of adrenal hyperfunction or hypofunction. Quality of life improved with therapy but was not completely reversed despite biochemical remission. Authors should adhere to consistent reporting practices which are interpretable by clinicians. Further research is required to explain the mechanisms driving impaired QOL and value of QOL evaluations in the clinical context.