Agreement between older adult patient and caregiver proxy symptom reports

Applicability and clinical utility of the German rivermead post-concussion symptoms questionnaire in proxies of children after traumatic brain injury: an instrument validation study

BACKGROUND

The German Rivermead Post-Concussion Symptoms Questionnaire (RPQ) can be used to assess post-concussion symptoms (PCS) after traumatic brain injury (TBI) in adults, adolescents, and children.

METHODS

In this study, we examined the psychometric properties of the German RPQ proxy version (N = 146) for children (8-12 years) after TBI at the item, total and scale score level. Construct validity was analyzed using rank correlations with the proxy-assessed Post-Concussion Symptoms Inventory (PCSI-P), the Patient Health Questionnaire 9 (PHQ-9), and the Generalized Anxiety Disorder Scale 7 (GAD-7). Furthermore, sensitivity testing was performed concerning subjects' sociodemographic and injury-related characteristics. Differential item functioning (DIF) was analyzed to assess the comparability of RPQ proxy ratings for children with those for adolescents.

RESULTS

Good internal consistency was demonstrated regarding Cronbach's α (0.81-0.90) and McDonald's ω (0.84-0.92). The factorial validity of a three-factor model was superior to the original one-factor model. Proxy ratings of the RPQ total and scale scores were strongly correlated with the PCSI-P (ϱ = 0.50-0.69), as well as moderately to strongly correlated with the PHQ-9 (ϱ = 0.49-0.65) and the GAD-7 (ϱ = 0.44-0.64). The DIF analysis revealed no relevant differences between the child and adolescent proxy versions.

CONCLUSIONS

The German RPQ proxy is a psychometrically reliable and valid instrument for assessing PCS in children after TBI. Therefore, RPQ self- and proxy-ratings can be used to assess PCS in childhood as well as along the lifespan of an individual after TBI.

Inter-rater agreement between patient- and proxy-reported cognitive functioning in intensive care unit patients: A cohort study

BACKGROUND

Health status, including cognitive functioning before critical illness, is associated with long-term outcomes in intensive care unit survivors. Premorbid data are therefore of importance in longitudinal studies. Few patients can self-report at intensive care admission. Consequently, proxy assessments of patients' health status are used. However, it remains unclear how accurately proxies can report on an intensive care patient's cognitive status.

OBJECTIVES

The aim of this study was to examine the agreement between patient- and proxy-reporting of the Cognitive Failures Questionnaire and to compare the agreement between proxy reports using the latter questionnaire and the Informant Questionnaire of Cognitive Decline in the Elderly as a reference.

METHODS

The present cohort study is part of a longitudinal multicentre study collecting both patient and proxy data using questionnaires and clinical data from medical records during intensive care unit stays. Agreement on patient and proxy pairs was examined using intraclass correlation coefficient (ICC), Spearman's correlation, percentage agreement, and Gwet's AC1 statistics. Agreement between the proxy-reported questionnaires was examined using percentage agreement and Gwet's AC1 statistics.

RESULTS

In total, we collected 99 pairs of patient-proxy assessments and 158 proxy-proxy assessments. The ICC for the sum scores revealed moderate agreement (n = 99; ICC = 0.59; 99% confidence interval [CI]: [0.30-0.76]) between patient and proxy. Agreement on items was poor (AC1 = 0.13; 99% CI: [0.01-0.24]) to moderate (AC1 = 0.55; 99% CI: [0.43-0.68]). Agreement using cut-off scores (>43) to indicate cognitive impairment was very good (89.9%, AC1 = 0.87; 99% CI: [0.79-0.95]). Agreement between the proxy-reported Cognitive Failures Questionnaire (>43) and the reference questionnaire (≥3.5) was also very good (n = 158; 85%, AC1 = 0.82; 99% CI: [0.74-0.90]).

CONCLUSIONS

Proxy assessments of the Cognitive Failures Questionnaire (>43) may be used to indicate cognitive impairment if patients are unable to self-report. Agreement was high between the two questionnaires determined by proxies, showing that these can be used interchangeably to assess cognitive functioning if proxy reporting is needed.

A systematic review of goal attainment scaling implementation practices by caregivers in randomized controlled trials

BACKGROUND

Goal attainment scaling (GAS), an established individualized, patient-centred outcome measure, is used to capture the patient's voice. Although first introduced ~60 years ago, there are few published guidelines for implementing GAS, and almost none for its use when caregivers GAS is implemented with caregiver input. We conducted a systematic review of studies that implemented GAS with caregiver input; and examined variations in GAS implementation, analysis, and reporting.

METHODS

Literature was retrieved from Medline, Embase, Cochrane, PsycInfo and CINAHL databases. We included randomized controlled trials (published between 1968 and November 2022) that used GAS as an outcome measure and involved caregiver input during goal setting.

RESULTS

Of the 2610 studies imported for screening, 21 met the inclusion criteria. Most studies employed GAS as a primary outcome. The majority (76%) had children as study participants. The most common disorders represented were cerebral palsy, developmental disorders, and dementia/Alzheimer's disease. The traditional five-point GAS scale, with levels from -2 to +2, was most often implemented, with -1 level typically being the baseline. However, most studies omitted essential GAS details from their reports including the number of goals set, number of attainment levels and whether any training was given to GAS facilitators.

CONCLUSIONS

GAS with caregiver input has been used in a limited number of randomized controlled trials, primarily in pediatric patients and adults with dementia. There is a variability in GAS implementation and many crucial details related to the specifics of GAS implementation are omitted from reports, which may limit reproducibility. Here we propose catalog that may be utilized when reporting research results pertaining to GAS with caregivers to enhance the application of this patient-centered outcome measure.

Patient-Family Caregiver Concordance of Symptom Assessment for Esophageal Cancer Patients Undergoing Esophagectomy

BACKGROUND

Esophageal cancer patients suffer from multiple and severe symptoms during the postoperative recovery period. Family caregivers play a vital role in assisting patients to cope with their symptoms.

OBJECTIVE

To examine the concordance of esophageal cancer patients and their caregivers on assessing patients' symptoms after surgery and identify predictors associated with the symptom concordance.

METHODS

In this cross-sectional study, 213 patient-caregiver dyads completed general information questionnaires, the Memorial Symptom Assessment Scale, the Depression Subscale of Hospital Anxiety and Depression Scale, the Mutuality Scale, and the Zarit Burden Interview (for caregivers). Data were analyzed using intraclass correlation coefficients, paired t tests, and binary logistic regression.

RESULTS

At the dyad level, agreement of patients' and caregivers' reported symptoms ranged from poor to fair. At the group level, patients reported significantly higher scores than caregivers in most symptoms. Of the 213 dyads, 119 (55.9%) were identified as concordant on symptom assessment. Patients' nasogastric tube, perceived mutuality, caregivers' educational background, and dyad's communication frequency with each other could predict their concordance of symptom assessment.

CONCLUSIONS

There were relatively low agreements between esophageal cancer patients and caregivers on assessing patients' symptoms, and caregivers tended to underestimate patients' symptoms. The dyad's symptom concordance was influenced by patient-, caregiver-, and dyad-related factors.

IMPLICATIONS FOR PRACTICE

Having an awareness of the incongruence on assessing symptoms between esophageal cancer patients and caregivers may help healthcare professionals to comprehensively interpret patients' symptoms and develop targeted dyadic interventions to improve their concordance, contributing to optimal symptom management and health outcomes.

Does Differential Item Functioning Jeopardize the Comparability of Health-Related Quality of Life Assessment Between Patients and Proxies in Patients with Moderate-to-Severe Traumatic Brain Injury?

BACKGROUND

Health-related quality of life (HRQoL) is clearly recognized as a patient-important outcome in patients with traumatic brain injury (TBI). Patient-reported outcomes are therefore often used and supposed to be directly reported by the patients without interpretation of their responses by a physician or anyone else. However, patients with TBI are often unable to self-report because of physical and/or cognitive impairments. Thus, proxy-reported measures, e.g., family members, are often used on the patient's behalf. Yet, many studies have reported that proxy and patient ratings differ and are noncomparable. However, most studies usually do not account for other potential confounding factors that may be associated with HRQoL. In addition, patients and proxies can interpret some items of the patient-reported outcomes differently. As a result, item responses may not only reflect patients' HRQoL but also the respondent's (patient or proxy) own perception of the items. This phenomenon, called differential item functioning (DIF), can lead to substantial differences between patient-reported and proxy-reported measures and compromise their comparability, leading to highly biased HRQoL estimates. Using data from the prospective multicenter continuous hyperosmolar therapy in traumatic brain-injured patients study (240 patients with HRQoL measured with the Short Form-36 (SF-36)), we assessed the comparability of patients' and proxies' reports by evaluating the extent to which items perception differs (i.e., DIF) between patients and proxies after controlling for potential confounders.

METHODS

Items at risk of DIF adjusting for confounders were examined on the items of the role physical and role emotional domains of the SF-36.

RESULTS

Differential item functioning was evidenced in three out of the four items of the role physical domain measuring role limitations due to physical health problems and in one out of the three items of the role emotional domain measuring role limitations due to personal or emotional problems. Overall, despite an expected similar level of role limitations between patients who were able to respond and those for whom proxies responded, proxies tend to give more pessimistic responses than patients in the case of major role limitations and more optimistic responses than patients in the case of minor limitations.

CONCLUSIONS

Patients with moderate-to-severe TBI and proxies seem to have different perceptions of the items measuring role limitations due to physical or emotional problems, questioning the comparability of patient and proxy data. Therefore, aggregating proxy and patient responses may bias HRQoL estimates and alter medical decision-making based on these patient-important outcomes.

Preliminary clinical testing to inform development of the Critical Care Pain Observation Tool for Families (CPOT-Fam)

Introduction

Many patients in the intensive care unit (ICU) cannot communicate. For these patients, family caregivers (family members/close friends) could assist in pain assessment. We previously adapted the Critical Care Pain Observation Tool (CPOT) for family caregiver use (CPOT-Fam). In this study, we conducted preliminary clinical evaluation of the CPOT-Fam to inform further tool development.

Methods

For preliminary testing, we collected (1) pain assessments of patients in the ICU from family caregivers (CPOT-Fam) and nurses (CPOT) and determined the degree of agreement (kappa coefficient, κ) and (2) collected openended feedback on the CPOT-Fam from family caregivers. For refinement, we used preliminary testing data to refine the CPOT-Fam with a multidisciplinary working group.

Results

We assessed agreement between family caregiver and nurse pain scores for 29 patients. Binary agreement (κ) between CPOT-Fam and CPOT item scores (scores ≥2 considered indicative of significant pain) was fair, κ = 0.43 (95% confidence interval [CI] 0.18-0.69). Agreement was highest for the CPOT-Fam items ventilator compliance/vocalization (weighted κ = 0.48, 95% CI 0.15-0.80) and lowest for muscle tension (weighted κ = 0.10, 95% [CI] -0.17 to 0.20). Most participants (n = 19; 69.0%) reported a very positive experience using the CPOT-Fam, describing it as "good" and "easy-to-use/clear/straightforward." We iteratively refined the CPOT-Fam over five cycles using the data collected until no further revisions were suggested.

Conclusion

Our preliminary clinical testing suggests that family involvement in pain assessment in the ICU is well perceived. The CPOT-Fam has been further refined and is now ready for clinical pilot testing to determine its feasibility and acceptability.

Fixing the Leaky Pipe: How to Improve the Uptake of Patient-Reported Outcomes-Based Prognostic and Predictive Models in Cancer Clinical Practice

PURPOSE

This discussion paper outlines challenges and proposes solutions for successfully implementing prediction models that incorporate patient-reported outcomes (PROs) in cancer practice.

METHODS

We organized a full-day multidisciplinary meeting of people with expertise in cancer care delivery, PRO collection, PRO use in prediction modeling, computing, implementation, and decision science. The discussions presented here focused on identifying challenges to the development, implementation and use of prediction models incorporating PROs, and suggesting possible solutions.

RESULTS

Specific challenges and solutions were identified across three broad areas. (1) Understanding decision making and implementation: necessitating multidisciplinary collaboration in the early stages and throughout; early stakeholder engagement to define the decision problem and ensure acceptability of PROs in prediction; understanding patient/clinician interpretation of PRO predictions and uncertainty to optimize prediction impact; striving for model integration into existing electronic health records; and early regulatory alignment. (2) Recognizing the limitations to PRO collection and their impact on prediction: incorporating validated, clinically important PROs to maximize model generalizability and clinical engagement; and minimizing missing PRO data (resulting from both structural digital exclusion and time-varying factors) to avoid exacerbating existing inequalities. (3) Statistical and modeling challenges: incorporating statistical methods to address missing data; ensuring predictive modeling recognizes complex causal relationships; and considering temporal and geographic recalibration so that model predictions reflect the relevant population.

CONCLUSION

Developing and implementing PRO-based prediction models in cancer care requires extensive multidisciplinary working from the earliest stages, recognition of implementation challenges because of PRO collection and model presentation, and robust statistical methods to manage missing data, causality, and calibration. Prediction models incorporating PROs should be viewed as complex interventions, with their development and impact assessment carried out to reflect this.

Development of consensus-based considerations for use of adult proxy reporting: an ISOQOL task force initiative

AIMS

Many large-scale population-based surveys, research studies, and clinical care allow for inclusion of proxy reporting as a strategy to collect outcomes when patients are unavailable or unable to provide reliable self-report. Prior work identified an absence of methodological guidelines regarding proxy reporting in adult populations, including who can serve as a proxy, and considerations for data collection, analysis, and reporting. The primary objective of this work by the ISOQOL Proxy Task Force was to review documents and clinical outcome assessment measures with respect to proxy reporting and to develop, through consensus, considerations for proxy reporting.

METHODS

We assembled an international group with clinically relevant and/or methodological expertise on proxy use in adult populations. We conducted a targeted review of documentation based on regulatory, non-regulatory, professional society, and individual measure sources. Using a standardized collection form, proxy-related information was extracted from each source including definitions of a proxy, characteristics of a proxy, domains addressable or addressed by a proxy, and observer-reporting.

RESULTS

The definition of proxy was inconsistent across 39 sources, except regulatory documents which defined a proxy as a person other than the patient who reports on an outcome as if she/he were the patient. While proxy report was discouraged in regulatory documentation, it was acknowledged there were instances where self-report was impossible. Many documentation sources indicated proxies would be well-justified in certain contexts, but did not indicate who could act as a proxy, when proxies could be used, what domains of patient health they could report on, or how data should be reported. Observer-reported outcomes were typically defined as those based on observed behaviors, however there was not a consistent differentiation between proxy and observer reporting. Based on information extracted from these resources, we developed a checklist of considerations when including proxy-reported measures or using proxies in study design, data collection, analysis, interpretation and reporting of proxy reported data.

CONCLUSION

Our targeted review highlights a lack of clarity in capturing, interpreting and reporting data from proxies in adult populations. We provide a checklist of considerations to assist researchers and clinicians with including proxies in research studies and clinical care. Lastly, our review identified areas where further guidance and future research are necessary.

Needs-based triggers for timely referral to palliative care for older adults severely affected by noncancer conditions: a systematic review and narrative synthesis

BACKGROUND

Older people with noncancer conditions are less likely to be referred to palliative care services due to the inherent uncertain disease trajectory and a lack of standardised referral criteria. For older adults with noncancer conditions where prognostic estimation is unpredictable, needs-based criteria are likely more suitable. Eligibility criteria for participation in clinical trials on palliative care could inform a needs-based criteria. This review aimed to identify and synthesise eligibility criteria for trials in palliative care to construct a needs-based set of triggers for timely referral to palliative care for older adults severely affected by noncancer conditions.

METHODS

A systematic narrative review of published trials of palliative care service level interventions for older adults with noncancer conditions. Electronic databases Medline, Embase, CINAHL, PsycINFO, CENTRAL, and ClinicalTrials.gov. were searched from inception to June 2022. We included all types of randomised controlled trials. We selected trials that reported eligibility criteria for palliative care involvement for older adults with noncancer conditions, where > 50% of the population was aged ≥ 65 years. The methodological quality of the included studies was assessed using a revised Cochrane risk-of-bias tool for randomized trials. Descriptive analysis and narrative synthesis provided descriptions of the patterns and appraised the applicability of included trial eligibility criteria to identify patients likely to benefit from receiving palliative care.

RESULTS

27 randomised controlled trials met eligibility out of 9,584 papers. We identified six major domains of trial eligibility criteria in three categories, needs-based, time-based and medical history-based criteria. Needs-based criteria were composed of symptoms, functional status, and quality of life criteria. The major trial eligibility criteria were diagnostic criteria (n = 26, 96%), followed by medical history-based criteria (n = 15, 56%), and physical and psychological symptom criteria (n = 14, 52%).

CONCLUSION

For older adults severely affected by noncancer conditions, decisions about providing palliative care should be based on the present needs related to symptoms, functional status, and quality of life. Further research is needed to examine how the needs-based triggers can be operationalized as referral criteria in clinical settings and develop international consensus on referral criteria for older adults with noncancer conditions.

Patient reported outcomes for phosphomannomutase 2 congenital disorder of glycosylation (PMM2-CDG): listening to what matters for the patients and health professionals

Background

Congenital disorders of glycosylation (CDG) are a growing group of rare genetic disorders. The most common CDG is phosphomannomutase 2 (PMM2)-CDG which often has a severe clinical presentation and life-limiting consequences. There are no approved therapies for this condition. Also, there are no validated disease-specific quality of life (QoL) scales to assess the heterogeneous clinical burden of PMM2-CDG which presents a challenge for the assessment of the disease severity and the impact of a certain treatment on the course of the disease.

Aim and methods

This study aimed to identify the most impactful clinical signs and symptoms of PMM2-CDG, and specific patient and observer reported outcome measures (PROMs and ObsROMs, respectively) that can adequately measure such impact on patients’ QoL. The most burdensome signs and symptoms were identified through input from the CDG community using a survey targeting PMM2-CDG families and experts, followed by family interviews to understand the real burden of these symptoms in daily life. The list of signs and symptoms was then verified and refined by patient representatives and medical experts in the field. Finally, a literature search for PROMs and ObsROMs used in other rare or common diseases with similar signs and symptoms to those of PMM2-CDG was performed.

Results

Twenty-four signs/symptoms were identified as the most impactful throughout PMM2-CDG patients’ lifetime. We found 239 articles that included tools to measure those community-selected PMM2-CDG symptoms. Among them, we identified 80 QoL scales that address those signs and symptoms and, subsequently, their psychometric quality was analysed. These scales could be applied directly to the PMM2-CDG population or adapted to create the first PMM2-CDG-specific QoL questionnaire.

Conclusion

Identifying the impactful clinical manifestations of PMM2-CDG, along with the collection of PROMs/ObsROMs assessing QoL using a creative and community-centric methodology are the first step towards the development of a new, tailored, and specific PMM2-CDG QoL questionnaire. These findings can be used to fill a gap in PMM2-CDG clinical development. Importantly, this methodology is transferable to other CDG and rare diseases with multiple signs and symptoms.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13023-022-02551-y.

Experiences of Assistive Products and Home Care among Older Clients with and without Dementia in Sweden

The purpose was to compare selection, use and outcomes of assistive products among older home care clients with and without dementia in Sweden, and to explore the relations between the use of assistive products and perceptions of home care, loneliness and safety. Self-reported data from 89,811 home care clients aged 65 years or more, of whom 8.9% had dementia, were analysed using regression models. Excluding spectacles, 88.2% of them used assistive products. Respondents without dementia were more likely to use at least one assistive product but less likely to use assistive products for remembering. Respondents with dementia participated less in the selection of assistive products, used less assistive products, and benefited less from them. Users of assistive products were more likely to be anxious and bothered by loneliness, to feel unsafe at home with home care, to experience that their opinions and wishes regarding assistance were disregarded by home care personnel, and to be treated worse by home care personnel. The findings raise concerns about whether the needs for assistive products among home care clients with dementia are adequately provided for. They also indicate a need to strengthen a person-centred approach to providing home care to users of assistive products.