Patient-reported outcome measurement: a bridge between health and social care?

Do new quality measures for social risk screening 'measure up'?

PURPOSE OF REVIEW

New social risk screening standards and quality metrics reward or penalize healthcare delivery organizations for social risk screening. After summarizing the recent literature on social risk screening in pediatric healthcare settings we consider how this evidence - and persistent evidence gaps - might inform future standards development.

RECENT FINDINGS

Reported social risk screening rates, measures, and modality differ greatly across recent work. Although many caregivers report acceptability of screening, experiences and expectations around effective follow-up vary. Likewise, although most frontline clinical providers find screening acceptable, they report significant implementation challenges related to time constraints, insufficient workforce, and availability of social services. Qualitative findings suggest opportunities to improve screening implementation. Literature examining the impacts of screening continues to focus on immediate posited impacts of assistance programs; few studies assess health outcomes.

SUMMARY

The existing literature does not clearly indicate whether, when, how, or for whom social risk screening standards focused on screening quantity will contribute to child health or health equity. Informed by studies on patient experience, quality measures focused on screening quantity (e.g. how many individuals are screened) should be paired with efforts to improve screening quality (i.e. patient/caregiver screening experience) as well as social and health outcomes.

Understanding factors impacting patient-reported outcome measures integration in routine clinical practice: an umbrella review

PURPOSE

Patient-report outcome measures (PROMs) have gained widespread support as a mechanism to improve healthcare quality. We aimed to map out key enablers and barriers influencing PROMs implementation strategies in routine clinical practice.

METHODS

An umbrella review was conducted to identify reviews exploring enablers and barriers related to the integration of PROMs in routine clinical practice from January 2000 to June 2023. Information on key enablers and barriers was extracted and summarised thematically according to the Theoretical Domains Framework.

RESULTS

34 reviews met our criteria for inclusion. Identified reviews highlighted barriers such as limited PROMs awareness among clinicians and patients, perceived low value by clinicians and patients, PROMs that were too complex or difficult for patients to complete, poor usability of PROMs systems, delayed feedback of PROMs data, clinician concerns related to use of PROMs as a performance management tool, patient concerns regarding privacy and security, and resource constraints. Enablers encompassed phased implementation, professional training, stakeholder engagement prior to implementation, clear strategies and goals, 'change champions' to support PROMs implementation, systems to respond to issues raised by PROMs, and integration into patient pathways. No consensus favoured paper or electronic PROMs, yet offering both options to mitigate digital literacy bias and integrating PROMs into electronic health records emerged as important facilitators.

CONCLUSIONS

The sustainable implementation of PROMs is a complex process that requires multicomponent organisational strategies covering training and guidance, necessary time and resources, roles and responsibilities, and consultation with patients and clinicians.

Understanding Health Equity in Patient-Reported Outcomes

Patient-reported outcomes (PROs) are measures of patients' health that are conveyed directly by individual patients. These measures serve as instruments to evaluate the impact of interventions on any aspect of patients' health, from specific symptoms to broader quality of life indicators. However, their effectiveness relies on capturing relevant factors accurately. Whereas they are commonly used in clinical trials, PROs extend their influence across health care settings, informing clinicians, health care payers, regulators, and administrators to guide quality improvement and reimbursement decisions. Neglecting health equity considerations in PRO development and implementation widens health disparities, leading to biased interpretations, medical mismanagement, and poor health outcomes among marginalized groups. To foster equitable health care, efforts must focus on considering the values of underrepresented populations in PRO design, addressing barriers to completion, enhancing representation in research, providing cultural competency training for clinicians, and allocating research funding to support health equity research. By addressing these issues, advances can be made toward fostering inclusive, equitable health care for all individuals.

The real experience of reporting electronic patient-reported outcomes in patients with inflammatory arthritis and factors influencing participation: a scoping review

Inflammatory arthritis can result in pain, stiffness, fatigue, and reduce quality of life. Frequent monitoring of disease activity is necessary for patients with inflammatory arthritis, and electronic patient-reported outcomes (ePROs) play a crucial role in this process. This study aimed to investigate the real experience of reporting ePROs in patients with inflammatory arthritis, as well as to identify factors influencing participation. The ultimate goal was to inform targeted strategies and develop interventions to enhance the utilization of ePROs in clinical settings. A scoping review was performed using PubMed, Web of science, Embase, and the Cochrane library from 2000 to the present and the literature search focused on the experience of reporting ePROs in inflammatory arthritis and the factors that influence participation. Screening articles based on inclusion and exclusion criteria. A total of 1478 studies were identified, out of which 26 were included in the review. The top experience of applications/platforms in patients was that they were easy to use and that the applications were clear, logical and intuitive. A summary of 18 potential influencing factors were identified and there was inconsistent evidence for five of these factors. The participation of reporting ePROs is influenced by various factors, and the experience is a crucial aspect in patients with inflammatory arthritis. Analyzing patients' experience and influencing factors provides a theoretical basis for future interventions to facilitate the clinical application of ePRO. However, further research is needed to fully understand the association between influencing factors and intervention outcomes.

Are Clinical Practice Guidelines Representative of Patients With Distal Radius Fractures? A Review of Patient Demographics and Patient-Reported Outcome Measures Used to Inform Guidelines

PURPOSE

Clinical practice guidelines (CPGs) are recommendations developed for broad application to optimize high-quality care and decision-making. The composition of patients and outcome measures used in studies informing CPGs; however, has not been rigorously evaluated. With growing evidence that outcomes in musculoskeletal surgery vary by sociocultural factors, we aimed to: (1) review the linguistic, racial, and ethnic representation of the patients in the studies informing CPGs for distal radius fractures and (2) assess their use of linguistically and culturally adapted patient-reported outcome measures (PROMs).

METHODS

The American Academy of Orthopaedic Surgeons website was used to identify relevant studies. Key variables were extracted, including inclusion and exclusion criteria, language of study, patient language and proficiency, patient race and ethnicity, and use of translated or culturally adapted PROMs. If provided, the clinical trial registration page for the study was evaluated. Descriptive statistics were used to describe the frequency of each variable.

RESULTS

Fifty-four published texts were evaluated. Participant language was reported in four (7%) of the published texts and six (11%) when including the clinical trial registration information. Of the published texts, one (2%) reported ethnic group/race data and 40 (74%) used PROMs. Of those using PROMs, eight (20%) of 40 reported the use of translated PROMs, and three (8%) of 40 reported the use of culturally adapted PROMs.

CONCLUSIONS

There is a lack of reporting of linguistic, racial, and ethnic data and inconsistent use of PROMs, particularly those that are translated and culturally adapted, in studies included in the American Academy of Orthopaedic Surgeons CPG for distal radius fractures. As sociocultural characteristics and PROMs are associated with outcomes, ensuring they are broadly represented in studies, may improve equity and shared decision-making.

CLINICAL RELEVANCE

Greater inclusion and reporting of demographic data and PROMs are required in musculoskeletal studies to ensure broad applicability and advance health equity.

Artificial intelligence based data curation: enabling a patient-centric European health data space

The emerging European Health Data Space (EHDS) Regulation opens new prospects for large-scale sharing and re-use of health data. Yet, the proposed regulation suffers from two important limitations: it is designed to benefit the whole population with limited consideration for individuals, and the generation of secondary datasets from heterogeneous, unlinked patient data will remain burdensome. AIDAVA, a Horizon Europe project that started in September 2022, proposes to address both shortcomings by providing patients with an AI-based virtual assistant that maximises automation in the integration and transformation of their health data into an interoperable, longitudinal health record. This personal record can then be used to inform patient-related decisions at the point of care, whether this is the usual point of care or a possible cross-border point of care. The personal record can also be used to generate population datasets for research and policymaking. The proposed solution will enable a much-needed paradigm shift in health data management, implementing a 'curate once at patient level, use many times' approach, primarily for the benefit of patients and their care providers, but also for more efficient generation of high-quality secondary datasets. After 15 months, the project shows promising preliminary results in achieving automation in the integration and transformation of heterogeneous data of each individual patient, once the content of the data sources managed by the data holders has been formally described. Additionally, the conceptualization phase of the project identified a set of recommendations for the development of a patient-centric EHDS, significantly facilitating the generation of data for secondary use.

Patient-reported outcomes in integrated health and social care: A scoping review

Background

Patient-reported outcomes (PROs) have potential to support integrated health and social care research and practice; however, evidence of their utilisation has not been synthesised.

Objective

To identify PRO measures utilised in integrated care and adult social care research and practice and to chart the evidence of implementation factors influencing their uptake.

Design

Scoping review of peer-reviewed literature.

Data sources

Six databases (01 January 2010 to 19 May 2023).

Study selection

Articles reporting PRO use with adults (18+ years) in integrated care or social care settings.

Review methods

We screened articles against pre-specified eligibility criteria; 36 studies (23%) were extracted in duplicate for verification. We summarised the data using thematic analysis and descriptive statistics.

Results

We identified 159 articles reporting on 216 PRO measures deployed in a social care or integrated care setting. Most articles used PRO measures as research tools. Eight (5.0%) articles used PRO measures as an intervention. Articles focused on community-dwelling participants (35.8%) or long-term care home residents (23.9%), with three articles (1.9%) focussing on integrated care settings. Stakeholders viewed PROs as feasible and acceptable, with benefits for care planning, health and wellbeing monitoring as well as quality assurance. Patient-reported outcome measure selection, administration and PRO data management were perceived implementation barriers.

Conclusion

This scoping review showed increasing utilisation of PROs in adult social care and integrated care. Further research is needed to optimise PROs for care planning, design effective training resources and develop policies and service delivery models that prioritise secure, ethical management of PRO data.

Health-Related Quality of Life Outcome Measures in Individuals With Hereditary Hemorrhagic Telangiectasia: A Scoping Review

BACKGROUND

Studies evaluating health-related quality of life (HRQOL) in patients with hereditary hemorrhagic telangiectasia (HHT) have expanded rapidly in the past decade. These studies have evaluated QOL aspects ranging from the general QOL for patients living with HHT to intervention-specific outcomes. However, few tools have been fully validated across the spectrum of disease manifestations and interventions in HHT.

OBJECTIVE

In this scoping review, we aim to map the literature on HHT-QOL metrics, identify gaps, inform future QOL research, and facilitate future metric development.

METHODS

We analyzed articles in English that assessed at least 1 measure of general HRQOL, including physical health, mental health, social health, or intervention-specific QOL in patients with HHT. Searches across 2 bibliographic databases (PubMed and Scopus) yielded 186 articles after duplicates were removed. Sixty-three studies met eligibility criteria: 22 prospective studies (34.9%), 20 retrospective studies (31.7%), 12 cross-sectional studies (17.5%), 6 randomized controlled trials or secondary analyses of a randomized controlled trials (9.5%), 2 qualitative studies (3.2%), and 1 case-control study (1.6%). Two additional studies-1 prospective and 1 cross-sectional study-were identified at the October 2022 14th International HHT Conference and included, making a total of 65 studies.

RESULTS

The 65 eligible studies used 30 QOL instruments. Twenty studies characterized baseline HRQOL, and 45 studies evaluated QOL before and after treatment. Of those 45 studies, 37 evaluated HRQOL before and after therapies targeting epistaxis and nasal symptoms, 4 targeted therapies for liver arteriovenous malformations and high-output heart failure, 3 evaluated therapies for both epistaxis and gastrointestinal bleeding, and 1 evaluated treatment targeting gastrointestinal bleeding alone.

CONCLUSIONS

Comparison of results across studies remains challenging given the heterogeneity in outcomes measures. Further development of HHT-specific patient-reported outcomes instruments that capture the global illness experience of HHT is needed.

Hospital Readmissions by Variation in Engagement in the Health Care Hotspotting Trial: A Secondary Analysis of a Randomized Clinical Trial

Importance

Variability in intervention participation within care management programs can complicate standard analysis strategies.

Objective

To evaluate whether care management was associated with reduced hospital readmissions among individuals with higher participation probabilities.

Design, Setting, and Participants

A total of 800 hospitalized patients aged 18 years and older were randomized as part of the Health Care Hotspotting randomized clinical trial, which was conducted in Camden, New Jersey, from June 2014 to September 2017. Data were collected through October 2018. In this new analysis performed between April 6, 2022, and April 23, 2023, the distillation method was applied to account for variable intervention participation. A gradient-boosting machine learning model produced predicted probabilities of engaged participation using baseline covariates only. Predicted probabilities were used to trim both intervention and control populations in an equivalent manner, and intervention effects were reevaluated within study population subsets that were increasingly concentrated with patients having higher participation probabilities. Patients had 2 or more hospitalizations in the 6-month preenrollment period and documented evidence of chronic illness and social complexity.

Intervention

Multidisciplinary teams provided services to patients in the intervention arm for a mean 120 days after hospital discharge. Patients in the control group received usual postdischarge care.

Main Outcomes and Measures

Hospital readmission rates and counts 30, 90, and 180 days postdischarge.

Results

Of 800 eligible patients, 782 had complete discharge information and were included in this analysis (mean [SD] age, 56.6 [12.7] years; 395 [50.5%] female). In the intent-to-treat analysis, the unadjusted 180-day readmission rate for treatment and control groups was 60.1% vs 61.7% (adjusted odds ratio, 0.95; 95% CI, 0.71-1.28; P = .73) and the mean (SD) number of 180-day readmissions was 1.45 (1.89) vs 1.48 (1.94) (adjusted incidence rate ratio, 0.99, 95% CI, 0.88-1.12; P = .86). Among the population with the highest participation probabilities, the mean (SD) 180-day readmission count was 1.22 (1.74) vs 1.57 (1.74) and the incidence rate ratio attained statistical significance (adjusted incidence rate ratio, 0.74; 95% CI, 0.56-0.99; P = .045). Adjusted odds ratios and adjusted incidence rate ratios for 30- and 90-day outcomes reached statistical significance after population distillation.

Conclusions and Relevance

This secondary analysis of a randomized clinical trial found that care management was associated with reduced readmissions among patients with higher participation probabilities, suggesting that program operation could be improved by addressing barriers to participation and refining inclusion criteria to identify patients most likely to benefit.

Trial Registration

ClinicalTrials.gov Identifier: NCT02090426.

Role of Patient-Reported Outcomes in Clinical Trials in Metastatic Colorectal Cancer: A Scoping Review

PURPOSE

To perform a scoping review on the use of Patient-Reported Outcome Measures (PROMs) in randomized trials on systemic therapy in patients with metastatic colorectal cancer (mCRC) between 2010 and 2021.

METHODS

First, a search on clinicaltrials.gov was performed, looking for randomized trials in mCRC. The use of PROMs was analyzed quantitatively. Subsequently, we assessed the completeness of PROM reporting based on the CONSORT PRO extension in publications related to the selected trials acquired using Embase and PubMed.

RESULTS

A total of 46/176 trials were registered on clinicaltrials.gov used PROMs. All these trials used validated PROM instruments. The EORTC QLQ-C30 was most frequently used (37 times), followed by the EQ-5D (21 times) and the EORTC QLQ-CR29 (six times). A total of 56/176 registered trials were published. In 35% (n = 20), the results of the PROMs were available. Overall, 7/20 (35%) trials documented all items of the CONSORT PRO extension and quality of reporting according to the CONSORT PRO extension was higher than in the period 2004-2012. In 3/20 (15%) of the published trials, the results of PROMs were not discussed nor included in the positioning of the new treatment compared to the reference treatment.

CONCLUSION

When PROMs are used, the quality of reporting on patient-reported outcomes is improving, but this must continue in order to optimize the translation of trial results to individual patient values.

Patient-Reported Outcomes and Experiences Assessment in Women with Breast Cancer: Portuguese Case Study

In 2020, female breast cancer was the most commonly diagnosed cancer worldwide, representing the type of cancer with the highest incidence among women and the second most common cause of cancer death among women in all OECD countries. The conventional measures addressing the burden of breast cancer by measuring mortality, incidence, and survival do not entirely reflect the quality of life and patients experience when receiving breast cancer care. The main objective of this study is to capture patient-reported outcomes and experiences in women with breast cancer in Portugal using methods developed for international benchmarking purposes, such as the OECD Patient-reported Indicators Surveys. The study included 378 women with breast cancer, with the age distribution being 19.8% aged 15 to 49 years and 80.2% aged 50 years and over. The data collection procedure and analysis followed the "OECD Breast Cancer Patient Reported Outcomes Working Group" protocol, allowing subsequent comparability with data from other OECD member countries. Most women were satisfied with the treatment outcome regarding the shape of their lumpectomy breast when wearing a bra (96.1%) and with the equal size of both breasts (78.3%). Findings on the WHO QOL-BREF showed that women manifest a lower score in well-being when compared with the general population or populations living with chronic diseases. This study shows the feasibility of implementing and using patient-reported metrics (PROM and PREM) in breast cancer services in Portugal. Measuring PROMs and PREMs from Portuguese women receiving breast cancer care provides insightful evidence into the quality and value of cancer care.

Identifying Listeners Whose Speech Intelligibility Depends on a Quiet Extra Moment After a Sentence

PURPOSE

An extra moment after a sentence is spoken may be important for listeners with hearing loss to mentally repair misperceptions during listening. The current audiologic test battery cannot distinguish between a listener who repaired a misperception versus a listener who heard the speech accurately with no need for repair. This study aims to develop a behavioral method to identify individuals who are at risk for relying on a quiet moment after a sentence.

METHOD

Forty-three individuals with hearing loss (32 cochlear implant users, 11 hearing aid users) heard sentences that were followed by either 2 s of silence or 2 s of babble noise. Both high- and low-context sentences were used in the task.

RESULTS

Some individuals showed notable benefit in accuracy scores (particularly for high-context sentences) when given an extra moment of silent time following the sentence. This benefit was highly variable across individuals and sometimes absent altogether. However, the group-level patterns of results were mainly explained by the use of context and successful perception of the words preceding sentence-final words.

CONCLUSIONS

These results suggest that some but not all individuals improve their speech recognition score by relying on a quiet moment after a sentence, and that this fragility of speech recognition cannot be assessed using one isolated utterance at a time. Reliance on a quiet moment to repair perceptions would potentially impede the perception of an upcoming utterance, making continuous communication in real-world scenarios difficult especially for individuals with hearing loss. The methods used in this study-along with some simple modifications if necessary-could potentially identify patients with hearing loss who retroactively repair mistakes by using clinically feasible methods that can ultimately lead to better patient-centered hearing health care.

SUPPLEMENTAL MATERIAL

https://doi.org/10.23641/asha.21644801.

Development and validation of the symptom burden questionnaire for long covid (SBQ-LC): Rasch analysis

OBJECTIVE

To describe the development and validation of a novel patient reported outcome measure for symptom burden from long covid, the symptom burden questionnaire for long covid (SBQ-LC).

DESIGN

Multiphase, prospective mixed methods study.

SETTING

Remote data collection and social media channels in the United Kingdom, 14 April to 1 August 2021.

PARTICIPANTS

13 adults (aged ≥18 years) with self-reported long covid and 10 clinicians evaluated content validity. 274 adults with long covid field tested the draft questionnaire.

MAIN OUTCOME MEASURES

Published systematic reviews informed development of SBQ-LC's conceptual framework and initial item pool. Thematic analysis of transcripts from cognitive debriefing interviews and online clinician surveys established content validity. Consensus discussions with the patient and public involvement group of the Therapies for Long COVID in non-hospitalised individuals: From symptoms, patient reported outcomes and immunology to targeted therapies (TLC Study) confirmed face validity. Rasch analysis of field test data guided item and scale refinement and provided initial evidence of the SBQ-LC's measurement properties.

RESULTS

SBQ-LC (version 1.0) is a modular instrument measuring patient reported outcomes and is composed of 17 independent scales with promising psychometric properties. Respondents rate their symptom burden during the past seven days using a dichotomous response or 4 point rating scale. Each scale provides coverage of a different symptom domain and returns a summed raw score that can be transformed to a linear (0-100) score. Higher scores represent higher symptom burden. After rating scale refinement and item reduction, all scales satisfied the Rasch model requirements for unidimensionality (principal component analysis of residuals: first residual contrast values <2.00 eigenvalue units) and item fit (outfit mean square values within 0.5 -1.5 logits). Rating scale categories were ordered with acceptable category fit statistics (outfit mean square values <2.0 logits). 14 item pairs had evidence of local dependency (residual correlation values >0.4). Across the 17 scales, person reliability ranged from 0.34 to 0.87, person separation ranged from 0.71 to 2.56, item separation ranged from 1.34 to 13.86, and internal consistency reliability (Cronbach's alpha) ranged from 0.56 to 0.91.

CONCLUSIONS

SBQ-LC (version 1.0) is a comprehensive patient reported outcome instrument developed using modern psychometric methods. It measures symptoms of long covid important to people with lived experience of the condition and may be used to evaluate the impact of interventions and inform best practice in clinical management.

Patient-reported outcome measures can advance population health, but is access to instruments and use equitable?

Patient reported outcome measures (PROM) can engage patients and clinicians to improve health outcomes. Their population health impact may be limited by systematic barriers inhibiting access to completion. In this analysis we evaluated the association between individual parent/child characteristics and clinic factors with parental completion of a locally developed PROM, the Early Healthy Lifestyles (EHL) questionnaire. Participants included parent-child dyads who presented at 14 pediatric clinics for regularly scheduled well-child visits (WCV) prior to age 26 months. EHL items include feeding practices, diet, play time, screen exposure, and sleep. Completion was categorized at patient- (i.e., parent-child dyad) and clinic-levels. Parents completed the 15-item EHL in the patient portal before arrival or in the clinic; ninety-three percent of EHL questionnaires were completed in the clinic vs. 7% in the patient portal. High-completers completed EHL for half of WCVs; low-completers completed at least once; and non-completers never completed. Clinics were classified by EHL adoption level (% high completion): High-adoption: >50%; Moderate-adoption: 10%-50%; and Low-adoption: <10%. Individual-level factors had negligible impact on EHL completion within moderate/low EHL adoption sites; high-adoption sites were used to evaluate infant and maternal factors in association with EHL completion using hierarchical logistic regression. Noncompletion of EHL was significantly associated (p < 0.05) with infant use of public insurance (OR = 1.92 [1.42, 2.59]), >1 clinic site for WCV (OR = 1.83 [1.34, 2.50]), non-White birth mother (OR = 1.78 [1.28, 2.47]), and body weight <2,500 grams or gestational age <34 weeks (OR = 1.74 [1.05, 2.90]). The number of WCVs, a proxy for clinic size, was evaluated but was not associated with completion. Findings indicate potential disparities between populations exposed to, completing, and benefitting from these tools.