Feedback of patient-reported outcomes to healthcare professionals for comparing health service performance: a scoping review

Evaluating the Population-Based Usage and Benefit of Digitally Collected Patient-Reported Outcomes and Experiences in Patients With Chronic Diseases: The PROMchronic Study Protocol

BACKGROUND

Chronic diseases are associated with a high disease burden. Under- and overprovision of care as well as quality variation between health care providers persists, while current quality indicators rarely capture the patients' perspective. Capturing patient-reported outcome measures (PROMs) as well as patient-reported experience measures (PREMs) is becoming more and more important to identify gaps in care provision, prioritize services most valuable to patients, and aid patients' self-management.

OBJECTIVE

This study aims to measure the potential benefits and effectiveness of using electronic patient-reported outcome measures (ePROMs) and electronic patient-reported experience measures in a structured and population-based manner to enhance health care for chronic disease patients in Germany.

METHODS

This prospective cohort study aims to evaluate the potential benefits of PROM usage in patients with chronic diseases. We evaluate whether (1) digitally collected PROMs and PREMs can be used for health system performance assessment by generating a representative response of chronically diseased individuals with asthma, chronic obstructive pulmonary disease, diabetes, and coronary artery disease across Germany, and (2) based on the PROMs and PREMs, low-value care can be identified. As patient-reported outcomes (PROs) are rarely presented back to patients, (3) this study also examines patients' reactions to their PROM scores in the form of digital PRO feedback. For these purposes, randomly selected patients from a nationwide German insurer are digitally surveyed with generic and disease-specific PROMs and PREMs, as well as additional questions on their health-related behavior, 4 times over 1 year. Individual PRO feedback is presented back to patients longitudinally and compared to a peer group after each survey period. Patient-reported data is linked with health insurance data. Response rates, changes in health and experience outcomes over time, self-reported changes in health behavior, and health care system usage will be analyzed.

RESULTS

The PROMchronic study explores the usage of PROMs in patients with chronic diseases. Data collection began in October 2023, after the initial invitation letter. All the 200,000 potential patients have been invited to participate in the study. Data have not yet been analyzed. Publication of the interim results is planned for the autumn of 2024, and the results are planned to be published in 2025.

CONCLUSIONS

We aim to fill the research gap on the population-based usage of PROMs and PREMs in patients with chronic diseases and add to the current understanding of PROM data-sharing with patients. The study's results can thereby inform whether a health care system-wide approach to collecting PROMs and PREMs can be used to identify low-value care, assess quality variation within and across chronic conditions, and determine whether PRO feedback is helpful and associated with any changes in patients' health behaviors.

TRIAL REGISTRATION

German Clinical Trials Register DRKS00031656; https://drks.de/search/en/trial/DRKS00031656.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

DERR1-10.2196/56487.

Navigating the Digital Landscape: Embracing Innovation, Addressing Challenges, and Prioritizing Patient-Centric Care

In the digital era, healthcare customer feedback plays a pivotal role in shaping the reputation of healthcare organizations. The study explores how digital advancements are integrated into modern healthcare, offering both transformative insights and addressing the challenges they present. It investigates how technologies such as artificial intelligence (AI), digital platforms, and patient feedback systems impact patient care, operational efficiency, and customer satisfaction in healthcare settings. The study emphasizes the importance of balancing both capitalizing on the opportunities presented by innovations and addressing the inherent difficulties associated with digitalization in healthcare, underlining the need for a comprehensive approach to navigating the opportunities and challenges in healthcare digitalization. AI is recognized for its role in reshaping value creation in healthcare, fostering collaboration among stakeholders, and improving patient care. Additionally, the study identifies key areas of research essential for effectively navigating the digital transformation in healthcare, including operational efficiency, patient-centric strategies, and organizational factors. However, along with the potential benefits come challenges, such as the need for regulatory frameworks to validate new technologies and address privacy concerns surrounding patient data. Managing reputation and customer relationships in the digital sphere also emerges as critical for healthcare organizations. In summary, the study underscores the importance of healthcare institutions prioritizing patient-centric care, adopting digital innovations, and adeptly navigating regulatory and ethical challenges. By doing so, they can enhance patient outcomes, and satisfaction, and drive innovation in today's dynamic healthcare landscape.

Tailored Model of Care for Patients with Metabolic Dysfunction-Associated Steatotic Liver Disease

Metabolic dysfunction-associated steatotic liver disease (MASLD), formerly known as nonalcoholic fatty liver disease (NAFLD), is increasing globally, creating a growing public health concern. However, this disease is often not diagnosed, and accurate data on its epidemiology are limited in many geographical regions, making it challenging to provide proper care and implement effective national plans. To combat the increasing disease burden, screening and diagnosis must reach a significant number of high-risk subjects. Addressing MASLD as a health care challenge requires a multidisciplinary approach involving prevention, diagnosis, treatment, and care, with collaboration between multiple stakeholders in the health care system. This approach must be guided by national and global strategies, to be combined with efficient models of care developed through a bottom-up process. This review article highlights the pillars of the MASLD model of care (MoC), including screening, risk stratification, and establishing a clinical care pathway for management, in addition to discussing the impact of nomenclature change on the proposed MoC.

PROMIS Profile-29 is a valid instrument with distinct advantages over legacy instruments for measuring the quality of life in chronic liver disease

BACKGROUND AND AIMS

The Patient-Reported Outcomes Measurement Information System (PROMIS) is increasingly used to measure health-related quality of life, yet, it has not been well-studied in chronic liver disease (CLD). This study compares PROMIS Profile-29 to Short-Form Health Survey (SF-36) and Chronic Liver Disease Questionnaire (CLDQ) in patients with CLD.

APPROACH AND RESULTS

In all, 204 adult outpatients with CLD completed PROMIS-29, CLDQ, SF-36 and usability questionnaires. Mean scores were compared between groups, the correlation between domain scores was assessed, and floor/ceiling effects were calculated. Etiologies of CLD were NAFLD (44%), hepatitis C (16%), and alcohol (16%). Fifty-three percent had cirrhosis and 33% were Child-Pugh B/C with a mean model for end-stage liver disease score of 12.0. In all 3 tools, the poorest scores were in physical function and fatigue. The presence of cirrhosis or complications was associated with worse scores in most PROMIS Profile-29 domains, indicating known group validity. Strong correlations ( r ≥ 0.7) were present between Profile-29 and SF-36 or CLDQ domains measuring similar concepts, indicating strong convergent validity. Profile-29 was completed faster than SF-36 and CLDQ (5.4 ± 3.0, 6.7 ± 3.3, 6.5 ± 5.2 min, p = 0.003) and rated equally on usability. All CLDQ and SF-36 domains reached the floor or ceiling, while none were noted for Profile-29. These floor/ceiling effects were magnified when assessed in those with and without cirrhosis, indicating the improved depth of measurement by Profile-29.

CONCLUSIONS

Profile-29 is a valid, more efficient, well-received tool that provides an improved depth of measurement when compared to SF-36 and CLDQ and, therefore, an ideal tool to measure general health-related quality of life in CLD.

Remote Symptom Monitoring With Ecological Momentary Computerized Adaptive Testing: Pilot Cohort Study of a Platform for Frequent, Low-Burden, and Personalized Patient-Reported Outcome Measures

BACKGROUND

Remote patient-reported outcome measure (PROM) data capture can provide useful insights into research and clinical practice and deeper insights can be gained by administering assessments more frequently, for example, in ecological momentary assessment. However, frequent data collection can be limited by the burden of multiple, lengthy questionnaires. This burden can be reduced with computerized adaptive testing (CAT) algorithms that select only the most relevant items from a PROM for an individual respondent. In this paper, we propose "ecological momentary computerized adaptive testing" (EMCAT): the use of CAT algorithms to reduce PROM response burden and facilitate high-frequency data capture via a smartphone app. We develop and pilot a smartphone app for performing EMCAT using a popular hand surgery PROM.

OBJECTIVE

The aim of this study is to determine the feasibility of EMCAT as a system for remote PROM administration.

METHODS

We built the EMCAT web app using Concerto, an open-source CAT platform maintained by the Psychometrics Centre, University of Cambridge, and hosted it on an Amazon Web Service cloud server. The platform is compatible with any questionnaire that has been parameterized with item response theory or Rasch measurement theory. For this study, the PROM we chose was the patient evaluation measure, which is commonly used in hand surgery. CAT algorithms were built using item response theory models derived from UK Hand Registry data. In the pilot study, we enrolled 40 patients with hand trauma or thumb-base arthritis, across 2 sites, between July 13, 2022, and September 14, 2022. We monitored their symptoms with the patient evaluation measure, via EMCAT, over a 12-week period. Patients were assessed thrice weekly, once daily, or thrice daily. We additionally administered full-length PROM assessments at 0, 6, and 12 weeks, and the User Engagement Scale at 12 weeks.

RESULTS

The use of EMCAT significantly reduced the length of the PROM (median 2 vs 11 items) and the time taken to complete it (median 8.8 seconds vs 1 minute 14 seconds). Very similar scores were obtained when EMCAT was administered concurrently with the full-length PROM, with a mean error of <0.01 on a logit (z score) scale. The median response rate in the daily assessment group was 93%. The median perceived usability score of the User Engagement Scale was 4.0 (maximum possible score 5.0).

CONCLUSIONS

EMCAT reduces the burden of PROM assessments, enabling acceptable high-frequency, remote PROM data capture. This has potential applications in both research and clinical practice. In research, EMCAT could be used to study temporal variations in symptom severity, for example, recovery trajectories after surgery. In clinical practice, EMCAT could be used to monitor patients remotely, prompting early intervention if a patient's symptom trajectory causes clinical concern.

TRIAL REGISTRATION

ISRCTN 19841416; https://www.isrctn.com/ISRCTN19841416.

Remote follow-up based on patient-reported outcomes in patients with chronic kidney disease: A qualitative study of patient perspectives

BACKGROUND

Patient-reported outcomes (PROs) are increasingly used in outpatient follow-up. PRO-based remote follow-up offers a new healthcare delivery model, where PROs are used as the basis for outpatient follow-up in patients with chronic kidney disease. However, the patient's perspective of this novel remote care delivery remains unknown.

OBJECTIVES

This study aimed to explore the patients' experiences using PROs in remote care and how this mode of follow-up may enhance patient engagement.

DESIGN

A qualitative approach was employed, guided by Focused Ethnography and Interpretive Description.

PARTICIPANTS

Purposively, 15 patients with chronic kidney disease experienced with PRO-based remote follow-up in 3 renal outpatient clinics in the Central Denmark Region, were recruited.

MEASURES

Field studies comprising participant observation in remote PRO consultations and individual, semi-structured interviews with the patients constituted the empirical data. Thematic analysis was performed according to Braun and Clarke's six-phase process.

RESULTS

PRO-based remote follow-up may enhance patient engagement by a) improving communication, b) increasing disease knowledge, c) inducing flexibility, d) ensuring clinician feedback on PRO data, and e) prompting clinical action. Barriers to enhanced patient engagement were identified as a) lack of feedback on PRO data, b) lower disease knowledge, c) PRO in competition with biomedical data, and d) loss of personal relation.

CONCLUSION

PRO-based follow-up in remote care holds several advantages for the patients. However, some barriers need clinical awareness before PROs may enhance the patients' engagement in remote follow-up. Future studies should explore the impact of involving relatives in PRO-based follow-up.

Reporting unit context data to stakeholders in long-term care: a practical approach

Background

The importance of reporting research evidence to stakeholders in ways that balance complexity and usability is well-documented. However, guidance for how to accomplish this is less clear. We describe a method of developing and visualising dimension-specific scores for organisational context (context rank method). We explore perspectives of leaders in long-term care nursing homes (NHs) on two methods for reporting organisational context data: context rank method and our traditionally presented binary method—more/less favourable context.

Methods

We used a multimethod design. First, we used survey data from 4065 healthcare aides on 290 care units from 91 NHs to calculate quartiles for each of the 10 Alberta Context Tool (ACT) dimension scores, aggregated at the care unit level based on the overall sample distribution of these scores. This ordinal variable was then summed across ACT scores. Context rank scores were assessed for associations with outcomes for NH staff and for quality of care (healthcare aides’ instrumental and conceptual research use, job satisfaction, rushed care, care left undone) using regression analyses. Second, we used a qualitative descriptive approach to elicit NH leaders’ perspectives on whether the methods were understandable, meaningful, relevant, and useful. With 16 leaders, we conducted focus groups between December 2017 and June 2018: one in Nova Scotia, one in Prince Edward Island, and one in Ontario, Canada. Data were analysed using content analysis.

Results

Composite scores generated using the context rank method had positive associations with healthcare aides’ instrumental research use (p < .0067) and conceptual research use and job satisfaction (p < .0001). Associations were negative between context rank summary scores and rushed care and care left undone (p < .0001). Overall, leaders indicated that data presented by both methods had value. They liked the binary method as a starting point but appreciated the greater level of detail in the context rank method.

Conclusions

We recommend careful selection of either the binary or context rank method based on purpose and audience. If a simple, high-level overview is the goal, the binary method has value. If improvement is the goal, the context rank method will give leaders more actionable details.

BREAST-Q REACT: Clinical Reference Values for the BREAST-Q in Post-mastectomy Breast Reconstruction Patients

BACKGROUND

The BREAST-Q is the most commonly used patient-reported outcome measure (PROM) for breast reconstruction research. However, clinical implementation of this PROM has been impeded by a lack of context for score interpretation. The aim of this study was to define reference values for the BREAST-Q at discrete timepoints following surgery, generating a tool for real-time score interpretation.

METHODS

BREAST-Q scores were prospectively obtained in women who underwent implant or autologous post-mastectomy breast reconstruction preoperatively and for 2 years following surgery at Memorial Sloan Kettering Cancer Center (MSK). Descriptive statistics were used to create reference values for BREAST-Q satisfaction and quality-of-life subscales. Reference values were externally validated by comparing patient characteristics and BREAST-Q scores between the MSK and the Mastectomy Reconstruction Outcomes Consortium (MROC) study cohorts.

RESULTS

Overall, 3268 MSK patients and 2814 MROC patients were included for analysis. When MSK and MROC cohorts were compared for validation, there were some statistical differences in BREAST-Q scores; however, most of these differences did not meet the minimal clinically important difference of 4 points. Reference values were used to create the BREAST-Q Real-time Engagement and Communication Tool (REACT).

CONCLUSIONS

Using a large cohort of patients, we have defined BREAST-Q reference values for post-mastectomy breast reconstruction patients for use in clinical practice. The BREAST-Q REACT will help breast reconstruction providers gauge patient wellbeing and satisfaction relative to the "average" breast reconstruction patient and determine which patients may benefit from additional intervention.

Feedback of aggregate patient-reported outcomes (PROs) data to clinicians and hospital end users: findings from an Australian codesign workshop process

OBJECTIVES

Patient-reported outcomes (PROs) are increasingly used to measure the patient's perspective of their outcomes following healthcare interventions. The aim of this study was to determine the preferred formats for reporting service-level PROs data to clinicians, researchers and managers to support greater utility of these data to improve healthcare and patient outcomes.

SETTING

Healthcare professionals receiving PRO data feedback at the health service level.

PARTICIPANTS

An interdisciplinary Project Working Group comprised of clinicians participated in three workshops to codesign reporting templates of summarised PRO data (modified Rankin Scale, EuroQol Five Dimension Descriptive System, EuroQol Visual Analogue Scale and Hospital Anxiety and Depression Scale) using a modified Delphi process. An electronic survey was then distributed to short list the preferred templates among a broad sample of clinical end users. A final workshop was undertaken with the Project Working Group to review results and reach consensus on the final templates.

PRIMARY AND SECONDARY OUTCOME MEASURES

The recommendation of preferred PRO summary data feedback templates and guiding principles for reporting aggregate PRO data to clinicians was the primary outcome. A secondary outcome was the identification of perceived barriers and enablers to the use of PRO data in hospitals. For each outcome measure, quantitative and qualitative data were summarised.

RESULTS

31 Working Group members (19 stroke, 2 psychology, 1 pharmacy, 9 researchers) participated in the workshops, where 25/55 templates were shortlisted for wider assessment. The survey was completed by 114 end users. Strongest preferences were identified for bar charts (37/82 votes, 45%) and stacked bar charts (37/91 votes, 41%). At the final workshop, recommendations to enhance communication of PROs data for comparing health service performance were made including tailoring feedback to professional roles and use of case-mix adjustment to ensure fair comparisons.

CONCLUSIONS

Our research provides guidance on PROs reporting for optimising data interpretation and comparing hospital performance.

Separate but Related: Dimensions of Healthcare Provider Social Support in Day-Treatment Oncology Units

Social support by healthcare providers has been increasingly investigated during the past decade, but studies have made different choices concerning its measurement. To evaluate how social support from a healthcare provider impacts the perceived quality of care and patient outcomes, reliable and valid instruments capable of measuring specific aspects of the construct are needed. In study 1, we tested the factor structure and the psychometric properties of a new Healthcare Provider Social Support measure (HPSS) for oncology settings. One-hundred-sixty-two patients (89 females; M age = 58.97, SD age = 13.28) from religious and government-operated hospitals completed the HPSS during day treatment. We modeled the HPSS factor structure to represent four related aspects: Emotional, Informational, Appraisal, and Instrumental social support. Study 2 preliminarily assessed the concurrent validity of the HPSS with patient perceptions of the patient-doctor relationship. Sixty-nine patients (40 females; M age = 53.67, SD age = 13.74) completed the HPPS with scales assessing perceived doctor-patient communication and patient trust in the healthcare provider. Study 1, using Exploratory Structural Equation Modeling, showed that a bifactor model had an excellent fit. The analysis supported the use of subscale scores, which were more tenable than a single total score in terms of bifactor model indices. This conclusion was also supported by greater scalability of the subscales in a Mokken Scale Analysis. Oncology patients treated in the religious hospital perceived greater Emotional, Informational, and Instrumental social support from their healthcare provider than those treated in government-operated. Study 2 showed that patient ratings of healthcare provider social support, except Instrumental, were positively correlated with better doctor communication skills and greater trust in the physician. Multiple regression analyses showed that Informational and Emotional support provided a unique contribution to building trust in the physician, controlling for the doctor's communication skills. The study results showed that the four social support ratings were reliable and valid, sharpening the distinction between functional components in the formal healthcare system.

Visualization formats of patient-reported outcome measures in clinical practice: a systematic review about preferences and interpretation accuracy

PURPOSE

The use of Patient-Reported Outcome Measures (PROMs) for individual patient management within clinical practice is becoming increasingly important. New evidence about graphic visualization formats for PROMs scores has become available. This systematic literature review evaluated evidence for graphic visualization formats of PROMs data in clinical practice for patients and clinicians, for both individual and group level PROMs data.

METHODS

Studies published between 2000 and 2020 were extracted from CINAHL, PubMed, PsychInfo, and Medline. Studies included patients ≥ 18 years old in daily clinical practice. Papers not available in English, without full-text access, or that did not specifically describe visualization of PROMs data were excluded. Outcomes were: visualization preferences; interpretation accuracy; guidance for clinical interpretation.

RESULTS

Twenty-five out of 789 papers were included for final analysis. Most frequently studied formats were: bar charts, line graphs, and pie charts. Patients preferred bar charts and line graphs as these were easy and quick for retrieving information about their PROMs scores over time. Clinicians' interpretation accuracy and preferences were similar among graphic visualization formats. Scores were most often compared with patients' own previous scores; to further guide clinical interpretation, scores were compared to norm population scores. Different 'add-ons' improved interpretability for patients and clinicians, e.g. using colors, descriptions of measurement scale directionality, descriptive labels, and brief definitions.

CONCLUSION

There was no predominant graphical visualization format approach in terms of preferences or interpretation accuracy for both patients and clinicians. Detailed clarification of graph content is essential.

Deploying the Behavioral and Environmental Sensing and Intervention for Cancer (BESI-C) smart health system to support patients and family caregivers in managing pain: A feasibility and acceptability study. (Preprint)

Background

Distressing cancer pain remains a serious symptom management issue for patients and family caregivers, particularly within home settings. Technology can support home-based cancer symptom management but must consider the experience of patients and family caregivers, as well as the broader environmental context.

Objective

This study aimed to test the feasibility and acceptability of a smart health sensing system—Behavioral and Environmental Sensing and Intervention for Cancer (BESI-C)—that was designed to support the monitoring and management of cancer pain in the home setting.

Methods

Dyads of patients with cancer and their primary family caregivers were recruited from an outpatient palliative care clinic at an academic medical center. BESI-C was deployed in each dyad home for approximately 2 weeks. Data were collected via environmental sensors to assess the home context (eg, light and temperature); Bluetooth beacons to help localize dyad positions; and smart watches worn by both patients and caregivers, equipped with heart rate monitors, accelerometers, and a custom app to deliver ecological momentary assessments (EMAs). EMAs enabled dyads to record and characterize pain events from both their own and their partners’ perspectives. Sensor data streams were integrated to describe and explore the context of cancer pain events. Feasibility was assessed both technically and procedurally. Acceptability was assessed using postdeployment surveys and structured interviews with participants.

Results

Overall, 5 deployments (n=10 participants; 5 patient and family caregiver dyads) were completed, and 283 unique pain events were recorded. Using our “BESI-C Performance Scoring Instrument,” the overall technical feasibility score for deployments was 86.4 out of 100. Procedural feasibility challenges included the rurality of dyads, smart watch battery life and EMA reliability, and the length of time required for deployment installation. Postdeployment acceptability Likert surveys (1=strongly disagree; 5=strongly agree) found that dyads disagreed that BESI-C was a burden (1.7 out of 5) or compromised their privacy (1.9 out of 5) and agreed that the system collected helpful information to better manage cancer pain (4.6 out of 5). Participants also expressed an interest in seeing their own individual data (4.4 out of 5) and strongly agreed that it is important that data collected by BESI-C are shared with their respective partners (4.8 out of 5) and health care providers (4.8 out of 5). Qualitative feedback from participants suggested that BESI-C positively improved patient-caregiver communication regarding pain management. Importantly, we demonstrated proof of concept that seriously ill patients with cancer and their caregivers will mark pain events in real time using a smart watch.

Conclusions

It is feasible to deploy BESI-C, and dyads find the system acceptable. By leveraging human-centered design and the integration of heterogenous environmental, physiological, and behavioral data, the BESI-C system offers an innovative approach to monitor cancer pain, mitigate the escalation of pain and distress, and improve symptom management self-efficacy.

International Registered Report Identifier (IRRID)

RR2-10.2196/16178

Positive Outcomes: Validity, reliability and responsiveness of a novel person-centred outcome measure for people with HIV

OBJECTIVES

Despite successful treatment, people living with HIV experience persisting and burdensome multidimensional problems. We aimed to assess the validity, reliability and responsiveness of Positive Outcomes, a patient-reported outcome measure for use in clinical practice.

METHODS

In all, 1392 outpatients in five European countries self-completed Positive Outcomes, PAM-13 (patient empowerment), PROQOL-HIV (quality of life) and FRAIL (frailty) at baseline and 12 months. Analysis assessed: (a) validity (structural, convergent and divergent, discriminant); (b) reliability (internal consistency, test-retest); and (c) responsiveness.

RESULTS

An interpretable four-factor structure was identified: 'emotional wellbeing', 'interpersonal and sexual wellbeing', 'socioeconomic wellbeing' and 'physical wellbeing'. Moderate to strong convergent validity was found for three subscales of Positive Outcomes and PROQOL (ρ = -0.481 to -0.618, all p < 0.001). Divergent validity was found for total scores with weak ρ (-0.295, p < 0.001). Discriminant validity was confirmed with worse Positive Outcomes score associated with increasing odds of worse FRAIL group (4.81-fold, p < 0.001) and PAM-13 level (2.28-fold, p < 0.001). Internal consistency for total Positive Outcomes and its factors exceeded the conservative α threshold of 0.6. Test-retest reliability was established: those with stable PAM-13 and FRAIL scores also reported median Positive Outcomes change of 0. Improved PROQOL-HIV score baseline to 12 months was associated with improved Positive Outcomes score (r = -0.44, p < 0.001).

CONCLUSIONS

Positive Outcomes face and content validity was previously established, and the remaining validity, reliability and responsiveness properties are now demonstrated. The items within the brief 22-item tool are designed to be actionable by health and social care professionals to facilitate the goal of person-centred care.