What do these scores mean? Presenting patient-reported outcomes data to patients and clinicians to improve interpretability

Strategies for implementing an electronic patient-reported outcomes-based symptom management program across six cancer centers

BACKGROUND

Electronic patient-reported outcome (ePRO)-based symptom management improves cancer patients' outcomes. However, implementation of ePROs is challenging, requiring technical resources for integration into clinical systems, substantial buy-in from clinicians and patients, novel workflows to support between-visit symptom management, and institutional investment.

METHODS

The SIMPRO Research Consortium developed eSyM, an electronic health record-integrated, ePRO-based symptom management program for medical oncology and surgery patients and deployed it at six cancer centers between August 2019 and April 2022 in a type II hybrid effectiveness-implementation cluster randomized stepped-wedge study. Sites documented implementation strategies monthly using REDCap, itemized them using the Expert Recommendations for Implementation Change (ERIC) list and mapped their target barriers using the Consolidated Framework for Implementation Research (CFIR) to inform eSyM program enhancement, facilitate inter-consortium knowledge sharing and guide future deployment efforts.

RESULTS

We documented 226 implementation strategies: 35 'foundational' strategies were applied consortium-wide by the coordinating center and 191 other strategies were developed by individual sites. We consolidated these 191 site-developed strategies into 64 unique strategies (i.e., removed duplicates) and classified the remainder as either 'universal', consistently used by multiple sites (N = 29), or 'adaptive', used only by individual sites (N = 35). Universal strategies were perceived as having the highest impact; they addressed eSyM clinical preparation, training, engagement of patients/clinicians, and program evaluation. Across all documented SIMPRO strategies, 44 of the 73 ERIC strategies were addressed and all 5 CFIR barriers were addressed.

CONCLUSION

Methodical collection of theory-based implementation strategies fostered the identification of universal, high-impact strategies that facilitated adoption of a novel care-delivery intervention by patients, clinicians, and institutions. Attention to the high-impact strategies identified in this project could support implementation of ePROs as a component of routine cancer care at other institutions.

TRIAL REGISTRATION

ClinicalTrials.gov. NCT03850912. February 22, 2019. https://clinicaltrials.gov/ct2/show/NCT03850912?term=hassett&draw=2&rank=1.

Patient perspective on adapting to bowel dysfunction after rectal cancer surgery

AIM

Bowel dysfunction continues to be a clinically significant consequence of rectal cancer surgery, affecting quality of life. Rectal cancer patients value self-empowerment and adaptation to change to improve their quality of life in the context of bowel dysfunction. There are limited qualitative data addressing patients' perspectives on adapting to bowel dysfunction. The aim of this study is to evaluate patients' perspectives on adapting to bowel dysfunction after rectal cancer surgery.

METHOD

Adult patients who underwent rectal cancer surgery with sphincter preservation at a single colorectal referral centre from July 2017 to July 2020 were included. Patients were excluded if they had surgery <1 year since recruitment, received a permanent stoma or developed recurrence or metastasis. Semistructured interviews were held by phone and transcribed verbatim. Bowel dysfunction was assessed via the low anterior resection syndrome (LARS) score. Thematic analysis was used to identify adaptations which patients found helpful for improving bowel dysfunction after rectal cancer surgery.

RESULTS

A total of 54 patient interviews were included. The distribution of patients with no, minor and major LARS was 39%, 22% and 39%, respectively. Four main themes were conceived from the analysis: implementing lifestyle changes, fostering supportive relationships and self-compassion, communication and access to resources, and adapting to social and cultural challenges. Associated subthemes were identified, namely forward planning, self-compassion and addressing social stigma.

CONCLUSION

Patients' valuable perspective on adapting to bowel dysfunction involve subtle themes which expand the existing literature. These themes inform a patient-centred approach, which may improve outcomes and quality of care for rectal cancer patients.

How well do we measure the impact of bowel dysfunction on health-related quality of life after rectal cancer surgery?

BACKGROUND

Rectal cancer surgery risks causing bowel dysfunction, which has an important impact on health-related quality of life. The validity of generic tools used to measure health-related quality of life after bowel dysfunction is unclear. This study aimed to determine the content validity of health-related quality-of-life measurement tools in rectal cancer.

METHODS

This was a qualitative single-center study in which adult patients who underwent rectal cancer surgery with sphincter preservation from July 2017 to October 2020 were recruited. Patients were excluded if they developed local metastasis, required a permanent stoma, or had surgery <1 year since recruitment. Telephone-based semi-structured interviews were conducted. Bowel dysfunction was measured using the Low Anterior Resection Syndrome score. Content analysis was achieved using the International Classification of Functioning framework.

RESULTS

Recurrent bowel dysfunction-related concepts included "Mental functions," "Defecation functions," "Emotional functions," "Recreation and leisure," "Intimate relationships," and "Remunerative employment." A mean of 7.5 recurrent bowel dysfunction-related concepts were identified within the health-related quality of life instruments analyzed. The European Organization for Research and Treatment of Cancer Quality-of-Life Questionnaire-C30 (n = 11) and the 36-Item Short Form Health Survey (n = 9) covered the greatest number of recurrent bowel dysfunction-related concepts. Concepts such as "Mental functions," "Urination functions," "Sexual functions," "Driving," and "Mobility" were not covered by any instrument.

CONCLUSION

The content of traditional health-related quality-of-life instruments is missing important areas that represent the impact of bowel dysfunction after rectal cancer surgery on health-related quality of life. These findings could help improve patient-centered care in rectal cancer surgery.

Interpretability and Clinical Utility of the Pediatric Evaluation of Disability Inventory - Patient Reported Outcome (PEDI-PRO) Score Report

AIMS

Well-designed score reports can support therapists to accurately interpret assessments. We piloted a score report for the Pediatric Evaluation Disability Inventory-Patient Reported Outcome (PEDI-PRO) and evaluated: 1) To what extent can occupational and physical therapists (OT, PT) accurately interpret item-response theory (IRT)-based PEDI-PRO assessment results? 2) What is the perceived clinical utility of the pilot score report?

METHODS

Exploratory, sequential mixed methods design. Focus groups with OT and PTs (n = 20) informed the development of the final score report; revisions were made in response to feedback. Next, OTs and PTs (n = 33) reviewed score reports from two fictional clients and answered survey questions about the interpretation of the PEDI-PRO results. Additional questions evaluated clinical utility.

RESULTS

Focus groups: Visual cues supported score interpretation, but therapists requested additional explanations for advanced IRT measurement concepts. Survey: Therapists accurately interpreted foundational IRT concepts (e.g. identifying most/least difficult items, highest scores), but were less accurate when interpreting advanced concepts (e.g. fit, unexpected responses). Therapists anticipated sharing different components of the score report with family members, clinicians, and payers to support their clinical practice.

CONCLUSIONS

The pilot PEDI-PRO score report was highly endorsed by therapists, but therapists may need additional training to interpret advanced IRT concepts.

Association of Social Determinants with Patient-Reported Outcomes in Patients with Cancer

Patient-reported outcome (PRO) scores have been utilized more frequently, but the relationship of PRO scores to determinants of health and social inequities has not been widely studied. Our goal was to determine the association of PRO scores with social determinants. All patients with a new cancer diagnosis who completed a PRO survey from 2020 to 2022 were included. The PRO survey recorded scores for depression, fatigue, pain interference and physical function. Higher depression, fatigue and pain scores indicated more distress. Higher physical condition scores indicated improved functionality. A total of 1090 patients were included. Married patients had significantly better individual PRO scores for each domain. Patients who were able to use the online portal to complete their survey also had better individual scores. Male patients and non-White patients had worse pain scores than female and White patients, respectively. Patients with prostate cancer had the best scores while patients with head and neck and lung cancer had the worst scores. PRO scores varied by cancer disease site and stage. Social support may act in combination with specific patient/tumor factors to influence PRO scores. These findings present opportunities to address patient support at institutional levels.

Strategies for Implementing an Electronic Patient-Reported Outcomes-Based Symptom Management Program Across Six Cancer Centers

Background

Electronic patient-reported outcome (ePRO)-based symptom management improves cancer patients' outcomes. However, implementation of ePROs is challenging, requiring technical resources for integration into clinical systems, substantial buy-in from clinicians and patients, novel workflows to support between-visit symptom management, and institutional investment.

Methods

The SIMPRO Research Consortium developed eSyM, an electronic health record-integrated, ePRO-based symptom management program for medical oncology and surgery patients and deployed it at six cancer centers between August 2019 and April 2022 in a type II hybrid effectiveness-implementation cluster randomized stepped-wedge study. Sites documented implementation strategies monthly using REDCap, itemized them using the Expert Recommendations for Implementation Change (ERIC) list and mapped their target barriers using the Consolidated Framework for Implementation Research (CFIR) to inform eSyM program enhancement, facilitate inter-consortium knowledge sharing and guide future deployment efforts.

Results

We documented 226 implementation strategies: 35 'foundational' strategies were applied consortium-wide by the coordinating center and 191 other strategies were developed by individual sites. We consolidated these 191 site-developed strategies into 64 unique strategies (i.e., removed duplicates) and classified the remainder as either 'universal', consistently used by multiple sites (N=29), or 'adaptive', used only by individual sites (N=35). Universal strategies were perceived as having the highest impact; they addressed eSyM clinical preparation, training, engagement of patients/clinicians, and program evaluation. Across all documented SIMPRO strategies, 44 of the 73 ERIC strategies were addressed and all 5 CFIR barriers were addressed.

Conclusion

Methodical collection of theory-based implementation strategies fostered the identification of universal, high-impact strategies that facilitated adoption of a novel care-delivery intervention by patients, clinicians, and institutions. Attention to the high-impact strategies identified in this project could support implementation of ePROs as a component of routine cancer care at other institutions.

A powerful partnership: researchers and patients working together to develop a patient-facing summary of clinical trial outcome data

OBJECTIVE

Availability of easy-to-understand patient-reported outcome (PRO) trial data may help individuals make more informed healthcare decisions. Easily interpretable, patient-centric PRO data summaries and visualizations are therefore needed. This three-stage study explored graphical format preferences, understanding, and interpretability of clinical trial PRO data presented to people with prostate cancer (PC).

MATERIALS AND METHODS

A 7-day online survey exploring people with PC's preferences for different PRO data presentations (stage 1; n = 30) informed development of a draft plain-language resource sheet containing PRO data. After refining for clarity during cognitive debriefing interviews (stage 2; n = 18), the final resource sheet was circulated to people with PC for broader feedback (stage 3; n = 45).

RESULTS

Although participants expressed preferences for certain graphical formats (pie charts and bar charts), preference did not always associate with interpretability and overall message clarity. Iterative development (stages 1 and 2) led to a final resource sheet, which 91.1% of participants in stage 3 considered useful and informative, and 88.9% expressed interest in receiving similar resources in the future.

DISCUSSION

Findings demonstrate PRO data are relevant to people with PC and highlights that targeted resource sheets can support patient-clinician discussions. Appropriate graphical formatting and use of plain-language text is essential for conveying interpretable PRO data. Data visualization preferences are context dependent.

CONCLUSION

Resource sheets summarizing clinical trial PRO data can be helpful for decision-making in PC. Researchers and patients can work together to develop clear, relevant, sensitive, and understandable resource sheets, which equally consider patient priorities as well as those of scientists.

The impact of restorative proctectomy versus permanent colostomy on health-related quality of life after rectal cancer surgery using the patient-generated index

BACKGROUND

The impact of bowel dysfunction versus colostomy on quality of life after rectal cancer surgery is poorly understood.

BACKGROUND

To evaluate the quality of life after rectal cancer surgery in patients with colostomy versus restorative proctectomy.

METHODS

A mixed-methods study measuring quality of life using the Patient-Generated Index, patients were asked to list up to 5 areas of their life affected by their surgery. Areas were then weighted according to patients' preferences for improvement to generate a score from 0-100. The areas reported by patients were linked to the International Classification of Functioning for content analysis. Bowel dysfunction was measured using the low anterior resection syndrome score, and patients were then grouped according to (1) colostomy, (2) no/minor, or (3) major low anterior resection syndrome. Quality of life was compared between groups.

RESULTS

Overall, 121 patients were included (colostomy n = 39, restorative proctectomy n = 82). There were no differences in demographics, neoadjuvant radiotherapy, or time to follow-up between groups. In the restorative proctectomy group, 53% had no/minor, and 47% had major low anterior resection syndrome. Overall, patients with colostomy had significantly lower quality-of-life scores than those with restorative proctectomy. However, patients with major low anterior resection syndrome scored similarly to those with colostomy. On content analysis, patients with colostomies reported more problems with sexual function, body image, and sports. Patients with restorative proctectomy reported more problems with sleep, using transportation, and taking care of themselves.

CONCLUSION

Colostomy has a more detrimental impact on quality of life than restorative proctectomy. However, bowel dysfunction severity is important to consider. The patient experience between treatments differs.

Healthcare providers' understanding of data displays of clinical trial information: a scoping review of the literature

BACKGROUND

Healthcare providers often encounter clinical trial results in the form of visual data displays. Although there is a robust literature on patient responses to data displays in medical settings, less is known about how providers comprehend and apply this information. Our study provides a scoping review of the literature on providers' reactions to and perceptions of data displays.

METHODS

We searched article databases (PubMed, PsycINFO, Web of Science, Cumulative Index to Nursing and Allied Health Literature, the Cochrane Library) supplemented by handsearching. Eligible articles were published in English from 1990 to 2020.

RESULTS

We identified 15 articles meeting our criteria. Studies with physicians were more prevalent (13/15) than those with other healthcare providers (6/15). Commonly assessed outcomes included objective (10/15) and subjective comprehension (4/15), preference for certain data display formats (6/15), and hypothetical decision-making around prescribing (4/15). In studies that assessed comprehension of clinical trial concepts, scores were average or below what would be considered mastery of the information. Data display formats that were preferred did not always correlate with better comprehension of information; lesser preferred formats (e.g. icon array) often resulted in better comprehension.

CONCLUSION

Our findings suggest that healthcare providers may not accurately interpret complex types of data displays, and it is unknown if such limitations affect actual decision-making. Interventions are needed to enhance comprehension of complex data displays within the context of prescription drug professional promotion.

Understanding the Impact of Bowel Dysfunction on Quality of Life After Rectal Cancer Surgery From the Patient's Perspective

BACKGROUND

Bowel dysfunction is an important consequence of rectal cancer surgery' and the specific quality-of-life domains that are affected remain unclear and unaddressed by generic surveys.

OBJECTIVE

This study aimed to identify quality-of-life domains most affected by rectal cancer surgery.

DESIGN

Qualitative content analysis.

SETTINGS

Semistructured interviews conducted by telephone with patients recruited from a single university-affiliated colorectal referral center.

PATIENTS

Adult patients were included if they underwent rectal cancer surgery with sphincter preservation from July 2017 to July 2020. Patients were excluded if their surgery was <1 year since the recruitment date, received a permanent stoma, or developed recurrence or metastasis.

MAIN OUTCOME MEASURES

Bowel dysfunction was evaluated via the low anterior resection syndrome score. Interview transcripts were coded by 2 independent reviewers and evaluated for concordance. Qualitative content analysis was used to identify themes, and their frequency of occurrence was quantified (percent total number of interviews).

RESULTS

A total of 54 patient interviews were conducted. Analysis revealed 5 quality-of-life-related themes impacted by bowel dysfunction: experiencing psychological and emotional stress, challenging roles and relationships within society, encountering physical limitations, restricting leisure and recreational activities, and learning self-empowerment and adapting to change. Patients with minor and major bowel dysfunction were more likely to report disruption to their social activities and their role as a sexual partner versus those with no bowel dysfunction. Patients with major bowel dysfunction were more likely to report effects on sleep versus those with no and minor bowel dysfunction.

LIMITATIONS

Single center, self-reported, and observer bias.

CONCLUSION

The impact of bowel dysfunction on quality of life includes a wide range of themes that extend beyond traditional measures. These results may help better inform patients in the preoperative setting and serve as a basis for the development of a more patient-centered quality-of-life survey.

COMPRENDER EL IMPACTO DE LA DISFUNCIN INTESTINAL EN LA CALIDAD DE VIDA DESPUS DE LA CIRUGA DE CNCER DE RECTO DESDE LA PERSPECTIVA DEL PACIENTE

ANTECEDENTES:La disfunción intestinal es una consecuencia importante de la cirugía del cáncer de recto y los dominios específicos de la calidad de vida que se ven afectados siguen sin estar claros y sin abordarse en las encuestas genéricas.OBJETIVO:Identificar los dominios de calidad de vida más afectados por la cirugía del cáncer de recto.DISEÑO:Análisis cualitativo de contenido.ÁMBITOS:Entrevistas semiestructuradas realizadas por teléfono con pacientes reclutados de un único centro de referencia colorrectal afiliado a una universidad.PACIENTES:Pacientes adultos intervenidos de cáncer de recto con preservación de esfínter del 07/2017 al 07/2020. Los pacientes fueron excluidos si su cirugía fue <1 año desde la fecha de reclutamiento, recibieron un estoma permanente o desarrollaron recurrencia o metástasis.PRINCIPALES MEDIDAS DE RESULTADO:La disfunción intestinal se evaluó a través de la puntuación del síndrome de resección anterior baja. Dos revisores independientes codificaron las transcripciones de las entrevistas y evaluaron su concordancia. Se utilizó el análisis de contenido cualitativo para identificar los temas, cuantificando su frecuencia de aparición (porcentaje del número total de entrevistas).RESULTADOS:Se realizaron un total de 54 entrevistas a pacientes. El análisis reveló cinco temas relacionados con la calidad de vida afectados por la disfunción intestinal: experimentar estrés psicológico y emocional, roles y relaciones desafiantes dentro de la sociedad, encontrar limitaciones físicas, restringir actividades recreativas y de ocio, y autoempoderamiento y adaptación al cambio. Los pacientes con disfunción intestinal menor y mayor tenían más probabilidades de informar la interrupción de las actividades sociales y el papel como pareja sexual en comparación con aquellos sin disfunción intestinal. Los pacientes con disfunción intestinal importante tenían más probabilidades de informar efectos sobre el sueño en comparación con aquellos sin disfunción intestinal o con disfunción intestinal menor.LIMITACIONES:Sesgo de un solo centro, autoinformado y observador.CONCLUSIÓN:El impacto de la disfunción intestinal en la calidad de vida incluye una amplia gama de temas que se extienden más allá de las medidas tradicionales. Estos resultados pueden ayudar a informar mejor a los pacientes en el entorno preoperatorio y servir como base para el desarrollo de una encuesta de calidad de vida más centrada en el paciente. (Traducción-Dr. Yesenia Rojas-Khalil ).

Complexity of Data Displays in Prescription Drug Advertisements for Healthcare Providers

BACKGROUND

Healthcare providers (HCPs) often encounter clinical trial results in the form of data displays in prescription drug promotions. Information conveyed in data displays vary in their presentation and complexity. This study describes characteristics of data displays in prescription drug advertising targeted to HCPs.

METHODS

This study characterized the content of 140 data displays in 98 unique print advertisements from 2009 to present and identified in AdPharm, an online database of pharmaceutical advertisements. Two reviewers independently coded the advertisements for characteristics (κ = 0.85) including complexity, format, and quality.

RESULTS

About one-third (32%) of the advertisements contained multiple data displays (range 2 to 6) and 44% showed clinical data from oncology trials; other disease domains were mental and behavioral health (14%), rheumatology and autoimmune disorders (8%), endocrinology (7%), cardiology (6%), infectious disease (6%), pulmonology and allergy (4%), and others (< 2% each). About one-half (51%) of displays were classified as "simple" which included "pseudographs" and basic tables or charts. "Complex" displays appeared as survival curves, line graphs, or bar graphs with complex features. Most complex displays included a comparator drug (90%), plain language restatement of the key finding (93%) and disclosure statements (91%) with additional study details, although their placement varied. Complex displays were of high quality, according to our selected indicators; our analysis found no data distortion or errors.

CONCLUSION

Data displays in prescription drug advertising are often highly complex. Future research assessing understanding of data displays and the potentially beneficial effect of disclosures and other features is warranted.

Oncology Providers' and Professionals' Experiences With Suicide Risk Screening Among Patients With Head and Neck Cancer: A Qualitative Study

PURPOSE

There has been limited study of the implementation of suicide risk screening for patients with head and neck cancer (HNC) as a part of routine care. To address this gap, this study assessed oncology providers' and professionals' perspectives about barriers and facilitators of implementing a suicide risk screening among patients with HNC.

MATERIALS AND METHODS

All patients with HNC with an in-person visit completed a suicide risk screening on an electronic tablet. Patients reporting passive death wish were then screened for active suicidal ideation and referred for appropriate intervention. Interviews were conducted with 25 oncology providers and professionals who played a key role in implementation including nurses, medical assistants, patient access representatives, advanced practice providers, physicians, social workers, and informatics staff. The interview guide was based on the Consolidated Framework for Implementation Research. Interviews were transcribed and analyzed for themes.

RESULTS

Participants identified multilevel implementation barriers, such as intervention level (eg, patient difficulty with using a tablet), process level (eg, limited nursing engagement), organizational level (eg, limited clinic Wi-Fi connectivity), and individual level (eg, low clinician self-efficacy for interpreting and acting upon patient-reported outcome scores). Participants noted facilitators, such as effective care coordination across nursing and social work staff and the opportunity for patients to be screened multiple times. Participants recommended strengthening patient and clinician education and providing patients with other modalities for data entry (eg, desktop computer in the waiting room).

CONCLUSION

Participants identified important intervention modifications that may be needed to optimize suicide risk screening in cancer care settings.

Patient-Reported Outcomes, Digital Health, and the Quest to Improve Health Equity

The theme of the 2023 American Society of Clinical Oncology Annual Meeting is Partnering With Patients: The Cornerstone of Cancer Care and Research. As we aim to partner with patients to improve their health care, digital tools have the potential to enhance patient-centered cancer care and make clinical research more accessible and generalizable. Using electronic patient-reported outcomes (ePROs) to collect patients' reports of symptoms, functioning, and well-being facilitates patient-clinician communication and improves care and outcomes. Early studies suggest that racial and ethnic minority populations, older patients, and patients with less education may benefit even more from ePRO implementation. Clinical practices looking to implement ePROs can refer to the resources of the PROTEUS Consortium (Patient-Reported Outcomes Tools: Engaging Users & Stakeholders). Beyond ePROs, in response to the COVID-19 pandemic, cancer practices have rapidly adopted other digital tools (eg, telemedicine, remote patient monitoring). As implementation grows, we must be aware of the limitations of these tools and implement them in ways to promote optimal function, access, and ease of use. Infrastructure, patient, provider, and system-level barriers need to be addressed. Partnerships across all levels can inform development and implementation of digital tools to meet the needs of diverse groups. In this article, we describe how we use ePROs and other digital health tools in cancer care, how digital tools can expand access to and generalizability of oncology care and research, and prospects for broader implementation and use.

Reporting unit context data to stakeholders in long-term care: a practical approach

Background

The importance of reporting research evidence to stakeholders in ways that balance complexity and usability is well-documented. However, guidance for how to accomplish this is less clear. We describe a method of developing and visualising dimension-specific scores for organisational context (context rank method). We explore perspectives of leaders in long-term care nursing homes (NHs) on two methods for reporting organisational context data: context rank method and our traditionally presented binary method—more/less favourable context.

Methods

We used a multimethod design. First, we used survey data from 4065 healthcare aides on 290 care units from 91 NHs to calculate quartiles for each of the 10 Alberta Context Tool (ACT) dimension scores, aggregated at the care unit level based on the overall sample distribution of these scores. This ordinal variable was then summed across ACT scores. Context rank scores were assessed for associations with outcomes for NH staff and for quality of care (healthcare aides’ instrumental and conceptual research use, job satisfaction, rushed care, care left undone) using regression analyses. Second, we used a qualitative descriptive approach to elicit NH leaders’ perspectives on whether the methods were understandable, meaningful, relevant, and useful. With 16 leaders, we conducted focus groups between December 2017 and June 2018: one in Nova Scotia, one in Prince Edward Island, and one in Ontario, Canada. Data were analysed using content analysis.

Results

Composite scores generated using the context rank method had positive associations with healthcare aides’ instrumental research use (p < .0067) and conceptual research use and job satisfaction (p < .0001). Associations were negative between context rank summary scores and rushed care and care left undone (p < .0001). Overall, leaders indicated that data presented by both methods had value. They liked the binary method as a starting point but appreciated the greater level of detail in the context rank method.

Conclusions

We recommend careful selection of either the binary or context rank method based on purpose and audience. If a simple, high-level overview is the goal, the binary method has value. If improvement is the goal, the context rank method will give leaders more actionable details.

Comprehension, utility, and preferences of prostate cancer survivors for visual timelines of patient-reported outcomes co-designed for limited graph literacy: meters and emojis over comics

OBJECTIVE

Visual timelines of patient-reported outcomes (PRO) can help prostate cancer survivors manage longitudinal data, compare with population averages, and consider future trajectories. PRO visualizations are most effective when designed with deliberate consideration of users. Yet, graph literacy is often overlooked as a design constraint, particularly when users with limited graph literacy are not engaged in their development. We conducted user testing to assess comprehension, utility, and preference of longitudinal PRO visualizations designed for prostate cancer survivors with limited literacy.

MATERIALS AND METHODS

Building upon our prior work co-designing longitudinal PRO visualizations with survivors, we engaged 18 prostate cancer survivors in a user study to assess 4 prototypes: Meter, Words, Comic, and Emoji. During remote sessions, we collected data on prototype comprehension (gist and verbatim), utility, and preference.

RESULTS

Participants were aged 61-77 (M = 69), of whom half were African American. The majority of participants had less than a college degree (95%), had inadequate health literacy (78%), and low graph literacy (89%). Among the 4 prototypes, Meter had the best gist comprehension and was preferred. Emoji was also preferred, had the highest verbatim comprehension, and highest rated utility, including helpfulness, confidence, and satisfaction. Meter and Words both rated mid-range for utility, and Words scored lower than Emoji and Meter for comprehension. Comic had the poorest comprehension, lowest utility, and was least preferred.

DISCUSSION

Findings identify design considerations for PRO visualizations, contributing to the knowledge base for visualization best practices. We describe our process to meaningfully engage patients from diverse and hard-to-reach groups for remote user testing, an important endeavor for health equity in biomedical informatics.

CONCLUSION

Graph literacy is an important design consideration for PRO visualizations. Biomedical informatics researchers should be intentional in understanding user needs by involving diverse and representative individuals during development.

Feedback of aggregate patient-reported outcomes (PROs) data to clinicians and hospital end users: findings from an Australian codesign workshop process

OBJECTIVES

Patient-reported outcomes (PROs) are increasingly used to measure the patient's perspective of their outcomes following healthcare interventions. The aim of this study was to determine the preferred formats for reporting service-level PROs data to clinicians, researchers and managers to support greater utility of these data to improve healthcare and patient outcomes.

SETTING

Healthcare professionals receiving PRO data feedback at the health service level.

PARTICIPANTS

An interdisciplinary Project Working Group comprised of clinicians participated in three workshops to codesign reporting templates of summarised PRO data (modified Rankin Scale, EuroQol Five Dimension Descriptive System, EuroQol Visual Analogue Scale and Hospital Anxiety and Depression Scale) using a modified Delphi process. An electronic survey was then distributed to short list the preferred templates among a broad sample of clinical end users. A final workshop was undertaken with the Project Working Group to review results and reach consensus on the final templates.

PRIMARY AND SECONDARY OUTCOME MEASURES

The recommendation of preferred PRO summary data feedback templates and guiding principles for reporting aggregate PRO data to clinicians was the primary outcome. A secondary outcome was the identification of perceived barriers and enablers to the use of PRO data in hospitals. For each outcome measure, quantitative and qualitative data were summarised.

RESULTS

31 Working Group members (19 stroke, 2 psychology, 1 pharmacy, 9 researchers) participated in the workshops, where 25/55 templates were shortlisted for wider assessment. The survey was completed by 114 end users. Strongest preferences were identified for bar charts (37/82 votes, 45%) and stacked bar charts (37/91 votes, 41%). At the final workshop, recommendations to enhance communication of PROs data for comparing health service performance were made including tailoring feedback to professional roles and use of case-mix adjustment to ensure fair comparisons.

CONCLUSIONS

Our research provides guidance on PROs reporting for optimising data interpretation and comparing hospital performance.

Prioritizing Support Offered to Caregivers by Examining the Status Quo and Opportunities for Enhancement When Using Web-Based Self-reported Health Questionnaires: Descriptive Qualitative Study

Background

The Rosalynn Carter Institute for Caregivers (RCI) offers evidence-based interventions to promote caregivers’ health and well-being. Trained coaches regularly meet with caregivers to offer education and instructions to improve caregiver health, build skill sets, and increase resilience. Two of these interventions, RCI Resources for Enhancing Alzheimer's Caregiver Health (REACH) and Operation Family Caregiver (OFC), use a set of caregiver-reported questionnaires to monitor caregivers’ health status and needs.

Objective

This study aims to describe how web-based assessment questionnaires are used to identify and monitor caregiver status in the RCI REACH and OFC programs and outlines perceived enhancements to the web-based system that could support caregiver-coach encounters by directing priorities.

Methods

This was a descriptive, qualitative study. Data were collected via semistructured interviews with caregivers and coaches in the RCI REACH and OFC programs from July 2020 to October 2020. During the interviews, participants were asked to describe how the assessment questionnaires were used to inform caregiver-coach encounters, perceived usefulness of enhancements to web-based display, and preference for the structure of score results. The interviews were recorded, transcribed, and coded using structural and interpretive codes from a structured codebook. Qualitative content analysis was used to identify themes and summarize the results.

Results

A total of 25 caregivers (RCI REACH: 13/25, 52%; OFC: 12/25, 48%) and 11 coaches (RCI REACH: 5/11, 45%; OFC: 6/11, 55%) were interviewed. Most caregivers indicated that the assessment questions were relevant to their caregiving experience. Some caregivers and coaches indicated that they thought the assessment should be administered multiple times throughout the program to evaluate the caregiver progress. Overall, caregivers did not want their scores to be compared with those of other caregivers, and there was heterogeneity in how caregivers preferred to view their results at the question or topic level. Coaches were uncertain as to which and how much of the results from the self-reported questionnaires should be shared with caregivers. Overall, the results were very similar, regardless of program affiliation (RCI REACH vs OFC).

Conclusions

Web-based and procedural enhancements were identified to enrich caregiver-coach encounters. New and enhanced strategies for using web-based assessment questionnaires to direct priorities in the caregiver-coach encounters included integrating figures showing caregiver progress at the individual caregiver level, ability to toggle results through different figures focused on individual versus aggregate results, and support for interpreting scores. The results of this qualitative study will drive the next steps for RCI’s web-based platform and expand on current standards for administering self-reported questionnaires in clinical practice settings.

Visualization formats of patient-reported outcome measures in clinical practice: a systematic review about preferences and interpretation accuracy

PURPOSE

The use of Patient-Reported Outcome Measures (PROMs) for individual patient management within clinical practice is becoming increasingly important. New evidence about graphic visualization formats for PROMs scores has become available. This systematic literature review evaluated evidence for graphic visualization formats of PROMs data in clinical practice for patients and clinicians, for both individual and group level PROMs data.

METHODS

Studies published between 2000 and 2020 were extracted from CINAHL, PubMed, PsychInfo, and Medline. Studies included patients ≥ 18 years old in daily clinical practice. Papers not available in English, without full-text access, or that did not specifically describe visualization of PROMs data were excluded. Outcomes were: visualization preferences; interpretation accuracy; guidance for clinical interpretation.

RESULTS

Twenty-five out of 789 papers were included for final analysis. Most frequently studied formats were: bar charts, line graphs, and pie charts. Patients preferred bar charts and line graphs as these were easy and quick for retrieving information about their PROMs scores over time. Clinicians' interpretation accuracy and preferences were similar among graphic visualization formats. Scores were most often compared with patients' own previous scores; to further guide clinical interpretation, scores were compared to norm population scores. Different 'add-ons' improved interpretability for patients and clinicians, e.g. using colors, descriptions of measurement scale directionality, descriptive labels, and brief definitions.

CONCLUSION

There was no predominant graphical visualization format approach in terms of preferences or interpretation accuracy for both patients and clinicians. Detailed clarification of graph content is essential.

The impact of bowel dysfunction on health-related quality of life after rectal cancer surgery: a systematic review

BACKGROUND

Symptoms of bowel dysfunction after sphincter-preserving rectal cancer surgery have an important impact on health-related quality of life (HRQOL), but that relationship is complex. A better understanding of this relationship allows for better informed shared decision-making about surgery. Our objective was to perform a systematic review to determine which HRQOL domains are most affected by postoperative bowel dysfunction.

METHODS

A systematic review of the CINAHL, Cochrane Library, Embase, Medline, PsycInfo, PubMed, Web of Science, and Scopus databases was performed according to Preferred Reporting Items for Systematic Reviews and Meta-Analyses guidelines. We included studies that evaluated bowel function after sphincter-preserving rectal cancer surgery and assessed HRQOL using a validated instrument. The quality of HRQOL analysis was assessed using an 11-item checklist. The main outcome was the impact bowel dysfunction had on global and domain specific quality-of-life indices. The impact was evaluated for clinical relevance using the Minimum Clinical Important Difference (MCID) for each specific HRQOL instrument.

RESULTS

Out of 952 unique citations, 103 studies were full-text reviews. Eighteen studies met the inclusion criteria (4 prospective cohorts and 9 cross-sectional studies). Of the 15 studies with long-term follow-up, the time to assessment after surgery ranged from 1.2 to 14.6 years. The low anterior resection syndrome score and European Organization for Research and Treatment core quality-of-life questionnaire (EORTC QLQ-C30) were the most commonly used instruments. Medium and large magnitudes in MCID were seen for global health, social functioning, emotional functioning, fatigue, diarrhea, and financial difficulties. Among included studies, the most consistently reported functional domains affected by bowel function were social functioning and emotional functioning.

CONCLUSIONS

Following sphincter-preserving rectal cancer surgery, poor bowel function mainly affects the social and emotional functional domains of HRQOL, which in turn impact global scores. This finding can help inform patients about expected changes in HRQOL after rectal cancer surgery and facilitate individualized treatment decisions.

Clinicians' perspectives on the integration of electronic patient-reported outcomes into dermatology clinics: a qualitative study

BACKGROUND

Skin conditions can have profound negative symptomatic and psychological effects. Failure to address these effects can lead to poor treatment adherence and/or patient dissatisfaction. Despite patient-reported outcome (PRO) use being highly recommended, real-world adoption has been slow.

OBJECTIVES

To assess clinicians' perceived facilitators and barriers to using PROs in daily practice.

METHODS

We conducted in-person semi-structured interviews with 19 clinicians and thematic analysis of transcripts.

RESULTS

Three main themes emerged: (1) clinicians' attitudes about the value of Skindex-16 in daily practice, (2) patient attitudes influencing clinicians' use of Skindex-16, and (3) clinicians' perceptions of their ability to use PROs successfully for clinical care. Clinicians recognized benefits to using Skindex-16, such as revealing patients' hidden concerns and highlighting discrepancies with the clinician's severity assessments. Conversely, clinicians also identified limitations, such as time constraints and lack of relevance for some skin conditions. Patient complaints about PRO relevance have influenced clinicians' use of Skindex-16 negatively. Finally, some clinicians recognized the need for more training in score interpretation and implementation strategies for optimal clinical flow.

CONCLUSIONS

While most clinicians believed PROs like Skindex-16 can be useful for patient care, barriers need to be addressed to make PROs more practical for routine clinical care.

User-centered design of a scalable, electronic health record-integrated remote symptom monitoring intervention for patients with asthma and providers in primary care

OBJECTIVE

To determine user and electronic health records (EHR) integration requirements for a scalable remote symptom monitoring intervention for asthma patients and their providers.

METHODS

Guided by the Non-Adoption, Abandonment, Scale-up, Spread, and Sustainability (NASSS) framework, we conducted a user-centered design process involving English- and Spanish-speaking patients and providers affiliated with an academic medical center. We conducted a secondary analysis of interview transcripts from our prior study, new design sessions with patients and primary care providers (PCPs), and a survey of PCPs. We determined EHR integration requirements as part of the asthma app design and development process.

RESULTS

Analysis of 26 transcripts (21 patients, 5 providers) from the prior study, 21 new design sessions (15 patients, 6 providers), and survey responses from 55 PCPs (71% of 78) identified requirements. Patient-facing requirements included: 1- or 5-item symptom questionnaires each week, depending on asthma control; option to request a callback; ability to enter notes, triggers, and peak flows; and tips pushed via the app prior to a clinic visit. PCP-facing requirements included a clinician-facing dashboard accessible from the EHR and an EHR inbox message preceding the visit. PCP preferences diverged regarding graphical presentations of patient-reported outcomes (PROs). Nurse-facing requirements included callback requests sent as an EHR inbox message. Requirements were consistent for English- and Spanish-speaking patients. EHR integration required use of custom application programming interfaces (APIs).

CONCLUSION

Using the NASSS framework to guide our user-centered design process, we identified patient and provider requirements for scaling an EHR-integrated remote symptom monitoring intervention in primary care. These requirements met the needs of patients and providers. Additional standards for PRO displays and EHR inbox APIs are needed to facilitate spread.

Patient-reported outcomes in human papillomavirus-related oropharyngeal cancer

This review explores how human papillomavirus-related oropharyngeal cancer affects health-related quality of life (HR-QoL) and the role patient-reported outcomes (PROs) can play in optimizing treatment. PRO measures (PROMs) are comprehensive, subjective assessments of patients' day-to-day HR-QoL. Developed through a scientifically robust, multistage process, PROMs offer insight into patients' symptoms, function, and satisfaction with care. The use of PROMs can increase symptom awareness, stimulate discussion, and enhance shared decision-making between patients and healthcare providers.

Using Mixed Methods With Multiple Stakeholders to Inform Development of a Breast Cancer Screening Decision Aid for Women With Limited Health Literacy

Background. When stakeholders offer divergent input, it can be unclear how to prioritize information for decision aids (DAs) on mammography screening. Objectives. This analysis triangulates perspectives (breast cancer screening experts, primary care providers [PCPs], and patients with limited health literacy [LHL]) to understand areas of divergent and convergent input across stakeholder groups in developing a breast cancer screening DA for younger women with LHL. Design. A modified online Delphi panel of 8 experts rated 57 statements for inclusion in a breast cancer screening DA over three rounds. Individual interviews with 25 patients with LHL and 20 PCPs from a large safety net hospital explored informational needs about mammography decision making. Codes from the qualitative interviews and open-ended responses from the Delphi process were mapped across stakeholders to ascertain areas where stakeholder preferences converged or diverged. Results. Four themes regarding informational needs were identified regarding 1) the benefits and harms of screening, 2) different screening modalities, 3) the experience of mammography, and 4) communication about breast cancer risk. Patients viewed pain as the primary harm, while PCPs and experts emphasized the harm of false positives. Patients, but not PCPs or experts, felt that information about the process of getting a mammogram was important. PCPs believed that mammography was the only evidence-based screening modality, while patients believed breast self-exam was also important for screening. All stakeholders described incorporating personal risk information as important. Limitations. As participants came from one hospital, perceptions may reflect local practices. The Delphi sample size was small. Conclusions. Patients, experts, and PCPs had divergent views on the most important information needed for screening decisions. More evidence is needed to guide integration of multiple stakeholder perspectives into the content of DAs.

From statistics to clinics: the visual feedback of PROMIS® CATs

Background

To reduce the burden of completing Patient-Reported Outcome Measures (PROMs), PROMIS® Computerized Adaptive Tests (CATs) are being implemented in pediatric clinical practice. We aimed to develop recommendations for visual feedback options for PROMIS CATs on individual item and domain score level as an evidence-based feedback recommendation for PROMIS CATs is lacking.

Methods

Focus groups were held with clinicians who use the KLIK PROM portal. Literature-based feedback options were provided to initiate group discussion. Data was analyzed using thematic coding method. Additionally, a questionnaire was sent out to assess patients’ (12-18y) and parents’ (child 0-18y) preference for individual item feedback. Data was analyzed using descriptive statistics.

Results

Six focus groups were held (N = 28 clinicians). Regarding individual item feedback, showing the complete item bank, with only responses to administered items in traffic light colors was preferred. For domain scores, line graphs were preferred, including numerical (T-)scores, reference and cut-off lines, and traffic light colors. Separate graphs per domain, ranked in order of importance and harmonization of directionality (‘higher = better’) were considered important. Questionnaire results (N = 31 patients/N = 131 parents) showed that viewing their own item responses was preferred above receiving no item feedback by 58.1% of the patients and 77.1% of the parents.

Conclusions

Based on the outcomes and after discussion with the Dutch-Flemish PROMIS National Center, recommendations for PROMIS CAT feedback options were developed. PROMIS CATs can now be used in clinical practice to help clinicians monitor patient outcomes, while reducing the burden of completing PROMs for patients significantly.

Adoption of patient-reported outcome measures with youth with intellectual/developmental disabilities: Contextual influences and practice patterns

BACKGROUND

The purpose of this study was to identify potential barriers to patient reported outcome measure (PROM) adoption with youth and young adults with intellectual and/or developmental disabilities (IDD) and to understand current PROM adoption patterns of paediatric practitioners working with this population.

METHODS

We used a web-based survey to collect data from paediatric practitioners who work with youth with IDD about factors influencing the adoption of PROMs and the frequency of PROM use across age groups (elementary, middle school and high school/transition age) and practice settings (school and rehabilitation).

RESULTS

A total of 113 paediatric practitioners (occupational therapist = 48, physical therapist = 32, physician = 16, other = 17) responded to the survey with an average of 15 years of experience working with youth ages 8-21 with IDD. Accessibility and appropriateness, psychometric evidence, and time were most frequently ranked among the top three factors that influence practitioners' adoption of PROMs. Practitioners reported 'never or rarely' using PROMs 39%-65% of the time across age groups.

CONCLUSIONS

Our results suggest that paediatric practitioners may be infrequently using PROMs with youth with IDD because of perceived inaccessibility and time requirements of PROMs and practice-environment barriers, including access to evidence and caseload demands. Because PROMs can facilitate client-centred care, addressing these potential barriers to adoption may improve paediatric rehabilitation.

SPIRIT-PRO Extension explanation and elaboration: guidelines for inclusion of patient-reported outcomes in protocols of clinical trials

Patient-reported outcomes (PROs) are used in clinical trials to provide valuable evidence on the impact of disease and treatment on patients' symptoms, function and quality of life. High-quality PRO data from trials can inform shared decision-making, regulatory and economic analyses and health policy. Recent evidence suggests the PRO content of past trial protocols was often incomplete or unclear, leading to research waste. To address this issue, international, consensus-based, PRO-specific guidelines were developed: the Standard Protocol Items: Recommendations for Interventional Trials (SPIRIT)-PRO Extension. The SPIRIT-PRO Extension is a 16-item checklist which aims to improve the content and quality of aspects of clinical trial protocols relating to PRO data collection to minimise research waste, and ultimately better inform patient-centred care. This SPIRIT-PRO explanation and elaboration (E&E) paper provides information to promote understanding and facilitate uptake of the recommended checklist items, including a comprehensive protocol template. For each SPIRIT-PRO item, we provide a detailed description, one or more examples from existing trial protocols and supporting empirical evidence of the item's importance. We recommend this paper and protocol template be used alongside the SPIRIT 2013 and SPIRIT-PRO Extension paper to optimise the transparent development and review of trial protocols with PROs.

Long-term improvement of quality of life in patients with breast cancer: supporting patient-physician communication by an electronic tool for inpatient and outpatient care

Purpose

The effectiveness of a pathway with quality of life (QoL) diagnosis and therapy has been already demonstrated in an earlier randomized trial (RCT) in patients with breast cancer. We refined the pathway by developing and evaluating an electronic tool for QoL assessment in routine inpatient and outpatient care.

Methods

In a single-arm study, patients with breast cancer with surgical treatment in two German hospitals were enrolled. QoL (EORTC QLQ-C30, QLQ-BR23) was measured with an electronic tool after surgery and during aftercare in outpatient medical practices (3, 6, 9, 12, 18, and 24 months) so that results (QoL-profile) were available immediately. Feedback by patients and physicians was analyzed to evaluate feasibility and impact on patient-physician communication.

Results

Between May 2016 and July 2018, 56 patients were enrolled. Physicians evaluated the QoL pathway as feasible. Patients whose physician regularly discussed QoL-profiles with them reported significantly more often that their specific needs were cared for (p < .001) and that their physician had found the right treatment strategy for these needs (p < .001) compared with patients whose doctor never/rarely discussed QoL-profiles. The latter significantly more often had no benefit from QoL assessments (p < .001).

Conclusion

The QoL pathway with electronic QoL assessments is feasible for inpatient and outpatient care. QoL results should be discussed directly with the patient.

Clinical trial information

NCT04334096, date of registration 06.04.2020

Supplementary Information

The online version contains supplementary material available at 10.1007/s00520-021-06270-1.

The development and validation of a revised version of the Medical Outcomes Study Sleep Scale (MOS Sleep-R)

Background

The 12-item Medical Outcomes Study Sleep Scale (MOS Sleep Scale) has been used to capture patient-reported sleep problems in hundreds of studies. A revised version of the MOS Sleep Scale (MOS Sleep-R) was developed that uses simplified response sets, provides interpretable norm-based scoring, and has two recall versions (one-week or four-week). The objective of this study was to evaluate the psychometric properties (reliability and construct validity) of the MOS Sleep-R using data from a representative sample of U.S. adults.

Methods

Standardization of raw scores into norm-based T-scores (mean = 50, standard deviation = 10) was based on data from a 2009 U.S. internet-based general population survey. The internal consistency reliability of multi-item subscales and global sleep problems indices for both one-week and four-week recall forms of the MOS Sleep-R were examined using Cronbach’s alphas and inter-item correlations. Construct validity was tested by comparing item-scale correlations between items within subscales with item-scale correlations across subscales. Scale-level convergent validity was tested using correlations with measures including generic health-related quality of life (i.e., SF-36v2) and other relevant outcomes (e.g., job performance, number of days in bed due to illness or injury, happiness/satisfaction with life, frequency of stress/pressure in daily life, the impact of stress/pressure on health, and overall health).

Results

The one-week and four-week recall forms of the MOS Sleep-R were completed by 2045 and 2033 respondents, respectively. The psychometric properties of the one-week and four-week forms were similar. All multi-item subscales and global index scores showed adequate internal consistency reliability (all Cronbach’s alpha > 0.75). Patterns of inter-item and item-scale correlations support the scaling assumptions of the MOS Sleep-R. Patterns of correlations between MOS Sleep-R scores with criterion measures of health-related quality of life and other outcomes indicated adequate construct validity.

Conclusions

The MOS Sleep-R introduces a number of revisions to the original survey, including simplified response sets, the introduction of a one-week recall form, and norm-based scoring that enhances interpretability of scores. Both the one-week and four-week recall period forms of the MOS Sleep-R demonstrated good internal consistency reliability and construct validity in a U.S. general population sample.

Could existing infrastructure for using patient-reported outcomes as quality measures also be used for individual care in patients with colorectal cancer?

Background

There has been increasing interest in integrating patient-reported outcomes (PROs) into routine oncological practice. To date, however, PROs have rarely been implemented in Germany. Currently, PROs are being used as performance measures in colorectal cancer centers in Germany. This content analysis identified factors that may inhibit or facilitate the additional use of PROMs for individual patient management.

Methods

The analysis follows an exploratory approach. Out of 103 centers that participated in a multicentric PRO quality management and benchmarking program in Germany, twelve oncological health-care providers from eight certified colorectal cancer centers were interviewed using a semi-structured interview guide. The interviewees were clinicians (physicians, nurses, psycho-oncologist and physician assistant) who care for colorectal cancer patients. This analysis evaluated whether and how PROs that are primarily collected for quality management/benchmarking reasons could also be used for the management of individual patients. The data was analyzed using a content-analysis approach.

Results

The interviewees were not using PRO in their routine clinical work, but they recognized its added value and pointed out potential example uses. Identified inhibiting factors for the use of PROs in clinical routine work were effortful access to PRO reports, lacking coordinating structures, time delays and time points of measurements as well as redundancy with other instruments. Facilitating factors for the use of PROs in clinical routine work that were identified included access via electronic patient records, implementation of coordinating structures for PRO processes in the center, clear PRO reports that are easy to interpret, and measurements at relevant time points.

Discussion

Clinicians had quite a positive attitude toward PROs and recognized their added value. Inhibiting and facilitating factors of an organizational and technical nature were identified.

Conclusions

These findings indicate how PROs used for quality management purposes may also be used for the management of individual patients. Therefore, existing structures and processes in the certified colorectal cancer centers, as well as lessons learned from the literature on the implementation of PROs monitoring individual patients need to be taken into account.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06457-6.

Assessment of the severity of infant crying and its impact on parents: Development and validation of the ColiQ Questionnaire in France

OBJECTIVES

The purpose of this study was to develop and validate a questionnaire that comprehensively assesses symptoms and severity of crying, symptoms suggesting infant functional gastrointestinal discomfort, and its impact on parents' quality of life: the Infant Colic Questionnaire (ColiQ©). For the first time, parents had access to a web application to follow their infants' evolving symptoms with a daily questionnaire.

METHODS

The ColiQ was developed with a board of clinical experts (physicians and psychologists) based on extensive parent input. A longitudinal, observational study was conducted in France for 3 months. ColiQ assessments were collected online at six different time points. Psychometric testing demonstrated that ColiQ has acceptable psychometric properties (reliability, internal consistency, construct validity, and responsiveness).

RESULTS

The ColiQ is a 16-question instrument developed in French including ten questions describing symptoms (Infant score) and six questions describing impacts (Parent score). The ColiQ demonstrated good test-retest reliability (ICC >0.70), internal consistency for both the Symptom and Impact subscale scores (Cronbach's α >0.70), and construct validity. Responsiveness was good; the ColiQ was able to detect significant improvement in the target population as early as 1 month (p<0.05). The global ColiQ score discriminated between severity levels (mild, medium, severe).

CONCLUSIONS

The ColiQ was developed with input from parents and healthcare professionals and has shown validity, reliably, and responsiveness to change. Parents can use the web application to follow how their infants' symptoms evolve. The ColiQ can help parents quantify and verbalize their concerns during consultations, and provides an opportunity to facilitate conversations between the physician and parents.

Visual analogies, not graphs, increase patients' comprehension of changes in their health status

OBJECTIVES

Patients increasingly use patient-reported outcomes (PROs) to self-monitor their health status. Visualizing PROs longitudinally (over time) could help patients interpret and contextualize their PROs. The study sought to assess hospitalized patients' objective comprehension (primary outcome) of text-only, non-graph, and graph visualizations that display longitudinal PROs.

MATERIALS AND METHODS

We conducted a clinical research study in 40 hospitalized patients comparing 4 visualization conditions: (1) text-only, (2) text plus visual analogy, (3) text plus number line, and (4) text plus line graph. Each participant viewed every condition, and we used counterbalancing (systematic randomization) to control for potential order effects. We assessed objective comprehension using the International Organization for Standardization protocol. Secondary outcomes included response times, preferences, risk perceptions, and behavioral intentions.

RESULTS

Overall, 63% correctly comprehended the text-only condition and 60% comprehended the line graph condition, compared with 83% for the visual analogy and 70% for the number line (P = .05) conditions. Participants comprehended the visual analogy significantly better than the text-only (P = .02) and line graph (P = .02) conditions. Of participants who comprehended at least 1 condition, 14% preferred a condition that they did not comprehend. Low comprehension was associated with worse cognition (P < .001), lower education level (P = .02), and fewer financial resources (P = .03).

CONCLUSIONS

The results support using visual analogies rather than text to display longitudinal PROs but caution against relying on graphs, which is consistent with the known high prevalence of inadequate graph literacy. The discrepancies between comprehension and preferences suggest factors other than comprehension influence preferences, and that future researchers should assess comprehension rather than preferences to guide presentation decisions.

Technological developments enable measuring and using patient-reported outcomes data in orthopaedic clinical practice

Patient-reported outcomes measures form the backbone of outcomes evaluation in orthopaedics, with most of the literature now relying on these scoring tools to measure change in patient health status. This patient-reported information is increasingly collected routinely by orthopaedic providers but use of the data is typically restricted to academic research. Developments in electronic data capture and the outcome tools themselves now allow use of this data as part of the clinical consultation. This review evaluates the role of patient reported outcomes data as a tool to enhance daily orthopaedic clinical practice, and documents how develop-ments in electronic outcome measures, computer-adaptive questionnaire design and instant graphical display of questionnaire can facilitate enhanced patient-clinician shared decision making.

Implementation of patient-reported outcome assessment in routine cancer care: A systematic review of multicentric programs in Europe

INTRODUCTION

To give an overview of patient-reported outcome measures (PROMs) programs in routine cancer care that allow for both major purposes of PROM assessment: 1) monitoring of an individual patient's outcome to assist treatment decision making, and 2) use in quality improvement initiatives including the benchmarking of providers. We synthesize information on program elements like the mode of assessment and questionnaire used, as well as information relevant for adaptation following a PDCA scheme.

METHOD

We carried out a systematic literature research in the databases PubMed and EMBASE using MeSH terms and keywords related to PROM assessment in routine cancer care to identify eligible studies published between January 2003 and November 2018 (PROSPERO reg. no. CRD42019141402). We included studies in which PROM assessment programs had been reported as being implemented in clinical practice as well as collected multicentrically with at least one site in Europe and in which PROMs had been collected before and at least once after intervention. Study authors were queried to verify or correct the program elements extracted and merged during the review. Study quality assessment was not done, since it is not expedient for the objective of this review.

RESULTS

Overall, 5,545 unique references were identified, 5,416 of which were excluded after the screening of titles and abstracts. Of the 29 references assessed, five programs were identified and included in the synthesis. The programs included those from Germany, Austria, Denmark, the Netherlands and the UK, and patients with different cancer types and tumor stages, which used paper-based or purely electronic PROM assessment.

DISCUSSION AND CONCLUSION

Few reports have so far been published on PROM programs that allow for both the monitoring of an individual patient's outcome and use in quality improvement initiatives. The studies revealed relevant information on existing PROM programs and gave valuable insight into issues that need to be considered when setting up such an infrastructure. Some critical issues, however, were hardly addressed, among them costs, staff resources and methods of reporting and responding.

Identifying clinically meaningful severity categories for PROMIS pediatric measures of anxiety, mobility, fatigue, and depressive symptoms in juvenile idiopathic arthritis and childhood-onset systemic lupus erythematosus

PURPOSE

A key limitation to widespread adoption of patient-reported outcome (PRO) measures is the lack of interpretability of scores. We aim to identify clinical severity thresholds to distinguish categories of no problems, mild, moderate, and severe along the PROMIS® Pediatric T-score metric for measures of anxiety, mobility, fatigue, and depressive symptoms for use in populations with juvenile idiopathic arthritis (JIA) and childhood-onset systemic lupus erythematosus (cSLE).

METHODS

We used a modified standard setting methodology from educational testing to identify clinical severity thresholds (clinical cut scores). Using item response theory-based parameters from PROMIS item banks, we developed a series of clinical vignettes that represented different severity or ability levels along the PROMIS Pediatric T-score metric. In stakeholder workshops, participants worked individually and together to reach consensus on clinical cut scores. Median cut-score placements were taken when consensus was not reached. Focus groups were recorded and qualitative analysis was conducted to identify decision-making processes.

RESULTS

Nine adolescents (age 13-17 years) with JIA (33% female) and their caregivers, five adolescents (age 14-16 years) with cSLE (100% female) and their caregivers, and 12 pediatric rheumatologists (75% female) participated in bookmarking workshops. Placement of thresholds for bookmarks was highly similar across stakeholder groups (differences from 0 to 5 points on the PROMIS t-score metric) for all but one bookmark placement.

CONCLUSION

This study resulted in clinical thresholds for severity categories for PROMIS Pediatric measures of anxiety, mobility, fatigue, and depressive symptoms, providing greater interpretability of scores in JIA and cSLE populations.

From obligation to opportunity: future of patient-reported outcome measures at the Veterans Health Administration

Patient-reported outcome (PRO) measures are particularly important in mental health services because patients are the central and essential source of information about their mental health status. PRO measures have the potential to engage patients in meaningful and focused conversations during clinical encounters, but unfortunately they often do not serve this purpose in mental health care. Administration of routine outcome measures has often been viewed by clinicians as an obligatory quality improvement process that takes time away from the clinical encounter. This commentary describes current practical barriers to using PRO measures in practice. Then, focusing specifically on the Veterans Health Administration, a unit of the U.S. Department of Veterans Affairs (VA), we propose processes within which PRO measures in mental health services could support the clinical encounter and enhance patient-centered mental health care. With the increasing number of Accountable Care Organizations and other integrated health-care systems that focus on mental health-care delivery, VA has an opportunity to leverage its long-standing electronic medical record technologies and integrated health system to serve as a model for incorporating PRO measures into mental health-care practices. This commentary provides a vision for the future of mental health delivery by incorporating PRO measures at the VA and in other health-care systems.

Evaluating the Thresholds for Clinical Importance of the EORTC QLQ-C15-PAL in Patients Receiving Palliative Treatment

Background: The EORTC QLQ-C15-PAL is a shortened version of the widely used EORTC QLQ-C30. This questionnaire was developed to measure the symptoms and functional health of patients receiving palliative care. Objective: To enhance clinical interpretability of the EORTC QLQ-C15-PAL, our aim was to evaluate the sensitivity and specificity of thresholds for clinical importance developed previously for the QLQ-C30 when applied to the QLQ-C15-PAL scales. Design: Cross-sectional observational study. Setting/Subjects: Patients with cancer receiving any type of palliative treatment. Measurement: Patients completed the EORTC QLQ-C15-PAL and anchor items on limitations, worries, and need for help for each of the health domains covered by the questionnaire. The anchor items were summarized in a binary criterion for clinical importance to calculate the sensitivity and specificity of the thresholds for clinical importance. Results: In total, 225 patients participated in the study (mean age 64.5 years). Patients were recruited from Austria, Italy, the Netherlands, Poland, Spain, and the United Kingdom. The thresholds for clinical importance for the QLQ-C15-PAL scales showed a median sensitivity of 0.88 (range: 0.82 for sleep disturbances to 1.00 for dyspnea) and a median specificity of 0.74 (range: 0.54 for dyspnea to 0.89 for constipation). Conclusion: The thresholds for clinical importance showed high sensitivity and mostly high specificity in identifying clinically important symptoms and functional health impairments as assessed by the QLQ-C15-PAL. These thresholds will facilitate interpretation of EORTC QLQ-C15-PAL scores in daily clinical practice and clinical research.

A retrospective assessment of the KLIK PROM portal implementation using the Consolidated Framework for Implementation Research (CFIR)

Purpose

The KLIK Patient-Reported Outcome Measure (PROM) portal is an evidence-based intervention implemented in clinical practice in > 25 Dutch hospitals for patients (children and adults) who regularly visit the outpatient clinic. Implementation science frameworks can be used to understand why implementation succeeded or failed, to structure barriers and enablers, and to develop implementation strategies to overcome barriers. This paper aimed to (A) retrospectively describe determinants of successful KLIK PROM implementation using the Consolidated Framework for Implementation Research (CFIR), and (B) identify current barriers and match implementation strategies.

Methods

(A) The KLIK implementation process was described retrospectively based on literature and experience, using the 39 CFIR constructs organized in five general domains: intervention characteristics, outer setting, inner setting, characteristics of individuals, and implementation process. (B) The CFIR-Expert Recommendations for Implementing Change (ERIC) Implementation Strategy Matching tool identified current barriers in the KLIK implementation and matched implementation strategies that addressed the identified barriers.

Results

(A) The most prominent determinants of successful KLIK PROM implementation lie in the following CFIR domains: intervention characteristics (e.g., easy to use), characteristics of individuals (e.g., motivation), and process of implementation (e.g., support). (B) 13 CFIR constructs were identified as current barriers for implementing the KLIK PROM portal. The highest overall advised ERIC strategy for the specific KLIK barriers was to identify and prepare champions.

Conclusion

Using an implementation science framework, e.g., CFIR, is recommended for groups starting to use PROMs in clinical care as it offers a structured approach and provides insight into possible enablers and barriers.

Electronic supplementary material

The online version of this article (10.1007/s11136-020-02586-3) contains supplementary material, which is available to authorized users.

Communicating treatment risks and benefits to cancer patients: a systematic review of communication methods

PURPOSE

Cancer patients are increasingly involved in decision-making processes. Hence, clinicians need to inform patients about the risks and benefits of different treatment options in order for patients to make well informed decisions. The aim of this review is to determine the effects of methods of communicating prognostic information about (1) disease progression (survival, progression, recurrence and remission), (2) side effects and complications and (3) health-related quality of life (HRQL) on cognitive, affective and behavioral outcomes in cancer patients.

METHODS

A literature search was performed to select articles that were published up to  November 2019 and that examined verbal and/or visual risk communication interventions in an oncological clinical setting.

RESULTS

The search yielded 14,875 studies; 28 studies were ultimately included. For disease progression information, we found that framing affects treatment choice. Furthermore, limiting the amount of progression information in a graphical display could benefit patients' understanding of risks and benefits. For prognostic information about side effects and complications, precise and defined risk information was better understood than information presented in words. When displaying HRQL data, no consensus was found on which graph type to use.

CONCLUSION

Great heterogeneity in the results and methodology and in the compared communication formats precluded us from drawing any further conclusions. Practical implications for clinicians are to consider the effects that different types of framing might have on the patient and to not rely exclusively on words to describe risks, but rather include at least some form of numbers or visualization.

Pragmatic cluster randomized trial to evaluate effectiveness and implementation of enhanced EHR-facilitated cancer symptom control (E2C2)

BACKGROUND

The prevalence of inadequate symptom control among cancer patients is quite high despite the availability of definitive care guidelines and accurate and efficient assessment tools.

METHODS

We will conduct a hybrid type 2 stepped wedge pragmatic cluster randomized clinical trial to evaluate a guideline-informed enhanced, electronic health record (EHR)-facilitated cancer symptom control (E2C2) care model. Teams of clinicians at five hospitals that care for patients with various cancers will be randomly assigned in steps to the E2C2 intervention. The E2C2 intervention will have two levels of care: level 1 will offer low-touch, automated self-management support for patients reporting moderate sleep disturbance, pain, anxiety, depression, and energy deficit symptoms or limitations in physical function (or both). Level 2 will offer nurse-managed collaborative care for patients reporting more intense (severe) symptoms or functional limitations (or both). By surveying and interviewing clinical staff, we will also evaluate whether the use of a multifaceted, evidence-based implementation strategy to support adoption and use of the E2C2 technologies improves patient and clinical outcomes. Finally, we will conduct a mixed methods evaluation to identify disparities in the adoption and implementation of the E2C2 intervention among elderly and rural-dwelling patients with cancer.

DISCUSSION

The E2C2 intervention offers a pragmatic, scalable approach to delivering guideline-based symptom and function management for cancer patients. Since discrete EHR-imbedded algorithms drive defining aspects of the intervention, the approach can be efficiently disseminated and updated by specifying and modifying these centralized EHR algorithms.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03892967. Registered on 25 March 2019.

Patient preferences for visualization of longitudinal patient-reported outcomes data

OBJECTIVE

The study sought to design symptom reports of longitudinal patient-reported outcomes data that are understandable and meaningful to end users.

MATERIALS AND METHODS

We completed a 2-phase iterative design and evaluation process. In phase I, we developed symptom reports and refined them according to expert input. End users then completed a survey containing demographics, a measure of health literacy, and items to assess visualization preferences and comprehension of reports. We then collected participants' perspectives on reports through semistructured interviews and modified them accordingly. In phase II, refined reports were evaluated in a survey that included demographics, validated measures of health and graph literacy, and items to assess preferences and comprehension of reports. Surveys were administered using a think-aloud protocol.

RESULTS

Fifty-five English- and Spanish-speaking end users, 89.1% of whom had limited health literacy, participated. In phase I, experts recommended improvements and 20 end users evaluated reports. From the feedback received, we added emojis, changed date and font formats, and simplified the y-axis scale of reports. In phase II, 35 end users evaluated refined designs, of whom 94.3% preferred reports with emojis, the favorite being a bar graph combined with emojis, which also promoted comprehension. In both phases, participants literally interpreted reports and provided suggestions for future visualizations.

CONCLUSIONS

A bar graph combined with emojis was participants' preferred format and the one that promoted comprehension. Target end users must be included in visualization design to identify literal interpretations of images and ensure final products are meaningful.

Patient-reported outcomes feedback report for knee arthroplasty patients should present selective information in a simple design - findings of a qualitative study

Background

Technical innovation to assess patient-reported outcomes (PROs) facilitates their implementation in clinical practice. In particular, mobile applications (apps) allow PROs to be assessed outside of the clinical setting. A patient’s health status can be remotely monitored and evaluated after discharge, and their recovery process tracked. This is of particular interest for patients after knee arthroplasty, as the recovery phase after surgery usually takes place in an outpatient setting and requires a high level of patient engagement. Providing results of PRO assessments to patients in the form of a feedback report could increase patient engagement and may improve communication between health care professionals and patients. The aim of the study is to develop a PRO feedback report for mobile devices that is comprehensible and provides valuable information for patients after knee arthroplasty.

Results

In an iterative development process, our expert group developed two preliminary feedback reports (a text-based version and a graphical display) based on previous research results and practical experience. In a second step, we discussed these reports with orthopedic patients (n = 8) in terms of comprehensibility and value using semi-structured interviews and cognitive debriefing methods. Participants assessed the reports as informative, but had some difficulties in fully comprehending all of the information provided. Based on the feedback from patients, we modified both versions and reduced complexity to increase comprehensibility.

Conclusions

A PRO feedback report for patients for mobile app use has to take account of the heterogeneous user group, particularly demographics such as age and experience with mobile devices. Information should be presented in a simple way to be comprehensible and of value to patients. Technological advancements allow a simple default report to be set, something which enables patients interested in additional information to make customizations.

Provider Perspectives on the Feasibility and Utility of Routine Patient-Reported Outcomes Assessment in Heart Failure: A Qualitative Analysis

Background

Patient‐reported outcomes (PROs) objectively measure health‐related quality of life and provide prognostic information. Advances in technology now allow for rapid, patient‐friendly PRO assessment and scoring, yet the adoption of PROs in clinic has been slow. We conducted a multicenter qualitative study of diverse providers to describe the barriers and facilitators of routine PRO use in heart failure clinics.

Methods and Results

Sixty heart failure providers from 5 institutions participated in 8 focus groups to explore provider perspectives on the use of heart failure‐specific and generic PROs in clinical practice. A qualitative editing approach was used to analyze the data, whereby a coding dictionary was iteratively developed and applied using the qualitative software program Altas.ti. Three main themes, supporting and impeding PRO use, emerged: (1) data collection; (2) presentation and interpretation; and (3) utility and value. For each construct, we identified perspectives that highlighted both barriers and facilitators. Providers identified burden, survey fatigue, and language/health literacy barriers as potentially impeding data collection. Optimal workflow, PRO frequency and length, use of PRO translations, and assistance of a patient's proxy were suggested as facilitators. Focus group discussions provided insight on how to display PROs to support its interpretability and sharing. Furthermore, the need to educate providers on the utility and value PROs over and above current clinical approaches emerged.

Conclusions

Overcoming the barriers and supporting facilitators of PRO adoption could potentially lead to more successful adoption of PROs in heart failure clinics.

The impact of patient-reported outcome (PRO) data from clinical trials: a systematic review and critical analysis

Background

Patient-reported outcomes (PROs) are commonly collected in clinical trials and should provide impactful evidence on the effect of interventions on patient symptoms and quality of life. However, it is unclear how PRO impact is currently realised in practice. In addition, the different types of impact associated with PRO trial results, their barriers and facilitators, and appropriate impact metrics are not well defined. Therefore, our objectives were: i) to determine the range of potential impacts from PRO clinical trial data, ii) identify potential PRO impact metrics and iii) identify barriers/facilitators to maximising PRO impact; and iv) to examine real-world evidence of PRO trial data impact based on Research Excellence Framework (REF) impact case studies.

Methods

Two independent investigators searched MEDLINE, EMBASE, CINAHL+, HMIC databases from inception until December 2018. Articles were eligible if they discussed research impact in the context of PRO clinical trial data. In addition, the REF 2014 database was systematically searched. REF impact case studies were included if they incorporated PRO data in a clinical trial.

Results

Thirty-nine publications of eleven thousand four hundred eighty screened met the inclusion criteria. Nine types of PRO trial impact were identified; the most frequent of which centred around PRO data informing clinical decision-making. The included publications identified several barriers and facilitators around PRO trial design, conduct, analysis and report that can hinder or promote the impact of PRO trial data. Sixty-nine out of two hundred nine screened REF 2014 case studies were included. 12 (17%) REF case studies led to demonstrable impact including changes to international guidelines; national guidelines; influencing cost-effectiveness analysis; and influencing drug approvals.

Conclusions

PRO trial data may potentially lead to a range of benefits for patients and society, which can be measured through appropriate impact metrics. However, in practice there is relatively limited evidence demonstrating directly attributable and indirect real world PRO-related research impact. In part, this is due to the wider challenges of measuring the impact of research and PRO-specific issues around design, conduct, analysis and reporting. Adherence to guidelines and multi-stakeholder collaboration is essential to maximise the use of PRO trial data, facilitate impact and minimise research waste.

Trial registration

Systematic Review registration PROSPERO CRD42017067799.

Associations between interim patient-reported outcome measures and functional status at discharge from rehabilitation for non-specific lumbar impairments

PURPOSE

Identify impact of frequency and timing of interim Patient-Reported Outcome Measures (PROMs) assessments during episodes of care for rehabilitation services in outpatient clinical settings on functional status (FS) outcomes at discharge for patients with low back pain.

METHODS

FS outcomes of patients who had no interim PROMs were compared to outcomes of six patient groups defined by interim timing (early, mid, late) and frequency (1, 2 or more). For each comparison, patients were matched using propensity score matching for variables known to be associated with FS outcomes and for episode duration (days) and number of visits. FS was assessed using the lumbar computerized adaptive test (LCAT) where scores range from 0 to 100 with higher scores representing better physical function.

RESULTS

A sample of 140,336 patients was considered for matching (mean age = 58 [SD = 17] range 18-89; 60% females) with 83,101 patients (59%) having no interim PROMs. Patients who had only one interim PROM, administered during early (first 2 weeks), mid (weeks 3-4), or late (week 5 or later) timing, had 4.6, 2.7, and 1.0 additional FS score points at discharge compared to those without an interim PROM, respectively (p < 0.001). Having two or more interim PROMs was associated with an additional 1.2 FS points compared to having only one interim assessment, but only if the first interim was administered early.

CONCLUSIONS

Optimal utilization of interim PROM assessment during clinical practice to enhance treatment outcomes was related to administering the first interim PROM within the first 2 weeks after the initial evaluation.

Using PROMs during routine medical consultations: The perspectives of people with Parkinson's disease and their health professionals

BACKGROUND

The use of patient-reported outcomes measures (PROMs), such as quality of life or symptoms like pain or fatigue, is increasingly embraced within patient-centred care and shared decision making.

OBJECTIVES

To investigate: (a) how patients and health professionals think about using PROMs during routine medical consultations; (b) for which purpose(s), patients and health professionals want to use PROMs during those consultations; and (c) how patients interpret PROMs information presented in various formats. People with Parkinson's disease and their health professionals served as case example.

METHODS

We performed semi-structured interviews with patients (N = 13) and professionals (N = 7 neurologists; N = 7 physiotherapists). We also used a survey in which patients (N = 115) were shown six figures displaying different information types. Presentation formats of this information varied (line/bar graphs). Interpretation by patients, perceived usefulness of information, attitude towards using information during routine medical consultations and (hypothetical) decisions were assessed.

FINDINGS

Patients and professionals were generally positive about using PROMs during medical consultations. Professionals stressed the opportunity to monitor changes in individual PROMs over time. Patients were primarily positive about aggregated PROMs to make treatment decisions. This information was also most often interpreted correctly, especially when presented through a line graph (90.1% correct). Professionals thought patients should take the initiative in discussing PROMs, whereas patients thought professionals should do so.

CONCLUSION/DISCUSSION

When used in routine medical consultations, PROMs seem to have potential to support shared decision making and facilitate patient-professional communication. However, training seems needed for both patients and professionals to facilitate actual discussion and proper interpretation.

Helping Hispanic Family Caregivers of Persons With Dementia "Get the Picture" About Health Status Through Tailored Infographics

BACKGROUND AND OBJECTIVES

Caregivers need to understand their health status and the disabilities of the care recipient to engage in effective health management. Infographics tailored with personal health data are a promising approach to facilitating comprehension, particularly for individuals with low health literacy/limited English proficiency. Such approaches may be especially important for dementia caregivers given the high care burden.

RESEARCH DESIGN AND METHODS

Guided by the Health Belief Model and the Data-Frame Theory of Sensemaking, we conducted iterative participatory design sessions with Hispanic family caregivers (N = 16) of persons with dementia. We created multiple prototype infographic designs to display scores on validated instruments of topics such as caregiving burden, overall health, and psychological distress. We retained and refined designs participants judged to be easily comprehensible. Analysis focused on identifying the graphical elements that contributed to the comprehensibility of designs and on evaluating participants' reactions to the designs.

RESULTS

Successful infographics used intuitive scaling consistent with caregivers' perspective of dementia as inevitable decline. Participants reacted to infographics by describing the self-management actions they would take to address the health issue at hand.

DISCUSSION AND IMPLICATIONS

Tailored infographics supported caregivers' comprehension of their health status and served as cues to engaging in self-management. As such, they should be presented in the context of informational support that can facilitate selection of appropriate next steps. This can mitigate the potential mental and physical health consequences of caregiving and enable caregivers to continue to care for their relatives with dementia with less damage to their own well-being.