The facilitators and barriers to implementing patient reported outcome measures in organisations delivering health related services: a systematic review of reviews

Psychometric evaluation of the Arabic version of the Quebec user evaluation of satisfaction with assistive technology (A-QUEST 2.0) in prosthesis users

BACKGROUND

The evaluation of patient satisfaction and perceptions plays a vital role in determining the quality of prosthesis users' devices and the competency of healthcare services.

AIM

To evaluate the psychometric properties of the Arabic Quebec User Evaluation of Satisfaction with Assistive Technology (A-QUEST 2.0) with prosthetics users.

DESIGN

A methodological study.

SETTING

Saudi Arabia, Turkey.

POPULATION

A convenience sample of outpatient prosthesis users (N.=183).

METHODS

The A-QUEST 2.0 includes two subscales respectively evaluating the user's satisfaction with the device and the services provided. The data for each subscale were investigated using Rasch analysis to evaluate the item fit, reliability indices, item difficulty, local item dependency, and differential item functioning (DIF).

RESULTS

Both subscales met the Rasch criteria for the functioning of rating scale categories. All items showed an acceptable fit to the Rasch model. The person separation indices for the Device and Services subscales were 2.21 (Cronbach's α=0.90) and 1.72 (Cronbach's α=0.85), respectively. Therefore, the two subscales are sensitive enough to distinguish between at least three different levels of satisfaction. The unidimensionality of each subscale was confirmed, and none of the items displayed differential item functioning across age, gender, location of amputation, country, and duration of use.

CONCLUSIONS

Overall, the findings indicate the psychometric evaluation of A-QUEST 2.0 is effective with prosthesis users across different clinical contexts and cultures. Thus, the A-QUEST 2.0 allows for a comprehensive understanding of users' perceptions of prosthesis characteristics, particularly among subjects with lower limb amputations caused by traumatic injuries.

CLINICAL REHABILITATION IMPACT

Our paper provides clinicians dealing with Arabic patients a validated outcome measure for satisfaction with prosthesis. Besides providing information in the development of new products and service delivery. Further studies are necessary to improve the measure's metric quality in different contexts and for different prosthesis devices.

Lessons learned on the experienced facilitators and barriers of implementing a tailored VBHC model in a Dutch university hospital from a perspective of physicians and nurses

OBJECTIVE

This study aims to obtain insight into experienced facilitators and barriers of implementing a tailored value-based healthcare (VBHC) model in a Dutch university hospital from a perspective of physicians and nurses.

METHOD

A descriptive qualitative study with 12 physicians, nurses and managers of seven different care pathways who were involved in the implementation of a tailored VBHC methodology was conducted. Thematic content analysis was used to analyse the data guided by all factors of the Consolidated Framework for Implementation Research (CFIR).

FINDINGS

The method designed for the implementation of a tailored VBHC methodology was appointed as a structured guide for the process. Throughout the implementation process, leadership and team dynamics were considered as important for the implementation to succeed. Also, sharing experiences with other value teams and the cooperation with external Information Technology (IT) teams in the hospital was mentioned as desirable. The involvement of patients, that is part of the VBHC methodology, was considered useful in the decision-making and improvement of the care process because it gave better insights in topics that are important for patients. The time-consuming nature of the implementation process was named as barrier to the VBHC methodology. On top of that, the shaping of the involvement of patients and the ongoing changes in departments were established as difficult. Finally, working with the Electronic Health Records and acquiring the necessary digital skills were considered to be often forgotten and, thus, hindering implementation.

CONCLUSION

Clinical Healthcare organisations implementing a tailored VBHC methodology will benefit from the use of a structured implementation methodology, a well-led strong team and cooperation with (external) teams and patients. However, shaping patient involvement, alignment with other departments and attention to digitisation were seen as a most important concerns in implementation and require further attention.

Implementation of an electronic patient-reported measure of barriers to antiretroviral therapy adherence with the Opal patient portal: Protocol for a mixed method type 3 hybrid pilot study at a large Montreal HIV clinic

BACKGROUND

Adherence to antiretroviral therapy (ART) remains problematic. Regular monitoring of its barriers is clinically recommended, however, patient-provider communication around adherence is often inadequate. Our team thus decided to develop a new electronically administered patient-reported outcome measure (PROM) of barriers to ART adherence (the I-Score) to systematically capture this data for physician consideration in routine HIV care. To prepare for a controlled definitive trial to test the I-Score intervention, a pilot study was designed. Its primary objectives are to evaluate patient and physician perceptions of the I-Score intervention and its implementation strategy.

METHODS

This one-arm, 6-month study will adopt a mixed method type 3 implementation-effectiveness hybrid design and be conducted at the Chronic Viral Illness Service of the McGill University Health Centre (Montreal, Canada). Four HIV physicians and 32 of their HIV patients with known or suspected adherence problems will participate. The intervention will involve having patients complete the I-Score through a smartphone application (Opal), before meeting with their physician. Both patients and physicians will have access to the I-Score results, for consideration during the clinic visits at Times 1, 2 (3 months), and 3 (6 months). The implementation strategy will focus on stakeholder involvement, education, and training; promoting the intervention's adaptability; and hiring an Application Manager to facilitate implementation. Implementation, patient, and service outcomes will be collected (Times 1-2-3). The primary outcome is the intervention's acceptability to patients and physicians. Qualitative data obtained, in part, through physician focus groups (Times 2-3) and patient interviews (Times 2-3) will help evaluate the implementation strategy and inform any methodological adaptations.

DISCUSSION

This study will help plan a definitive trial to test the efficacy of the I-Score intervention. It will generate needed data on electronic PROM interventions in routine HIV care that will help improve understanding of conditions for their successful implementation.

CLINICAL TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT04702412; https://clinicaltrials.gov/.

Clinical Outcome Assessment in Cancer Rehabilitation and the Central Role of Patient-Reported Outcomes

Simple Summary

After completion of acute cancer treatment, it is important to support patients in recovering physically and psychologically and to help them regain their social life. This is the goal of cancer rehabilitation. If we want to know which rehabilitation interventions are helpful, we must measure their effects. This can be done by asking clinicians, testing patients’ performance, observing their behaviors, or by asking patients directly about their experience. This paper focuses on reports from the patients. We give an overview of available questionnaires and offer advice regarding their use. Furthermore, we discuss how to integrate them into clinical practice and research. The most promising way to collect such data are electronic systems, which offer many advantages. The goal of assessing the patient perspective is to help patients, clinicians, and health insurance providers to decide which rehabilitation interventions suit patients’ needs, and therefore, which ones should be chosen and reimbursed.

Abstract

The aim of cancer rehabilitation is to help patients regain functioning and social participation. In order to evaluate and optimize rehabilitation, it is important to measure its outcomes in a structured way. In this article, we review the different types of clinical outcome assessments (COAs), including Clinician-Reported Outcomes (ClinROs), Observer-Reported Outcomes (ObsROs), Performance Outcomes (PerfOs), and Patient-Reported Outcomes (PROs). A special focus is placed on PROs, which are commonly defined as any direct report from the patient about their health condition without any interpretation by a third party. We provide a narrative review of available PRO measures (PROMs) for relevant outcomes, discuss the current state of PRO implementation in cancer rehabilitation, and highlight trends that use PROs to benchmark value-based care. Furthermore, we provide examples of PRO usage, highlight the benefits of electronic PRO (ePRO) collection, and offer advice on how to select, implement, and integrate PROs into the cancer rehabilitation setting to maximize efficiency.

Patient-Reported Outcomes in Children With Chronic Kidney Disease

Patient-reported outcomes (PROs) are quantitative assessments of a patient's perspective on their health and are derived directly from the patient, as opposed to clinician interpretation. PROs can serve as unique tools to improve health care providers' understanding of the patient's daily lived experience and highlight salient domains that are specific to children with chronic kidney disease (CKD). As such, PROs fill an important gap in achieving optimal health and well-being for children with CKD. However, several knowledge gaps remain in the implementation of PROs within both the clinical and research realms. This review provides a broad overview of PRO development, implementation for children with CKD, and highlights future directions and challenges.

Best Practices in the Development, Translation, and Cultural Adaptation of Patient-Reported Outcome Measures for Adults With Hearing Impairment: Lessons From the Cochlear Implant Quality of Life Instruments

This manuscript summarizes available evidence-based best practices in the development, translation, and cultural adaptation of one type of outcome measure for adults with hearing impairment, patient-reported outcome measures (PROMs). It presents the development of the Cochlear Implant Quality of Life (CIQOL) instruments and the ongoing translation and cultural adaptation of the CIQOL-35 Profile from English to French as case studies and discusses useful lessons for selecting, developing, translating, culturally adapting, and using PROMs. Relevant best practice guides are introduced, described and their steps are illustrated with examples. Future trends in hearing-related PROMs, including computerized adaptive testing, patient-reported experience measures (PREMs), economic evaluation and allocation of scarce resources, and PROMs in low-resource settings, are discussed. The manuscript concludes on the lessons that can be learned from implementation science for the successful and sustainable integration of PROMs in clinical practice.

A Rapid Realist Review of Quality Care Process Metrics Implementation in Nursing and Midwifery Practice

Quality measurement initiatives promote quality improvement in healthcare but can be challenging to implement effectively. This paper presents a Rapid Realist Review (RRR) of published literature on Quality Care-Process Metrics (QCP-M) implementation in nursing and midwifery practice. An RRR informed by RAMESES II standards was conducted as an efficient means to synthesize evidence using an expert panel. The review involved research question development, quality appraisal, data extraction, and evidence synthesis. Six program theories summarised below identify the key characteristics that promote positive outcomes in QCP-M implementation. Program Theory 1: Focuses on the evidence base and accessibility of the QCP-M and their ease of use by nurses and midwives working in busy and complex care environments. Program Theory 2: Examines the influence of external factors on QCP-M implementation. Program Theory 3: Relates to existing cultures and systems within clinical sites. Program Theory 4: Relates to nurses’ and midwives’ knowledge and beliefs. Program Theory 5: Builds on the staff theme of Programme Theory four, extending the culture of organizational learning, and highlights the meaningful engagement of nurses and midwives in the implementation process as a key characteristic of success. Program Theory 6: Relates to patient needs. The results provide nursing and midwifery policymakers and professionals with evidence-based program theory that can be translated into action-orientated strategies to help guide successful QCP-M implementation.

Patient-Reported Experience and Outcome Measures in People Living with Diabetes: A Scoping Review of Instruments

BACKGROUND

Diabetes mellitus is a global public health concern, with over 463 million people living with this chronic disease. Pathology complexity, management difficulty, and limited participation in care has resulted in healthcare systems seeking new strategies to engage people living with diabetes. Patient-reported experience measures (PREMs) and patient-reported outcome measures (PROMs) were developed to address the gap between the healthcare system expectation and patient preference.

OBJECTIVE

This study aimed to review the existing literature on PREMs and PROMs specific to type 1 and 2 diabetes, and report the dimensions report the dimensions they have measured.

METHODS

A scoping review was conducted from January 1985 to March 2020 of six databases, MEDLINE, EMBASE, PsycINFO, CINHAL, Scopus, and BiblioPro, to identify PREM and PROM instruments specific for type 1 and 2 diabetes.

RESULTS

Overall, 34 instruments were identified, 32 PROMs and two PREMs. The most common instrument included outcomes related to quality of life at 44% (n = 15), followed by satisfaction (whether with treatment, device, and healthy habits) at 26% (n = 9). Furthermore, instruments regarding personal well-being accounted for 15% (n = 5). For instruments that measure experiences of persons with diabetes, there were two scales of symptoms, and one related to the attitude patients have toward the disease.

CONCLUSIONS

Diabetes-specific validated instruments mainly focus on quality of life, education, and treatment, and sometimes overlap each other, in their subscales and assessment dimensions. Constructs such as cultural and religious beliefs, leisure, and work life may need more attention. There appears to be a gap in instruments to measure experiences of individuals who "live with diabetes" and seek to lead a "normal life."

Integrating Spinal Cord Injury - Quality of Life instruments into rehabilitation: Implementation science to guide adoption of patient-reported outcome measures

Context/objective: This study describes a development strategy for integrating the Spinal Cord Injury - Quality of Life (SCI-QOL) item banks into inpatient spinal cord injury (SCI) rehabilitation and recommendations for protocol implementation.Design: We adopted an implementation science approach to develop a strategy for adapting and contextualizing SCI-QOL use during SCI rehabilitation. We conducted focus groups and stakeholder meetings with clinical assessment champions to (1) identify barriers and supports to SCI-QOL adoption; (2) reduce barriers and emphasize supports; (3) evaluate and select relevant SCI-QOL domains and item banks; (4) develop administration and reporting guidelines; and (5) identify hospital roles to alert with SCI-QOL results.Setting: A regional inpatient rehabilitation hospital. This study focuses on clinicians providing inpatient rehabilitation to patients with SCI.Participants: Fifty-nine clinicians, including physicians, speech language pathologists, occupational and physical therapists, nurses, and social workers providing care to SCI inpatients.Interventions: N/A.Outcome measures: N/A.Results: Clinicians identified the SCI-QOL domains that were most relevant to inpatient care; when SCI-QOL should be administered; what hospital roles were best suited for administering SCI-QOL; how results should be displayed in the electronic medical record; and which clinical roles needed notification of SCI-QOL results.Conclusions: Clinicians acknowledge the value of patient-reported outcome measures in inpatient SCI rehabilitation, but noted barriers to adoption. Engaging clinicians in the decision-making process for developing an implementation and administration protocol can inform strategies to overcome barriers and emphasize supports.

Using a Learning Health System to Improve Physical Therapy Care for Patients With Intermittent Claudication: Lessons Learned From the ClaudicatioNet Quality System

Routinely collected outcomes data can be used to improve physical therapy care through benchmarking, personalization, continued education, and treatment optimization. This article describes how a nationwide infrastructure to routinely collect data from daily practice was created and how these data were used through a support system (called the ClaudicatioNet Quality system) to improve physical therapy care for patients with intermittent claudication in the Netherlands. ClaudicatioNet is a nationwide network of 2100 specialized physical therapists, providing high-quality supervised exercise therapy in combination with lifestyle counseling. The ClaudicatioNet Quality system uses a large national registry in which specific relevant health outcomes have been routinely collected since 2015. These data have then been used in turn to assess quality of care and provide transparency to therapists and other stakeholders. The Quality system is intended to serve as a learning health system, to support continuous learning at the therapist, practice, and network level. In this approach, individual patients and physical therapists are provided with opportunities to personalize, benchmark, and evaluate (and possibly alter) a treatment plan using routinely collected data from historical patients. The Quality system is described based on the essential elements of a learning health system. The challenges and lessons learned in developing the Quality system also are described.

IMPACT

The use of routinely collected health outcomes can, if implemented correctly, facilitate continuous learning among physical therapists and contribute to person-centered care. This example of a learning health system might serve as a blueprint for physical therapists on how to optimally implement and distill meaning from routinely collected clinical data.

Feasibility of a Mobile Health App for Routine Outcome Monitoring and Feedback in SMART Recovery Mutual Support Groups: Stage 1 Mixed Methods Pilot Study

Background

Mutual support groups are an important source of long-term help for people impacted by addictive behaviors. Routine outcome monitoring (ROM) and feedback are yet to be implemented in these settings. SMART Recovery mutual support groups focus on self-empowerment and use evidence-based techniques (eg, motivational and behavioral strategies). Trained facilitators lead all SMART Recovery groups, providing an opportunity to implement ROM.

Objective

The aim of this stage 1 pilot study is to explore the feasibility, acceptability, and preliminary outcomes of a novel, purpose-built mobile health ROM and feedback app (SMART Track) in mutual support groups coordinated by SMART Recovery Australia (SRAU) over 8 weeks.

Methods

SMART Track was developed during phase 1 of this study using participatory design methods and an iterative development process. During phase 2, 72 SRAU group participants were recruited to a nonrandomized, prospective, single-arm trial of the SMART Track app. Four modes of data collection were used: ROM data directly entered by participants into the app; app data analytics captured by Amplitude Analytics (number of visits, number of unique users, visit duration, time of visit, and user retention); baseline, 2-, and 8-week follow-up assessments conducted through telephone; and qualitative telephone interviews with a convenience sample of study participants (20/72, 28%) and facilitators (n=8).

Results

Of the 72 study participants, 68 (94%) created a SMART Track account, 64 (88%) used SMART Track at least once, and 42 (58%) used the app for more than 5 weeks. During week 1, 83% (60/72) of participants entered ROM data for one or more outcomes, decreasing to 31% (22/72) by the end of 8 weeks. The two main screens designed to provide personal feedback data (Urges screen and Overall Progress screen) were the most frequently visited sections of the app. Qualitative feedback from participants and facilitators supported the acceptability of SMART Track and the need for improved integration into the SRAU groups. Participants reported significant reductions between the baseline and 8- week scores on the Severity of Dependence Scale (mean difference 1.93, SD 3.02; 95% CI 1.12-2.73) and the Kessler Psychological Distress Scale-10 (mean difference 3.96, SD 8.31; 95% CI 1.75-6.17), but no change on the Substance Use Recovery Evaluator (mean difference 0.11, SD 7.97; 95% CI –2.02 to 2.24) was reported.

Conclusions

Findings support the feasibility, acceptability, and utility of SMART Track. Given that sustained engagement with mobile health apps is notoriously difficult to achieve, our findings are promising. SMART Track offers a potential solution for ROM and personal feedback, particularly for people with substance use disorders who attend mutual support groups.

Trial Registration

Australian New Zealand Clinical Trials Registry ACTRN12619000686101; https://anzctr.org.au/Trial/Registration/TrialReview.aspx?id=377336

International Registered Report Identifier (IRRID)

RR2-10.2196/15113

Patient-level barriers and facilitators to completion of patient-reported outcomes measures

PURPOSE

To identify patient-level barriers and facilitators to completion of patient-reported outcomes measures (PROMs) in a hand and upper extremity clinic in Baltimore, Maryland.

METHODS

We conducted 12 h of direct observation of PROM completion (October-November, 2020). Ethnographic observation memos were qualitatively analyzed for barriers and facilitators using rapid thematic analysis. Informed by observation findings, we conducted 17 semi-structured interviews with mixed-literacy patients, caregivers, and clinic staff to understand the patient experience when completing PROMs (November 2020-March 2021). We identified initial themes through inductive and deductive framework analysis and validated findings through subsequent interviews with member-checking.

RESULTS

We identified nine patient-level factors that influence PROM completion: platform design, print literacy, health literacy, technology literacy, language proficiency, physical functioning, vision, cognitive functioning, and time.

CONCLUSIONS

There are multiple distinct patient-level factors that affect PROM completion. Failure to consider these factors in PROM design and implementation may lower completion rates or prevent accurate completion, undermining PROM validity. Because certain factors affect minority populations at disproportionate rates, this may also contribute to existing health disparities.

Implementation of a cloud-based electronic patient-reported outcome (ePRO) platform in patients with advanced cancer

Background

Patient reported outcomes (PROs) have been associated with improved symptom management and quality of life in patients with cancer. However, the implementation of PROs in an academic clinical practice has not been thoroughly described. Here we report on the execution, feasibility and healthcare utilization outcomes of an electronic PRO (ePRO) application for cancer patients at an academic medical center.

Methods

We conducted a randomized trial comparing an experimental ePRO arm to standard of care in patients with advanced cancer in the thoracic, gastrointestinal, and genitourinary oncology groups at Stanford Cancer Center from March 2018 to November 2019. We describe the pre-implementation, implementation, and post-implementation phases of the ePRO arm, technological barriers, electronic health record (EHR) integration, clinician burden, and patient data privacy and security. Feasibility was pre-specified to be at least 70% completion of all questionnaires. Acceptability was based on patient and clinician feedback. Ambulatory healthcare utilization was assessed by reviewing numbers of phone messages, electronic portal messages, and referrals for supportive care.

Results

Of 617 ePRO questionnaires sent to 72 patients, 445 (72%) were completed. Most clinicians (87.5%) and patients (93%) felt neutral or positive about the ePRO tool’s ease of use. Exposure to ePRO did not cause a measurable change in ambulatory healthcare utilization, with a median of less than two phone messages and supportive care referrals, and 5–6 portal messages.

Conclusions

Web-based ePRO tools for patients with advanced cancer are feasible and acceptable without increasing clinical burden. Key lessons include the importance of pilot testing, engagement of stakeholders at all levels, and the need for customization by disease group. Future directions for this work include completion of EHR integration, expansion to other centers, and development of integrated workflows for routine clinical practice.

Supplementary Information

The online version contains supplementary material available at 10.1186/s41687-021-00358-2.

The use of patient-reported outcomes in routine cancer care: preliminary insights from a multinational scoping survey of oncology practitioners

Background

There exists scant evidence on the optimal approaches to integrating patient-reported outcomes (PROs) in clinical practice. This study gathered oncology practitioners’ experiences with implementing PROs in cancer care.

Methods

Between December 2019 and June 2020, we surveyed practitioners who reported spending > 5% of their time providing clinical care to cancer patients. Respondents completed an online survey describing their experiences with and barriers to using PROs in clinical settings.

Results

In total, 362 practitioners (physicians 38.7%, nurses 46.7%, allied health professionals 14.6%) completed the survey, representing 41 countries (Asia–Pacific 42.5%, North America 30.1%, Europe 24.0%, others 3.3%). One quarter (25.4%) identified themselves as “high frequency users” who conducted PRO assessments on > 80% of their patients. Practitioners commonly used PROs to facilitate communication (60.2%) and monitor treatment responses (52.6%). The most commonly reported implementation barriers were a lack of technological support (70.4%) and absence of a robust workflow to integrate PROs in clinical care (61.5%). Compared to practitioners from high-income countries, more practitioners in low-middle income countries reported not having access to a local PRO expert (P < .0001) and difficulty in identifying the appropriate PRO domains (P = .006). Compared with nurses and allied health professionals, physicians were more likely to perceive disruptions in clinical care during PRO collection (P = .001) as an implementation barrier.

Conclusions

Only a quarter of the surveyed practitioners reported capturing PROs in routine clinical practice. The implementation barriers to PRO use varied across respondents in different professions and levels of socioeconomic resources. Our findings can be applied to guide planning and implementation of PRO collection in cancer care.

Supplementary Information

The online version contains supplementary material available at 10.1007/s00520-021-06545-7.

Organizing work in local service implementation: an ethnographic study of nurses' contributions and competencies in implementing a municipal acute ward

BACKGROUND

The increased prevalence of chronic diseases and an ageing population challenge healthcare delivery, particularly hospital-based care. To address this issue, health policy aims to decentralize healthcare by transferring responsibility and introducing new services in primary healthcare. In-depth knowledge of associated implementation processes is crucial for health care managers, policymakers, and the health care personnel involved. In this article, we apply an ethnographic approach in a study of nurses' contributions to the implementation of a new inpatient service in an outpatient primary care emergency clinic and explore the competencies involved. The approach allowed us to explore the unexpressed yet significant effort, knowledge and competence of nurses that shaped the new service.

METHODS

The study combines observations (250 h) and several in situ interviews with healthcare personnel and individual in-depth interviews with nurses (n = 8) at the emergency clinic. In our analysis, we draw on a sociological perspective on healthcare work and organization that considers nursing a practice within the boundaries of clinical patient work, organizational structures, and managerial and professional requirements.

RESULTS

We describe the following three aspects of nurses' contributions to the implementation of the new service: (1) anticipating worst-case scenarios and taking responsibility for preventing them, (2) contributing coherence in patient care by ensuring that new and established procedures are interconnected, and (3) engaging in "invisible work". The nurses draw on their own experiences from their work as emergency nurses and knowledge of the local and regional contexts. They utilize their knowledge, competence, and organizing skills to influence the implementation process and ensure high-quality healthcare delivery in the extended service.

CONCLUSIONS

Our study illustrates that nurses' contributions are vital to coordinating and adjusting extended services. Organizing work, in addition to clinical work, is a crucial aspect of nursing work. It 'glues' the complex and varied components of the individual patient's services into coherent and holistic care trajectories. It is this organizing competence that nurses utilize when coordinating and adjusting extended services. We believe that nurses' organizing work is generally invaluable in implementing new services, although it has not been well emphasized in practice and research.

Comorbid Anxiety and Depression, Though Underdiagnosed, Are Not Associated with High Rates of Low-Value Care in Patients with Chronic Obstructive Pulmonary Disease

Rationale: Patients with chronic obstructive pulmonary disease (COPD) and anxiety or depression experience more symptoms and exacerbations than patients without these comorbidities. Failure to provide beneficial COPD therapies to appropriate patients (underuse) and provision of potentially harmful therapies to patients without an appropriate indication (overuse) could contribute to respiratory symptoms and exacerbations. Anxiety and depression are known to affect the provision of health services for other comorbid conditions; therefore, underuse or overuse of therapies may explain the increased risk of severe symptoms among these patients.Objectives: To determine whether diagnosed anxiety and depression, as well as significant anxiety and depression symptoms, are associated with underuse and overuse of appropriate COPD therapies.Methods: We analyzed data from a multicenter prospective cohort study of 2,376 participants (smokers and control subjects) enrolled between 2010 and 2015. We identified two subgroups of participants, one at risk for inhaled corticosteroid (ICS) overuse and one at risk for long-acting bronchodilator (LABD) underuse based on the 2011 Global Initiative for Chronic Obstructive Lung Disease statement. Our primary outcomes were self-reported overuse and underuse. Our primary exposures of interest were self-reported anxiety and depression and significant anxiety and depression symptoms. We adopted a propensity-score method with inverse probability of treatment weighting adjusting for differences in prevalence of confounders and performed inverse probability of treatment weighting logistic regression to evaluate all associations between the exposures and outcomes.Results: Among the 1,783 study participants with COPD confirmed by spirometry, 667 (37.4%) did not have an indication for ICS use, whereas 985 (55.2%) had an indication for LABD use. Twenty-five percent (n = 167) of patients reported ICS use, and 72% (n = 709) denied LABD use in each subgroup, respectively. Neither self-reported anxiety and depression nor significant anxiety and depression symptoms were associated with overuse or underuse. At least 50% of patients in both subgroups with significant symptoms of anxiety or depression did not report a preexisting mental health diagnosis.Conclusions: Underuse of LABDs and overuse of ICSs are common but are not associated with comorbid anxiety or depression diagnosis or symptoms. Approximately one-third of individuals with COPD experience anxiety or depression, and most are undiagnosed. There are significant opportunities to improve disease-specific and patient-centered treatment for individuals with COPD.

Supporting Patient-Clinician Interaction in Chronic HIV Care: Design and Development of a Patient-Reported Outcomes Software Application

BACKGROUND

The consideration of health-related quality of life (HRQL) is a hallmark of best practice in HIV care. Information technology offers an opportunity to more closely engage patients with chronic HIV infection in their long-term management and support a focus on HRQL. However, the implementation of patient-reported outcome (PRO) measures, such as HRQL in routine care, is challenged by the need to synthesize data generated by questionnaires, the complexity of collecting data between patient visits, and the integration of results into clinical decision-making processes.

OBJECTIVE

Our aim is to design and pilot-test a multimedia software platform to overcome these challenges and provide a vehicle to increase focus on HRQL issues in HIV management.

METHODS

A multidisciplinary team in France and Australia conducted the study with 120 patients and 16 doctors contributing to the design and development of the software. We used agile development principles, user-centered design, and qualitative research methods to develop and pilot the software platform. We developed a prototype application to determine the acceptability of the software and piloted the final version with 41 Australian and 19 French residents using 2 validated electronic questionnaires, the Depression, Anxiety and Stress Scale-21 Items, and the Patient Reported Outcomes Quality of Life-HIV.

RESULTS

Testing of the prototype demonstrated that patients wanted an application that was intuitive and without excessive instruction, so it felt effortless to use, as well as secure and discreet. Clinicians wanted the PRO data synthesized, presented clearly and succinctly, and clinically actionable. Safety concerns for patients and clinicians included confidentiality, and the potential for breakdown in communication if insufficient user training was not provided. The final product, piloted with patients from both countries, showed that most respondents found the application easy to use and comprehend. The usability testing survey administered found that older Australians had reduced scores for understanding the visual interface (P=.004) and finding the buttons organized (P=.02). Three-fourths of the respondents were concerned with confidentiality (P=.007), and this result was more prevalent in participants with higher anxiety and stress scores (P=.01), as measured by the Depression, Anxiety and Stress Scale-21 Items. These statistical associations were not observed in 15 French patients who completed the same questionnaire.

CONCLUSIONS

Digital applications in health care should be safe and fit for purpose. Our software was acceptable to patients and shows potential to overcome some barriers to the implementation of PROs in routine care. The design of the clinicians' interface presents a solution to the problem of voluminous data, both synthesizing and providing a snapshot of longitudinal data. The next stage is to conduct a randomized controlled trial to determine whether patients experience increased satisfaction with care and whether doctors perceive that they deliver better clinical care without compromising efficiency.

Facilitators and barriers for implementing patient-reported outcome measures in clinical care: An academic center's initial experience

Objectives The aim of this study was to explore the perspectives of healthcare providers and researchers in a large academic hospital on facilitators and barriers for implementing patient-reported outcome measures (PROMs) in clinical care. Methods A customized web-based questionnaire was developed and disseminated to healthcare providers and researchers across multiple medical departments involved in a value-based health care initiative in the hospital. Questionnaire statements were rated using a 5-point Likert scale ranging from "strongly agree" to "strongly disagree". In addition, 8 open-ended questions were included allowing respondents to mention additional facilitators and barriers for implementing PROMs. Descriptive statistics were used to summarize the results. Results In total, 61 participants from both surgical and non-surgical departments completed the survey. Most respondents (51%) were medical specialists and the median employment duration was 14 years. Frequently reported facilitators were the presence of a PROM coordinator in the (outpatient) clinic (85%), the integration of PROMs in the electronic health record (81%), and the intrinsic motivation of members involved in the implementation (N=9 open responses). Commonly reported barriers were language barriers (76%), IT issues (N=17 open responses), and time constraints (N=14 open responses). Conclusions For the successful implementation of PROMs in clinical practice, it is imperative that healthcare organizations consider supporting motivated healthcare professionals, involving PROMs coordinators, and investing in an adequate IT infrastructure, and removal of language barriers.

A qualitative study on professionals' attitudes and views towards the introduction of patient reported measures into public maternity care pathway

Background

The importance and potential benefits of introducing patient reported measures (PRMs) into health care service have been widely acknowledged, yet the experience regarding their implementation into practice is limited. There is a considerable paucity of research in adopting PRMs in maternity care routine. This study, which utilizes the PRMs included in Pregnancy and Childbirth (PCB) outcome set developed by International Consortium for Health Outcomes Measurement (ICHOM) as sample measures, aims to elicit Finnish professionals’ views on PRMs and to explore the applicability of PRMs in Finnish public maternity care.

Methods

This qualitative study, applying semi-structured interviews, described the local professionals’ views towards the application of PRMs in Finnish public maternity care. Professionals were asked to assess the PRMs defined in ICHOM PCB set and provide their expectations and concerns on the implementation of PRMs in Finnish public maternity service.

Results

Twenty professionals participated in the interviews. Participants agreed on the importance and relevance of the PRMs questions included in ICHOM PCB set for delivering and developing maternity care in Finland. However, they criticized the number and length of questions as well as the recommended time points of data collection. In addition, for a successful implementation, various steps like developing suitable questions, redesigning service pathway and protocols, and motivating women to respond to PRMs questions were considered to be important. Also, some potential obstacles, difficulties and risks associated with the implementation were underlined.

Conclusion

This study indicates that the implementation of PRMs into Finnish public maternity service is possible, highly relevant and important. However, the adoption of PRMs into routine practice may be challenging and will require a series of efforts. This study shows viewpoints from Finnish professionals who have not participated in developing the ICHOM PCB standard set and provides important insights on the development and implementation of PRMs.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06658-z.

A. B, J. M. VDB, A. H. M. B, C. C. B, C. J. F, J. W. G, C. M. VDH, B. J, A. K, H. K, B. J. P. K, L. A. M, M. A. MH, M. P, M. A. J. VR, N. W. P. R, H. J. S, A. Y. N. S, F. S, M. M. T, A. S. P. T, F. A. W. Paediatric patients report lower health-related quality of life in daily clinical practice compared to new normative PedsQLTM data

Aim

To compare Health‐Related Quality of Life (HRQOL) of paediatric patients with newly collected HRQOL data of the general Dutch population, explore responses to individual items and investigate variables associated with HRQOL.

Methods

Children (8–12y) and adolescents (13–17y) from the general population (N = 966) and from a paediatric population (N = 1209) completed the Pediatric Quality of Life Inventory (PedsQL^TM) online via the KLIK Patient‐Reported Outcome Measures portal. PedsQL^TM scale scores were compared between groups with independent t tests, by age group and gender. Responses to PedsQL^TM items were explored using descriptive analyses. Linear regression analyses were performed to determine which variables were associated with HRQOL.

Results

Paediatric patients reported worse HRQOL than the general population on all PedsQL^TM scales (p ≤ .001, d = 0.20–1.03), except social functioning, and a high proportion reported problems on PedsQL^TM items, for example, ‘I have trouble sleeping’. Younger age, female gender and school absence were negatively associated with HRQOL (β = −0.37–0.10, p ≤ .008).

Conclusion

Paediatric patients reported lower HRQOL than the general population, and school absence, female gender and younger age were associated with lower HRQOL. The results underline the importance to structurally monitor paediatric patients’ HRQOL in clinical practice to detect problems and offer the right help on time.

Adoption of patient-reported outcome measures with youth with intellectual/developmental disabilities: Contextual influences and practice patterns

BACKGROUND

The purpose of this study was to identify potential barriers to patient reported outcome measure (PROM) adoption with youth and young adults with intellectual and/or developmental disabilities (IDD) and to understand current PROM adoption patterns of paediatric practitioners working with this population.

METHODS

We used a web-based survey to collect data from paediatric practitioners who work with youth with IDD about factors influencing the adoption of PROMs and the frequency of PROM use across age groups (elementary, middle school and high school/transition age) and practice settings (school and rehabilitation).

RESULTS

A total of 113 paediatric practitioners (occupational therapist = 48, physical therapist = 32, physician = 16, other = 17) responded to the survey with an average of 15 years of experience working with youth ages 8-21 with IDD. Accessibility and appropriateness, psychometric evidence, and time were most frequently ranked among the top three factors that influence practitioners' adoption of PROMs. Practitioners reported 'never or rarely' using PROMs 39%-65% of the time across age groups.

CONCLUSIONS

Our results suggest that paediatric practitioners may be infrequently using PROMs with youth with IDD because of perceived inaccessibility and time requirements of PROMs and practice-environment barriers, including access to evidence and caseload demands. Because PROMs can facilitate client-centred care, addressing these potential barriers to adoption may improve paediatric rehabilitation.

How to foster successful implementation of a patient reported experience measurement in the disability sector: an example of developing strategies in co-creation

BACKGROUND

The integrated uptake of patient-reported experience measures, using outcomes for the micro, meso and macro level, calls for a successful implementation process which depends on how stakeholders are involved in this process. Currently, the impact of stakeholders on strategies to improve the integrated use is rarely reported, and information about how stakeholders can be engaged, including care-users who are communication vulnerable, is limited. This study illustrates the impact of all stakeholders on developing tailored implementation strategies and provides insights into supportive conditions to involve care-users who are communication vulnerable.

METHODS

With the use of participatory action research, implementation strategies were co-created by care-users who are communication vulnerable (n = 8), professionals (n = 12), management (n = 6) and researchers (n = 5) over 9 months. Data collection consisted of audiotapes, reports, and researchers' notes. Conventional content analysis was performed.

RESULTS

The impact of care-users concerned the strategies' look and feel, understandability and relevance. Professionals influenced impact on how to use strategies and terminology. The impact of management was on showing the gap between policy and practice, and learning from previous improvement failures. Researchers showed impact on analysis, direction of strategy changes and translating academic and development experience into practice. The engagement of care-users who are communication vulnerable was supported, taking into account organisational issues and the presentation of information.

CONCLUSIONS

The impact of all engaged stakeholders was identified over the different levels strategies focused on. Care-users who are communication vulnerable were valuable engaged in co-creation implementation strategies by equipping them to their needs and routines, which requires adaptation in communication, delimited meetings and a safe group environment.

TRIAL REGISTRATION

Reviewed by the Medical Ethics Committee of Zuyderland-Zuyd (METCZ20190006). NL7594 registred at https://www.trialregister.nl/ .

Healthcare provider characteristics that influence the implementation of individual-level patient-centered outcome measure (PROM) and patient-reported experience measure (PREM) data across practice settings: a protocol for a mixed methods systematic review with a narrative synthesis

BACKGROUND

Substantial literature has highlighted the importance of patient-reported outcome and experience measures (PROMs and PREMs, respectively) to collect clinically relevant information to better understand and address what matters to patients. The purpose of this systematic review is to synthesize the evidence about how healthcare providers implement individual-level PROMs and PREMs data into daily practice.

METHODS

This mixed methods systematic review protocol describes the design of our synthesis of the peer-reviewed research evidence (i.e., qualitative, quantitative, and mixed methods), systematic reviews, organizational implementation projects, expert opinion, and grey literature. Keyword synonyms for "PROMs," PREMs," and "implementation" will be used to search eight databases (i.e., MEDLINE, CINAHL, PsycINFO, Web of Science, Embase, SPORTDiscus, Evidence-based Medicine Reviews, and ProQuest (Dissertation and Theses)) with limiters of English from 2009 onwards. Study selection criteria include implementation at the point-of-care by healthcare providers in any practice setting. Eligible studies will be critically appraised using validated tools (e.g., Joanna Briggs Institute). Guided by the review questions, data extraction and synthesis will occur simultaneously to identify biographical information and methodological characteristics as well as classify study findings related to implementation processes and strategies. As part of the narrative synthesis approach, two frameworks will be utilized: (a) Consolidated Framework for Implementation Research (CFIR) to identify influential factors of PROMs and PREMs implementation and (b) Expert Recommendations for Implementing Change (ERIC) to illicit strategies. Data management will be undertaken using NVivo 12TM.

DISCUSSION

Data from PROMs and PREMs are critical to adopt a person-centered approach to healthcare. Findings from this review will guide subsequent phases of a larger project that includes interviews and a consensus-building forum with end users to create guidelines for implementing PROMs and PREMs at the point of care.

SYSTEMATIC REVIEW REGISTRATION

PROSPERO CRD42020182904 .

Outcomes after kidney transplantation, let's focus on the patients' perspectives

Graft function and patient survival are traditionally the most used parameters to assess the objective benefits of kidney transplantation. Monitoring graft function, along with therapeutic drug concentrations and transplant complications, comprises the essence of outpatient management in kidney transplant recipients (KTRs). However, the patient's perspective is not always included in this process. Patients' perspectives on their health after kidney transplantation, albeit subjective, are increasingly acknowledged as valuable healthcare outcomes and should be considered in order to provide patient-centred healthcare. Such outcomes are known as patient-reported outcomes (PROs; e.g. health-related quality of life and symptom burden) and are captured using PRO measures (PROMs). So far, PROMs have not been routinely used in clinical care for KTRs. In this review we will introduce PROMs and their potential application and value in the field of kidney transplantation, describe commonly used PROMs in KTRs and discuss structural PROMs implementation into kidney transplantation care.

Primary care physician's (PCP) perceived value of patient-reported outcomes (PROs) in clinical practice: a mixed methods study

BACKGROUND

Patient-reported outcomes (PROs) can promote patient engagement, shared-decision making and improve the overall experience of care. However, PRO integration in the primary care clinical setting is limited. Exploring the perspectives of primary care physicians (PCPs) on PROs is key to understanding how they are being used in the clinical setting. We sought to elucidate this clinical perspective at one of the largest US health systems that has integrated a wide range of PROs into routine primary care.

METHODS

Mixed methods study with both anonymous online surveys and in-person qualitative semistructured interviews conducted with PCPs to understand their clinical perspectives on the applications of the existing PROs. PCPs from the 19 affiliated clinics were prompted to complete the survey. Interviewed PCPs were selected via a combination of random and purposive selection from the PCP directory.

RESULTS

Of 172 PCPs, 117 (68%) completed the online survey and 28 completed semistructured interviews. Most PCPs (77%) reviewed PRO responses with their patients. PCPs endorsed that PROs improve clinic efficiency and clinical management. However, PCPs have heterogeneous perspectives on the relevance of PROs in clinical practice, likely due to variations in clinic practice. For specific PRO instruments, PCPs reported anxiety and depression screening PROs to be most helpful. PCPs felt that PROs assisted with completing screening questions that are required by regulatory bodies. Barriers to using PROs include poor user-interface for both clinicians and patients and inadequate training.

CONCLUSIONS

Most PCPs regularly use PRO data though there are mixed opinions about their clinical relevance. An adaptable, user-friendly PRO system has the potential to have meaningful clinical applications in primary care.

Using an Activity Tracker in Healthcare: Experiences of Healthcare Professionals and Patients

Despite the increased use of activity trackers, little is known about how they can be used in healthcare settings. This study aimed to support healthcare professionals and patients with embedding an activity tracker in the daily clinical practice of a specialized mental healthcare center and gaining knowledge about the implementation process. An action research design was used to let healthcare professionals and patients learn about how and when they can use an activity tracker. Data collection was performed in the specialized center with audio recordings of conversations during therapy, reflection sessions with the therapists, and semi-structured interviews with the patients. Analyses were performed by directed content analyses. Twenty-eight conversations during therapy, four reflection sessions, and eleven interviews were recorded. Both healthcare professionals and patients were positive about the use of activity trackers and experienced it as an added value. Therapists formulated exclusion criteria for patients, a flowchart on when to use the activity tracker, defined goals, and guidance on how to discuss (the data of) the activity tracker. The action research approach was helpful to allow therapists to learn and reflect with each other and embed the activity trackers into their clinical practice at a specialized mental healthcare center.

Could existing infrastructure for using patient-reported outcomes as quality measures also be used for individual care in patients with colorectal cancer?

Background

There has been increasing interest in integrating patient-reported outcomes (PROs) into routine oncological practice. To date, however, PROs have rarely been implemented in Germany. Currently, PROs are being used as performance measures in colorectal cancer centers in Germany. This content analysis identified factors that may inhibit or facilitate the additional use of PROMs for individual patient management.

Methods

The analysis follows an exploratory approach. Out of 103 centers that participated in a multicentric PRO quality management and benchmarking program in Germany, twelve oncological health-care providers from eight certified colorectal cancer centers were interviewed using a semi-structured interview guide. The interviewees were clinicians (physicians, nurses, psycho-oncologist and physician assistant) who care for colorectal cancer patients. This analysis evaluated whether and how PROs that are primarily collected for quality management/benchmarking reasons could also be used for the management of individual patients. The data was analyzed using a content-analysis approach.

Results

The interviewees were not using PRO in their routine clinical work, but they recognized its added value and pointed out potential example uses. Identified inhibiting factors for the use of PROs in clinical routine work were effortful access to PRO reports, lacking coordinating structures, time delays and time points of measurements as well as redundancy with other instruments. Facilitating factors for the use of PROs in clinical routine work that were identified included access via electronic patient records, implementation of coordinating structures for PRO processes in the center, clear PRO reports that are easy to interpret, and measurements at relevant time points.

Discussion

Clinicians had quite a positive attitude toward PROs and recognized their added value. Inhibiting and facilitating factors of an organizational and technical nature were identified.

Conclusions

These findings indicate how PROs used for quality management purposes may also be used for the management of individual patients. Therefore, existing structures and processes in the certified colorectal cancer centers, as well as lessons learned from the literature on the implementation of PROs monitoring individual patients need to be taken into account.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06457-6.

Clinicians' knowledge and attitudes towards patient reported outcomes in colorectal cancer care - insights from qualitative interviews

Introduction

Patient-reported outcomes (PROs) can be used in cancer care to monitor patients’ disease-related symptoms and functional status. However, successful implementation of such instruments is only possible if clinical staff are convinced of the clinical benefits. It is therefore crucial to investigate the attitudes of clinical staff to PROs in routine cancer care.

Methods

Semi-structured, guideline-based interviews were held with 12 clinicians working in certified colorectal cancer centers in Germany who are taking part in an observational study on PROs (five surgeons, two oncologists, one psycho-oncologist, two oncological care nurses, one stoma therapist, and one physician assistant) in order to investigate firstly, how clinicians describe PRO instruments (“wording”); and secondly, the clinicians’ general attitude toward PROs. A qualitative content analysis according to Kuckartz was performed.

Results

The wording used to describe PROs was not consistent. Statements on attitudes toward PROs were very heterogeneous and were therefore categorized into “(rather) positive” and “(rather) negative.” The principal advantages of PROs mentioned by participants included broader, structured knowledge about patients and treatment, as well as relevance for patients. Subcategories for (rather) negative attitudes included statements expressing doubts about the questionnaires and “no need for PROs.”

Discussion

The clinicians participating mainly expressed fairly positive attitudes toward PROs. However, they had little knowledge about PROs in general and the interviews therefore mainly reflect their expectations and assumptions about them. These initial impressions may be regarded as providing a basis for future implementation strategies and for training of clinicians on how to use PROs in routine cancer care.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-021-06361-z.

Uptake of an Integrated Electronic Questionnaire System in Community Pediatric Clinics

OBJECTIVE

The study aimed to evaluate an integrated electronic questionnaire system implementation in outpatient community pediatric practices on workflow, completion rates, and recorded scores.

METHODS

We evaluated the implementation and outcomes of an integrated electronic questionnaire system at 45 community pediatric practices that used standardized questionnaires to screen for autism, depression, and substance use and to measure asthma control. Electronic health record (EHR) data for all well child visits were extracted for the 3 months before and after implementation. We used statistical process control charts to evaluate questionnaire completion rates and Chi-square tests to evaluate screening completion and positive screening rates. The collection and entry of questionnaire information was observed and timed.

RESULTS

EHR data included 107,120 encounters across 45 practices that showed significant and sustained improvement in completion rates for all questionnaires. The rate of recorded concerning questionnaires decreased for asthma control (19.3 vs. 12.8%, p < 0.001), stayed the same for autism (96.6 vs. 96.2%, p = 0.38), decreased for depression (9.5 vs. 6.7%, p ≤ 0.001), and increased for any substance use (9.8 vs. 12.8%, p < 0.001). Twelve practices were observed, and patient time and staff time managing questionnaires were decreased after implementation.

DISCUSSION

Electronic questionnaire administration saved staff time and patient time. We report overall improvement in questionnaire completion rates, with notable variation in improvement in completion across practices and in change in concerning recorded result rates across measures.

CONCLUSION

Conversion of four standard paper questionnaires to an integrated electronic system reduces patient and staff time while increasing completion rates when well integrated into routine care.

Improving the patient-centred care of children with life-altering skin conditions using feedback from electronic patient-reported outcome measures: protocol for a hybrid effectiveness-implementation study (PEDS-ePROM)

INTRODUCTION

Using patient-reported outcome measures (PROMs) with children have been described as 'giving a voice to the child'. Few studies have examined the routine use of these measures as potentially therapeutic interventions. This study aims to investigate: (1) the effectiveness of feedback using graphical displays of information from electronic PROMs (ePROMs) that target health-related quality of life, to improve health outcomes, referrals and treatment satisfaction and (2) the implementation of ePROMs and graphical displays by assessing acceptability, sustainability, cost, fidelity and context of the intervention and study processes.

METHODS AND ANALYSIS

A hybrid II effectiveness-implementation study will be conducted from February 2020 with children with life-altering skin conditions attending two outpatient clinics at a specialist paediatric children's hospital. A pragmatic randomised controlled trial and mixed methods process evaluation will be completed. Randomisation will occur at the child participant level. Children or parent proxies completing baseline ePROMs will be randomised to: (1) completion of ePROMs plus graphical displays of ePROM results to treating clinicians in consultations, versus (2) completion of ePROMs without graphical display of ePROM results. The primary outcome of the effectiveness trial will be overall health-related quality of life of children. Secondary outcomes will include other health-related quality of life outcomes (eg, child psychosocial and physical health, parent psychosocial health), referrals and treatment satisfaction. Trial data will be primarily analysed using linear mixed-effects models; and implementation data using inductive thematic analysis of interviews, meeting minutes, observational field notes and study communication mapped to the Consolidated Framework for Implementation Research.

ETHICS AND DISSEMINATION

Ethical approval was obtained from Children's Health Queensland Human Research Ethics Committee (HREC/2019/QCHQ/56290), The University of Queensland (2019002233) and Queensland University of Technology (1900000847). Dissemination will occur through stakeholder groups, scientific meetings and peer-reviewed publications.

TRIAL REGISTRATION NUMBER

Australian New Zealand Clinical Trials Registry (ACTRN12620000174987).

The role of kidney registries in expediting large-scale collection of patient-reported outcome measures for people with chronic kidney disease

In this issue of Clinical Kidney Journal, Van der Willik et al. report findings from a pilot study where they introduced collection of patient-reported outcome measures (PROMs) into routine kidney care in Dutch dialysis centres. It is comparable to a registry-led PROMs initiative in Sweden, published in Clinical Kidney Journal in 2020. Both studies reported low average PROMs response rates with substantial between-centre variation, and both identified suboptimal patient and staff engagement as a key barrier to implementing PROMs in routine care for people with chronic kidney disease (CKD). This suggests that national kidney registries could be well placed to facilitate large-scale collection of PROMs data, but that they may require additional guidance on how to do this successfully. In this editorial, we discuss the current state-of-play of PROMs collection by kidney registries and provide an overview of what is (un)known about the feasibility and effectiveness of PROMs in CKD and other conditions. We anticipate that the fast-growing evidence base on whether, and how, PROMs can be of value in CKD settings will expedite registry-based PROMs collection, which will ultimately lead to more valuable and person-centred services and to enhanced health and well-being of people with CKD.

Effect of routinely assessing and addressing depression and diabetes distress using patient-reported outcome measures in improving outcomes among adults with type 2 diabetes: a systematic review protocol

INTRODUCTION

Type 2 diabetes is a global health priority. People with diabetes are more likely to experience mental health problems relative to people without diabetes. Diabetes guidelines recommend assessment of depression and diabetes distress during diabetes care. This systematic review will examine the effect of routinely assessing and addressing depression and diabetes distress using patient-reported outcome measures in improving outcomes among adults with type 2 diabetes.

METHODS AND ANALYSIS

MEDLINE, Embase, CINAHL Complete, PsycInfo, The Cochrane Library and Cochrane Central Register of Controlled Trials will be searched using a prespecified strategy using a prespecified Population, Intervention, Comparator, Outcomes, Setting and study design strategy. The date range of the search of all databases will be from inception to 3 August 2020. Randomised controlled trials, interrupted time-series studies, prospective and retrospective cohort studies, case-control studies and analytical cross-sectional studies published in peer-reviewed journals in the English language will be included. Two review authors will independently screen abstracts and full texts with disagreements resolved by a third reviewer, if required, using Covidence software. Two reviewers will undertake risk of bias assessment using checklists appropriate to study design. Data will be extracted using prespecified template. A narrative synthesis will be conducted, with a meta-analysis, if appropriate.

ETHICS AND DISSEMINATION

Ethics approval is not required for this review of published studies. Presentation of results will follow the Preferred Reporting Items for Systematic reviews and Meta-Analyses guidance. Findings will be disseminated via peer-reviewed publication and conference presentations.

PROSPERO REGISTRATION NUMBER

CRD42020200246.

Barriers and Facilitators to the International Implementation of Standardized Outcome Measures in Clinical Cleft Practice

Objective:

To identify barriers and facilitators to international implementation of a prospective system for standardized outcomes measurement in cleft care.

Design:

Cleft teams that have implemented the International Consortium for Health Outcomes Measurement Standard Set for cleft care were invited to participate in this 2-part qualitative study: (1) an exploratory survey among clinicians, health information technology professionals, and project coordinators, and (2) semistructured interviews of project leads. Thematic content analysis was performed, with organization of themes according to the dimensions of the reach, effectiveness, adoption, implementation and maintenance (RE-AIM) framework: reach, effectiveness, adoption, implementation, and maintenance.

Results:

Four cleft teams in Europe and North America participated in this study. Thirteen participants completed exploratory questionnaires and 5 interviewees participated in follow-up interviews. Survey responses and thematic content analysis revealed common facilitators and barriers to implementation at all sites. Teams reach patients either via email or during the clinic visit to capture patient-reported outcomes. Adopting routine data collection is enhanced by aligning priorities at the organizational and cleft team level. Streamlining workflows and developing an efficient data collection platform are necessary early on, followed by pilot testing or stepwise implementation. Regular meetings and financial resources are crucial for implementing, sustaining, analyzing collected data, and providing feedback to health care professionals and patients. Fostering patient-centered care was articulated as a positive outcome, whereas time presented challenges across all RE-AIM dimensions.

Conclusions:

Identified themes can inform ongoing implementation efforts. Intentionally investing time to lay a sound foundation early on will benefit every phase of implementation and help overcome barriers such as lack of support or motivation.

Comparing patient-reported outcomes across countries: An assessment of methodological challenges

Objectives

There is little published literature on the comparison of patient-reported outcomes between countries. This study aimed to assess pre- and postoperative health among samples of patients undergoing elective groin hernia repair procedures in the National Health Service (NHS), England, and groin hernia patients in Vancouver, Canada.

Methods

We used datasets from two different sources. For the English NHS we used published anonymized patient-level data files which include the EQ-5D(3L) patient-reported outcome measure and a number of demographic and clinical characteristics. For Vancouver, we used data from a sample of Vancouver patients who completed the same instrument during a similar time frame. English patients were matched with Vancouver participant’s characteristics using propensity score methods. A linear regression model was used to measure differences in postoperative visual analogue scale values between countries, adjusting for patient characteristics.

Results

Our study revealed a range of methodological issues concerning the comparability of patient-reported outcomes following hernia repair surgery in the two health systems. These related to differences in approaches to collecting patient-reported outcome measures and the nature of explanatory variables (self-report vs. administrative data), among other challenges. As a consequence, there were differences between the matched samples and the NHS data, indicating a healthy participant bias. Unadjusted results found that Vancouver patients (N = 280) reported more problems in domains of mobility, self care, usual activities and anxiety/depression than the matched cohort of NHS patients (N = 840). Interpreting differences is challenging given different sampling designs.

Conclusions

There are significant hurdles facing comparisons of surgical patients’ outcomes between countries, including adjusting for patient differences, health system factors and approaches to survey administration. While between-country comparisons of surgical outcomes using patient-reported outcomes shows significant promise, much work on standardizing sampling design, variables and analytic methods is needed.

Implementation of a standard outcome set in perinatal care: a qualitative analysis of barriers and facilitators from all stakeholder perspectives

BACKGROUND

To improve their quality, healthcare systems are increasingly focused on value delivered to patients. For perinatal care, the International Consortium for Health Outcomes Measurement (ICHOM) proposed a patient-centred outcome set with both clinical and patient-reported measures for pregnancy and childbirth (PCB set). This study aimed to identify factors that affect the implementation of the PCB set at the pre-implementation stage, using the consolidated framework for implementation research (CFIR).

METHODS

In this qualitative study, we conducted semi-structured interviews amongst a purposive sample of key stakeholders within an obstetric care network (OCN): 1) patients, 2) perinatal care professionals involved in the full cycle of perinatal care, and 3) policy makers, including hospital managers, administrative staff and health care insurers. While the CFIR guided data capture and structuring, thematic analysis revealed overarching themes that best reflected the barriers and facilitators from different stakeholder perspectives. Within these overarching themes, the CFIR constructs were maintained.

RESULTS

Interviews were conducted with 6 patients, 16 professionals and 5 policy makers. Thematic analysis supported by the CFIR framework identified four main themes: the instrument and its implementation process, use in individual patient care, use in quality improvement, and the context of the OCN. Important barriers included professional workload, data reliability, and interprofessional and interorganizational collaboration. Potential facilitators were the PCB set's direct value in individual care, interprofessional feedback and education, and aligning with existing systems. Prominent variations between stakeholder groups included the expected patient burden, the level of use, transparency of outcomes and the degree of integrated care.

CONCLUSIONS

This study clarified critical factors that affect successful implementation of the PCB set in perinatal care. Practice recommendations, suggested at multiple levels, can enable structural patient-centred care improvement and may unite stakeholders towards integrated birth care.

An actionable needs assessment for adolescents and young adults with cancer: the AYA Needs Assessment & Service Bridge (NA-SB)

PURPOSE

In the USA, many of the nearly 90,000 adolescents and young adults (AYAs) diagnosed with cancer each year do not receive services to address the full scope of needs they experience during and after cancer treatment. To facilitate a systematic and patient-centered approach to delivering services to address the unmet needs of AYAs with cancer, we developed the AYA Needs Assessment & Service Bridge (NA-SB).

METHODS

To develop NA-SB, we leveraged user-centered design, an iterative process for intervention development based on prospective user (i.e., provider and AYA) engagement. Specifically, we conducted usability testing and concept mapping to refine an existing tool-the Cancer Needs Questionnaire-Young People-to promote its usability and usefulness in routine cancer practice.

RESULTS

Our user-centered design process yielded a need assessment which assesses AYAs' physical, psychosocial, and practical needs. Importantly, needs in the assessment are grouped by services expected to address them, creating an intuitive and actionable link between needs and services.

CONCLUSION

NA-SB has the potential to improve care coordination at the individual level by allowing cancer care programs to tailor service delivery and resource provision to the individual needs of AYAs they serve.

Discrepancies between proxy estimates and patient reported, health related, quality of life: minding the gap between patient and clinician perceptions in heart failure

PURPOSE

Health related quality of life (HRQoL) is rarely routinely measured in the clinical setting. In the absence of patient reported data, clinicians rely on proxy and informal estimates to support clinical decisions. This study compares clinician estimates (proxy) with patient reported HRQoL in patients with advanced heart failure and examines factors influencing discrepancies.

METHODS

Seventy-five patients with heart failure, (22 females, 53 males) completed the EQ-5D-5L questionnaire. Thirty-nine clinicians (11 medical, 23 nursing, 5 allied health) completed the proxy version (V1) producing 194 dyads. Correlation was assessed using Spearman's rank tests, systematic bias was examined with Bland-Altman analyses. Inter-rater agreement at the domain level, was investigated using linear weighted Kappa statistics while factors influencing the IRG were explored using independent student t-tests, analysis of variance and regression.

RESULTS

There was a moderate positive correlation between clinician HRQoL estimates and patient reported utility (r = 0.38; p < .0005). Mean clinician estimates were higher than patient reported utility (0.60 vs 0.54; p = 0.008), with significant underestimation of reported problems apparent in three of the five EQ-5D-5L domains. Patient sex (female), depressed mood and frailty were all associated with an increased inter-rater gap.

CONCLUSION

Clinicians in this sample overestimated HRQoL. Factors affecting the inter-rater gap, including sex and depression, support formal HRQoL screening to enhance clinical conversations and decision making. The discrepancy also supports regulatory restriction on the use of expert opinion in the development of QALYs in health economic analysis.

An Investigation of the Effectiveness of Arts Therapies Interventions on Measures of Quality of Life and Wellbeing: A Pilot Randomized Controlled Study in Primary Schools

BACKGROUND

Over the last decades there has been a change in the way schooling is perceived recognizing that children's learning is closely linked to children's health. Children spend most of their time at school, which is often the place where problems are identified and interventions are offered, not only for treatment but also prevention. Embedding arts therapies into the educational system may help address children's emerging needs and have a positive impact on their wellbeing.

METHODS

A pilot cross-over randomized controlled design was employed to investigate the effectiveness of an arts therapies intervention on a series of child- and teacher-reported outcome measures, specifically, health related quality of life (assessed using a HRQOL scale; EQ-5D-Y), wellbeing and life functioning (assessed using the child outcome rating scale; CORS), emotional and behavioral difficulties (assessed using the strengths and difficulties questionnaire; SDQ), as well as duration of sleep (assessed using Fitbits). Sample size calculations for future large-scale studies were also performed, and the sustained impact of the intervention was evaluated at 3, 6, and 12 months follow-up. The pluralistic theoretical and therapeutic framework of this intervention was informed by a systematic review on school-based arts therapies interventions and is presented in detail in the study protocol. Participants were 62 children with mild emotional and behavioral difficulties.

RESULTS

Improvements in HRQOL and CORS were greater in those engaged in the arts therapies intervention than the control groups and were maintained at the follow-up stages. Significant improvements were only found for duration of sleep (P = 0.002) and SDQ (P = 0.008). Minimal clinically important differences (MCIDs) as defined in the published protocol were found for CORS, SDQ and duration of sleep, but not HRQOL.

DISCUSSION

Findings indicate that the arts therapies interventions were having a clinically significant effect on life functioning, duration of sleep, emotional and behavioral difficulties. Findings also indicate a small effect size for health related quality of life, suggesting the intervention was having a small positive effect on this outcome measure. The study indicates that all outcome measures assessed here would be suitable for inclusion in a larger randomized controlled study utilizing these arts therapies interventions, and that a sample size of 225 participants would be required if these outcome measures were used.

Implementing PROMs in routine clinical care: a qualitative exploration of GP perspectives

Background

The recently announced long-term plan for the NHS is based on a model of person-centred care, which relies on the sustained engagement of patients, shared decision making, and capability for self-management. For a primary care service under increasing pressure from an ageing and chronically ill population, Patient Reported Outcome Measures (PROMs) appear capable of supporting many of the requirements for person-centred care, yet little is known of the circumstances of their current implementation or how their use might be optimised.

Aim

To begin the conversation about how successfully PROMs have been integrated into primary care and how their use might be supported.

Design & setting

A qualitative investigation of the perspectives of GPs exploring the use of PROMs as part of routine clinical care in England.

Method

Semi-structured telephone interviews were conducted with GPs from across England. The data were analysed using the Consolidated Framework for Implementation Research (CFIR).

Results

A total of 25 interviews were conducted and GPs described the potential benefit of PROMs in a range of circumstances, but also voiced concerns about their reliability and their potential to constrain consultations. Their flexibility meant they had the potential to be incorporated into existing care processes but only with the requisite logistical support.

Conclusion

Areas that need to be addressed include the creation of a compelling body of evidence of the benefit of PROMs, appropriate training for staff and patients, and a coherent implementation strategy from policymakers and funding bodies.

The needs of key-stakeholders for evaluating client's experienced quality of home care: a qualitative approach

BACKGROUND

To optimize home care, it is essential to determine how care recipients experience quality of care. Traditionally, quality of care is measured with normative quality indicators such as safety, efficiency, or prevalence rates such as falls. The growing interest for qualitative patient-reported experience measures in home care requires insight into the needs of care receivers, providers, and organizations as key-stakeholders. Each stakeholder has their own needs that are important to communicate and use to conduct thorough comparisons before implementing new experience measures. This study aims to understand the needs of clients, formal/informal caregivers, and managers/policy officers in measuring client's experienced quality of care in home care.

METHODS

Four focus group interviews and 25 semi-structured interviews with key-stakeholders were conducted and analyzed by means of content analysis. The value-proposition canvas was used as a thematic framework to explore the purpose of experience quality of care measures and related pains and gains.

RESULTS

There were two main purposes for measuring experienced quality of care: first improving the primary care process of individual clients and second for learning and improving in home care team. Using experienced quality of care measures for external accountability and transparency on an organizational or national level were considered less relevant. Among others, participants described not having time and no clear procedure for conducting an evaluation as a pain of the current methods used to evaluate perceived quality of home care. As gains they put forward the ability to informally evaluate experiences during care delivery and to openly discuss complaints with a familiar caregiver.

CONCLUSIONS

This study advocates that home care organizations should be aware of the goal of quality of care measures. They should consider selecting experienced quality of care measures mainly for improving primary care processes of individual clients. The results also underline the relevance of adopting next to quantitative evaluations, more narrative evaluation methods which support communicating openly on care experiences, leading to concrete point-of-improvement. The findings of this study can serve as a guide for both the development or selection of adequate methods, from the perspectives of key-stakeholders, in assessing experienced quality in home care.

Web-Based Patient-Reported Outcome Measures for Personalized Treatment and Care (PROMPT-Care): Multicenter Pragmatic Nonrandomized Trial

Background

Despite the acceptability and efficacy of e–patient-reported outcome (ePRO) systems, implementation in routine clinical care remains challenging.

Objective

This pragmatic trial implemented the PROMPT-Care (Patient Reported Outcome Measures for Personalized Treatment and Care) web-based system into existing clinical workflows and evaluated its effectiveness among a diverse population of patients with cancer.

Methods

Adult patients with solid tumors receiving active treatment or follow-up care in four cancer centers were enrolled. The PROMPT-Care intervention supported patient management through (1) monthly off-site electronic PRO physical symptom and psychosocial well-being assessments, (2) automated electronic clinical alerts notifying the care team of unresolved clinical issues following two consecutive assessments, and (3) tailored online patient self-management resources. Propensity score matching was used to match controls with intervention patients in a 4:1 ratio for patient age, sex, and treatment status. The primary outcome was a reduction in emergency department presentations. Secondary outcomes were time spent on chemotherapy and the number of allied health service referrals.

Results

From April 2016 to October 2018, 328 patients from four public hospitals received the intervention. Matched controls (n=1312) comprised the general population of patients with cancer, seen at the participating hospitals during the study period. Emergency department visits were significantly reduced by 33% (P=.02) among patients receiving the intervention compared with patients in the matched controls. No significant associations were found in allied health referrals or time to end of chemotherapy. At baseline, the most common patient reported outcomes (above-threshold) were fatigue (39%), tiredness (38.4%), worry (32.9%), general wellbeing (32.9%), and sleep (24.1%), aligning with the most frequently accessed self-management domain pages of physical well-being (36%) and emotional well-being (23%). The majority of clinical feedback reports were reviewed by nursing staff (729/893, 82%), largely in response to the automated clinical alerts (n=877).

Conclusions

Algorithm-supported web-based systems utilizing patient reported outcomes in clinical practice reduced emergency department presentations among a diverse population of patients with cancer. This study also highlighted the importance of (1) automated triggers for reviewing above-threshold results in patient reports, rather than passive manual review of patient records; (2) the instrumental role nurses play in managing alerts; and (3) providing patients with resources to support guided self-management, where appropriate. Together, these factors will inform the integration of web-based PRO systems into future models of routine cancer care.

Trial Registration

Australian New Zealand Clinical Trials Registry ACTRN12616000615482; https://www.anzctr.org.au/Trial/Registration/TrialReview.aspx?id=370633

International Registered Report Identifier (IRRID)

RR2-10.1186/s12885-018-4729-3

The utility of the implementation science framework "Integrated Promoting Action on Research Implementation in Health Services" (i-PARIHS) and the facilitator role for introducing patient-reported outcome measures (PROMs) in a medical oncology outpatient department

PURPOSE

We evaluated the utility of the implementation science framework "Integrated Promoting Action on Research Implementation in Health Services" (i-PARIHS) for introducing patient-reported outcome measures (PROMs) into a medical oncology outpatient department. The i-PARIHS framework identifies four core constructs for implementation, including Facilitation, Innovation, Context and Recipients.

METHODS

A pilot study used the i-PARIHS framework to identify PROM implementation barriers and enablers to inform facilitation support strategies, such as training clinicians and staff, workflow support, technical support and audit and feedback. Pre- and post-implementation surveys were completed by 83 and 72 staff, respectively, (nurses, doctors and allied health), to assess perceived knowledge, enablers, barriers and utility of PROMs; and acceptability of the PROM intervention was also assessed post-implementation.

RESULTS

Important barriers included time constraints and previous experiences with technology. Enablers included good leadership support and a culture of learning. Facilitation strategies were used to overcome barriers identified in the i-PARIHS core domains. Compared to before the intervention, staff surveys showed improvement in perceived usefulness, perceived understanding and interpretation skills for PROMs. Staff perceptions about lack of time to use PROMs during visits remained a major perceived barrier post-implementation.

CONCLUSION

The i-PARIHS framework was useful for guiding the implementation of PROMs in routine oncology care. The four core i-PARIHS constructs (Facilitation, Innovation, Context and Recipients) identified factors that directly impacted implementation, with Facilitation having a particularly important role to overcome these barriers. Oncology clinics and health systems considering implementing PROMs should consider having a dedicated Facilitator available during PROM implementation.

Can post-treatment oral cancer patients' concerns reflect their cancer characteristics, HRQoL, psychological distress level and satisfaction with consultation?

Background

Oral cancer and its treatment impact patients' post-treatment outcomes, challenging clinicians to manage them optimally. Addressing patients' concerns is central to holistic patient-centred care.

Objectives

This study aimed to determine post-treatment oral cancer patients' concerns and its relationship with patients' clinical characteristics, health-related quality of life (HRQoL), psychological distress and patient satisfaction with the follow-up consultation.

Methods

A total of 85 oral cancer patients were recruited from a three-armed pragmatic RCT study on the patient concerns inventory for head and neck cancer (PCI-H&N), which was conducted at six hospital-based oral maxillofacial specialist clinics throughout Malaysia. Malaysians aged 18 years and above and on follow-ups from 1 month to 5 years or more were eligible. Patients completed the PCI-H&N, functional assessment of cancer therapy -H&N v4.0 and Distress Thermometer at pre-consultation and satisfaction questionnaire at post-consultation. The data were analysed descriptively; multiple linear regression and multivariate logistic regression analyses were used to determine possible predictors of patients' HRQoL and psychological distress.

Results

'Recurrence or fear of cancer coming back' (31.8%) was most frequently selected. 43.5% of patients selected ≥4 concerns. A significantly high number of concerns were associated with patients of '1-month to 1-year post-treatment' (n = 84%; p = 0.001). A significant association existed between 'time after treatment completed' and patients' concerns of 'chewing/eating', 'mouth opening', 'swelling', 'weight', 'ability to perform', 'cancer treatment' and 'supplement/diet-related'. 'Chewing/eating' was predicted for low HRQoL (p < 0.0001) followed by 'appearance' and 'ability to perform recreation activities' (personal functions domain). Patients with high psychological distress levels were 14 times more likely to select 'ability to perform recreation activities' and seven times more likely to select 'feeling depressed'. No significant association was identified between patients' concerns and patients' satisfaction with the consultation.

Conclusion

Routine follow-up consultations should incorporate the PCI-H&N prompt list to enhance patient-centred care approach as the type and number of patients' concerns are shown to reflect their HRQoL and psychological distress.TRIAL REGISTRATION: NMRR-18-3624-45010 (IIR).

How do third sector organisations or charities providing health and well-being services in England implement patient-reported outcome measures (PROMs)? A qualitative interview study

OBJECTIVES

To identify the facilitators and barriers to implementing patient-reported outcome measures (PROMs) in third sector organisations (TSOs) delivering health and well-being services.

DESIGN

A qualitative interview study. Participants were recruited using purposive, opportunistic and snowballing methods. Framework analysis was used.

SETTING

TSOs including charities, community groups and not-for-profit organisations in England, UK.

PARTICIPANTS

Thirty interviewees including service users, TSO front-line workers and managers, commissioners of TSOs and other stakeholders such as academic researchers.

RESULTS

TSOs primarily used PROMs because of pressures arising from the external funding context. However, organisations often struggled to implement PROMs, rarely getting the process right first time. Facilitators for implementation included having an implementation lead committed to making it work, investing resources in data management systems and support staff and taking a collaborative approach to designing the PROMs process. The latter helped to ensure an appropriate PROMs process for the specific TSO including choosing a suitable measure and planning how data would be collected, processed and used. There was a dilemma about whether TSOs should use standardised well-being measures (eg, the Warwick-Edinburgh Mental Well-being Scale) or design their own PROM. Not all TSOs sustained the collection and reporting of PROMs over time because this required a change in organisational culture to view PROMs as beneficial for the TSO and PROMs becoming part of front-line workers' job specifications.

CONCLUSIONS

TSOs are trying to use PROMs because they feel they have no choice but often struggle with implementation. Having an implementation lead, designing an appropriate process, investing resources, training staff and taking mitigating action to address potential barriers can facilitate implementation. Some of the findings are consistent with the experiences of more clinical services so appear relevant to the implementation of PROMs irrespective of the specific context.

Implementing models of care for musculoskeletal conditions in health systems to support value-based care

Models of Care (MoCs), and their local Models of Service Delivery, for people with musculoskeletal conditions are becoming an acceptable way of supporting effective implementation of value-based care. MoCs can support the quadruple aim of value-based care through providing people with musculoskeletal disease improved access to health services, better health outcomes and satisfactory experience of their healthcare; ensure the health professionals involved are experiencing satisfaction in delivering such care and health system resources are better utilised. Implementation of MoCs is relevant at the levels of clinical practice (micro), service delivery organisations (meso) and health system (macro) levels. The development, implementation and evaluation of MoCs has evolved over the last decade to more purposively engage people with lived experience of their condition, to operationalise the Chronic Care Model and to employ innovative solutions. This paper explores how MoCs have evolved and are supporting the delivery of value-based care in health systems.