Implementing successful systematic Patient Reported Outcome and Experience Measures (PROMs and PREMs) in robotic oncological surgery-The role of physicians

The role of patient-reported experiences in disclosing genetic prenatal testing: Findings from a large-scale survey on pregnant women

Introduction

Pregnant women can choose from different prenatal genetic tests throughout their maternity journey. We aim to investigate the clinical, societal, and economic determinants influencing the selection of different options (non-invasive, invasive, or both).

Methods

A systematic survey focusing on maternity pathways was launched by the Region of Tuscany, Italy, to collect data on pregnant women's experience, outcomes and satisfaction levels. Drawing from this survey, we retrospectively analyzed data on women who filled out the second-trimester questionnaire between March 2019 and February 2023 (n = 27,337), providing complete data on relevant variables. Logistic regression models were applied to identify the factors contributing to a higher likelihood of opting for non-invasive prenatal testing (NIPT) and invasive testing.

Results

Among the participants, 42.7 % chose only NIPT, 3.8 % opted for invasive tests exclusively, 1.3 % underwent both tests, and 52.2 % did not pursue any genetic testing. NIPT was more often chosen by older, Italian, highly educated, nulliparous women, who perceived better health, were employed (versus unemployed), had higher economic status, planned pregnancy, received hospital-based care (versus counseling center), under gynecologist supervision (versus midwife), not opted for combined testing and received pregnancy vaccinations. Conversely, invasive testing was more prevalent among older women but less common among those who were nulliparous, had Italian nationality, and had a perceived better health status. This group also tended to experience unplanned and high-risk pregnancy, did not take folate during pregnancy, received public hospital-based assistance, less frequently chose combined tests or NIPT, and had frequent delays in examinations.

Conclusions

Various factors beyond clinical considerations influence the selection of a prenatal test. Therefore, NIPT pathways should include balanced, high-quality information about benefits and limitations, ensuring laboratory specialists' active and integrated involvement in decision-making.

Usability of an Automated System for Real-Time Monitoring of Shared Decision-Making for Surgery: Mixed Methods Evaluation

BACKGROUND

Improving shared decision-making (SDM) for patients has become a health policy priority in many countries. Achieving high-quality SDM is particularly important for approximately 313 million surgical treatment decisions patients make globally every year. Large-scale monitoring of surgical patients' experience of SDM in real time is needed to identify the failings of SDM before surgery is performed. We developed a novel approach to automating real-time data collection using an electronic measurement system to address this. Examining usability will facilitate its optimization and wider implementation to inform interventions aimed at improving SDM.

OBJECTIVE

This study examined the usability of an electronic real-time measurement system to monitor surgical patients' experience of SDM. We aimed to evaluate the metrics and indicators relevant to system effectiveness, system efficiency, and user satisfaction.

METHODS

We performed a mixed methods usability evaluation using multiple participant cohorts. The measurement system was implemented in a large UK hospital to measure patients' experience of SDM electronically before surgery using 2 validated measures (CollaboRATE and SDM-Q-9). Quantitative data (collected between April 1 and December 31, 2021) provided measurement system metrics to assess system effectiveness and efficiency. We included adult patients booked for urgent and elective surgery across 7 specialties and excluded patients without the capacity to consent for medical procedures, those without access to an internet-enabled device, and those undergoing emergency or endoscopic procedures. Additional groups of service users (group 1: public members who had not engaged with the system; group 2: a subset of patients who completed the measurement system) completed user-testing sessions and semistructured interviews to assess system effectiveness and user satisfaction. We conducted quantitative data analysis using descriptive statistics and calculated the task completion rate and survey response rate (system effectiveness) as well as the task completion time, task efficiency, and relative efficiency (system efficiency). Qualitative thematic analysis identified indicators of and barriers to good usability (user satisfaction).

RESULTS

A total of 2254 completed surveys were returned to the measurement system. A total of 25 service users (group 1: n=9; group 2: n=16) participated in user-testing sessions and interviews. The task completion rate was high (169/171, 98.8%) and the survey response rate was good (2254/5794, 38.9%). The median task completion time was 3 (IQR 2-13) minutes, suggesting good system efficiency and effectiveness. The qualitative findings emphasized good user satisfaction. The identified themes suggested that the measurement system is acceptable, easy to use, and easy to access. Service users identified potential barriers and solutions to acceptability and ease of access.

CONCLUSIONS

A mixed methods evaluation of an electronic measurement system for automated, real-time monitoring of patients' experience of SDM showed that usability among patients was high. Future pilot work will optimize the system for wider implementation to ultimately inform intervention development to improve SDM.

INTERNATIONAL REGISTERED REPORT IDENTIFIER (IRRID)

RR2-10.1136/bmjopen-2023-079155.

Including patient-reported measures in performance evaluation systems: Patient contribution in assessing and improving the healthcare systems

In healthcare, the introduction of quality standards and indicators to assess performance triggered the development of multidimensional Performance Management Systems (PMSs). The concept of performance in healthcare has recently evolved and broadened its scope. One of the current challenges of PMSs is measuring and integrating the patient perspective into traditional measures. In the regional healthcare system of Tuscany (Italy), a PMS has been implemented and used since 2005. The PMS counts on the systematic involvement of clinicians and managers. Furthermore, the PMS also includes patients' perspective. Moreover, Tuscany has recently implemented the first regional permanent Patient-Reported Outcome and Experience Measures (PROMs and PREMs) Observatory in Italy. This paper presents the results of an action research aimed at analysing the integration of patient-reported outcome and experience indicators into a consolidated PMS. The study describes the process of identifying and discussing of patient-reported indicators with practitioners and categorising findings into three domains: design of patient-reported indicators, integration process into the PMS, and goal of adoption of the patient-related indicators. The paper also describes facilitators, challenges, and lessons learnt with respect to organisational, methodological, cultural, and responsibility-linked factors. The study discusses the ability to agree on how to transform patient data, especially PROMs, into effective performance indicators. The integration of patient-reported indicators into the PMS poses two main challenges: one in terms of sustainability of the performance system itself, and another regarding the attribution of the responsibility for patient outcomes between care settings and providers. This paper provides initial insights on how the integration of patient-reported indicators can make PMSs more inclusive and focussed on the patient-centred perspective.

A longitudinal assessment of chronic care pathways in real-life: self-care and outcomes of chronic heart failure patients in Tuscany

BACKGROUND

Worldwide healthcare systems face challenges in assessing and monitoring chronic care pathways and, even more, the value generated for patients. Patient-reported outcomes measures (PROMs) represent a valid Real-World Evidence (RWE) source to fully assess health systems' performance in managing chronic care pathways.

METHODS

The originality of the study consists in the chance of adopting PROMs, as a longitudinal assessment tool for continuous monitoring of patients' adherence to therapies and self-care behavior recommendations in clinical practice and as a chance to provide policy makers insights to improve chronic pathways adopting a patient perspective. The focus was on PROMs of patients with chronic heart failure (CHF) collected in the Gabriele Monasterio Tuscan Foundation (FTGM), a tertiary referral CHF centre in Pisa, Italy. During the hospital stay, CHF patients were enrolled and received a link (via SMS or email) to access to the first questionnaire. Follow-up questionnaires were sent 1, 7 and 12 months after the index hospitalisation. Professionals invited 200 patients to participate to PROMs surveys. 174 answers were digitally collected at baseline from 2018 to 2020 and analysed. Quantitative and qualitative analyses were conducted, using Chi2, t-tests and regression models together with narrative evidence from free text responses.

RESULTS

Both quantitative and qualitative results showed FTGM patients declared to strongly adhere to the pharmacological therapy across the entire pathway, while seemed less careful to adhere to self-care behavior recommendations (e.g., physical activity). CHF patients that performed adequate Self-Care Maintenance registered outcome improvements. Respondents declared to be supported by family members in managing their adherence.

CONCLUSIONS

The features of such PROMs collection model are relevant for researchers, policymakers and for managers to implement interventions aimed at improving pathway adherence dimensions. Among those, behavioral economics interventions could be implemented to increase physical activity among CHF patients since proven successful in Tuscany. Strategies to increase territorial care and support patients' caregivers in their daily support to patients' adherence should be further explored. Systematic PROMs collection would allow to monitor changes in the whole pathway organization. This study brings opportunities for extending such monitoring systems to other organizations to allow for reliable benchmarking opportunities.

Collection and Utilization of Patient-Reported Outcome Measures in a Colorectal Surgery Clinic

INTRODUCTION

The routine collection of patient-reported outcome measures (PROMs) promises to improve patient care. However, in colorectal surgery, PROMs are uncommonly collected outside of clinical research studies and rarely used in clinical care. We designed and implemented a quality improvement project with the goals of routinely collecting PROMs and increasing the frequency that PROMs are utilized by colorectal surgeons in clinical practice.

METHODS

This mixed-methods, quality improvement project was conducted in the colorectal surgery clinic of a tertiary academic medical center. Patients were administered up to five PROMs before each appointment. PROM completion rates were measured. Additionally, we performed two educational interventions to increase utilization of our electronic health record's PROM dashboard by colorectal surgeons. Utilization rates and attitudes toward the PROM dashboard were measured.

RESULTS

Overall, patients completed 3600 of 3977 (90.9%) administered PROMs during the study period. At baseline, colorectal surgeons reviewed 6.7% of completed PROMs. After two educational interventions, this increased to 39.3% (P = 0.004). Colorectal surgeons also felt that the PROM dashboard was easier to use. Barriers to greater PROM dashboard utilization included poor user interface/user experience and a perceived lack of knowledge, time, and relevance.

CONCLUSIONS

The collection of PROMs in colorectal surgery clinics is feasible and can result in high PROM completion rates. Educational interventions can improve the utilization of PROMs by colorectal surgeons in clinical practice. Our experience collecting PROMs through this quality improvement initiative can serve as a template for other colorectal surgery clinics interested in collecting and utilizing data from PROMs.

A continuous PREMs and PROMs Observatory for elective hip and knee arthroplasty: study protocol

INTRODUCTION

Scholars, healthcare practitioners and policymakers have increasingly focused their attention on patient-centredness. Patient-reported metrics support patient-driven improvement actions in healthcare systems. Despite the great interest, patient-reported outcome measures (PROMs) are still not extensively collected in many countries and not integrated with the collection of patient-reported experience measures (PREMs). This protocol describes the methodology behind an innovative observatory implemented in Tuscany, Italy, aiming at continuously and longitudinally collecting PROMs and PREMs for elective hip and knee total replacement.

METHODS AND ANALYSIS

The Observatory is digital. Enrolled patients are invited via SMS or email to online questionnaires, which include the Oxford Hip Score or the Oxford Knee Score. Data are real-time reported to healthcare professionals and managers in a raw format, anonymised and aggregated on a web platform. The data will be used to investigate the relationship between the PROMs trend and patients' characteristics, surgical procedure, hospital characteristics, and PREMs. Indicators using patient data will be computed, and they will integrate the healthcare performance evaluation system adopted in Tuscany.

ETHICS AND DISSEMINATION

The data protection officers of local healthcare organisations and the regional privacy office framed the initiative referring to the national and regional guidelines that regulate patient surveys. The findings will be reported both in real time and for publication in peer-reviewed journals.

Protocol for implementation of the 'AusPROM' recommendations for elective surgery patients: a mixed-methods cohort study

INTRODUCTION

Incorporating patient-reported outcome measures (PROMs) into usual care in hospitals can improve safety and quality. Gaps exist in electronic PROM (ePROM) implementation recommendations, including for elective surgery. The aims are to: (1) understand barriers and enablers to ePROM implementation in hospitals and develop Australian ePROM implementation recommendations (AusPROM); (2) test the feasibility and acceptability of the Quality of Recovery 15 item short-form (QoR-15) PROM for elective surgery patients applying the AusPROM and (3) establish if the QoR-15 PROM has concurrent validity with the EQ-5D-5L.

METHODS AND ANALYSIS

Phase I will identify staff barriers and facilitators for the implementation of the AusPROM recommendations using a Delphi technique. Phase II will determine QoR-15 acceptability for elective surgery patients across four pilot hospitals, using the AusPROM recommendations. For phase II, in addition to a consumer focus group, patients will complete brief acceptability surveys, incorporating the QoR-15, in the week prior to surgery, in the week following surgery and 4 weeks postsurgery. The primary endpoint will be 4 weeks postsurgery. Phase III will be the national implementation of the AusPROM (29 hospitals) and the concurrent validity of the QoR-15 and generic EQ-5D-5L. This protocol adopts the Guidelines for Inclusion of Patient-Reported Outcomes in Clinical Trials Protocols guidelines.

ETHICS AND DISSEMINATION

The results will be disseminated via public forums, conferences and peer-reviewed journals. Ethics approval: La Trobe University (HEC20479).

TRIAL REGISTRATION NUMBER

ACTRN12621000298819 (Phase I and II) and ACTRN12621000969864 (Phase III).

Adjusted Indirect and Mixed Comparisons of Interventions for the Patient-Reported Outcomes Measures (PROMs) of Disabled Adults: A Systematic Review and Network Meta-Analysis

This systematic review adopted the Preferred Reporting Items for Systematic Reviews and Meta-Analyses Statement (PRISMA) guidelines and used the method of network meta-analysis to compare the effects of different types of interventions from different perspectives which were abilities of daily life activity, psychological health, social functioning, and overall life quality. The eligibility criteria were: (1) Participants were adults above 18 years old with disabilities; (2) Interventions could be classified into active exercise, passive therapy, psychological education, psychosocial support program, multi-disciplinary program, and usual care; (3) Outcomes should be the patient-reported outcome measures (PROMs) that could be classified into abilities of daily life activity, psychological health, social functioning, and overall life quality; (4) Randomized designed and published in English. The keywords and their search field were: (1) “people with disabilities/disability”, “disabled”, “handicapped”, or “disable people” in titles or abstracts; (2) AND “randomized” or “randomised” in titles or abstracts; (3) NOT “design”, “protocol”, or “review” in titles. After searching in databases of Medline (EBSCO), PubMed, CINAHL, and Ovid, 16 studies were included. As a result, active exercise and passive therapy are most likely to be the best interventions for overall life quality, psychological education and passive therapy are most likely to be the best interventions for abilities of daily life activity, and psychosocial support programs are most likely to be the best intervention for psychological health and social functioning.

Systematic and continuous collection of patient-reported outcomes and experience in women with cancer undergoing mastectomy and immediate breast reconstruction: a study protocol for the Tuscany Region (Italy)

INTRODUCTION

Monitoring how patients feel and what they experience during the care process gives health professionals data to improve the quality of care, and gives health systems information to better design and implement care pathways. To gain new insights about specific gaps and/or strengths in breast cancer care, we measure patient-reported outcomes (PROs) and patient-reported experiences (PREs) for women receiving immediate breast reconstruction (iBR).

METHODS AND ANALYSIS

Prospective, multicentre, cohort study with continuous and systematic web-based data collection from women diagnosed with breast cancer, who have an indication for iBR after mastectomy treated at any Breast Unit (BU) in Tuscany Region (Italy). Patients are classified into one of two groups under conditions of routine clinical practice, based on the type of iBR planned (implant and autologous reconstruction). Patient-reported information are obtained prior to and after surgery (at 3-month and 12-month follow-up). We estimate that there are around 700 annual eligible patients.Descriptive analyses are used to assess trends in PROs over time and differences between types of iBR in PROs and PREs. Additionally, econometric models are used to analyse patient and BU characteristics associated with outcomes and experiences. PREs are evaluated to assess aspects of integrated care along the care pathway.

ETHICS AND DISSEMINATION

The study has been reviewed and obtained a nihil obstat from the Tuscan Ethics Committees of the three Area Vasta in 2017. Dissemination of results will be via periodic report, journal articles and conference presentations.

The Being Taken Seriously Questionnaire-Development and Psychometric Evaluation of a PREM Measure for Person-Centeredness in a High-Tech Hospital Environment

There is a need for patient-reported experience measures (PREMs) in high-tech hospital environments based on the philosophy of person-centeredness. The aim of this study was to describe the development and initial psychometric evaluation of a measure of person-centeredness by means of being taking seriously. In this cross-sectional survey, the study sample (n = 79) completed two measures, the Being Taken Seriously Questionnaire—Patient version (BTSQ-P) which was the measure undergoing psychometric evaluation, and the Person-Centered Climate Questionnaire—Patient version (PCQ-P) that was used to evaluate the climate in which the intervention was occurring. The expected scale dimensionality was examined both by the confirmatory multi-trait analysis program and by explorative principal component analysis (with oblique, varimax rotation). Scale reliability was estimated using ordinal alpha and Cronbach’s alpha. One solid factor was generated. This factor had good internal convergent validity and good item–scale reliability, covering 80.41% of the variance. The interitem correlation ranged from 0.759 to 0.908 and the alpha was 0.93 (ordinal alpha) and 0.87 (Cronbach’s alpha) respectively. There was a strong relationship between BTSQ-P and the PCQ-P dimension safety climate. In conclusion, the internal consistency, reliability and concurrent validity of the BTSQ-P was satisfactory for use in a high-tech hospital environment.