The impact of electronic versus paper-based data capture on data collection logistics and on missing scores in thyroid cancer patients

PURPOSE

The purpose of this study was to investigate the impact of the type of data capture on the time and help needed for collecting patient-reported outcomes as well as on the proportion of missing scores.

METHODS

In a multinational prospective study, thyroid cancer patients from 17 countries completed a validated questionnaire measuring quality of life. Electronic data capture was compared to the paper-based approach using multivariate logistic regression.

RESULTS

A total of 437 patients were included, of whom 13% used electronic data capture. The relation between data capture and time needed was modified by the emotional functioning of the patients. Those with clinical impairments in that respect needed more time to complete the questionnaire when they used electronic data capture compared to paper and pencil (ORadj 24.0; p = 0.006). This was not the case when patients had sub-threshold emotional problems (ORadj 1.9; p = 0.48). The odds of having the researcher reading the questions out (instead of the patient doing this themselves) (ORadj 0.1; p = 0.01) and of needing any help (ORadj 0.1; p = 0.01) were lower when electronic data capture was used. The proportion of missing scores was equivalent in both groups (ORadj 0.4, p = 0.42).

CONCLUSIONS

The advantages of electronic data capture, such as real-time assessment and fewer data entry errors, may come at the price of more time required for data collection when the patients have mental health problems. As this is not uncommon in thyroid cancer, researchers need to choose the type of data capture wisely for their particular research question.

Pilot trial of an electronic patient-reported outcome monitoring system in patients with metastatic breast cancer undergoing chemotherapy

BACKGROUND

Electronic patient-reported outcomes monitoring (ePROM) is a useful communication tool for patients and healthcare providers in cancer chemotherapy. In this study, we examined the feasibility of our newly developed ePROM system, which we refer to as "Hibilog".

METHODS

An ePROM app was developed by extracting 18 items from the Patient-Reported Outcome-Common Terminology Criteria for Adverse Events (PRO-CTCAE). Symptom monitoring was conducted every two weeks for patients with metastatic breast cancer undergoing chemotherapy. The primary outcome was the response rate to the ePROM system. The secondary outcomes were response time, item missing rate, and distribution of responses for each symptom.

RESULTS

A total of 71 cases (mean age 52.6 years) were analyzed. Performance status was 0 in 76% of the cases and 1 or higher in 24%. First-line treatment was being administered in 30% of cases, second-line treatment in 17%, and third-line or higher treatment in 53%. The response rate to the ePROM system from registration to week 40 remained high at around 80%, indicating good compliance. The average response time was 5.5 min and the missing rate for each item was below 0.4%. Among 1,093 responses, the top 3 symptoms causing interference with daily life were Fatigue (63%), Numbness and tingling (48%), and General pain (46%).

CONCLUSION

Our developed ePROM system was able to capture symptoms accurately in patients with metastatic breast cancer undergoing chemotherapy while maintaining a high response compliance.

The effectiveness of symptom management interventions based on electronic patient-reported outcomes (ePROs) for symptom burden, quality of life, and overall survival among patients with cancer: A meta-analysis of randomized controlled trials

OBJECTIVE

To explore the effectiveness of ePRO-based symptom management interventions on symptom burden, quality of life, and overall survival among patients with cancer for the first time and to explore the effects of different types of these interventions.

BACKGROUND

Since advances in screening and treatment have transformed cancer into a chronic illness rather than a fatal disease, symptom management has become increasingly critical in oncology nursing. In recent decades, ePROs have been increasingly used in the symptom management of cancer patients to improve their symptom burden, quality of life and overall survival, but the existing findings are still inconsistent and equivocal.

METHODS

A literature search was conducted in PubMed, Web-of-Science, CENTRAL, and CINAHL-Plus-with-Full-Text from inception to January 31, 2023. The quality of methodology and evidence were evaluated by the revised Cochrane risk-of-bias tool and the Grading of Recommendations, Assessment, Development, and Evaluation framework. All data were analyzed using R within the RStudio platform, and the effects of interventions were determined by calculating SMD, HR and 95 %CI. Subgroup analysis, sensitivity analysis and cumulative meta-analysis were performed, and statistical heterogeneity was examined by I2 statistic, P value, and Egger's or arcsine test. Statistical significance was defined as a two-tailed P value <0.05.

RESULTS

A total of 23 randomized controlled trials with 7231 patients were included. The results indicated that ePRO-based symptom management interventions could improve the symptom burden (SMD = -0.19, 95 % CI [-0.33, -0.05], P < 0.01), quality of life (SMD = 0.16, 95 % CI [0.06, 0.25], P < 0.01) and overall survival (HR = 0.84, 95 % CI [0.73, 0.97], P = 0.02) of cancer patients. Subgroup analysis showed that targeted interventions for patients undergoing specific treatments were effective in relieving the symptom burden and enhancing quality of life. Short-term (≤3 months) interventions or reporting via telephone call contributed to alleviating the symptom burden, while quality of life improved when the intervention was more than three months in duration or not reported by telephone call. The pooled results of symptom burden and quality of life were stable, and the beneficial trends of all three outcomes were steady. The overall quality of methodology and evidence was moderate.

CONCLUSIONS

We found that ePRO-based symptom management interventions are conducive to improving symptom burden, quality of life, and overall survival of cancer patients. In addition to encouraging the integration of ePRO-based interventions into routine oncology care, interventions with tailored plans, proper intensity and multidimensional supports need to be developed in the future to optimize the symptom management of cancer patients.

REGISTRATION

CRD42023393330.

Measuring symptom burden in patients with cancer during a pandemic: the MD Anderson symptom inventory for COVID-19 (MDASI-COVID)

BACKGROUND

Symptom expression in SARS-CoV-2 infection (COVID-19) may affect patients already symptomatic with cancer. Patient-reported outcomes (PROs) can describe symptom burden during the acute and postacute stages of COVID-19 and support risk stratification for levels of care. At the start of the COVID-19 pandemic, our purpose was to rapidly develop, launch through an electronic patient portal, and provide initial validation for a PRO measure of COVID-19 symptom burden in patients with cancer.

METHODS

We conducted a CDC/WHO web-based scan for COVID-19 symptoms and a relevance review of symptoms by an expert panel of clinicians treating cancer patients with COVID-19 to create a provisional MD Anderson Symptom Inventory for COVID-19 (MDASI-COVID). English-speaking adults with cancer who tested positive for COVID-19 participated in the psychometric testing phase. Patients completed longitudinal assessments of the MDASI-COVID and the EuroQOL 5 Dimensions 5 Levels (EQ-5D-5L) utility index and visual analog scale, which were presented through an electronic health record patient portal. To test the validity of the MDASI-COVID to distinguish between known groups of patients, we hypothesized that patients hospitalized, including having a hospitalization extended, for COVID-19 versus those not hospitalized would experience higher symptom burden. Correlation of mean symptom severity and interference scores with relevant EQ-5D-5L scores tested concurrent validity. The reliability of the MDASI-COVID was evaluated by calculating Cronbach alpha coefficients and test-retest reliability was evaluated by calculating Pearson correlation coefficients between the initial assessment and a second assessment no more than 14 days later.

RESULTS

The web-based scan found 31 COVID-19-related symptoms; rankings of a 14-clinician expert panel reduced this list to 11 COVID-specific items to be added to the core MDASI. Time from literature scan start in March 2020 to instrument launch in May 2020 was 2 months. Psychometric analysis established the MDASI-COVID's reliability, known-group validity, and concurrent validity.

CONCLUSIONS

We were able to rapidly develop and electronically launch a PRO measure of COVID-19 symptom burden in patients with cancer. Additional research is needed to confirm the content domain and predictive validity of the MDASI-COVID and define the symptom burden trajectory of COVID-19.

Facilitators and barriers to adhere to monitoring disease activity with ePROs: a focus group study in patients with inflammatory arthritis

Telemonitoring disease activity with electronic patient-reported outcomes (ePROs) may reduce the workload of rheumatic care by decreasing outpatient clinic visits. However, low adherence to reporting ePROs is frequently observed. Our objective was to identify facilitators and barriers to weekly monitoring of disease activity with ePROs. Patients with rheumatoid arthritis (RA), psoriatic arthritis (PsA), or ankylosing spondylitis (AS) who recently participated in one of the two telemonitoring studies with ePROs completed in a smartphone app, were invited to participate in focus group discussions (FGD). Thematic analysis was used to identify themes that play a role in the decision to continue or stop reporting weekly ePROs. A total of 22 patients participated in three FGDs. Five themes were identified that were of importance to adhere to telemonitoring: (1) questionnaire frequency, (2) discussing results of completed ePROs, (3) physical consultations, (4) patient insight into disease activity and (5) user experience of the app. All themes contained both barrier and facilitator elements. The results suggest that to improve adherence to telemonitoring of disease activity with ePROs, the perceived benefits of completing ePROs should be maximized. This can be done by providing patients the ability to skip (unneeded) physical consultations in case of low disease activity, and training clinicians to always discuss the completed ePROs. In addition, it is essential to reduce the effort to report ePROs, by tailoring the frequency of ePROs based on the patients' disease activity or preference, aiming for optimal app functionality as well as by sending notifications when new ePROs are available.

Usability and acceptability of the electronic self-assessment and care (eSAC) program in advanced ovarian cancer: A mixed methods study

OBJECTIVE

To determine usability and acceptability of the electronic self-assessment and care (eSAC) web-based, patient reported outcome (PRO) program for people with advanced ovarian cancer.

METHODS

Patient participants recruited from a single ambulatory site were prompted by email to answer symptom/quality of life items prior to each clinic visit. Patient participant acceptability was measured with the Acceptability E-Scale Score (AES). Usability was measured among a subset of patient participants using semi-structured interviews. Clinician participant acceptability and usability were measured via survey and semi-structured interviews. Quantitative data were analyzed with descriptive statistics. Qualitative data were analyzed using thematic content analysis. A mixed methods analysis was performed.

RESULTS

Of 163 eligible patients approached, 143 (87.7%) provided written consent. Patient participants (n = 71) who created an eSAC report prior to at least 3 clinic visits, rated eSAC as acceptable with a mean AES score of 26.19 ± 3.36 (out of 30). Interview data from patient participants (n = 33) revealed that eSAC was easy to use and important to the clinic visit conversation. Data from clinician surveys (n = 8) and focus groups (n = 3) revealed that the eSAC program was acceptable and useful for clinicians. Qualitative analysis suggested process improvements from patients and clinicians for effectiveness in the advanced ovarian cancer setting. Mixed methods analysis demonstrated no major discrepancies between quantitative and qualitative findings, with the qualitative data broadening understanding of quantitative ratings.

CONCLUSION

eSAC was useful and acceptable in this setting. This PRO is a promising strategy for enhancing patient-centered care for people with advanced ovarian cancer.

Electronic patient-reported monitoring of symptoms during follow-up of ovarian cancer patients: a feasibility study

Background

Ovarian cancer patients require monitoring for relapse. Innovative follow-up methods are increasingly being explored. An electronic patient-reported outcome (ePRO) follow-up pathway was developed for women treated for ovarian cancer. This feasibility study explored patient acceptability and compliance.

Methods

A single-arm non-blinded prospective feasibility study was undertaken at two hospitals. Participants were women who had completed treatment for ovarian cancer whose clinician was happy for them to be monitored remotely. Automated 3-monthly reminders were sent to participants to complete an ePRO questionnaire and obtain blood tests. Participants were reviewed over the phone by their clinical nurse specialist instead of attending clinic-based follow-up. The primary outcome was compliance (expected ePRO completions/blood tests) across the 12-month study period. Secondary outcomes were recruitment, attrition, resource use, symptom severity/alerts and patient acceptability.

Results

Twenty-four women consented (50% consent rate), and 13 remained on study at 12 months. Seven women relapsed, 3 chose to withdraw, and 1 withdrew for other clinical reasons. ePRO compliance was high and consistent at 75-82%, although the two hospitals differed. Adherence to the clinical protocol was evident for blood tests and contacts with staff (fewer visits, more phonecalls compared to an earlier audit). End-of-study feedback indicated high patient satisfaction.

Conclusions

Remote ePRO follow-up for ovarian cancer is feasible and acceptable to patients who are able and willing to participate. However, the low recruitment rate (ineligible + declined) indicate it is not suitable/acceptable to all patients immediately post-treatment. Further large-scale research and implementation work is required, especially in a post-COVID era.

Trial registration

ClinicalTrials.gov ID: NCT02847715 (first registered 19/05/2016).

Supplementary Information

The online version contains supplementary material available at 10.1186/s12885-022-09817-5.

A narrative review of current evidence supporting the implementation of electronic patient-reported outcome measures in the management of chronic diseases

An application of telemedicine of growing interest and relevance is the use of personal computers and mobile devices to collect patient-reported outcomes (PROs). PROs are self-reports of patients' health status without interpretation by anyone else. The tools developed to assess PROs are known as patient-reported outcomes measures (PROMs). The technological innovations that have led to an increased ownership of electronic devices have also facilitated the development of electronic PROMs (ePROMs). ePROMs are a conduit for telemedicine in the care of patients with chronic diseases. Various studies have demonstrated that the use of ePROMs in routine clinical practice is both acceptable and feasible with patients increasingly expressing a preference for an electronic mode of administration. There is increasing evidence that the use of electronic patient-reported outcome (ePROMs) could have significant impacts on outcomes valued by patients, healthcare providers and researchers. Whilst the development and implementation of these systems may be initially costly and resource-intensive, patient preferences and existing evidence to support their implementation suggests the need for continued research prioritisation in this area. This narrative review summarises and discusses evidence of the impact of ePROMs on clinical parameters and outcomes relevant to chronic diseases. We also explore recently published literature regarding issues that may influence the robust implementation of ePROMs for routine clinical practice.

Patient experiences of an electronic PRO tailored feedback system for symptom management following upper gastrointestinal cancer surgery

Purpose

Complications following upper gastrointestinal (UGI) surgery are common. Symptom-monitoring following discharge is not standardized. An electronic patient-reported outcome (ePRO) system providing feedback to patients and clinicians could support patients and improve outcomes. Little is known about patients’ experiences of using such systems. This qualitative sub-study explored patients’ perspectives of the benefits of using a novel ePRO system, developed as part of the mixed methods eRAPID pilot study, to support recovery following discharge after UGI surgery.

Methods

Patients completed the online ePRO symptom-report system post-discharge. Weekly interviews explored patients’ experiences of using ePRO, the acceptability of feedback generated and its value for supporting their recovery. Interviews were audio-recorded and targeted transcriptions were thematically analysed.

Results

Thirty-five interviews with 16 participants (11 men, mean age 63 years) were analysed. Two main themes were identified: (1) reassurance and (2) empowerment. Feelings of isolation were common; many patients felt uninformed regarding their expectations of recovery and whether their symptoms warranted clinical investigation. Participants were reassured by tailored feedback advising them to contact their care team, alleviating their anxiety. Patients reported feeling empowered by the ePRO system and in control of their symptoms and recovery.

Conclusion

Patients recovering at home following major cancer surgery regarded electronic symptom-monitoring and feedback as acceptable and beneficial. Patients perceived that the system enhanced information provision and provided a direct link to their care team. Patients felt that the system provided reassurance at a time of uncertainty and isolation, enabling them to feel in control of their symptoms and recovery.

Electronic supplementary material

The online version of this article (10.1007/s11136-020-02539-w) contains supplementary material, which is available to authorised users.

Racial differences in user experiences and perceived value of electronic symptom monitoring in a cohort of black and white bladder and prostate cancer patients

PURPOSE

Electronic patient-reported outcomes (ePROs) are increasingly being used for symptom monitoring during routine cancer care, but have rarely been evaluated in diverse patient populations. We assessed ePRO user experiences and perceived value among Black and White cancer patients.

METHODS

We recruited 30 Black and 49 White bladder and prostate cancer patients from a single institution. Participants reported symptoms using either a web-based or automated telephone interface over 3 months and completed satisfaction surveys and qualitative interviews focused on user experiences and value. Using a narrative mixed methods approach, we evaluated overall and race-specific differences in ePRO user experiences and perceived value.

RESULTS

Most participants selected the web-based system, but Blacks were more likely to use the automated telephone-based system than Whites. In satisfaction surveys, Whites more commonly reported ease in understanding and reporting symptoms compared with Blacks. Blacks more often reported that the ePRO system was helpful in facilitating symptom-related discussions with clinicians. During interviews, Blacks described how the ePRO helped them recognize symptoms, while Whites found value in better understanding and tracking symptoms longitudinally. Blacks also expressed preferences for paper-based ePRO options due to perceived ease in better understanding of symptom items.

CONCLUSION

Electronic patient-reported outcomes are perceived as valuable for variable reasons by Black and White cancer populations, with greater perceived value for communicating with clinicians reported among Blacks. To optimize equitable uptake of ePROs, oncology practices should offer several ePRO options (e.g., web-based, phone-based), as well as paper-based options, and consider the e-health literacy needs of patients during implementation.

Collection of electronic patient-reported symptoms in patients with advanced cancer using Epic MyChart surveys

BACKGROUND

Use of electronic patient-reported outcomes (ePROs) in routine cancer care can help identify troublesome symptoms and facilitate discussions between patients and clinicians and has been shown to improve patient satisfaction, quality of life, and survival.

METHODS

Eighty patients with stage IV non-hematologic malignancies on chemotherapy participated. Patient-Reported Symptom Monitoring (PRSM) surveys were sent every 14 days via the Epic MyChart system over a 12-week period. Surveys were offered via phone or paper if patients failed to complete the automated MyChart survey by day 16. Severe symptoms or concerning symptom trends were automatically highlighted in reports for clinic staff. Patients reporting severe symptoms were routed to oncology nursing triage for standard symptom care management.

RESULTS

Two hundred seventy-one surveys were sent during the 12-week study period. One hundred eighty-three surveys (66%) were completed, with 68% completed electronically via MyChart, 25% by paper, and 7% by phone call from a research coordinator. At least one severe symptom was reported on 36% of all surveys. However, most severe symptoms did not result in urgent triage follow-up because they were already being addressed and/or patients felt they were manageable. Patients and clinicians generally said the ePRO was efficient and helpful for addressing distressing symptoms and would use it in routine oncology care.

CONCLUSION

ePROs can be integrated into the electronic health record using the Epic MyChart system. Patients and clinicians gave positive feedback on the system. Monitoring symptoms in real time may soon become part of standard oncology practice and requires seamless methods for collection.

Key methodological considerations for usability testing of electronic patient-reported outcome (ePRO) systems

Introduction

Recent advances in information technology and improved access to the internet have led to a rapid increase in the adoption and ownership of electronic devices such as touch screen smartphones and tablet computers. This has also led to a renewed interest in the field of digital health also referred to as telehealth or electronic health (eHealth). There is now a drive to collect these PROs electronically using ePRO systems.

Method

However, the user interfaces of ePRO systems need to be adequately assessed to ensure they are not only fit for purpose but also acceptable to patients who are the end users. Usability testing is a technique that involves the testing of systems, products or websites with participants drawn from the target population. Usability testing can assist ePRO developers in the evaluation of ePRO user interface. The complexity of ePRO systems; stage of development; metrics to measure; and the use of scenarios, moderators and appropriate sample sizes are key methodological issues to consider when planning usability tests.

Conclusion

The findings from usability testing may facilitate the improvement of ePRO systems making them more usable and acceptable to end users. This may in turn improve the adoption of ePRO systems post-implementation. This article highlights the key methodological issues to consider and address when planning usability testing of ePRO systems.

Usability testing of EirV3-a computer-based tool for patient-reported outcome measures in cancer

PURPOSE

Eir version 3 (V3) is an electronic tool for administration of patient-reported outcome measures (Eir-Patient) that immediately presents patient scores on the physician's computer (Eir-Doctor). Perceived usability is an important determinant for successful implementation. The aim of this study was to answer the following research question evaluated at the cancer outpatient clinics, in the patients' home, and at general practitioners' (GPs) offices: What are the number, type, and severity of usability issues evaluated by the patient (Eir-Patient module) and by the physician (Eir-Doctor module)?

METHODS

A usability evaluation using observations, think-aloud sessions, individual interviews and focus group interviews in cancer patients and their physicians was conducted. Identified usability issues were graded on a severity scale from 1 (irritant) to 4 (unusable).

RESULTS

Overall, 73 Eir registrations were performed by 37 patients, and used by 17 physicians in clinical consultations. All patients were able to complete the Eir-Patient symptom registration. Seventy-two usability issues were identified. None of them were graded as unusable. For the Eir-Patient module, 62% of the identified usability issues was graded as irritant (grade 1), 18% as moderate (grade 2), and 20% as severe (grade 3). For the Eir-Doctor module, 46% of the identified usability issues were graded as irritant, 36% as moderate and 18% as severe.

CONCLUSIONS

In the updated Eir version, issues in the severe and moderate categories have been changed, to optimize the usability of using real-time PROMs in clinical practice.

Implementation of the Kids-CAT in clinical settings: a newly developed computer-adaptive test to facilitate the assessment of patient-reported outcomes of children and adolescents in clinical practice in Germany

PURPOSE

To describe the implementation process of a computer-adaptive test (CAT) for measuring health-related quality of life (HRQoL) of children and adolescents in two pediatric clinics in Germany. The study focuses on the feasibility and user experience with the Kids-CAT, particularly the patients' experience with the tool and the pediatricians' experience with the Kids-CAT Report.

METHODS

The Kids-CAT was completed by 312 children and adolescents with asthma, diabetes or rheumatoid arthritis. The test was applied during four clinical visits over a 1-year period. A feedback report with the test results was made available to the pediatricians. To assess both feasibility and acceptability, a multimethod research design was used. To assess the patients' experience with the tool, the children and adolescents completed a questionnaire. To assess the clinicians' experience, two focus groups were conducted with eight pediatricians.

RESULTS

The children and adolescents indicated that the Kids-CAT was easy to complete. All pediatricians reported that the Kids-CAT was straightforward and easy to understand and integrate into clinical practice; they also expressed that routine implementation of the tool would be desirable and that the report was a valuable source of information, facilitating the assessment of self-reported HRQoL of their patients.

CONCLUSIONS

The Kids-CAT was considered an efficient and valuable tool for assessing HRQoL in children and adolescents. The Kids-CAT Report promises to be a useful adjunct to standard clinical care with the potential to improve patient-physician communication, enabling pediatricians to evaluate and monitor their young patients' self-reported HRQoL.