Implementation and evaluation of an expanded electronic health record-integrated bilingual electronic symptom management program across a multi-site Comprehensive Cancer Center: The NU IMPACT protocol

Statistical analysis plan for the NU IMPACT stepped-wedge cluster randomized trial

BACKGROUND

As part of the IMPACT Consortium of three effectiveness-implementation trials, the NU IMPACT trial was designed to evaluate implementation and effectiveness outcomes for an electronic health record (EHR)-embedded symptom monitoring and management program for outpatient cancer care. NU IMPACT uses a unique stepped-wedge cluster randomized design, involving six clusters of 26 clinics, for evaluation of implementation outcomes with an embedded patient-level randomized trial to evaluate effectiveness outcomes. Collaborative, consortium-wide efforts to ensure use of the most robust and recent analytic methodologies for stepped-wedge trials motivated updates to the statistical analysis plan for implementation outcomes in the NU IMPACT trial.

METHODS

In the updated statistical analysis plan for NU IMPACT, the primary implementation outcome patient adoption, as measured by clinic-level monthly proportions of patient engagement with the EHR-based cancer symptom monitoring system, will be analyzed using generalized least squares linear regression with auto-regressive errors and adjustment for cluster and time effects (underlying secular trends). A similar strategy will be used for secondary patient and provider implementation outcomes.

DISCUSSION

The analytic updates described here resulted from highly iterative, collaborative efforts among statisticians, implementation scientists, and trial leads in the IMPACT Consortium. This updated statistical analysis plan will serve as the a priori specified approach for analyzing implementation outcomes for the NU IMPACT trial.

A mixed methods evaluation of patient perspectives on the implementation of an electronic health record-integrated patient-reported symptom and needs monitoring program in cancer care

BACKGROUND

As cancer centers have increased focus on patient-centered, evidenced-based care, implementing efficient programs that facilitate effective patient-clinician communication remains critical. We implemented an electronic health record-integrated patient-reported symptom and needs monitoring program ('cPRO' for cancer patient-reported outcomes). To aid evaluation of cPRO implementation, we asked patients receiving care in one of three geographical regions of an academic healthcare system about their experiences.

METHODS

Using a sequential mixed-methods approach, we collected feedback in two waves. Wave 1 included virtual focus groups and interviews with patients who had completed cPRO. In Wave 2, we administered a structured survey to systematically examine Wave 1 themes. All participants had a diagnosed malignancy and received at least 2 invitations to complete cPRO. We used rapid and traditional qualitative methods to analyze Wave 1 data and focused on identifying facilitators and barriers to cPRO implementation. Wave 2 data were analyzed descriptively.

RESULTS

Participants (n = 180) were on average 62.9 years old; were majority female, White, non-Hispanic, and married; and represented various cancer types and phases of treatment. Wave 1 participants (n = 37) identified facilitators, including cPRO's perceived value and favorable usability, and barriers, including confusion about cPRO's purpose and various considerations for responding. High levels of clinician engagement with, and patient education on, cPRO were described as facilitators while low levels were described as barriers. Wave 2 (n = 143) data demonstrated high endorsement rates of cPRO's usability on domains such as navigability (91.6%), comprehensibility (98.7%), and relevance (82.4%). Wave 2 data also indicated low rates of understanding cPRO's purpose (56.7%), education from care teams about cPRO (22.5%), and discussing results of cPRO with care teams (16.3%).

CONCLUSIONS

While patients reported high value and ease of use when completing cPRO, they also reported areas of confusion, emphasizing the importance of patient education on the purpose and use of cPRO and clinician engagement to sustain participation. These results guided successful implementation changes and will inform future improvements.

Disparities in electronic health record portal access and use among patients with cancer

BACKGROUND

Electronic health record-linked portals may improve health-care quality for patients with cancer. Barriers to portal access and use undermine interventions that rely on portals to reduce cancer care disparities. This study examined portal access and persistence of portal use and associations with patient and structural factors before the implementation of 3 portal-based interventions within the Improving the Management of symPtoms during And following Cancer Treatment (IMPACT) Consortium.

METHODS

Portal use data were extracted from electronic health records for the 12 months preceding intervention implementation. Sociodemographic factors, mode of accessing portals (web vs mobile), and number of clinical encounters before intervention implementation were also extracted. Rurality was derived using rural-urban commuting area codes. Broadband access was estimated using the 2015-2019 American Community Survey. Multiple logistic regression models tested the associations of these factors with portal access (ever accessed or never accessed) and persistence of portal use (accessed the portal ≤20 weeks vs ≥21 weeks in the 35-week study period).

RESULTS

Of 28 942 eligible patients, 10 061 (35%) never accessed the portal. Male sex, membership in a racial and ethnic minority group, rural dwelling, not working, and limited broadband access were associated with lower odds of portal access. Younger age and more clinical encounters were associated with higher odds of portal access. Of those with portal access, 25% were persistent users. Using multiple modalities for portal access, being middle-aged, and having more clinical encounters were associated with persistent portal use.

CONCLUSION

Patient and structural factors affect portal access and use and may exacerbate disparities in electronic health record-based cancer symptom surveillance and management.

Advancing survivorship at a comprehensive cancer center: integrating clinical care, education and research initiatives at Northwestern Medicine and the Robert H. Lurie Comprehensive Cancer Center

The unprecedented and growing number of cancer survivors requires comprehensive quality care that includes cancer surveillance, symptom management, and health promotion to reduce morbidity and mortality and improve quality of life. However, coordinated and sustainable survivorship care has been challenged by barriers at multiple levels. We outline the survivorship programs at Northwestern Medicine and the Robert H. Lurie Comprehensive Cancer Center that have evolved over two decades. Our current survivorship clinics comprise STAR (Survivors Taking Action and Responsibility) for adult survivors of childhood cancers; Adult Specialty Survivorship for survivors of breast, colorectal and testicular cancers, lymphomas, and leukemias; and Gynecologic Oncology Survivorship. Care provision models align with general, disease/treatment-specific, and integrated survivorship models, respectively. Reimbursement for survivorship services has been bolstered by institutional budget allocations. We have standardized survivor education, counseling, and referrals through electronic health record (EHR)-integrated survivorship care plan (SCP) templates that incorporate partial auto-population. We developed EHR-integrated data collection tools (e.g., dashboards; SmartForm, and registry) to facilitate data analytics, personalized patient referrals, and reports to the Commission on Cancer (CoC). We report to the CoC on SCP delivery, dietitian encounters, and DEXA scans. For the last decade, our Cancer Survivorship Institute has aligned the efforts of clinicians, researchers, and educators. The institute promotes evidence-based care, high-impact research, and state-of-the-science educational programs for professionals, survivors, and the community. Future plans include expansion of clinical services and funding for applied research centered on the unique needs of post-treatment cancer survivors. IMPLICATIONS FOR CANCER SURVIVORS: The survivorship programs at Northwestern Medicine and the Robert H. Lurie Comprehensive Cancer Center underscore the imperative for comprehensive, coordinated, and sustainable survivorship care to address the needs of increasing numbers of cancer survivors, with a focus on evidence-based clinical practices, associated research, and educational initiatives.

Seamless Integration of Computer-Adaptive Patient Reported Outcomes into an Electronic Health Record

BACKGROUND

Patient-reported outcome (PRO) measures have become an essential component of quality measurement, quality improvement, and capturing the voice of the patient in clinical care. In 2004, the National Institutes of Health endorsed the importance of PROs by initiating the Patient-Reported Outcomes Measurement Information System (PROMIS), which leverages computer-adaptive tests (CATs) to reduce patient burden while maintaining measurement precision. Historically, PROMIS CATs have been used in a large number of research studies outside the electronic health record (EHR), but growing demand for clinical use of PROs requires creative information technology solutions for integration into the EHR.

OBJECTIVES

This paper describes the introduction of PROMIS CATs into the Epic Systems EHR at a large academic medical center using a tight integration; we describe the process of creating a secure, automatic connection between the application programming interface (API) which scores and selects CAT items and Epic.

METHODS

The overarching strategy was to make CATs appear indistinguishable from conventional measures to clinical users, patients, and the EHR software itself. We implemented CATs in Epic without compromising patient data security by creating custom middleware software within the organization's existing middleware framework. This software communicated between the Assessment Center API for item selection and scoring and Epic for item presentation and results. The middleware software seamlessly administered CATs alongside fixed-length, conventional PROs while maintaining the display characteristics and functions of other Epic measures, including automatic display of PROMIS scores in the patient's chart. Pilot implementation revealed differing workflows for clinicians using the software.

RESULTS

The middleware software was adopted in 27 clinics across the hospital system. In the first 2 years of hospital-wide implementation, 793 providers collected 70,446 PROs from patients using this system.

CONCLUSION

This project demonstrated the importance of regular communication across interdisciplinary teams in the design and development of clinical software. It also demonstrated that implementation relies on buy-in from clinical partners as they integrate new tools into their existing clinical workflow.

The Longitudinal Implementation Strategy Tracking System (LISTS): feasibility, usability, and pilot testing of a novel method

BACKGROUND

Systematic approaches are needed to accurately characterize the dynamic use of implementation strategies and how they change over time. We describe the development and preliminary evaluation of the Longitudinal Implementation Strategy Tracking System (LISTS), a novel methodology to document and characterize implementation strategies use over time.

METHODS

The development and initial evaluation of the LISTS method was conducted within the Improving the Management of SymPtoms during And following Cancer Treatment (IMPACT) Research Consortium (supported by funding provided through the NCI Cancer MoonshotSM). The IMPACT Consortium includes a coordinating center and three hybrid effectiveness-implementation studies testing routine symptom surveillance and integration of symptom management interventions in ambulatory oncology care settings. LISTS was created to increase the precision and reliability of dynamic changes in implementation strategy use over time. It includes three components: (1) a strategy assessment, (2) a data capture platform, and (3) a User's Guide. An iterative process between implementation researchers and practitioners was used to develop, pilot test, and refine the LISTS method prior to evaluating its use in three stepped-wedge trials within the IMPACT Consortium. The LISTS method was used with research and practice teams for approximately 12 months and subsequently we evaluated its feasibility, acceptability, and usability using established instruments and novel questions developed specifically for this study.

RESULTS

Initial evaluation of LISTS indicates that it is a feasible and acceptable method, with content validity, for characterizing and tracking the use of implementation strategies over time. Users of LISTS highlighted several opportunities for improving the method for use in future and more diverse implementation studies.

CONCLUSIONS

The LISTS method was developed collaboratively between researchers and practitioners to fill a research gap in systematically tracking implementation strategy use and modifications in research studies and other implementation efforts. Preliminary feedback from LISTS users indicate it is feasible and usable. Potential future developments include additional features, fewer data elements, and interoperability with alternative data entry platforms. LISTS offers a systematic method that encourages the use of common data elements to support data analysis across sites and synthesis across studies. Future research is needed to further adapt, refine, and evaluate the LISTS method in studies with employ diverse study designs and address varying delivery settings, health conditions, and intervention types.

Systematic symptom management in the IMPACT Consortium: rationale and design for 3 effectiveness-implementation trials

Cancer and its treatment produce deleterious symptoms across the phases of care. Poorly controlled symptoms negatively affect quality of life and result in increased health-care needs and hospitalization. The Improving the Management of symPtoms during And following Cancer Treatment (IMPACT) Consortium was created to develop 3 large-scale, systematic symptom management systems, deployed through electronic health record platforms, and to test them in pragmatic, randomized, hybrid effectiveness and implementation trials. Here, we describe the IMPACT Consortium's conceptual framework, its organizational components, and plans for evaluation. The study designs and lessons learned are highlighted in the context of disruptions related to the COVID-19 pandemic.