Implementation science for ambulatory care safety: a novel method to develop context-sensitive interventions to reduce quality gaps in monitoring high-risk patients

Extent of Follow-Up on Abnormal Cancer Screening in Multiple California Public Hospital Systems: A Retrospective Review

BACKGROUND

Inequitable follow-up of abnormal cancer screening tests may contribute to racial/ethnic disparities in colon and breast cancer outcomes. However, few multi-site studies have examined follow-up of abnormal cancer screening tests and it is unknown if racial/ethnic disparities exist.

OBJECTIVE

This report describes patterns of performance on follow-up of abnormal colon and breast cancer screening tests and explores the extent to which racial/ethnic disparities exist in public hospital systems.

DESIGN

We conducted a retrospective cohort study using data from five California public hospital systems. We used multivariable robust Poisson regression analyses to examine whether patient-level factors or site predicted receipt of follow-up test.

MAIN MEASURES

Using data from five public hospital systems between July 2015 and June 2017, we assessed follow-up of two screening results: (1) colonoscopy after positive fecal immunochemical tests (FIT) and (2) tissue biopsy within 21 days after a BIRADS 4/5 mammogram.

KEY RESULTS

Of 4132 abnormal FITs, 1736 (42%) received a follow-up colonoscopy. Older age, Medicaid insurance, lack of insurance, English language, and site were negatively associated with follow-up colonoscopy, while Hispanic ethnicity and Asian race were positively associated with follow-up colonoscopy. Of 1702 BIRADS 4/5 mammograms, 1082 (64%) received a timely biopsy; only site was associated with timely follow-up biopsy.

CONCLUSION

Despite the vulnerabilities of public-hospital-system patients, follow-up of abnormal cancer screening tests occurs at rates similar to that of patients in other healthcare settings, with colon cancer screening test follow-up occurring at lower rates than follow-up of breast cancer screening tests. Site-level factors have larger, more consistent impact on follow-up rates than patient sociodemographic traits. Resources are needed to identify health system-level factors, such as test follow-up processes or data infrastructure, that improve abnormal cancer screening test follow-up so that effective health system-level interventions can be evaluated and disseminated.

Training the next generation of learning health system scientists

Introduction

The learning health system (LHS) aligns science, informatics, incentives, stakeholders, and culture for continuous improvement and innovation. The Agency for Healthcare Research and Quality and the Patient-Centered Outcomes Research Institute designed a K12 initiative to grow the number of LHS scientists. We describe approaches developed by 11 funded centers of excellence (COEs) to promote partnerships between scholars and health system leaders and to provide mentored research training.

Methods

Since 2018, the COEs have enlisted faculty, secured institutional resources, partnered with health systems, developed and implemented curricula, recruited scholars, and provided mentored training. Program directors for each COE provided descriptive data on program context, scholar characteristics, stakeholder engagement, scholar experiences with health system partnerships, roles following program completion, and key training challenges.

Results

To date, the 11 COEs have partnered with health systems to train 110 scholars. Nine (82%) programs partner with a Veterans Affairs health system and 9 (82%) partner with safety net providers. Clinically trained scholars (n = 87; 79%) include 70 physicians and 17 scholars in other clinical disciplines. Non-clinicians (n = 29; 26%) represent diverse fields, dominated by population health sciences. Stakeholder engagement helps scholars understand health system and patient/family needs and priorities, enabling opportunities to conduct embedded research, improve outcomes, and grow skills in translating research methods and findings into practice. Challenges include supporting scholars through roadblocks that threaten to derail projects during their limited program time, ranging from delays in access to data to COVID-19-related impediments and shifts in organizational priorities.

Conclusions

Four years into this novel training program, there is evidence of scholars' accomplishments, both in traditional academic terms and in terms of moving along career trajectories that hold the potential to lead and accelerate transformational health system change. Future LHS training efforts should focus on sustainability, including organizational support for scholar activities.

Customized registry tool for tracking adherence to clinical guidelines for head and neck cancers: protocol for a pilot study

BACKGROUND

Despite recommendations for monitoring patients with chronic and high-risk conditions, gaps still remain. These gaps are exacerbated in outpatient care, where patients and clinicians face challenges related to care coordination, multiple electronic health records, and extensive follow-up. In addition, low-income and racial/ethnic minority populations that are disproportionately cared for in safety net settings are particularly at risk to lapses in monitoring.

METHODS

We aim to implement and evaluate a health information technology platform developed using systems engineering methodologies. The implementation is situated in a clinic that monitors patients with head and neck cancer within a large, urban, publicly funded hospital. Our study will evaluate the time it takes for patients to progress through key treatment milestones prior to and after implementation of the tool. We will use models controlling for secular trend to estimate the effect of the tool on improving timely and successful completion of guideline-based care processes.

DISCUSSION

This protocol details the evaluation of the effectiveness of a human-centered health information technology intervention on improving timely delivery of care for high-risk populations. Other settings, including those that face challenges related to limited resources to devote to safety programs and fragmented health information technology, may benefit from this approach.

TRIAL REGISTRATION

ClinicalTrials.gov, NCT03546322. "Customized Registry Tool for Tracking Adherence to Clinical Guidelines for Head and Neck Cancers." Registered 1 June 2018.

Reducing delays to diagnosis in ambulatory care settings: A macrocognition perspective

We aim to use a macrocognition theoretical perspective to characterize contributors to diagnostic delays by physicians that can be mitigated by work system redesign. As experienced with other complex, sociotechnical domains, system redesign is anticipated to be more effective at improving safety than training-based solutions. In the outpatient care setting, complex tasks, conducted by a primary care provider, are provided for five macrocognition functions: sensemaking, re-planning, detecting problems, deciding, and coordinating. Redesigning systems could reduce delays to diagnosis by helping users to avoid missed symptoms, forgotten follow-up activities, and delayed actions. Health information technology could support resilience strategies by offloading documentation burdens, recording working diagnoses, displaying planned follow-up activities at the correct time interval, and supporting recognition of patterns in patient care. These insights suggest a path forward for future research on system design innovations to reduce diagnostic delays, and ultimately, reduce patient harm.

An electronic registry to improve adherence to active surveillance monitoring among men with prostate cancer at a safety-net hospital: protocol for a pilot study

Background

The evidence-based practice of active surveillance to monitor men with favorable-risk prostate cancer in lieu of initial definitive treatment is becoming more common. However, there are barriers to effective implementation, particularly in low-resource settings. Our goal is to assess the efficacy and feasibility of a health information technology registry for men on active surveillance at a safety-net hospital to ensure patients receive guideline-recommended care.

Methods

We developed an electronic registry for urology clinic staff to monitor men on active surveillance. The health information technology tool was developed using the Systems Engineering Initiative for Patient Safety model and iteratively tailored to the needs of the clinic by engaging providers in a co-design process. We will enroll all men at Zuckerberg San Francisco General Hospital and Trauma Center who choose active surveillance as a treatment strategy. The primary outcomes to be assessed during this non-randomized, pragmatic evaluation are number of days delayed beyond recommended date of follow-up testing, the proportion of men who are lost to follow-up, the cancer stage at active treatment, and the feasibility and acceptability of the clinic-wide intervention with clinic staff. Secondary outcomes include appointment adherence within 30 days of the scheduled date.

Discussion

Use of a customized electronic approach for monitoring men on active surveillance could improve patient outcomes. It may help reduce the number of men lost to follow-up and improve adherence to timely follow-up testing. Evaluating the adoption and efficacy of a customized registry in a safety-net setting may also demonstrate feasibility for implementation in diverse clinical contexts.

Trial registration

ClinicalTrials.gov identifier NCT03553732, An Electronic Registry to Improve Adherence to Active Surveillance Monitoring at a Safety-net Hospital. Registered 11 June 2018.

Accurate Measurement In California's Safety-Net Health Systems Has Gaps And Barriers

Patient safety in ambulatory care has not been routinely measured. California implemented a pay-for-performance program in safety-net hospitals that incentivized measurement and improvement in key areas of ambulatory safety: referral completion, medication safety, and test follow-up. We present two years of program data (collected during July 2015-June 2017) and show both suboptimal performance in aspects of ambulatory safety and questionable reliability in data reporting. Performance was better in areas that required limited coordination or patient engagement-for example, annual medication monitoring versus follow-up after high-risk mammograms. Health care systems that lack seamlessly integrated electronic health records and patient registries encountered barriers to reporting reliable ambulatory safety data, particularly for measures that integrated multiple data elements. These data challenges precluded accurate performance measurement in many areas. Policy makers and safety advocates need to support the development of information systems and measures that facilitate the accurate ascertainment of the health systems, patients, and clinical tasks at greatest risk for ambulatory safety failures.