Evaluating the Reliability of EHR-Generated Clinical Outcomes Reports: A Case Study

Accuracy of Physician Electronic Health Record Usage Analytics using Clinical Test Cases

Usage log data are an important data source for characterizing the potential burden related to use of the electronic health record (EHR) system. However, the utility of this data source has been hindered by concerns related to the real-world validity and accuracy of the data. While time-motion studies have historically been used to address this concern, the restrictions caused by the pandemic have made it difficult to carry out these studies in-person. In this regard, we introduce a practical approach for conducting validation studies for usage log data in a controlled environment. By developing test runs based on clinical workflows and conducting them within a test EHR environment, it allows for both comparison of the recorded timings and retrospective investigation of any discrepancies. In this case report, we describe the utility of this approach for validating our physician EHR usage logs at a large academic teaching mental health hospital in Canada. A total of 10 test runs were conducted across 3 days to validate 8 EHR usage log metrics, finding differences between recorded measurements and the usage analytics platform ranging from 9 to 60%.

Primary Care Practices' Ability to Report Electronic Clinical Quality Measures in the EvidenceNOW Southwest Initiative to Improve Heart Health

IMPORTANCE

The capability and capacity of primary care practices to report electronic clinical quality measures (eCQMs) are questionable.

OBJECTIVE

To determine how quickly primary care practices can report eCQMs and the practice characteristics associated with faster reporting.

DESIGN, SETTING, AND PARTICIPANTS

This quality improvement study examined an initiative (EvidenceNOW Southwest) to enhance primary care practices' ability to adopt evidence-based cardiovascular care approaches: aspirin prescribing, blood pressure control, cholesterol management, and smoking cessation (ABCS). A total of 211 primary care practices in Colorado and New Mexico participating in EvidenceNOW Southwest between February 2015 and December 2017 were included.

INTERVENTIONS

Practices were instructed on eCQM specifications that could be produced by an electronic health record, a registry, or a third-party platform. Practices received 9 months of support from a practice facilitator, a clinical health information technology advisor, and the research team. Practices were instructed to report their baseline ABCS eCQMs as soon as possible.

MAIN OUTCOMES AND MEASURES

The main outcome was time to report the ABCS eCQMs. Cox proportional hazards models were used to examine practice characteristics associated with time to reporting.

RESULTS

Practices were predominantly clinician owned (48%) and in urban or suburban areas (71%). Practices required a median (interquartile range) of 8.2 (4.6-11.9) months to report any ABCS eCQM. Time to report differed by eCQM: practices reported blood pressure management the fastest (median [interquartile range], 7.8 [3.5-10.4] months) and cholesterol management the slowest (median [interquartile range], 10.5 [6.6 to >12] months) (log-rank P < .001). In multivariable models, the blood pressure eCQM was reported more quickly by practices that participated in accountable care organizations (hazard ratio [HR], 1.88; 95% CI, 1.40-2.53; P < .001) or participated in a quality demonstration program (HR, 1.58; 95% CI, 1.14-2.18; P = .006). The cholesterol eCQM was reported more quickly by practices that used clinical guidelines for cardiovascular disease management (HR, 1.35; 95% CI, 1.18-1.53; P < .001). Compared with Federally Qualified Health Centers, hospital-owned practices had greater ability to report blood pressure eCQMs (HR, 2.66; 95% CI, 95% CI, 1.73-4.09; P < .001), and clinician-owned practices had less ability to report cholesterol eCQMs (HR, 0.52; 95% CI, 0.35-0.76; P < .001).

CONCLUSIONS AND RELEVANCE

In this study, time to report eCQMs varied by measure and practice type, with very few practices reporting quickly. Practices took longer to report a new cholesterol measure than other measures. Programs that require eCQM reporting should consider the time and effort practices must exert to produce reports. Practices may benefit from additional support to succeed in new programs that require eCQM reporting.

Distributed Data Networks That Support Public Health Information Needs

INTRODUCTION

Data networks, consisting of pooled electronic health data assets from health care providers serving different patient populations, promote data sharing, population and disease monitoring, and methods to assess interventions. Better understanding of data networks, and their capacity to support public health objectives, will help foster partnerships, expand resources, and grow learning health systems.

METHODS

We conducted semistructured interviews with 16 key informants across the United States, identified as network stakeholders based on their respective experience in advancing health information technology and network functionality. Key informants were asked about their experience with and infrastructure used to develop data networks, including each network's utility to identify and characterize populations, usage, and sustainability.

RESULTS

Among 11 identified data networks representing hundreds of thousands of patients, key informants described aggregated health care clinical data contributing to population health measures. Key informant interview responses were thematically grouped to illustrate how networks support public health, including (1) infrastructure and information sharing; (2) population health measures; and (3) network sustainability.

CONCLUSION

Collaboration between clinical data networks and public health entities presents an opportunity to leverage infrastructure investments to support public health. Data networks can provide resources to enhance population health information and infrastructure.

Clinical Pharmacist Team-Based Care in a Safety Net Medical Home: Facilitators and Barriers to Chronic Care Management

Collaborative care models incorporating pharmacists have been shown to improve quality of care for patients with hypertension and/or diabetes. Little is known about how to integrate such services outside of clinical trials. The authors implemented a 22-month observational study to evaluate pharmacy collaborative care for hypertension and diabetes in a safety net medical home that incorporated population risk stratification, clinical decision support, and medication dose adjustment protocols. Patients in the pharmacy group saw their primary care provider (PCP) more often and had higher baseline systolic blood pressure (SBP) and diastolic blood pressure (DBP) and A1c levels compared to patients who only received care from their PCPs. There were no significant differences in the proportion of patients achieving treatment goals (SBP <140, DBP <90; A1c < 8) or the magnitude of change in BP or A1c among patients who underwent collaborative care versus those who did not. Age, race, and number of PCP encounters were associated with BP and A1c trends. The median time to achieve disease control was longer in the pharmacy group. Although 70% of all patients with poorly controlled hypertension achieved treatment goals within 7 months, less than 50% of patients with poorly controlled diabetes achieved A1c < 8 within 15 months, suggesting that diabetes was harder to manage overall. Contextual factors that facilitated or hindered practice redesign included organizational culture, health information technology and related workflows, and pharmacy caseload optimization. Future studies should further examine implementation strategies that work best in specific settings to optimize the benefits of team-based care with clinical pharmacists.

IT-enabled Community Health Interventions: Challenges, Opportunities, and Future Directions

Rising health information technology (HIT) adoption and the increasing interoperability of health data have propelled the role of IT in community-wide health transformations. Disseminating the challenges and opportunities that the early adopters of community-wide HIT interventions have experienced is critical for empowering the growing demand for community-based health systems. This special issue of eGEMs addresses that need. This issue includes a variety of community-based HIT projects covering topics such as governance, informatics, and learning health systems. These projects represent a diverse set of stakeholders, a wide selection of data sources, and multiple information platforms to collate or exchange data. We hope that this special issue of eGEMs will be the first of several future issues dedicated to community-wide HIT transformations.