Challenges to electronic clinical quality measurement using third-party platforms in primary care practices: the healthy hearts in the heartland experience

Perspective: Leveraging Electronic Health Record Data Within Food Is Medicine Program Evaluation: Considerations and Potential Paths Forward

Government, health care systems and payers, philanthropic entities, advocacy groups, nonprofit organizations, community groups, and for-profit companies are presently making the case for Food is Medicine (FIM) nutrition programs to become reimbursable within health care services. FIM researchers are working urgently to build evidence for FIM programs' cost-effectiveness by showing improvements in health outcomes and health care utilization. However, primary collection of this data is costly, difficult to implement, and burdensome to participants. Electronic health records (EHRs) offer a promising alternative to primary data collection because they provide already-collected information from existing clinical care. A few FIM studies have leveraged EHRs to demonstrate positive impacts on biomarkers or health care utilization, but many FIM studies run into insurmountable difficulties in their attempts to use EHRs. The authors of this commentary serve as evaluators and/or technical assistance providers with the United States Department of Agriculture's Gus Schumacher Nutrition Incentive Program National Training, Technical Assistance, Evaluation, and Information Center. They work closely with over 100 Gus Schumacher Nutrition Incentive Program Produce Prescription FIM projects, which, as of 2023, span 34 US states and territories. In this commentary, we describe recurring challenges related to using EHRs in FIM evaluation, particularly in relation to biomarkers and health care utilization. We also outline potential opportunities and reasonable expectations for what can be learned from EHR data and describe other (non-EHR) data sources to consider for evaluation of long-term health outcomes and health care utilization. Large integrated health systems may be best positioned to use their own data to examine outcomes of interest to the broader field.

Development of a natural language processing model for deriving breast cancer quality indicators : A cross-sectional, multicenter study

OBJECTIVES

Medico-administrative data are promising to automate the calculation of Healthcare Quality and Safety Indicators. Nevertheless, not all relevant indicators can be calculated with this data alone. Our feasibility study objective is to analyze 1) the availability of data sources; 2) the availability of each indicator elementary variables, and 3) to apply natural language processing to automatically retrieve such information.

METHOD

We performed a multicenter cross-sectional observational feasibility study on the clinical data warehouse of Assistance Publique - Hôpitaux de Paris (AP-HP). We studied the management of breast cancer patients treated at AP-HP between January 2019 and June 2021, and the quality indicators published by the European Society of Breast Cancer Specialist, using claims data from the Programme de Médicalisation du Système d'Information (PMSI) and pathology reports. For each indicator, we calculated the number (%) of patients for whom all necessary data sources were available, and the number (%) of patients for whom all elementary variables were available in the sources, and for whom the related HQSI was computable. To extract useful data from the free text reports, we developed and validated dedicated rule-based algorithms, whose performance metrics were assessed with recall, precision, and f1-score.

RESULTS

Out of 5785 female patients diagnosed with a breast cancer (60.9 years, IQR [50.0-71.9]), 5,147 (89.0%) had procedures related to breast cancer recorded in the PMSI, and 3732 (72.5%) had at least one surgery. Out of the 34 key indicators, 9 could be calculated with the PMSI alone, and 6 others became so using the data from pathology reports. Ten elementary variables were needed to calculate the 6 indicators combining the PMSI and pathology reports. The necessary sources were available for 58.8% to 94.6% of patients, depending on the indicators. The extraction algorithms developed had an average accuracy of 76.5% (min-max [32.7%-93.3%]), an average precision of 77.7% [10.0%-97.4%] and an average sensitivity of 71.6% [2.8% to 100.0%]. Once these algorithms applied, the variables needed to calculate the indicators were extracted for 2% to 88% of patients, depending on the indicators.

DISCUSSION

The availability of medical reports in the electronic health records, of the elementary variables within the reports, and the performance of the extraction algorithms limit the population for which the indicators can be calculated.

CONCLUSIONS

The automated calculation of quality indicators from electronic health records is a prospect that comes up against many practical obstacles.

A Cohort Analysis of Statin Treatment Patterns Among Small-Sized Primary Care Practices

BACKGROUND

Small-sized primary care practices, defined as practices with fewer than 10 clinicians, delivered the majority of outpatient visits in the USA. Statin therapy in high-risk individuals reduces atherosclerotic cardiovascular disease (ASCVD) events, but prescribing patterns in small primary care practices are not well known. This study describes statin treatment patterns in small-sized primary care practices and examines patient- and practice-level factors associated with lack of statin treatment.

METHODS

We conducted a retrospective cohort analysis of statin-eligible patients from practices that participated in Healthy Hearts in the Heartland (H3), a quality improvement initiative aimed at improving cardiovascular care measures in small primary care practices. All statin-eligible adults who received care in one of 53 H3 practices from 2013 to 2016. Statin-eligible adults include those aged at least 21 with (1) clinical ASCVD, (2) low-density lipoprotein cholesterol (LDL-C) ≥ 190 mg/dL, or (3) diabetes aged 40-75 and with LDL-C 70-189 mg/dL. Eligible patients with no record of moderate- to high-intensity statin prescription are defined by ACC/AHA guidelines.

RESULTS

Among the 13,330 statin-eligible adults, the mean age was 58 years and 52% were women. Overall, there was no record of moderate- to high-intensity statin prescription among 5,780 (43%) patients. Younger age, female sex, and lower LDL-C were independently associated with a lack of appropriate intensity statin therapy. Higher proportions of patients insured by Medicaid and having only family medicine trained physicians (versus having at least one internal medicine trained physician) at the practice were also associated with lower appropriate intensity statin use. Lack of appropriate intensity statin therapy was higher in independent practices than in Federally Qualified Health Centers (FQHCs) (50% vs. 40%, p value < 0.01).

CONCLUSIONS

There is an opportunity for improved ASCVD risk reduction in small primary care practices. Statin treatment patterns and factors influencing lack of treatment vary by practice setting, highlighting the importance of tailored approaches to each setting.

Chasm Between Cancer Quality Measures and Electronic Health Record Data Quality

PURPOSE

The Medicare Access and CHIP Reauthorization Act of 2015 (MACRA) requires eligible clinicians to report clinical quality measures (CQMs) in the Merit-Based Incentive Payment System (MIPS) to maximize reimbursement. To determine whether structured data in electronic health records (EHRs) were adequate to report MIPS CQMs, EHR data aggregated by ASCO's CancerLinQ platform were analyzed.

MATERIALS AND METHODS

Using the CancerLinQ health technology platform, 19 Oncology MIPS (oMIPS) CQMs were evaluated to determine the presence of data elements (DEs) necessary to satisfy each CQM and the DE percent population with patient data (fill rates). At the time of this analysis, the CancerLinQ network comprised 63 active practices, representing eight different EHR vendors and containing records for more than 1.63 million unique patients with one or more malignant neoplasms (1.73 million cancer cases).

RESULTS

Fill rates for the 63 oMIPS-associated DEs varied widely among the practices. The average site had at least one filled DE for 52% of the DEs. Only 35% of the DEs were populated for at least one patient record in 95% of the practices. However, the average DE fill rate of all practices was 23%. No data were found at any practice for 22% of the DEs. Since any oMIPS CQM with an unpopulated DE component resulted in an inability to compute the measure, only two (10.5%) of the 19 oMIPS CQMs were computable for more than 1% of the patients.

CONCLUSION

Although EHR systems had relatively high DE fill rates for some DEs, underfilling and inconsistency of DEs in EHRs render automated oncology MIPS CQM calculations impractical.

Clinical data sharing improves quality measurement and patient safety

OBJECTIVE

Accurate and robust quality measurement is critical to the future of value-based care. Having incomplete information when calculating quality measures can cause inaccuracies in reported patient outcomes. This research examines how quality calculations vary when using data from an individual electronic health record (EHR) and longitudinal data from a health information exchange (HIE) operating as a multisource registry for quality measurement.

MATERIALS AND METHODS

Data were sampled from 53 healthcare organizations in 2018. Organizations represented both ambulatory care practices and health systems participating in the state of Kansas HIE. Fourteen ambulatory quality measures for 5300 patients were calculated using the data from an individual EHR source and contrasted to calculations when HIE data were added to locally recorded data.

RESULTS

A total of 79% of patients received care at more than 1 facility during the 2018 calendar year. A total of 12 994 applicable quality measure calculations were compared using data from the originating organization vs longitudinal data from the HIE. A total of 15% of all quality measure calculations changed (P < .001) when including HIE data sources, affecting 19% of patients. Changes in quality measure calculations were observed across measures and organizations.

DISCUSSION

These results demonstrate that quality measures calculated using single-site EHR data may be limited by incomplete information. Effective data sharing significantly changes quality calculations, which affect healthcare payments, patient safety, and care quality.

CONCLUSIONS

Federal, state, and commercial programs that use quality measurement as part of reimbursement could promote more accurate and representative quality measurement through methods that increase clinical data sharing.

Push Button Population Health: The SMART/HL7 FHIR Bulk Data Access Application Programming Interface

The 21st Century Cures Act requires that certified health information technology have an application programming interface (API) giving access to all data elements of a patient's electronic health record, "without special effort". In the spring of 2020, the Office of the National Coordinator of Health Information Technology (ONC) published a rule-21st Century Cures Act Interoperability, Information Blocking, and the ONC Health IT Certification Program-regulating the API requirement along with protections against information blocking. The rule specifies the SMART/HL7 FHIR Bulk Data Access API, which enables access to patient-level data across a patient population, supporting myriad use cases across healthcare, research, and public health ecosystems. The API enables "push button population health" in that core data elements can readily and standardly be extracted from electronic health records, enabling local, regional, and national-scale data-driven innovation.