Development and reliability assessment of a tool to assess community pharmacist potential to influence prescriber performance on quality measures

Feasibility and reliability of a quality indicator system for an ambulatory dispensing service

Background

For a medication dispensing service to function with quality, continuous evaluation is required, which is why it is necessary to have reliable measurement tools that make it possible. Quality indicators can serve as tools for managing quality, as they are variables that directly or indirectly measure changes in a situation and help evaluate the progress made in addressing it. This article aims to determine the feasibility and reliability of a quality indicator system for a drug dispensing service for paediatric outpatients in two Mexican hospitals.

Methods

A study of the development type of health systems and services at a microlevel was conducted from October 2020 to October 2021 in the pharmaceutical service of two Mexican hospitals. To determine the feasibility of the quality indicators, a retrospective evaluation was performed, which considered the indicators that could be calculated with the available information to be feasible. To determine reliability, an inter-observer agreement study (Kappa (κ)) was performed.

Results

The feasibility analysis revealed that all five reference indicators related to the structure were feasible in both hospitals. In the Infantil of the Californias hospital, all six process indicators evaluated were feasible, whilst only one was found feasible in H+ Querétaro. As for outcome indicators, only one was feasible in the Infantil of the Californias hospital. The causes of non-feasibility in both hospitals were the non-documentation of the primary data related to the stages of the process and the lack of instruments to measure patient satisfaction. The reliability of the indicators showed little variability.

Conclusion

Although not all indicators were feasible, solutions were proposed so that the 15 reference indicators could be used if an organization decided to do so. The reliability of the indicators was demonstrated, evidencing the importance of the data sheet as a tool to generate valid reliable measures.This article is part of the Hospital pharmacy, rational use of medicines and patient safety in Latin America Special Issue: https://www.drugsincontext.com/special_issues/hospital-pharmacy-rational-use-of-medicines-and-patient-safety-in-latin-america/.

Relative contribution of pharmacists and primary care providers to shared quality measures

Background

Alternative payment models are common for both primary care providers and pharmacies. These models rely on quality measures to determine reimbursement, and pharmacists and primary care providers can contribute to performance on a similar set of medication-related measures. Therefore, payers need to decide which provider to incentivize for which measures when both are included in alternative payment models.

Objectives

To explore the relative contribution of pharmacies and primary care group practices to a range of quality measures.

Methods

This retrospective cross-sectional study used Medicare Part A, B, and D claims for a 20% random sample of Medicare beneficiaries for 2014–2016. Eight quality measures were selected from the Merit-based Incentive Payment System and Medicare Part D Stars Ratings. Measures included medication adherence measures, appropriate prescribing measures such as high-risk medication use in the elderly, statin use in persons with diabetes (SUPD), and others. The residual intraclass correlation coefficient (RICC) was used to estimate the contribution of pharmacists and primary care providers to measure variation. To estimate the relative contribution across provider types, the pharmacy RICC was divided by the group practice RICC to yield a RICC ratio.

Results

Due to varying measure eligibility requirements, the number of patients per measure ranged from 179,430 to 2,226,129. Across all measures, the RICC values were low, ranging from 0.013 for SUPD to 0.145 for adult sinusitis. Adherence measures had the highest RICC ratios (1.15–1.44), and the annual influenza vaccination measure had the lowest (0.56).

Discussion and conclusions

The relative contributions of pharmacists and primary care providers vary across quality measures. As payers design payment models with measures to which pharmacists and primary care providers can contribute, the RICC ratio may be useful in aligning incentives to the providers with the greatest relative contributions. Additional research is needed to validate this method and extend it to additional sets of providers.

•

Comparing RICC ratios across provider groups can guide payer decisions on measures to include in alternative payment models.

•

Absolute RICC values may be useful for inferring measure reliability

•

Pharmacists had greatest relative contributions to adherence measures

•

Primary care providers had greatest relative contributions to non-medication related measures