Low-Value Service Use in Provider Organizations

Analyzing health outcomes measured as bounded counts

This paper assesses analytical strategies that respect the bounded-count nature of health outcomes encountered often in empirical applications. Absent in the literature is a comprehensive discussion and critique of strategies for analyzing and understanding such data. The paper's goal is to provide an in-depth consideration of prominent issues arising in and strategies for undertaking such analyses, emphasizing the merits and limitations of various analytical tools empirical researchers may contemplate. Three main topics are covered. First, bounded-count health outcomes' measurement properties are reviewed and their implications assessed. Second, issues arising when bounded-count outcomes are the objects of concern in evaluations are described. Third, the (conditional) probability and moment structures of bounded-count outcomes are derived and corresponding specification and estimation strategies presented with particular attention to partial effects. Many questions may be asked of such data in health research and a researcher's choice of analytical method is often consequential.

Discrepancies Among Hospitals and Regions in the Provision of Low-Value Care

BACKGROUND

Low-value care (LVC) is a critical issue in terms of patient safety and fiscal policy; however, little has been known in Asia. For the purpose of better understanding the extent of LVC on a national level, the utilization, costs, and associated characteristics of selected international recommendations were assessed in this study.

METHODS

This retrospective cohort study used the National Health Insurance (NHI) claims data during 2013-2017 to evaluate the LVC utilization. Adult beneficiaries who enrolled in the NHI program and received at least one of the low-value services in hospitals were included. We measured seven procedures derived from the international recommendations at the hospital level, and a composite measure was created by summing the total utilization of selected services to determine the overall prevalence and corresponding cost. The generalized estimating equation (GEE) model was adopted to estimate the association.

RESULTS

A total of 1 970 496 episodes of LVC was identified among 1 218 146 beneficiary-year observations and 2054 hospital-year observations. Overall, the utilization rate of the composite measure increased from 150.70 to 186.23 episodes per 10 000 beneficiaries with the growth in cost from US$ 5.40 to US$ 6.90 million. LVC utilization was proportional to the volume of outpatient visits and length of stay. Also, hospitals with a large volume of outpatient visits (adjusted odds ratio [aOR]: 95% CI, 2.10: 1.26 to 3.49 for Q2-Q3, 2.88: 1.45 to 5.75 for ≥Q3) and a higher proportion of older patients (aOR: 95% CI, 1.06: 1.02 to 1.11) were more likely to have high costs.

CONCLUSION

The utilization and corresponding cost of LVC appeared to increase annually despite the relatively lower prevalence compared to other countries. Multicomponent interventions such as recommendations, de-implementation policies and payment reforms are considered effective ways to reduce LVC. Repeated measurements would be needed to evaluate the effectiveness of interventions.

Impact of a quality programme on overindication of surgeries for endometriosis and cholecystectomies

Approximately 45% of patients receive medical services with minimal or no benefit (low-value care). In addition to the increasing costs to the health system, performing invasive procedures without an indication poses a potentially preventable risk to patient safety. This study aimed to determine whether a managed quality improvement programme could prevent cholecystectomy and surgery for endometriosis treatment with minimal or no benefit to patients.This before-and-after study was conducted at a private hospital in São Paulo, Brazil, which has a main medical remuneration model of fee for service. All patients who underwent cholecystectomy or surgery for endometriosis between 1 August 2020 and 31 May 2021 were evaluated.The intervention consisted of allowing the performance of procedures that met previously defined criteria or for which the indications were validated by a board of experts.A total of 430 patients were included in this analysis. The programme prevented the unnecessary performance of 13% of cholecystectomies (p=0.0001) and 22.2% (p=0.0006) of surgeries for the treatment of endometriosis. This resulted in an estimated annual cost reduction to the health system of US$466 094.93.In a hospital with a private practice and fee-for-service medical remuneration, the definition of clear criteria for indicating surgery and the analysis of cases that did not meet these criteria by a board of reputable experts at the institution resulted in a statistically significant reduction in low-value cholecystectomies and endometriosis surgeries.

Patient, provider, and system-level factors associated with preoperative cardiac testing: A systematic review

BACKGROUND

Overuse of preoperative cardiac testing contributes to high healthcare costs and delayed surgeries. A large body of research has evaluated factors associated with variation in preoperative cardiac testing. However, patient, provider, and system-level factors associated with variation in testing have not been systematically studied.

OBJECTIVE

To conduct a systematic review to better delineate the patient, provider, and system-level factors associated with variation in preoperative cardiac testing.

METHODS

We included studies of an adult US population evaluating a patient, provider, or system-level factor associated with variation in preoperative cardiac testing for noncardiac surgery since 2012. Our search strategy used terms related to preoperative testing, diagnostic cardiac tests, and care variation with Ovid MEDLINE and Embase from inception through January 2023. We extracted study characteristics and factors associated with variation and qualitatively analyzed them. We assessed risk of bias using the Newcastle-Ottawa Scale and Evidence Project Risk of Bias tool.

RESULTS

Twenty-eight articles met inclusion criteria. Older age and higher comorbidity were strongly associated with higher-intensity testing. The evidence for provider and system-level covariates was weaker. However, there was strong evidence that a focus on primary care and away from preoperative clinic and cardiac consultations was associated with less testing and that interventions to reduce low-value testing can be successful.

CONCLUSIONS

There is significant interprovider and interhospital variation in preoperative cardiac testing, the correlates of which are not well-defined. Further work should aim to better understand these factors.

Racial differences in low value care among older adult Medicare patients in US health systems: retrospective cohort study

OBJECTIVE

To characterize racial differences in receipt of low value care (services that provide little to no benefit yet have potential for harm) among older Medicare beneficiaries overall and within health systems in the United States.

DESIGN

Retrospective cohort study SETTING: 100% Medicare fee-for-service administrative data (2016-18).

PARTICIPANTS

Black and White Medicare patients aged 65 or older as of 2016 and attributed to 595 health systems in the United States.

MAIN OUTCOME MEASURES

Receipt of 40 low value services among Black and White patients, with and without adjustment for patient age, sex, and previous healthcare use. Additional models included health system fixed effects to assess racial differences within health systems and separately, racial composition of the health system's population to assess the relative contributions of individual patient race and health system racial composition to low value care receipt.

RESULTS

The cohort included 9 833 304 patients (6.8% Black; 57.9% female). Of 40 low value services examined, Black patients had higher adjusted receipt of nine services and lower receipt of 20 services than White patients. Specifically, Black patients were more likely to receive low value acute diagnostic tests, including imaging for uncomplicated headache (6.9% v 3.2%) and head computed tomography scans for dizziness (3.1% v 1.9%). White patients had higher rates of low value screening tests and treatments, including preoperative laboratory tests (10.3% v 6.5%), prostate specific antigen tests (31.0% v 25.7%), and antibiotics for upper respiratory infections (36.6% v 32.7%; all P<0.001). Secondary analyses showed that these differences persisted within given health systems and were not explained by Black and White patients receiving care from different systems.

CONCLUSIONS

Black patients were more likely to receive low value acute diagnostic tests and White patients were more likely to receive low value screening tests and treatments. Differences were generally small and were largely due to differential care within health systems. These patterns suggest potential individual, interpersonal, and structural factors that researchers, policy makers, and health system leaders might investigate and address to improve care quality and equity.

Measuring low-value care in hospital discharge records: evidence from China

Background

Plenty of efforts have been made to reduce the use of low-value care (the care that is not expected to provide net benefits for patients) across the world, but measures of low-value care have not been developed in China. This study aims to develop hospital discharge records-based measures of low-value surgical procedures, evaluate their annual use and associated expenditure, and analyze the practice patterns by characterizing its temporal trends and correlations across rates of different low-value procedures within hospitals.

Methods

Informed by evidence-based lists including Choosing Wisely, we developed 11 measures of low-value surgical procedures. We evaluated the count and proportion of low-value episodes, as well as the proportion of expenditure and medical insurance payouts for these episodes, using hospital discharge records in Sichuan Province, China during a period of 2016-2022. We compared the count and expenditure detected by different versions of these measures, which varied in sensitivity and specificity. We characterized the temporal trends in the rate of low-value surgical procedures and estimated the annual percent change using joint-point regression. Additionally, we calculated the Spearman correlation coefficients between the risk-standardized rates of low-value procedures which were estimated by multilevel models adjusting for case mix across hospitals.

Findings

Low-value episodes detected by more specific versions of measures accounted for 3.25% (range, 0.11%-71.66%), and constituted 6.03% (range, 0.32%-84.63%) and 5.90% (range, 0.33%-82.86%) of overall expenditure and medical insurance payouts, respectively. The three figures accounted for 5.90%, 8.41%, and 8.38% in terms of more sensitive versions of measures. Almost half of the low-value procedures (five out of eleven) experienced an increase in rates during the period of 2016-2022, with four of them increasing over 20% per year. There was no significant correlation across risk-standardized rates of different low-value procedures within hospitals (mean r for pairwise, 0.03; CI, -0.02, 0.07).

Interpretation

Despite overall low-value practices detected by the 11 developed measures was modest, certain clinical specialties were plagued by widespread low-value practices which imposed heavy economic burdens for the healthcare system. Given the pervasive and significant upward trends in rates of low-value practices, it has become increasingly urgent to reduce such practices. Interventions in reducing low-value practices in China would be procedure-specific as practice patterns of low-value care varied by procedures and common drivers of low-value practices may not exist.

Funding

The National Science Foundation of China (72074163), Taikang Yicai Public Health and Epidemic Control Fund, Sichuan Science and Technology Program (2022YFS0052 and 2021YFQ0060), and Sichuan University (2018hhf-27 and SKSYL201811).

Longitudinal Patterns in Testosterone Prescribing After US FDA Safety Communication in 2014

BACKGROUND

The objective of this study was to describe changes in testosterone prescribing following a 2014 US Food and Drug Administration (FDA) safety communication and how changes varied by physician characteristics.

METHODS

Data were extracted from a 20% random sample of Medicare fee-for-service administrative claims data from 2011 through 2019. The sample included 1,544,604 unique male beneficiaries who received evaluation and management (E&M) services from 58,819 unique physicians that prescribed testosterone between 2011 and 2013. Patients were categorized based on presence of coronary artery disease (CAD) and non-age-related hypogonadism. Physician characteristics were identified in the OneKey database and included specialty and affiliations with teaching hospitals, for-profit hospitals, hospitals in integrated delivery networks, and hospitals in the top decile of case mix index. Linear segmented models described how testosterone prescriptions changed following a 2014 FDA safety communication and how changes were associated with physician and organizational characteristics.

RESULTS

Among 65,089,560 physician-patient-quarter-year observations, mean (standard deviation) age ranged from 72.16 (5.84) years for observations without CAD or non-age-related hypogonadism to 75.73 (6.92) years with CAD and without non-age-related hypogonadism. Following the safety communication, immediate changes in off-label testosterone prescription levels fell by 0.22 percentage points (pp) (95% confidence interval [CI] -0.33 to -0.11) for patients with CAD and by -0.16 pp (95% CI -0.19 to -0.16) for patients without CAD. A similar change was noticed in on-label prescribing levels. Off-label testosterone prescription quarterly trend, however, increased for patients with CAD and without CAD; on-label testosterone prescription trends declined for both groups. Declines in off-label prescribing were larger when treated by primary care physicians vs. non-primary care physicians, and physicians affiliated with teaching compared to nonteaching hospitals. Physician and organizational characteristics were not associated with changes in on-label prescribing.

CONCLUSION

On-label and off-label testosterone therapy declined following the FDA safety communication. Certain physician characteristics were associated with changes in off-label, but not on-label, prescribing.

Variation in Low-Value Service Use Across Veterans Affairs Facilities

BACKGROUND

It is unclear whether extensive variation in the use of low-value services exists even within a national integrated delivery system like the Veterans Health Administration (VA).

OBJECTIVE

To quantify variation in the use of low-value services across VA facilities and examine associations between facility characteristics and low-value service use.

DESIGN

In this retrospective cross-sectional study of VA administrative data, we constructed facility-level rates of low-value service use as the mean count of 29 low-value services per 100 Veterans per year. Adjusted rates were calculated via ordinary least squares regression including covariates for Veteran sociodemographic and clinical characteristics. We quantified the association between adjusted facility-level rates and facility geographic/operational characteristics.

PARTICIPANTS

5,242,301 patients across 139 VA facilities.

MAIN MEASURES

Use of 29 low-value services within six domains: cancer screening, diagnostic/preventive testing, preoperative testing, imaging, cardiovascular testing and procedures, and surgery.

KEY RESULTS

The mean rate of low-value service use was 20.0 services per 100 patients per year (S.D. 6.1). Rates ranged from 13.9 at the 10th percentile to 27.6 at the 90th percentile (90th/10th percentile ratio 2.0, 95% CI 1.8‒2.3). With adjustment for patient covariates, variation across facilities narrowed (S.D. 5.2, 90th/10th percentile ratio 1.8, 95% CI 1.6‒1.9). Only one facility characteristic was positively associated with low-value service use percent of patients seeing non-VA clinicians via VA Community Care, p < 0.05); none was associated with total low-value service use after adjustment for other facility characteristics. There was extensive variation in low-value service use within categories of facility operational characteristics.

CONCLUSIONS

Despite extensive variation in the use of low-value services across VA facilities, we observed substantial use of these services across facility operational characteristics and at facilities with lower rates of low-value service use. Thus, system-wide interventions to address low-value services may be more effective than interventions targeted to specific facilities or facility types.

Who's Accountable? Low-Value Care Received By Medicare Beneficiaries Outside Of Their Attributed Health Systems

Policy makers and payers increasingly hold health systems accountable for spending and quality for their attributed beneficiaries. Low-value care-medical services that offer little or no benefit and have the potential for harm in specific clinical scenarios-received outside of these systems could threaten success on both fronts. Using national Medicare data for fee-for-service beneficiaries ages sixty-five and older and attributed to 595 US health systems, we describe where and from whom they received forty low-value services during 2017-18 and identify factors associated with out-of-system receipt. Forty-three percent of low-value services received by attributed beneficiaries originated from out-of-system clinicians: 38 percent from specialists, 4 percent from primary care physicians, and 1 percent from advanced practice clinicians. Recipients of low-value care were more likely to obtain that care out of system if age 75 or older (versus ages 65-74), male (versus female), non-Hispanic White (versus other races or ethnicities), rural dwelling (versus metropolitan dwelling), more medically complex, or experiencing lower continuity of care. However, out-of-system service receipt was not associated with recipients' health systems' accountable care organization status. Health systems might improve quality and reduce spending for their attributed beneficiaries by addressing out-of-system receipt of low-value care-for example, by improving continuity.

Performance on Patient Experience Measures of Former Chief Medical Residents as Physician Exemplars Chosen by the Profession

Importance

Physicians' knowledge about each other's quality is central to clinical decision-making, but such information is not well understood and is rarely harnessed to identify exemplars for disseminating best practices or quality improvement. One exception is chief medical resident selection, which is typically based on interpersonal, teaching, and clinical skills.

Objective

To compare care for patients of primary care physicians (PCPs) who were former chiefs with care for patients of nonchief PCPs.

Design, Setting, and Participants

Using 2010 to 2018 Medicare Fee-For-Service Consumer Assessment of Healthcare Providers and Systems (CAHPS) survey data (response rate, 47.6%), Medicare claims for random 20% samples of fee-for-service beneficiaries, and medical board data from 4 large US states, we compared care for patients of former chief PCPs with care for patients of nonchief PCPs in the same practice using linear regression. Data were analyzed from August 2020 to January 2023.

Exposures

Receiving the plurality of primary care office visits from a former chief PCP.

Main Outcomes and Measures

Composite of 12 patient experience items as primary outcome and 4 spending and utilization measures as secondary outcomes.

Results

The CAHPS samples included 4493 patients with former chief PCPs and 41 278 patients with nonchief PCPs. The 2 groups were similar in age (mean [SD], 73.1 [10.3] years vs 73.2 [10.3] years), sex (56.8% vs 56.8% female), race and ethnicity (1.2% vs 1.0% American Indian or Alaska Native, 1.3% vs 1.9% Asian or Pacific Islander, 4.8% vs. 5.6% Hispanic, 7.3% vs 6.6% non-Hispanic Black, and 81.5% vs. 80.0% non-Hispanic White), and other characteristics. The Medicare claims for random 20% samples included 289 728 patients with former chief PCPs and 2 954 120 patients with nonchief PCPs. Patients of former chief PCPs rated their care experiences significantly better than patients of nonchief PCPs (adjusted difference in composite, 1.6 percentage points; 95% CI, 0.4-2.8; effect size of 0.30 standard deviations (SD) of the physician-level distribution of performance; P = .01), including markedly higher ratings of physician-specific communication and interpersonal skills typically emphasized in chief selection. Differences were large for patients of racial and ethnic minority groups (1.16 SD), dual-eligible patients (0.81 SD), and those with less education (0.44 SD) but did not vary significantly across groups. Differences in spending and utilization were minimal overall.

Conclusions and Relevance

In this study, patients of PCPs who were former chief medical residents reported better care experiences than patients of other PCPs in the same practice, especially for physician-specific items. The study results suggest that the profession possesses information about physician quality, motivating the development and study of strategies for harnessing such information to select and repurpose exemplars for quality improvement.

Stratification of Spine Patients based on Self-Reported Clinical Symptom Classes: Evaluation of Long-Term Outcomes and Subsequent Interventions

Background

Prior work by our group developed a stratification tool based on four PROMIS domains for patients with low back pain (LBP). Our study aimed to evaluate the ability of our previously developed symptom classes to predict long-term outcomes, and determine whether there were differential treatment effects by intervention.

Methods

This was a retrospective cohort study of adult patients with LBP seen in spine clinics in a large health system between November 14, 2018 and May 14, 2019 who completed patient-reported outcomes as part of routine care at baseline and again at 12-months follow-up. Latent class analysis identified symptom classes based on PROMIS domain scores (physical function, pain interference, social role satisfaction, and fatigue) that were ≥1 standard deviation worse (meaningfully worse) than the general population. The ability of the profiles to predict long-term outcomes at 12-months was evaluated through multivariable models. Differences in outcomes by subsequent treatments (physical therapy, specialist visits, injections, and surgery) were investigated.

Results

There were 3,236 adult patients (average age 61.1 ± 14.2, 55.4% female) included in the study with three distinct classes identified: mild symptoms (n = 986, 30.5%), mixed (n = 798, 24.7%) with poor scores on physical function and pain interference but better scores on other domains, and significant symptoms (n = 1,452, 44.9%). The classes were significantly associated with long-term outcomes, with patients with significant symptoms improving the most across all domains. Utilization differed across classes, with the mixed symptom class receiving more PT and injections and significant symptom class receiving more surgeries and specialist visits.

Conclusions

Patients with LBP have distinct clinical symptom classes which could be utilized to stratify patients into groups based on risk of future disability. These symptom classes can also be used to provide estimates of the effectiveness of different interventions, further increasing the clinical utility of these classes in standard care.

Organization and Performance of US Health Systems

IMPORTANCE

Health systems play a central role in the delivery of health care, but relatively little is known about these organizations and their performance.

OBJECTIVE

To (1) identify and describe health systems in the United States; (2) assess differences between physicians and hospitals in and outside of health systems; and (3) compare quality and cost of care delivered by physicians and hospitals in and outside of health systems.

EVIDENCE REVIEW

Health systems were defined as groups of commonly owned or managed entities that included at least 1 general acute care hospital, 10 primary care physicians, and 50 total physicians located within a single hospital referral region. They were identified using Centers for Medicare & Medicaid Services administrative data, Internal Revenue Service filings, Medicare and commercial claims, and other data. Health systems were categorized as academic, public, large for-profit, large nonprofit, or other private systems. Quality of preventive care, chronic disease management, patient experience, low-value care, mortality, hospital readmissions, and spending were assessed for Medicare beneficiaries attributed to system and nonsystem physicians. Prices for physician and hospital services and total spending were assessed in 2018 commercial claims data. Outcomes were adjusted for patient characteristics and geographic area.

FINDINGS

A total of 580 health systems were identified and varied greatly in size. Systems accounted for 40% of physicians and 84% of general acute care hospital beds and delivered primary care to 41% of traditional Medicare beneficiaries. Academic and large nonprofit systems accounted for a majority of system physicians (80%) and system hospital beds (64%). System hospitals were larger than nonsystem hospitals (67% vs 23% with >100 beds), as were system physician practices (74% vs 12% with >100 physicians). Performance on measures of preventive care, clinical quality, and patient experience was modestly higher for health system physicians and hospitals than for nonsystem physicians and hospitals. Prices paid to health system physicians and hospitals were significantly higher than prices paid to nonsystem physicians and hospitals (12%-26% higher for physician services, 31% for hospital services). Adjusting for practice size attenuated health systems differences on quality measures, but price differences for small and medium practices remained large.

CONCLUSIONS AND RELEVANCE

In 2018, health system physicians and hospitals delivered a large portion of medical services. Performance on clinical quality and patient experience measures was marginally better in systems but spending and prices were substantially higher. This was especially true for small practices. Small quality differentials combined with large price differentials suggests that health systems have not, on average, realized their potential for better care at equal or lower cost.

Assessing patient, physician, and practice characteristics predicting the use of low-value services

OBJECTIVE

To examine characteristics of beneficiaries, physicians, and their practice sites associated with greater use of low-value services (LVS) using LVS measures that reflect current care practices.

DATA SOURCES

This study was conducted in the context of a large, nationwide primary care redesign initiative (Comprehensive Primary Care Plus), using Medicare claims data in 2018.

STUDY DESIGN

We examined beneficiary-level total counts of LVS based on the existing 31 claims-based measures updated by excluding three services provided with diminishing frequency to Medicare beneficiaries and by replacing these with more recently identified LVS. We estimated hierarchical linear models with an extensive list of beneficiary, physician, and practice site characteristics to examine the contribution of characteristics at each level in predicting greater use of LVS. We also examined the proportion of variation in LVS use attributable to the set of characteristics at each level.

DATA COLLECTION/EXTRACTION METHODS

The study included 5,074,642 Medicare fee-for-service beneficiaries attributed to 32,406 primary care physicians in 11,009 primary care practice sites.

PRINCIPAL FINDINGS

Patients with disabilities, end-stage renal disease, and those in regions with higher poverty rates receive 10 (standard error [SE] = 3.0), 80 (SE = 14.0), and 10 (SE = 1.0) more LVS per 1000 beneficiaries across all 31 measures combined than patients without such attributes, respectively. Greater physician comprehensiveness and an increase in the number of primary care practitioners at a practice were associated with 40 (SE = 20.0) and 20 (SE = 6.0) fewer LVS per 1000 beneficiaries, respectively. Yet, the explanatory variables we examined only account for 11 percent of the variation in LVS use, with most of the variation (87 percent) being due to unobserved differences at the beneficiary level.

CONCLUSIONS

Unexplained residual variation, from underlying patient preferences and behavior of non-primary care providers, could be important determinants of LVS use.

Organizational influences on the use of low-value care in primary health care - a qualitative interview study with physicians in Sweden

AIM

The aim was (1) to explore organizational factors influencing the use of low-value care (LVC) as perceived by primary care physicians and (2) to explore which organizational strategies they believe are useful for reducing the use of LVC.

DESIGN

Qualitative study with semi-structured focus group discussions (FGDs) analyzed using qualitative content analysis.

SETTING

Six publicly owned primary health care centers in Stockholm.

SUBJECTS

The participants were 31 primary care physicians. The number of participants in each FGD varied between 3 and 7.

MAIN OUTCOME MEASURES

Categories and subcategories reporting organizational factors perceived to influence the use of LVC and organizational strategies considered useful for reducing the use of LVC.

RESULTS

Four types of organizational factors (resources, care processes, improvement activities, and governance) influenced the use of LVC. Resources involved time to care for patients, staff knowledge, and working tools. Care processes included work routines and the ways activities and resources were prioritized in the organization. Improvement activities involved performance measurement and improvement work to reduce LVC. Governance concerned organizational goals, higher-level decision making, and policies. Physicians suggested multiple strategies targeting these factors to reduce LVC, including increased patient-physician continuity, adjusted economic incentives, continuous professional development for physicians, and gatekeeping functions which prevent unnecessary appointments and guide patients to the appropriate point of care. .

CONCLUSION

The influence of multiple organizational factors throughout the health-care system indicates that a whole-system approach might be useful in reducing LVC.KEY POINTSWe know little about how organizational factors influence the use of low-value care (LVC) in primary health care.Physicians perceive organizational resources, care processes, improvement activities, and governance as influences on the use of LVC and LVC-reducing strategies.This study provides insights about how these factors influence LVC use.Strategies at multiple levels of the health-care system may be warranted to reduce LVC.

Practice Billing for Medicare Advance Care Planning Across the USA

BACKGROUND

Medicare introduced billing codes in 2016 to encourage clinicians to engage in advance care planning (ACP) and promote goal-concordantend-of-life care, but uptake has been modest. While prior research examined individual-level factors in ACP billing, organization-level factors associated with physician practices billing for ACP remain unknown.

OBJECTIVE

Examine the role of practices in ACP billing.

DESIGN

Retrospective cohort study analyzing 2016-2018 national Medicare data.

PARTICIPANTS

A total of 53,926 practices with at least 10 attributed Medicare beneficiaries.

MAIN MEASURES

Outcomes were practice-level ACP billing (any use by the practice) and ACP use rate by practice-attributed beneficiaries. Practice characteristics were number of beneficiaries attributed to the practice; percentage of beneficiaries by race, Medicare-Medicaid dual enrollment, sex, and age; practice size; and specialty mix.

KEY RESULTS

Fifteen percent of practices billed for ACP. In adjusted models, we found higher odds of ACP billing and higher ACP use rates among practices with more primary care physicians (billing AOR: 10.01, 95%CI: 8.81-11.38 for practices with 75-100% (vs 0) primary care physicians), and those serving more Medicare beneficiaries (billing AOR: 4.55, 95%CI 4.08-5.08 for practices with highest (vs lowest) quintile of beneficiaries), and larger shares of female beneficiaries (billing AOR: 3.06, 95% CI 2.01-4.67 for 75-100% (vs <25%) female ).

CONCLUSIONS

Several years after Medicare introduced ACP reimbursements for physicians, relatively few practices bill for ACP. ACP billing was more likely in large practices with a greater percentage of primary care physicians. To increase ACP billing uptake, policymakers and health system leaders might target interventions to larger practices where a small number of physicians already bill for ACP and to specialty practices that serve as the primary source of care for seriously ill patients.

Low-Value Prostate-Specific Antigen Test for Prostate Cancer Screening and Subsequent Health Care Utilization and Spending

IMPORTANCE

Delivering low-value care can lead to unnecessary follow-up services and associated costs, and such care cascades have not been well examined in common clinical scenarios.

OBJECTIVE

To evaluate the utilization and costs of care cascades of prostate-specific antigen (PSA) tests for prostate cancer screening, as the routine use of which among asymptomatic men aged 70 years and older is discouraged by multiple guidelines.

DESIGN, SETTING, AND PARTICIPANTS

This cross-sectional study included men aged 70 years and older without preexisting prostate conditions enrolled in a Medicare Advantage plan during January 2016 to December 2018 with at least 1 outpatient visit. Medical billing claims data from the deidentified OptumLabs Data Warehouse were used. Data analysis was conducted from September 2020 to August 2021.

EXPOSURES

At least 1 claim for low-value PSA tests for prostate cancer screening during the observation period.

MAIN OUTCOMES AND MEASURES

Utilization of and spending on low-value PSA cancer screening and associated care cascades and the difference in overall health care utilization and spending among individuals receiving low-value PSA cancer screening vs those who did not, adjusting for observed characteristics using inverse probability of treatment weighting.

RESULTS

Of 995 442 men (mean [SD] age, 78.0 [5.6] years) aged 70 years or older in a Medicare Advantage plan included in this study, 384 058 (38.6%) received a low-value PSA cancer screening. Utilization increased for each subsequent cohort from 2016 to 2018 (49 802 of 168 951 [29.4%] to 134 404 of 349 228 [38.5%] to 199 852 of 477 203 [41.9%]). Among those receiving initial low-value PSA cancer screening, 241 188 of 384 058 (62.8%) received at least 1 follow-up service. Repeated PSA testing was the most common, and 27 268 (7.1%) incurred high-cost follow-up services, such as imaging, radiation therapy, and prostatectomy. Utilization and spending associated with care cascades also increased from 2016 to 2018. For every $1 spent on a low-value PSA cancer screening, an additional $6 was spent on care cascades. Despite avoidable care cascades, individuals who received low-value PSA cancer screening were not associated with increased overall health care utilization and spending during the 1-year follow-up period compared with an unscreened population.

CONCLUSIONS AND RELEVANCE

In this cross-sectional study, low-value PSA tests for prostate cancer screening remained prevalent among Medicare Advantage plan enrollees and were associated with unnecessary expenditures due to avoidable care cascades. Innovative efforts from clinicians and policy makers, such as payment reforms, to reduce initial low-value care and avoidable care cascades are warranted to decrease harm, enhance equity, and improve health care efficiency.

Development and validation of a new ICD-10-based screening colonoscopy overuse measure in a large integrated healthcare system: a retrospective observational study

BACKGROUND

Low-value use of screening colonoscopy is wasteful and potentially harmful to patients. Decreasing low-value colonoscopy prevents procedural complications, saves patient time and reduces patient discomfort, and can improve access by reducing procedural demand. The objective of this study was to develop and validate an electronic measure of screening colonoscopy overuse using International Classification of Diseases, Tenth Edition codes and then apply this measure to estimate facility-level overuse to target quality improvement initiatives to reduce overuse in a large integrated healthcare system.

METHODS

Retrospective national observational study of US Veterans undergoing screening colonoscopy at 119 Veterans Health Administration (VHA) endoscopy facilities in 2017. A measure of screening colonoscopy overuse was specified by an expert workgroup, and electronic approximation of the measure numerator and denominator was performed ('electronic measure'). The electronic measure was then validated via manual record review (n=511). Reliability statistics (n=100) were calculated along with diagnostic test characteristics of the electronic measure. The measure was then applied to estimate overall rates of overuse and facility-level variation in overuse among all eligible patients.

RESULTS

The electronic measure had high specificity (99%) and moderate sensitivity (46%). Adjusted positive predictive value and negative predictive value were 33% and 95%, respectively. Inter-rater reliability testing revealed near perfect agreement between raters (k=0.81). 269 572 colonoscopies were performed in VHA in 2017 (88 143 classified as screening procedures). Applying the measure to these 88 143 screening colonoscopies, 24.5% were identified as potential overuse. Median facility-level overuse was 22.5%, with substantial variability across facilities (IQR 19.1%-27.0%).

CONCLUSIONS

An International Classification of Diseases, Tenth Edition based electronic measure of screening colonoscopy overuse has high specificity and improved sensitivity compared with a previous International Classification of Diseases, Ninth Edition based measure. Despite increased focus on reducing low-value care and improving access, a quarter of VHA screening colonoscopies in 2017 were identified as potential low-value procedures, with substantial facility-level variability.

Analysis of Affordable Health Care

BACKGROUND

Lack of affordable health care affects the uninsured, commercially insured, and Medicare beneficiaries. Yet, the wide variation in providers' prices and practice styles suggests that more affordable care already may be available and data on low value and wasteful care suggest that lower cost care need not come at the expense of better quality. Although price variation has received the most attention in the literature and legislation, total cost of care is a function of both unit prices (fees) and the quantity of services.

OBJECTIVE

To partition provider-specific variation in total annual risk-adjusted per capita expenditures on health care services into variation in unit prices (fees) versus quantities of services, and to explore the relationship between low value, avoidable, discretionary, and recommended care to total health expenditures. The analysis is important because both prices and quantities of services can affect affordability and reductions in prices versus quantities have very different effects on providers' profits.

SETTING

2018 data from the Minnesota State Employees Group Insurance Program (SEGIP) that offers a tiered cost-sharing health insurance benefit design to 130,000 State employees and their dependents (SEGIP "members").

EXPOSURE

Each year during open enrollment, SEGIP members choose a primary care clinic (PCC). The PCC can make decisions regarding both unit prices and prescribed services. PCCs are placed in one of four cost-sharing tiers based on the total annual risk-adjusted per capita health expenditures for the SEGIP members who choose their clinic. Members choosing higher cost PCCs face higher deductibles, copayments, and maximum out-of-pocket spending limits.

MEASURES

Overall prices and use of inpatient, outpatient hospital, professional, and pharmaceutical services, total and avoidable use of emergency department visits and inpatient admissions, low value care, testing for patients with pneumonia, and recommended preventive care.

RESULTS

Differences in total risk-adjusted annual per capita health expenditures across the care systems were substantial. Higher cost providers had both higher unit prices and higher use of services. Variation in the quantity of health care services explained more of the variance in total spending than variation in prices. Prices for professional services and use of inpatient, outpatient hospital, and pharmaceutical services, and ambulatory care sensitive admissions, contributed significantly to high total expenditures. Lower cost PCCs in the lowest cost-sharing tier had higher rates of low value care and lower emergency department visits per capita. Neither the number of investigations for patients with pneumonia nor the receipt of recommended mammography screening varied systematically by tier.

CONCLUSIONS

Efforts to identify and expand sources of affordable care, including improved information and incentives for consumers, need to account for variation in both prices and quantities of services. Efforts to encourage more efficient use of health care services by providers need to consider the effect of those efforts on the provider's internal costs and thus their profits.

Identifying drivers of health care value: a scoping review of the literature

Background

As health care spending reaches unsustainable levels, improving value has become an increasingly important policy priority. Relatively little research has explored factors driving value. As a first step towards filling this gap, we performed a scoping review of the literature to identify potential drivers of health care value.

Methods

Searches of PubMed, Embase, Google Scholar, Policy File, and SCOPUS were conducted between February and March 2020. Empirical studies that explored associations between any range of factors and value (loosely defined as quality or outcomes relative to cost) were eligible for inclusion. We created a template in Microsoft Excel for data extraction and evaluated the quality of included articles using the Critical Appraisal Skills Programme (CASP) quality appraisal tool. Data was synthesized using narrative methods.

Results

Twenty-two studies were included in analyses, of which 20 focused on low value service utilization. Independent variables represented a range of system-, hospital-, provider-, and patient-level characteristics. Although results were mixed, several consistent findings emerged. First, insurance incentive structures may affect value. For example, patients in Accountable Care Organizations had reduced rates of low value care utilization compared to patients in traditionally structured insurance plans. Second, higher intensity of care was associated with higher rates of low value care. Third, culture is likely to contribute to value. This was suggested by findings that recent medical school graduation and allopathic training were associated with reduced low value service utilization and that provider organizations had larger effects on value than did individual physicians.

Conclusions

System, hospital, provider, and community characteristics influence low value care provision. To improve health care value, strategies aiming to reduce utilization of low value services and promote high value care across various levels will be essential.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08225-6.

Longitudinal Content Analysis of the Characteristics and Expected Impact of Low-Value Services Identified in US Choosing Wisely Recommendations

IMPORTANCE

The US Choosing Wisely campaign has had substantial reach in mobilizing efforts to reduce low-value care, achieved largely by engaging physician specialty societies in stewardship. While some early recommendations were criticized for avoiding revenue-generating services, there is limited evidence of how the composition of recommendations shifted as more societies contributed.

OBJECTIVE

To analyze the characteristics and expected impact of Choosing Wisely recommendations.

DESIGN, SETTING, AND PARTICIPANTS

This qualitative study included content and trend analyses of all 626 Choosing Wisely recommendations by US physician societies as of March 1, 2021. Data were analyzed between March and May 2021.

MAIN OUTCOMES AND MEASURES

Primary outcomes were proportions of identified low-value services by characteristics (society type, service type, indication, do vs avoid, and clinical context) and expected impact (effect on the revenue of society members, cost, number of individuals at risk, direct harm potential, and cascade potential).

RESULTS

Low-value services identified in the 626 Choosing Wisely recommendations largely covered imaging (168 [26.8%]) and laboratory studies (156 [24.9%]) in the context of chronic conditions (169 [27.0%]) and healthy patients with risk factors alone (126 [20.1%]). Most of the identified low-value services were revenue neutral for the recommending society (402 [64.2%]) and the plurality were low cost (<$200; 284 [45.4%]); low-cost services represented a growing share of low-value services identified by Choosing Wisely recommendations (1.2 percentage points per year; P = .001). Nearly half (280 [44.7%]) of recommendations identified services with high direct harm potential, and 388 (62.0%) identified those with high potential for cascades (ie, triggering downstream services).

CONCLUSIONS AND RELEVANCE

The results of this qualitative study suggest that the Choosing Wisely recommendations identified services with a range of expected impacts. Stakeholders could explicitly set priorities for future recommendations, while clinical leaders and payers might target intervention efforts on recommendations with the greatest potential for impact based on spending across populations, direct harms, and cascades.

Development of a Metric to Detect and Decrease Low-Value Prescribing in Older Adults

IMPORTANCE

Metrics that detect low-value care in common forms of health care data, such as administrative claims or electronic health records, primarily focus on tests and procedures but not on medications, representing a major gap in the ability to systematically measure low-value prescribing.

OBJECTIVE

To develop a scalable and broadly applicable metric that contains a set of quality indicators (EVOLV-Rx) for use in health care data to detect and reduce low-value prescribing among older adults and that is informed by diverse stakeholders' perspectives.

DESIGN, SETTING, AND PARTICIPANTS

This qualitative study used an online modified-Delphi method to convene an expert panel of 15 physicians and pharmacists. This panel, comprising clinicians, health system leaders, and researchers, was tasked with rating and discussing candidate low-value prescribing practices that were derived from medication safety criteria; peer-reviewed literature; and qualitative studies of patient, caregiver, and physician perspectives. The RAND ExpertLens online platform was used to conduct the activities of the panel. The panelists were engaged for 3 rounds between January 1 and March 31, 2021.

MAIN OUTCOMES AND MEASURES

Panelists used a 9-point Likert scale to rate and then discuss the scientific validity and clinical usefulness of the criteria to detect low-value prescribing practices. Candidate low-value prescribing practices were rated as follows: 1 to 3, indicating low validity or usefulness; 3.5 to 6, uncertain validity or usefulness; and 6.5 to 9, high validity or usefulness. Agreement among panelists and the degree of scientific validity and clinical usefulness were assessed using the RAND/UCLA (University of California, Los Angeles) Appropriateness Method.

RESULTS

Of the 527 low-value prescribing recommendations identified, 27 discrete candidate low-value prescribing practices were considered for inclusion in EVOLV-Rx. After round 1, 18 candidate practices were rated by the panel as having high scientific validity and clinical usefulness (scores of ≥6.5). After round 2 panel deliberations, the criteria to detect 19 candidate practices were revised. After round 3, 18 candidate practices met the inclusion criteria, receiving final median scores of 6.5 or higher for both scientific validity and clinical usefulness. Of those practices that were not included in the final version of EVOLV-Rx, 3 received high scientific validity (scores ≥6.5) but uncertain clinical usefulness (scores <6.5) ratings, whereas 6 received uncertain scientific validity rating (scores <6.5).

CONCLUSIONS AND RELEVANCE

This study culminated in the development of EVOLV-Rx and involved a panel of experts who identified the 18 most salient low-value prescribing practices in the care of older adults. Applying EVOLV-Rx may enhance the detection of low-value prescribing practices, reduce polypharmacy, and enable older adults to receive high-value care across the full spectrum of health services.

Low-Value Care at the Actionable Level of Individual Health Systems

IMPORTANCE

Low-value health care remains prevalent in the US despite decades of work to measure and reduce such care. Efforts have been only modestly effective in part because the measurement of low-value care has largely been restricted to the national or regional level, limiting actionability.

OBJECTIVES

To measure and report low-value care use across and within individual health systems and identify system characteristics associated with higher use using Medicare administrative data.

DESIGN, SETTING, AND PARTICIPANTS

This retrospective cohort study of health system-attributed Medicare beneficiaries was conducted among 556 health systems in the Agency for Healthcare Research and Quality Compendium of US Health Systems and included system-attributed beneficiaries who were older than 65 years, continuously enrolled in Medicare Parts A and B for at least 12 months in 2016 or 2017, and eligible for specific low-value services. Statistical analysis was conducted from January 26 to July 15, 2021.

MAIN OUTCOMES AND MEASURES

Use of 41 individual low-value services and a composite measure of the 28 most common services among system-attributed beneficiaries, standardized to distance from the mean value. Measures were based on the Milliman MedInsight Health Waste Calculator and published claims-based definitions.

RESULTS

Across 556 health systems serving a total of 11 637 763 beneficiaries, the mean (SD) use of each of the 41 low-value services ranged from 0% (0.01%) to 28% (4%) of eligible beneficiaries. The most common low-value services were preoperative laboratory testing (mean [SD] rate, 28% [4%] of eligible beneficiaries), prostate-specific antigen testing in men older than 70 years (mean [SD] rate, 27% [8%]), and use of antipsychotic medications in patients with dementia (mean [SD] rate, 24% [8%]). In multivariable analysis, the health system characteristics associated with higher use of low-value care were smaller proportion of primary care physicians (adjusted composite score, 0.15 [95% CI, 0.04-0.26] for systems with less than the median percentage of primary care physicians vs -0.16 [95% CI, -0.27 to -0.05] for those with more than the median percentage of primary care physicians; P < .001), no major teaching hospital (adjusted composite, 0.10 [95% CI, -0.01 to 0.20] without a teaching hospital vs -0.18 [95% CI, -0.34 to -0.02] with a teaching hospital; P = .01), larger proportion of non-White patients (adjusted composite, 0.15 [95% CI, -0.02 to 0.32] for systems with >20% of non-White beneficiaries vs -0.06 [95% CI, -0.16 to 0.03] for systems with ≤20% of non-White beneficiaries; P = .04), headquartered in the South or West (adjusted composite, 0.28 [95% CI, 0.14-0.43] for the South and 0.22 [95% CI, 0.02-0.42] for the West compared with -0.09 [95% CI, -0.26 to 0.08] for the Northeast and -0.44 [95% CI, -0.60 to -0.28] for the Midwest; P < .001), and serving areas with more health care spending (adjusted composite, 0.23 [95% CI, 0.11-0.35] for areas above the median level of spending vs -0.24 [95% CI, -0.36 to -0.12] for areas below the median level of spending; P < .001).

CONCLUSIONS AND RELEVANCE

The findings of this large cohort study suggest that system-level measurement and reporting of specific low-value services is feasible, enables cross-system comparisons, and reveals a broad range of low-value care use.

An Evidence Review of Low-Value Care Recommendations: Inconsistency and Lack of Economic Evidence Considered

BACKGROUND

Low-value care, typically defined as health services that provide little or no benefit, has potential to cause harm, incur unnecessary costs, and waste limited resources. Although evidence-based guidelines identifying low-value care have increased, the guidelines differ in the type of evidence they cite to support recommendations against its routine use.

OBJECTIVE

We examined the evidentiary rationale underlying recommendations against low-value interventions.

DESIGN

We identified 1167 "low-value care" recommendations across five US organizations: the US Preventive Services Task Force (USPSTF), the "Choosing Wisely" Initiative, American College of Physicians (ACP), American College of Cardiology/American Heart Association (ACC/AHA), and American Society of Clinical Oncology (ASCO). For each recommendation, we classified the reported evidentiary rationale into five groups: (1) low economic value; (2) no net clinical benefit; (3) little or no absolute clinical benefit; (4) insufficient evidence; (5) no reason mentioned. We further investigated whether any cited or otherwise available cost-effectiveness evidence was consistent with conventional low economic value benchmarks (e.g., exceeding $100,000 per quality-adjusted life-year).

RESULTS

Of the identified low-value care recommendations, Choosing Wisely contributed the most (N=582, 50%), followed by ACC/AHA (N=250, 21%). The services deemed "low value" differed substantially across organizations. "No net clinical benefit" (N=428, 37%) and "little or no clinical benefit" (N=296, 25%) were the most commonly reported reasons for classifying an intervention as low value. Consideration of economic value was less frequently reported (N=171, 15%). When relevant cost-effectiveness studies were available, their results were mostly consistent with low-value care recommendations.

CONCLUSIONS

Our study found that evidentiary rationales for low-value care vary substantially, with most recommendations relying on clinical evidence. Broadening the evidence base to incorporate cost-effectiveness evidence can help refine the definition of "low-value" care to reflect whether an intervention's costs are worth the benefits. Developing a consensus grading structure on the strength and evidentiary rationale may help improve de-implementation efforts for low-value care.

The Impact of Choosing Wisely Interventions on Low-Value Medical Services: A Systematic Review

Policy Points Dissemination of Choosing Wisely guidelines alone is unlikely to reduce the use of low-value health services. Interventions by health systems to implement Choosing Wisely guidelines can reduce the use of low-value services. Multicomponent interventions targeting clinicians are currently the most effective types of interventions.

CONTEXT

Choosing Wisely aims to reduce the use of unnecessary, low-value medical services through development of recommendations related to service utilization. Despite the creation and dissemination of these recommendations, evidence shows low-value services are still prevalent. This paper synthesizes literature on interventions designed to reduce medical care identified as low value by Choosing Wisely and evaluates which intervention characteristics are most effective.

METHODS

We searched peer-reviewed and gray literature from the inception of Choosing Wisely in 2012 through June 2019 to identify interventions in the United States motivated by or using Choosing Wisely recommendations. We also included studies measuring the impact of Choosing Wisely on its own, without interventions. We developed a coding guide and established coding agreement. We coded all included articles for types of services targeted, components of each intervention, results of the intervention, study type, and, where applicable, study quality. We measured the success rate of interventions, using chi-squared tests or Wald tests to compare across interventions.

FINDINGS

We reviewed 131 articles. Eighty-eight percent of interventions focused on clinicians only; 48% included multiple components. Compared with dissemination of Choosing Wisely recommendations only, active interventions were more likely to generate intended results (65% vs 13%, p < 0.001) and, among those, interventions with multiple components were more successful than those with one component (77% vs 47%, p = 0.002). The type of services targeted did not matter for success. Clinician-based interventions were more effective than consumer-based, though there is a dearth of studies on consumer-based interventions. Only 17% of studies included a control arm.

CONCLUSIONS

Interventions built on the Choosing Wisely recommendations can be effective at changing practice patterns to reduce the use of low-value care. Interventions are more effective when targeting clinicians and using more than one component. There is a need for high-quality studies that include active controls.

Adverse Events and Hospital-Acquired Conditions Associated With Potential Low-Value Care in Medicare Beneficiaries

Question

What is the prevalence and cost of hospital-acquired conditions (HACs) and patient safety events (PSIs) associated with procedures that may be low value?

Findings

In this retrospective claims analysis of a cohort of Medicare fee-for-service beneficiaries, there were 231 HACs and 1764 PSIs in 197 755 claims for 7 inpatient procedures from 2016 to 2018.

Meaning

Patients with flagged, potential low-value procedures were harmed while in hospital, resulting in an extended length of stay and additional costs.

Importance

There has been insufficient research on the patient harms and costs associated with potential low-value procedures in the US Medicare population.

Objective

To report the prevalence of adverse events associated with potential low-value procedures and the additional hospital length of stay (LOS) and costs.

Design, Setting, and Participants

This is a retrospective cohort study using Medicare fee-for-service claims between January 2016 to December 2018. Participants were aged 65 years or older. Procedures were selected if they had previously published indicators of low-value care, including knee arthroscopy, spinal fusion, vertebroplasty, percutaneous coronary intervention (PCI), carotid endarterectomy, renal stenting, and hysterectomy for benign conditions. Analysis was conducted from July to December, 2020.

Main Outcomes and Measures

For inpatient procedures, the number and rate of admissions with a hospital-acquired condition (HAC) or patient safety indicator event (PSIs), as well as the unadjusted and adjusted difference in mean LOS and Medicare costs between admissions with and without a HAC/PSI. For outpatient procedures, we report the number of claims where the beneficiary had an unplanned hospital admission within seven days and the number of these admissions with a HAC/PSI.

Results

There were 573 351 patients included in the study, with 617 264 procedures; the mean (SD) age was 74.2 (6.7) years, with 320 637 women (55.9%), and mostly White patients (520 735; 90.8%). Among the 197 755 claims for the inpatient procedures, 231 had an HAC and 1764 had a PSI. Spinal fusion was associated with the most HACs (123 admissions) and PSIs (1015 admissions). Overall, HACs during a PCI admission were associated with the highest adjusted additional mean LOS (17.5 days; 95% CI, 10.3-23.6), with also the highest adjusted additional mean cost ($22 000; 95% CI, $9100-$32 600). There were 419 509 included outpatient procedures, and 7514 (1.8%) had an unplanned admission within 7 days. A total of 17 HACs and PSIs occurred in these admissions.

Conclusions and Relevance

In this cross-sectional cohort study of Medicare fee-for-service claims, patients receiving potential low-value care were exposed to risk of unnecessary harm associated with higher cost and LOS.

Association of Low-Value Care Exposure With Health Care Experience Ratings Among Patient Panels

IMPORTANCE

Patient reviews of health care experiences are increasingly used for public reporting and alternative payment models. Critics have argued that this incentivizes physicians to provide more care, including low-value care, undermining efforts to reduce wasteful practices.

OBJECTIVE

To assess associations between rates of low-value service provision to a primary care professional (PCP) patient panel and patients' ratings of their health care experiences.

DESIGN, SETTING, AND PARTICIPANTS

This quality improvement study used Medicare fee-for-service claims from January 1, 2007, to December 31, 2014, for a random 20% sample of beneficiaries to identify beneficiaries for whom each of 8 low-value services could be ordered but would be considered unnecessary. The study also used health care experience reports from independently sampled beneficiaries who responded to the 2010-2015 Consumer Assessment of Healthcare Providers and Systems (CAHPS) Medicare fee-for-service survey. Statistical analysis was performed from January 1, 2019, to December 9, 2020.

MAIN OUTCOMES AND MEASURES

The main outcomes were health care experience ratings from Medicare beneficiaries who responded to the CAHPS survey from 2 domains, namely "Your Health Care in the Last 6 Months" (overall health care, office wait time, timely access to nonurgent care, and timely access to urgent care) and "Your Personal Doctor" (overall personal physician and a composite score for interactions with personal physician). Beneficiaries in both samples were attributed to the PCP with whom they had the most spending. For each PCP, a composite score of low-value service exposure was constructed using the 20% sample; this score represented the adjusted relative propensity of the PCP patient panel to receive low-value care. The association between low-value service exposure and health care experience ratings reported by the CAHPS respondents in the PCP patient panel was estimated using regression analysis.

RESULTS

The final sample had 100 743 PCPs, with a mean of approximately 258 patients per PCP. Only 1 notable association was found; more low-value care exposure was associated with more frequent reports of having to wait more than 15 minutes after the scheduled time of an appointment (a mean of 0.448 points lower CAHPS score on a 10-point scale for PCP patient panels who received the most low-value care vs the least low-value care). Although some other associations were statistically significant, their magnitudes were substantially smaller than those typically considered meaningful in other CAHPS literature and were inconsistent in direction across levels of low-value service exposure.

CONCLUSIONS AND RELEVANCE

This quality improvement study found that more low-value care exposure for a PCP patient panel was not associated with more favorable patient ratings of their health care experiences.

Medicare's Care Management Codes Might Not Support Primary Care As Expected

To enhance compensation for primary care activities that occur outside of face-to-face visits, the Centers for Medicare and Medicaid Services recently introduced new billing codes for transitional care management (TCM) and chronic care management (CCM) services. Overall, rates of adoption of these codes have been low. To understand the patterns of adoption, we compared characteristics of the practices that billed for these services to those of the practices that did not and determined the extent to which a practice other than the beneficiary's usual primary care practice billed for the services. Larger practices and those using other novel billing codes were more likely to adopt TCM or CCM. Over a fifth of all TCM claims and nearly a quarter of all CCM claims were billed by a practice that was not the beneficiary's assigned primary care practice. Our results raise concerns about whether these codes are supporting primary care as originally expected.

Assessment of Overuse of Medical Tests and Treatments at US Hospitals Using Medicare Claims

Importance

Overuse of health care services exposes patients to unnecessary risk of harm and costs. Distinguishing patterns of overuse among hospitals requires hospital-level measures across multiple services.

Objective

To describe characteristics of hospitals associated with overuse of health care services in the US.

Design, Setting, and Participants

This retrospective cross-sectional analysis used Medicare fee-for-service claims data for beneficiaries older than 65 years from January 1, 2015, to December 31, 2017, with a lookback of 1 year. Inpatient and outpatient services were included, and services offered at specialty and federal hospitals were excluded. Patients were from hospitals with the capacity (based on a claims filter developed for this study) to perform at least 7 of 12 investigated services. Statistical analyses were performed from July 1, 2020, to December 20, 2020.

Main Outcomes and Measures

Outcomes of interest were a composite overuse score ranging from 0 (no overuse of services) to 1 (relatively high overuse of services) and characteristics of hospitals clustered by overuse rates. Twelve published low-value service algorithms were applied to the data to find overuse rates for each hospital, normalized and aggregated to a composite score and then compared across 6 hospital characteristics using multivariable regression. A k-means cluster analysis was used on normalized overuse rates to identify hospital clusters.

Results

The primary analysis was performed on 2415 cohort A hospitals (ie, hospitals with capacity for 7 or more services), which included 1 263 592 patients (mean [SD] age, 72.4 [14] years; 678 549 women [53.7%]; 101 017 191 White patients [80.5%]). Head imaging for syncope was the highest-volume low-value service (377 745 patients [29.9%]), followed by coronary artery stenting for stable coronary disease (199 579 [15.8%]). The mean (SD) composite overuse score was 0.40 (0.10) points. Southern hospitals had a higher mean score than midwestern (difference in means: 0.06 [95% CI, 0.05-0.07] points; P < .001), northeast (0.08 [95% CI, 0.06-0.09] points; P < .001), and western hospitals (0.08 [95% CI, 0.07-0.10] points; P < .001). Nonprofit hospitals had a lower adjusted mean score than for-profit hospitals (-0.03 [95% CI, -0.04 to -0.02] points; P < .001). Major teaching hospitals had significantly lower adjusted mean overuse scores vs minor teaching hospitals (difference in means, -0.07 [95% CI, -0.08 to -0.06] points; P < .001) and nonteaching hospitals (-0.10 [95% CI, -0.12 to -0.09] points; P < .001). Of the 4 clusters identified, 1 was characterized by its low counts of overuse in all services except for spinal fusion; the majority of major teaching hospitals were in this cluster (164 of 223 major teaching hospitals [73.5%]).

Conclusions and Relevance

This cross-sectional study used a novel measurement of hospital-associated overuse; results showed that the highest scores in this Medicare population were associated with nonteaching and for-profit hospitals, particularly in the South.

Effects of employer-offered high-deductible plans on low-value spending in the privately insured population

Enrollment in plans with high deductibles has increased more than seven-fold in the last decade. Proponents of these plans argue that high deductibles could reduce wasteful spending by providing patients with incentives to limit use of low-value services that offer little or no clinical benefit. Others are concerned that patients may respond to these incentives by reducing their use of medical services indiscriminately and regardless of clinical benefit, which may negatively impact health outcomes. This study uses individual-level insurance claims data (2008-2013) and plausibly exogenous changes in plan offerings within firms over time to estimate the intent-to-treat and local-average treatment effects of high-deductible plan offerings on spending on 24 low-value services received in the outpatient setting. We find that firm offer of a high-deductible plan leads to a 13.7% ($5.23) reduction in average enrollee spending on low-value outpatient services and a 5.2% ($105.77) reduction in overall outpatient spending. We also find reductions in spending on measures of low-value imaging and laboratory services. We find some evidence that offering high-deductible plans disproportionately reduces low-value spending relative to overall spending, indicating that deductibles may be a way to incentivize value-based decision making.

Development of a Simple Index to Measure Overuse of Diagnostic Testing at the Hospital Level Using Administrative Data

OBJECTIVE

We developed a diagnostic overuse index that identifies hospitals with high levels of diagnostic intensity by comparing negative diagnostic testing rates for common diagnoses.

METHODS

We prospectively identified candidate overuse metrics, each defined by the percentage of patients with a particular diagnosis who underwent a potentially unnecessary diagnostic test. We used data from seven states participating in the State Inpatient Databases. Candidate metrics were tested for temporal stability and internal consistency. Using mixed-effects ordinal regression and adjusting for regional and hospital characteristics, we compared results of our index with three Dartmouth health service area-level utilization metrics and three Medicare county-level cost metrics.

RESULTS

The index was comprised of five metrics with good temporal stability and internal consistency. It correlated with five of the six prespecified overuse measures. Among the Dartmouth metrics, our index correlated most closely with physician reimbursement, with an odds ratio of 2.02 (95% CI, 1.11-3.66) of being in a higher tertile of the overuse index when comparing tertiles 3 and 1 of this Dartmouth metric. Among the Medicare county-level metrics, our index correlated most closely with standardized costs of procedures per capita, with an odds ratio of 2.03 (95% CI, 1.21-3.39) of being in a higher overuse index tertile when comparing tertiles 3 and 1 of this metric.

CONCLUSIONS

We developed a novel overuse index that is preliminary in nature. This index is derived from readily available administrative data and shows some promise for measuring overuse of diagnostic testing at the hospital level.

Savings or Selection? Initial Spending Reductions in the Medicare Shared Savings Program and Considerations for Reform

Policy Points Concerns have been raised about risk selection in the Medicare Shared Savings Program (MSSP). Specifically, turnover in accountable care organization (ACO) physicians and patient panels has led to concerns that ACOs may be earning shared-savings bonuses by selecting lower-risk patients or providers with lower-risk panels. We find no evidence that changes in ACO patient populations explain savings estimates from previous evaluations through 2015. We also find no evidence that ACOs systematically manipulated provider composition or billing to earn bonuses. The modest savings and lack of risk selection in the original MSSP design suggest opportunities to build on early progress. Recent program changes provide ACOs with more opportunity to select providers with lower-risk patients. Understanding the effect of these changes will be important for guiding future payment policy.

CONTEXT

The Medicare Shared Savings Program (MSSP) establishes incentives for participating accountable care organizations (ACOs) to lower spending for their attributed fee-for-service Medicare patients. Turnover in ACO physicians and patient panels has raised concerns that ACOs may be earning shared-savings bonuses by selecting lower-risk patients or providers with lower-risk panels.

METHODS

We conducted three sets of analyses of Medicare claims data. First, we estimated overall MSSP savings through 2015 using a difference-in-differences approach and methods that eliminated selection bias from ACO program exit or changes in the practices or physicians included in ACO contracts. We then checked for residual risk selection at the patient level. Second, we reestimated savings with methods that address undetected risk selection but could introduce bias from other sources. These included patient fixed effects, baseline or prospective assignment, and area-level MSSP exposure to hold patient populations constant. Third, we tested for changes in provider composition or provider billing that may have contributed to bonuses, even if they were eliminated as sources of bias in the evaluation analyses.

FINDINGS

MSSP participation was associated with modest and increasing annual gross savings in the 2012-2013 entry cohorts of ACOs that reached $139 to $302 per patient by 2015. Savings in the 2014 entry cohort were small and not statistically significant. Robustness checks revealed no evidence of residual risk selection. Alternative methods to address risk selection produced results that were substantively consistent with our primary analysis but varied somewhat and were more sensitive to adjustment for patient characteristics, suggesting the introduction of bias from within-patient changes in time-varying characteristics. We found no evidence of ACO manipulation of provider composition or billing to inflate savings. Finally, larger savings for physician group ACOs were robust to consideration of differential changes in organizational structure among non-ACO providers (eg, from consolidation).

CONCLUSIONS

Participation in the original MSSP program was associated with modest savings and not with favorable risk selection. These findings suggest an opportunity to build on early progress. Understanding the effect of new opportunities and incentives for risk selection in the revamped MSSP will be important for guiding future program reforms.

Understanding Geographic Variation in Systemic Overuse Among the Privately Insured

BACKGROUND

Medical care overuse is a significant source of patient harm and wasteful spending. Understanding the drivers of overuse is essential to the design of effective interventions.

OBJECTIVE

We tested the association between structural factors of the health care delivery system and regional differences systemic overuse.

RESEARCH DESIGN

We conducted a retrospective analysis of deidentified claims for 18- to 64-year-old adults from the IBM MarketScan Commercial Claims and Encounters Database. We calculated a semiannual Johns Hopkins Overuse Index for each of the 375 Metropolitan Statistical Areas in the United States, from January 2011 to June 2015. We fit an ordinary least squares regression to model the Johns Hopkins Overuse Index as a function of regional characteristics of the health care system, adjusted for confounders and time.

RESULTS

The supply of regional health care resources was associated with systemic overuse in commercially insured beneficiaries. Regional characteristics associated with systemic overuse included number of physicians per 1000 residents (P=0.001) and higher Medicare malpractice geographic price cost index (P<0.001). Regions with a higher density of primary care physicians (P=0.008) and a higher proportion of hospital-based providers (P=0.016) had less systemic overuse. Differences in hospital and insurer market power were inversely associated with systemic overuse.

CONCLUSIONS

Systemic overuse is associated with observable, structural characteristics of the regional health care system. These findings suggest that interventions that aim to improve care efficiency via reductions in overuse should focus on the structural drivers of this phenomenon, rather than on the eradication of individual overused procedures.

Low-Value Back Imaging in the Care of Medicare Beneficiaries: A Comparison of Nurse Practitioners and Physician Assistants

Little is known about practice pattern differences between nurse practitioners (NPs) and physician assistants (PAs). We compared the rates of low-value back images ordered by NPs and PAs. For this comparison, we used 2012-2013 Medicare Part B claims for all beneficiaries in 18 hospital referral regions and a measure of low-value back imaging from the Choosing Wisely recommendations. Models included a random clinician effect and fixed effects for beneficiary age, disability, Elixhauser comorbidities, clinician type, the emergency department setting, and region. NPs (N = 234) order low-value back images significantly less than PAs (N = 204) (NPs 25.5% vs. PAs 39.2%, p < .0001). Controlling for relevant factors, NPs are 10.0 percentage points (p < .0001) less likely to order a low-value back image than PAs. NPs and PAs have distinct patterns of low-value back imaging, which is likely a reflection of their different practice settings.

Prevalence and Cost of Care Cascades After Low-Value Preoperative Electrocardiogram for Cataract Surgery in Fee-for-Service Medicare Beneficiaries

IMPORTANCE

Low-value care is prevalent in the United States, yet little is known about the downstream health care use triggered by low-value services. Measurement of such care cascades is essential to understanding the full consequences of low-value care.

OBJECTIVE

To describe cascades (tests, treatments, visits, hospitalizations, and new diagnoses) after a common low-value service, preoperative electrocardiogram (EKG) for patients undergoing cataract surgery.

DESIGN, SETTING, AND PARTICIPANTS

Observational cohort study using fee-for-service Medicare claims data from beneficiaries aged 66 years or older without known heart disease who were continuously enrolled between April 1, 2013, and September 30, 2015, and underwent cataract surgery between July 1, 2014 and June 30, 2015. Data were analyzed from March 12, 2018, to April 9, 2019.

EXPOSURES

Receipt of a preoperative EKG. The comparison group included patients who underwent cataract surgery but did not receive a preoperative EKG.

MAIN OUTCOMES AND MEASURES

Cascade event rates and associated spending in the 90 days after preoperative EKG, or in a matched timeframe for the comparison group. Secondary outcomes were patient, physician, and area-level characteristics associated with experiencing a potential cascade.

RESULTS

Among 110 183 cataract surgery recipients, 12 408 (11.3%) received a preoperative EKG (65.6% of them were female); of those, 1978 (15.9%) had at least 1 potential cascade event. The comparison group included 97 775 participants (63.1% female). Those who received a preoperative EKG experienced between 5.11 (95% CI, 3.96-6.25) and 10.92 (95% CI, 9.76-12.08) additional events per 100 beneficiaries relative to the comparison group. This included between 2.18 (95% CI, 1.34-3.02) and 7.98 (95% CI, 7.12-8.84) tests, 0.33 (95% CI, 0.19-0.46) treatments, 1.40 (95% CI, 1.18-1.62) new patient cardiology visits, and 1.21 (95% CI, 0.62-1.79) new cardiac diagnoses. Spending for the additional services was up to $565 per Medicare beneficiary (95% CI, $342-$775), or an estimated $35 025 923 annually across all Medicare beneficiaries in addition to the $3 275 712 paid for the preoperative EKGs. Among preoperative EKG recipients, those who were older (adjusted odds ratio [aOR] for patients aged 75 to 84 years vs 66 to 74 years old, 1.42; 95% CI, 1.28-1.57), had more chronic conditions (aOR for each additional Elixhauser condition, 1.18; 95% CI, 1.14-1.22), lived in more cardiologist-dense areas (aOR, 1.05; 95% CI, 1.02-1.09), or had their preoperative EKG performed by a cardiac specialist rather than a primary care physician (aOR, 1.26; 95% CI, 1.10-1.43) were more likely to experience a potential cascade.

CONCLUSIONS AND RELEVANCE

Care cascades after preoperative EKG for cataract surgery are infrequent but costly. Policy and practice interventions to reduce low-value services and the cascades that follow could yield substantial savings.

Systemic overuse of health care in a commercially insured US population, 2010-2015

BACKGROUND

Overuse is a leading contributor to the high cost of health care in the United States. Overuse harms patients and is a definitive waste of resources. The Johns Hopkins Overuse Index (JHOI) is a normalized measure of systemic health care services overuse, generated from claims data, that has been used to describe overuse in Medicare beneficiaries and to understand drivers of overuse. We aimed to adapt the JHOI for application to a commercially insured US population, to examine geographic variation in systemic overuse in this population, and to analyze trends over time to inform whether systemic overuse is an enduring problem.

METHODS

We analyzed commercial insurance claims from 18 to 64 year old beneficiaries. We calculated a semiannual JHOI for each of the 375 Metropolitan Statistical Areas and 47 rural regions of the US. We generated maps to examine geographic variation and then analyzed each region's change in their JHOI quintile from January 2011 to June 2015.

RESULTS

The JHOI varied markedly across the US. Across the country, rural regions tended to have less systemic overuse than their MSA counterparts (p < 0.01). Regional systemic overuse is positively correlated from one time period to the next (p < 0.001). Between 2011 and 2015, 53.7% (N = 226) of regions remained in the same quintile of the JHOI. Eighty of these regions had a persistently high or persistently low JHOI throughout study duration.

CONCLUSIONS

The systemic overuse of health care resources is an enduring, regional problem. Areas identified as having a persistently high rate of systemic overuse merit further investigation to understand drivers and potential points of intervention.

Analysis of Physician Variation in Provision of Low-Value Services

IMPORTANCE

Facing new financial incentives to reduce unnecessary spending, health care organizations may attempt to reduce wasteful care by influencing physician practices or selecting more cost-effective physicians. However, physicians' role in determining the use of low-value services has not been well described.

OBJECTIVES

To quantify variation in provision of low-value health care services among primary care physicians and to estimate the proportion of variation attributable to physician characteristics that may be used to predict performance.

DESIGN, SETTING, AND PARTICIPANTS

This retrospective analysis included national Medicare fee-for-service claims of 3 159 834 beneficiaries served by 41 773 generalist physicians from January 1, 2008, through December 31, 2013 (data were analyzed in 2016 through 2018). Multilevel modeling was used to estimate the extent of variation in service use across physicians within their region and provider organization, adjusted for patient clinical and sociodemographic characteristics and sampling variation. The proportion of variation attributable to physician characteristics that may be used to predict performance (age, sex, academic degree, professorship, publication record, trial investigation, grant receipt, pharmaceutical or device manufacturer payment, and panel size) was estimated via additional regression analysis.

MAIN OUTCOMES AND MEASURES

Annual count per beneficiary of 17 primary care-associated services that provide minimal clinical benefit.

RESULTS

Among the 3 159 834 beneficiaries (58.3% women; mean [SD] age, 73.2 [11.0] years) served by 41 773 physicians (74.9% men; mean [SD] age, 48.0 [10.1] years), the mean annual rate of low-value services was 33.1 services per 100 beneficiaries. Considerable variation across physicians within the same region was found (SD, 8.8 [95% CI, 8.7-8.9]; 90th:10th percentile ratio, 2.03 [95% CI, 2.01-2.06]) and across physicians within the same organization (SD, 6.1 [95% CI, 6.0-6.2]; 90th:10th percentile ratio, 1.61 [95% CI, 1.60-1.63]). The corresponding rates at the 10th percentile of physicians within region and within organization respectively were 21.8 and 25.3 services per 100 beneficiaries. Observable physician characteristics accounted for only 4.4% of physician variation within region and 1.4% of physician variation within organization.

CONCLUSIONS AND RELEVANCE

Physician practices may substantially contribute to low-value service use, which is prevalent even among the least wasteful physicians. Because little variation is predicted by measured physician characteristics, direct measures of low-value care provision may aid organizational efforts to encourage high-value practices.

Current evidence for spinal X-ray use in the chiropractic profession: a narrative review

The use of routine spinal X-rays within chiropractic has a contentious history. Elements of the profession advocate for the need for routine spinal X-rays to improve patient management, whereas other chiropractors advocate using spinal X-rays only when endorsed by current imaging guidelines. This review aims to summarise the current evidence for the use of spinal X-ray in chiropractic practice, with consideration of the related risks and benefits. Current evidence supports the use of spinal X-rays only in the diagnosis of trauma and spondyloarthropathy, and in the assessment of progressive spinal structural deformities such as adolescent idiopathic scoliosis. MRI is indicated to diagnose serious pathology such as cancer or infection, and to assess the need for surgical management in radiculopathy and spinal stenosis. Strong evidence demonstrates risks of imaging such as excessive radiation exposure, overdiagnosis, subsequent low-value investigation and treatment procedures, and increased costs. In most cases the potential benefits from routine imaging, including spinal X-rays, do not outweigh the potential harms. The use of spinal X-rays should not be routinely performed in chiropractic practice, and should be guided by clinical guidelines and clinician judgement.

Patient Variability Seldom Assessed in Cost-effectiveness Studies

BACKGROUND

Cost-effectiveness analysis (CEA) estimates can vary substantially across patient subgroups when patient characteristics influence preferences, outcome risks, treatment effectiveness, life expectancy, or associated costs. However, no systematic review has reported the frequency of subgroup analysis in CEA, what type of heterogeneity they address, and how often heterogeneity influences whether cost-effectiveness ratios exceed or fall below conventional thresholds.

METHODS

We reviewed the CEA literature cataloged in the Tufts Medical Center CEA Registry, a repository describing cost-utility analyses published through 2016. After randomly selecting 200 of 642 articles published in 2014, we ascertained whether each study reported subgroup results and collected data on the defining characteristics of these subgroups. We identified whether any of the CEA subgroup results crossed conventional cost-effectiveness benchmarks (e.g., $100,000 per QALY) and compared characteristics of studies with and without subgroup-specific findings.

RESULTS

Thirty-eight studies (19%) reported patient subgroup results. Articles reporting subgroup analyses were more likely to be US-based, government funded (v. drug industry- or nonprofit foundation-funded) studies, with a focus on primary or secondary (v. tertiary) prevention (P < 0.05 for comparisons). One or more patient characteristics were used to stratify CEA results 68 times within the 38 studies, with most stratifications using one characteristic (n = 47), most commonly age (n = 35). Among the 23 stratifications reported alongside average ratios in US studies, 13 produced subgroup ratios that crossed a conventional CEA ratio benchmark.

CONCLUSIONS

Most CEAs do not report any subgroup results, and those that do most often stratify only by patient age. Over half of the subgroup analyses reported could lead to different value-based decision making for at least some patients.

Impact of consumer-directed health plans on low-value healthcare

OBJECTIVES

To assess the impact of consumer-directed health plan (CDHP) enrollment on low-value healthcare spending.

STUDY DESIGN

We performed a quasi-experimental analysis using insurance claims data from 376,091 patients aged 18 to 63 years continuously enrolled in a plan from a large national commercial insurer from 2011 to 2013. We measured spending on 26 low-value healthcare services that offer unclear or no clinical benefit.

METHODS

Employing a difference-in-differences approach, we compared the change in spending on low-value services for patients switching from a traditional health plan to a CDHP with the change in spending on low-value services for matched patients remaining in a traditional plan.

RESULTS

Switching to a CDHP was associated with a $231.60 reduction in annual outpatient spending (95% CI, -$341.65 to -$121.53); however, no significant reductions were observed in annual spending on the 26 low-value services (--$3.64; 95% CI, -$9.60 to $2.31) or on these low-value services relative to overall outpatient spending (-$7.86 per $10,000 in outpatient spending; 95% CI, -$18.43 to $2.72). Similarly, a small reduction was noted for low-value spending on imaging (-$1.76; 95% CI, -$3.39 to -$0.14), but not relative to overall imaging spending, and no significant reductions were noted in low-value laboratory spending.

CONCLUSIONS

CDHPs in their current form may represent too blunt an instrument to specifically curtail low-value healthcare spending.

A methodological protocol for selecting and quantifying low-value prescribing practices in routinely collected data: an Australian case study

Background

Growing imperatives for safety, quality and responsible resource allocation have prompted renewed efforts to identify and quantify harmful or wasteful (low-value) medical practices such as test ordering, procedures and prescribing. Quantifying these practices at a population level using routinely collected health data allows us to understand the scale of low-value medical practices, measure practice change following specific interventions and prioritise policy decisions. To date, almost all research examining health care through the low-value lens has focused on medical services (tests and procedures) rather than on prescribing. The protocol described herein outlines a program of research funded by Australia’s National Health and Medical Research Council to select and quantify low-value prescribing practices within Australian routinely collected health data.

Methods

We start by describing our process for identifying and cataloguing international low-value prescribing practices. We then outline our approach to translate these prescribing practices into indicators that can be applied to Australian routinely collected health data. Next, we detail methods of using Australian health data to quantify these prescribing practices (e.g. prevalence of low-value prescribing and related costs) and their downstream health consequences. We have approval from the necessary Australian state and commonwealth human research ethics and data access committees to undertake this work.

Discussion

The lack of systematic and transparent approaches to quantification of low-value practices in routinely collected data has been noted in recent reviews. Here, we present a methodology applied in the Australian context with the aim of demonstrating principles that can be applied across jurisdictions in order to harmonise international efforts to measure low-value prescribing. The outcomes of this research will be submitted to international peer-reviewed journals. Results will also be presented at national and international pharmacoepidemiology and health policy forums such that other jurisdictions have guidance to adapt this methodology.

Electronic supplementary material

The online version of this article (doi:10.1186/s13012-017-0585-9) contains supplementary material, which is available to authorized users.