Measures Used to Assess the Impact of Interventions to Reduce Low-Value Care: a Systematic Review

Success factors for interventions to reduce low-value imaging. Six crucial lessons learned from a practical case study in Norway

BACKGROUND

Substantial overuse of health care services is identified and intensified efforts are incited to reduce low-value services in general and in imaging in particular.

OBJECTIVE

To report crucial success factors for developing and implementing interventions to reduce specific low-value imaging examinations based on a case study in Norway.

MATERIALS AND METHODS

Mixed methods design including one systematic review, one scoping review, implementation science, qualitative interviews, content analysis of stakeholders' input, and stakeholder deliberations.

RESULTS

The description and analysis of an intervention to reduce low-value imaging in Norway identifies six general success factors: 1) Acknowledging complexity: advanced knowledge synthesis, competence of the context, and broad and strong stakeholder involvement is crucial to manage de-implementation complexity. 2) Clear consensus-based criteria for selecting low-value imaging procedures are key. 3) Having a clear target group is critical. 4) Stakeholder engagement is essential to ascertain intervention relevance and compliance. 5) Active and well-motivated intervention collaborators is imperative. 6) Paying close attention to the mechanisms of low-value imaging and the barriers to reduce it is decisive.

CONCLUSION

Reducing low-value imaging is crucial to increase the quality, safety, efficiency, and sustainability of the health services. Reducing low-value imaging is a complex task and paying attention to specific practical success factors is key.

Assessing MRI referrals' appropriateness for low back pain post a radiology-initiated intervention

INTRODUCTION

This study evaluated a pilot intervention to reduce low-value Magnetic Resonance Imaging (MRI) referrals for Low Back Pain (LBP).

METHODS

This before-after intervention study analysed MRI referrals for LBP at two private imaging centres in Norway. MRI referrals for LBP obtained before and after an intervention of information campaigns and sending a return letter to clinicians for declined referrals were evaluated on information, quality, and justification rates. Four radiologists and two radiographers assessed the referrals. A point system was used to calculate referral quality. Each referral was given a score 'good' when rated above 5.5 and 'poor' below 2.5. Justification was based on assessors categorised rating as justified, unjustified or need more information. Stata Statistical Software (Release 18) was used for analysis. A mixed model analysed variations of the referrals pre- and post-intervention. A p-value of <.05 in variations was considered statistically significant.

RESULTS

A total n = 300 patients' referrals (150 referrals pre- and post-intervention) were collected and assessed. Post-intervention, 68% of referrals were justified, up from 63% pre-intervention. The assessment showed a 4% decrease in referrals with poor scores and a 2% increase in those rated as good or intermediate quality post-intervention. These changes were not statistically significant.

CONCLUSION

It is important to state that it was not possible in our study to identify the subgroup of referrals that are known to be from clinicians who had received a return letter, although the information campaign targeted all referrers. Despite the limitations our findings suggest that providing reasons for declined referrals can serve as an educational tool for clinicians and contribute to the reduction of low value MRI for LBP.

IMPLICATIONS FOR PRACTICE

Radiology department initiatives that raise awareness and offer referral criteria guidance to clinicians can serve as valuable educational tools, and further emphasize the importance of providing comprehensive information in MRI referrals for LBP.

PERSPECTIVE: A Path to Value-Based Insurance Design for Mental Health Services

BACKGROUND

Aligning cost of mental health care with expected clinical and functional benefits of that care would incentivize the delivery of high value treatments and services. In turn, ineffective or untested care could still be offered but at costs high enough to offset the delivery of high value care.

AIMS

The authors comment on Benson and Fendrick's paper on Value-Based Insurance Design (VBID) for mental health in the September 2023 special issue of this journal. The authors also present a preliminary framework of key ingredients needed to consider VBID for mental health treatments and services.

METHODS

The authors briefly review current and past efforts to contain costs and improve quality of mental health care, which include (for example) use of carve-out and carve-in programs, evaluation of cost sharing models, impact of accountable care organizations, and studying other benefit designs and impact of federal and state policies.

RESULTS

Using PTSD as an example, key ingredients of VBID for mental health services were identified and include the following: tools for case identification and monitoring progress over time at the population level; specific treatments and services with evidence of clinical effectiveness, cost-effectiveness, and health equity; and an approach to document the specific treatment or service was delivered (versus another treatment or service that may lack evidence).

DISCUSSION

The inability to afford mental health care is a top barrier to treatment seeking. People who do elect to spend time and money on mental health care are further disadvantaged by accessing care that is not well regulated and the quality at best is questionable. VBID could be an important lever for increasing access to and use of high value mental health care. Partnerships among the research, practice, and policy communities can help ensure research solutions meet needs of these two communities.

IMPLICATIONS FOR HEALTH CARE

VBID holds promise to make high value mental health care more affordable while discouraging low value treatments and services.

IMPLICATIONS FOR HEALTH POLICIES

While evidence gaps remain, these gaps can be filled concurrently with pursuit of VBID for mental health services.

IMPLICATIONS FOR FUTURE RESEARCH

This paper identifies important research opportunities to help make VBID a reality for mental health care.

Impacts of COVID-19 on Appropriate Use of Screening Colonoscopy in a Large Integrated Healthcare Delivery System

BACKGROUND

Decreasing low-value colonoscopy is critical to optimizing access for high-need patients, particularly in resource-constrained environments such as those created by the COVID-19 pandemic. We hypothesized that rates of screening colonoscopy overuse would decline during COVID compared to pre-COVID due to enhanced procedural scrutiny and prioritization in the setting of constrained access.

OBJECTIVE

To characterize impacts of COVID-19 on screening colonoscopy overuse DESIGN: Retrospective national cohort study using Veterans Health Administration administrative data PARTICIPANTS: Veterans undergoing screening colonoscopy in Q4 2019 (pre-COVID) and Q4 2020 (COVID) at 109 endoscopy facilities MAIN MEASURES: Rates of screening colonoscopy overuse KEY RESULTS: 18,376 screening colonoscopies were performed pre-COVID, 19% (3,641) of which met overuse criteria. While only 9,360 screening colonoscopies were performed in Q4 2020, 25% met overuse criteria. Overall change in median facility-level overuse during COVID compared to pre-COVID was 6% (95%CI 5%-7%), with significant variability across facilities (IQR: 2%-11%). Of colonoscopies meeting overuse criteria, the top reason for overuse in both periods was screening colonoscopy performed <9 years after previous screening procedure (55% pre-COVID, 49% during COVID). The largest shifts in overuse category were in screening procedures performed <9 years after prior screening colonoscopy (-6% decline COVID vs. pre-COVID) and screening procedures performed in patients below average-risk screening age (i.e., age <40 (5% increase COVID compared to pre-COVID), age 40-44 (4% increase COVID vs. pre-COVID)). Within facility performance was stable over time; 83/109 facilities changed their performance by <=1 quartile during COVID compared to pre-COVID.

CONCLUSIONS

Despite pandemic-related resource constraints and enhanced procedural scrutiny and prioritization in the setting of COVID-related backlogs, screening colonoscopy overuse rates remained roughly stable during COVID compared to pre-COVID, with continued variability across facilities. These data highlight the need for systematic and concerted efforts to address overuse, even in the face of strong external motivating factors.

De-adopting low-value care: The missing step in evidence-based practice?

BACKGROUND

Low-value care provides little or no benefit to pediatric patients, has the potential to cause harm, waste healthcare resources, and increase healthcare costs. Nursing has a responsibility to identify and de-adopt low-value practices to help promote quality care.

PURPOSE

1) Describe the process of identifying and de-adopting low-value clinical practices guided by a conceptual model using a case study approach. 2) Identify facilitators and barriers to de-adoption practices, including levels of stakeholder engagement, organizational structures, and the quality of available scientific and non-scientific evidence.

METHODOLOGY

An evidence-based practice (EBP) project investigating the efficacy of antihistamines in decreasing infusion reactions to infliximab identified a low-value practice within a pediatric infusion center. The Synthesis Model for the Process of De-adoption was then applied to guide the de-adoption of this low-value practice. Case study analysis highlighted facilitators and barriers to de-adoption efforts.

CONCLUSIONS

The process for de-adopting care is an essential component of EBP and, as such, should be explicated through robust, standardized EBP processes and education.

PRACTICE IMPLICATIONS

Nurses are best positioned to identify, assess and prioritize low-value practices and facilitate the de-adoption of low-value practice that impact pediatric patients and families. Models to support de-adoption and a focus on site-specific practices including a prepared nursing workforce, continuous evaluation of care processes and the use of resources to assess for contextual determinants facilitates success and sustainability of this essential EBP approach.

Development of the SPREAD framework to support the scaling of de-implementation strategies: a mixed-methods study

OBJECTIVE

We aimed to increase the understanding of the scaling of de-implementation strategies by identifying the determinants of the process and developing a determinant framework.

DESIGN AND METHODS

This study has a mixed-methods design. First, we performed an integrative review to build a literature-based framework describing the determinants of the scaling of healthcare innovations and interventions. PubMed and EMBASE were searched for relevant studies from 1995 to December 2020. We systematically extracted the determinants of the scaling of interventions and developed a literature-based framework. Subsequently, this framework was discussed in four focus groups with national and international de-implementation experts. The literature-based framework was complemented by the findings of the focus group meetings and adapted for the scaling of de-implementation strategies.

RESULTS

The literature search resulted in 42 articles that discussed the determinants of the scaling of innovations and interventions. No articles described determinants specifically for de-implementation strategies. During the focus groups, all participants agreed on the relevance of the extracted determinants for the scaling of de-implementation strategies. The experts emphasised that while the determinants are relevant for various countries, the implications differ due to different contexts, cultures and histories. The analyses of the focus groups resulted in additional topics and determinants, namely, medical training, professional networks, interests of stakeholders, clinical guidelines and patients' perspectives. The results of the focus group meetings were combined with the literature framework, which together formed the supporting the scaling of de-implementation strategies (SPREAD) framework. The SPREAD framework includes determinants from four domains: (1) scaling plan, (2) external context, (3) de-implementation strategy and (4) adopters.

CONCLUSIONS

The SPREAD framework describes the determinants of the scaling of de-implementation strategies. These determinants are potential targets for various parties to facilitate the scaling of de-implementation strategies. Future research should validate these determinants of the scaling of de-implementation strategies.

Prevalence and changes of low-value care at acute care hospitals: a multicentre observational study in Japan

OBJECTIVES

We aimed to examine the use and factors associated with the provision of low-value care in Japan.

DESIGN

A multicentre observational study.

SETTING

Routinely collected claims data that include all inpatient and outpatient visits in 242 large acute care hospitals (accounting for approximately 11% of all acute hospitalisations in Japan).

PARTICIPANTS

345 564 patients (median age (IQR): 62 (40-75) years; 182 938 (52.9%) women) seeking care at least once in the hospitals in the fiscal year 2019.

PRIMARY AND SECONDARY OUTCOME MEASURES

We identified 33 low-value services, as defined by clinical evidence, and developed two versions of claims-based measures of low-value services with different sensitivity and specificity (broader and narrower definitions). We examined the number of low-value services, the proportion of patients receiving these services and the proportion of total healthcare spending incurred by these services in 2019. We also evaluated the 2015-2019 trends in the number of low-value services.

RESULTS

Services identified by broader low-value care definition occurred in 7.5% of patients and accounted for 0.5% of overall annual healthcare spending. Services identified by narrower low-value care definition occurred in 4.9% of patients and constituted 0.2% of overall annual healthcare spending. Overall, there was no clear trend in the prevalence of low-value services between 2015 and 2019. When focusing on each of the 17 services accounting for more than 99% of all low-value services identified (narrower definition), 6 showed decreasing trends from 2015 to 2019, while 4 showed increasing trends. Hospital size and patients' age, sex and comorbidities were associated with the probability of receiving low-value service.

CONCLUSIONS

A substantial number of patients received low-value care in Japan. Several low-value services with high frequency, especially with increasing trends, require further investigation and policy interventions for better resource allocation.

Dealing With Immunoglobulin Shortages: A Rationalization Plan From Evidence-Based and Data Collection

Background

The demand and consumption of immunoglobulins (IgGs) are growing, and there are many difficulties in obtaining supplies. The aim of the study was to analyze the evolution of IgG consumption and cost over a decade, describe the measures implemented for clinical management in the context of regional public health system, and evaluate the initial impact of these measures.

Methods

We performed a retrospective longitudinal study including patients of all public health systems in Catalonia. First, we analyzed data on consumption and cost of IgGs during a period between 1 January, 2010 and 31 December 2021. Second, we analyzed the impact of a set of regional measures in terms of annual consumption and cost of IgGs. Regional measures were based on rational evidence-based measures and computer registries. We compared the data of year before applying intervention measures (1 January and 31 December 2020) with data of year after applying clinical management interventions (1 January and 31 December 2021). In addition, detailed information on clinical indications of IgG use between 1 January and 31 December 2021 was collected.

Results

Overall, in terms of population, the consumption of IgGs (g/1,000 inhabitants) increased from 40.4 in 2010 to 94.6 in 2021. The mean cost per patient increased from €10,930 in 2010 to €15,595 in 2021. After implementing the measures, the mean annual estimated consumption per patient in 2021 was statistically lower than the mean annual estimated consumption per patient in 2020 (mean difference −47 g, 95% CI −62.28 g, −31.72 g, p = 0.03). The mean annual estimated cost per patient in 2021 was also lower than the mean annual estimated cost per patient in 2020 (the mean difference was –€1,492, 95% CI –€2,132.12, –€851.88; p = 0.027). In 2021, according to evidence-based classification, 75.66% treatments were prescribed for a demonstrated therapeutic evidence-based indication, 12.17% for a developed therapeutic evidence-based indication, 4.66% for non-evidence-based therapeutic role indication, and 8.1% could not be classified because of lack of information.

Conclusion

The annual consumption and cost of IgGs have grown steadily over the last decade in our regional public health system. After implementing a set of regional measures, the annual consumption of IgGs per patient and annual cost per patient decreased. However, the decrease has occurred in the context of the coronavirus disease 2019 (COVID-19) pandemic, which may have influenced their clinical use. Managing the use of IgGs through a rational plan with strategies including evidence-based and data collection may be useful in a shortage situation with growing demand. Registries play a key role in collection of systematic data to analyze, synthesize, and obtain valuable information for decision support. The action developed needs close monitoring in order to verify its effectiveness.

De-implementing low-value care in cancer care delivery: a systematic review

BACKGROUND

Accumulating evidence suggests that interventions to de-implement low-value services are urgently needed. While medical societies and educational campaigns such as Choosing Wisely have developed several guidelines and recommendations pertaining to low-value care, little is known about interventions that exist to de-implement low-value care in oncology settings. We conducted this review to summarize the literature on interventions to de-implement low-value care in oncology settings.

METHODS

We systematically reviewed the published literature in PubMed, Embase, CINAHL Plus, and Scopus from 1 January 1990 to 4 March 2021. We screened the retrieved abstracts for eligibility against inclusion criteria and conducted a full-text review of all eligible studies on de-implementation interventions in cancer care delivery. We used the framework analysis approach to summarize included studies' key characteristics including design, type of cancer, outcome(s), objective(s), de-implementation interventions description, and determinants of the de-implementation interventions. To extract the data, pairs of authors placed text from included articles into the appropriate cells within our framework. We analyzed extracted data from each cell to describe the studies and findings of de-implementation interventions aiming to reduce low-value cancer care.

RESULTS

Out of 2794 studies, 12 met our inclusion criteria. The studies covered several cancer types, including prostate cancer (n = 5), gastrointestinal cancer (n = 3), lung cancer (n = 2), breast cancer (n = 2), and hematologic cancers (n = 1). Most of the interventions (n = 10) were multifaceted. Auditing and providing feedback, having a clinical champion, educating clinicians through developing and disseminating new guidelines, and developing a decision support tool are the common components of the de-implementation interventions. Six of the de-implementation interventions were effective in reducing low-value care, five studies reported mixed results, and one study showed no difference across intervention arms. Eleven studies aimed to de-implement low-value care by changing providers' behavior, and 1 de-implementation intervention focused on changing the patients' behavior. Three studies had little risk of bias, five had moderate, and four had a high risk of bias.

CONCLUSIONS

This review demonstrated a paucity of evidence in many areas of the de-implementation of low-value care including lack of studies in active de-implementation (i.e., healthcare organizations initiating de-implementation interventions purposefully aimed at reducing low-value care).

The costs incurred by the NHS in England due to the unnecessary prescribing of dependency-forming medications

This cross-sectional study estimates the costs incurred by the National Health Service (NHS) in England as a consequence of the unnecessary prescribing (i.e. non-indicated or dispensable) of dependency-forming medicines (antidepressants, opioids, gabapentinoids, benzodiazepines, Z-drugs). It assesses prescribing in primary care from April 2015-March 2018. Analyses were based upon the following data sets: the number of adults continuously prescribed dependency forming medications and the duration of prescriptions (obtained from Public Health England); the Net Ingredient Cost (NIC) and the dispensing costs for each medicine (obtained from the NHS Business Service Authority [NHSBSA]). Consultation costs were calculated based on guideline recommendations and the number of consultations evidenced in prior research for long-term medication monitoring. Across opioids, gabapentinoids, benzodiazepines, Z-drugs the total estimated unnecessary cost over three years (April 2015-March 2018) was £1,367,661,104 to £1,555,234,627. For antidepressants the total estimated unnecessary cost for one year was £37,321,783 to £45,765,504. The data indicate that the NHS in England may incur a significant estimated mean annual loss of £455,887,035 to £518,411,542 for opioids, gabapentinoids, benzodiazepines, Z-drugs and an estimated annual loss of £37,321,783 to £45,765,504 for antidepressants. Combined, this gives an estimated annual loss of £493,208,818 to £564,177,046 as a result of non-indicated or dispensable prescribing of dependency-forming medicines. Estimates are conservative and figures could be higher.

Frequency and estimated costs of ten low-value practices in the Spanish Primary Care: a retrospective study

BACKGROUND

The frequency of low-value practices (LVPs) in the healthcare system is a worldwide challenge. Far less is known about the related extra cost. This study aimed to evaluate the LVPs trend in Spanish primary care (PC), its frequency in both sexes, and estimate its related extra cost.

METHODS

A multicentric, retrospective, and national research project was conducted. Ten LVPs highly frequent and potentially harmful for patients were analyzed. Algorithms were applied to collect the data from 28,872,851 episodes registered into national databases (2015-2017). Cost estimation was made.

RESULTS

LVPs registered a total of 7,160,952 (26.5%) episodes plus a total of 259,326 avoidable PSA screening tests. In adults, a high frequency was found for prescription of 1g paracetamol >3 days, antibiotics for acute bronchitis (unconfirmed comorbidity), and benzodiazepines in patients >65 years with insomnia. Women received more jeopardizing practices (p≤0.001). Pediatrics presented a downward of antibiotic and paracetamol-ibuprofen prescription combination. The estimated extra cost was close to €292 million (2.8% of the total cost in PC).

CONCLUSION

LVPs reduction during the analyzed period was moderate compared to studies following 'Choosing Wisely list' of LVPs and must improve to reduce patient risk and the extra related costs.

Avoidable Adverse Events Related to Ignoring the Do-Not-Do Recommendations: A Retrospective Cohort Study Conducted in the Spanish Primary Care Setting

OBJECTIVE

This study aimed to measure the frequency and severity of avoidable adverse events (AAEs) related to ignoring do-not-do recommendations (DNDs) in primary care.

METHODS

A retrospective cohort study analyzing the frequency and severity of AAEs related to ignoring DNDs (7 from family medicine and 3 from pediatrics) was conducted in Spain. Data were randomly extracted from computerized electronic medical records by a total of 20 general practitioners and 5 pediatricians acting as reviewers; data between February 2018 and September 2019 were analyzed.

RESULTS

A total of 2557 records of adult and pediatric patients were reviewed. There were 1859 (72.7%) of 2557 (95% confidence interval [CI], 71.0%-74.4%) DNDs actions in 1307 patients (1507 were performed by general practitioners and 352 by pediatricians). Do-not-do recommendations were ignored more often in female patients (P < 0.0001). Sixty-nine AAEs were linked to ignoring DNDs (69/1307 [5.3%]; 95% CI, 4.1%-6.5%). Of those, 54 (5.1%) of 1062 were in adult patients (95% CI, 3.8%-6.4%) and 15 (6.1%) of 245 in pediatric patients (95% CI, 3.1%-9.1%). In adult patients, the majority of AAEs (51/901 [5.7%]; 95% CI, 4.2%-7.2%) occurred in patients 65 years or older. Most AAEs were characterized by temporary minor harm both in adult patients (28/54 [51.9%]; 95% CI, 38.5%-65.2%) and pediatric patients (15/15 [100%]).

CONCLUSIONS

These findings provide a new perspective about the consequences of low-value practices for the patients and the health care systems. Ignoring DNDs could place patients at risk, and their safety might be unnecessarily compromised.

TRIAL REGISTRATION NUMBER

NCT03482232.

Association between insurance-mandated precertification criteria and inpatient healthcare utilization during 1 year after bariatric surgery

BACKGROUND

Insurance-mandated precertification requirements are barriers to bariatric surgery. The value of their prescription, based on insurance type rather that the clinical necessity, is unclear.

OBJECTIVES

To determine whether there is an association between insurance-mandated precertification criteria for bariatric surgery and short-term inpatient healthcare utilization.

SETTING

Pennsylvania Health Care Cost Containment Council's inpatient care databases for the years 2016-2017.

METHODS

The study included 2717 adults who underwent bariatric surgery in Southeastern Pennsylvania in 2016. Postoperative length of stay and rehospitalizations for these individuals were followed using clinical and claims data during the first year after bariatric surgery.

RESULTS

The requirements for 3- to 6-month preoperative medical weight management, as well as pulmonology and cardiology examinations, were not associated with the patient length of stay, number of all-cause rehospitalizations, or number of all-cause rehospitalization days after adjusting for patient age, sex, race, ethnicity, the Elixhauser comorbidity score, type of the surgery, facility where the surgery was performed, primary payer type, and the estimated median household income. Among commercially insured individuals (n = 1499), the mean number of all-cause rehospitalizations during the study period was lower in patients with no medical weight management requirement by a factor of .57 (lower by 43.1%; 95% confidence interval, .35-.94, P = .03) and higher in patients with no requirement for preoperative cardiology and pulmonology evaluations by a factor of 2.09 (95% confidence interval 1.09-4.02, P = .03).

CONCLUSION

The findings suggest that the precertification requirement for preoperative medical weight management is not associated with a reduction in inpatient healthcare utilization in the first postoperative year.

De-implementing low-value care in endocrinology

Low-value care exposes patients to ineffective, costly, and potentially harmful care. In endocrinology, low-value care practices are common in the care of patients with highly prevalent conditions. There is an urgent need to move past the identification of these practices to an active process of de-implementation. However, clinicians, researchers, and other stakeholders might lack familiarity with the frameworks and processes that can help guide successful de-implementation. To address this gap and support the de-implementation of low-value care, we provide a summary of low-value care practices in endocrinology and a primer on the fundamentals of de-implementation science. Our goal is to increase awareness of low-value care within endocrinology and suggest a path forward for addressing low-value care using principles of de-implementation science.

Trends in Low-Value Carotid Imaging in the Veterans Health Administration From 2007 to 2016

IMPORTANCE

As part of the Choosing Wisely campaign, primary care, surgery, and neurology societies have identified carotid imaging ordered for screening, preoperative evaluation, and syncope as frequently low value.

OBJECTIVE

To determine the changes in overall and indication-specific rates of carotid imaging following Choosing Wisely recommendations.

DESIGN, SETTING, AND PARTICIPANTS

This serial cross-sectional study compared annual rates of carotid imaging before Choosing Wisely recommendations (ie, 2007 to 2012) and after (ie, 2013 to 2016) among adults receiving care in the Veterans Health Administration (VHA) national health system. Data analysis was performed from April 10, 2019, to November 27, 2019.

EXPOSURES

Release of the Choosing Wisely recommendations.

MAIN OUTCOMES AND MEASURES

Annual rates of overall imaging, imaging ordered for stroke workup, imaging ordered for low-value indications (ie, screening owing to carotid bruit, preoperative evaluation, and syncope). Indications were identified using a text lexicon algorithm based on electronic health record review of a stratified random sample of 1000 free-text imaging orders. The subsequent performance of carotid procedures within 6 months after carotid imaging was assessed.

RESULTS

Between 2007 and 2016, 809 071 carotid imaging examinations were identified (mean [SD] age of patients undergoing imaging, 69 [10] years; 776 632 [96%] men), of which 201 467 images (24.9%) were ordered for low-value indications (67 064 [8.2%] for carotid bruit, 25 032 [3.1%] for preoperative evaluation, and 109 400 [13.5%] for syncope), 257 369 (31.8%) for stroke workup, and 350 235 (43.3%) for other indications. Imaging for carotid bruits declined across the study period while there was no significant change in imaging for syncope or preoperative evaluation. Compared with the 6 years before, during the 4 years following Choosing Wisely recommendations, there was no change in the trend for syncope, a small decline in preoperative imaging (post-Choosing Wisely trend, -0.1 [95% CI, -0.1 to <-0.1] images per 10 000 veterans), and a continued but less steep decline in imaging for carotid bruits (post-Choosing Wisely trend, -0.3 [95% CI, -0.3 to -0.2] images per 10 000 veterans). During the study period, 17 689 carotid procedures were identified, of which 3232 (18.3%) were preceded by carotid imaging ordered for low-value indications.

CONCLUSIONS AND RELEVANCE

These findings suggest that Choosing Wisely recommendations were not associated with a meaningful change in low-value carotid imaging in a national integrated health system. To reduce low-value testing and utilization cascades, interventions targeting ordering clinicians are needed to augment the impact of public awareness campaigns.