Evaluating the effects of variation in clinical practice: a risk adjusted cost-effectiveness (RAC-E) analysis of acute stroke services

Local Level Economic Evaluation: What is it? What is its Value? Is it Sustainable?

In Australia, local health services with allocated budgets manage public hospital services for defined geographical areas. The authors were embedded in a local health service for around 2 years and undertook a range of local level economic evaluations for which three decision contexts were defined: intervention development, post-implementation and prioritisation. Despite difficulties in estimating opportunity costs and in the relevance of portfolio-based prioritisation approaches, economic evaluation added value to local decision-making. Development-focused (ex ante) economic evaluations used expert elicitation and calibration methods to synthesise published evidence with local health systems data to evaluate interventions to prevent hospital acquired complications. The use of economic evaluation facilitated the implementation of interventions with additional resource requirements. Decision analytic models were used alongside the implementation of larger scale, more complex service interventions to estimate counterfactual patient pathways, costs and outcomes, providing a transparent alternative to the statistical analyses of intervention effects, which were subject to high risk of bias. Economic evaluations of more established services had less impact due to data limitations and lesser executive interest. Prioritisation-focused economic evaluations compared costs, outcomes and processes of care for defined patient populations across alternative local health services to identify, understand and quantify the effects of unwarranted variation to inform priority areas for improvement within individual local health services. The sustained use of local level economic evaluation could be supported by embedding health economists in local continuous improvement units, perhaps with an initial focus on supporting the development and evaluation of prioritised new service interventions. Shared resources and critical mass are important, which could be facilitated through groups of embedded economists with joint appointments between different local health services and the same academic institution.

Clinical Practice Variation Needs to be Considered in Cost-Effectiveness Analyses: A Case Study of Patients with a Recent Transient Ischemic Attack or Minor Ischemic Stroke

BACKGROUND AND OBJECTIVE

The cost-effectiveness of clinical interventions is often assessed using current care as the comparator, with national guidelines as a proxy. However, this comparison is inadequate when clinical practice differs from guidelines, or when clinical practice differs between hospitals. We examined the degree of variation in the way patients with a recent transient ischemic attack (TIA) or minor ischemic stroke are assessed and used the results to illustrate the importance of investigating possible clinical practice variation, and the need to perform hospital-level cost-effectiveness analyses (CEAs) when variation exists.

METHODS

Semi-structured interviews were conducted with 16 vascular neurologists in hospitals throughout the Netherlands. Questions were asked about the use of initial and confirmatory diagnostic imaging tests to assess carotid stenosis in patients with a recent TIA or minor ischemic stroke, criteria to perform confirmatory tests, and criteria for treatment. We also performed hospital-level CEAs to illustrate the consequences of the observed diagnostic strategies in which the diagnostic test costs, sensitivity and specified were varied according to the local hospital conditions.

RESULTS

56 % (9/16) of the emergency units and 63 % (10/16) of the outpatient clinics use the initial and confirmatory diagnostic tests to assess carotid stenosis in accordance with the national guidelines. Of the hospitals studied, only one uses the recommended criteria for use of a confirmatory test, 38 % (6/16) follow the guidelines for treatment. The most cost-effective diagnostic test strategy differs between hospitals.

CONCLUSIONS

If important practice variation exists, hospital-level CEAs should be performed. These CEAs should include an assessment of the feasibility and costs of switching to a different strategy.

Process Mining for Clinical Processes

Business process analysis and process mining, particularly within the health care domain, remain under-utilized. Applied research that employs such techniques to routinely collected health care data enables stakeholders to empirically investigate care as it is delivered by different health providers. However, cross-organizational mining and the comparative analysis of processes present a set of unique challenges in terms of ensuring population and activity comparability, visualizing the mined models, and interpreting the results. Without addressing these issues, health providers will find it difficult to use process mining insights, and the potential benefits of evidence-based process improvement within health will remain unrealized. In this article, we present a brief introduction on the nature of health care processes, a review of process mining in health literature, and a case study conducted to explore and learn how health care data and cross-organizational comparisons with process-mining techniques may be approached. The case study applies process-mining techniques to administrative and clinical data for patients who present with chest pain symptoms at one of four public hospitals in South Australia. We demonstrate an approach that provides detailed insights into clinical (quality of patient health) and fiscal (hospital budget) pressures in the delivery of health care. We conclude by discussing the key lessons learned from our experience in conducting business process analysis and process mining based on the data from four different hospitals.

Accounting for costs, QALYs, and capacity constraints: using discrete-event simulation to evaluate alternative service delivery and organizational scenarios for hospital-based glaucoma services

BACKGROUND

Decision-analytic models are routinely used as a framework for cost-effectiveness analyses of health care services and technologies; however, these models mostly ignore resource constraints. In this study, we use a discrete-event simulation model to inform a cost-effectiveness analysis of alternative options for the organization and delivery of clinical services in the ophthalmology department of a public hospital. The model is novel, given that it represents both disease outcomes and resource constraints in a routine clinical setting.

METHODS

A 5-year discrete-event simulation model representing glaucoma patient services at the Royal Adelaide Hospital (RAH) was implemented and calibrated to patient-level data. The data were sourced from routinely collected waiting and appointment lists, patient record data, and the published literature. Patient-level costs and quality-adjusted life years were estimated for a range of alternative scenarios, including combinations of alternate follow-up times, booking cycles, and treatment pathways.

RESULTS

The model shows that a) extending booking cycle length from 4 to 6 months, b) extending follow-up visit times by 2 to 3 months, and c) using laser in preference to medication are more cost-effective than current practice at the RAH eye clinic.

CONCLUSIONS

The current simulation model provides a useful tool for informing improvements in the organization and delivery of glaucoma services at a local level (e.g., within a hospital), on the basis of expected effects on costs and health outcomes while accounting for current capacity constraints. Our model may be adapted to represent glaucoma services at other hospitals, whereas the general modeling approach could be applied to many other clinical service areas.

A risk adjusted cost-effectiveness analysis of alternative models of nurse involvement in obesity management in primary care

OBJECTIVE

Controlled evaluations are subject to uncertainty regarding their replication in the real world, particularly around systems of service provision. Using routinely collected data, we undertook a risk adjusted cost-effectiveness (RAC-E) analysis of alternative applied models of primary health care for the management of obese adult patients. Models were based on the reported level of involvement of practice nurses (registered or enrolled nurses working in general practice) in the provision of clinical-based activities.

DESIGN AND METHODS

Linked, routinely collected clinical data describing clinical outcomes (weight, BMI, and obesity-related complications) and resource use (primary care, pharmaceutical, and hospital resource use) were collected. Potential confounders were controlled for using propensity weighted regression analyses.

RESULTS

Relative to low level involvement of practice nurses in the provision of clinical-based activities to obese patients, high level involvement was associated with lower costs and better outcomes (more patients losing weight, and larger mean reductions in BMI). Excluding hospital costs, high level practice nurse involvement was associated with slightly higher costs. Incrementally, the high level model gets one additional obese patient to lose weight at an additional cost of $6,741, and reduces mean BMI by an additional one point at an additional cost of $563 (upper 95% confidence interval $1,547).

CONCLUSION

Converted to quality adjusted life year (QALY) gains, the results provide a strong indication that increased involvement of practice nurses in clinical activities is associated with additional health benefits that are achieved at reasonable additional cost. Dissemination activities and incentives are required to encourage general practices to better integrate practice nurses in the active provision of clinical services.

Quality: performance improvement, teamwork, information technology and protocols

Using the Institute of Medicine framework that outlines the domains of quality, this article considers four key aspects of health care delivery which have the potential to significantly affect the quality of health care within the pediatric intensive care unit. The discussion covers: performance improvement and how existing methods for reporting, review, and analysis of medical error relate to patient care; team composition and workflow; and the impact of information technologies on clinical practice. Also considered is how protocol-driven and standardized practice affects both patients and the fiscal interests of the health care system.