1
|
Karnon J, Partington A, Gray J, Pincombe A, Schultz T. Local Level Economic Evaluation: What is it? What is its Value? Is it Sustainable? APPLIED HEALTH ECONOMICS AND HEALTH POLICY 2024; 22:273-281. [PMID: 37980329 DOI: 10.1007/s40258-023-00847-z] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Accepted: 10/19/2023] [Indexed: 11/20/2023]
Abstract
In Australia, local health services with allocated budgets manage public hospital services for defined geographical areas. The authors were embedded in a local health service for around 2 years and undertook a range of local level economic evaluations for which three decision contexts were defined: intervention development, post-implementation and prioritisation. Despite difficulties in estimating opportunity costs and in the relevance of portfolio-based prioritisation approaches, economic evaluation added value to local decision-making. Development-focused (ex ante) economic evaluations used expert elicitation and calibration methods to synthesise published evidence with local health systems data to evaluate interventions to prevent hospital acquired complications. The use of economic evaluation facilitated the implementation of interventions with additional resource requirements. Decision analytic models were used alongside the implementation of larger scale, more complex service interventions to estimate counterfactual patient pathways, costs and outcomes, providing a transparent alternative to the statistical analyses of intervention effects, which were subject to high risk of bias. Economic evaluations of more established services had less impact due to data limitations and lesser executive interest. Prioritisation-focused economic evaluations compared costs, outcomes and processes of care for defined patient populations across alternative local health services to identify, understand and quantify the effects of unwarranted variation to inform priority areas for improvement within individual local health services. The sustained use of local level economic evaluation could be supported by embedding health economists in local continuous improvement units, perhaps with an initial focus on supporting the development and evaluation of prioritised new service interventions. Shared resources and critical mass are important, which could be facilitated through groups of embedded economists with joint appointments between different local health services and the same academic institution.
Collapse
Affiliation(s)
- Jonathan Karnon
- Flinders Health and Medical Research Institute, Flinders University, Adelaide, SA, Australia.
| | - Andrew Partington
- Flinders Health and Medical Research Institute, Flinders University, Adelaide, SA, Australia
| | - Jodi Gray
- Flinders Health and Medical Research Institute, Flinders University, Adelaide, SA, Australia
| | - Aubyn Pincombe
- Flinders Health and Medical Research Institute, Flinders University, Adelaide, SA, Australia
| | - Timothy Schultz
- Flinders Health and Medical Research Institute, Flinders University, Adelaide, SA, Australia
| |
Collapse
|
2
|
Buisman LR, Rijnsburger AJ, den Hertog HM, van der Lugt A, Redekop WK. Clinical Practice Variation Needs to be Considered in Cost-Effectiveness Analyses: A Case Study of Patients with a Recent Transient Ischemic Attack or Minor Ischemic Stroke. APPLIED HEALTH ECONOMICS AND HEALTH POLICY 2016; 14:67-75. [PMID: 25917685 PMCID: PMC4740566 DOI: 10.1007/s40258-015-0167-4] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/29/2023]
Abstract
BACKGROUND AND OBJECTIVE The cost-effectiveness of clinical interventions is often assessed using current care as the comparator, with national guidelines as a proxy. However, this comparison is inadequate when clinical practice differs from guidelines, or when clinical practice differs between hospitals. We examined the degree of variation in the way patients with a recent transient ischemic attack (TIA) or minor ischemic stroke are assessed and used the results to illustrate the importance of investigating possible clinical practice variation, and the need to perform hospital-level cost-effectiveness analyses (CEAs) when variation exists. METHODS Semi-structured interviews were conducted with 16 vascular neurologists in hospitals throughout the Netherlands. Questions were asked about the use of initial and confirmatory diagnostic imaging tests to assess carotid stenosis in patients with a recent TIA or minor ischemic stroke, criteria to perform confirmatory tests, and criteria for treatment. We also performed hospital-level CEAs to illustrate the consequences of the observed diagnostic strategies in which the diagnostic test costs, sensitivity and specified were varied according to the local hospital conditions. RESULTS 56 % (9/16) of the emergency units and 63 % (10/16) of the outpatient clinics use the initial and confirmatory diagnostic tests to assess carotid stenosis in accordance with the national guidelines. Of the hospitals studied, only one uses the recommended criteria for use of a confirmatory test, 38 % (6/16) follow the guidelines for treatment. The most cost-effective diagnostic test strategy differs between hospitals. CONCLUSIONS If important practice variation exists, hospital-level CEAs should be performed. These CEAs should include an assessment of the feasibility and costs of switching to a different strategy.
Collapse
Affiliation(s)
- Leander R Buisman
- Institute of Health Policy and Management, Erasmus University Rotterdam, PO Box 1738, 3000 DR, Rotterdam, The Netherlands.
- Institute for Medical Technology Assessment, Erasmus University Rotterdam, PO Box 1738, 3000 DR, Rotterdam, The Netherlands.
| | - Adriana J Rijnsburger
- Institute of Health Policy and Management, Erasmus University Rotterdam, PO Box 1738, 3000 DR, Rotterdam, The Netherlands
- Institute for Medical Technology Assessment, Erasmus University Rotterdam, PO Box 1738, 3000 DR, Rotterdam, The Netherlands
| | - Heleen M den Hertog
- Department of Neurology, Medical Spectrum Twente, PO Box 50000, 7500 KA, Enschede, The Netherlands
- Department of Neurology, Erasmus MC, University Medical Center Rotterdam, PO Box 2040, 3000 CA, Rotterdam, The Netherlands
| | - Aad van der Lugt
- Department of Radiology, Erasmus MC, University Medical Center Rotterdam, PO Box 2040, 3000 CA, Rotterdam, The Netherlands
| | - William K Redekop
- Institute of Health Policy and Management, Erasmus University Rotterdam, PO Box 1738, 3000 DR, Rotterdam, The Netherlands
- Institute for Medical Technology Assessment, Erasmus University Rotterdam, PO Box 1738, 3000 DR, Rotterdam, The Netherlands
| |
Collapse
|
3
|
Partington A, Wynn M, Suriadi S, Ouyang C, Karnon J. Process Mining for Clinical Processes. ACM TRANSACTIONS ON MANAGEMENT INFORMATION SYSTEMS 2015. [DOI: 10.1145/2629446] [Citation(s) in RCA: 29] [Impact Index Per Article: 3.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/24/2022]
Abstract
Business process analysis and process mining, particularly within the health care domain, remain under-utilized. Applied research that employs such techniques to routinely collected health care data enables stakeholders to empirically investigate care as it is delivered by different health providers. However, cross-organizational mining and the comparative analysis of processes present a set of unique challenges in terms of ensuring population and activity comparability, visualizing the mined models, and interpreting the results. Without addressing these issues, health providers will find it difficult to use process mining insights, and the potential benefits of evidence-based process improvement within health will remain unrealized. In this article, we present a brief introduction on the nature of health care processes, a review of process mining in health literature, and a case study conducted to explore and learn how health care data and cross-organizational comparisons with process-mining techniques may be approached. The case study applies process-mining techniques to administrative and clinical data for patients who present with chest pain symptoms at one of four public hospitals in South Australia. We demonstrate an approach that provides detailed insights into clinical (quality of patient health) and fiscal (hospital budget) pressures in the delivery of health care. We conclude by discussing the key lessons learned from our experience in conducting business process analysis and process mining based on the data from four different hospitals.
Collapse
Affiliation(s)
| | - Moe Wynn
- Queensland University of Technology, Information Systems School, Australia
| | - Suriadi Suriadi
- Queensland University of Technology, Information Systems School, Australia
| | - Chun Ouyang
- Queensland University of Technology, Information Systems School, Australia
| | - Jonathan Karnon
- University of Adelaide, School of Population Health, Australia
| |
Collapse
|
4
|
Crane GJ, Kymes SM, Hiller JE, Casson R, Martin A, Karnon JD. Accounting for costs, QALYs, and capacity constraints: using discrete-event simulation to evaluate alternative service delivery and organizational scenarios for hospital-based glaucoma services. Med Decis Making 2013; 33:986-97. [PMID: 23515216 DOI: 10.1177/0272989x13478195] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
Abstract
BACKGROUND Decision-analytic models are routinely used as a framework for cost-effectiveness analyses of health care services and technologies; however, these models mostly ignore resource constraints. In this study, we use a discrete-event simulation model to inform a cost-effectiveness analysis of alternative options for the organization and delivery of clinical services in the ophthalmology department of a public hospital. The model is novel, given that it represents both disease outcomes and resource constraints in a routine clinical setting. METHODS A 5-year discrete-event simulation model representing glaucoma patient services at the Royal Adelaide Hospital (RAH) was implemented and calibrated to patient-level data. The data were sourced from routinely collected waiting and appointment lists, patient record data, and the published literature. Patient-level costs and quality-adjusted life years were estimated for a range of alternative scenarios, including combinations of alternate follow-up times, booking cycles, and treatment pathways. RESULTS The model shows that a) extending booking cycle length from 4 to 6 months, b) extending follow-up visit times by 2 to 3 months, and c) using laser in preference to medication are more cost-effective than current practice at the RAH eye clinic. CONCLUSIONS The current simulation model provides a useful tool for informing improvements in the organization and delivery of glaucoma services at a local level (e.g., within a hospital), on the basis of expected effects on costs and health outcomes while accounting for current capacity constraints. Our model may be adapted to represent glaucoma services at other hospitals, whereas the general modeling approach could be applied to many other clinical service areas.
Collapse
Affiliation(s)
- Glenis J Crane
- University of Adelaide, Adelaide, South Australia, Australia (GJC, RC, JDK)
| | | | - Janet E Hiller
- Australian Catholic University, Melbourne, Victoria, Australia (JEH)
| | - Robert Casson
- University of Adelaide, Adelaide, South Australia, Australia (GJC, RC, JDK)
| | - Adam Martin
- Health Economics Group, Norwich Medical School, University of East Anglia, Norwich, UK (AM)
| | - Jonathan D Karnon
- University of Adelaide, Adelaide, South Australia, Australia (GJC, RC, JDK)
| |
Collapse
|
5
|
Karnon J, Ali Afzali HH, Gray J, Holton C, Banham D, Beilby J. A risk adjusted cost-effectiveness analysis of alternative models of nurse involvement in obesity management in primary care. Obesity (Silver Spring) 2013; 21:472-9. [PMID: 23592655 DOI: 10.1002/oby.20100] [Citation(s) in RCA: 12] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/04/2012] [Accepted: 08/16/2012] [Indexed: 11/11/2022]
Abstract
OBJECTIVE Controlled evaluations are subject to uncertainty regarding their replication in the real world, particularly around systems of service provision. Using routinely collected data, we undertook a risk adjusted cost-effectiveness (RAC-E) analysis of alternative applied models of primary health care for the management of obese adult patients. Models were based on the reported level of involvement of practice nurses (registered or enrolled nurses working in general practice) in the provision of clinical-based activities. DESIGN AND METHODS Linked, routinely collected clinical data describing clinical outcomes (weight, BMI, and obesity-related complications) and resource use (primary care, pharmaceutical, and hospital resource use) were collected. Potential confounders were controlled for using propensity weighted regression analyses. RESULTS Relative to low level involvement of practice nurses in the provision of clinical-based activities to obese patients, high level involvement was associated with lower costs and better outcomes (more patients losing weight, and larger mean reductions in BMI). Excluding hospital costs, high level practice nurse involvement was associated with slightly higher costs. Incrementally, the high level model gets one additional obese patient to lose weight at an additional cost of $6,741, and reduces mean BMI by an additional one point at an additional cost of $563 (upper 95% confidence interval $1,547). CONCLUSION Converted to quality adjusted life year (QALY) gains, the results provide a strong indication that increased involvement of practice nurses in clinical activities is associated with additional health benefits that are achieved at reasonable additional cost. Dissemination activities and incentives are required to encourage general practices to better integrate practice nurses in the active provision of clinical services.
Collapse
Affiliation(s)
- J Karnon
- Discipline of Public Health, School of Population Health, University of Adelaide, SA 5005, Australia.
| | | | | | | | | | | |
Collapse
|
6
|
Coleman NE, Pon S. Quality: performance improvement, teamwork, information technology and protocols. Crit Care Clin 2013; 29:129-51. [PMID: 23537668 DOI: 10.1016/j.ccc.2012.11.002] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/27/2022]
Abstract
Using the Institute of Medicine framework that outlines the domains of quality, this article considers four key aspects of health care delivery which have the potential to significantly affect the quality of health care within the pediatric intensive care unit. The discussion covers: performance improvement and how existing methods for reporting, review, and analysis of medical error relate to patient care; team composition and workflow; and the impact of information technologies on clinical practice. Also considered is how protocol-driven and standardized practice affects both patients and the fiscal interests of the health care system.
Collapse
Affiliation(s)
- Nana E Coleman
- Division of Critical Care Medicine, Department of Pediatrics, Weill Cornell Medical College, 525 East 68th Street, M-508, New York, NY 10065-4870, USA
| | | |
Collapse
|