Validating health economic models with the Probabilistic Analysis Check dashBOARD (PACBOARD)

OBJECTIVES

Health economic (HE) models are often considered as "black boxes" because they are not publicly available and lack transparency, which prevents independent scrutiny of HE models. Additionally, validation efforts and validation status of HE models are not systematically reported. Methods to validate HE models in absence of their full underlying code are therefore urgently needed to improve health policy making.This study aimed to develop and test a generic dashboard to systematically explore the workings of HE models and validate their model parameters and outcomes.

METHODS

The Probabilistic Analysis Check dashBOARD (PACBOARD) was developed using insights from literature, health economists, and a data scientist.Functionalities of PACBOARD are 1) exploring and validating model parameters and outcomes using standardised validation tests and interactive plots, 2) visualising and investigating the relationship between model parameters and outcomes using metamodelling, and 3) predicting health economic outcomes using the fitted metamodel.To test PACBOARD, two mock HE models were developed and errors were introduced in these models, e.g. negative costs inputs, utility values exceeding 1. PACBOARD metamodelling predictions of incremental net monetary benefit were validated against the original model's outcomes.

RESULTS

PACBOARD automatically identified all errors introduced in the erroneous HE models. Metamodel predictions were accurate compared to the original model outcomes.

CONCLUSIONS

PACBOARD is a unique dashboard aiming at improving the feasibility and transparency of validation efforts of HE models. PACBOARD allows users to explore the working of HE models using metamodelling based on HE models' parameters and outcomes.

Quantifying hospital-associated costs, and accompanying travel costs and productivity losses, before and after withdrawing tumour necrosis factor-alfa inhibitors in juvenile idiopathic arthritis

OBJECTIVE

To quantify differences in hospital-associated costs, and accompanying travel costs and productivity losses, before and after withdrawing TNFi in JIA patients.

METHODS

Retrospective analysis of prospectively collected data from electronic medical records of paediatric JIA patients treated with TNFi, which were either immediately discontinued, spaced (increased treatment interval) or tapered (reduced subsequent doses). Costs of hospital-associated resource use (consultations, medication, radiology procedures, laboratory testing, procedures under general anaesthesia, hospitalisation) and associated travel costs and productivity losses were quantified during clinically inactive disease until TNFi withdrawal (pre-withdrawal period) and compared with costs during the first and second year after withdrawal initiation (first and second year post-withdrawal).

RESULTS

Fifty-six patients were included of whom 26 immediately discontinued TNFi, 30 spaced and zero tapered. Mean annual costs were €9,165/patient on active treatment (pre-withdrawal) and decreased significantly to €5,063/patient (-44.8%) and €6,569/patient (-28.3%) in the first and second year post-withdrawal, respectively (p< 0.05). Of these total annual costs, travel costs plus productivity losses were €834/patient, €1,180/patient, and €1,320/patient, in the three periods respectively. Medication comprised 80.7%, 61.5% and 72.4% of total annual costs in the pre-withdrawal, first, and second year post-withdrawal period, respectively.

CONCLUSION

In the first two years after initiating withdrawal, the total annual costs are decreased compared with the pre-withdrawal period. However, cost reductions were lower in the second year compared with the first year post-withdrawal, primarily due to restarting or intensifying biologics. To support biologic withdraw decisions, future research should assess the full long-term societal cost impacts, and include all biologics.

Withdrawing biologics in non-systemic JIA: what matters to pediatric rheumatologists?

OBJECTIVE

Approximately one third of children with JIA receive biologic therapy, but evidence on biologic therapy withdrawal is lacking. This study aims to increase our understanding of whether and when pediatric rheumatologists postpone a decision to withdraw biologic therapy in children with clinically inactive non-systemic JIA.

METHODS

A survey containing questions about background characteristics, treatment patterns, minimum treatment time with biologic therapy, and 16 different patient vignettes, was distributed among 83 pediatric rheumatologists in Canada and the Netherlands. For each vignette, respondents were asked whether they would withdraw biologic therapy at their minimum treatment time, and if not, how long they would continue biologic therapy. Statistical analysis included descriptive statistics, logistic and interval regression analysis.

RESULTS

Thirty-three pediatric rheumatologists completed the survey (40% response rate). Pediatric rheumatologists are most likely to postpone the decision to withdraw biologic therapy when the child and/or parents express a preference for continuation (OR 6.3; p < 0.001), in case of a flare in the current treatment period (OR 3.9; p = 0.001), and in case of uveitis in the current treatment period (OR 3.9; p < 0.001). On average, biologic therapy withdrawal is initiated 6.7 months later when the child or parent prefer to continue treatment.

CONCLUSION

Patient's and parents' preferences were the strongest driver of a decision to postpone biologic therapy withdrawal in children with clinically inactive non-systemic JIA and prolongs treatment duration. These findings highlight the potential benefit of a tool to support pediatric rheumatologists, patients and parents in decision making, and can help inform its design.

What matters most to pediatric rheumatologists in deciding whether to discontinue biologics in a child with juvenile idiopathic arthritis? A best-worst scaling survey

OBJECTIVES

Care for JIA patients has been transformed in the biologics era; however, biologics carry important (although rare) risks and are costly. Flares after biological withdrawal are seen frequently, yet there is little clinical guidance to identify which patients in clinical remission can safely have their biologic discontinued (by stopping or tapering). We examined what characteristics of the child or their context are important to pediatric rheumatologists when making the decision to discuss withdrawal of biologics.

METHODS

We conducted a survey including a best-worst scaling (BWS) exercise in pediatric rheumatologists who are part of the UCAN CAN-DU network to assess the relative importance of 14 previously identified characteristics. A balanced incomplete block design was used to generate choice tasks. Respondents evaluated 14 choice sets of 5 characteristics of a child with JIA and identified for each set which was the most and least important in the decision to offer withdrawal. Results were analyzed using conditional logit regression.

RESULTS

Fifty-one (out of 79) pediatric rheumatologists participated (response rate 65%). The three most important characteristics were how challenging it was to achieve remission, history of established joint damage, and time spent in remission. The three least important characteristics were history of temporomandibular joint involvement, accessibility of biologics, and the patient's age.

CONCLUSIONS

These findings give quantitative insight about factors important to pediatric rheumatologists' decision-making about biologic withdrawal. In addition to high quality clinical evidence, further research is needed to understand the perspective of patients and families to inform shared decision-making about biologic withdrawal for JIA patients with clinically inactive disease. Key Points ● What is already known on this topic-there is limited clinical guidance for pediatric rheumatologists in making decisions about biologic withdrawal for patients with juvenile idiopathic arthritis who are in clinical remission. ● What this study adds-this study quantitatively examined what characteristic of the child in clinical remission, or of their context, are most important to pediatric rheumatologists in deciding whether to offer withdrawal of biologics. ● How this study might affect research, practice or policy-understanding of these characteristics can provide useful information to other pediatric rheumatologists in making their decisions, and may guide areas to focus on for future research.

Costs of Hospital-Associated Care for Patients With Juvenile Idiopathic Arthritis in the Dutch Health Care System

OBJECTIVE

The aim of this study was to quantify costs of hospital-associated care for juvenile idiopathic arthritis (JIA), provide insights in patient-level variation in costs, and investigate costs over time from the moment of JIA diagnosis. Results were reported for all JIA patients in general and by subtype.  METHODS: This study was a single-center, retrospective analysis of prospective data from electronic medical records of children with JIA, ages 0-18 years, between April 1, 2011 and March 31, 2019. Patient characteristics (age, sex, JIA subtype) and hospital-based resource use (consultations, medication, radiology procedures, laboratory testing, surgeries, emergency department [ED] visits, hospital stays) were extracted and analyzed. Unit prices were obtained from Dutch reimbursement lists and pharmaceutical and hospital list prices.

RESULTS

The analysis included 691 patients. The mean total cost of hospital care was €3,784/patient/year, of which €2,103 (55.6%) was attributable to medication. Other costs involved pediatric rheumatologist visits (€633/patient/year [16.7%]), hospital stays (€439/patient/year [11.6%]), other within-hospital specialist visits (€324/patient/year [8.6%]), radiology procedures (€119/patient/year [3.1%]), laboratory tests (€114/patient/year [3.0%]), surgeries (€46/patient/year [1.2%]), and ED visits (€6/patient/year [0.2%]). Mean annual total costs varied between JIA subtypes and between individuals and were the highest for systemic JIA (€7,772/patient/year). Over the treatment course, costs were the highest in the first month after JIA diagnosis.

CONCLUSION

Hospital care costs of JIA vary substantially between individuals, between subtypes, and over the treatment course. The highest annual costs were for systemic JIA, primarily attributable to medication (i.e., biologics). Costs of other hospital-associated care were comparable regardless of subtype.

Perspectives of Pediatric Rheumatologists on Initiating and Tapering Biologics in Patients with Juvenile Idiopathic Arthritis: A Formative Qualitative Study

BACKGROUND

Few studies have examined pediatric rheumatologists' approaches to treatment decision making for biologic therapy for patients with juvenile idiopathic arthritis (JIA). This study presents the qualitative research undertaken to support the development of a Best-Worst Scaling (BWS) survey for tapering in JIA. The study objectives were to (1) describe the treatment decision-making process of pediatric rheumatologists to initiate and taper biologics; and (2) select attributes for a BWS survey.

METHODS

Pediatric rheumatologists across Canada were recruited to participate in interviews using purposeful sampling. Interviews were conducted until saturation was achieved. Interview recordings were transcribed verbatim and transcripts were analyzed using deductive thematic analysis. Initial codes were organized into themes and subthemes using an iterative process. Attributes for the BWS survey were developed from these themes and a literature review was conducted in parallel to inform survey development. Further refinement of the attributes was done through consultation with the research team.

RESULTS

Five pediatric rheumatologists participated in the interviews. Shared decision making was part of the approach to initiating and tapering biologics in their practice. Tapering approaches differed; some pediatric rheumatologists preferred to stop biologics immediately, while others tapered by reducing dose and/or increasing the dose interval over time. A total of 14 attributes were developed for the BWS. Thirteen attributes were selected from the themes that emerged from the qualitative interviews and one attribute was included after review with the research team. Attributes related to patient characteristics included JIA subtype, time in remission, history or presence of joint damage or erosive disease, how challenging it was to achieve remission, and history of flares. Contextual attributes included accessibility of biologics and willingness to taper biologics.

CONCLUSION

This study contributes to the limited literature on pediatric rheumatologists' approaches to treatment decision making for biologics in JIA and identifies attributes that affect the decision to both initiate and taper. Further research is planned to implement the BWS survey to understand the importance of the attributes identified. Additional investigation is required to determine if these characteristics align with patient and parent preferences.

Factors associated with care- and health-related quality of life of caregivers of children with juvenile idiopathic arthritis

OBJECTIVE

This study investigates the relationship of child, caregiver, and caring context measurements with the care-related quality of life (CRQoL) and health-related quality of life (HRQoL) of caregivers of children with juvenile idiopathic arthritis (JIA).

METHODS

We performed a cross-sectional analysis of baseline data on caregivers of children with JIA from Canada and the Netherlands collected for the "Canada-Netherlands Personalized Medicine Network in Childhood Arthritis and Rheumatic Diseases" study from June 2019 to September 2021. We used the CRQoL questionnaire (CarerQoL), adult EQ-5D-5L, and proxy-reported Youth 5-Level version of EuroQoL (EQ-5D-5L-Y) to assess caregiver CRQoL, caregiver HRQoL, and child HRQoL, respectively. We used a multivariate analysis to assess the relationship between both caregiver CRQoL and HRQoL and patient, caregiver, and caring context measurements.

RESULTS

A total of 250 caregivers were included in this study. Most of the caregivers were from the Netherlands (n = 178, 71%) and 77% were females (n = 193). The mean CarerQoL scores was 82.7 (standard deviation (SD) 11.4) and the mean EQ-5D-5L utility score was 0.87 (SD 0.16). Child HRQoL and employment had a positive relationship with both caregiver CarerQoL and EQ-5D-5L utility scores (p < 0.05), while receiving paid or unpaid help had a negative relationship with both scores (p < 0.05).

CONCLUSION

Our findings indicated that to understand the impact of JIA on families, we need to consider socio-economic factors, such as employment and support to carry caregiving tasks, in addition to child HRQoL.

Pharmacological treatment patterns in patients with juvenile idiopathic arthritis in the Netherlands: a real-world data analysis

OBJECTIVE

To investigate medication prescription patterns among children with JIA, including duration, sequence and reasons for medication discontinuation.

METHODS

This study is a single-centre, retrospective analysis of prospective data from the electronic medical records of JIA patients receiving systemic therapy aged 0-18 years between 1 April 2011 and 31 March 2019. Patient characteristics (age, gender, JIA subtype) and medication prescriptions were extracted and analysed using descriptive statistics, Sankey diagrams and Kaplan-Meier survival methods.

RESULTS

Over a median of 4.2 years follow-up, the 20 different medicines analysed were prescribed as monotherapy (n = 15) or combination therapy (n = 48 unique combinations) among 236 patients. In non-systemic JIA, synthetic DMARDs were prescribed to almost all patients (99.5%), and always included MTX. In contrast, 43.9% of non-systemic JIA patients received a biologic DMARD (mostly adalimumab or etanercept), ranging from 30.9% for oligoarticular persistent ANA-positive JIA, to 90.9% for polyarticular RF-positive JIA. Among systemic JIA, 91.7% received a biologic DMARD (always including anakinra). When analysing medication prescriptions according to their class, 32.6% involved combination therapy. In 56.8% of patients, subsequent treatment lines were initiated after unsuccessful first-line treatment, resulting in 68 unique sequences. Remission was the most common reason for DMARD discontinuation (44.7%), followed by adverse events (28.9%) and ineffectiveness (22.1%).

CONCLUSION

This paper reveals the complexity of pharmacological treatment in JIA, as indicated by: the variety of mono- and combination therapies prescribed, substantial variation in medication prescriptions between subtypes, most patients receiving two or more treatment lines, and the large number of unique treatment sequences.

Real-world data reveals the complexity of disease modifying anti-rheumatic drug treatment patterns in juvenile idiopathic arthritis: an observational study

OBJECTIVE

Pharmacological treatment is a cornerstone of care for children with juvenile idiopathic arthritis (JIA). The objective of this study is to evaluate prescription patterns of conventional and biologic disease modifying anti-rheumatic drugs (c-DMARDs and b-DMARDs) for patients with JIA.

METHODS

We conducted a retrospective cohort study of children diagnosed with JIA at a rheumatology pediatric clinic. Eligibility criteria were defined as children and youth newly diagnosed with enthesis-related arthritis, polyarticular, or oligoarticular JIA between 2011 and 2019, with at least one year of observation. Data on c-DMARDs and b-DMARDs prescriptions were obtained from electronic medical charts. We used descriptive statistics, Kaplan-Meier survival methods, and Sankey diagrams to describe treatment prescription patterns.

RESULTS

A total of 325 patients with JIA were included, with a median observation time of 3.7 years. The most frequently prescribed c-DMARD and b-DMARD were methotrexate and etanercept, respectively. Within the first year of rheumatology care, 62% and 21% of patients had a c-DMARD and a b-DMARD prescribed, respectively. These proportions varied greatly by JIA subtype. Among the 147 (147/325, 45%) patients that had at least one b-DMARD prescribed, 24% were prescribed a second, and 7% a third-line of b-DMARD. A total of 112 unique treatment sequences were observed, with c-DMARD monotherapy followed by the addition of either a b-DMARD (56%) or another c-DMARD (30%) being the two most prevalent patterns in this cohort.

CONCLUSION

We observed a variety of treatment trajectories, with many patients experiencing multiple treatment lines, illustrating the complexity of the overall JIA treatment path.

Evaluation of Real-World Healthcare Resource Utilization and Associated Costs in Children with Juvenile Idiopathic Arthritis: A Canadian Retrospective Cohort Study

INTRODUCTION

Juvenile idiopathic arthritis (JIA) is a chronic rheumatic disease, whose multifaceted care path can lead to significant expenditure for the healthcare system. We aim to assess the real-world healthcare resource use (HCRU) and associated cost for children with JIA in a single center in Canada.

METHODS

A single-center consecutive cohort of newly diagnosed patients with JIA attending the pediatric rheumatology clinic from 2011 to 2019 was identified using an administrative data algorithm and electronic medical charts. HCRU was estimated from six administrative health databases that included hospital admissions, emergency, outpatient care, practitioners' visits, medication, and laboratory and imaging tests. Costs were assigned using appropriate sources. We reported the yearly overall and JIA-associated HCRU and costs 5 years prior to and 6 years after the first visit to the pediatric rheumatologist. The Zhao and Tian estimator was used to calculate cumulative mean costs over a 6-year timeframe. Results were stratified by disease subtype.

RESULTS

A total of 389 patients were identified. The yearly total overall mean costs per patient ranged between $804 and $4460 during the 5 years prior to the first visit to the pediatric rheumatologist and $8529 and $10,651 for the 6 years after. Medication cost, driven by use of biologic therapies, and outpatient visits were the greatest contributor to the total cost. The overall cumulative mean cost for 6 years of care was $48,649 per patient, while the JIA-associated cumulative mean cost was $26,820 per patient. During the first year of rheumatology care, systemic onset JIA had the highest cumulative mean overall cost, while oligoarticular JIA had the lowest cumulative mean cost.

CONCLUSION

The care pathway for children with JIA can be expensive, and complex-and varies by JIA subtype. Although the yearly total mean cost per patient was constant, the distribution of costs changes over time with the introduction of biologic therapies later in the care pathway. This study provides a better understanding of the JIA costs profile and can help inform future economic studies.

Costs of medication use among patients with juvenile idiopathic arthritis in the Dutch healthcare system

Background: This study aims to quantify medication costs in juvenile idiopathic arthritis (JIA), based on subtype.Research design and methods: This study is a single-center, retrospective analysis of prospective data from electronic medical records of JIA patients, aged 0-18 years between 1 April 2011 and 31 March 2019. Patient characteristics (age, gender, subtype) and medication use were extracted. Medication use and costs were reported as: 1) mean total annual costs; 2) between-patient heterogeneity in these costs; 3) duration of medication use; and, 4) costs over the treatment course.Results: The analysis included 691 patients. Mean total medication costs were €2,103/patient/year, including €1,930/patient/year (91.8%) spent on biologicals. Costs varied considerably between subtypes, with polyarticular rheumatoid-factor positive and systemic JIA patients having the highest mean costs (€5,020/patient/year and €4,790/patient/year, respectively). Mean annual medication costs over the patient's treatment course ranged from <€1,000/year (71.1% of patients) to >€11,000/year (2.5% of patients). Etanercept and adalimumab were the most commonly used biologicals. Cost fluctuations over the treatment course were primarily attributable to biological use.Conclusions: Polyarticular rheumatoid-factor positive and systemic JIA patients had the highest mean total annual medication costs, primarily attributable to biologicals. Costs varied considerably between subtypes, individuals, and over the treatment course.

Health State Utility Values in Juvenile Idiopathic Arthritis: What is the Evidence?

OBJECTIVES

The objectives of this systematic review were to identify health state utility values (HSUV) of children and adults with juvenile idiopathic arthritis in the literature and to assess whether HSUV were appropriately reported and could be used to inform parameter inputs for a model-based cost-utility analysis to inform decision making.

METHODS

MEDLINE, EMBASE, PsycINFO, EconLit and CINAHL databases were searched in July 2019. Inclusion criteria were studies using preference-based instruments, targeting children or adults with juvenile idiopathic arthritis, and in the English language. The quality of studies was assessed using a modified checklist that included relevant sources of bias and assessment of quality of HSUV valuation and measurement. A descriptive analysis was conducted, including assessment on reporting of population characteristics and stratification of HSUV by potential health states or population subgroup.

RESULTS

From 620 identified articles, ten reported HSUV. Seven studies reported HSUV of children with juvenile idiopathic arthritis, and three of adults with a history of juvenile idiopathic arthritis. Population disease activity status and drug treatment were reported in less than half of the studies. Six (out of ten) studies stratified HSUV results for at least one of the potential health state categories, but they represent very specific situations or interventions (e.g. patients receiving different types of physiotherapy or treated with etanercept over time).

CONCLUSIONS

We have identified critical gaps in the literature reporting HSUV in patients with juvenile idiopathic arthritis including a lack of HSUV measures for distinct health states, particularly in adults with a history of juvenile idiopathic arthritis. The current reported HSUV data in juvenile idiopathic arthritis are insufficient for a full cost-utility analysis with a short or lifetime horizon.

Preventing overuse of laboratory diagnostics: a case study into diagnosing anaemia in Dutch general practice

Background

More information is often thought to improve medical decision-making, which may lead to test overuse. This study assesses which out of 15 laboratory tests contribute to diagnosing the underlying cause of anaemia by general practitioners (GPs) and determines a potentially more efficient subset of tests for setting the correct diagnosis.

Methods

Logistic regression was performed to determine the impact of individual tests on the (correct) diagnosis. The statistically optimal test subset for diagnosing a (correct) underlying cause of anaemia by GPs was determined using data from a previous survey including cases of real-world anaemia patients.

Results

Only 9 (60%) of the laboratory tests, and patient age, contributed significantly to the GPs’ ability to diagnose an underlying cause of anaemia (CRP, ESR, ferritin, folic acid, haemoglobin, leukocytes, eGFR/MDRD, reticulocytes and serum iron). Diagnosing the correct underlying cause may require just five (33%) tests (CRP, ferritin, folic acid, MCV and transferrin), and patient age.

Conclusions

In diagnosing the underlying cause of anaemia a subset of five tests has most added value. The real-world impact of using only this subset should be further investigated. As illustrated in this case study, a statistical approach to assessing the added value of tests may reduce test overuse.

Toward Alignment in the Reporting of Economic Evaluations of Diagnostic Tests and Biomarkers: The AGREEDT Checklist

Objectives. General frameworks for conducting and reporting health economic evaluations are available but not specific enough to cover the intricacies of the evaluation of diagnostic tests and biomarkers. Such evaluations are typically complex and model-based because tests primarily affect health outcomes indirectly and real-world data on health outcomes are often lacking. Moreover, not all aspects relevant to the evaluation of a diagnostic test may be known and explicitly considered for inclusion in the evaluation, leading to a loss of transparency and replicability. To address this challenge, this study aims to develop a comprehensive reporting checklist. Methods. This study consisted of 3 main steps: 1) the development of an initial checklist based on a scoping review, 2) review and critical appraisal of the initial checklist by 4 independent experts, and 3) development of a final checklist. Each item from the checklist is illustrated using an example from previous research. Results. The scoping review followed by critical review by the 4 experts resulted in a checklist containing 44 items, which ideally should be considered for inclusion in a model-based health economic evaluation. The extent to which these items were included or discussed in the studies identified in the scoping review varied substantially, with 14 items not being mentioned in ≥47 (75%) of the included studies. Conclusions. The reporting checklist developed in this study may contribute to improved transparency and completeness of model-based health economic evaluations of diagnostic tests and biomarkers. Use of this checklist is therefore encouraged to enhance the interpretation, comparability, and—indirectly—the validity of the results of such evaluations.

Seeking the state of the art in standardized measurement of health care resource use and costs in juvenile idiopathic arthritis: a scoping review

BACKGROUND

This study aims to describe current practice in identifying and measuring health care resource use and unit costs in economic evaluations or costing studies of juvenile idiopathic arthritis (JIA).

METHODS

A scoping review was conducted (in July 2018) in PubMed and Embase to identify economic evaluations, costing studies, or resource utilization studies focusing on patients with JIA. Only English language peer-reviewed articles reporting primary research were included. Data from all included full-text articles were extracted and analysed to identify the reported health care resource use items. In addition, the data sources used to obtain these resource use and unit costs were identified for all included articles.

RESULTS

Of 1176 unique citations identified by the search, 20 full-text articles were included. These involved 4 full economic evaluations, 5 cost-outcome descriptions, 8 cost descriptions, and 3 articles reporting only resource use. The most commonly reported health care resource use items involved medication (80%), outpatient and inpatient hospital visits (80%), laboratory tests (70%), medical professional visits (70%) and other medical visits (65%). Productivity losses of caregivers were much more often incorporated than (future) productivity losses of patients (i.e. 55% vs. 15%). Family borne costs were not commonly captured (ranging from 15% for school costs to 50% for transportation costs). Resource use was mostly obtained from family self-reported questionnaires. Estimates of unit costs were mostly based on reimbursement claims, administrative data, or literature.

CONCLUSIONS

Despite some consistency in commonly included health care resource use items, variability remains in including productivity losses, missed school days and family borne costs. As these items likely substantially influence the full cost impact of JIA, the heterogeneity found between the items reported in the included studies limits the comparability of the results. Therefore, standardization of resource use items and unit costs to be collected is required. This standardization will provide guidance to future research and thereby improve the quality and comparability of economic evaluations or costing studies in JIA and potentially other childhood diseases. This would allow better understanding of the burden of JIA, and to estimate how it varies across health care systems.

Understanding the adoption and use of point-of-care tests in Dutch general practices using multi-criteria decision analysis

BACKGROUND

The increasing number of available point-of-care (POC) tests challenges clinicians regarding decisions on which tests to use, how to efficiently use them, and how to interpret the results. Although POC tests may offer benefits in terms of low turn-around-time, improved patient's satisfaction, and health outcomes, only few are actually used in clinical practice. Therefore, this study aims to identify which criteria are, in general, important in the decision to implement a POC test, and to determine their weight. Two POC tests available for use in Dutch general practices (i.e. the C-reactive protein (CRP) test and the glycated haemoglobin (HbA_1c) test) serve as case studies. The information obtained from this study can be used to guide POC test development and their introduction in clinical practice.

METHODS

Relevant criteria were identified based on a literature review and semi-structured interviews with twelve experts in the field. Subsequently, the criteria were clustered in four groups (i.e. user, organization, clinical value, and socio-political context) and the relative importance of each criterion was determined by calculating geometric means as implemented in the Analytic Hierarchy Process. Of these twelve experts, ten participated in a facilitated group session, in which their priorities regarding both POC tests (compared to central laboratory testing) were elicited.

RESULTS

Of 20 criteria in four clusters, the test's clinical utility, its technical performance, and risks (associated with the treatment decision based on the test result) were considered most important for using a POC test, with relative weights of 22.2, 12.6 and 8.5%, respectively. Overall, the experts preferred the POC CRP test over its laboratory equivalent, whereas they did not prefer the POC HbA_1c test. This difference was mainly explained by their strong preference for the POC CRP test with regard to the subcriterion 'clinical utility'.

CONCLUSIONS

The list of identified criteria, and the insights in their relative impact on successful implementation of POC tests, may facilitate implementation and use of existing POC tests in clinical practice. In addition, having experts score new POC tests on these criteria, provides developers with specific recommendations on how to increase the probability of successful implementation and use.

Cost-effectiveness of procalcitonin testing to guide antibiotic treatment duration in critically ill patients: results from a randomised controlled multicentre trial in the Netherlands

BACKGROUND

Procalcitonin (PCT) testing can help in safely reducing antibiotic treatment duration in intensive care patients with sepsis. However, the cost-effectiveness of such PCT guidance is not yet known.

METHODS

A trial-based analysis was performed to estimate the cost-effectiveness of PCT guidance compared with standard of care (without PCT guidance). Patient-level data were used from the SAPS trial in which 1546 patients were randomised. This trial was performed in the Netherlands, which is a country with, on average, low antibiotic use and a short duration of hospital stay. As quality of life among sepsis survivors was not measured during the SAPS, this was derived from a Dutch follow-up study. Outcome measures were (1) incremental direct hospital cost and (2) incremental cost per quality-adjusted life year (QALY) gained from a healthcare perspective over a one-year time horizon. Uncertainty in outcomes was assessed with bootstrapping.

RESULTS

Mean in-hospital costs were €46,081/patient in the PCT group compared with €46,146/patient with standard of care (i.e. - €65 (95% CI - €6314 to €6107); - 0.1%). The duration of the first course of antibiotic treatment was lower in the PCT group with 6.9 vs. 8.2 days (i.e. - 1.2 days (95% CI - 1.9 to - 0.4), - 14.8%). This was accompanied by lower in-hospital mortality of 21.8% vs. 29.8% (absolute decrease 7.9% (95% CI - 13.9% to - 1.8%), relative decrease 26.6%), resulting in an increase in mean QALYs/patient from 0.47 to 0.52 (i.e. + 0.05 (95% CI 0.00 to 0.10); + 10.1%). However, owing to high costs among sepsis survivors, healthcare costs over a one-year time horizon were €73,665/patient in the PCT group compared with €70,961/patient with standard of care (i.e. + €2704 (95% CI - €4495 to €10,005), + 3.8%), resulting in an incremental cost-effectiveness ratio of €57,402/QALY gained. Within this time frame, the probability of PCT guidance being cost-effective was 64% at a willingness-to-pay threshold of €80,000/QALY.

CONCLUSIONS

Although the impact of PCT guidance on total healthcare-related costs during the initial hospitalisation episode is likely negligible, the lower in-hospital mortality may lead to a non-significant increase in costs over a one-year time horizon. However, since uncertainty remains, it is recommended to investigate the long-term cost-effectiveness of PCT guidance, from a societal perspective, in different countries and settings.

The cost-utility of point-of-care troponin testing to diagnose acute coronary syndrome in primary care

Background

The added value of using a point-of-care (POC) troponin test in primary care to rule out acute coronary syndrome (ACS) is debated because test sensitivity is inadequate early after symptom onset. This study investigates the potential cost-utility of diagnosing ACS by a general practitioner (GP) when a POC troponin test is available versus GP assessment only.

Methods

A patient-level simulation model was developed, representing a hypothetical cohort of the Dutch population (>35 years) consulting the GP with chest complaints. All health related consequences as well as cost consequences were included. Both symptom duration, selection of patients in whom the POC troponin test is performed, and test performance at different time points were incorporated. Health outcomes were expressed as Quality-Adjusted Life Years (QALYs). The main outcome parameters involve the effect of POC troponin testing on (in)correct hospital referrals, QALYs, and costs.

Results

The POC troponin strategy decreases the referral rate in non-ACS patients from 38.46% to 31.85%. Despite a small increase in non-referral among ACS patients from 0.22% to 0.27%, the overall health effect is negligible. Costs will decrease with €77.25/patient (95% CI €-126.81 to €-33.37).

Conclusions

The POC troponin strategy is likely cost-saving, by reducing hospital referrals. The small increase in missed ACS patients can be partly explained by conservative assumptions used in the analysis. Besides, current developments in POC troponin tests will likely further improve their diagnostic performance. Therefore, future prospective studies are warranted to investigate whether those developments make the POC troponin test to a safe and cost-effective diagnostic tool for diagnosing ACS in general practices.

Electronic supplementary material

The online version of this article (doi:10.1186/s12872-017-0647-6) contains supplementary material, which is available to authorized users.

Health Economic Evaluation of a Strict Glucose Control Guideline Implemented Using Point-of-Care Testing in Three Intensive Care Units in The Netherlands

BACKGROUND

Point-of-care testing of blood glucose (BG-POCT) is essential for safe and effective insulin titrations in critically ill patients under glucose control with insulin. The costs associated with this practice are considered substantial, especially when more frequent blood glucose (BG) testing is needed, as with more strict glucose control (SGC) aiming for lower BG levels.

OBJECTIVE

The objective of this study was to estimate, from a hospital perspective, the incremental cost effectiveness of an SGC guideline, aiming for BG levels of 4.4-6.1 mmol/L, compared to the situation before implementation of that guideline (aiming for BG levels <8.3 mmol/L), both using BG-POCT.

METHODS

This is a secondary analysis of a guideline implementation project aiming for implementation of a guideline of SGC in three intensive care units in The Netherlands. A Markov model including the four health states 'target glucose', 'hyperglycaemia' (defined as BG levels >6.1 mmol/L), 'hypoglycaemia' (defined as BG levels <4.4 mmol/L) and 'in-hospital death' was developed to compare expected costs, number of patients within target and number of life-years saved before and after implementation of the SGC guideline. The effectiveness estimates are based on empirical data from 3195 patients 12 and 24 months before and after implementation of the guideline, respectively. All costs have been converted to price year 2013, and are estimated based on hospital data, the literature and available price lists.

RESULTS

The number of BG-POCT increased from 4.8 [interquartile range (IQR) 2.6-6.7] to 8.0 [IQR 4.1-11.2] per patient per day, accruing 58% higher costs for BG-POCT (€13.56 vs. €8.57 per patient) in the SGC protocol versus the situation before implementation. When taking total hospital costs and clinical effects into account, implementation of the SGC guideline increased total hospital costs per patient by 1.8%, i.e., €355 (from €20,617 to €20,972) during the inpatient stay, while the number of patients in target glucose levels increased by 1.4% (i.e., from 881 to 895 per 1000 patients). This translates to an incremental cost-effectiveness ratio of €25 per additional patient within the target glucose level. The model outcomes are most sensitive to changes in ICU length of stay.

CONCLUSION

The increase in the number of patients and time within target glucose levels is achieved with a small increase in total direct hospital costs.

A PCT algorithm for discontinuation of antibiotic therapy is a cost-effective way to reduce antibiotic exposure in adult intensive care patients with sepsis

OBJECTIVE

Procalcitonin (PCT) is a specific marker for differentiating bacterial from non-infective causes of inflammation. It can be used to guide initiation and duration of antibiotic therapy in intensive care unit (ICU) patients with suspected sepsis, and might reduce the duration of hospital stay. Limiting antibiotic treatment duration is highly important because antibiotic over-use may cause patient harm, prolonged hospital stay, and resistance development. Several systematic reviews show that a PCT algorithm for antibiotic discontinuation is safe, but upfront investment required for PCT remains an important barrier against implementation. The current study investigates to what extent this PCT algorithm is a cost-effective use of scarce healthcare resources in ICU patients with sepsis compared to current practice.

METHODS

A decision tree was developed to estimate the health economic consequences of the PCT algorithm for antibiotic discontinuation from a Dutch hospital perspective. Input data were obtained from a systematic literature review. When necessary, additional information was gathered from open interviews with clinical chemists and intensivists. The primary effectiveness measure is defined as the number of antibiotic days, and cost-effectiveness is expressed as incremental costs per antibiotic day avoided.

RESULTS

The PCT algorithm for antibiotic discontinuation is expected to reduce hospital spending by circa € 3503 per patient, indicating savings of 9.2%. Savings are mainly due to reductions in length of hospital stay, number of blood cultures performed, and, importantly, days on antibiotic therapy. Probabilistic and one-way sensitivity analyses showed the model outcome to be robust against changes in model inputs.

CONCLUSION

Proven safe, a PCT algorithm for antibiotic discontinuation is a cost-effective means of reducing antibiotic exposure in adult ICU patients with sepsis, compared to current practice. Additional resources required for PCT are more than offset by downstream cost savings. This finding is highly important given the aim of preventing widespread antibiotic resistance.