A comparison of cost effectiveness using data from randomized trials or actual clinical practice: selective cox-2 inhibitors as an example

Validating use of diagnostic codes in Canadian administrative data for identification of adverse drug events

AIMS

While diagnostic codes from administrative health data might be a valuable source to identify adverse drug events (ADEs), their ability to identify unintended harms remains unclear. We validated claims-based diagnosis codes for ADEs based on events identified in a prospective cohort study and assessed whether key attributes predicted their documentation in administrative data.

METHODS

This was a retrospective analysis of 3 prospective cohorts in British Columbia, from 2008 to 2015 (n = 13 969). We linked prospectively identified ADEs to administrative insurance data to examine the sensitivity and specificity of different diagnostic code schemes. We used logistic regression to assess which key attributes (e.g., type of event, symptoms and culprit medications) were associated with better documentation of ADEs in administrative data.

RESULTS

Among 1178 diagnosed events, the sensitivity of the diagnostic codes in administrative data ranged from 3.4 to 52.6%, depending on the database and codes used. We found that documentation was worse for certain types of ADEs (dose-related: odds ratio [OR]: 0.32, 95% confidence interval [CI]: 0.15, 0.69; nonadherence events (OR: 0.35, 95% CI: 0.20, 0.62), and better for those experiencing arrhythmias (OR: 4.19, 95% CI: 0.96, 18.28).

CONCLUSION

ADEs were not well documented in administrative data. Alternative methods should be explored to capture ADEs for health research.

Dehydrated Amnion Chorion Membrane versus standard of care for diabetic foot ulcers: a randomised controlled trial

OBJECTIVE

Diabetic foot ulcers (DFUs) continue to challenge wound care practitioners. This prospective, multicentre, randomised controlled trial (RCT) evaluated the effectiveness of a dehydrated Amnion Chorion Membrane (dACM) (Organogenesis Inc., US) versus standard of care (SoC) alone in complex DFUs in a challenging patient population.

METHOD

Subjects with a DFU extending into dermis, subcutaneous tissue, tendon, capsule, bone or joint were enrolled in a 12-week trial. They were allocated equally to two treatment groups: dACM (plus SoC); or SoC alone. The primary endpoint was frequency of wound closure determined by a Cox analysis that adjusted for duration and wound area. Kaplan-Meier analysis was used to determine median time to complete wound closure (CWC).

RESULTS

The cohort comprised 218 patients, and these were split equally between the two treatment groups with 109 patients in each. A Cox analysis showed that the estimated frequency of wound closure for the dACM plus SoC group was statistically superior to the SoC alone group at week 4 (12% versus 8%), week 6 (22% versus 11%), week 8 (31% versus 21%), week 10 (42% versus 27%) and week 12 (50% versus 35%), respectively (p=0.04). The computed hazard ratio (1.48 (confidence interval: 0.95, 2.29) showed a 48% greater probability of wound closure in favour of the dACM group. Median time to wound closure for dACM-treated ulcers was 84 days compared to 'not achieved' in the SoC-treated group (i.e., ≥50% of SoC-treated DFUs failed to heal by week 12; p=0.04).

CONCLUSION

In an adequately powered DFU RCT, dACM increased the frequency, decreased the median time, and improved the probability of CWC when compared with SoC alone. dACM demonstrated beneficial effects in DFUs in a complex patient population.

DECLARATION OF INTEREST

This study was funded by Organogenesis Inc., US. JC serves as a consultant and speaker for Organogenesis. RDD serves as a speaker for Organogenesis. OMA and MLS serve as consultants for Organogenesis. The authors have no other conflicts of interest to declare.

Applying Trial-Derived Treatment Effects to Real-World Populations: Generalizing Cost-Effectiveness Estimates When Modeling Complex Hazards

OBJECTIVES

Generalizability of trial-based cost-effectiveness estimates to real-world target populations is important for decision making. In the context of independent aggregate time-to-event baseline and relative effects data, complex hazards can make modeling of data for use in economic evaluation challenging. Our article provides an overview of methods that can be used to apply trial-derived relative treatment effects to external real-world baselines when faced with complex hazards and follows with a motivating example.

METHODS

Approaches for applying trial-derived relative effects to real-world baselines are presented in the context of complex hazards. Appropriate methods are applied in a cost-effectiveness analysis using data from a previously published study assessing the real-world cost-effectiveness of a treatment for carcinoma of the head and neck as a motivating example.

RESULTS

Lack of common hazards between the trial and target real-world population, a complex baseline hazard function, and nonproportional relative effects made the use of flexible models necessary to adequately estimate survival. Assuming common distributions between trial and real-world reference survival substantially affected survival and cost-effectiveness estimates. Modeling time-dependent vs proportional relative effects affected estimates to a lesser extent, dependent on assumptions used in cost-effectiveness modeling.

CONCLUSIONS

Appropriately capturing reference treatment survival when attempting to generalize trial-derived relative treatment effects to real-world target populations can have important impacts on cost-effectiveness estimates. A balance between model complexity and adequacy for decision making should be considered where multiple data sources with complex hazards are being evaluated.

Treatment With Tofacitinib in Refractory Psoriatic Arthritis: A National Multicenter Study of the First 87 Patients in Clinical Practice

OBJECTIVE

Tofacitinib (TOF) is the first Janus kinase ( JAK) inhibitor approved for psoriatic arthritis (PsA). It has shown efficacy in patients refractory to anti-tumor necrosis factor-α in randomized controlled trials (RCTs). Our aim was to assess efficacy and safety of TOF in clinical practice.

METHODS

This was an observational, open-label multicenter study of PsA patients treated with TOF due to inefficacy or adverse events of previous therapies. Outcome variables were efficacy, corticosteroid dose-sparing effect, retention rate, and safety. A comparative study of clinical features between our cohort of patients and those from the OPAL Beyond trial was performed.

RESULTS

There were 87 patients (28 women/59 men), with a mean age of 52.8 ± 11.4 years. All patients were refractory to biologic disease-modifying antirheumatic drugs (DMARDs) and/or to conventional synthetic DMARDs plus apremilast. TOF was started at 5 mg twice daily after a mean follow-up of 12.3 ± 9.3 years from PsA diagnosis. At first month, Disease Activity Score in 28 joints based on erythrocyte sedimentation rate (DAS28-ESR) decreased from median 4.8 (IQR 4.1-5.4) to 3.7 (IQR 2.8-4.7, P < 0.01), Disease Activity Index for Psoriatic Arthritis from median 28 (IQR 18.4-34.1) to 15.5 (IQR 10.1-25.7, P < 0.01), and C-reactive protein from median 1.9 (IQR 0.3-5.0) to 0.5 (IQR 0.1-2.2) mg/dL (P < 0.01). Also, TOF led to a significant reduction in prednisone dose. Mild adverse effects were reported in 21 patients (24.13%), mainly gastrointestinal symptoms. TOF retention rate at Month 6 was 77% (95% CI 65.2-86.3). Patients in clinical practice were older with longer disease duration and received biologic agents more commonly than those in the OPAL Beyond trial.

CONCLUSION

Data from clinical practice confirm that TOF seems to be effective, rapid, and relatively safe in refractory PsA despite clinical differences with patients in RCTs.

Inhaled therapies for chronic obstructive pulmonary disease: a systematic review and meta-analysis

OBJECTIVES

To integrate evidence from randomised controlled trials (RCTs) and observational studies on the efficacy of inhaled treatments for chronic obstructive pulmonary disease using network meta-analyses.

METHODS

Systematic searches MEDLINE and Embase based on predetermined criteria. Network meta-analyses of RCTs investigated efficacy on exacerbations (long-term: ≥20 weeks of treatment; short-term: <20 weeks), lung function (≥12 weeks), health-related quality of life, mortality and adverse events. Qualitative comparisons of efficacies between RCTs and observational studies.

RESULTS

212 RCTs and 19 observational studies were included. Compared with combined long-acting beta-adrenoceptor agonists and long-acting muscarinic antagonists (LABA+LAMA), triple therapy (LABA+LAMA+inhaled corticosteroid) was significantly more effective at reducing exacerbations (long-term 0.85 (95% CI: 0.78 to 0.94; short-term 0.67 (95% CI: 0.49 to 0.92)) and mortality (0.72 (95% CI: 0.59 to 0.89)) but was also associated with increased pneumonia (1.35 (95% CI: 1.10 to 1.67)). No differences in lung function (0.02 (95% CI: -0.10 to 0.14)), health-related quality of life (-1.12 (95% CI: -3.83 to 1.59)) or other adverse events (1.02 (95% CI: 0.96 to 1.08)) were found. Most of the observational evidence trended in the same direction as pooled RCT data.

CONCLUSION

Further evidence, especially pragmatic trials, are needed to fully understand the characteristics of patient subgroups who may benefit from triple therapy and for those whom the extra risk of adverse events, such as pneumonia, may outweigh any benefits.

PROSPERO REGISTRATION NUMBER

CRD42018088013.

A randomized controlled clinical trial of a hypothermically stored amniotic membrane for use in diabetic foot ulcers

Aim: Determine the effectiveness of hypothermically stored amniotic membrane (HSAM) versus standard of care (SOC) in diabetic foot ulcers (DFUs). Methods: A randomized controlled trial was conducted on 76 DFUs analyzed digitally. Results: Cox wound closure for HSAM (38 wounds) was significantly greater (p = 0.04) at weeks 12 (60 vs 38%), and 16 (63 vs 38%). The probability of wound closure increased by 75% (Hazard Ratio = 1.75; 95% CI: 1.16–2.70). HSAM showed >60% reductions in area (82 vs 58%; p = 0.02) and depth (65 vs 39%; p = 0.04) versus SOC. Conclusion: HSAM increased frequency and probability of wound closure in DFUs versus SOC.

Protocol for a systematic literature review and network meta-analysis of the clinical benefit of inhaled maintenance therapies in chronic obstructive pulmonary disease

INTRODUCTION

Chronic obstructive pulmonary disease (COPD) exacerbations progress the course of disease and impair lung function. Inhaled maintenance therapy reduces exacerbations. It is not yet established which inhaled therapy combination is best to reduce exacerbations, lung function decline and symptom burden.

METHODS AND ANALYSIS

MEDLINE, EMBASE and the Cochrane Library will be searched for articles between January 2011 and May 2018 using a pre-specified search strategy. Conference proceedings will be searched. Systematic reviews (with or without meta-analysis), randomised controlled trials (RCTs), cohort studies and case controlled studies comparing six interventions comprising different combinations of long-acting bronchodilators and inhaled corticosteroids in unison or on their own. The primary outcome is the reduction in moderate-to-severe exacerbations. Secondary outcomes include: lung function, quality of life, mortality and other adverse events. Titles and abstracts will screened by the primary researcher. A second reviewer will repeat this on a proportion of records. The Population, Intervention, Comparator, Outcomes and Study framework will be used for data extraction. A network meta-analyses of outcomes from RCTs and real-world evidence will be integrated if feasible. The 95% credible interval will be used to assess the statistical significance of each summary effect. Ranking of interventions will be based on their surface under cumulative ranking area.

ETHICS AND DISSEMINATION

COPD exacerbations are burdensome to patients. We aim to report results that provide clinicians with a more informed choice of which inhaled therapy combinations are best to reduce exacerbations, improve disease burden and reduce lung function and exercise capacity decline, compared with the potential harms, in certain populations with COPD.

PROSPERO REGISTRATION NUMBER

CRD42018088013.

Engaging Stakeholders and Patient Partners

Recent advances in engagement of stakeholders and patient partners in clinical research have bridged the disconnect between researchers and stakeholders, resulting in improved research goals with relevant outcomes, increased clinical trial enrollment, and improved communication of research results. This article focuses on the mechanisms, challenges, and benefits of patient and stakeholder engagement, with strategies for improvement. The 3 stages of clinical research and key iterative steps to create a reciprocal relationship are presented. Despite recent advances in stakeholder engagement, additional investigation and improved reporting of methods will facilitate strong reciprocal relationships between researchers and stakeholders.

Comparative effectiveness of a bilayered living cellular construct and an acellular fetal bovine collagen dressing in the treatment of venous leg ulcers

Aim: To compare the effectiveness of bilayered living cellular construct (BLCC) and an acellular fetal bovine collagen dressing (FBCD) for the treatment of venous leg ulcers. Methods: Data from WoundExpert^® (Net Health, PA, USA) was used to analyze 1021 refractory venous leg ulcers treated at 177 facilities. Results: Kaplan-Meier analyses showed that BLCC (893 wounds) was superior to FBCD (128 wounds), p = 0.01 for: wound closure by weeks 12 (31 vs 25%), 24 (55 vs 43%) and 36 (68 vs 53%); reduction in time to wound closure of 37%, (19 vs 30 weeks); and improvement in the probability of healing by 45%. Conclusion: BLC versus FBCD showed significant differences in both time to and frequency of healing suggesting that BLCC may provide significant cost savings compared with FBCD.

An examination of user costs in relation to smokers using a cessation service based in the UK

BACKGROUND

Smoking cessation services provide support to smokers who desire to quit. Published studies to date have looked at the cost and benefit of service provision but typically focus on clinical trial data. Using routinely collected observational data, this study examined the costs involved in providing a service in terms of average health care expenditure per successful quit attempt in addition to population - level cost-effectiveness measures.

METHODS

Data were analysed from Quit-51 smoking cessation service across five English regions between March 2013 and March 2016 (n = 9116). For each user, costs were estimated in relation to: (i) time spent with advisers; (ii) prescription of pharmacotherapy. The total costs compared against self-reported quit at 12 weeks, which represents the time period for which the service is offered. Cost per quit (CPQ), with 95% confidence interval (CI), was calculated by relating total expenditure to the number of quitters, firstly for the whole dataset and then by subgroups of key categorical variables, namely; gender, age group, the Fagerstrom test for nicotine dependence (FTND) and Index of Multiple Deprivation (IMD). Confidence intervals (CIs) for the mean estimates were derived using a non-parametric bootstrap procedure. Parameters derived from the calculation in relation to treatment were used to estimate potential long-term population outcomes under a scenario where the Quit 51 prescription was rolled out nationally.

RESULTS

The overall mean CPQ for this sample as estimated at 12 weeks was £403.51 (95% CI = £393.36 to £413.76). The estimated CPQs at this time point were comparable for those aged 12-19 (£423.56, 95% CI = £369.45 to £492.60) and those aged 20-29 (£430.76, 95% CI = £395.95 to £470.56). Differences were also seen in relation to other subgroups considered. The treatment parameters translated to a projected increase of 1.5 quality-adjusted life years (QALYs) per 1000 smokers in the short-term and 23.4 QALYS per 1000 smokers based on a lifetime horizon.

CONCLUSIONS

These figures throw light on service expenditure for each successful quit over the timeframe for which the service is offered in addition to highlighting variability in these costs across different subgroups of the user population.

Use of generic and essential medicines for prevention and treatment of cardiovascular diseases in Portugal

BACKGROUND

The successful control of cardiovascular diseases at the lowest possible cost requires the use of the most effective and affordable medicines. We aimed to describe the trends in the ambulatory use of medicines for prevention and treatment of cardiovascular diseases [Anatomic Therapeutic Chemical classification system (ATC): C and B01A] in Portugal, between 2004 and 2012, and to estimate the potential for expenditure reduction through changes in patterns of use.

METHODS

We analysed sell-out data, expressed as defined daily doses (DDD) and pharmacy retail price (€), from a nationwide database. We estimated potential reduction in expenditures through the increase, up to 90% of the volume of DDD, in the use of generic and essential medicines; the latter were defined according to guidelines from Portugal and another European country.

RESULTS

Overall consumption increased by approximately 50% from 2004 to 2012, reaching nearly 2400 million DDD, whereas expenditure decreased to 753 million € (-31.3% since 2006). Use of generics and essential medicines increased, representing 43.6 and 39.9% of DDD consumption in 2012, respectively. The 40 most used groups of medicines in 2012 accounted for just over 80% of overall consumption; among these, increase in use of generics and essential medicines would have contributed to a saving of 275 million €.

CONCLUSIONS

Changes in patterns of consumption of medicines towards a more frequent use of generics, a preferential use of essential medicines and a more rational use of fixed-dose combinations may contribute to a more efficient use of health resources.

Calculating Total Health Service Utilisation and Costs from Routinely Collected Electronic Health Records Using the Example of Patients with Irritable Bowel Syndrome Before and After Their First Gastroenterology Appointment

INTRODUCTION

Health economic models are increasingly important in funding decisions but most are based on data, which may therefore not represent the general population. We sought to establish the potential of real-world data available within the Clinical Practice Research Datalink (CPRD) and linked Hospital Episode Statistics (HES) to determine comprehensive healthcare utilisation and costs as input variables for economic modelling.

METHODS

A cohort of patients with irritable bowel syndrome (IBS) who first saw a gastroenterologist in 2008 or 2009, and with 3 years of data before and after their appointment, was created in the CPRD. Primary care, outpatient, inpatient, prescription and colonoscopy data were extracted from the linked CPRD and HES. The appropriate cost to the NHS was attached to each event. Total and stratified annual healthcare utilisation rates and costs were calculated before and after the gastroenterology appointment with distribution parameters. Absolute differences were calculated with 95% confidence intervals.

RESULTS

Total annual healthcare costs over 3 years increase by £935 (95% CI £928-941) following a gastroenterology appointment for IBS. We derived utilisation and cost data with parameter distributions stratified by demographics and time. Women, older patients, smokers and patients with greater comorbidity utilised more healthcare resources, which generated higher costs.

CONCLUSIONS

These linked datasets provide comprehensive primary and secondary care data for large numbers of patients, which allows stratification of outcomes. It is possible to derive input parameters appropriate for economic models and their distributions directly from the population of interest.

Designing and incorporating a real world data approach to international drug development and use: what the UK offers

Assessments of the safety, efficacy and appropriate use of new medicines lie at the heart of treatment development and subsequent adoption in clinical practice. Highly controlled randomised clinical trials routinely inform decisions on the approval, coverage and use of a medicine. Researchers and decision makers have become increasingly aware that these experimental data alone are insufficient to address those decisions fully. Real world data recorded from routine healthcare delivery by healthcare professionals and patients help provide a more complete picture of care. The UK, with its connectivity and rich longitudinal patient records, accumulated research and informatics experience and National Health Service, provides an exemplar of how real world data address a wide range of challenges across drug development.

Economic evaluation of the restriction in the use piroxicam in Spain

OBJECTIVES

A retrospective economic evaluation was performed on the restriction of the use of piroxicam in Spain, a non-steroidal anti-inflammatory drug, with a proven higher risk of serious gastrointestinal complications compared to other non-steroidal anti-inflammatory drugs with the objective of putting the relevance of these activities into context.

METHODS

A retrospective cost-effectiveness analysis and a budget impact analysis were performed. Costs and cases of serious gastrointestinal complications were compared in the non-intervention (use of piroxicam) and the intervention scenarios (use of other non-steroidal anti-inflammatory drugs). The cost of serious gastrointestinal complications was obtained from the Diagnosis Related Groups and the cost of non-steroidal anti-inflammatory drugs from usage data in the Spanish national health system. The risk of serious gastrointestinal complications was obtained from epidemiological studies.

RESULTS

The regulatory intervention was the dominant option. In that sense, 0.81 euros per treated patient were saved, 2.75 cases of serious gastrointestinal complications were avoided per 10,000 patients and 578,608 euros were saved in total in Spain in the first year following the intervention.

CONCLUSIONS

It is possible to perform complete economical evaluations on pharmacovigilance actions. The intervention performed by the Spanish Agency for Medicines and Medical Devices, AEMPS on piroxicam not only achieved the objective of preventing adverse drug reactions but also resulted in significant economical savings even under conservative assumptions.

Sorafenib for Hepatocellular Carcinoma: From Randomized Controlled Trials to Clinical Practice

Hepatocellular carcinoma is a challenging malignancy of global importance. It is the sixth most common solid malignancy and the third leading cause of cancer-related death, worldwide. Curative treatments at early stages include liver transplantation, resection and percutaneous ablation, while transarterial chemoembolization can improve survival in patients with intermediate tumor stage. Patients with mild, related symptoms and/or macrovascular invasion or extrahepatic spread are classified under the advanced stage. The standard of care in this group is sorafenib, an inhibitor of Raf kinase and vascular endothelial growth factor receptor, whose effectiveness has been proven by 2 recent randomized controlled trials (RCTs). The aim of this brief review is to highlight the main concerns and pitfalls and to analyze the recent data of literature regarding the efficacy and the management of sorafenib therapy from RCTs to real practice.

Recent advances in the utility and use of the General Practice Research Database as an example of a UK Primary Care Data resource

Since its inception in the mid-1980s, the General Practice Research Database (GPRD) has undergone many changes but remains the largest validated and most utilised primary care database in the UK. Its use in pharmacoepidemiology stretches back many years with now over 800 original research papers. Administered by the Medicines and Healthcare products Regulatory Agency since 2001, the last 5 years have seen a rebuild of the database processing system enhancing access to the data, and a concomitant push towards broadening the applications of the database. New methodologies including real-world harm-benefit assessment, pharmacogenetic studies and pragmatic randomised controlled trials within the database are being implemented. A substantive and unique linkage program (using a trusted third party) has enabled access to secondary care data and disease-specific registry data as well as socio-economic data and death registration data. The utility of anonymised free text accessed in a safe and appropriate manner is being explored using simple and more complex techniques such as natural language processing.

Improving the transparency of prognosis research: the role of reporting, data sharing, registration, and protocols

George Peat and colleagues review and discuss current approaches to transparency and published debates and concerns about efforts to standardize prognosis research practice, and make five recommendations.

Please see later in the article for the Editors' Summary

Use of electronic healthcare records in large-scale simple randomized trials at the point of care for the documentation of value-based medicine

A solid foundation of evidence of the effects of an intervention is a prerequisite of evidence-based medicine. The best source of such evidence is considered to be randomized trials, which are able to avoid confounding. However, they may not always estimate effectiveness in clinical practice. Databases that collate anonymized electronic health records (EHRs) from different clinical centres have been widely used for many years in observational studies. Randomized point-of-care trials have been initiated recently to recruit and follow patients using the data from EHR databases. In this review, we describe how EHR databases can be used for conducting large-scale simple trials and discuss the advantages and disadvantages of their use.

Comparative effectiveness of a bilayered living cellular construct and a porcine collagen wound dressing in the treatment of venous leg ulcers

Using data from a national wound-specific electronic medical record (WoundExpert, Net Health, Pittsburgh, PA), we compared the effectiveness of a bilayered living cellular construct (BLCC) and an acellular porcine small intestine submucosa collagen dressing (SIS) for the treatment of venous leg ulcer. Data from 1,489 patients with 1,801 refractory venous leg ulcers (as defined by failure to have >40% reduction in size in the 4 weeks prior to treatment) with surface areas between 1 and 150 cm(2) in size, treated between July 2009 and July 2012 at 158 wound care facilities across the US were analyzed. Patient baseline demographics and wound characteristics were comparable between groups. Kaplan-Meier-derived estimates of wound closure for BLCC (1,451 wounds) was significantly greater (p = 0.01, log-rank test) by weeks 12 (31% vs. 26%), 24 (50% vs. 41%), and 36 (61% vs. 46%), respectively, compared with SIS (350 wounds). BLCC treatment reduced the median time to wound closure by 44%, achieving healing 19 weeks sooner (24 vs. 43 weeks, p = 0.01, log-rank test). Treatment with BLCC increased the probability of healing by 29% compared with porcine SIS dressing (hazard ratio = 1.29 [95% confidence interval 1.06, 1.56], p = 0.01).

Sorafenib for the treatment of hepatocellular carcinoma

The multikinase inhibitor sorafenib, which inhibits targets related to tumor cell proliferation and angiogenesis, was the first systemic agent to demonstrate a significant improvement in the overall survival for patients with advanced hepatocellular carcinoma (HCC) in two large randomized controlled Phase III trials. Together with its manageable safety profile (mainly diarrhea, hand-foot skin reaction and fatigue), sorafenib was approved for the treatment of patients with (unresectable) HCC in 2007. Since then, sorafenib has been established as the standard of care in Child-Pugh A patients with advanced HCC or in those ineligible for or after failure of locoregional therapies in the intermediate stage of the disease. This article summarizes current knowledge and future perspectives regarding the use of sorafenib in patients with HCC.

Osteoarthritis and the rule of halves

BACKGROUND

Symptomatic osteoarthritis poses a major challenge to primary health care but no studies have related accessing primary care ('detection'), receiving recommended treatments ('treatment'), and achieving adequate control ('control').

OBJECTIVE

To provide estimates of detection, treatment, and control within a single population adapting the approach used to determine a Rule of Halves for other long-term conditions.

SETTING

General population.

PARTICIPANTS

400 adults aged 50+ years with prevalent symptomatic knee osteoarthritis.

DESIGN

Prospective cohort with baseline questionnaire, clinical assessment, and plain radiographs, and questionnaire follow-up at 18 and 36 months and linkage to primary care medical records.

OUTCOME MEASURES

'Detection' was defined as at least one musculoskeletal knee-related GP consultation between baseline and 36 months. 'Treatment' was self-reported use of at least one recommended treatment or physiotherapy/hospital specialist referral for their knee problem at all three measurement points. Pain was 'controlled' if characteristic pain intensity <5 out of 10 on at least two occasions.

RESULTS

In 221 cases (55.3%; 95%CI: 50.4, 60.1) there was evidence that the current problem had been detected in general practice. Of those detected, 164 (74.2% (68.4, 80.0)) were receiving one or more of the recommended treatments at all three measurement points. Of those detected and treated, 45 (27.4% (20.5, 34.3)) had symptoms under control on at least two occasions. Using narrower definitions resulted in substantially lower estimates.

CONCLUSION

Osteoarthritis care does not conform to a Rule of Halves. Symptom control is low among those accessing health care and receiving treatment.

Randomized Controlled Trials and real life studies. Approaches and methodologies: a clinical point of view

Randomized Controlled Trials (RCTs) are the "gold standard" for evaluating treatment outcomes providing information on treatments "efficacy". They are designed to test a therapeutic hypothesis under optimal setting in the absence of confounding factors. For this reason they have high internal validity. The strict and controlled conditions in which they are conducted, leads to low generalizability because they are performed in conditions very different from real life usual care. Conversely, real life studies inform on the "effectiveness" of a treatment, that is, the measure of the extent to which an intervention does what is intended to do in routine circumstances. At variance to RCTs, real life trials have high generalizability, but low internal validity. Recently the number of real life studies has been rapidly growing in different areas of respiratory medicine, particularly in asthma and COPD. The role of such studies is becoming a hot topic in respiratory medicine, attracting research interest and debate. In the first part of this review we discuss some of the advantages and disadvantages of different types of RCTs and analyze the strengths and weaknesses of real life trials, considering the recent examples of some studies conducted in COPD. We then discuss methodological approaches and options to overcome some of the limitations of real life studies. Comparing the conclusions of effectiveness and efficacy trials can provide important pieces of information. Indeed, these approaches can result complementary, and they can guide the interpretation of each other results.

Evaluating adverse drug event reporting in administrative data from emergency departments: a validation study

BACKGROUND

Adverse drug events are a frequent cause of emergency department presentations. Administrative data could be used to identify patients presenting with adverse drug events for post-market surveillance, and to conduct research in patient safety and in drug safety and effectiveness. However, such data sources have not been evaluated for their completeness with regard to adverse drug event reporting. Our objective was to determine the proportion of adverse drug events to outpatient medications diagnosed at the point-of-care in emergency departments that were documented in administrative data.

METHODS

We linked the records of patients enrolled in a prospective observational cohort study on adverse drug events conducted in two Canadian tertiary care emergency departments to their administrative data. We compared the number of adverse drug events diagnosed and recorded at the point-of-care in the prospective study with the number of adverse drug events recorded in the administrative data.

RESULTS

Among 1574 emergency department visits, 221 were identified as adverse drug event-related in the prospective database. We found 15 adverse drug events documented in administrative records with ICD-10 codes clearly indicating an adverse drug event, indicating a sensitivity of 6.8% (95% CI 4.0-11.2%) of this code set. When the ICD-10 code categories were broadened to include codes indicating a very likely, likely or possible adverse event to a medication, 62 of 221 events were identifiable in administrative data, corresponding to a sensitivity of 28.1% (95% CI 22.3-34.6%).

CONCLUSIONS

Adverse drug events to outpatient medications were underreported in emergency department administrative data compared to the number of adverse drug events diagnosed and recorded at the point-of-care.

The Workforce wellness index: a method for valuing US workers' health

OBJECTIVE

To devise a methodology to create a single health risk-cost score that can be applied to health risk assessment survey data and account for the medical costs associated with modifiable risks.

METHODS

We linked person-level health risk assessment data with medical benefit eligibility and claims data for 341,650 workers for the period 2005 to 2010 and performed multivariate analyses to estimate costs associated with high risks. We used the estimated costs and risk prevalence rates to create a composite Workforce Wellness Index (WWI) score.

RESULTS

Increasing obesity rates among employees was found to be the most important contributor to increased health care spending and the main reason the WWI score worsened over time.

CONCLUSIONS

Employers that address employees' health risk factors may be able to reduce their medical spending and achieve an improvement in their WWI scores.

Patient and service user engagement in research: a systematic review and synthesized framework

BACKGROUND

There is growing attention towards increasing patient and service user engagement (PSUE) in biomedical and health services research. Existing variations in language and design inhibit reporting and indexing, which are crucial to comparative effectiveness in determining best practices.

OBJECTIVE

This paper utilizes a systematic review and environmental scan to derive an evidence-based framework for PSUE.

DESIGN

A metanarrative systematic review and environmental scan/manual search using scientific databases and other search engines, along with feedback from a patient advisory group (PAG).

ELIGIBLE SOURCES

English-language studies, commentaries, grey literature and other sources (including systematic and non-systematic reviews) pertaining to patient and public involvement in biomedical and health services research.

DATA EXTRACTED

Study description (e.g. participant demographics, research setting) and design, if applicable; frameworks, conceptualizations or planning schemes for PSUE-related endeavours; and methods for PSUE initiation and gathering patients'/service users' input or contributions.

RESULTS

Overall, 202 sources were included and met eligibility criteria; 41 of these presented some framework or conceptualization of PSUE. Sources were synthesized into a two-part framework for PSUE: (i) integral PSUE components include patient and service user initiation, reciprocal relationships, colearning and re-assessment and feedback, (ii) sources describe PSUE at several research stages, within three larger phases: preparatory, execution and translational.

DISCUSSION AND CONCLUSIONS

Efforts at developing a solid evidence base on PSUE are limited by the non-standard and non-empirical nature of much of the literature. Our proposed two-part framework provides a standard structure and language for reporting and indexing to support comparative effectiveness and optimize PSUE.

Resource utilization and outcomes in patients with atrial fibrillation: a case control study

BACKGROUND

Atrial fibrillation (AF) is the most common sustained disorder of cardiac rhythm. Various new anticoagulation and antiarrythmic treatments are being investigated for the treatment of AF. Before novel treatments can be used widely in actual clinical practice, the cost effectiveness of such novel treatments may need to be determined.

OBJECTIVE

The objectives of the study were to describe resource utilization for AF and control patients, and estimate the incidence of mortality.

METHODS

This case control study evaluated 6 months of primary and secondary care resource utilization and mortality rates for patients within the period 01 April 2001 to 31 March 2006. Cases included 15 373 adults with a record of AF in the General Practice Research Database (GPRD) within the study period. The index date was randomly selected between 6 months after the AF record and end of data collection. Cases were matched to controls by age, gender, general practice and time.

RESULTS

AF patients had significantly higher resource utilization than controls. Resource utilization increased with greater National Institute for Clinical Excellence (NICE) stroke risk strata (graded as low, moderate or high based on associated risk factors). Both current warfarin and aspirin users had higher resource utilization than control patients. Resource utilization remained high amongst AF patients who discontinued therapy. The mortality rate was significantly higher in AF patients than controls, deaths due to circulatory system disease were increased 4-fold and cancer deaths were doubled. All-cause and circulatory mortality rates, as well as rates of clinical outcomes, were related to the NICE stroke risk schema.

CONCLUSIONS

There was large heterogeneity in resource utilization between AF patients, although overall, this was still higher than controls without AF. Higher resource utilization was evident in patients at higher risk of stroke, and remained where antithrombotic therapy was discontinued. The mortality risk in AF was increased substantially, both for cardiovascular and non-cardiovascular causes of death, indicating a large unmet medical need.

A turbulent decade for NSAIDs: update on current concepts of classification, epidemiology, comparative efficacy, and toxicity

Non-steroidal anti-inflammatory drugs (NSAIDs) represent a diverse class of drugs and are among the most commonly used analgesics for arthritic pain worldwide, though long-term use is associated with a spectrum of adverse effects. The introduction of cyclooxygenase-2-selective NSAIDs early in the last decade offered an alternative to traditional NSAIDs with similar efficacy and improved gastrointestinal tolerability; however, emerging concerns about cardiovascular safety resulted in the withdrawal of two agents (rofecoxib and valdecoxib) in the mid-2000s and, subsequently, in an overall reduction in NSAID use. It is now understood that all NSAIDs are associated with some varying degree of gastrointestinal and cardiovascular risk. Guidelines still recommend their use, but little is known of how patients use these agents. While strategies and guidelines aimed at reducing NSAID-associated complications exist, there is a need for evidence-based algorithms combining cardiovascular and gastrointestinal factors that can be used to aid treatment decisions at an individual patient level.

Risk of death and cardiovascular outcomes with thiazolidinediones: a study with the general practice research database and secondary care data

Objective

To describe the likely extent of confounding in evaluating the risks of cardiovascular (CV) events and mortality in patients using diabetes medication.

Methods

The General Practice Research Database was used to identify inception cohorts of insulin and different oral antidiabetics. An analysis of bias and incidence of mortality, acute coronary syndrome, stroke and heart failure were analysed in GPRD, Hospital Episode Statistics and death certificates.

Results

206,940 patients were identified. The bias analysis showed that past thiazolidinedione users had a lower mortality risk compared to past metformin users. There were no differences between past users of rosiglitazone and pioglitazone (adjusted RR of 1.04; 95% CI 0.93–1.18). Current rosiglitazone users had an increased risk of death (adjusted RR 1.20; 95% CI 1.08–1.34) and of hospitalisation for heart failure (adjusted RR of 1.73; 95% CI 1.19–2.51) compared to current pioglitazone users. Risk of mortality was increased two-fold shortly after starting rosiglitazone. Excess risk of death over 3 years with rosiglitazone was 0.3 per 100 in those aged 50–64 years, 2.0 aged 65–74, 3.0 aged 75–84, and 7.0 aged 85+. The cause of death with rosiglitazone was more likely to be due to a disease of the circulatory system.

Conclusions

Higher risks for death (overall and due to cardiovascular disease) and heart failure were found for rosiglitazone compared to pioglitazone. These excess risks were largest in patients aged 65 years or older. The European regulatory decision to suspend rosiglitazone is supported by this study.

Reassessing the evidence hierarchy in asthma: evaluating comparative effectiveness

Classical randomized controlled trials are the gold standard in medical evidence because of their high internal validity. However, their necessarily strict design can limit their external validity and the ability to extrapolate these data to real world patients. Therefore, alternatively designed studies may play a complementary role in evaluating the comparative effectiveness of therapies in nonidealized patients in more naturalistic, real world settings. Observational studies have high external validity and can evaluate real world outcomes. Their strength lies in hypothesis generation and testing and in identifying areas in which further clinical trials may be required. Pragmatic trials are designed to maximize applicability of trial results to usual care settings by relying on clinically important outcomes and enrolling a wide range of participants. A combination of these approaches is preferable and necessary.

Bridging the efficacy-effectiveness gap: a regulator's perspective on addressing variability of drug response

Drug regulatory agencies should ensure that the benefits of drugs outweigh their risks, but licensed medicines sometimes do not perform as expected in everyday clinical practice. Failure may relate to lower than anticipated efficacy or a higher than anticipated incidence or severity of adverse effects. Here we show that the problem of benefit-risk is to a considerable degree a problem of variability in drug response. We describe biological and behavioural sources of variability and how these contribute to the long-known efficacy-effectiveness gap. In this context, efficacy describes how a drug performs under conditions of clinical trials, whereas effectiveness describes how it performs under conditions of everyday clinical practice. We argue that a broad range of pre- and post-licensing technologies will need to be harnessed to bridge the efficacy-effectiveness gap. Successful approaches will not be limited to the current notion of pharmacogenomics-based personalized medicines, but will also entail the wider use of electronic health-care tools to improve drug prescribing and patient adherence.

Academic impact of a public electronic health database: bibliometric analysis of studies using the general practice research database

BACKGROUND

Studies that use electronic health databases as research material are getting popular but the influence of a single electronic health database had not been well investigated yet. The United Kingdom's General Practice Research Database (GPRD) is one of the few electronic health databases publicly available to academic researchers. This study analyzed studies that used GPRD to demonstrate the scientific production and academic impact by a single public health database.

METHODOLOGY AND FINDINGS

A total of 749 studies published between 1995 and 2009 with 'General Practice Research Database' as their topics, defined as GPRD studies, were extracted from Web of Science. By the end of 2009, the GPRD had attracted 1251 authors from 22 countries and been used extensively in 749 studies published in 193 journals across 58 study fields. Each GPRD study was cited 2.7 times by successive studies. Moreover, the total number of GPRD studies increased rapidly, and it is expected to reach 1500 by 2015, twice the number accumulated till the end of 2009. Since 17 of the most prolific authors (1.4% of all authors) contributed nearly half (47.9%) of GPRD studies, success in conducting GPRD studies may accumulate. The GPRD was used mainly in, but not limited to, the three study fields of "Pharmacology and Pharmacy", "General and Internal Medicine", and "Public, Environmental and Occupational Health". The UK and United States were the two most active regions of GPRD studies. One-third of GRPD studies were internationally co-authored.

CONCLUSIONS

A public electronic health database such as the GPRD will promote scientific production in many ways. Data owners of electronic health databases at a national level should consider how to reduce access barriers and to make data more available for research.

Assuring the safety and effectiveness of new drugs: rigorous phase IV trials randomizing general practices to delayed access to new drugs

Randomized trials are crucial for establishing the effectiveness of new drugs and procedures. However, they are less effective at detecting uncommon but clinically significant side effects. We propose a solution. All UK general practices could be randomized to be allowed to prescribe new licenced drugs earlier or later. This would produce a large pragmatic cluster trial which could enable rare, but harmful, effects to be demonstrated more quickly than the current usual practice of looking for harmful events in observational datasets. Given current computerization of practice records such an approach is feasible and likely to be cost-effective.

A quantitative evaluation of the regulatory assessment of the benefits and risks of rofecoxib relative to naproxen: an application of the incremental net-benefit framework

PURPOSE

To undertake a quantitative benefit-risk analysis of rofecoxib relative to naproxen using an incremental net-benefit (INB) analysis from the societal perspective, using the same data evaluated by the Health Canada and US FDA expert advisory panels.

METHODS

We developed a discrete event simulation model to calculate the INB of rofecoxib relative to naproxen in arthritis patients over a 1-year time horizon. All outcomes were weighted using societal utilities for each health state which facilitated the use of quality-adjusted life years (QALYs) as the outcome. Probability distributions were incorporated for each model parameter to facilitate a probabilistic analysis using second-order Monte Carlo simulation.

RESULTS

In the base case analysis, the mean INB (SD) of rofecoxib relative to naproxen was 0.0002 (0.415) QALYs per patient over 12 months of treatment, or 0.2 QALYs per 1000 patients treated. The probabilistic sensitivity analysis resulted in a mean INB of 0.0022 QALYs (95%CI -0.0005, 0.0051). Overall, the INB associated with rofecoxib relative to naproxen was ≥0 in 94% of the iterations of the model.

CONCLUSIONS

This analysis illustrates the application of the incremental net-benefit framework to quantitative benefit-risk evaluation, and suggests that the potential benefits of rofecoxib outweigh the potential harms relative to naproxen over 1 year from the societal perspective under the assumptions of this model.

Cardiovascular safety of non-steroidal anti-inflammatory drugs: network meta-analysis

OBJECTIVE

To analyse the available evidence on cardiovascular safety of non-steroidal anti-inflammatory drugs.

DESIGN

Network meta-analysis.

DATA SOURCES

Bibliographic databases, conference proceedings, study registers, the Food and Drug Administration website, reference lists of relevant articles, and reports citing relevant articles through the Science Citation Index (last update July 2009). Manufacturers of celecoxib and lumiracoxib provided additional data.

STUDY SELECTION

All large scale randomised controlled trials comparing any non-steroidal anti-inflammatory drug with other non-steroidal anti-inflammatory drugs or placebo. Two investigators independently assessed eligibility.

DATA EXTRACTION

The primary outcome was myocardial infarction. Secondary outcomes included stroke, death from cardiovascular disease, and death from any cause. Two investigators independently extracted data.

DATA SYNTHESIS

31 trials in 116 429 patients with more than 115 000 patient years of follow-up were included. Patients were allocated to naproxen, ibuprofen, diclofenac, celecoxib, etoricoxib, rofecoxib, lumiracoxib, or placebo. Compared with placebo, rofecoxib was associated with the highest risk of myocardial infarction (rate ratio 2.12, 95% credibility interval 1.26 to 3.56), followed by lumiracoxib (2.00, 0.71 to 6.21). Ibuprofen was associated with the highest risk of stroke (3.36, 1.00 to 11.6), followed by diclofenac (2.86, 1.09 to 8.36). Etoricoxib (4.07, 1.23 to 15.7) and diclofenac (3.98, 1.48 to 12.7) were associated with the highest risk of cardiovascular death.

CONCLUSIONS

Although uncertainty remains, little evidence exists to suggest that any of the investigated drugs are safe in cardiovascular terms. Naproxen seemed least harmful. Cardiovascular risk needs to be taken into account when prescribing any non-steroidal anti-inflammatory drug.