A strategy for collecting pharmacoeconomic data during phase II/III clinical trials

An approach to quantify parameter uncertainty in early assessment of novel health technologies

Health economic modeling of novel technology at the early stages of a product lifecycle has been used to identify technologies that are likely to be cost-effective. Such early assessments are challenging due to the potentially limited amount of data. Modelers typically conduct uncertainty analyses to evaluate their effect on decision-relevant outcomes. Current approaches, however, are limited in their scope of application and imposes an unverifiable assumption, that is, uncertainty can be precisely represented by a probability distribution. In the absence of reliable data, an approach that uses the fewest number of assumptions is desirable. This study introduces a generalized approach for quantifying parameter uncertainty, that is, probability bound analysis (PBA), that does not require a precise specification of a probability distribution in the context of early-stage health economic modeling. We introduce the concept of a probability box (p-box) as a measure of uncertainty without necessitating a precise probability distribution. We provide formulas for a p-box given data on summary statistics of a parameter. We describe an approach to propagate p-boxes into a model and provide step-by-step guidance on how to implement PBA. We conduct a case and examine the differences between the status-quo and PBA approaches and their potential implications on decision-making.

Incorporating Pharmacometrics into Pharmacoeconomic Models: Applications from Drug Development

Pharmacometrics is the science of quantifying the relationship between the pharmacokinetics and pharmacodynamics of drugs in combination with disease models and trial information to aid in drug development and dosing optimization for clinical practice. Considering the variability in the dose-concentration-effect relationship of drugs, an opportunity exists in linking pharmacokinetic and pharmacodynamic model-based estimates with pharmacoeconomic models. This link may provide early estimates of the cost effectiveness of drug therapies, thus informing late-stage drug development, pricing, and reimbursement decisions. Published case studies have demonstrated how integrated pharmacokinetic-pharmacodynamic-pharmacoeconomic models can complement traditional pharmacoeconomic analyses by identifying the impact of specific patient sub-groups, dose, dosing schedules, and adherence on the cost effectiveness of drugs, thus providing a mechanistic basis to predict the economic value of new drugs. Greater collaboration between the pharmacoeconomics and pharmacometrics community can enable methodological improvements in pharmacokinetic-pharmacodynamic-pharmacoeconomic models to support drug development.

An Economic Analysis of Radiation Therapy Oncology Group 94-10: Cost-Efficacy of Concurrent vs. Sequential Chemoradiotherapy

Background

Cost can be a major issue in therapeutic decision-making, and in particular for patients with locally advanced non-small cell lung cancer (LA-NSCLC).

Methods

The specific aim of this analysis was to evaluate the costs and outcomes of patients treated on Radiation Therapy Oncology Group (RTOG) 94-10, Medicare Part A and Part B costs from all for patients treated from 1991 to 1996 on RTOG 94-10, a phase III trial showing a survival benefit for concurrent chemoradiation (STD RT) over sequential (RT day 50) chemoradiation in LA-NSCLC with intermediate outcome for concurrent twice daily radiation and chemotherapy (HFX RT). 26-month expected costs for each arm of the trial in 1996 dollars were determined, with Kaplan Meier sampling average estimates of survival probabilities for each month and mean monthly costs. The analysis was performed from a payer's perspective. Incremental cost-effectiveness ratios were calculated comparing RT on day 50 and HFX RT to the STD RT.

Results

Of the 610 patients entered, Medicare cost data and clinical outcomes were available for 92 patients. In this subset, compared to STD RT, RT on day 50 proved less costly but resulted in reduced survival at 1 year. In addition, HFX RT cost slightly more than STD RT but was less effective in this cohort of patients.

Conclusions

In patients with Medicare insurance and with significant toxicity burden, RT on day 50 is the least expensive but also least effective treatment in this subset of patients treated on RTOG 94-10.

Emerging Use of Early Health Technology Assessment in Medical Product Development: A Scoping Review of the Literature

Early health technology assessment is increasingly being used to support health economic evidence development during early stages of clinical research. Such early models can be used to inform research and development about the design and management of new medical technologies to mitigate the risks, perceived by industry and the public sector, associated with market access and reimbursement. Over the past 25 years it has been suggested that health economic evaluation in the early stages may benefit the development and diffusion of medical products. Early health technology assessment has been suggested in the context of iterative economic evaluation alongside phase I and II clinical research to inform clinical trial design, market access, and pricing. In addition, performing early health technology assessment was also proposed at an even earlier stage for managing technology portfolios. This scoping review suggests a generally accepted definition of early health technology assessment to be "all methods used to inform industry and other stakeholders about the potential value of new medical products in development, including methods to quantify and manage uncertainty". The present review also aimed to identify recent published empirical studies employing an early-stage assessment of a medical product. With most included studies carried out to support a market launch, the dominant methodology was early health economic modeling. Further methodological development is required, in particular, by combining systems engineering and health economics to manage uncertainty in medical product portfolios.

Yoga vs. physical therapy vs. education for chronic low back pain in predominantly minority populations: study protocol for a randomized controlled trial

BACKGROUND

Chronic low back pain causes substantial morbidity and cost to society while disproportionately impacting low-income and minority adults. Several randomized controlled trials show yoga is an effective treatment. However, the comparative effectiveness of yoga and physical therapy, a common mainstream treatment for chronic low back pain, is unknown.

METHODS/DESIGN

This is a randomized controlled trial for 320 predominantly low-income minority adults with chronic low back pain, comparing yoga, physical therapy, and education. Inclusion criteria are adults 18-64 years old with non-specific low back pain lasting ≥ 12 weeks and a self-reported average pain intensity of ≥ 4 on a 0-10 scale. Recruitment takes place at Boston Medical Center, an urban academic safety-net hospital and seven federally qualified community health centers located in diverse neighborhoods. The 52-week study has an initial 12-week Treatment Phase where participants are randomized in a 2:2:1 ratio into i) a standardized weekly hatha yoga class supplemented by home practice; ii) a standardized evidence-based exercise therapy protocol adapted from the Treatment Based Classification method, individually delivered by a physical therapist and supplemented by home practice; and iii) education delivered through a self-care book. Co-primary outcome measures are 12-week pain intensity measured on an 11-point numerical rating scale and back-specific function measured using the modified Roland Morris Disability Questionnaire. In the subsequent 40-week Maintenance Phase, yoga participants are re-randomized in a 1:1 ratio to either structured maintenance yoga classes or home practice only. Physical therapy participants are similarly re-randomized to either five booster sessions or home practice only. Education participants continue to follow recommendations of educational materials. We will also assess cost effectiveness from the perspectives of the individual, insurers, and society using claims databases, electronic medical records, self-report cost data, and study records. Qualitative data from interviews will add subjective detail to complement quantitative data.

TRIAL REGISTRATION

This trial is registered in ClinicalTrials.gov, with the ID number: NCT01343927.

Contribution of economic evaluation to decision making in early phases of product development: a methodological and empirical review

BACKGROUND

Economic evaluation as an integral part of health technology assessment is today mostly applied to established technologies. Evaluating healthcare innovations in their early states of development has recently attracted attention. Although it offers several benefits, it also holds methodological challenges.

OBJECTIVES

The aim of our study was to investigate the possible contributions of economic evaluation to industry's decision making early in product development and to confront the results with the actual use of early data in economic assessments.

METHODS

We conducted a literature research to detect methodological contributions as well as economic evaluations that used data from early phases of product development.

RESULTS

Economic analysis can be beneficially used in early phases of product development for various purposes including early market assessment, R&D portfolio management, and first estimations of pricing and reimbursement scenarios. Analytical tools available for these purposes have been identified. Numerous empirical works were detected, but most do not disclose any concrete decision context and could not be directly matched with the suggested applications.

CONCLUSIONS

Industry can benefit from starting economic evaluation early in product development in several ways. Empirical evidence suggests that there is still potential left unused.

Development and first assessment of a questionnaire for health care utilization and costs for cardiac patients

Background

The valid and reliable measurement of health service utilization, productivity losses and consequently total disease-related costs is a prerequisite for health services research and for health economic analysis. Although administrative data sources are usually considered to be the most accurate, their use is limited as some components of utilization are not systematically captured and, especially in decentralized health care systems, no single source exists for comprehensive utilization and cost data. The aim of this study was to develop and test a questionnaire for the measurement of disease-related costs for patients after an acute cardiac event (ACE).

Methods

To design the questionnaire, the literature was searched for contributions to the assessment of utilization of health care resources by patient-administered questionnaires. Based on these findings, we developed a retrospective questionnaire appropriate for the measurement of disease-related costs over a period of 3 months in ACE patients. Items were generated by reviewing existing guidelines and by interviewing medical specialists and patients. In this study, the questionnaire was tested on 106 patients, aging 35–65 who were admitted for rehabilitation after ACE. It was compared with prospectively measured data; selected items were compared with administrative data from sickness funds.

Results

The questionnaire was accepted well (response rate = 88%), and respondents completed the questionnaire in an average time of 27 minutes. Concordance between retrospective and prospective data showed an intraclass correlation (ICC) ranging between 0.57 (cost of medical intake) and 0.9 (hospital days) with the other main items (physician visits, days off work, medication) clustering around 0.7. Comparison between self-reported and administrative data for days off work and hospitalized days were possible for n = 48. Respective ICCs ranged between 0.92 and 0.94, although differences in mean levels were observed.

Conclusion

The questionnaire was accepted favorably and correlated well with alternative measurement approaches. This first assessment showed promising characteristics of this questionnaire in different aspects of validity for patients with ACE. However, additional research and more extensive tests in other patient groups would be worthwhile.

Feasibility of using administrative claims data for cost-effectiveness analysis of a clinical trial

OBJECTIVE

This study was performed retrospectively to determine if Medicare claims data could be used to evaluate the cost effectiveness, from a payer perspective, of different radiation treatment schedules evaluated in a national clinical trial.

METHODS

Medicare costs from all providers and all places of service were obtained from the Centers for Medicare & Medicaid Services for patients treated in the period 1992-1996 on Radiation Therapy Oncology Group 90-03, and combined with data on outcomes from the trial.

RESULTS

Of the 1,113 patients entered, Medicare cost data and clinical outcomes were available for 187 patients. Significant differences in tolerance of treatment and outcome were noted between patients with Medicare data included in the study and patients without Medicare data, and non-Medicare patients excluded from it. Ninety-five percent confidence ellipses on the incremental cost-effectiveness scatterplots crossed both axes, indicating non-significant differences in cost effectiveness between radiation treatment schedules.

CONCLUSIONS

Claims data permit estimation of cost effectiveness, but Medicare data provide inadequate representation of results applicable to patients from the general population.

Comparison of alternative methods of collection of service use data for the economic evaluation of health care interventions

Economic evaluation of health care interventions usually requires the collection of service use data to estimate the total cost of participants in an evaluation. There are a number of methods available to measure the quantity of services used but little is known about the relative accuracy of alternative methods. In a multicentre randomised controlled trial of interventions for the treatment of adults with recurrent episodes of deliberate self-harm (the POPMACT trial), health service data were collected by patient self-report after six and twelve months and also from GP records by independent investigators. Agreement for overall costs was relatively high. However, this hides substantial variation in agreement between the two sources of information for different services. The results suggest that GP records provide more accurate data on the use of general practice-based contacts than patient report, but less reliable information on contacts with other health services. Thus reliance on GP records for data on hospital services and other community health services based outside of general practice surgeries is not recommended. Future research should explore the level of agreement between patient report and other providing sector records, such as hospital records.

Costs of inflammatory bowel disease in Germany

INTRODUCTION

Inflammatory bowel disease (IBD) is a chronic condition that afflicts young adults in their economically productive years. The goal of this study was to determine the costs of IBD in Germany from a societal perspective, using cost diaries.

METHODS

Members of the German Crohn's Disease and Ulcerative Colitis Association who had IBD were recruited by post, and those who agreed to participate documented their IBD-associated costs prospectively in a diary over 4 weeks. They documented their use of healthcare facilities, medications, sick leave and out-of-pocket expenditures, as well as general demographic information, the status and history of their IBD, and long-term disability. Item costs were calculated according to national sources. Cost data were calculated using non-parametric bootstrapping and presented as mean costs (year 2004) over 4 weeks.

RESULTS

The cost diaries were returned by 483 subjects (Crohn's disease: n = 241, ulcerative colitis: n = 242) with a mean age of 42 years and an average disease duration of 13 years (SD +/- 8.09). The cost diaries were regarded as 'easy to complete' by 89% of participants. The mean 4-week costs per subject were 1,425 Euros(95% CI 1201, 1689) for Crohn's disease and 1,015 Euros(95% CI 832, 1258) for ulcerative colitis. Of the total costs for Crohn's disease, 64% were due to indirect costs such as early retirement or sick leave and 32% were due to direct medical costs. In contrast, of the total costs for ulcerative colitis, 41% were due to direct medical costs and 54% to indirect costs.

CONCLUSIONS

This is the first comprehensive cost study for Crohn's disease and ulcerative colitis in Germany. The most important economic factors that influenced the cost profiles of both diseases were the long-term productivity losses due to an ongoing inability to work and the cost of medications. Results indicate significant cost differences between Crohn's disease and ulcerative colitis. This data provides initial cost estimates that can be analysed further with respect to cost determinants and disease-specific costs in the future.

Data validation in an economic evaluation of surgery for colon cancer

Objectives:This study aimed to validate the accuracy of data retrieved in a prospective multicenter trial, the purpose of which was an economic evaluation of two techniques of surgery for colon cancer.

Methods:Within the Swedish contribution of the COLOR trial (Colon Cancer Open or Laparoscopic Resection), an economic evaluation of open versus laparoscopic surgical techniques was conducted. Data were collected by case record forms (CRF), patient diaries, and telephone surveys every 2 weeks. The study period was 12 weeks, and the perspective was societal. Data from the first consecutive forty patients to complete the health economic study protocol were validated. Retrieved data were compared with data from medical records and data from local social security offices for agreement.

Results:Statistically significant differences were found for duration of anesthesia, length of surgery, number of outpatient consultations by doctors and district nurses, complication rate, and the use of central venous lines. No significant differences were observed concerning length of hospital stay, disposable instruments cost, and time off work, all of which heavily influence total costs.

Conclusions:The present method of data collection regarding resources used in this setting seems to produce accurate data for economic evaluation; however, relative to complication rates, the method did not retrieve accurate data.

Unexpected yes- and no-answering behaviour in the discrete choice approach to elicit willingness to pay: a methodological comparison with payment cards

When measuring willingness to pay (WTP) by contingent valuation surveys, several elicitation methods can be applied. The most common methods are the discrete choice (DC) approach and payment cards. The purpose of this study was to analyse the convergent validity of both approaches in order to investigate different kinds of answering behaviour in these approaches. Unexpected deviations of the answers in the DC approach from the answers provided on the payment cards were analysed, i.e. unexpected yes- (no-)answering was given when respondents stated to the DC question that they are (not) willing to pay a monetary amount while they stated the opposite on the payment cards. Furthermore, we analysed the feasibility of these two elicitation methods. Each of a group of 92 diabetic patients was asked to state their WTP for reductions of the risk of several diabetic complications by both elicitation methods in two surveys. Both elicitation methods were feasible. Compared with the WTP stated on the payment cards, we found unexpected yes- as well as no-answering behaviour in the DC approach which partly balanced each other. At low bids, there was a tendency that unexpected no-outweighed unexpected yes-answering behaviour. At high bids, unexpected yes- outweighed unexpected no-answering behaviour. Overall, unexpected yes-answering behaviour was predominating. Several explanations for these phenomena remain to be investigated.

Design issues for conducting cost-effectiveness analyses alongside clinical trials

In response to rising demands for timely economic data on new medical technologies, cost-effectiveness studies are increasingly being conducted alongside clinical trials. Because of the historical differences in perspective and methods between cost-effectiveness studies and clinical trials, the design phase of these hybrid trials requires special consideration. Cost-effectiveness studies require more comprehensive evaluations of outcomes than the endpoints typically measured in clinical trials. Often, these comprehensive outcome measures (such as quality of life) prove useful for interpreting the other endpoints measured in the trial, as well as for estimating the cost-effectiveness of the intervention. In this manuscript, we discuss several aspects related to the design of joint clinical/economic trials, including study perspective, hypothesis testing, sample size estimation, and methods for collecting cost and outcome data. We also discuss issues that may limit the external validity of the cost-effectiveness results of these trials. Many potential threats to external validity can be successfully addressed if they are identified and accounted for in the design phase of the study.

Evaluating cancer costs in NCI trials

Economic evaluation is playing an increasingly important role in the assessment of clinical treatment strategies for cancer patients. Physicians and patients can use the comprehensive data on the cost and effectiveness of cancer therapies emerging from economic studies to help make treatment decisions. The data from economic analyses will afford clinical investigators an increasingly important tool to help determine the optimal treatment strategies for cancer patients and to help inform health policy decision-makers about the importance of specific cancer therapeutic strategies. In this chapter, we have outlined a set of procedures that can be used to assess the costs of care within NCI clinical trials. We review the economic framework for assessment of clinical trials, then review a proposed strategy for economic assessment. The design was successfully implemented, and the results have been recently published.

Economic evaluations during early (phase II) drug development: a role for clinical trial simulations?

Faced with increasing demands on demonstrating cost effectiveness, pharmaceutical companies are required to conduct pharmacoeconomic evaluations throughout the drug development programme. At present, there is particular emphasis in the literature on burden-of-illness studies and on economic evaluations conducted alongside phase III clinical trials but not on those conducted during phase II clinical trials. This article describes modelling techniques, namely clinical trial simulations (CTS), which are gaining popularity in the clinical research community, but which might also prove to be beneficial during the conduct of these early pharmacoeconomic evaluations. The basic concepts and structure of CTS are described by using published examples of simulations of antipsychotic and anticancer drugs. With the use of an illustrative example of a hypothetical cholinesterase inhibitor for Alzheimer's disease, an integrated CTS-based pharmacoeconomic evaluation is presented. The results demonstrate how the modelling may be of value in 'go/no-go' decisions during the drug development programme.

Client Socio-Demographic and Service Receipt Inventory--European Version: development of an instrument for international research. EPSILON Study 5. European Psychiatric Services: Inputs Linked to Outcome Domains and Needs

BACKGROUND

Cross-cultural comparison of mental health service utilisation and costs is complicated by the heterogeneity of service systems. For data to be locally meaningful yet internationally comparable, a carefully constructed approach to its collection is required.

AIMS

To develop a research method and instrument for the collection of data on the service utilisation and related characteristics of people with mental disorders, as the basis for calculating the costs of care.

METHOD

Various approaches to the collection of service use data and key stages of instrument development were identified in order to select the most appropriate methods.

RESULTS

Based on previous work, and following translation and cross-cultural validation, an instrument was developed: the Client Socio-Demographic and Service Receipt Inventory--European Version (CSSRI-EU). This was subsequently administered to 404 people with schizophrenia across five countries.

CONCLUSION

The CSSRI-EU provides a standardised yet adaptable method for collating service receipt and associated data alongside assessment of patient outcomes.

Testing the validity of cost-effectiveness models

A growing body of recent work has identified several problems with economic evaluations undertaken alongside controlled trials that can have potentially serious impacts on the ability of decision makers to draw valid conclusions. At the same time, the use of cost-effectiveness models has been drawn into question, due to the alleged arbitrary nature of their construction. This has led researchers to try and identify ways of improving the quality of cost-effectiveness models through identifying 'best practice', producing guidelines for peer review and identifying tests of validity. This paper investigates the issue of testing the validity of cost-effectiveness models or, perhaps more appropriately, whether it is possible to objectively measure the quality of a cost-effectiveness model. A review of the literature shows that there is much confusion over the different aspects of modelling that should be assessed in respect to model quality, and how this should be done. We develop a framework for assessing model quality in terms of: (i) the structure of the model; (ii) the inputs of the model; (iii) the results of the model; and (iv) the value of the model to the decision maker. Quality assessment is investigated within this framework, and it is argued that it is doubtful that a set of objective tests of validity will ever be produced, or indeed that such an approach would be desirable. The lack of any clearly definable and objective tests of validity means that the other parts of the evaluation process need to be given greater emphasis. Quality assurance forms a small part of a broader process and is best implemented in the form of good practice guidelines. A set of key guidelines are presented.

Cost effectiveness of omeprazole and ranitidine in intermittent treatment of symptomatic gastro-oesophageal reflux disease

OBJECTIVE

This 1-year study compared the cost effectiveness of omeprazole and ranitidine when used as initial therapy in an intermittent treatment strategy for the management of patients with symptomatic gastro-oesophageal reflux disease with or without erosive oesophagitis.

DESIGN AND SETTING

A prospective health economic analysis was conducted alongside an international multicentre randomised, double-blind clinical study. The economic analysis was performed from a societal perspective.

PATIENTS

A total of 704 patients in the UK, the Republic of Ireland, Germany, France, Italy and Spain were randomised to 1 of the 3 treatment groups.

INTERVENTIONS

Patients were randomised to receive either omeprazole 20 mg once daily, omeprazole 10 mg once daily or ranitidine 150 mg twice daily. Initial treatment failure resulted in dose titration and drug switching from ranitidine to omeprazole, and subsequently open maintenance treatment.

MAIN OUTCOME MEASURES AND RESULTS

The estimated mean direct medical costs (medication and number of visits and endoscopies) were found to be lower for both dosages of omeprazole than for ranitidine in all countries except Germany. However, none of the differences were statistically significant. The differences between omeprazole 10 mg and omeprazole 20 mg were small and nonsignificant. With regard to numbers of symptom-free days, both omeprazole 20 mg and omeprazole 10 mg were found to be more effective than ranitidine. However, none of the differences were statistically significant.

CONCLUSIONS

Following a pragmatic interpretation, incorporating intermediate short term results, the results in this study give no support to the notion that a step-up approach, either as dose titration from omeprazole 10 mg to omeprazole 20 mg or as drug switching from ranitidine to omeprazole, will result in cost savings and thereby be cost effective.

Comparison of alternative sources of data on health service encounters

OBJECTIVES

Due to the paucity and incompleteness of routine databases, many areas of health services research rely on the accuracy of individuals' recollections of health service encounters. The objective of this study is to explore differences between patient and physician recall of health care resource use by employing data from two randomized controlled trials.

METHODS

Data on the frequency of use of community-based health services were reported by both patients and their general practitioners (GPs) at three-month intervals for the first year after randomization. Analysis compared the completeness of data collected, the level of agreement between GPs and patients and differences in the estimated cost of community services. Further analysis assessed the impact of patient characteristics on reporting.

RESULTS

Data provided by GPs were less likely to be complete than patient data. There were significant differences between GPs and patients in their reported use of certain community services, particularly in relation to GP-patient contacts. However, this did not lead to significant differences in estimates of costs. Patient characteristics influenced the level of agreement with GPs, but not the proportion of forms completed.

CONCLUSIONS

In research in which the use of community resources is a major component of costs, differential estimates of resource use may influence study results. Further research is required to identify optimal data collection methods for health service encounters. Where possible, studies should incorporate estimates of resource use from a variety of sources and conduct sensitivity analyses to assess the robustness of the results.

Trials and tribulations. Emerging issues in designing economic evaluations alongside clinical trials

Decisions relating to designing and implementing economic evaluations alongside clinical trials are dependent on a number of issues initial consideration should focus on whether an economic evaluation is appropriate, whether a randomized controlled trial (RCT) is a suitable vehicle, and whether the design of the specific RCT is appropriate for integration of economic evaluation. If an economic evaluation is appropriate, decisions are required on how economic data are to be collected and analyzed. This paper discusses these and other issues and, where appropriate, provides recommendations for future studies.