Implementation fidelity, student outcomes, and cost-effectiveness of train-the-trainer strategies for Masters-level therapists in urban schools: results from a cluster randomized trial

BACKGROUND

Little is known about the effectiveness and cost-effectiveness of train-the-trainer implementation strategies in supporting mental health evidence-based practices in schools, and about the optimal level of support needed for TT strategies.

METHODS

The current study is part of a larger type 2 hybrid cluster randomized controlled trial. It compares two train-the-trainer strategies, Train-the-Trainer (TT) and Train-the-Trainer plus ongoing consultation for trainers (TT +) on the delivery of a group cognitive behavioral treatment protocol for anxiety disorders. Participants were 33 therapists, 29 supervisors, and 125 students who were at risk for anxiety disorders from 22 urban schools. Implementation outcomes were implementation fidelity and treatment dosage. Student outcomes were child- and parent-reported symptoms of anxiety, child-reported symptoms of depression, and teacher-reported academic engagement. We estimated the cost of implementing the intervention in each condition and examined the probability that a support strategy for supervisors (TT vs TT +) is a good value for varying values of willingness to pay.

RESULTS

Therapists in the TT and TT + conditions obtained similarly high implementation fidelity and students in the conditions received similar treatment dosages. A mixed effects modeling approach for student outcomes revealed time effects for symptoms of anxiety and depression reported by students, and emotional disaffection reported by teachers. There were no condition or condition × times effects. For both conditions, the time effects indicated an improvement from pre-treatment to post-treatment in symptoms of anxiety and depression and academic emotional engagement. The average cost of therapist, supervisor, and consultant time required to implement the intervention in each condition was $1002 for TT and $1431 for TT + (p = 0.01). There was a greater than 80% chance that TT was a good value compared to TT + for all values of willingness to pay per one-point improvement in anxiety scores.

CONCLUSIONS

A TT implementation approach consisting of a thorough initial training workshop for therapists and supervisors as well as ongoing supervision for therapists resulted in adequate levels of fidelity and student outcomes but at a lower cost, compared to the TT + condition that also included ongoing external expert consultation for supervisors.

TRIAL REGISTRATION

ClinicalTrials.gov identifier: NCT02651402.

Telemedicine management of obstructive sleep apnea disorder in China: a randomized, controlled, non-inferiority trial

PURPOSE

Previous studies assessed different components of telemedicine management pathway for OSA instead of the whole pathway. This randomized, controlled, and non-inferiority trial aimed to assess whether telemedicine management is clinically inferior to in-person care in China.

METHODS

Adults suspected of OSA were randomized to telemedicine (web-based questionnaires, self-administered home sleep apnea test [HSAT], automatically adjusting positive airway pressure [APAP], and video-conference visits) or in-person management (paper questionnaires, in-person HSAT set-up, APAP, and face-to-face visits). Participants with an apnea-hypopnea index (AHI) ≥ 15 events/hour received APAP for 3 months. The non-inferiority analysis was based on the change in Functional Outcomes of Sleep Questionnaire (FOSQ) score and APAP adherence. Cost-effectiveness analysis was performed.

RESULTS

In the modified intent-to-treat analysis set (n = 111 telemedicine, 111 in-person), FOSQ scores improved 1.73 (95% confidence interval [CI], 1.31-2.14) points with telemedicine and 2.05 (1.64-2.46) points with in-person care. The lower bound of the one-sided 95% non-inferiority CI for the difference in change between groups of - 0.812 was larger than the non-inferiority threshold of - 1. APAP adherence at 3 months was 243.3 (223.1-263.5) minutes/night for telemedicine and 241.6 (221.3-261.8) minutes/night for in-person care. The lower bound of the one-sided 95% non-inferiority CI of - 22.2 min/night was higher than the non-inferiority delta of - 45 min/night. Telemedicine had lower total costs than in-person management (CNY 1482.7 ± 377.2 vs. 1912.6 ± 681.3; p < 0.0001), driven by patient costs, but no significant difference in QALYs.

CONCLUSIONS

Functional outcomes and adherence were not clinically inferior in patients managed by a comprehensive telemedicine approach compared to those receiving in-person care in China.

CLINICAL TRIAL REGISTRATION

https://www.chictr.org.cn , Registration number ChiCTR2000030546. Retrospectively registered on March 06, 2020.

A comparison of two group cognitive behavioral therapy protocols for anxiety in urban schools: appropriateness, child outcomes, and cost-effectiveness

Background

Cognitive behavioral therapy (CBT) for pediatric anxiety is efficacious for reducing anxiety symptoms and improving functioning, but many children are unable to access CBT for anxiety in community settings. Schools are an important setting in which children access mental health care, including therapy for anxiety. In this setting, therapy is usually delivered by Masters-level therapists.

Objectives

Friends for Life (FRIENDS), a 12-session, manualized, group CBT program for anxiety has demonstrated effectiveness when implemented in schools. However, prior research has also found challenges regarding feasibility and cultural fit when delivering FRIENDS in the urban school context. To address these challenges, we adapted FRIENDS for implementation in the school setting so that it might be more feasible and culturally appropriate for low-income, urban schools in the United States, while maintaining the core components of treatment. The current study uses a mixed-method approach to compare the effectiveness, cost-effectiveness, and perceived appropriateness of FRIENDS and CATS when delivered by Masters-level therapists with train-the-trainer support.

Materials and methods

First, we compared change scores for student outcomes (i.e., child-report MASC-2 total score, parent-report MASC-2 total score, teacher-report Engagement and Disaffection subscale scores) from pre- to post- treatment between students receiving FRIENDS and students receiving CATS to assess whether the two conditions resulted in equivalent outcomes. Second, we compared the cost and cost-effectiveness between the groups. Finally, we used an applied thematic analysis to compare appropriateness of the interventions as perceived by therapists and supervisors.

Results

The mean change score for the child-reported MASC-2 was 1.9 (SE = 1.72) points in the FRIENDS condition and 2.9 (SE = 1.73) points in the CATS condition; results indicated that the conditions were similar in their treatment effects, and symptom reductions were small in both groups. The modified protocol, CATS, was shown to cost significantly less to implement compared to FRIENDS and showed greater cost-effectiveness. Finally, compared to therapists and supervisors in the CATS condition, therapists and supervisors in the FRIENDS condition more strongly described aspects of the intervention that were not appropriate for their context and in need of more extensive adaptations.

Conclusion

Relatively brief, group CBT for anxiety, with adaptations to improve cultural fit, is a promising approach to treat youth anxiety symptom when delivered by school-based therapists with train-the-trainer implementation support.

Association Between Positive Airway Pressure Adherence and Health Care Costs Among Individuals With OSA

BACKGROUND

The impact of positive airway pressure (PAP) therapy for OSA on health care costs is uncertain.

RESEARCH QUESTION

Are 3-year health care costs associated with PAP adherence in participants from the Tele-OSA clinical trial?

STUDY DESIGN AND METHODS

Participants with OSA and prescribed PAP in the Tele-OSA study were stratified into three PAP adherence groups based on usage patterns over 3 years: (1) high (consistently ≥ 4 h/night), (2) moderate (2-3.9 h/night or inconsistently ≥ 4 h/night), and (3) low (< 2 h/night). Using data from 3 months of the Tele-OSA trial and 33 months of posttrial follow up, average health care costs (2020 US dollars) in 6-month intervals were derived from electronic health records and analyzed using multivariable generalized linear models.

RESULTS

Of 543 participants, 25% were categorized as having high adherence, 22% were categorized as having moderate adherence, and 52% were categorized as having low adherence to PAP therapy. Average PAP use mean ± SD was 6.5 ± 1.0 h, 3.7 ± 1.2 h, and 0.5 ± 0.5 h for the high, moderate, and low adherence groups, respectively. The high adherence group had the lowest average covariate-adjusted 6-month health care costs ± SE ($3,207 ± $251) compared with the moderate ($3,638 ± $363) and low ($4,040 ± $304) adherence groups. Significant cost differences were observed between the high and low adherence groups ($832; 95% CI, $127 to $1,538); differences between moderate and low adherence were nonsignificant ($401; 95% CI, -$441 to $1,243).

INTERPRETATION

In participants with OSA, better PAP adherence was associated with significantly lower health care costs over 3 years. Findings support the importance of strategies to enhance long-term PAP adherence.

Cost-effectiveness of a 3-year tele-messaging intervention for positive airway pressure use

OBJECTIVES

To evaluate the cost-effectiveness of a 3-year tele-messaging intervention for positive airway pressure (PAP) use in obstructive sleep apnea (OSA).

STUDY DESIGN

A post hoc cost-effectiveness analysis (from US payers' perspective) of data from a 3-month tele-OSA trial, augmented with 33 months of epidemiologic follow-up.

METHODS

Cost-effectiveness was compared among 3 groups of participants with an apnea-hypopnea index of at least 15 events/hour: (1) no messaging (n = 172), (2) messaging for 3 months (n = 124), and (3) messaging for 3 years (n = 46). We report the incremental cost (2020 US$) per incremental hour of PAP use and the fraction probability of acceptability based on a willingness-to-pay threshold of $1825 per year ($5/day).

RESULTS

The use of 3 years of messaging had similar mean annual costs ($5825) compared with no messaging ($5889; P = .89) but lower mean cost compared with 3 months of messaging ($7376; P = .02). Those who received messaging for 3 years had the highest mean PAP use (4.11 hours/night), followed by no messaging (3.03 hours/night) and 3 months of messaging (2.84 hours/night) (all P < .05). The incremental cost-effectiveness ratios indicated that 3 years of messaging showed lower costs and greater hours of PAP use compared with both no messaging and 3 months of messaging. Based on a willingness-to-pay threshold of $1825, there is a greater than 97.5% chance (ie, 95% confidence) that 3 years of messaging is acceptable compared with the other 2 interventions.

CONCLUSIONS

Long-term tele-messaging is highly likely to be cost-effective compared with both no and short-term messaging, with an acceptable willingness-to-pay threshold. Future long-term cost-effectiveness studies in a randomized controlled trial setting are warranted.

Study protocol: cluster randomized trial of consultation strategies for the sustainment of mental health interventions in under-resourced urban schools: rationale, design, and methods

Background

The school is a key setting for the provision of mental health services to children, particularly those underserved through traditional service delivery systems. School-wide Positive Behavioral Interventions and Supports (PBIS) is a tiered approach to service delivery based on the public health model that schools use to implement universal (Tier 1) supports to improve school climate and safety. As our prior research has demonstrated, PBIS is a useful vehicle for implementing mental and behavioral health evidence-based practices (EBPs) at Tier 2 for children with, or at risk for, mental health disorders. Very little research has been conducted regarding the use of mental health EBPs at Tier 2 or how to sustain implementation in schools.

Methods/design

The main aim of the study is to compare fidelity, penetration, cost-effectiveness, and student outcomes of Tier 2 mental health interventions across 2 sustainment approaches for school implementers in 12 K-8 schools. The study uses a 2-arm, cluster randomized controlled trial design. The two arms are: (a) Preparing for Sustainment (PS)—a consultation strategy implemented by school district coaches who receive support from external consultants, and (b) Sustainment as Usual (SAU)—a consultation strategy implemented by school district coaches alone. Participants will be 60 implementers and 360 students at risk for externalizing and anxiety disorders. The interventions implemented by school personnel are: Coping Power Program (CPP) for externalizing disorders, CBT for Anxiety Treatment in Schools (CATS) for anxiety disorders, and Check-in/Check-out (CICO) for externalizing and internalizing disorders. The Interactive Systems Framework (ISF) for Dissemination and Implementation guides the training and support procedures for implementers.

Discussion

We expect that this study will result in a feasible, effective, and cost-effective strategy for sustaining mental health EBPs that is embedded within a multi-tiered system of support. Results from this study conducted in a large urban school district would likely generalize to other large, urban districts and have an impact on population-level child mental health.

Trial registration ClinicalTrials.gov identifier number NCT04869657. Registered May 3, 2021.

One-Year Quality of Life Post-Pneumonia Diagnosis in Japanese Adults

BACKGROUND

Pneumonia is a common, serious illness in the elderly, with a poorly characterized long-term impact on health-related quality of life (HRQoL). The Japanese Goto Epidemiology Study is a prospective, active, population-based surveillance study of adults with X-ray/CT scan-confirmed community-onset pneumonia, assessing the HRQoL outcome quality-adjusted life-years (QALYs). We report QALY scores and losses among a subset of participants in this study.

METHODS

QALYs were derived from responses to the Japanese version of the EuroQol-5D-5L health-state classification instrument at days 0, 7, 15, 30, 90, 180, and 365 after pneumonia diagnosis from participants enrolled from June 2017 to May 2018. We used patients as their own controls, calculating comparison QALYs by extrapolating EuroQol-5D-5L scores for day -30, accounting for mortality and changes in scores with age.

RESULTS

Of 405 participants, 85% were aged ≥65 years, 58% were male, and 69% were hospitalized for clinically and radiologically confirmed pneumonia. Compliance with interviews by patients or proxies was 100%. Adjusted EuroQol-5D-5L scores were 0.759, 0.561, 0.702, and 0.689 at days -30, 0 (diagnosis), 180, and 365, respectively. Average scores at all time points remained below the average day -30 scores (P ≤ .001). Pneumonia resulted in a 1-year adjusted loss of 0.13 QALYs (~47.5 quality-adjusted days) (P < .001).

CONCLUSIONS

Substantial QALY losses were observed among Japanese adults following pneumonia diagnosis, and scores had not returned to prediagnosis levels at 1 year postdiagnosis. QALY scores and cumulative losses were comparable to those in US adults with chronic heart failure, stroke, or renal failure.

Evaluation of COVID-19 Testing Strategies for Repopulating College and University Campuses: A Decision Tree Analysis

PURPOSE

The optimal approach to identify SARS-CoV-2 infection among college students returning to campus is unknown. Recommendations vary from no testing to two tests per student. This research determined the strategy that optimizes the number of true positives and negatives detected and reverse transcription polymerase chain reaction (RT-PCR) tests needed.

METHODS

A decision tree analysis evaluated five strategies: (1) classifying students with symptoms as having COVID-19, (2) RT-PCR testing for symptomatic students, (3) RT-PCR testing for all students, (4) RT-PCR testing for all students and retesting symptomatic students with a negative first test, and (5) RT-PCR testing for all students and retesting all students with a negative first test. The number of true positives, true negatives, RT-PCR tests, and RT-PCR tests per true positive (TTP) was calculated.

RESULTS

Strategy 5 detected the most true positives but also required the most tests. The percentage of correctly identified infections was 40.6%, 29.0%, 53.7%, 72.5%, and 86.9% for Strategies 1-5, respectively. All RT-PCR strategies detected more true negatives than the symptom-only strategy. Analysis of TTP demonstrated that the repeat RT-PCR strategies weakly dominated the single RT-PCR strategy and that the thresholds for more intensive RT-PCR testing decreased as the prevalence of infection increased.

CONCLUSION

Based on TTP, the single RT-PCR strategy is never preferred. If the cost of RT-PCR testing is of concern, a staged approach involving initial testing of all returning students followed by a repeat testing decision based on the measured prevalence of infection might be considered.

Abstract PD7-05: Comparative costs of breast cancer screening with digital breast tomosynthesis versus digital mammography: A health system perspective

Background

Digital breast tomosynthesis (DBT) is being rapidly implemented in breast cancer screening and demonstrates improved specificity and sensitivity compared to screening with digital mammography (DM) alone. Prior work based on payer perspectives has demonstrated that DBT can be cost-effective. However, DBT is costlier than DM, and there are little data from a health system perspective about the comparative test performance and costs of DBT versus DM.

Methods

We evaluated breast cancer screening episodes in a single health system between January 1, 2012 and December 31, 2013. A screening episode was defined as a single screening mammogram and all downstream breast diagnosis related costs for the following 1 year. Episodes were excluded if the patient had a prior diagnosis of breast cancer or reached 90 years of age before the end of the follow-up period. Test performance with respect to four outcomes – true positive (TP), true negative (TN), false positive (FP), and false negative (FN) rates – was determined by comparing the BI-RADS score assigned at screening with data about subsequent cancer diagnosis from institutional and state cancer registries. Cost data were developed using CPT codes collected from organizational billing systems and converted to the Medicare Physician Fee Payment Schedule for our region with an imputed additional charge of $60.16 for DBT. Based on this approach, a DM screening exam cost $155.66 and a DBT screening exam cost $215.82. We evaluated overall costs across a screening episode, as well as by four windows: screening, follow-up, diagnosis, and cancer treatment. Data were described using percentages, and Chi-squared and Fisher's exact tests were used to evaluate differences in test performance outcomes and costs based on screening technology.

Results

There were a total of 46,483 cost episodes during the study period, of which 24,502 (52.7%) were screened by DM and 21,981 (47.3%) were screened by DBT. Overall, there were 224 TP (0.5%), 29 FN (0.1%), 4,530 FP (9.8%), and 41,700 TN (89.7%) episodes. Compared to DM episodes, DBT episodes had lower FP (8.6% vs. 10.8%, p&lt;0.001) and higher TN (90.9% vs. 88.7%, p&lt;0.001) rates. There were no statistically significant differences between DBT and DM episodes with respect to TP and FN rates.

Overall, average episode costs were higher for DBT compared to DM ($378.02 vs. $286.62, p&lt;0.001). This $91.40 difference was driven by higher average screening costs ($215.94 vs. $155.76, p&lt;0.001), which approximated the additional charge for DBT, as well as follow-up costs ($23.67 vs. $12.11, p&lt;0.001). There was no significant difference in costs between DBT and DM episodes within the diagnosis or cancer treatment windows.

Compared to DM episodes, DBT episodes had equivalent average episode costs per woman screened for FP ($67.75 vs. $65.71, p=0.49), FN ($4.63 vs. $5.60, p=0.69) and TP ($85.80 vs. $65.15, p=0.07) outcomes, but higher costs for TN ($219.84 vs. $150.16, p&lt;0.001) outcomes.

Conclusion

At a single health system, screening with DBT decreased FP rates and increased TN rates compared to screening with DM. DBT costs more overall, but not on a per-woman-screened basis for FP, FN, and TP outcomes.

Citation Format: Liao GJ, Glick HA, Synnestvedt MB, Schnall MD, Conant EF. Comparative costs of breast cancer screening with digital breast tomosynthesis versus digital mammography: A health system perspective [abstract]. In: Proceedings of the 2017 San Antonio Breast Cancer Symposium; 2017 Dec 5-9; San Antonio, TX. Philadelphia (PA): AACR; Cancer Res 2018;78(4 Suppl):Abstract nr PD7-05.

Comparative effectiveness and cost-effectiveness analyses frequently agree on value

The Patient-Centered Outcomes Research Institute, known as PCORI, was established by Congress as part of the Affordable Care Act (ACA) to promote evidence-based treatment. Provisions of the ACA prohibit the use of a cost-effectiveness analysis threshold and quality-adjusted life-years (QALYs) in PCORI comparative effectiveness studies, which has been understood as a prohibition on support for PCORI's conducting conventional cost-effectiveness analyses. This constraint complicates evidence-based choices where incremental improvements in outcomes are achieved at increased costs of care. How frequently this limitation inhibits efficient cost containment, also a goal of the ACA, depends on how often more effective treatment is not cost-effective relative to less effective treatment. We examined the largest database of studies of comparisons of effectiveness and cost-effectiveness to see how often there is disagreement between the more effective treatment and the cost-effective treatment, for various thresholds that may define good value. We found that under the benchmark assumption, disagreement between the two types of analyses occurs in 19 percent of cases. Disagreement is more likely to occur if a treatment intervention is musculoskeletal and less likely to occur if it is surgical or involves secondary prevention, or if the study was funded by a pharmaceutical company.

A hybrid effectiveness-implementation cluster randomized trial of group CBT for anxiety in urban schools: rationale, design, and methods

Background

Schools present a context with great potential for the implementation of psychosocial evidence-based practices. Cognitive behavioral therapy (CBT) is an evidence-based practice that has been found to be very effective in treating anxiety in various community settings, including schools. Friends for Life (FRIENDS) is an efficacious group CBT protocol for anxiety. Unfortunately, evidence-based practices for anxiety are seldom employed in under-resourced urban schools, because many treatment protocols are not a good fit for the urban school context or the population, existing behavioral health staff do not receive adequate training or support to allow them to implement the treatment with fidelity, or school districts do not have the resources to contract with external consultants. In our prior work, we adapted FRIENDS to create a more culturally sensitive, focused, and feasible CBT protocol for anxiety disorders (CBT for Anxiety Treatment in Schools (CATS)).

Methods/design

The aim of this 5-year study is to evaluate both the effectiveness of CATS for urban public schools compared to the original FRIENDS as well as compare the implementation strategies (train-the-trainer vs. train-the-trainer + ongoing consultation) by conducting a three-arm, parallel group, type 2 hybrid effectiveness-implementation trial in 18 K-8 urban public schools. We will also assess the cost-effectiveness and the mediators and moderators of fidelity. Ninety therapists, 18 agency supervisors, and 360 children will participate. The interactive systems framework for dissemination and implementation guides the training and support procedures for therapists and supervisors.

Discussion

This study has the potential to demonstrate that agency therapists and supervisors who have had little to no prior exposure to evidence-based practices (EBPs) can implement an anxiety disorder EBP with fidelity. Comparisons of the implementation strategies would provide large urban mental health systems with data to make decisions about the adoption of EBPs.

Trial registration

ClinicalTrials.gov, NCT02651402

Impact of intensive lifestyle intervention on preference-based quality of life in type 2 diabetes: Results from the Look AHEAD trial

OBJECTIVE

To assess the effect of an intensive lifestyle intervention (ILI) compared with standard diabetes support and education (DSE) on preference-based health-related quality of life (HRQOL) in persons with overweight or obesity and type 2 diabetes.

METHODS

Look AHEAD was a multisite, randomized trial of 5,145 participants assigned to ILI or DSE. Four instruments were administered during the trial: Feeling Thermometer (FT), Health Utilities Index Mark 2 (HUI2), Health Utilities Index Mark 3 (HUI3), and Short Form 6D (SF-6D). Linear mixed effect models were used to estimate the mean difference in preference scores by treatment group for 9 years.

RESULTS

The ILI had higher mean FT (0.019, 95% CI, 0.015-0.024, P < 0.001) and SF-6D (0.011, 95% CI, 0.006-0.014, P < 0.001) scores than the DSE. No significant group differences were observed for the HUI2 (0.004, 95% CI, -0.003 to 0.010, P = 0.23) and HUI3 (0.004, -0.004 to 0.012, P = 0.36). In year 1, the ILI had higher mean preference scores for all instruments. Thereafter, the increases remained significant only for FT and SF-6D, and the effects also become smaller.

CONCLUSIONS

ILI aimed at reducing body weight among persons with overweight or obesity and type 2 diabetes improves preference-based HRQOL in the short term, but its long-term effect is unclear.

Low Health Literacy Predicts Misperceptions of Diabetes Control in Patients With Persistently Elevated A1C

Purpose

The purpose of this study is to identify factors associated with perceived control of diabetes in a group of poorly controlled patients. Identifying factors associated with perceived control in these patients is an important step in improving actual control as measured by A1C. As health literacy is essential for understanding complex medical information, we hypothesized that low health literacy would be associated with inaccurate perceptions of diabetes control.

Methods

A cross-sectional analysis was performed on 280 adults with type 2 diabetes whose last 2 A1C measurements were >8.0%. Participants were recruited primarily from 6 University of Pennsylvania primary care practices. Perceived control and factors potentially associated with this outcome, including health literacy, were assessed during an in-person interview. Health literacy was measured using the Rapid Estimate of Adult Literacy.

Results

Thirty-nine percent of patients responded that they were managing to control their diabetes well or very well. However, 57% of those at the seventh to eighth-grade health literacy level and 61% of those at the level of sixth grade and below reported that they were controlling their diabetes well or very well.

Conclusions

In this population of patients with poorly controlled diabetes, a majority of those with low health literacy believed that they were controlling their disease well or very well. Patients who believe that they are already controlling their diabetes well may be less likely to make changes to improve control. Health care providers and educators should consider health literacy when discussing control of diabetes and when setting management goals with patients.

Re-examining the BMI threshold for bariatric surgery in the USA

BACKGROUND

The optimal BMI threshold above which gastric bypass surgery should be offered to obese patients is controversial. The objective of this study was to compare the impact of Roux-en-Y gastric bypass (RYGB) vs. diet and exercise (D&E) on life expectancy to find the BMI at which patients experience an improvement in their life expectancy by undergoing surgery.

METHODS

A Markov state transition model was designed to implement a decision tree that simulated the lives of obese patients. Life expectancies following RYGB and 2 years of D&E were estimated and compared. Ten thousand patients' lives were simulated in each weight-loss intervention group in the model. In addition to base case analysis (45 kg/m(2) BMI pre-intervention), sensitivity analysis of initial BMI at the start of the study was completed. Markov model parameters were extracted from the literature.

RESULTS

The impact of RYGB on survival relative to D&E depended on the patient's initial BMI. Compared to patients who underwent 2 years of "optimal" diet and exercise (7 % total body weight loss/year), RYGB improved long-term survival for patients above a BMI of 31.3 kg/m(2).

CONCLUSIONS

Roux-en-Y gastric bypass can improve long-term survival for patients with class I obesity. This study suggests that RYGB should not be reserved solely for patients with class II or III obesity.

Impact of an intensive lifestyle intervention on use and cost of medical services among overweight and obese adults with type 2 diabetes: the action for health in diabetes

OBJECTIVE

To assess the relative impact of an intensive lifestyle intervention (ILI) on use and costs of health care within the Look AHEAD trial.

RESEARCH DESIGN AND METHODS

A total of 5,121 overweight or obese adults with type 2 diabetes were randomly assigned to an ILI that promoted weight loss or to a comparison condition of diabetes support and education (DSE). Use and costs of health-care services were recorded across an average of 10 years.

RESULTS

ILI led to reductions in annual hospitalizations (11%, P = 0.004), hospital days (15%, P = 0.01), and number of medications (6%, P < 0.001), resulting in cost savings for hospitalization (10%, P = 0.04) and medication (7%, P < 0.001). ILI produced a mean relative per-person 10-year cost savings of $5,280 (95% CI 3,385-7,175); however, these were not evident among individuals with a history of cardiovascular disease.

CONCLUSIONS

Compared with DSE over 10 years, ILI participants had fewer hospitalizations, fewer medications, and lower health-care costs.

Lack of effectiveness of hyperbaric oxygen therapy for the treatment of diabetic foot ulcer and the prevention of amputation: a cohort study

OBJECTIVE

Hyperbaric oxygen (HBO) is a device that is used to treat foot ulcers. The study goal was to compare the effectiveness of HBO with other conventional therapies administered in a wound care network for the treatment of a diabetic foot ulcer and prevention of lower-extremity amputation.

RESEARCH DESIGN AND METHODS

This was a longitudinal observational cohort study. To address treatment selection bias, we used propensity scores to determine the "propensity" that an individual was selected to receive HBO.

RESULTS

We studied 6,259 individuals with diabetes, adequate lower limb arterial perfusion, and foot ulcer extending through the dermis, representing 767,060 person-days of wound care. In the propensity score-adjusted models, individuals receiving HBO were less likely to have healing of their foot ulcer (hazard ratio 0.68 [95% CI 0.63-0.73]) and more likely to have an amputation (2.37 [1.84-3.04]). Additional analyses, including the use of an instrumental variable, were conducted to assess the robustness of our results to unmeasured confounding. HBO was not found to improve the likelihood that a wound might heal or to decrease the likelihood of amputation in any of these analyses.

CONCLUSIONS

Use of HBO neither improved the likelihood that a wound would heal nor prevented amputation in a cohort of patients defined by Centers for Medicare and Medicaid Services eligibility criteria. The usefulness of HBO in the treatment of diabetic foot ulcers needs to be reevaluated.

Roux-en-Y gastric bypass compared with aggressive diet and exercise therapy for morbidly obese patients awaiting renal transplant: a decision analysis

BACKGROUND

The optimal management of morbidly obese patients awaiting renal transplant is controversial and unknown. The objective of this study was to compare the impact of Roux-en-Y gastric bypass (RYGB) versus diet and exercise on the survival of morbidly obese patients with end-stage renal disease awaiting renal transplant.

METHODS

A decision analytic Markov state transition model was designed to simulate the life of morbidly obese patients with end-stage renal disease awaiting transplant. Life expectancy after RYGB and after 1 and 2 years of diet and exercise was estimated and compared in the framework of 2 clinical scenarios in which patients above a body mass index (BMI) of 35 kg/m(2) or above a BMI of 40 kg/m(2) were ineligible for transplantation, reflecting the BMI restrictions of many transplant centers. In addition to base case analysis (45 kg/m(2) BMI preintervention), sensitivity analysis of initial BMI was completed. Markov model parameters were extracted from the literature.

RESULTS

RYGB improved survival compared with diet and exercise. Patients who underwent RYGB received transplants sooner and in higher frequency. Using 40 kg/m(2) as the upper limit for transplant eligibility, base case patients who underwent RYGB gained 5.4 years of life, whereas patients who underwent 1 and 2 years of diet and exercise gained 1.5 and 2.8 years of life, respectively. Using 35 kg/m(2) as the upper limit, RYGB base case patients gained 5.3 years of life, whereas patients who underwent 1 and 2 years of diet and exercise gained .7 and 1.5 years of life, respectively.

CONCLUSIONS

In morbidly obese patients with end-stage renal disease, RYGB may be more effective than optimistic weight loss outcomes after diet and exercise, thereby improving access to renal transplantation.

Comparative effectiveness of nonbiologic versus biologic disease-modifying antirheumatic drugs for rheumatoid arthritis

OBJECTIVE

To evaluate the comparative effectiveness of nonbiologic disease-modifying antirheumatic drugs (DMARD) versus biologic DMARD (bDMARD) for treatment of rheumatoid arthritis (RA), using 2 common analytic approaches.

METHODS

We analyzed change in Clinical Disease Activity Index (CDAI) scores in patients with RA enrolled in a US-based observational registry from 2001 to 2008 using multivariable (MV) regression and propensity score (PS) matching. Among patients who initiated treatment with a nonbiologic DMARD (n = 1729), we compared patients who switched to, or added, another nonbiologic (n = 182) or a bDMARD (n = 342) at 5, 9, and 24 months after treatment change.

RESULTS

Both analytic approaches showed that patients switching to or adding another nonbiologic DMARD demonstrated improvement across 9 and 24 months (both p < 0.001). Both approaches also demonstrated greater improvement in CDAI among recipients of bDMARD relative to a second nonbiologic DMARD at 5 months (p < 0.02). The MV regression approach upheld these results at 9 and 24 months (p < 0.03). In contrast, the PS-matching approach did not show a sustained advantage with bDMARD at these later timepoints, possibly because of lower statistical power and/or lower baseline disease activity in the PS-matched cohort.

CONCLUSION

Patients in both treatment groups generally experienced lower CDAI scores across time. Patients switching to bDMARD demonstrated greater improvement than patients switching to nonbiologic DMARD with both analytic approaches at 5 months. Relative advantages with bDMARD were observed at 9 and 24 months only with MV regression. These analyses provide a practical example of how findings in comparative effectiveness research can diverge with different methodological approaches.

Sample size and power for cost-effectiveness analysis (Part 2): the effect of maximum willingness to pay

Sample size and power for cost-effectiveness analysis depend on assumptions about the difference in cost and effect, the standard deviations of cost and effect, the correlation of the difference in cost and effect, the α and β errors and maximum willingness to pay (W). The first seven of these parameters share much in common in their effect on sample size and power for cost-effectiveness analysis, including that each is associated with a single pattern of power. W, on the other hand, is unique in that, when plotted for positive values, we can potentially observe any of six patterns of power associated with positive values of W. In addition, as W approaches ∞, power need be neither monotonically increasing nor decreasing and it can be multimodal. In this article, the relationship between W and sample size and power is explained.

Sample size and power for cost-effectiveness analysis (part 1)

Basic sample size and power formulae for cost-effectiveness analysis have been established in the literature. These formulae are reviewed and the similarities and differences between sample size and power for cost-effectiveness analysis and for the analysis of other continuous variables such as changes in blood pressure or weight are described. The types of sample size and power tables that are commonly calculated for cost-effectiveness analysis are also described and the impact of varying the assumed parameter values on the resulting sample size and power estimates is discussed. Finally, the way in which the data for these calculations may be derived are discussed.

Direct medical cost of overweight and obesity in the USA: a quantitative systematic review

To estimate per-person and aggregate direct medical costs of overweight and obesity and to examine the effect of study design factors. PubMed (1968-2009), EconLit (1969-2009) and Business Source Premier (1995-2009) were searched for original studies. Results were standardized to compute the incremental cost per overweight person and per obese person, and to compute the national aggregate cost. A total of 33 US studies met review criteria. Among the four highest-quality studies, the 2008 per-person direct medical cost of overweight was $266 and of obesity was $1723. The aggregate national cost of overweight and obesity combined was $113.9 billion. Study design factors that affected cost estimates included use of national samples vs. more selected populations, age groups examined, inclusion of all medical costs vs. obesity-related costs only, and body mass index cut-offs for defining overweight and obesity. Depending on the source of total national healthcare expenditures used, the direct medical cost of overweight and obesity combined is approximately 5.0% to 10% of US healthcare spending. Future studies should include nationally representative samples, evaluate adults of all ages, report all medical costs and use standard body mass index cut-offs.

What do international pharmacoeconomic guidelines say about economic data transferability?

OBJECTIVES

The objectives of this article were to assess the positions of the various national pharmacoeconomic guidelines on the transferability (or lack of transferability) of clinical and economic data and to review the methods suggested in the guidelines for addressing issues of transferability.

METHODS

A review of existing national pharmacoeconomic guidelines was conducted to assess recommendations on the transferability of clinical and economic data, whether there are important differences between countries, and whether common methodologies have been suggested to address key transferability issues. Pharmacoeconomic guidelines were initially identified through the ISPOR Web site. In addition, those national guidelines not included in the ISPOR Web site, but known to us, were also considered.

RESULTS

Across 27 sets of guidelines, baseline risk and unit costs were uniformly considered to be of low transferability, while treatment effect was classified as highly transferable. Results were more variable for resource use and utilities, which were considered to have low transferability in 63% and 45% of cases, respectively. There were some differences between older and more recent guidelines in the treatment of transferability issues.

CONCLUSIONS

A growing number of jurisdictions are using guidelines for the economic evaluation of pharmaceuticals. The recommendations in existing guidelines regarding the transferability of clinical and economic data are quite diverse. There is a case for standardization in dealing with transferability issues. One important step would be to update guidelines more frequently.

Estimation and validation of a multiattribute model of Alzheimer disease progression

OBJECTIVES

To estimate and validate a multiattribute model of the clinical course of Alzheimer disease (AD) from mild AD to death in a high-quality prospective cohort study, and to estimate the impact of hypothetical modifications to AD progression rates on costs associated with Medicare and Medicaid services.

DATA AND METHODS

The authors estimated sex-specific longitudinal Grade of Membership (GoM) models for AD patients (103 men, 149 women) in the initial cohort of the Predictors Study (1989-2001) based on 80 individual measures obtained every 6 mo for 10 y. These models were replicated for AD patients (106 men, 148 women) in the 2nd Predictors Study cohort (1997-2007). Model validation required that the disease-specific transition parameters be identical for both Predictors Study cohorts. Medicare costs were estimated from the National Long Term Care Survey.

RESULTS

Sex-specific models were validated using the 2nd Predictors Study cohort with the GoM transition parameters constrained to the values estimated for the 1st Predictors Study cohort; 57 to 61 of the 80 individual measures contributed significantly to the GoM models. Simulated, cost-free interventions in the rate of progression of AD indicated that large potential cost offsets could occur for patients at the earliest stages of AD.

CONCLUSIONS

AD progression is characterized by a small number of parameters governing changes in large numbers of correlated indicators of AD severity. The analysis confirmed that the progression of AD represents a complex multidimensional physiological process that is similar across different study cohorts. The estimates suggested that there could be large cost offsets to Medicare and Medicaid from the slowing of AD progression among patients with mild AD. The methodology appears generally applicable in AD modeling.

Cost-effectiveness of extended buprenorphine-naloxone treatment for opioid-dependent youth: data from a randomized trial

AIMS

The objective is to estimate cost, net social cost and cost-effectiveness in a clinical trial of extended buprenorphine-naloxone (BUP) treatment versus brief detoxification treatment in opioid-dependent youth.

DESIGN

Economic evaluation of a clinical trial conducted at six community out-patient treatment programs from July 2003 to December 2006, who were randomized to 12 weeks of BUP or a 14-day taper (DETOX). BUP patients were prescribed up to 24 mg per day for 9 weeks and then tapered to zero at the end of week 12. DETOX patients were prescribed up to 14 mg per day and then tapered to zero on day 14. All were offered twice-weekly drug counseling.

PARTICIPANTS

152 patients aged 15-21 years.

MEASUREMENTS

Data were collected prospectively during the 12-week treatment and at follow-up interviews at months 6, 9 and 12.

FINDINGS

The 12-week out-patient study treatment cost was $1514 (P < 0.001) higher for BUP relative to DETOX. One-year total direct medical cost was only $83 higher for BUP (P = 0.97). The cost-effectiveness ratio of BUP relative to DETOX was $1376 in terms of 1-year direct medical cost per quality-adjusted life year (QALY) and $25,049 in terms of out-patient treatment program cost per QALY. The acceptability curve suggests that the cost-effectiveness ratio of BUP relative to DETOX has an 86% chance of being accepted as cost-effective for a threshold of $100,000 per QALY.

CONCLUSIONS

Extended BUP treatment relative to brief detoxification is cost effective in the US health-care system for the outpatient treatment of opioid-dependent youth.

Pattern and predictors of the initiation of biologic agents for the treatment of rheumatoid arthritis in the United States: an analysis using a large observational data bank

OBJECTIVE

The aim of this study was to identify factors associated with the initiation of biologic agents for the treatment of rheumatoid arthritis (RA) in a large US observational cohort.

METHODS

Semiannual patient-reported data in the ARAMIS (Arthritis, Rheumatism and Aging Medical Information System) data bank from January 1998 to January 2006 were analyzed retrospectively using pooled logistic regression (with adjustment for center-level and temporal effects) to identify patient-, disease-, and treatment-related characteristics associated with the initiation of biologics for the treatment of RA.

RESULTS

The analysis included 1545 patients from 7 US centers. By 2006, 41.4% of 679 patients remaining in the sample had received biologics. Initiation of biologics was significantly associated with greater disability in the previous 6-month period (per 1-unit increase in Health Assessment Questionnaire score: odds ratio [OR] = 1.45; 95% CI, 1.22-1.72; P < 0.01) and treatment in the previous period with steroids (OR = 2.24; 95% CI, 1.76-2.85; P < 0.01) or nonbiologic disease-modifying antirheumatic drugs (OR = 2.43; 95% CI, 1.71-3.46; P < 0.01). Two sociodemographic factors were significant predictors of decreased use of biologics: older age (per 10 years: OR = 0.74; 95% CI, 0.660.82; P < 0.01) and lower annual income (per $10,000 reduction: OR = 0.95; 95% CI, 0.91-1.00; P = 0.04). There were no significant differences with respect to sex, race, employment status, comorbidity, previous NSAID use, or treatment center.

CONCLUSIONS

Disease- and treatment-related factors were significant predictors of the initiation of biologics for RA. Independent of these factors, however, biologics were less often used in patients who were older and those with lower incomes. Use of biologics increased steadily over the period studied.

Transferability of economic evaluations across jurisdictions: ISPOR Good Research Practices Task Force report

ABSTRACT A growing number of jurisdictions now request economic data in support of their decision-making procedures for the pricing and/or reimbursement of health technologies. Because more jurisdictions request economic data, the burden on study sponsors and researchers increases. There are many reasons why the cost-effectiveness of health technologies might vary from place to place. Therefore, this report of an ISPOR Good Practices Task Force reviews what national guidelines for economic evaluation say about transferability, discusses which elements of data could potentially vary from place to place, and recommends good research practices for dealing with aspects of transferability, including strategies based on the analysis of individual patient data and based on decision-analytic modeling.

A randomized, controlled trial of financial incentives for smoking cessation

BACKGROUND

Smoking is the leading preventable cause of premature death in the United States. Previous studies of financial incentives for smoking cessation in work settings have not shown that such incentives have significant effects on cessation rates, but these studies have had limited power, and the incentives used may have been insufficient.

METHODS

We randomly assigned 878 employees of a multinational company based in the United States to receive information about smoking-cessation programs (442 employees) or to receive information about programs plus financial incentives (436 employees). The financial incentives were $100 for completion of a smoking-cessation program, $250 for cessation of smoking within 6 months after study enrollment, as confirmed by a biochemical test, and $400 for abstinence for an additional 6 months after the initial cessation, as confirmed by a biochemical test. Individual participants were stratified according to work site, heavy or nonheavy smoking, and income. The primary end point was smoking cessation 9 or 12 months after enrollment, depending on whether initial cessation was reported at 3 or 6 months. Secondary end points were smoking cessation within the first 6 months after enrollment and rates of participation in and completion of smoking-cessation programs.

RESULTS

The incentive group had significantly higher rates of smoking cessation than did the information-only group 9 or 12 months after enrollment (14.7% vs. 5.0%, P<0.001) and 15 or 18 months after enrollment (9.4% vs. 3.6%, P<0.001). Incentive-group participants also had significantly higher rates of enrollment in a smoking-cessation program (15.4% vs. 5.4%, P<0.001), completion of a smoking-cessation program (10.8% vs. 2.5%, P<0.001), and smoking cessation within the first 6 months after enrollment (20.9% vs. 11.8%, P<0.001).

CONCLUSIONS

In this study of employees of one large company, financial incentives for smoking cessation significantly increased the rates of smoking cessation. (ClinicalTrials.gov number, NCT00128375.)

Age inconsistency in the American Academy of Pediatrics guidelines for acute otitis media

OBJECTIVE

The American Academy of Pediatrics acute otitis media guidelines could reduce antibiotic use. The objective was to compare strategies for diagnosing and treating otitis: (1) a commonly used, 2-criteria strategy, (2) the guidelines' 3-criteria algorithm, and (3) initially watching without antibiotics.

METHODS

A decision analysis was performed with literature-based parameter. The target population was children presenting to primary care physicians with possible otitis media. Main outcomes were antibiotic use, sick days, mild adverse drug events, and number needed to treat/avoided sick day.

RESULTS

For children 2 to <6 months of age, compared with the 2-criteria strategy, guideline use predicted 21% less antibiotic use, 13% more sick days, and 23% fewer adverse drug events; the number needed to treat for the 2-criteria strategy versus the American Academy of Pediatrics strategy was 1.2 children per avoided sick day. For children 6 to <24 months of age, guideline use, compared with the 2-criteria strategy, predicted 26% less antibiotic use, 14% more sick days, and 28% fewer adverse drug events; the number needed to treat for the 2-criteria strategy versus the American Academy of Pediatrics strategy was 1.4 children per avoided sick day. For children >2 years of age, guideline use, compared with the 2-criteria strategy, predicted 67% less antibiotic use, 4% more sick days, and 68% fewer adverse drug events. The number needed to treat for the guideline strategy versus the watch strategy was 6.3 children per avoided sick day; that for the 2-criteria strategy versus the guideline strategy was 12.3. Guideline use for children <2 years implies that our number needed to treat to avoid a sick day is <1.4; for children >2, guideline use implies we are willing to treat at least 6.3 children to avoid a sick day. Thus, the guidelines imply a greater willingness to treat older children, compared with younger children.

CONCLUSIONS

The American Academy of Pediatrics guidelines are inconsistent in their outcomes across age groups. Guideline implementation under age 2 reduces antibiotic use but at a relatively heavy cost of sick days and parental missed work days. This trade-off may be particularly unfavorable for working parents, who might reasonably prefer greater antibiotic use.

A critical comparison of clinical decision instruments for computed tomographic scanning in mild closed traumatic brain injury in adolescents and adults

STUDY OBJECTIVE

A number of clinical decision aids have been introduced to limit unnecessary computed tomographic scans in patients with mild traumatic brain injury. These aids differ in the risk factors they use to recommend a scan. We compare the instruments according to their sensitivity and specificity and recommend ones based on incremental benefit of correctly classifying patients as having surgical, nonsurgical, or no intracranial lesions.

METHODS

We performed a secondary analysis of prospectively collected database from 7,955 patients aged 10 years or older with mild traumatic brain injury to compare sensitivity and specificity of 6 common clinical decision strategies: the Canadian CT Head Rule, the Neurotraumatology Committee of the World Federation of Neurosurgical Societies, the New Orleans, the National Emergency X-Radiography Utilization Study II (NEXUS-II), the National Institute of Clinical Excellence guideline, and the Scandinavian Neurotrauma Committee guideline. Excluded from the database were patients for whom the history of trauma was unclear, the initial Glasgow Coma Scale score was less than 14, the injury was penetrating, vital signs were unstable, or who refused diagnostic tests. Patients revisiting the emergency department within 7 days were counted only once.

RESULTS

The percentage of scans that would have been required by applying each of the 6 aids were Canadian CT head rule (high risk only) 53%, Canadian (medium & high risk) 56%, the Neurotraumatology Committee of the World Federation of Neurosurgical Societies 56%, New Orleans 69%, NEXUS-II 56%, National Institute of Clinical Excellence 71%, and the Scandinavian 50%. The 6 decision aids' sensitivities for surgical hematomas could not be distinguished statistically (P>.05). Sensitivity was 100% (95% confidence interval [CI] 96% to 100%) for NEXUS-II, 98.1% (95% CI 93% to 100%) for National Institute of Clinical Excellence, and 99.1% (95% CI 94% to 100%) for the other 4 clinical decision instruments. Sensitivity for any intracranial lesion ranged from 95.7% (95% CI 93% to 97%) (Scandinavian) to 100% (95% CI 98% to 100%) (National Institute of Clinical Excellence). In contrast, specificities varied between 30.9% (95% CI 30% to 32%) (National Institute of Clinical Excellence) and 52.9% (95% CI 52% to 54) (Scandinavian).

CONCLUSION

NEXUS-II and the Scandinavian clinical decision aids displayed the best combination of sensitivity and specificity in this patient population. However, we cannot demonstrate that the higher sensitivity of NEXUS-II for surgical hematomas is statistically significant. Therefore, choosing which of the 2 clinical decision instruments to use must be based on decisionmakers' attitudes toward risk.

Clinical trial-based cost-effectiveness analyses of antipsychotic use

OBJECTIVE

Second-generation antipsychotics make up one of the fastest growing segments of the rapidly growing pharmaceutical sector. Given limited health care resources, assessment of the value for the cost of second-generation antipsychotics relative to first-generation antipsychotics is critical for resource-allocation decisions.

METHOD

With a MEDLINE search, the authors identified eight studies (based on six randomized clinical trials) that analyzed the cost-effectiveness of second-generation antipsychotics relative to first-generation antipsychotics in individuals with schizophrenia disorders. The authors reviewed appropriate methods of measurement, analysis, and design of cost-effectiveness studies in randomized clinical trials and evaluated the validity of economic results derived from the studies in light of appropriate methods.

RESULTS

The eight randomized clinical trial-based cost-effectiveness studies of antipsychotic medications faced a variety of threats to validity related to 1) measurement of costs, 2) measurement of effectiveness, 3) analysis of costs, 4) measurement of sampling uncertainty, 5) analysis of incomplete cost data, 6) minimizing loss to follow-up, and 7) threats to external validity.

CONCLUSIONS

Economic claims made by the authors of a number of trial-based economic evaluations have generally been favorable to second-generation antipsychotics. However, the methodological issues the authors of the current study identified suggest that there is no clear evidence that atypical antipsychotics generate cost savings or are cost-effective in general use among all schizophrenia patients. Psychiatrists, researchers, and administrators should consider the methodological issues highlighted in interpreting study results. These issues should be addressed in future trial designs.

Analyses of cost data in economic evaluations conducted alongside randomized controlled trials

OBJECTIVE

The adoption and diffusion of new medical treatments depend increasingly on evidence of costs and cost-effectiveness. This evidence is increasingly being generated from economic data collected in randomized clinical trials. The objective of this article is to evaluate the statistical methods used for analysis of cost data in economic evaluations conducted alongside randomized controlled trials.

METHODS

Systematic review of economic evaluations based on patient-level cost or resource-use data collected in randomized trials was published in 2003. One hundred fifteen articles were identified from the MEDLINE database. The use of statistical methods for 1) joint comparison of costs and effects and assessment of stochastic uncertainty, 2) incremental cost estimation, and 3) handling of incomplete or censored cost data was evaluated.

RESULTS

Only 42 (37%) of the 115 economic evaluations presented a cost-effectiveness ratio or estimated net benefits and 24 (57%) of these reported the uncertainty of this statistic. A comparison of costs alone was more common with 92 (80%) of the 115 studies statistically comparing costs between treatment groups. Of these, about two-thirds (62; 68%) used at least one statistical test appropriate for drawing inferences for arithmetic means. Incomplete cost data were reported in 67 (58%) studies with only two using a published statistical approach for handling censored cost data.

CONCLUSION

The quality of statistical methods used in economic evaluations conducted alongside randomized controlled trials was poor in the majority of studies published in 2003. Adoption of appropriate statistical methods is required before the results from such studies can consistently provide valid information to decision-makers.

Indications for CT Scanning in Mild Traumatic Brain Injury: A Cost-Effectiveness Study

BACKGROUND

There is considerable uncertainty about the indications for cranial computed tomography (CT) scanning in patient with minor traumatic brain injury (TBI). This analysis involves an evidence-based comparison of several strategies for selecting patients for CT with regard to effectiveness and cost.

METHODS

We performed a structured literature review of mild traumatic brain injury and constructed a cost-effectiveness model. The model estimated the impact of missed intracranial lesions on longevity, quality of life and costs. Using a 20-year-old patient for primary analysis, we compared the following strategies to screen for the need to perform a CT scan: observation in the emergency department or hospital floor, skull radiography, Selective CT based on the presence of additional risk factors and scanning all.

RESULTS

Outcome measures for each strategy included average years of life, quality of life and costs. Selective CT and the CT All policy performed significantly better than the alternatives with respect to outcome. They were also less expensive in terms of total direct health care costs, although the differences did not reach statistical significance. The model yielded similar, but smaller, differences between the selective imaging and other strategies when run for older patients.

CONCLUSIONS

Although the incidence of intracranial lesions, especially those that require surgery, is low in mild TBI, the consequences of delayed diagnosis are forbidding. Adverse outcome of an intracranial hematoma is so costly that it more than balances the expense of CT scans. In our cost-effectiveness model, the liberal use of CT scanning in mild TBI appears justified.

The Role of Risk Stratification in the Decision to Provide Upstream Versus Selective Glycoprotein IIb/IIIa Inhibitors for Acute Coronary Syndromes

OBJECTIVES

We endeavored to determine under what conditions a strategy of upstream use of small molecule platelet glycoprotein (GP) IIb/IIIa inhibitors for all acute coronary syndromes (ACS) patients is cost effective compared to that of selective use of abciximab in only those patients requiring percutaneous coronary intervention (PCI).

BACKGROUND

Small molecule GP IIb/IIIa inhibitors have shown benefit in ACS, but abciximab, the more expensive GP IIb/IIIa inhibitor, may be more effective during PCI. However, abciximab does not have proven efficacy in medical management. No prior study has attempted to balance these competing benefits.

METHODS

A decision analysis was performed to examine two strategies: 1) treat all ACS patients upstream with a small molecule GP IIb/IIIa inhibitor and continue through medical management and PCI, if performed; or 2) wait, and selectively use abciximab only in patients who ultimately undergo PCI. Applicable randomized controlled trial data were used for the principal analysis.

RESULTS

The strategy of upstream use of a small molecule GP IIb/IIIa inhibitor was superior to selective use, and economically acceptable, with a cost-effectiveness ratio of 18,000 dollars per year of life gained. The superiority of the upstream use strategy persisted over the majority of sensitivity analyses. When stratified by risk according to Thrombolysis in Myocardial Infarction risk score, a strategy of upstream use was only cost effective in those patients with moderate or high risk.

CONCLUSIONS

Upstream use of small molecule GP IIb/IIIa inhibition in ACS patients with moderate or high risk for cardiovascular events is a cost-effective approach that should be considered in this subset of patients.

Cost-effectiveness of a low-carbohydrate diet and a standard diet in severe obesity

OBJECTIVE

Low-carbohydrate diets have become a popular alternative to standard diets for weight loss. Our aim was to compare the cost-effectiveness of these two diets.

RESEARCH METHODS AND PROCEDURES

The patient population included 129 severely obese subjects (BMI = 42.9) from a randomized trial; participants had a high prevalence of diabetes or metabolic syndrome. We compared within-trial costs, quality-adjusted life years (QALYs), and the incremental cost-effectiveness ratio (CER) for the two study groups. We imputed missing values for QALYs. The CER was bootstrapped to derive 95% confidence intervals and to define acceptability cut-offs. We took a societal perspective for our analysis.

RESULTS

Total costs during the one year of the trial were 6742 dollars +/- 6675 and 6249 dollars +/- 5100 for the low-carbohydrate and standard groups, respectively (p = 0.78). Participants experienced 0.64 +/- 0.02 and 0.61 +/- 0.02 QALYs during the one year of the study, respectively (p = 0.17 for difference). The point estimate of the incremental CER was -1225 dollars/QALY (i.e., the low-carbohydrate diet dominated the standard diet). However, in the bootstrap analysis, the wide spread of CERs caused the 95% confidence interval to be undefined. The probabilities that the low-carbohydrate diet was acceptable, using cut-offs of 50,000 dollars/QALY, 100,000 dollars/QALY, and 150,000 dollars/QALY, were 72.4% 78.6%, and 79.8%, respectively.

DISCUSSION

The low-carbohydrate diet was not more cost-effective for weight loss than the standard diet in the patient population studied. Larger studies are needed to better assess the cost-effectiveness of dietary therapies for weight loss.

Medicare Coverage of Tumor Necrosis Factor α Inhibitors as an Influence on Physicians’ Prescribing Behavior

BACKGROUND

Rheumatoid arthritis is a chronic debilitating disease that affects 1% of the population. Tumor necrosis factor alpha inhibitors, such as etanercept and infliximab, have revolutionized the treatment of rheumatoid arthritis by averting disability but at great financial expense, generally borne by third-party payors. Prior to implementation of the Medicare Modernization Act, Medicare reimbursed for the infusion drug infliximab but not for the self-injectable drug etanercept. To determine the impact of this differential Medicare drug coverage on physicians' prescribing behavior in clinical practice, we analyzed patterns of prescribing etanercept and infliximab for patients with rheumatoid arthritis who had public insurance compared with those who had private insurance.

METHODS

We conducted an observational cohort study of 1663 patients with rheumatoid arthritis newly prescribed etanercept or infliximab after enrollment in the National Databank for Rheumatic Diseases. Univariate and multivariable analyses of patient demographic and disease characteristics were conducted to characterize predictors of the biologic drug prescribed.

RESULTS

Treatment groups who received etanercept and infliximab differed in 6 of 8 demographic variables and in 8 of 10 disease variables. However, stratification by type of insurance reduced many of these differences. In multivariable analyses, type of insurance plan and demographic factors were strong predictors of differential prescribing of etanercept compared with prescribing of infliximab, whereas disease characteristics generally were not. Patients with public insurance were 30% more likely to receive infliximab than those who were privately insured (P<.001).

CONCLUSIONS

Public insurance predicted prescription of infliximab, reflecting preferential Medicare reimbursement for infusion drugs. Financial considerations are influential in physicians' prescription decisions. Differential drug coverage has an impact on patient care and health care costs because it influences physicians' prescribing behavior.

Conducting economic evaluations alongside multinational clinical trials: toward a research consensus

Demand for economic evaluations in multinational clinical trials is increasing, but there is little consensus about how such studies should be conducted and reported. At a workshop in Durham, North Carolina, we sought to identify areas of agreement about how the primary findings of economic evaluations in multinational clinical trials should be generated and presented. In this paper, we propose a framework for classifying multinational economic evaluations according to (a) the sources of an analyst's estimates of resource use and clinical effectiveness and (b) the analyst's method of estimating costs. We review existing studies in the cardiology literature in the context of the proposed framework. We then describe important methodological and practical considerations in conducting multinational economic evaluations and summarize the advantages and disadvantages of each approach. Finally, we describe opportunities for future research. Delineation of the various approaches to multinational economic evaluation may assist researchers, peer reviewers, journal editors, and decision makers in evaluating the strengths and limitations of particular studies.

Clinical nurse specialist care managers' time commitments in a disease-management program for bipolar disorder

OBJECTIVES

As part of a cost-effectiveness analysis for Department of Veterans Affairs Cooperative Studies Program #430, 'Reducing the Efficacy-Effectiveness Gap in Bipolar Disorder,' we conducted a time and motion study to quantify the time psychiatric clinical nurse specialist (CNS) care managers spent providing care for patients.

METHODS

Clinical nurse specialist care managers completed activity logs in which they recorded time spent implementing the Bipolar Disorders Program (BDP) during a 1-week period in spring, summer, fall and winter over a 1-year period when caseloads were at steady state. Mean service time was estimated by use of univariate analysis of means and by multivariable regression analysis.

RESULTS

On average CNS care managers spent 40% of their clinical time in activities that typically are reimbursed (e.g. clinic visits) and spent the remaining 60% of their time in activities that are typically unreimbursed. Total clinic time increased as the number of visits per day increased; however, this increase got smaller with each additional visit per day.

CONCLUSIONS

As with other chronic illness management programs, CNS care managers expend a substantial portion of their clinical effort for the BDP in activities that are typically unreimbursed. Their activities have a fixed component per day as well as a component that systematically varies with the number of visits per day. These findings should be considered when costing out and disseminating psychiatric and other medical chronic illness management programs.

A manic-depressive symptom self-report in optical scanable format

INTRODUCTION

The Internal State Scale (ISS) is a self-report instrument that allows the simultaneous assessment of both manic and depressive symptoms in individuals with manic-depressive disorder. Prior work indicates that subscales are highly correlated with clinician ratings of mania and depression and provide a discriminant function that identifies individuals in manic/hypomanic, mixed, depressed, and euthymic mood states. A drawback to the ISS is that its items were developed in the visual analogue scale (VAS) format which is labor-intensive to score, particularly with repeat (e.g. daily) administration. A Likert-based format would allow quick and easy optical scanning for which scoring could be automated.

METHODS

To compare discriminating properties in Likert versus VAS format we re-analyzed previously collected data and collected new data: (a) VAS-based ISS scores from 86 subjects from a prior four-site study were re-analyzed by collapsing scores into 20 and then 10 Likert-based bins to assess loss of precision from collapsing scores, and (b) 24 additional subjects were administered the ISS in VAS and Likert formats to assess loss of precision due to instrument completion factors.

RESULTS

Discriminant ability, including kappas and receiver operator characteristic curves, were unchanged across the two formats. Within-subjects reliability was uniformally high across formats.

CONCLUSIONS

Likert-based scoring of the ISS can be used without loss of precision, thus making automated scoring of the ISS feasible. This format will be particularly useful for studies that require processing of large numbers of ISSs, such as those that collect frequent ratings over long periods of time and/or those that utilize large samples.

Factors affecting decisions to seek treatment for sick children in Kerala, India

The purpose of this study was to measure the effects of social and economic variables, disease-related variables, and child gender on the decisions of parents in Kerala, India, to seek care for their children and on their choice of providers in the allopathic vs. the alternative system. A case-control analysis was done using data from the Kerala section of the 1996 Indian National Family Health Survey, a cross-sectional survey of a probability sample of households conducted by trained interviewers with a close-ended questionnaire. Of the 469 children who were eligible for this study because they had at least one common symptom suggestive of acute respiratory illness or diarrhea during the 2 weeks before the interview, 78 (17%) did not receive medical care, while the remaining 391 (83%) received medical care. Of the 391 children who received medical care, 342 (88%) received allopathic medical care, and 48 (12%) received alternative medical care. In multivariable analyses, parents chose not to seek medical care for their children significantly more often when the illness was mild, the child had a specific diagnosis, the mother had previously made fewer antenatal visits, and the family had a higher economic status. When parents sought medical care for their children, care was sought significantly more often in the alternative provider system when the child was a boy, the family lived in a rural area, and the family had a lower social class. We conclude that, in Kerala, disease severity and economic status predict whether children with acute respiratory infection or diarrhea are taken to medical providers. In contrast, most studies of this issue carried out in other populations have identified economic status as the primary predictor of medical system utilization. Also in Kerala, the gender of the child did not influence whether or not the child was taken for treatment but did influence whether care was sought in the alternative or the allopathic system.

Design and analysis of unit cost estimation studies: How many hospital diagnoses? How many countries?

We evaluated three questions that commonly arise when unit costing exercises for multinational trials are conducted: (1). In countries where investigators plan to collect hospital unit cost estimates for a selected set of diagnoses, how should one estimate unit costs for the remaining diagnoses observed in the trial for which cost data were not collected? (2). For how many hospital diagnoses should estimates be obtained? (3). For how many countries should they be obtained? We addressed these questions using unit cost data collected in four western European countries and three relative value measures from the US Medicare diagnosis-related group (DRG) payment system. We found that the arithmetic mean length of stay from the US DRG payment system was a good predictor of unit costs in four countries in Europe. We also found that the imputation error decreased as the number of hospital diagnoses and countries sampled increased, but that the rate of reduction in error shrank. Finally, we found that - given the existence of a reliable method for cost imputation - from a pure information standpoint, it is better to obtain estimates for fewer hospital diagnoses from more countries than the reverse.

Economic evaluation of breast cancer treatment: considering the value of patient choice

PURPOSE

To use 5 years of primary data to compare the incremental cost-effectiveness of breast conservation and radiation versus mastectomy with the restriction of choice to a single therapy versus providing a choice of either therapy.

PATIENTS AND METHODS

We evaluated a random retrospective cohort of 2,517 Medicare beneficiaries treated for newly diagnosed stage I or II breast cancer from 1992 through 1994. The outcome measures were quality-adjusted life-years (QALYs) and 5-year medical costs. Risk and propensity score adjustments were used in the analysis.

RESULTS

A breast conservation and radiation regimen has significantly higher costs than mastectomy in the first year after surgery; the adjusted 5-year costs are $14,054 (95% confidence interval, $9,791 to $18,312) greater than those of mastectomy. The adjusted incremental cost-effectiveness ratio comparing breast conservation and radiation to mastectomy was $219,594 per QALY for the comparison of the two strategies. If the possibility of patient choice from maintaining the availability of multiple treatments versus restricting choice to mastectomy alone provides a quality-of-life gain of 0.031 QALYs, then the cost-effectiveness ratio of this choice option is $80,440 per QALY.

CONCLUSION

The current system of providing a choice between mastectomy and breast conservation surgery is economically attractive when the economic analysis includes the benefit of patient choice of treatment.

Economic analysis of conventional-dose chemotherapy compared with high-dose chemotherapy plus autologous hematopoietic stem-cell transplantation for metastatic breast cancer

We performed an economic analysis of data from 180 women in a clinical trial of conventional-dose chemotherapy vs high-dose chemotherapy plus stem-cell transplantation for metastatic breast cancer responding to first-line chemotherapy. Data on resource use, including hospitalizations, medical procedures, medications, and diagnostic tests, were abstracted from subjects' clinical trial records. Resources were valued using the Medicare Fee Schedule for inpatient costs at one academic medical center and average wholesale prices for medications. Monthly costs were calculated and stratified by treatment group and clinical phase. Mean follow-up was 690 days in the transplantation group and 758 days in the conventional-dose chemotherapy group. Subjects in the transplantation group were hospitalized for more days (28.6 vs 17.8, P=0.0041) and incurred higher costs (US dollars 84055 vs US dollars 28169) than subjects receiving conventional-dose chemotherapy, with a mean difference of US dollars 55886 (95% CI, US dollars 47298-US dollars 63666). Sensitivity analyses resulted in cost differences between the treatment groups from US dollars 36528 to US dollars 75531. High-dose chemotherapy plus stem-cell transplantation resulted in substantial additional morbidity and costs at no improvement in survival. Neither the survival results nor the economic findings support the use of this procedure outside of the clinical trial setting.

Effects of linezolid on hospital length of stay compared with vancomycin in treatment of methicillin-resistant Staphylococcus infections. An application of multivariate survival analysis

OBJECTIVES

This study was designed to estimate the effects of treatment with linezolid as compared with vancomycin, on the distribution of length of stay (LOS) for hospitalized patients with methicillin-resistant staphylococcal infections. Treatment with intravenous-oral linezolid may allow some patients to be discharged earlier than would treatment with intravenous vancomycin.

METHODS

The analysis is based on the intention-to-treat sample from a randomized multinational phase 3 clinical trial of 460 patients showing that the treatments had equal efficacy. Given the nature of the LOS data, some censoring, and some imbalances between treatment groups, multivariate survival analysis was indicated. Cox proportional hazards assumptions were tested and failed, and accelerated failure time models were tested for best fit. The log-logistic model was selected and used as the basis for estimating the overall treatment effect on LOS. Two methods for multivariate corrections to the survivorship functions allowed more thorough description of the treatment effect on the distribution of LOS, including multivariate-adjusted Kaplan-Meier curves.

RESULTS

The average reduction in LOS associated with linezolid treatment, based on the log-logistic model after correction for covariate effects, was 18.1% (p = .041) or 2.53 days at the median. This was consistent with differences at the medians of the adjusted survivorship functions, which were 2 or 3 days depending on the method used. Treatment-based differences exist at each decile of LOS and consistently favor linezolid. Estimated mean reduction in LOS due to linezolid was 1.62 days in both methods.

CONCLUSIONS

In this study sample, linezolid treatment resulted in statistically significantly shorter hospital LOS as compared with vancomycin treatment. Appropriate use of multivariate survival analysis allows better examination of the nature of the treatment effect on LOS, which may be important for economic analysis.

Preference-based quality-of-life in patients with Parkinson's disease

BACKGROUND

Preference-based instruments are a specific type of health-related quality-of-life scale designed to measure the relative value of health. Because of this property, they are the appropriate measures of quality of life for cost-effectiveness analysis. Although preference-based scales are widely used, their validity has rarely been tested in specific patient groups.

OBJECTIVES

To assess quality of life using preference-based scales in a group of patients with PD and to compare these scores with measures of clinical severity and traditional quality of life.

METHODS

Each patient was rated using the Disability and Distress Index (DDI), the Euroqol System (EQ-5D), and the Health Utilities Index Mark II (HUI). Clinical severity was measured using the Unified PD Rating Scale (UPDRS) and PD Questionnaire-39 (PDQ-39) quality-of-life instrument. Results from preference-based instruments were compared with each other and with clinical measures of disease severity.

RESULTS

One hundred subjects participated in the study, and 97 completed all preference-based instruments. Scores from all three instruments correlated well with the UPDRS and most domains of the PDQ-39. The mean scores for the DDI, HUI, and EQ-5D were 0.92 (range 0 to 1), 0.74 (range 0.19 to 1), and 0.58 (range -0.429 to 1). Differences between mean scores for the instruments were significant.

CONCLUSIONS

In the sample of patients with PD, the Disability and Distress Index, Euroqol System, and the Health Utilities Index Mark II correlate well with measures of disease severity and quality of life. However, they give strikingly different values. When applied in cost-effectiveness analysis, these discrepancies could result in substantially different cost-effectiveness ratios for PD-related interventions.

Decision-analytic model and cost-effectiveness evaluation of postmastectomy radiation therapy in high-risk premenopausal breast cancer patients

PURPOSE

To present a decision model that describes the clinical and economic outcomes of node-positive breast cancer with and without postmastectomy radiation therapy (PMRT).

METHODS

A Markov process was constructed to project the natural history of breast cancer following mastectomy in premenopausal node-positive women. Biannual hazards of local and distant recurrence without PMRT were derived from a large meta-analysis of adjuvant systemic therapy trials for breast cancer. The addition of PMRT reduced the risk of disease relapse by an odds ratio of 0.69. Costs of PMRT ($11,600) and recurrent breast cancer ($4,250 to 16,200/year) were estimated from available literature. The model projected number of recurrences, relapse-free and overall survival, and costs to 15 years, using a discount rate of 3%. Cost-effectiveness ratios were calculated per incremental year of life and quality-adjusted year of life gained. One- and two-way sensitivity analyses were performed to determine the sensitivity of results to clinical and economic assumptions.

RESULTS

The model projected 15-year relapse-free survival of 52% and 43% with and without PMRT, respectively. Overall survival was increased from 48% to 55% with PMRT, resulting in an incremental 0.29 years of life gained per subject. PMRT increased 15-year costs from $40,800 to $48,100. Cost per year of life gained was $24,900, or $22,600 when survival was adjusted for quality of life. Results of the model were relatively sensitive to radiation therapy cost and breast cancer relapse risk.

CONCLUSION

This analysis suggests that PMRT offers substantial clinical benefits achieved in a cost-effective manner, with an average cost per year of life gained of $24,900. Results of the model were robust under a wide range of clinical and economic parameters.

Approaches to analysis of length of hospital stay related to antibiotic therapy in a randomized clinical trial: linezolid versus vancomycin for treatment of known or suspected methicillin-resistant Staphylococcus species infections

As length of hospital stay (LOS) represents about 70-90% of the total cost of treating serious infections, it represents a key variable in analyzing the health economic differences between treatments for hospitalized patients. In a retrospective analysis using LOS data from a multinational, randomized, phase III clinical trial, we examined two methods (the log-logistic model and Kaplan-Meier survival function) and three approaches (unadjusted total LOS, total LOS adjusted for nontreatment factors, and adjusted LOS based on antibiotic treatment [the antibiotic treatment LOS]) for estimating antibiotic treatment effect on LOS and determined if these approaches could reduce the variation in LOS and control for the imbalance between treatment groups. The trial enrolled patients who were hospitalized with known or suspected Staphylococcus species infections who received at least one dose of linezolid or vancomycin (intent-to-treat sample) and who continued taking the study drug for at least 7 days (clinically evaluable sample). In the intent-to-treat sample, the linezolid group had a 2- (unadjusted) or 4-day (adjusted for nontreatment factors) shorter LOS at the 25th percentile; a 1- or 2-day advantage, respectively, at the 50th percentile (median); and a 0.6- or 1.6-day mean LOS advantage, compared with the vancomycin group. With the antibiotic treatment LOS approach, the linezolid group had mean and median LOS reductions comparable to or greater than those seen in the nontreatment-factor-adjusted results. Results for the clinically evaluable sample were similar to those of the intent-to-treat sample, but the differences between the treatment groups were greater. Linezolid-treated patients had significant LOS reductions that otherwise would be masked without the use of more appropriate, but less commonly used, methods.

Duration of therapy and health care costs of fluoxetine, paroxetine, and sertraline in 6 health plans

BACKGROUND

Previous studies comparing fluoxetine, paroxetine, and sertraline, the 3 most common selective serotonin reuptake inhibitors (SSRIs), in naturalistic settings have produced conflicting results. With this study, we provide new evidence as to the similarities and differences among these SSRI therapies with respect to the duration of use and health care costs.

METHOD

Data from 6 health maintenance organizations were used to identify patients with new-onset major depression. number of days with filled prescriptions, and total health care and depression-related costs. The sample consisted of 1771 patients given initial prescriptions for sertraline (N = 386), fluoxetine (N = 840), or paroxetine (N = 545) in the period from July 1, 1994, to March 31, 1997. Analyses included Cox proportional hazards models (for duration of initial therapy) and ordinary least squares regression (for cost).

RESULTS

Patients who initiated therapy with fluoxetine were more likely to have a later interruption of therapy than patients who initiated therapy with sertraline (p = .03) and paroxetine (p = .001). Total 1-year costs did not differ statistically between the treatment groups, but 1-year depression-related costs were significantly lower for patients who initiated therapy with sertraline or paroxetine than for those who initiated therapy with fluoxetine ($332 less for sertraline, 95% confidence interval [CI] = $125 to $562; $339 less for paroxetine, 95% CI = $144 to $416).

LIMITATIONS

A limitation of this observational study, as well as of observational studies in general, is that unobserved characteristics of the patients may lead to biased estimates of the impact of treatment on adherence or cost, even with controls for observed characteristics.

CONCLUSION

We found no significant differences in total health care costs among the 3 SSRIs, but noted significant differences in depression-related costs (the costs of fluoxetine are greater than those of sertraline and paroxetine). Importantly, there was no relationship between treatment interruption and increased health care or depression-related costs, in contrast to the findings of some, but not all, prior studies.