Economic analyses of the Be Fit Be Well program: a weight loss program for community health centers

A Systematic Review of the Evidence for Non-surgical Weight Management for Adults with Severe Obesity: What is Cost Effective and What are the Implications for the Design of Health Services?

PURPOSE OF REVIEW

Severe obesity (BMI ≥ 35 kg/m²) increases premature mortality and reduces quality-of-life. Obesity-related disease (ORD) places substantial burden on health systems. This review summarises the cost-effectiveness evidence for non-surgical weight management programmes (WMPs) for adults with severe obesity.

RECENT FINDINGS

Whilst evidence shows bariatric surgery is often cost-effective, there is no clear consensus on the cost-effectiveness of non-surgical WMPs. Thirty-two studies were included. Most were short-term evaluations that did not capture the long-term costs and consequences of ORD. Decision models often included only a subset of relevant ORDs, and made varying assumptions about the rate of weight regain over time. A lack of sensitivity analyses limited interpretation of results. Heterogeneity in the definition of WMPs and usual care prevents formal evidence synthesis. We were unable to establish the most cost-effective WMPs. Addressing these limitations may help future studies provide more robust cost-effectiveness evidence for decision makers.

Frailty as a Superior Predictor of Dysphagia and Surgically Placed Feeding Tube Requirement After Anterior Cervical Discectomy and Fusion Relative to Age

Frailty is a measure of physiological reserve that has been demonstrated to be a discriminative predictor of worse outcomes across multiple surgical subspecialties. Anterior cervical discectomy and fusion (ACDF) is one of the most common neurosurgical procedures in the United States and has a high incidence of postoperative dysphagia. To determine the association between frailty and dysphagia after ACDF and compare the predictive value of frailty and age. 155,300 patients with cervical stenosis (CS) who received ACDF were selected from the 2016-2019 National Inpatient Sample (NIS) utilizing International Classification of Disease, tenth edition (ICD-10) codes. The 11-point modified frailty index (mFI-11) was used to stratify patients based on frailty: mFI-11 = 0 was robust, mFI-11 = 1 was prefrail, mFI-11 = 2 was frail, and mFI-11 = 3 + was characterized as severely frail. Demographics, complications, and outcomes were compared between frailty groups. A total of 155,300 patients undergoing ACDF for CS were identified, 33,475 (21.6%) of whom were frail. Dysphagia occurred in 11,065 (7.1%) of all patients, and its incidence was significantly higher for frail patients (OR 1.569, p < 0.001). Frailty was a risk factor for postoperative complications (OR 1.681, p < 0.001). Increasing frailty and undergoing multilevel ACDF were significant independent predictors of negative postoperative outcomes, including dysphagia, surgically placed feeding tube (SPFT), prolonged LOS, non-home discharge, inpatient death, and increased total charges (p < 0.001 for all). Increasing mFI-11 score has better prognostic value than patient age in predicting postoperative dysphagia and SPFT after ACDF.

Using Innovation-Corps (I-Corps™) Methods to Adapt a Mobile Health (mHealth) Obesity Treatment for Community Mental Health Settings

Background

We employed Innovation Corps (I-Corps™) methods to adaptation of a mobile health (mHealth) short-message-system (SMS) -based interactive obesity treatment approach (iOTA) for adults with severe mentall illness receiving care in community settings.

Methods

We hypothesized "jobs to be done" in three broad stakeholder groups: "decision makers" (DM = state and community clinic administrators), "clinician consumers" (CC = case managers, peer supports, nurses, prescribers) and "service consumers" (SC = patients, peers and family members). Semistructured interviews (N = 29) were recorded and transcribed ver batim and coded based on pragmatic-variant grounded theory methods.

Results

Four themes emerged across groups: education, inertia, resources and ownership. Sub-themes in education and ownership differed between DM and CC groups on implementation ownership, intersecting with professional development, suggesting the importance of training and supervision in scalability. Sub-themes in resources and intertia differed between CC and SC groups, suggesting illness severity and access to healthy food as major barriers to engagement, whereas the SC group identified the need for enhanced emotional support, in addition to pragmatic skills like menu planning and cooking, to promote health behavior change. Although SMS was percieved as a viable education and support tool, CC and DM groups had limited familiarity with use in clinical care delivery.

Conclusions

Based on customer discovery, the characteristics of a minimum viable iOTA for implementation, scalability and sustainability include population- and context-specific adaptations to treatment content, interventionist training and delivery mechanism. Successful implementation of an SMS-based intervention will likely require micro-adaptations to fit specific clinical settings.

Pragmatic considerations and approaches for measuring staff time as an implementation cost in health systems and clinics: key issues and applied examples

Background

As the field of implementation science wrestles with the need for system decision-makers to anticipate the budget impact of implementing new programs, there has been a push to report implementation costs more transparently. For this purpose, the method of time-driven activity-based costing (TDABC) has been heralded as a pragmatic advance. However, a recent TDABC review found that conventional methods for estimating staff time remain resource-intensive and called for simpler alternatives. Our objective was to conceptually compare conventional and emerging TDABC approaches to measuring staff time.

Methods

Our environmental scan of TDABC methods identified several categories of approaches for staff time estimation; across these categories, staff time was converted to cost as a pro-rated fraction of salary/benefits. Conventional approaches used a process map to identify each step of program delivery and estimated the staff time used at each step in one of 3 ways: (a) uniform estimates of time needed for commonly occurring tasks (self-report), (b) retrospective “time diary” (self-report), or (c) periodic direct observation. In contrast, novel semi-automated electronic health record (EHR) approaches “nudge” staff to self-report time for specific process map step(s)—serving as a contemporaneous time diary. Also, novel EHR-based automated approaches include timestamps to track specific steps in a process map. We compared the utility of these TDABC approach categories according to the 5 R’s model that measures domains of interest to system decision-makers: relevance, rapidity, rigor, resources, and replicability, and include two illustrative case examples.

Results

The 3 conventional TDABC staff time estimation methods are highly relevant to settings but have limited rapidity, variable rigor, are rather resource-intensive, and have varying replicability. In contrast to conventional TDABC methods, the semi-automated and automated EHR-based approaches have high rapidity, similar rigor, similar replicability, and are less resource-intensive, but have varying relevance to settings.

Conclusions

This synthesis and evaluation of conventional and emerging methods for staff time estimation by TDABC provides the field of implementation science with options beyond the current approaches. The field remains pressed to innovatively and pragmatically measure costs of program delivery that rate favorably across all of the 5 R’s domains.

Using economic evaluations in implementation science to increase transparency in costs and outcomes for organizational decision-makers

Background

Economic evaluations frequently are utilized to compare the value of different interventions in medicine and health in concrete terms. Implementation science also would benefit from the incorporation of economic evaluations, but such studies are rare in the literature. The National Cancer Institute has supported a special collection of articles focusing on economic evaluations in implementation science. Even when interventions are supported by substantial evidence, they are implemented infrequently in the field. Implementation costs are important determinants for whether organizational decision-makers choose to adopt an intervention and whether the implementation process is successful. Economic evaluations, such as cost-effectiveness analyses, can help organizational decision-makers choose between implementation approaches for evidence-based interventions by accounting for costs and succinctly presenting cost/benefit tradeoffs.

Main text

This manuscript presents a discussion of important considerations for incorporating economic evaluations into implementation science. First, the distinction between intervention and implementation costs is presented, along with an explanation of why the comprehensive representation of implementation costs is elusive. Then, the manuscript describes how economic evaluations in implementation science may differ from those in medicine and health intervention studies, especially in terms of determining the perspectives and outcomes of interest. Finally, referencing a scale-up trial of an evidence-based behavioral health intervention, concrete case examples of how cost data can be collected and used in economic evaluations targeting implementation, rather than clinical outcomes, are described.

Conclusions

By gaining a greater understanding of the costs and economic impact associated with different implementation approaches, organizational decision-makers will have better transparency for future replication and scale-up. The use of economic evaluations can help to advance this understanding and provide researchers, purveyors or third-party intermediaries, and organizational decision-makers with essential information to facilitate implementation.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00295-1.

Understanding implementation costs of a pediatric weight management intervention: an economic evaluation protocol

Background

Understanding the cost and/or cost-effectiveness of implementation strategies is crucial for organizations to make informed decisions about the resources needed to implement and sustain evidence-based interventions (EBIs). This economic evaluation protocol describes the methods and processes that will be used to assess costs and cost-effectiveness across implementation strategies used to improve the reach, adoption, implementation, and organizational maintenance of an evidence-based pediatric weight management intervention- Building Health Families (BHF).

Methods

A within-trial cost and cost-effectiveness analysis (CEA) will be completed as part of a hybrid type III effectiveness-implementation trial (HEI) designed to examine the impact of an action Learning Collaborative (LC) strategy consisting of network weaving, consultee-centered training, goal-setting and feedback, and sustainability action planning to improve the adoption, implementation, organizational maintenance, and program reach of BHF in micropolitan and surrounding rural communities in the USA, over a 12-month period. We discuss key features of implementation strategy components and the associated cost collection and outcome measures and present brief examples on what will be included in the CEA for each discrete implementation strategy and how the results will be interpreted. The cost data will be collected by identifying implementation activities associated with each strategy and using a digital-based time tracking tool to capture the time associated with each activity. Costs will be assessed relative to the BHF program implementation and the multicomponent implementation strategy, included within and external to a LC designed to improve reach, effectiveness, adoption, implementation, and maintenance (RE-AIM) of BHF. The CEA results will be reported by RE-AIM outcomes, using the average cost-effectiveness ratio or incremental cost-effectiveness ratio. All the CEAs will be performed from the community perspective.

Discussion

The proposed costing approach and economic evaluation framework for dissemination and implementation strategies and EBI implementation will contribute to the evolving but still scant literature on economic evaluation of implementation and strategies used and facilitate the comparative economic analysis.

Trial registration

ClinicalTrials.gov NCT04719442. Registered on January 22, 2021.

Supplementary Information

The online version contains supplementary material available at 10.1186/s43058-022-00287-1.

Cost-Effectiveness of a Web-Based Program for Residual Depressive Symptoms: Mindful Mood Balance

OBJECTIVE

Mindful Mood Balance (MMB) is an effective Web-based program for residual depressive symptoms that prevents relapse among patients with partial recovery from major depressive episodes. This cost-effectiveness analysis was conducted from the health plan perspective alongside a pragmatic randomized controlled trial of MMB.

METHODS

Adults were recruited from behavioral health and primary care settings in a large integrated health system and randomly assigned to MMB plus usual depression care (MMB+UDC) or UDC. Patients had at least one prior major depressive episode; a current score of 5-9 on the Patient Health Questionnaire-9, indicating residual depressive symptoms; and Internet access. Program costs included recruitment, coaching, and MMB licensing. Center for Medicare and Medicaid fee schedules were applied to electronic health record utilization data for psychotropic medications and psychiatric and psychotherapy visits. Effectiveness was measured as depression-free days (DFDs), converted from PHQ-9 scores collected monthly for 1 year. Incremental cost-effectiveness ratios were calculated with various sets of cost inputs.

RESULTS

A total of 389 patients (UDC, N=210; MMB+UDC, N=179) had adequate follow-up PHQ-9 measures for inclusion. MMB+UDC patients had 29 more DFDs during follow-up. Overall, the incremental cost of MMB+UDC was $431.54 over 12 months. Incremental costs per DFD gained ranged from $9.63 for program costs only to $15.04 when psychiatric visits, psychotherapy visits, and psychotropic medications were included.

CONCLUSIONS

MMB offers a cost-effective Web-based program for reducing residual depressive symptoms and preventing relapse. Health systems should consider adopting MMB as adjunctive to traditional mental health care services.

Study protocol for a type III hybrid effectiveness-implementation trial of strategies to implement firearm safety promotion as a universal suicide prevention strategy in pediatric primary care

Background

Insights from behavioral economics, or how individuals’ decisions and behaviors are shaped by finite cognitive resources (e.g., time, attention) and mental heuristics, have been underutilized in efforts to increase the use of evidence-based practices in implementation science. Using the example of firearm safety promotion in pediatric primary care, which addresses an evidence-to-practice gap in universal suicide prevention, we aim to determine: is a less costly and more scalable behavioral economic-informed implementation strategy (i.e., “Nudge”) powerful enough to change clinician behavior or is a more intensive and expensive facilitation strategy needed to overcome implementation barriers?

Methods

The Adolescent and child Suicide Prevention in Routine clinical Encounters (ASPIRE) hybrid type III effectiveness-implementation trial uses a longitudinal cluster randomized design. We will test the comparative effectiveness of two implementation strategies to support clinicians’ use of an evidence-based firearm safety practice, S.A.F.E. Firearm, in 32 pediatric practices across two health systems. All pediatric practices in the two health systems will receive S.A.F.E. Firearm materials, including training and cable locks. Half of the practices (k = 16) will be randomized to receive Nudge; the other half (k = 16) will be randomized to receive Nudge plus 1 year of facilitation to target additional practice and clinician implementation barriers (Nudge+). The primary implementation outcome is parent-reported clinician fidelity to the S.A.F.E Firearm program. Secondary implementation outcomes include reach and cost. To understand how the implementation strategies work, the primary mechanism to be tested is practice adaptive reserve, a self-report practice-level measure that includes relationship infrastructure, facilitative leadership, sense-making, teamwork, work environment, and culture of learning.

Discussion

The ASPIRE trial will integrate implementation science and behavioral economic approaches to advance our understanding of methods for implementing evidence-based firearm safety promotion practices in pediatric primary care. The study answers a question at the heart of many practice change efforts: which strategies are sufficient to support change, and why? Results of the trial will offer valuable insights into how best to implement evidence-based practices that address sensitive health matters in pediatric primary care.

Trial registration

ClinicalTrials.gov, NCT04844021. Registered 14 April 2021.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01154-8.

Counselor Efficiency at Providing Feedback in a Technology-Based Behavioral Weight Loss Intervention: Longitudinal Analysis

BACKGROUND

Feedback for participants' self-monitoring is a crucial and costly component of technology-based weight loss interventions. Detailed examination of interventionist time when reviewing and providing feedback for online self-monitoring data is lacking.

OBJECTIVE

The aim of this study was to longitudinally examine the time counselors spent providing feedback on participant self-monitoring data (ie, diet, physical activity, weight) in a 12-month technology-based weight loss intervention. We hypothesized that counselors would compose feedback for participants more quickly over time.

METHODS

The time the lay counselors (N=10) spent reviewing self-monitoring records and providing feedback to participants via email was longitudinally examined for all counselors across the three years of study implementation. Descriptives were observed for counselor feedback duration across counselors by 12 annual quarters (ie, 3-month periods). Differences in overall duration times by each consecutive annual quarter were analyzed using Wilcoxon-Mann-Whitney tests.

RESULTS

There was a decrease in counselor feedback duration from the first to second quarter (mean 53 to 46 minutes; P<.001), and from the second to third (mean 46 to 30 minutes; P<.001). A trend suggested a decrease from the third to fourth quarter (mean 30 to 26 minutes; P=.053), but no changes were found in subsequent quarters. Consistent with the hypothesis, counselors may be increasing their efficiency in providing feedback; across 12 months, counselors spent less time reviewing participant self-monitoring and composing feedback (decreasing from mean 53 to 26 minutes).

CONCLUSIONS

Counselors used increasingly less time to review online self-monitoring data and compose feedback after the initial 9 months of study implementation. Results inform counselor costs for future technology-based behavioral weight loss interventions. For example, regardless of increasing counselor efficiency, 25-30 minutes per feedback message is a high cost for interventions. One possibility for reducing costs would be generating computer-automated feedback.

TRIAL REGISTRATION

ClinicalTrials.gov NCT02063178; https://clinicaltrials.gov/ct2/show/NCT02063178.

Cost evaluation of tobacco control interventions in clinical settings: A systematic review

Elucidating the cost implications of tobacco control interventions is a prerequisite to their adoption in clinical settings. This review fills a knowledge gap in characterizing the extent to which cost is measured in tobacco control studies. A search of English literature was conducted in the following electronic databases: MEDLINE, EconLit, PsychINFO, and CINAHL using MeSH terms from 2009 to 2018. Studies were reviewed by two independent reviewers and included if they were conducted in U.S. inpatient or outpatient facilities and reported costs associated with a tobacco control intervention. They were categorized according to evaluation type, clinical setting, target population, cost measures, and stakeholder perspective. Bias risk was evaluated for RCTs. Seventeen publications were included, representing counseling interventions (n = 8) and combination (i.e., counseling and pharmacotherapy) interventions (n = 9). Studies were categorized by evaluation type: cost-effectiveness analysis (n = 10), cost utility analysis (n = 3) and cost identification (n = 4). The selected studies targeted the following populations: general adults (n = 6), hospitalized/inpatient (n = 4), military/veterans (n = 4), individuals with low socioeconomic status (n = 4), mental health or medical comorbidities (n = 2), and pregnant women (n = 2). Intervention costs included personnel, medication, education material, technology, and overhead costs. Stakeholder perspectives included: healthcare organization (n = 10), payer (n = 8), patient (n = 2), and societal (n = 1). Few studies have reported the cost of tobacco control interventions in clinical settings. Cost is a critical outcome that should be consistently measured in evaluations of tobacco control interventions to promote their uptake in clinical settings.

Importance of Multiple Reinforcing Comments and Areas for Change in Optimizing Dietary and Exercise Self-Monitoring Feedback in Behavioral Weight Loss Programs: Factorial Design

Background

Individualized dietary and physical activity self-monitoring feedback is a core element of behavioral weight loss interventions and is associated with clinically significant weight loss. To our knowledge, no studies have evaluated individuals’ perspectives on the composition of feedback messages or the effect of feedback composition on the motivation to self-monitor.

Objective

This study aims to assess the perceptions of feedback emails as a function of the number of comments that reinforce healthy behavior and the number of areas for change (ie, behavioral changes that the individual might make to have an impact on weight) identified.

Methods

Emailed feedback followed a factorial design with 2 factors (ie, reinforcing comments and areas for change), each with 3 levels (ie, 1, 4, or 8 comments). A total of 250 adults with overweight or obesity who were interested in weight loss were recruited from the Qualtrics research panel. Participants read 9 emails presented in a random order. For each email, respondents answered 8 questions about the likelihood to self-monitor in the future, motivation for behavioral change, and perceptions of the counselor and the email. A mixed effects ordinal logistic model was used to compute conditional odds ratios and predictive margins (ie, average predicted probability) on a 5-point Likert response scale to investigate the optimal combination level of the 2 factors.

Results

Emails with more reinforcing comments or areas for change were better received, with small incremental benefits for 8 reinforcing comments or areas for change versus 4 reinforcing comments or areas for change. Interactions indicated that the best combination for 3 of 8 outcomes assessed (ie, motivation to make behavioral changes, counselor’s concern for their welfare, and the perception that the counselor likes them) was the email with 8 reinforcing comments and 4 areas for change. Emails with 4 reinforcing comments and 4 areas for change resulted in the highest average probability of individuals who reported being very likely to self-monitor in the future.

Conclusions

The study findings suggest how feedback might be optimized for efficacy. Future studies should explore whether the composition of feedback email affects actual self-monitoring performance.

The Balance protocol: a pragmatic weight gain prevention randomized controlled trial for medically vulnerable patients within primary care

BACKGROUND

For patients with obesity who are not ready for or experience barriers to weight loss, clinical practice guidelines recommend provider counseling on preventing further weight gain as a first-line treatment approach. Unfortunately, evidence-based weight gain prevention interventions are not routinely available within primary care. To address this gap, we will implement a pragmatic 12-month randomized controlled trial of a digital weight gain prevention intervention delivered to patients receiving primary care within a network of Federally Qualified Community Health Centers in central North Carolina.

METHODS

Balance (Equilibrio in Spanish) is a pragmatic effectiveness trial that will randomize adult patients who have overweight or obesity (BMI of 25-40 kg/m2) to either: 1) a weight gain prevention intervention with tailored behavior change goals and tracking, daily weighing on a network-connected electronic scale, and responsive weight and goal coaching delivered remotely by health center registered dietitians; or 2) a usual care program with automated healthy living text messages and print materials and routine primary care. The primary outcome will be weight gain prevention at 24-months, defined as ≤3% change in baseline weight. To align with its pragmatic design, trial outcome data will be pulled from the electronic health record of the community health center network.

DISCUSSION

For underserved, often rurally-located patients with obesity, digital approaches to promote a healthy lifestyle can curb further weight gain. Yet enrolling medically vulnerable patients into a weight gain prevention trial, many of whom are from racial/ethnic minorities, can be difficult. Despite these potential challenges, we plan to recruit a large, diverse sample from rural areas, and will implement a remotely-delivered weight gain prevention intervention to medically vulnerable patients. Upcoming trial results will demonstrate the effectiveness of this pragmatic approach to implement and evaluate a digital weight gain prevention intervention within primary care.

TRIALS REGISTRATION

NCT03003403 . Registered December 28, 2016.

Stakeholder perspectives on costs and resource expenditures: tools for addressing economic issues most relevant to patients, providers, and clinics

Cost and other resources required are often primary considerations in whether a potential program or policy will be adopted or implemented and an important element in determining value. However, few economic analyses are conducted from the perspective of patient/family or small-scale stakeholders such as local clinics. We outline and discuss alternative cost assessment and resource expenditures options from the perspective of these small, proximal stakeholders. The perspective of these persons differs from larger societal or health plan perspectives, and often differs across individuals in terms of what they value and the types of expenditures about which they are concerned. We discuss key features of the perspectives of patients, health care clinics, and local leaders, and present brief examples and sample templates for collection of consumer/stakeholder relevant cost and return on investment issues. These tools can be used prospectively and iteratively during program planning, intervention delivery, summative analysis, and preparation for dissemination stages. There is an important need for this type of feasible, pragmatic, rapid, and iterative cost and resource expenditure analysis directly relevant to patients/families, small local stakeholders and their organizations. Future research on and use of these approaches is recommended.

Bariatric surgery, lifestyle interventions and orlistat for severe obesity: the REBALANCE mixed-methods systematic review and economic evaluation

BACKGROUND

Adults with severe obesity [body mass index (BMI) of ≥ 35 kg/m2] have an increased risk of comorbidities and psychological, social and economic consequences.

OBJECTIVES

Systematically review bariatric surgery, weight-management programmes (WMPs) and orlistat pharmacotherapy for adults with severe obesity, and evaluate the feasibility, acceptability, clinical effectiveness and cost-effectiveness of treatment.

DATA SOURCES

Electronic databases including MEDLINE, EMBASE, PsycINFO, the Cochrane Central Register of Controlled Trials and the NHS Economic Evaluation Database were searched (last searched in May 2017).

REVIEW METHODS

Four systematic reviews evaluated clinical effectiveness, cost-effectiveness and qualitative evidence for adults with a BMI of ≥ 35 kg/m2. Data from meta-analyses populated a microsimulation model predicting costs, outcomes and cost-effectiveness of Roux-en-Y gastric bypass (RYGB) surgery and the most effective lifestyle WMPs over a 30-year time horizon from a NHS perspective, compared with current UK population obesity trends. Interventions were cost-effective if the additional cost of achieving a quality-adjusted life-year is < £20,000-30,000.

RESULTS

A total of 131 randomised controlled trials (RCTs), 26 UK studies, 33 qualitative studies and 46 cost-effectiveness studies were included. From RCTs, RYGB produced the greatest long-term weight change [-20.23 kg, 95% confidence interval (CI) -23.75 to -16.71 kg, at 60 months]. WMPs with very low-calorie diets (VLCDs) produced the greatest weight loss at 12 months compared with no WMPs. Adding a VLCD to a WMP gave an additional mean weight change of -4.41 kg (95% CI -5.93 to -2.88 kg) at 12 months. The intensive Look AHEAD WMP produced mean long-term weight loss of 6% in people with type 2 diabetes mellitus (at a median of 9.6 years). The microsimulation model found that WMPs were generally cost-effective compared with population obesity trends. Long-term WMP weight regain was very uncertain, apart from Look AHEAD. The addition of a VLCD to a WMP was not cost-effective compared with a WMP alone. RYGB was cost-effective compared with no surgery and WMPs, but the model did not replicate long-term cost savings found in previous studies. Qualitative data suggested that participants could be attracted to take part in WMPs through endorsement by their health-care provider or through perceiving innovative activities, with WMPs being delivered to groups. Features improving long-term weight loss included having group support, additional behavioural support, a physical activity programme to attend, a prescribed calorie diet or a calorie deficit.

LIMITATIONS

Reviewed studies often lacked generalisability to UK settings in terms of participants and resources for implementation, and usually lacked long-term follow-up (particularly for complications for surgery), leading to unrealistic weight regain assumptions. The views of potential and actual users of services were rarely reported to contribute to service design. This study may have failed to identify unpublished UK evaluations. Dual, blinded numerical data extraction was not undertaken.

CONCLUSIONS

Roux-en-Y gastric bypass was costly to deliver, but it was the most cost-effective intervention. Adding a VLCD to a WMP was not cost-effective compared with a WMP alone. Most WMPs were cost-effective compared with current population obesity trends.

FUTURE WORK

Improved reporting of WMPs is needed to allow replication, translation and further research. Qualitative research is needed with adults who are potential users of, or who fail to engage with or drop out from, WMPs. RCTs and economic evaluations in UK settings (e.g. Tier 3, commercial programmes or primary care) should evaluate VLCDs with long-term follow-up (≥ 5 years). Decision models should incorporate relevant costs, disease states and evidence-based weight regain assumptions.

STUDY REGISTRATION

This study is registered as PROSPERO CRD42016040190.

FUNDING

The National Institute for Health Research Health Technology Assessment programme. The Health Services Research Unit and Health Economics Research Unit are core funded by the Chief Scientist Office of the Scottish Government Health and Social Care Directorate.

Expanding the CONSORT Figure: Increasing Transparency in Reporting on External Validity

INTRODUCTION

There are major problems with failure to replicate research findings. Contributing to this problem is a failure to report on factors related to external validity. Frequently, researchers have little knowledge whether findings apply more generally, especially to low-resource settings and underserved populations. The CONSORT flow diagram has improved reporting on variables related to internal validity, but it has very limited detail on issues related to external validity. A recent CONSORT update and other publications have called for more transparent reporting on external validity and context, and information regarding the sustainability of interventions. All of these elements influence the generalizability of findings from outcomes research.

METHODS

Drawing on theory, a prior meeting, and recent recommendations for reporting factors related to external validity, the authors propose an expansion of the basic CONSORT flow diagram for clinical trials to concisely summarize these data that recent CONSORT statements and other guidelines have recommended.

RESULTS

The authors propose the use of an expanded CONSORT figure and illustrate its utility with an example. The expanded CONSORT figure adds data about participation and representativeness at the levels of settings and staff, and about intervention sustainability after project support ends. The authors provide an expanded CONSORT figure reporting template, and demonstrate its use.

CONCLUSIONS

Improving transparent reporting on external validity by using the proposed expanded CONSORT figure would help to address both the scientific replication crisis and health equity concerns. This figure provides a method to efficiently address the representativeness, generalizability, and sustainability of outcomes research.

Assessing Effectiveness and Cost-Benefit of the Trinity Hospital Twin City Fit For Life Program for Weight Loss and Diabetes Prevention in a Rural Midwestern Town

INTRODUCTION

Obesity is a top public health priority in the United States. This article reports on the Fit For Life (FFL) health education program designed to address the determinants of obesity in rural settings and help participants lose weight.

PURPOSE AND OBJECTIVES

We evaluated the implementation of the original FFL program, a replication program, and a diabetes-focused program.

INTERVENTION APPROACH

The original FFL program (2006 to 2012) was a 12-week session of classes meeting once weekly. Lecture topics included stress management, nutrition, healthy eating, reading food labels, fitness, disease prevention, and healthy aging. The replication program, conducted in 4 locations from 2012 to 2015, helped determine if the FFL program could be implemented on a larger scale, with outcomes similar to the original program. The longer, more-intensive FFL diabetes prevention program, conducted in 2016 and 2017, sought to reduce the number of rural adults at risk for diabetes.

EVALUATION METHODS

We evaluated FFL participation and outcome data from 2009 through first quarter 2017. We calculated rates of course participation and completion and measured changes in several health indicators. We constructed a linear regression model to examine the impact of health behaviors on weight loss and calculated program cost-effectiveness.

RESULTS

From 2009 to 2017, FFL was delivered to over 1,200 people; 82% of participants completed the program. Completing participants lost an average of 2.7 kg or 3% of their total weight. Overall, 68% of participants said they exercised more per week at the end of the program than at the beginning. Estimated cost per kilogram lost for replication sites was between $73 and $101 for original FFL, in line with other programs. The more resource-intensive diabetes prevention program cost per kilogram lost was $151 to $171.

IMPLICATIONS FOR PUBLIC HEALTH PRACTICE

Weight loss and lifestyle management are major ways to counteract obesity. Improving program options, especially in rural locales, should be a key policy priority. These programs should be considered for population-based expansion, perhaps by health departments or public-private health care consortiums.

Qualitative approaches to use of the RE-AIM framework: rationale and methods

BACKGROUND

There have been over 430 publications using the RE-AIM model for planning and evaluation of health programs and policies, as well as numerous applications of the model in grant proposals and national programs. Full use of the model includes use of qualitative methods to understand why and how results were obtained on different RE-AIM dimensions, however, recent reviews have revealed that qualitative methods have been used infrequently. Having quantitative and qualitative methods and results iteratively inform each other should enhance understanding and lessons learned.

METHODS

Because there have been few published examples of qualitative approaches and methods using RE-AIM for planning or assessment and no guidance on how qualitative approaches can inform these processes, we provide guidance on qualitative methods to address the RE-AIM model and its various dimensions. The intended audience is researchers interested in applying RE-AIM or similar implementation models, but the methods discussed should also be relevant to those in community or clinical settings.

RESULTS

We present directions for, examples of, and guidance on how qualitative methods can be used to address each of the five RE-AIM dimensions. Formative qualitative methods can be helpful in planning interventions and designing for dissemination. Summative qualitative methods are useful when used in an iterative, mixed methods approach for understanding how and why different patterns of results occur.

CONCLUSIONS

In summary, qualitative and mixed methods approaches to RE-AIM help understand complex situations and results, why and how outcomes were obtained, and contextual factors not easily assessed using quantitative measures.

Role of the family doctor in the management of adults with obesity: a scoping review

OBJECTIVES

Obesity management is an important issue for the international primary care community. This scoping review examines the literature describing the role of the family doctor in managing adults with obesity. The methods were prospectively published and followed Joanna Briggs Institute methodology.

SETTING

Primary care. Adult patients.

INCLUDED PAPERS

Peer-reviewed and grey literature with the keywords obesity, primary care and family doctors. All literature published up to September 2015. 3294 non-duplicate papers were identified and 225 articles included after full-text review.

PRIMARY AND SECONDARY OUTCOME MEASURES

Data were extracted on the family doctors' involvement in different aspects of management, and whether whole person and person-centred care were explicitly mentioned.

RESULTS

110 papers described interventions in primary care and family doctors were always involved in diagnosing obesity and often in recruitment of participants. A clear description of the provider involved in an intervention was often lacking. It was difficult to determine if interventions took account of whole person and person-centredness. Most opinion papers and clinical overviews described an extensive role for the family doctor in management; in contrast, research on current practices depicted obesity as undermanaged by family doctors. International guidelines varied in their description of the role of the family doctor with a more extensive role suggested by guidelines from family medicine organisations.

CONCLUSIONS

There is a disconnect between how family doctors are involved in primary care interventions, the message in clinical overviews and opinion papers, and observed current practice of family doctors. The role of family doctors in international guidelines for obesity may reflect the strength of primary care in the originating health system. Reporting of primary care interventions could be improved by enhanced descriptions of the providers involved and explanation of how the pillars of primary care are used in intervention development.

An Economic Evaluation of a Weight Loss Intervention Program for People with Serious Mental Illnesses Taking Antipsychotic Medications

Individuals with serious mental illnesses suffer from obesity and cardiometabolic diseases at high rates, and antipsychotic medications exacerbate these conditions. While studies have shown weight loss and lifestyle interventions can be effective in this population, few have assessed intervention cost-effectiveness. We present results from a 12-month randomized controlled trial that reduced weight, fasting glucose, and medical hospitalizations in intervention participants. Costs per participant ranged from $4365 to $5687. Costs to reduce weight by one kilogram ranged from $1623 to $2114; costs to reduce fasting glucose by 1 mg/dL ranged from $467 to $608. Medical hospitalization costs were reduced by $137,500.

Texting Motivational Interviewing: A Randomized Controlled Trial of Motivational Interviewing Text Messages Designed to Augment Childhood Obesity Treatment

BACKGROUND

Text messages improve health outcomes for adults engaged in weight management. Little is known about whether text messaging parents of children enrolled in obesity treatment will improve child health.

METHODS

We conducted a 2-group randomized controlled study among 101 children aged 5-12 and their parent/guardian enrolling in tertiary-care obesity treatment. Participants were randomized to standard care or standard care plus daily motivational interviewing-based text messages. The primary outcome was change in child BMI at 3 months. Secondary outcomes included feasibility, health behaviors, attrition, motivation, and parent BMI.

RESULTS

We enrolled 101 parent-child dyads and retained 81% to 3-month follow-up. Child participants had a mean age of 9.9 years, and baseline BMI of 30.5 kg/m². Half (48%) of participants were Black, and 64% of parent participants had a high school equivalent education or less. Ninety-nine percent of parents owned a mobile device with unlimited text messaging. Parents responded to 80% of texts, and 95% felt the texts "always" or "almost always" helped them make a good health decision. We observed no between-group difference in child zBMI from baseline to 3 months (0.0 vs. 0.2, p = 0.2). Intervention participants had significantly better adherence to clinic visits (3.3 visits vs. 2.1 visits/3 months, p < 0.001).

CONCLUSIONS

Parent-directed text messages did not significantly change child BMI. However, texting significantly reduced attrition for treatment visits. Nearly all parents in this racially diverse, low-income sample engaged in daily text messaging, making this a feasible approach.

A Systematic Review of Economic Evidence on Community Hypertension Interventions

CONTEXT

Effective community-based interventions are available to control hypertension. It is important to determine the economics of these interventions.

EVIDENCE ACQUISITION

Peer-reviewed studies from January 1995 through December 2015 were screened. Interventions were categorized into educational interventions, self-monitoring interventions, and screening interventions. Incremental cost-effectiveness ratios were summarized by types of interventions. The review was conducted in 2016.

EVIDENCE SYNTHESIS

Thirty-four articles were included in the review (16 from the U.S., 18 from other countries), including 25 on educational interventions, three on self-monitoring interventions, and six on screening interventions. In the U.S., five (31.3%) studies on educational interventions were cost saving. Among the studies that found the interventions cost effective, the median incremental costs were $62 (range, $40-$114) for 1-mmHg reduction in systolic blood pressure (SBP) and $13,986 (range, $6,683-$58,610) for 1 life-year gained. Outside the U.S., educational interventions cost from $0.62 (China) to $29 (Pakistan) for 1-mmHg reduction in SBP. Self-monitoring interventions, evaluated in the U.S. only, cost $727 for 1-mmHg reduction in SBP and $41,927 for 1 life-year gained. For 1 quality-adjusted life-year, screening interventions cost from $21,734 to $56,750 in the U.S., $613 to $5,637 in Australia, and $7,000 to $18,000 in China. Intervention costs to reduce 1 mmHg blood pressure or 1 quality-adjusted life-year were higher in the U.S. than in other countries.

CONCLUSIONS

Most studies found that the three types of interventions were either cost effective or cost saving. Quality of economic studies should be improved to confirm the findings.

A cost analysis of implementing a behavioral weight loss intervention in community mental health settings: Results from the ACHIEVE trial

OBJECTIVE

In the ACHIEVE randomized controlled trial, an 18-month behavioral intervention accomplished weight loss in persons with serious mental illness who attended community psychiatric rehabilitation programs. This analysis estimates costs for delivering the intervention during the study. It also estimates expected costs to implement the intervention more widely in a range of community mental health programs.

METHODS

Using empirical data, costs were calculated from the perspective of a community psychiatric rehabilitation program delivering the intervention. Personnel and travel costs were calculated using time sheet data. Rent and supply costs were calculated using rent per square foot and intervention records. A univariate sensitivity analysis and an expert-informed sensitivity analysis were conducted.

RESULTS

With 144 participants receiving the intervention and a mean weight loss of 3.4 kg, costs of $95 per participant per month and $501 per kilogram lost in the trial were calculated. In univariate sensitivity analysis, costs ranged from $402 to $725 per kilogram lost. Through expert-informed sensitivity analysis, it was estimated that rehabilitation programs could implement the intervention for $68 to $85 per client per month.

CONCLUSIONS

Costs of implementing the ACHIEVE intervention were in the range of other intensive behavioral weight loss interventions. Wider implementation of efficacious lifestyle interventions in community mental health settings will require adequate funding mechanisms.

Automated telephone communication systems for preventive healthcare and management of long-term conditions

BACKGROUND

Automated telephone communication systems (ATCS) can deliver voice messages and collect health-related information from patients using either their telephone's touch-tone keypad or voice recognition software. ATCS can supplement or replace telephone contact between health professionals and patients. There are four different types of ATCS: unidirectional (one-way, non-interactive voice communication), interactive voice response (IVR) systems, ATCS with additional functions such as access to an expert to request advice (ATCS Plus) and multimodal ATCS, where the calls are delivered as part of a multicomponent intervention.

OBJECTIVES

To assess the effects of ATCS for preventing disease and managing long-term conditions on behavioural change, clinical, process, cognitive, patient-centred and adverse outcomes.

SEARCH METHODS

We searched 10 electronic databases (the Cochrane Central Register of Controlled Trials; MEDLINE; Embase; PsycINFO; CINAHL; Global Health; WHOLIS; LILACS; Web of Science; and ASSIA); three grey literature sources (Dissertation Abstracts, Index to Theses, Australasian Digital Theses); and two trial registries (www.controlled-trials.com; www.clinicaltrials.gov) for papers published between 1980 and June 2015.

SELECTION CRITERIA

Randomised, cluster- and quasi-randomised trials, interrupted time series and controlled before-and-after studies comparing ATCS interventions, with any control or another ATCS type were eligible for inclusion. Studies in all settings, for all consumers/carers, in any preventive healthcare or long term condition management role were eligible.

DATA COLLECTION AND ANALYSIS

We used standard Cochrane methods to select and extract data and to appraise eligible studies.

MAIN RESULTS

We included 132 trials (N = 4,669,689). Studies spanned across several clinical areas, assessing many comparisons based on evaluation of different ATCS types and variable comparison groups. Forty-one studies evaluated ATCS for delivering preventive healthcare, 84 for managing long-term conditions, and seven studies for appointment reminders. We downgraded our certainty in the evidence primarily because of the risk of bias for many outcomes. We judged the risk of bias arising from allocation processes to be low for just over half the studies and unclear for the remainder. We considered most studies to be at unclear risk of performance or detection bias due to blinding, while only 16% of studies were at low risk. We generally judged the risk of bias due to missing data and selective outcome reporting to be unclear.For preventive healthcare, ATCS (ATCS Plus, IVR, unidirectional) probably increase immunisation uptake in children (risk ratio (RR) 1.25, 95% confidence interval (CI) 1.18 to 1.32; 5 studies, N = 10,454; moderate certainty) and to a lesser extent in adolescents (RR 1.06, 95% CI 1.02 to 1.11; 2 studies, N = 5725; moderate certainty). The effects of ATCS in adults are unclear (RR 2.18, 95% CI 0.53 to 9.02; 2 studies, N = 1743; very low certainty).For screening, multimodal ATCS increase uptake of screening for breast cancer (RR 2.17, 95% CI 1.55 to 3.04; 2 studies, N = 462; high certainty) and colorectal cancer (CRC) (RR 2.19, 95% CI 1.88 to 2.55; 3 studies, N = 1013; high certainty) versus usual care. It may also increase osteoporosis screening. ATCS Plus interventions probably slightly increase cervical cancer screening (moderate certainty), but effects on osteoporosis screening are uncertain. IVR systems probably increase CRC screening at 6 months (RR 1.36, 95% CI 1.25 to 1.48; 2 studies, N = 16,915; moderate certainty) but not at 9 to 12 months, with probably little or no effect of IVR (RR 1.05, 95% CI 0.99, 1.11; 2 studies, 2599 participants; moderate certainty) or unidirectional ATCS on breast cancer screening.Appointment reminders delivered through IVR or unidirectional ATCS may improve attendance rates compared with no calls (low certainty). For long-term management, medication or laboratory test adherence provided the most general evidence across conditions (25 studies, data not combined). Multimodal ATCS versus usual care showed conflicting effects (positive and uncertain) on medication adherence. ATCS Plus probably slightly (versus control; moderate certainty) or probably (versus usual care; moderate certainty) improves medication adherence but may have little effect on adherence to tests (versus control). IVR probably slightly improves medication adherence versus control (moderate certainty). Compared with usual care, IVR probably improves test adherence and slightly increases medication adherence up to six months but has little or no effect at longer time points (moderate certainty). Unidirectional ATCS, compared with control, may have little effect or slightly improve medication adherence (low certainty). The evidence suggested little or no consistent effect of any ATCS type on clinical outcomes (blood pressure control, blood lipids, asthma control, therapeutic coverage) related to adherence, but only a small number of studies contributed clinical outcome data.The above results focus on areas with the most general findings across conditions. In condition-specific areas, the effects of ATCS varied, including by the type of ATCS intervention in use.Multimodal ATCS probably decrease both cancer pain and chronic pain as well as depression (moderate certainty), but other ATCS types were less effective. Depending on the type of intervention, ATCS may have small effects on outcomes for physical activity, weight management, alcohol consumption, and diabetes mellitus. ATCS have little or no effect on outcomes related to heart failure, hypertension, mental health or smoking cessation, and there is insufficient evidence to determine their effects for preventing alcohol/substance misuse or managing illicit drug addiction, asthma, chronic obstructive pulmonary disease, HIV/AIDS, hypercholesterolaemia, obstructive sleep apnoea, spinal cord dysfunction or psychological stress in carers.Only four trials (3%) reported adverse events, and it was unclear whether these were related to the interventions.

AUTHORS' CONCLUSIONS

ATCS interventions can change patients' health behaviours, improve clinical outcomes and increase healthcare uptake with positive effects in several important areas including immunisation, screening, appointment attendance, and adherence to medications or tests. The decision to integrate ATCS interventions in routine healthcare delivery should reflect variations in the certainty of the evidence available and the size of effects across different conditions, together with the varied nature of ATCS interventions assessed. Future research should investigate both the content of ATCS interventions and the mode of delivery; users' experiences, particularly with regard to acceptability; and clarify which ATCS types are most effective and cost-effective.

Multimorbidity in chronic disease: impact on health care resources and costs

Effective and resource-efficient long-term management of multimorbidity is one of the greatest health-related challenges facing patients, health professionals, and society more broadly. The purpose of this review was to provide a synthesis of literature examining multimorbidity and resource utilization, including implications for cost-effectiveness estimates and resource allocation decision making. In summary, previous literature has reported substantially greater, near exponential, increases in health care costs and resource utilization when additional chronic comorbid conditions are present. Increased health care costs have been linked to elevated rates of primary care and specialist physician occasions of service, medication use, emergency department presentations, and hospital admissions (both frequency of admissions and bed days occupied). There is currently a paucity of cost-effectiveness information for chronic disease interventions originating from patient samples with multimorbidity. The scarcity of robust economic evaluations in the field represents a considerable challenge for resource allocation decision making intended to reduce the burden of multimorbidity in resource-constrained health care systems. Nonetheless, the few cost-effectiveness studies that are available provide valuable insight into the potential positive and cost-effective impact that interventions may have among patients with multiple comorbidities. These studies also highlight some of the pragmatic and methodological challenges underlying the conduct of economic evaluations among people who may have advanced age, frailty, and disadvantageous socioeconomic circumstances, and where long-term follow-up may be required to directly observe sustained and measurable health and quality of life benefits. Research in the field has indicated that the impact of multimorbidity on health care costs and resources will likely differ across health systems, regions, disease combinations, and person-specific factors (including social disadvantage and age), which represent important considerations for health service planning. Important priorities for research include economic evaluations of interventions, services, or health system approaches that can remediate the burden of multimorbidity in safe and cost-effective ways.

Technology-assisted weight loss interventions in primary care: a systematic review

BACKGROUND

The US Preventive Services Task Force recommends screening for and treating obesity. However, there are many barriers to successfully treating obesity in primary care (PC). Technology-assisted weight loss interventions offer novel ways of improving treatment, but trials are overwhelmingly conducted outside of PC and may not translate well into this setting. We conducted a systematic review of technology-assisted weight loss interventions specifically tested in PC settings.

METHODS

We searched the literature from January 2000 to March 2014.

INCLUSION CRITERIA

(1) Randomized controlled trial; (2) trials that utilized the Internet, personal computer, and/or mobile device; and (3) occurred in an ambulatory PC setting. We applied the Cochrane Effective Practice and Organization of Care (EPOC) and Delphi criteria to assess bias and the Pragmatic-Explanatory Continuum Indicator Summary (PRECIS) criteria to assess pragmatism (whether trials occurred in the real world versus under ideal circumstances). Given heterogeneity, results were not pooled quantitatively.

RESULTS

Sixteen trials met inclusion criteria. Twelve (75 %) interventions achieved weight loss (range: 0.08 kg - 5.4 kg) compared to controls, while 5-45 % of patients lost at least 5 % of baseline weight. Trial duration and attrition ranged from 3-36 months and 6-80 %, respectively. Ten (63 %) studies reported results after at least 1 year of follow-up. Interventions used various forms of personnel, technology modalities, and behavior change elements; trials most frequently utilized medical doctors (MDs) (44 %), web-based applications (63 %), and self-monitoring (81 %), respectively. Interventions that included clinician-guiding software or feedback from personnel appeared to promote more weight loss than fully automated interventions. Only two (13 %) studies used publically available technologies. Many studies had fair pragmatism scores (mean: 2.8/4), despite occurring in primary care.

DISCUSSION

Compared to usual care, technology-assisted interventions in the PC setting help patients achieve weight loss, offering evidence-based options to PC providers. However, best practices remain undetermined. Despite occurring in PC, studies often fall short in utilizing pragmatic methodology and rarely provide publically available technology. Longitudinal, pragmatic, interdisciplinary, and open-source interventions are needed.

Use of RE-AIM to Address Health Inequities: Application in a low-income community health center based weight loss and hypertension self-management program

BACKGROUND

While health inequities are well documented, and there are helpful frameworks to understand health disparities, implementation frameworks are also needed to focus the design, evaluation and reporting on interventions targeting populations at increased risk.

PURPOSE

Describe how the RE-AIM framework (Reach, Effectiveness, Adoption, Implementation, and Maintenance) can be used for these purposes and illustrate its application in the context of a randomized, pragmatic weight-loss and hypertension self-management intervention.

METHODS

RE-AIM was used to both plan and evaluate the Be Fit Be Well program for urban community health center patients.

RESULTS

The RE-AIM framework helped to focus attention on and produce high rates of adoption and reach. Implementation rates varied across components. Weight losses were statistically significant, but not clinically significant. They were robust across a variety of patient characteristics, and the program was relatively low cost. Individual weight losses and blood pressure reductions were maintained throughout the 24-month period, but the program was not sustained at any of the three settings.

CONCLUSION

Implementation frameworks such as RE-AIM can help design pragmatic interventions that focus on both the context for disparities reduction and the ultimate goal of public health impact.