Estimating development cost for a tailored interactive computer program to enhance colorectal cancer screening compliance

A microcosting approach for planning and implementing community-based mental health prevention program: what does it cost?

BACKGROUND

Estimating program costs when planning community-based mental health programs can be burdensome. Our aim was to retrospectively document the cost for the first year of planning and implementing Healthy Minds Healthy Communities (HMHC), a mental health promotion and prevention multi-level intervention initiative. This Program is among the first to use the Community Initiated Care (CIC) model in the US and is aimed at building community resilience and the capacity for communities to provide mental health support, particularly among those disproportionately impacted by COVID-19. Our objective is to share our methods for costing a program targeting 10 zip codes that are ethnically and linguistically diverse and provide an example for estimating the cost of a mental health prevention and promotion programs consisting of multiple evidence-based interventions.

METHODS

We used a semi-structured interview process to collect cost data through the first year of program planning, start-up and initial implementation from key staff. We calculated costs for each activity, grouped them by major project categories, and identified the cost drivers of each category. We further validated cost estimates through extensive literature review. The cost analysis was done from the provider's perspective, which included the implementing agency and its community partners. We delineated costs that were in-kind contributions to the program by other agency, and community partners. Sensitivity analyses were conducted to estimate uncertainty around parameters.

RESULTS

For the first year of the development and implementation of the program, (funded through program and in-kind) is estimated at $1,382,669 (2022 US$). The costs for the three main activity domains for this project are: project management $135,822, community engagement $364,216 and design and execution $756,934. Overall, the cost drivers for the first year of this intervention were: hiring and onboarding staff, in-person community building/learning sessions, communications and marketing, and intervention delivery.

CONCLUSION

Implementation of community-based mental health promotion and prevention programs, when utilizing a participatory approach, requires a significant amount of upfront investment in program planning and development. A large proportion of this investment tends to be human capital input. Developing partnerships is a successful strategy for defraying costs.

A micro costing analysis of the development of a primary care intervention to improve the uptake of diabetic retinopathy screening

Background

The application of economic analysis within implementation science is still developing and the cost of intervention development, which differs markedly from the costs of initial implementation and maintenance, is often overlooked. Our aim was to retrospectively cost the development of a multifaceted intervention in primary care to improve attendance at diabetic retinopathy screening.

Methods

A retrospective micro costing of developing the intervention from the research funder perspective was conducted. It was based on a systematic intervention development process involving analysis of existing audit data and interviews with patients and healthcare professionals (HCPs), conducting consensus meetings with patients and HCPs, and using these data together with a rapid review of the effectiveness of interventions, to inform the final intervention. Both direct (non-personnel, e.g. travel, stationary, room hire) and indirect (personnel) costs were included. Data sources included researcher time logs, payroll data, salary scales, an online financial management system, invoices and purchase orders. Personnel involved in the intervention development were consulted to determine the activities they conducted and the duration of their involvement. Sensitivity and scenario analyses were conducted to estimate uncertainty around parameters and scope.

Results

The total cost of intervention development (July 2014–January 2019) was €40,485 of which 78% were indirect (personnel) costs (€31,451). In total, personnel contributed 1368 h to intervention development. Highest cost activities were the patient interviews, and consensus process, contributing 23% and 34% of the total cost. Varying estimated time spent on intervention development activities by + 10% increased total intervention development cost by 6% to €42,982.

Conclusions

Our results highlight that intervention development requires a significant amount of human capital input, combining research experience, patient and public experience, and expert knowledge in relevant fields. The time committed to intervention development is critical but has a significant opportunity cost. With limited resources for research on developing and implementing interventions, capturing intervention development costs and incorporating them as part of assessment of cost-effective interventions, could inform research priority and resource allocation decisions.

Supplementary Information

The online version contains supplementary material available at 10.1186/s13012-021-01085-4.

Interventions developed with the Intervention Mapping protocol in the field of cancer: A systematic review

OBJECTIVES

The Intervention Mapping (IM) protocol provides a structured framework to develop, implement, and evaluate complex interventions. The main objective of this review was to identify and describe the content of the interventions developed in the field of cancer with the IM protocol. Secondary objectives were to assess their fidelity to the IM protocol and to review their theoretical frameworks.

METHODS

Medline, Web of Science, PsycINFO, PASCAL, FRANCIS, and BDSP databases were searched. All titles and abstracts were reviewed. A standardized extraction form was developed. All included studies were reviewed by 2 reviewers blinded to each other.

RESULTS

Sixteen studies were identified, and these reported 15 interventions. The objectives were to increase cancer screening participation (n = 7), early consultation (n = 1), and aftercare/quality of life among cancer survivors (n = 7). Six reported a complete participatory planning group, and 7 described a complete logic model of the problem. Ten studies described a complete logic model of change. The main theoretical frameworks used were the theory of planned behaviour (n = 8), the transtheoretical model (n = 6), the health belief model (n = 6), and the social cognitive theory (n = 6). The environment was rarely integrated in the interventions (n = 4). Five interventions were reported as effective.

CONCLUSIONS

Culturally relevant interventions were developed with the IM protocol that were effective to increase cancer screening and reduce social disparities, particularly when they were developed through a participative approach and integrated the environment. Stakeholders' involvement and the role of the environment were heterogeneously integrated in the interventions.

The cost of developing a computerized tailored interactive multimedia intervention vs. a print based Photonovella intervention for HPV vaccine education

Mobile technology is opening new avenues for healthcare providers to create and implement tailored and personalized health education programs. We estimate and compare the cost of developing an i-Pad based tailored interactive multimedia intervention (TIMI) and a print based (Photonovella) intervention to increase human papillomavirus (HPV) immunization. The development costs of the interventions were calculated using a societal perspective. Direct cost included the cost of planning the study, conducting focus groups, and developing the intervention materials by the research staff. Costs also included the amount paid to the vendors who produced the TIMI and Photonovella. Micro cost data on the staff time and materials were recorded in logs for tracking personnel time, meeting time, supplies and software purchases. The costs were adjusted for inflation and reported in 2015 USD. The total cost of developing the Photonovella was $66,468 and the cost of developing the TIMI was $135,978. The amortized annual cost for the interventions calculated at a 3% discount rate and over a 7-year period was $10,669 per year for the Photonovella and $21,825 per year for the TIMI intervention. The results would inform decision makers when planning and investing in the development of interactive multimedia health interventions.

Estimating development cost of an interactive website based cancer screening promotion program

OBJECTIVES

The aim of this study was to estimate the initial development costs for an innovative talk show format tailored intervention delivered via the interactive web, for increasing cancer screening in women 50-75 who were non-adherent to screening guidelines for colorectal cancer and/or breast cancer.

METHODS

The cost of the intervention development was estimated from a societal perspective. Micro costing methods plus vendor contract costs were used to estimate cost. Staff logs were used to track personnel time. Non-personnel costs include all additional resources used to produce the intervention.

RESULTS

Development cost of the interactive web based intervention was $.39 million, of which 77% was direct cost. About 98% of the cost was incurred in personnel time cost, contract cost and overhead cost.

CONCLUSIONS

The new web-based disease prevention medium required substantial investment in health promotion and media specialist time. The development cost was primarily driven by the high level of human capital required. The cost of intervention development is important information for assessing and planning future public and private investments in web-based health promotion interventions.

Against Colorectal Cancer in Our Neighborhoods, a Community-Based Colorectal Cancer Screening Program Targeting Low-Income Hispanics

Background. Colorectal cancer is the second leading cause of cancer-related death in the United States. Despite universal screening recommendations, screening rates in the United States remain suboptimal, especially among the poor, the uninsured, recent immigrants, and Hispanics. This article describes the development of a large community-based colorectal cancer screening program designed to address these disparities. Method. The Against Colorectal Cancer in our Neighborhoods program is a bilingual, evidence-based, theory-guided, multicomponent community screening intervention, targeting the uninsured and developed using a systematic planning process. It combines community health worker–led outreach, bilingual and culturally tailored community education, and no-cost screening with provision of the fecal immunochemical test or colonoscopy and navigation services. A detailed process and outcome evaluation is planned. Program development cost calculated prospectively (in 2011 dollars) using a societal perspective and micro-costing methods was $243,278, of which $180,344 was direct cost. Discussion. The detailed description of the development processes and costs of this health promotion program targeting low-income Hispanics will inform health program decision makers about the resource requirements for planning and developing new programs to reduce disease burden in communities.

Development of a fully automated, web-based, tailored intervention promoting regular physical activity among insufficiently active adults with type 2 diabetes: integrating the I-change model, self-determination theory, and motivational interviewing components

Background

Type 2 diabetes is a major challenge for Canadian public health authorities, and regular physical activity is a key factor in the management of this disease. Given that fewer than half of people with type 2 diabetes in Canada are sufficiently active to meet the recommendations, effective programs targeting the adoption of regular physical activity (PA) are in demand for this population. Many researchers argue that Web-based, tailored interventions targeting PA are a promising and effective avenue for sedentary populations like Canadians with type 2 diabetes, but few have described the detailed development of this kind of intervention.

Objective

This paper aims to describe the systematic development of the Web-based, tailored intervention, Diabète en Forme, promoting regular aerobic PA among adult Canadian francophones with type 2 diabetes. This paper can be used as a reference for health professionals interested in developing similar interventions. We also explored the integration of theoretical components derived from the I-Change Model, Self-Determination Theory, and Motivational Interviewing, which is a potential path for enhancing the effectiveness of tailored interventions on PA adoption and maintenance.

Methods

The intervention development was based on the program-planning model for tailored interventions of Kreuter et al. An additional step was added to the model to evaluate the intervention’s usability prior to the implementation phase. An 8-week intervention was developed. The key components of the intervention include a self-monitoring tool for PA behavior, a weekly action planning tool, and eight tailored motivational sessions based on attitude, self-efficacy, intention, type of motivation, PA behavior, and other constructs and techniques. Usability evaluation, a step added to the program-planning model, helped to make several improvements to the intervention prior to the implementation phase.

Results

The intervention development cost was about CDN $59,700 and took approximately 54 full-time weeks. The intervention officially started on September 29, 2014. Out of 2300 potential participants targeted for the tailored intervention, approximately 530 people visited the website, 170 people completed the registration process, and 83 corresponded to the selection criteria and were enrolled in the intervention.

Conclusions

Usability evaluation is an essential step in the development of a Web-based tailored intervention in order to make pre-implementation improvements. The effectiveness and relevance of the theoretical framework used for the intervention will be analyzed following the process and impact evaluation. Implications for future research are discussed.

The effects of tailoring knowledge acquisition on colorectal cancer screening self-efficacy

Interventions tailored to psychological factors such as personal and vicarious behavioral experiences can enhance behavioral self-efficacy but are complex to develop and implement. Information seeking theory suggests tailoring acquisition of health knowledge (without concurrent psychological factor tailoring) could enhance self-efficacy, simplifying the design of tailored behavior change interventions. To begin to examine this issue, the authors conducted exploratory analyses of data from a randomized controlled trial, comparing the effects of an experimental colorectal cancer screening intervention tailoring knowledge acquisition with the effects of a nontailored control on colorectal cancer screening knowledge and self-efficacy in 1159 patients comprising three ethnicity/language strata (Hispanic/Spanish, 23.4%, Hispanic/English, 27.2%, non-Hispanic/English, 49.3%) and 5 recruitment center strata. Adjusted for study strata, the mean postintervention knowledge score was significantly higher in the experimental group than in the control group. Adjusted experimental intervention exposure (B = 0.22, 95% CI [0.14, 0.30]), preintervention knowledge (B = 0.11, 95% CI [0.05, 0.16]), and postintervention knowledge (B = 0.03, 95% CI [0.01, 0.05]) were independently associated with subsequent colorectal cancer screening self-efficacy (p < .001 all associations). These exploratory findings suggest that tailoring knowledge acquisition may enhance self-efficacy, with potential implications for tailored intervention design, but this implication requires confirmation in studies specifically designed to examine this issue.

Trends and Determinants of Up-to-date Status with Colorectal Cancer Screening in Tennessee, 2002-2008

BACKGROUND

Screening rates for colorectal cancer (CRC) are increasing nationwide including Tennessee (TN); however, their up-to-date status is unknown. The objective of this study is to determine the trends and characteristics of TN adults who are up-to-date status with CRC screening during 2002-2008.

METHODS

We examined data from the TN Behavioral Risk Factor Surveillance System for 2002, 2004, 2006 and 2008 to estimate the proportion of respondents aged 50 years and above who were up-to-date status with CRC screening, defined as an annual home fecal occult blood test and/or sigmoidoscopy or colonoscopy in the past 5 years. We identified trends in up-to-status in all eligible respondents. Using multivariable logistic regression models, we delineated key characteristics of respondents who were up-to-date status.

RESULTS

During 2002-2008, the proportion of respondents with up-to-date status for CRC screening increased from 49% in 2002- 55% in 2006 and then decreased to 46% in 2008. The screening rates were higher among adults aged 65-74 years, those with some college education, those with annual household income ≥$35,000 and those with health-care access. In 2008, the respondents who were not up-to-date status with CRC screening included those with no health-care coverage (adjusted odds ratio [OR] 0.46, 95% confidence interval [CI] 0.33-0.63), those aged 50-54 years (OR 0.62, 95% CI 0.46-0.82) and those with annual household income <$25,000 (OR 0.65, 95% CI 0.52-0.82).

CONCLUSIONS

TN adults who are up-to-date status with CRC screening are increasing, but not across all socio-demographic subgroups. The results identified specific subgroups to be targeted by screening programs, along with continued efforts to educate public and providers about the importance of CRC screening.

Prospective cohort study of compliance with faecal immunochemical tests for colorectal cancer screening in Hong Kong

OBJECTIVE

This study aims to examine the rate and determinants of faecal immunochemical test (FIT) compliance over a four-year period among asymptomatic participants in a colorectal cancer (CRC) screening programme in Hong Kong.

METHOD

Self-referred screening participants aged between 50 and 70 years who chose FIT for annual screening were followed up for four years (2008-2012). All participants were reminded up to three times yearly for FIT retrieval within two months of the expected screening date. The proportions of screening participants who failed to adhere to annual FIT tests in 1, 2, 3 and 4-years, respectively, after the initial screening uptake were evaluated. The factors associated with non-compliance with FITs in any year were assessed by a binary logistic regression analysis.

RESULTS

From 5700 consecutive screening participants, the compliance rates to FIT were 95.1%, 79.9%, 66.2% and 68.4% at years one to four, respectively. The proportions of people missing one, two and three tests were 6.2%, 19.6% and 2.1%, respectively. From multivariate regression analysis, male subjects, younger participants, smokers and those with positive family history of CRC were more likely to be non-compliant.

CONCLUSION

Participants identified as at higher risk for screening non-compliance should be especially considered for individual reminders to enhance screening effectiveness.

Effects of tailored knowledge enhancement on colorectal cancer screening preference across ethnic and language groups

OBJECTIVE

Tailoring to psychological constructs (e.g. self-efficacy, readiness) motivates behavior change, but whether knowledge tailoring alone changes healthcare preferences--a precursor of behavior change in some studies--is unknown. We examined this issue in secondary analyses from a randomized controlled trial of a tailored colorectal cancer (CRC) screening intervention, stratified by ethnicity/language subgroups (Hispanic/Spanish, Hispanic/English, non-Hispanic/English).

METHODS

Logistic regressions compared effects of a CRC screening knowledge-tailored intervention versus a non-tailored control on preferences for specific test options (fecal occult blood or colonoscopy), in the entire sample (N=1164) and the three ethnicity/language subgroups.

RESULTS

Pre-intervention, preferences for specific tests did not differ significantly between study groups (experimental, 64.5%; control 62.6%). Post-intervention, more experimental participants (78.6%) than control participants (67.7%) preferred specific tests (P<0.001). Adjusting for pre-intervention preferences, more experimental group participants than control group participants preferred specific tests post-intervention [average marginal effect (AME)=9.5%, 95% CI 5.3-13.6; P<0.001]. AMEs were similar across ethnicity/language subgroups.

CONCLUSION

Knowledge tailoring increased preferences for specific CRC screening tests across ethnic and language groups.

PRACTICE IMPLICATIONS

If the observed preference changes are found to translate into behavior changes, then knowledge tailoring alone may enhance healthy behaviors.

A randomized controlled trial of a tailored interactive computer-delivered intervention to promote colorectal cancer screening: sometimes more is just the same

BACKGROUND

There have been few studies of tailored interventions to promote colorectal cancer (CRC) screening.

PURPOSE

We conducted a randomized trial of a tailored, interactive intervention to increase CRC screening.

METHODS

Patients 50-70 years completed a baseline survey, were randomized to one of three groups, and attended a wellness exam after being exposed to a tailored intervention about CRC screening (tailored group), a public web site about CRC screening (web site group), or no intervention (survey-only group). The primary outcome was completion of any recommended CRC screening by 6 months.

RESULTS

There was no statistically significant difference in screening by 6 months: 30%, 31%, and 28% of the survey-only, web site, and tailored groups were screened. Exposure to the tailored intervention was associated with increased knowledge and CRC screening self-efficacy at 2 weeks and 6 months. Family history, prior screening, stage of change, and physician recommendation moderated the intervention effects.

CONCLUSIONS

A tailored intervention was not more effective at increasing screening than a public web site or only being surveyed.

Cost effectiveness of interventions to promote screening for colorectal cancer: a randomized trial

Objectives

Screening for colorectal cancer is considered cost effective, but is underutilized in the U.S. Information on the efficiency of "tailored interventions" to promote colorectal cancer screening in primary care settings is limited. The paper reports the results of a cost effectiveness analysis that compared a survey-only control group to a Centers for Disease Control (CDC) web-based intervention (screen for life) and to a tailored interactive computer-based intervention.

Methods

A randomized controlled trial of people 50 and over, was conducted to test the interventions. The sample was 1224 partcipants 50-70 years of age, recruited from Kelsey-Seybold Clinic, a large multi-specialty clinic in Houston, Texas. Screening status was obtained by medical chart review after a 12-month follow-up period. An "intention to treat" analysis and micro costing from the patient and provider perspectives were used to estimate the costs and effects. Analysis of statistical uncertainty was conducted using nonparametric bootstrapping.

Results

The estimated cost of implementing the web-based intervention was $40 per person and the cost of the tailored intervention was $45 per person. The additional cost per person screened for the web-based intervention compared to no intervention was $2602 and the tailored intervention was no more effective than the web-based strategy.

Conclusions

The tailored intervention was less cost-effective than the web-based intervention for colorectal cancer screening promotion. The web-based intervention was less cost-effective than previous studies of in-reach colorectal cancer screening promotion. Researchers need to continue developing and evaluating the effectiveness and cost-effectiveness of interventions to increase colorectal cancer screening.

Cost-effectiveness of targeted and tailored interventions on colorectal cancer screening use

BACKGROUND

Colorectal cancer (CRC) screening is cost-effective but underused. The objective of this study was to determine the cost-effectiveness of targeted and tailored behavioral interventions to increase CRC screening use by conducting an economic analysis associated with a randomized trial among patients in a large, racially and ethnically diverse, urban family practice in Philadelphia.

METHODS

The incremental costs per unit increase were measured in individuals who were screened during the 24 months after intervention. Percent increase in screening was adjusted for baseline differences in the study groups. Each intervention arm received a targeted screening invitation letter, stool blood test (SBT) cards, informational booklet, and reminder letter. Tailored interventions incrementally added tailored messages and reminder telephone calls.

RESULTS

Program costs of the targeted intervention were 42 dollars per participant. Additional costs of adding tailored print materials and of delivering a reminder telephone call were 150 dollars and 200 dollars per participant, respectively. The cost per additional individual screened was 319 dollars when comparing the no intervention group with the targeted intervention group.

CONCLUSIONS

The targeted intervention was more effective and less costly than the tailored intervention. Although tailoring plus reminder telephone call was the most effective strategy, it was very costly per additional individual screened. Mailed SBT cards significantly boosted CRC screening use. However, going beyond the targeted intervention to include tailoring or tailoring plus reminder calls in the manner used in this study did not appear to be an economically attractive strategy.