Using a Developmental Approach to Evaluation Capacity Building in Home Visiting

The Maternal, Infant, and Early Childhood Home Visiting (MIECHV) program, administered by the Health Resources and Service Administration in collaboration with the Administration for Children and Families, provides evidence-based home visiting services across 50 states, the District of Columbia, and five U.S. territories. MIECHV invests in comprehensive technical assistance (TA) to support and build the capacity of awardees to conduct rigorous evaluations of their programs. Throughout the course of the evaluation process, awardees received TA from the Design Options for Home Visiting Evaluation project. Between 2011 and 2020, over 173 state-led evaluations have been conducted. Individual technical assistance (TA) modalities included conference calls, emails, interactive and individualized webinars, developing and sharing resources, and involvement of content experts. When issues and challenges were identified across multiple awardees, Design Options for Home Visiting Evaluation (DOHVE) delivered targeted group TA to awardees with common needs that may benefit from peer-to-peer learning. When cross-cutting issues and challenges were identified, DOHVE used universal approaches such as webinars and guidance documents that were made available to all awardees.Through the Maternal, Infant, and Early Childhood Home Visiting (MIECHV) program, efforts have been taken to promote awardee capacity by targeting all phases of the evaluation process, including planning, implementing, and disseminating findings and providing TA that is responsive and tailored to meet awardee-specific needs. This approach enabled DOHVE to support MIECHV awardees in expanding knowledge of their programs and the evidence base on home visiting. Lessons learned from TA provision highlight the importance of developing feasible plans and providing ongoing support during implementation.

Standardized Cost Estimates for Home Visiting: Pilot Study of the Home Visiting Budget Assistance Tool (HV-BAT)

Purpose Using a standardized approach and metrics to estimate home visiting costs across multiple evidence-based models and regions could improve the consistency and accuracy of cost estimates, allow stakeholders to observe trends in cost allocation, analyze how home visiting costs vary, and develop future program budgets. Between October 2015 and December 2018, we developed and pilot-tested the Home Visiting Budget Assistance Tool (HV-BAT) to standardize the collection of home visiting program costs and analyze costs for local implementing agencies (LIAs). Methods We recruited LIAs that implemented at least one of nine evidence-based home visiting models in 15 states implementing the Maternal, Infant, and Early Childhood Home Visiting (MIECHV) Program. LIAs reported their costs to implement a home visiting model using the HV-BAT and provided feedback on the tool. We estimated annual total cost and cost per family served for each LIA, examined cost summary statistics for the sample, and analyzed whether and how LIA characteristics affected home visiting costs using regression analyses. Results Of the 168 LIAs invited to participate in the HV-BAT pilot study, 75 agreed to participate, and 45 across 14 states completed the HV-BAT. We estimated home visiting costs of approximately $8500 per family per year, but costs varied across LIAs (range $1970-$39,770; standard deviation = $5794). The marginal cost of adding a family declined as the number of families served by an LIA increased. Feedback from LIAs indicated that users had difficulty providing some details on costs (e.g., mileage for specific services), needed more detailed instructions, and desired a summary of subtotals and total costs reported in the HV-BAT. Conclusions The HV-BAT provides an approach to standardize cost data collection for home visiting programs. Pilot study results indicate that there may be significant economies of scale for home visiting services. This study provides preliminary estimates of costs that can help in program planning and budgeting.

Introduction to the Special Issue on Taking Home Visiting to Scale: Findings from the Maternal, Infant, and Early Childhood Home Visiting Program State-Led Evaluations

The Maternal, Infant and Early Childhood Home Visiting (MIECHV) Program is a two-generation approach to supporting healthy families through home visits during pregnancy and early childhood. All states and territories receiving MIECHV funding are encouraged to evaluate their programs. This special issue highlights evaluations from 11 awardees-Arkansas, Florida, Illinois, Iowa, Maryland, Massachusetts, Michigan, New Jersey, Oregon, Pennsylvania, and Tennessee. With the wide expansion of home visiting since the onset of MIECHV, the state-led evaluations contribute to the understanding of replication and scale-up of evidence-based home visiting.