Exploring Multilevel Factors for Family Engagement in Home Visiting Across Two National Models

Engagement Measures in Maltreatment Prevention Studies: A Scoping Review

Prevention services can promote public health by building protective factors and reducing maltreatment risk. Yet, engaging caregivers in prevention services presents a unique set of challenges. Measurement studies are important first steps to increase the knowledge of caregiver engagement in prevention services. The purpose of this scoping review was to investigate how family engagement has been measured and operationalized in the studies of maltreatment prevention/positive parenting programs. The review examined quantitative and mixed methods studies conducted in the U.S., which measured multiple dimensions of client engagement, including behavioral, attitudinal, and relational domains. A total of 88 studies selected from PubMed, CINAHL, ERIC, PsycINFO, Social Work Abstracts, Academic Search Premier, and Web of Science were included in this review. Results indicated that studies examine engagement constructs in all three domains of engagement with a primary focus on behavioral engagement. The attitudinal and relational engagement was mostly assessed through general satisfaction surveys, and a limited number of studies utilized validated measures to assess those constructs. While most studies reported acceptable internal reliabilities, only two studies reported other dimensions of psychometric qualities. Only one validated measure was found, which assessed client perceptions of provider cultural competence. More measurement studies are needed to further incorporate multiple dimensions of engagement into the studies of maltreatment prevention programs, which can inform the effort to develop tailored implementation strategies to fully engage various groups of parents in maltreatment prevention programs.

Cross-sector Collaboration Between Public Health, Healthcare and Social Services Improves Retention: Findings from a Nurse Home Visiting Program

The study aimed to examine the association between cross-sector collaboration in Nurse-Family Partnership (NFP), a model home visiting program, and participant retention. We used the 2018 NFP Collaboration Survey that measured agency-level collaboration, operationalized as relational coordination and structural integration, among nine community provider types (including obstetrics care, substance use treatment, child welfare). This dataset was linked to 2014-2018 NFP program implementation data (n = 36,900). We used random-intercept models with nurse-level random effects to examine the associations between provider-specific collaborations and participant retention adjusting for client, nurse, and agency characteristics. The adjusted models suggest that stronger relational coordination between nurses and substance use treatment providers (OR:1.177, 95% CI: 1.09-1.26) and greater structural integration with child welfare (OR: 1.062, CI: 1.04-1.09) were positively associated with participant retention at birth. Stronger structural integration between other home visiting programs and supplemental nutrition for women, infants, and children was negatively associated with participant retention at birth (OR: 0.985, CI: 0.97-0.99). Structural integration with child welfare remained significantly associated with participant retention at 12-month postpartum (OR: 1.032, CI: 1.01-1.05). In terms of client-level characteristics, clients who were unmarried, African-American, or visited by nurses who ceased NFP employment prior to their infant's birth were more likely to drop out of the NFP program. Older clients and high school graduates were more likely to remain in NFP. Visits by a nurse with a master's degree, agency rurality, and healthcare systems that implement the program were associated with participant retention. Cross-sector collaboration in a home visiting setting that bridges healthcare and addresses social determinants of health has potential to improve participant retention. This study sets the groundwork for future research to explore the implications of collaborative activities between preventive services and community providers.

The BEM Program: An innovative online parenting program for socioeconomically disadvantaged caregiver-child dyads in Brazil

Objective

To describe the BEM Program, an innovative online parenting program for socioeconomically disadvantaged caregiver-child dyads in Brazil.

Methods

The Template for Intervention Description and Replication checklist was used to describe the BEM Program in detail.

Results

The BEM Program (an acronym for Brincar Ensina Mudar in Portuguese, "Play Teaches Change" in English) refers to the change in adult, child, and dyad outcomes that can be observed through incorporating playful interactions between the caregiver and their child into their daily household chores. Content consisting of 8 videos and 40 text and audio messages was sent entirely online through WhatsApp®. Thus, the Program could be accessed wherever caregivers wanted, if they had their smartphone and Internet access.

Conclusions

The detailed description of an innovative online parenting program focused on caregiver-child interaction and child development contributes to the scarce evidence on this type of programs. Adherence to the program continues to represent one of the main challenges to overcome.

Characteristics Associated with Participant Attrition and Retention in a Perinatal Home Visiting Program

Using data from the Florida Maternal, Infant, and Early Childhood Home Visiting (MIECHV) funded programs, we examined program- and participant-level characteristics associated with participant retention by time of enrollment. Analyses of data for 1,807 women enrolled in 11 sites across three years included descriptive statistics; Kaplan-Meier survival curve estimation and multilevel survival analyses using shared frailty model to assess participant- and program-level characteristics overall and by time of enrollment (during pregnancy or post-delivery). Median retention time for MIECHV participants was 462 days. The primary reason for attrition was loss-to-follow-up (59.4%) due to change of address/telephone. We found participant age > 25 years (compared to < 20 years), enrollment during pregnancy, and an average of 1.5-2.0 home visit/month to be protective, while current/history of substance abuse was a risk factor for attrition. To improve participant retention, the Florida MIECHV program may need to bolster efforts to support housing stability, increase outreach and engagement to younger women, address barriers to achieving two home visits per month throughout the program, and target differential predictors of participant attrition depending on time of enrollment.

A Qualitative Study of Mothers' Perspectives on Enrolling and Engaging in an Evidence-Based Nurse Home Visiting Program

Prevention programs like Nurse-Family Partnership® (NFP) must enroll and retain clients of the intended population to maximize program impact. NFP is an evidence-based nurse home visitation program shown in randomized trials to improve maternal and child health and life course outcomes for first-time parents experiencing economic adversity, particularly for mothers with limited psychological resources. The purpose of this study was to understand enrollment and engagement experiences of mothers with previous live births referred to NFP in a formative study of the program for this population, but did not enroll or dropped out before program graduation. We used a grounded theory approach and purposively selected three NFP sites with variation in enrollment rates. We conducted telephone interviews with 23 mothers who were either referred to NFP and declined enrollment or former clients who dropped out before graduation. All interviews were conducted in English, recorded, transcribed, and validated. We developed an iterative codebook with multiple coders to analyze our data in NVivo11 and wrote thematic memos to synthesize data across study sites. Mothers described experiencing overlapping risk factors including physical and behavioral health conditions, child welfare involvement, and housing insecurity. Mothers from all sites discussed how they were referred to the NFP program, their experience of the enrollment process, reasons for enrolling or not enrolling, and reasons for dropping out after initial enrollment. Key themes that influenced mothers' decision-making were: perceptions of program value, not needing the program, their living situation or being too busy as a deterrence, and past experiences including a distrust of health care. Reasons for attrition were related to no longer needing the service, being assigned a new nurse, being too tired postpartum, and moving out of the service area. One way to support home visiting nurses in family enrollment and engagement is to build their professional capacity to implement trauma-informed strategies given mothers' life experiences.

Effects of Home Visiting Program Implementation on Preventive Health Care Access and Utilization: Results from a Randomized Trial of Healthy Families Oregon

Home visiting programs are an increasingly popular mechanism for providing a broad set of early prevention supports to high-risk families. A key intended outcome for these programs is to support maternal and child health by helping families increase access to and use of preventive health care services. For many community-based home visiting programs, however, there is less evidence of positive outcomes in the health care domain. The current study used a randomized trial conducted in a statewide early childhood home visiting program, Healthy Families Oregon (HFO), to examine program impacts on families' use of preventive health care services. The study recruited a large sample of participants (n = 1438 HFO families and n = 1289 controls) and utilized state agency health insurance and medical records as the primary data source. There were challenges in providing services in alignment with an intent-to-treat research design, leading to the need to take alternative approaches to analyzing effects of service receipt on outcomes. Results found that while there were no significant differences in health care access or utilization in the intent-to-treat models, positive outcomes were found when propensity score matching was used to limit the program sample to those who actually received services. Further, within the program group, children who were enrolled for longer had fewer gaps in health insurance coverage and received more well-baby visits and immunizations compared to those with less service. The role of the home visitor in helping families navigate the complexities of publicly funded health care is discussed. Investments in professional development strategies that can increase staff expertise in this area and improve family retention may be needed to more effectively achieve intended health outcomes.

Parent Involvement in Maternal, Infant, and Early Childhood Home Visiting Programs: an Integrative Review

Despite the evidence and investment in evidence-based federally funded maternal, infant, and early childhood home visiting, substantial challenges persist with parent involvement: enrolling, engaging, and retaining participants. We present an integrative review and synthesis of recent evidence regarding the influence of multi-level factors on parent involvement in evidence-based home visiting programs. We conducted a search for original research studies published from January 2007 to March 2018 using PubMed, Embase, Cochrane, and CINAHL databases. Twenty-two studies met criteria for inclusion. Parent and family characteristics were the most commonly studied influencing factor; however, consistent evidence for its role in involvement was scarce. Attributes of the home visitor and quality of the relationship between home visitor and participant were found to promote parent involvement. Staff turnover was found to be a barrier to parent involvement. A limited number of influencing factors have been adequately investigated, and those that have reveal inconsistent findings regarding factors that promote parent involvement in home visiting. Future research should move beyond the study of parent- and family-level characteristics and focus on program- and home visitor-level characteristics which, although still limited, have demonstrated some consistent association with parent involvement. Neighborhood characteristics have not been well studied and warrant future research.

Sustained Impact on Parenting Practices: Year 7 Findings from the Healthy Families New York Randomized Controlled Trial

Prevention of maltreatment and harsh parenting are the primary goals of evidence-based home visiting programs, but rigorous studies demonstrating long-term outcomes are limited despite widespread implementation. The current study examines data from a 7-year follow-up study of a randomized controlled trial of Healthy Family New York (HFNY). Specifically, the study examines whether HFNY participation predicts lower rates of harsh and abusive parenting 7 years after enrollment. The data include both maternal self-report of parenting behaviors as well as the target child's report of harsh parenting. The year 7 sample included 942 mother interviews (83.5% retention from baseline) and 800 child interviews. At the 7-year follow-up, maternal-reported behaviors measured by CTS-PC showed a significantly increased use of positive parenting strategies and lower levels of serious physical abuse in the HFNY group compared with the control group. Significant group differences were observed for the frequency with which mothers engaged in severe or very severe physical assault (control group = .16, compared with .03 in the intervention group, p < .001). In addition, fewer children reported that their parents used minor physical assault. There was no intervention impact on indicated child protective service records. The current study indicates that home visiting participation reduces harsh and abusive parenting and promotes positive parenting behaviors that endure and may strengthen later development.

Engagement in home visiting: An overview of the problem and how a coalition of researchers worked to address this cross-model concern

Home visiting is a widely supported intervention strategy for parents of young children who are in need of parenting skill improvement. However, parental engagement limits the potential public health impact of home visiting, as these programs often have low enrollment rates, as well as high attrition and low completion rates for those who enroll in these programs. The Coalition for Research on Engagement and Well-being (CREW) provided support for three pilot projects representing different home visiting models and aspects of engagement. The results of these pilot projects are presented in this special section. The purpose of this commentary is to introduce CREW and highlight the importance of a cross-model project to improve engagement among home visiting programs.

Parent And Caregiver Active Participation Toolkit (PACT): Adaptation for a Home Visitation Program

OBJECTIVES

Parent engagement poses a persistent challenge to home visitation (HV) programs. Previous work on parent engagement in HV has focused primarily on enrollment, attendance, and retention, with less attention on participation. The purpose of this study was to adapt an engagement toolkit originally developed for child mental health treatment settings, the Parent And Caregiver Active Participation Toolkit (PACT), and test the adapted toolkit in a HV program, SafeCare® (SC), with a focus on parent participation.

METHODS

Toolkit adaptation was informed by interviews/focus groups with parents and home visitors. Next, home visitors (n = 6) were trained to use adapted PACT for SC as part of SC delivery to 18 parents. A comparison group included 24 parents who received SC one year prior to this study. Analyses compared PACT for SC participants to the comparison group on parent participation and home visitor fidelity to assignment of homework. Qualitative and quantitative data from parents, home visitors, and supervisors (n = 4) assessed the acceptability, utility, appropriateness, and feasibility of PACT for SC.

RESULTS

Parents receiving PACT for SC had higher participation and reported greater home visitor fidelity to homework assignment than comparison parents. Parents found PACT for SC acceptable and useful as part of SC. Home visitors and supervisors identified some limitations in PACT for SC's utility but generally found it to be a positive, feasible addition to HV services.

CONCLUSIONS

Results suggest that enhancing HV programs with an engagement toolkit may improve parents' participation in services and providers' assignment of homework between sessions.

How do collective student behavior and other classroom contextual factors relate to teachers' implementation of an evidence-based intervention? A multilevel structural equation model

Building on prior work regarding the potential for peer contagion or deviance training in group delivered interventions (Dishion & Dodge, 2005, 2006; Dodge, Dishion, & Lansford, 2006), we leveraged data from a randomized trial, testing the integration of two preventive interventions (Promoting Alternative THinking Strategies and PAX Good Behavior Game), to explore the extent to which classroom contextual factors served as either a barrier to or a motivator for teachers to implement the evidence-based PAX Good Behavior Game with high frequency or dosage. We included students' baseline levels of behavior, measured with regard to both positive (i.e., engagement and social emotional skills) and negative (i.e., hyperactive and aggressive-disruptive) behaviors. Data were collected from 204 teachers in 18 urban elementary schools. A series of multilevel structural equation models were fit to the data. The analyses indicated that classrooms with higher classroom levels of aggressive behavior, on average, at baseline had teachers with lower implementation dosage (i.e., played fewer games) across the school year. In addition, teachers who reported higher baseline levels of emotional exhaustion, regardless of student behavior, also reported lower implementation dosage. Taken together, the results indicated that negative, but not positive, contextual factors at baseline were related to lower implementation dosage; this, in turn, suggests that negative contextual factors may serve as a barrier, rather than a motivator, of teachers' implementation dosage of classroom-based preventive interventions.

Addressing Maternal Depression, Substance Use, and Intimate Partner Violence in Home Visiting: a Quasi-Experimental Pilot Test of a Screen-and-Refer Approach

This quasi-experimental pilot study describes preliminary impacts of the "Home Visitation Enhancing Linkages Project (HELP)," a pragmatic screen-and-refer approach for promoting identification of and linkage to treatment for maternal depression (MD), substance use (SU), and intimate partner violence (IPV) within early childhood home visiting. HELP includes screening for MD, SU, and IPV followed by a menu of motivational interviewing and case management interventions aimed at linking clients to treatment, designed for delivery within routine home visiting. HELP was piloted within four counties of a statewide home visiting system that were implementing Healthy Families America. HELP clients (N = 394) were compared to clients in five demographically matched counties that received usual Healthy Families services (N = 771) on whether their home visitors (1) identified MD, SU, and IPV risk; (2) discussed MD, SU, and IPV during home visits; and (3) made referrals for MD, SU, and IPV. All data were extracted from the program's management information system. A significant impact of HELP was found on discussion of risk in home visits for all three risk domains with large effect sizes (MD OR = 4.08; SU OR = 15.94; IPV OR = 9.35). HELP had no impact on risk identification and minimal impact on referral. Findings provide preliminary support for HELP as a way of improving discussion of client behavioral health risks during home visits, an important first step toward better meeting these needs within home visiting. However, more intensive intervention is likely needed to impact risk identification and referral outcomes.

Principles of Precision Prevention Science for Improving Recruitment and Retention of Participants

Precision medicine and precision public health focus on identifying and providing the right intervention to the right population at the right time. Expanding on the concept, precision prevention science could allow the field to examine prevention programs to identify ways to make them more efficient and effective at scale, including addressing issues related to engagement and retention of participants. Research to date on engagement and retention has often focused on demographics and risk factors. The current paper proposes using McCurdy and Daro (Family Relations, 50, 113-121, 2001) model that posits a complex mixture of individual, provider, program, and community-level factors synergistically affect enrollment, engagement, and retention. The paper concludes recommending the use of research-practice partnerships and innovative, rapid cycle methods to design and improve prevention programs related to participant engagement and retention at scale.

Quality of delivery of "right@home": Implementation evaluation of an Australian sustained nurse home visiting intervention to improve parenting and the home learning environment

Background

Home visiting programs are implemented in high income countries to improve outcomes for families with young children. Significant resources are invested in such programs and high quality evaluations are important. In the context of research trials, implementation quality is often poorly reported and, when reported, is variable. This paper presents the quality of implementation of the right@home program, a sustained nurse home visiting intervention trialled in Australia, and delivered in a ‘real world’ context through usual child and family health services. right@home is structured around the core Maternal Early Childhood Sustained Home-visiting (MECSH) program, which is a salutogenic, child focused prevention model.

Method

At each visit right@home practitioners completed a checklist detailing the client unique identifier, date of contact and activities undertaken. These checklists were collated to provide data on intervention dose, retention to program completion at child age 2 years, and visit content, which were compared with the program schedule. Quality of family-provider relationship was measured using the Session Rating Scale. Exploratory factor analysis was conducted to identify clusters of activities and allow qualitative assessment of concordance between program aims and program delivery.

Results

Of 363 intervention families offered the program, 352 (97·0%) commenced the program and 304 (87·3%) completed the program to child age 2 years. 253 of 352 (71·9%) families who commenced the program received more than 75 percent of scheduled visits including at least one antenatal visit. Families rated the participant-practitioner relationship highly (mean 39.4/40). The factor analysis identified six antenatal and six postnatal components which were concordant with the program aims.

Conclusions

The right@home program was delivered with higher adherence to program dose, schedule and content, and retention than usually reported in other home visiting research. Program compliance may have resulted from program design (visit schedule, dose, content and delivery flexibility) that was consistent with family aims.

Mother and Home Visitor Emotional Well-Being and Alignment on Goals for Home Visiting as Factors for Program Engagement

Objectives Family engagement in home visiting (HV), as indicated by length of enrollment, is a major challenge as most families do not stay enrolled for the intended duration prescribed by HV models. This study examined maternal and visitor emotional well-being as factors for maternal satisfaction with the program in addressing reasons for enrolling in HV and program engagement and the role of their working alliance with the visitor as a mediator of this. Methods Longitudinal data were collected from 148 mothers and 54 visitors in 21 HV programs. Mothers completed surveys shortly after enrolling and 6 months later to assess attributes of the working alliance with their visitor. Visitors completed a survey to assess work-related well-being. HV program data were used to measure engagement. Results Mothers enrolled for multiple, diverse reasons, most often to promote child development and parenting (96%). Mothers’ satisfaction with program efforts to address reasons for enrollment was highest for parenting (79%) and lowest for jobs and education (30%). Results of the mediational path model indicated that ratings of the visitor on goal alignment were positively associated with engagement. Maternal emotional availability and visitor work-related emotional exhaustion were negatively associated with engagement. Exploratory analyses suggested that ratings of the visitor on goal alignment were a stronger predictor of engagement for mothers with low emotional availability compared to other mothers. Conclusions for Practice Visitor alignment with mothers on goals and responsiveness to reasons for enrolling appear to be effective in promoting engagement. Individualizing services to reflect maternal goals and emotional capacity may be important strategies to address engagement challenges.