Conceptualizing and measuring sustainability of prevention programs, policies, and practices

A large knowledge gap exists regarding the measurement of sustainability of evidence-based prevention programs for mental and behavioral health. We interviewed 45 representatives of 10 grantees and 9 program officers within 4 Substance Abuse and Mental Health Services Administration prevention grant initiatives to identify experiences with implementation and sustainability barriers and facilitators; what "sustainability" means and what it will take to sustain their programs; and which Consolidated Framework for Implementation Research (CFIR) elements are important for sustainability. Lists of sustainability determinants and outcomes were then compiled from each data set and compared with one another. Analysis of themes from interviews and free lists revealed considerable overlap between sustainability determinants and outcomes. Four sustainability elements were identified by all three data sets (ongoing coalitions, collaborations, and networks and partnerships; infrastructure and capacity to support sustainability; community need for program; and ongoing evaluation of performance and outcomes), and 11 elements were identified by two of three data sets (availability of funding; consistency with organizational culture; evidence of positive outcomes; development of a plan for implementation and sustainment; presence of a champion; institutionalization and integration of program; institutional support and commitment; community buy-in and support; program continuity; supportive leadership; and opportunities for staff training). All but one of the CFIR domain elements (pressure from other states, tribes, or communities) were endorsed as important to sustainability by 50% or more of participants. It may be more important to implement a standardized process of eliciting determinants and outcomes of sustainability than to implement a single standardized instrument.

Challenges and opportunities in the science of research to practice: lessons learned from a randomized controlled trial of a sexual risk-reduction intervention for psychiatric patients in a public mental health system

Objective:

Human immunodeficiency virus (HIV) prevention efficacy trials with psychiatric patients have been conducted in research settings in high-resourced countries, establishing short-term efficacy for reducing sexual risk behavior. None has been implemented within systems of care. In the last decade, overcoming this research-to-practice gap has become a focus of implementation science. This paper describes the first and only HIV Prevention intervention trial for psychiatric patients conducted in real-world outpatient psychiatric settings facilitated by trained clinic-based providers.

Methods:

The HIV Prevention intervention, which uses the Information-Motivation-Behavioral Skills model to achieve sexual risk-reduction, was rigorously adapted to the local context and clinic services’ needs. Participants from eight clinics were randomized to HIV Prevention or Health Promotion conditions.

Results:

HIV Prevention participants showed significant improvement in Information-Motivation-Behavioral domains; in this group, behavioral intentions were associated with significantly fewer unprotected sex occasions, but reduction of unprotected sex occasions was similar in both conditions.

Conclusion:

Our trial was conducted before implementation studies became widely funded. Transporting an intervention to a new culture or into real-world practice settings may require adaptations. Our results demonstrate that clear guidelines are needed regarding whether to conduct efficacy, effectiveness, and/or implementation research as the most appropriate next step.

Clinical trial registration:

NCT00881699

Barriers to Implementing a Group Treatment for Maternal Depression in Head Start: Comparing Staff Perspectives

Although providing depression treatment for Head Start mothers may improve child wellbeing, interventions have not been widely used for this purpose. This failure may be due to the characteristics of clients, interventions, or the systems of care in which services are delivered. This study explored barriers to implementing Interpersonal Psychotherapy-Group with ethnic minority Head Start mothers, including differences in the level of staff consensus regarding barriers, which may predict implementation success. Barriers included resource challenges, cultural and linguistic differences, and participant concerns, and staff demonstrated low to moderate consensus. Results emphasize the importance of engaging diverse stakeholders in implementation.

Widowhood, leisure activity engagement, and cognitive function among older adults

OBJECTIVES

Maintaining cognitive function is an essential aspect of successful aging. Widowhood is a salient life transition that can affect older adults' cognitive function. Leisure engagement has received increasing attention because it is still modifiable in later life to help prevent cognitive decline. Nonetheless, limited longitudinal studies have examined how widowhood influences cognitive function, and even fewer studies have tested the role of leisure activities in this relationship.

METHOD

This study delineated the mechanism of widowhood, leisure activity engagement, and cognitive function among older adults using a national longitudinal dataset, the Health and Retirement Study, and its supplementary dataset, the Consumption and Activities Mail Survey, which repeatedly measured individuals' leisure activity engagement.

RESULTS

Findings showed no significant association between widowhood and cognitive function during a 4-year period. However, engagement in mental activities moderated the impact of widowhood on cognitive function. Specifically, the benefit of mental activity engagement on cognition was more pronounced among individuals who were recently widowed compared to those who were married. This implies a protective role of mental activities in the relationship between widowhood and cognitive function.

CONCLUSION

Interventions with mentally stimulating activities at the community level to retain cognition among individuals in early phase widowhoodare suggested. Future studies are necessary to explore whether other factors such as changes in physical and mental health and intergenerational support from adult children during widowhood may further influence this mechanism among widowhood, leisure activities, and cognitive function.

Implementing Evidence-Based HIV Prevention for Female Sex Workers in Mexico: Provider Assessments of Feasibility and Acceptability

This study examined service provider perceptions of feasibility and acceptability of implementing evidence-based practices for preventing HIV/AIDS and STIs in female sex workers (FSWs) in Mexico. Semi-structured interviews were conducted with 124 directors, supervisors and counselors from 12 reproductive health clinics located throughout Mexico participating in a large randomized controlled trial to scale-up the use of a psychoeducational intervention designed to promote FSW condom use and enhance safer sex negotiation skills. Feasibility was based on assessment of personal, organizational and social costs, benefits, and capacity. Costs included anxiety over intervention competency, purchase of condoms and other supplies, expenses of laboratory tests for HIV/STIs, and stigma associated with FSWs. Benefits included increase in personal knowledge and experience, enhanced clinic reputation and service delivery capacity, and increased public health. Capacity was expressed in terms of provider skills to deliver the intervention and additional workload. Acceptability was expressed in terms of provider enthusiasm in delivering these services and FSWs willingness to receive the services. Service provider evaluations of feasibility and acceptability of implementing evidence-based prevention interventions are grounded in local contexts that define costs and benefits of and capacity for implementation and determine features of the intervention and its implementation that are acceptable.

Promoting Enrollment in Parenting Programs Among a Filipino Population: A Randomized Trial

BACKGROUND AND OBJECTIVES

Evidence-based parenting programs prevent the onset and escalation of youth conduct problems. However, participation rates in such programs are low among hard-to-reach populations, including Filipino individuals. Compared with other ethnic groups, Filipino adolescents have significant mental health disparities. We evaluated the effectiveness of a theory-based, culturally tailored video versus a usual-care mainstream video on enrollment in an evidence-based parenting program among Filipino caregivers of children ages 6 to 12 years and tested theoretical mediators of intervention effect.

METHODS

We randomly assigned 215 Filipino participants to view either a theory-based, culturally tailored video based on the Health Belief Model and Theory of Planned Behavior or a control video. The primary outcome was actual enrollment in an evidence-based parenting intervention. Mediators (knowledge and perceived susceptibility) were modeled as latent variables in a structural equation model.

RESULTS

After the intervention, participants in the intervention group had significantly higher knowledge of Filipino adolescent behavioral health disparities and higher perceived susceptibility to adolescent risky sexual activity and illegal drug use. Controlling for child sex, parents in the intervention group had significantly greater odds of actual enrollment in the Incredible Years program (odds ratio = 2.667; 95% confidence interval: 1.328-5.354; P = .006). The intervention effects were mediated by increased knowledge and perceived susceptibility.

CONCLUSIONS

Results demonstrated the effectiveness of a theory-based, culturally tailored intervention aimed at increasing participation of a hard-to-engage population in parenting interventions. Videos that include parents and health professionals with whom audiences can identify can be used to produce shifts in knowledge and behavior.

Innovations in Mixed Methods Evaluations

Mixed methods research-i.e., research that draws on both qualitative and quantitative methods in varying configurations-is well suited to address the increasing complexity of public health problems and their solutions. This review focuses specifically on innovations in mixed methods evaluations of intervention, program or policy (i.e., practice) effectiveness, and implementation. The article begins with an overview of the structure, function, and process of different mixed methods designs and then provides illustrations of their use in effectiveness studies, implementation studies, and combined effectiveness-implementation hybrid studies. The article then examines four specific innovations: procedures for transforming (or "quantitizing") qualitative data, application of rapid assessment and analysis procedures in the context of mixed methods studies, development of measures to assess implementation outcomes, and strategies for conducting both random and purposive sampling, particularly in implementation-focused evaluation research. The article concludes with an assessment of challenges to integrating qualitative and quantitative data in evaluation research.

Operationalizing the 'pragmatic' measures construct using a stakeholder feedback and a multi-method approach

Context

Implementation science measures are rarely used by stakeholders to inform and enhance clinical program change. Little is known about what makes implementation measures pragmatic (i.e., practical) for use in community settings; thus, the present study’s objective was to generate a clinical stakeholder-driven operationalization of a pragmatic measures construct.

Evidence acquisition

The pragmatic measures construct was defined using: 1) a systematic literature review to identify dimensions of the construct using PsycINFO and PubMed databases, and 2) interviews with an international stakeholder panel (N = 7) who were asked about their perspectives of pragmatic measures.

Evidence synthesis

Combined results from the systematic literature review and stakeholder interviews revealed a final list of 47 short statements (e.g., feasible, low cost, brief) describing pragmatic measures, which will allow for the development of a rigorous, stakeholder-driven conceptualization of the pragmatic measures construct.

Conclusions

Results revealed significant overlap between terms related to the pragmatic construct in the existing literature and stakeholder interviews. However, a number of terms were unique to each methodology. This underscores the importance of understanding stakeholder perspectives of criteria measuring the pragmatic construct. These results will be used to inform future phases of the project where stakeholders will determine the relative importance and clarity of each dimension of the pragmatic construct, as well as their priorities for the pragmatic dimensions. Taken together, these results will be incorporated into a pragmatic rating system for existing implementation science measures to support implementation science and practice.

Factors associated with program effectiveness in the implementation of a sexual risk reduction intervention for female sex workers across Mexico: Results from a randomized trial

OBJECTIVE

The overall aim of this paper is to examine effectiveness of an evidence-based intervention in community settings, and the factors associated with effectiveness. Limited research in the area of HIV prevention has focused on evaluating intervention program effectiveness in real-world settings.

METHODS

We implemented an efficacious theory-based sexual risk reduction intervention for female sex workers (FSW) called Mujer Segura across 13 different clinics in 13 sites across Mexico. The overall design was a cluster randomized Type I design simultaneously testing intervention program effectiveness with an observational study of implementation factors. We aimed to examine the effectiveness of Mujer Segura at reducing HIV/STI incidence among FSW participants at each site, and to examine the client-, provider-, organization-, and structure-related factors associated with program effectiveness.

RESULTS

We found lower HIV/STI incidence density in the intervention relative to the control group in 5 sites we labeled as "program effective sites," but not in 8 sites we labeled as "program ineffective sites." Using generalized estimating equations controlling for site and computed mean difference effect sizes, we examined statistically and practically significant differences, respectively, between the two groups of sites along various client-, provider-, organization-, and structure-related characteristics. Results indicated that client-level HIV/AIDS related knowledge, and proficiency and engagement in the organizational social context were associated with program effectiveness.

CONCLUSIONS

Enormous resources are required to systematically and adequately test the role of multilevel factors on program effectiveness. We successfully implemented Mujer Segura in 13 sites in Mexico. Results suggest that other measures may need to be included in future implementation studies than the ones included here. We were able to point to a few specific factors that should be targeted to increase effectiveness of similar evidence-based programs in low- and other middle-income countries like Mexico.

TRIAL REGISTRATION

ClinicalTrials.gov NCT01465607.

Correlates of Domestic Violence Victimization Among North Korean Refugee Women in South Korea

Although many North Korean (NK) refugee women are victims of domestic violence (DV) in North Korea, face sexual exploitation during migration, and remain at risk of DV while adapting to life in South Korea, there is no empirical evidence about risk factors for DV in this population. To fill this gap, this study examined whether gender role beliefs, child abuse history, and sociocultural adaptation were associated with past-year physical, emotional, sexual, and economic abuse, and whether they were associated with multiple forms of abuse. We also explored whether these associations were similar or different across different types of DV among NK refugee women. A sample of 180 ever-married NK refugee women in South Korea from the 2010 National Survey on Family Violence was used for analysis. Physical abuse was associated with more traditional gender role beliefs; emotional abuse and multiple forms of abuse were associated with lower levels of sociocultural adaptation; and sexual and economic abuse were associated with an increased likelihood of childhood abuse and poor sociocultural adaptation. Our study findings underscore the importance of assisting NK refugee women to be better adapted to the new culture in a practical way, because better sociocultural adaptation might protect them from experiencing various types of abuse. At the same time, findings of this study highlight the need for empowering NK refugee women who report physical abuse by educating their rights and altering their traditional beliefs of gender roles, and screening of childhood abuse and providing culturally sensitive psychotherapy to those who report sexual or economic abuse. Moreover, we suggest future studies to examine correlates of different forms of abuse separately because they can inform culturally tailored interventions for abused NK refugee women. To prevent further victimization, educational programs should be provided to NK refugee women at an early stage of resettlement in South Korea.

Agency Leaders' Assessments of Feasibility and Desirability of Implementation of Evidence-Based Practices in Youth-Serving Organizations Using the Stages of Implementation Completion

Background: This study examined influences on the decisions of administrators of youth-serving organizations to initiate and proceed with implementation of an evidence-based practice (EBP).

Methods: Semi-structured interviews, developed using the Stages of Implementation Completion (SIC) as a framework, were conducted with 19 agency chief executive officers and program directors of 15 organizations serving children and adolescents.

Results: Agency leaders' self-assessments of implementation feasibility and desirability prior to implementation (Pre-implementation) were influenced by intervention affordability, feasibility, requirements, validity, reliability, relevance, cost savings, positive outcomes, and adequacy of information; availability of funding, support from sources external to the agency, and adequacy of technical assistance; and staff availability and attitudes toward innovation in general and EBPs in particular, organizational capacity, fit between the EBP and agency mission and capacity, prior experience with implementation, experience with seeking evidence, and developing consensus. Assessments during the Implementation phase included intervention flexibility and requirements; availability of funding, adequacy of training and technical assistance, and getting sufficient and appropriate referrals; and staffing and implementing with fidelity. Assessments during the Sustainment phase included intervention costs and benefits; availability of funding, support from sources outside of the agency, and need for the EBP; and the fit between the EBP and the agency mission.

Discussion: The results point to opportunities for using agency leader models to develop strategies to facilitate implementation of evidence-based and innovative practices for children and adolescents. The SIC provides a standardized framework for guiding agency leader self-assessments of implementation.

Retirement, Leisure Activity Engagement, and Cognition Among Older Adults in the United States

Objective: Retirement is a salient later-life transition that may influence cognition. Leisure activities can help individuals better adjust to life after significant life transitions. This study examined the role of leisure activity engagement in the relationship between retirement and cognition. Method: A path analysis (N = 2,827) was conducted using three waves of the Health and Retirement Study (2004, 2006, 2008) and its supplementary Consumption and Activities Mail Survey, to test the association between retirement (categorized as remained working, transitioned to retirement, remained retired) and cognition (memory, working memory, attention, and processing speed) via leisure (mental, physical, social, household) activity engagement. Results: Older adults who remained retired showed significantly lower cognition than those who remained working. Moreover, this negative association between retirement and cognition was attenuated by greater engagement mental activities. Discussion: Interventions that encourage mental activities among retired individuals are strongly suggested to help maintain cognitive function.

Socio-contextual Determinants of Research Evidence Use in Public-Youth Systems of Care

Recent efforts have been devoted to understanding the conditions by which research evidence use (REU) is facilitated from the perspective of system leaders in the context of implementing evidence-based child mental health interventions. However, we have limited understanding of the extent to which outer contextual factors influence REU. Outer contextual factors for 37 counties in California were gathered from public records in 2008; and child welfare, juvenile justice, and mental health system leaders' perceptions of their REU were measured via a web-based survey from 2010 to 2012. Results showed that leaders with higher educational attainment and in counties with lower expenditures on inpatient mental health services were significantly associated with higher REU. Positive relationships between gathering research evidence and racial minority concentration and poverty at the county level were also detected. Results underscore the need to identify the organizational and socio-political factors by which mental health services and resources meet client demands that influence REU, and to recruit and retain providers with a graduate degree to negotiate work demands and interpret research evidence.

Voices of the Filipino Community Describing the Importance of Family in Understanding Adolescent Behavioral Health Needs

Filipinos are a large, yet invisible, minority at high risk for adolescent behavioral health problems. Limited research describes the family as offering a source of positive support for some Filipino youths and yet for some it is also a source of stress and isolation, leading to struggles with adolescent depression and suicidal behavior. This article describes a qualitative study that investigates the role of family when understanding behavioral health needs among Filipino adolescents. Findings highlight the importance of addressing family cohesion when designing interventions aimed at improving the well-being of Filipino youth.

Use of Research Evidence and Implementation of Evidence-Based Practices in Youth-Serving Systems

Although the effectiveness of interventions for prevention and treatment of mental health and behavioral problems in abused and neglected youth is demonstrated through the accumulation of evidence through rigorous and systematic research, it is uncertain whether use of research evidence (URE) by child-serving systems leaders increases the likelihood of evidence- based practice (EBP) implementation and sustainment. Information on URE was collected from 151 directors and senior administrators of child welfare, mental health and juvenile justice systems in 40 California and 11 Ohio counties participating in an RCT of the use of community development teams (CDTs) to scale up implementation of Treatment Foster Care Oregon over a 3 year period (2010-12). Separate multivariate models were used to assess independent effects of evidence acquisition (input), evaluation (process), application (output), and URE in general (SIEU Total) on two measures of EBP implementation, highest stage reached and proportion of activities completed at pre-implementation, implementation and sustainment phases. Stage of implementation and proportion of activities completed in the implementation and sustainment phases were independently associated with acquisition of evidence and URE in general. Participation in CDTs was significantly associated with URE in general and acquisition of research evidence in particular. Implementation of EBPs for treatment of abused and neglected youth does appear to be associated with use of research evidence, especially during the later phases.

Self-care behavior change and depression among low-income predominantly Hispanic patients in safety-net clinics

This study examined whether changes in self-care behaviors during a 12-month period predicted the likelihood of screening positive for depression concurrently and prospectively among low-income Hispanic patients with diabetes. Secondary analyses were conducted with longitudinal data collected from a randomized controlled trial that had tested effectiveness of collaborative depression care. We examined whether changes in self-care behaviors observed during the 12 months after baseline predicted the likelihood of screening positive for depression at 12-, 18-, and 24-month follow-up. Self-care behaviors included healthy diet, exercise, self-blood glucose monitoring, and foot care, which were measured by a validated self-reported instrument. Logistic regression analyses indicated that patients with more frequent healthy diet during the 12 months after baseline had significantly lower likelihood of depression. Patients with more frequent exercise had a lower likelihood of screening for depression at 18- and 24-month follow-up. No significant association was found with self-blood glucose monitoring and foot care. These findings suggest the importance of integrated care that emphasizes healthy diet and exercise, together with traditional depression treatment, when helping low-income Hispanic patients with diabetes and comorbid depression.

Parent-reported stigma and child anxiety: A mixed methods research study

BACKGROUND

Stigma has been frequently cited as a barrier to service use for various mental health problems. Studies suggest that stigma may be greater for childhood mental health problems that are perceived as more atypical.

AIMS

This study utilized a mixed methods research design (qual + QUAN) to examine parental endorsement of stigma and its impact on service utilization among children with significant anxiety-a common childhood problem frequently perceived as normative.

METHODS

Semi-structured qualitative interviews were conducted with 29 parents of anxious children. Qualitative data were coded using a grounded theory approach, and stigma-related responses were examined for emergent themes. Quantitative data was analyzed with frequency counts and chi-square analysis.

RESULTS

Stigma related to children's anxiety symptoms and seeking mental health services was reported by 41.3% (n = 12) of parents. Emergent themes included: 1) Parental Concern for Negative Consequences, 2) Parent Internalized Stigma, and 3) Negative Associations with Mental Health Treatment. Latino parents discussed stigma more frequently than non-Latino White parents (70% vs. 17.6%, respectively, X²(1, N = 27) = 5.33, p < 0.05).

CONCLUSIONS

Although anxiety is a common childhood problem, stigma is still frequently reported by parents and may be an important barrier to mental health service use, especially among Latino youth.

Adoption of innovative and evidence-based practices for children and adolescents in state-supported mental health clinics: a qualitative study

Background

This study examined how mental health clinic administrators decided whether or not to adopt evidence-based and other innovative practices by exploring their views of implementation barriers and facilitators and operation of these views in assessment of implementation costs and benefits.

Methods

Semi-structured interviews were conducted with 75 agency chief executive officers and program directors of 34 New York State-licensed mental health clinics serving children and adolescents.

Results

Three interconnected themes relating to barriers and facilitators were identified, namely costs and benefits associated with adoption, capacity for adoption, and acceptability of new practices. The highest percentage of participants (86.7%) mentioned costs as a barrier, followed by limited capacity (55.9%) and lack of acceptability (52.9%). The highest percentage (82.3%) of participants identified available capacity as a facilitator, followed by acceptability (41.2%) and benefits or limited costs (24.0%). Assessment of costs and benefits exhibited several principles of behavioural economics, including loss aversion, temporal discounting use of heuristics, sensitivity to monetary incentives, decision fatigue, framing, and environmental influences.

Conclusions

The results point to opportunities for using agency leader models to develop strategies to facilitate implementation of evidence-based and innovative practices for children and adolescents.

An Overview of Research and Evaluation Designs for Dissemination and Implementation

The wide variety of dissemination and implementation designs now being used to evaluate and improve health systems and outcomes warrants review of the scope, features, and limitations of these designs. This article is one product of a design workgroup that was formed in 2013 by the National Institutes of Health to address dissemination and implementation research, and whose members represented diverse methodologic backgrounds, content focus areas, and health sectors. These experts integrated their collective knowledge on dissemination and implementation designs with searches of published evaluations strategies. This article emphasizes randomized and nonrandomized designs for the traditional translational research continuum or pipeline, which builds on existing efficacy and effectiveness trials to examine how one or more evidence-based clinical/prevention interventions are adopted, scaled up, and sustained in community or service delivery systems. We also mention other designs, including hybrid designs that combine effectiveness and implementation research, quality improvement designs for local knowledge, and designs that use simulation modeling.

A Conceptual Model to Assess Stress-Associated Health Effects of Multiple Ecosystem Services Degraded by Disaster Events in the Gulf of Mexico and Elsewhere

Few conceptual frameworks attempt to connect disaster-associated environmental injuries to impacts on ecosystem services (the benefits humans derive from nature) and thence to both psychological and physiological human health effects. To our knowledge, this study is one of the first, if not the first, to develop a detailed conceptual model of how degraded ecosystem services affect cumulative stress impacts on the health of individual humans and communities. Our comprehensive Disaster-Pressure State-Ecosystem Services-Response-Health (DPSERH) model demonstrates that oil spills, hurricanes, and other disasters can change key ecosystem components resulting in reductions in individual and multiple ecosystem services that support people's livelihoods, health, and way of life. Further, the model elucidates how damage to ecosystem services produces acute, chronic, and cumulative stress in humans which increases risk of adverse psychological and physiological health outcomes. While developed and initially applied within the context of the Gulf of Mexico, it should work equally well in other geographies and for many disasters that cause impairment of ecosystem services. Use of this new tool will improve planning for responses to future disasters and help society more fully account for the costs and benefits of potential management responses. The model also can be used to help direct investments in improving response capabilities of the public health community, biomedical researchers, and environmental scientists. Finally, the model illustrates why the broad range of potential human health effects of disasters should receive equal attention to that accorded environmental damages in assessing restoration and recovery costs and time frames.

Evidence Use in Mental Health Policy Making for Children in Foster Care

Considerable attention is being given to the use of research evidence to inform public policy making. Building upon Weiss's model of research utilization, we examined the types and uses of evidence that child welfare administrators used in response to federal policy reforms requiring psychotropic medications oversight for children in foster care. Participants relied on a range of "global" and "local" evidence types throughout the policy development phase. Global research evidence was used to raise awareness about problems associated with psychotropic medication use. Local evidence helped to contextualize concerns and had problem-solving and political uses. In most states, policy actions were informed by a combination of evidence types.

Effect of the Antarctic environment on hormone levels and mood of Chinese expeditioners

BACKGROUND

Serum thyroid hormones, plasma catecholamines and mood were examined in 10 male members of the 16th Chinese Antarctic Expedition who spent the 2000 austral winter at Great Wall Station.

STUDY DESIGN

Samples were taken prior to deployment to Antarctica (December, 1999) and upon return to China 54 weeks later (December, 2000). The expeditioners also completed the Profile of Mood States (POMS) each month over an 8-month period (April through November, 2000).

RESULTS

There was a significant decrease in levels of serum total thyroxine (p < 0.01) and plasma epinephrine (p < 0.05), and a significant increase in serum TSH (p < 0.01). With the exception of a significant decline in level of vigor (p = 0.008), there were no significant changes in mood throughout the expedition. Low levels of pre- and post-deployment total triiodothyronine and high levels of TSH were significantly associated with high levels of tension-anxiety, depression, anger, confusion, and total mood disturbance at the beginning and end of winter. High levels of TSH were also significantly associated with high levels of fatigue (p < 0.001), while low levels of total thyroxine were significantly associated with high levels of tension-anxiety (p < 0.001), depression (p < 0.05), and total mood disturbance (p < 0.05). Low levels of dopamine were significantly associated with high levels of tension-anxiety (p < 0.05). An increase in anger during the austral winter was significantly associated with an increase in adrenaline during the expedition (p < 0.05).

CONCLUSION

The increase in TSH, and its association with mood, is consistent with the polar T3 syndrome, while the absence of changes in free triiodothyronine and thyroxine may reflect characteristics of the environment, or racial/ethnic differences in psychophysiological, or socio-cultural adaptation to circumpolar environments.

Incidence of psychiatric disorders after extended residence in Antarctica

OBJECTIVES

The incidence of psychiatric disorders and depressive symptoms was examined in a cohort of American men and women who spent an austral winter at two different research stations in Antarctica to determine whether extended residence of nonindigenous inhabitants in a polar region is associated with psychiatric morbidity.

STUDY DESIGN

Debriefings interviews with 220 men and 93 women were conducted by 3 psychiatrists and 1 clinical psychologist at McMurdo Station and South Pole Station at the end of the austral winter between 1994 and 1997. Crewmembers were assigned a DSM-IV diagnosis if they satisfied diagnostic criteria. Debriefed crewmembers also completed the Structured Interview Guide for the Hamilton Depression Inventory-Seasonal Affective Disorders version (SIGH-SAD).

RESULTS

Thirty-nine (12.5%) crewmembers presented with symptoms that met the criteria for one or more DSM-IV disorders. After weighting the prevalence to account for the low participation rate of civilian personnel, the incidence of DSM-IV disorders was 5.2%. Mood disorders were the most common diagnoses, accounting for 30.2% of all diagnoses, followed by adjustment disorders (27.9%), sleep-related disorders (20.9%), personality disorders (11.6%), and substance-related disorders (9.3%). Depressive symptoms as measured by the SAD-SIGH were significantly associated with female gender, military occupation, station, year of expedition, and DSM-IV diagnosis.

CONCLUSION

Differences in the distribution of symptoms and diagnoses by demographic and expedition characteristics suggests that the social environment may be a more powerful determinant than the physical environment of psychiatric disorders in a polar region.

Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research

Purposeful sampling is widely used in qualitative research for the identification and selection of information-rich cases related to the phenomenon of interest. Although there are several different purposeful sampling strategies, criterion sampling appears to be used most commonly in implementation research. However, combining sampling strategies may be more appropriate to the aims of implementation research and more consistent with recent developments in quantitative methods. This paper reviews the principles and practice of purposeful sampling in implementation research, summarizes types and categories of purposeful sampling strategies and provides a set of recommendations for use of single strategy or multistage strategy designs, particularly for state implementation research.

Optimal Design and Purposeful Sampling: Complementary Methodologies for Implementation Research

Optimal design has been an under-utilized methodology. However, it has significant real-world applications, particularly in mixed methods implementation research. We review the concept and demonstrate how it can be used to assess the sensitivity of design decisions and balance competing needs. For observational studies, this methodology enables selection of the most informative study units. For experimental studies, it entails selecting and assigning study units to intervention conditions in the most informative manner. We blend optimal design methods with purposeful sampling to show how these two concepts balance competing needs when there are multiple study aims, a common situation in implementation research.

Communication Delays Impact Behavior and Performance Aboard the International Space Station

INTRODUCTION

Long-duration space explorations will involve significant communication delays that will likely impact individual and team outcomes. However, the extent of these impacts and the appropriate countermeasures for their mitigation remain largely unknown. This study examined the feasibility and acceptability of utilizing the International Space Station (ISS) as a research platform to assess the impacts of communication delays on individual and team behavior and performance.

METHODS

For this study, 3 ISS crewmembers and 18 mission support personnel performed 10 tasks identified by subject matter experts as meeting study criteria, 6 tasks without a delay in communication and 4 tasks with a 50-s one-way delay. Assessments of individual and team performance and behavior were obtained after each task. The completion rate of posttask assessments and postmission interviews with astronauts were used to assess feasibility and acceptability.

RESULTS

Posttask assessments were completed in 100% of the instances where a crewmember was assigned to a task and in 83% where mission support personnel were involved. Qualitative analysis of postmission interviews found the study to be important and acceptable to the three astronauts. However, they also reported the study was limited in the number and type of tasks included, limitations in survey questions, and preference for open-ended to scaled items.

DISCUSSION

Although the ISS is considered a high fidelity analog for long-duration space missions, future studies of communication delays on the ISS must take into considerations the constraints imposed by mission operations and subject preferences and priorities. Kintz KM, Palinkas LA. Communication delays impact behavior and performance aboard the International Space Station. Aerosp Med Hum Perform. 2017; 87(11):940-946.

Measuring Use of Research Evidence: The Structured Interview for Evidence Use

OBJECTIVES

This article describes the Standard Interview for Evidence Use (SIEU), a measure to assess the level of engagement in acquiring, evaluating, and applying research evidence in health and social service settings.

METHOD

Three scales measuring input, process, and output of research evidence and eight subscales were identified using principal axis factor analysis and parallel analysis of data collected from 202 state and county child welfare, mental health, and juvenile justice systems leaders.

RESULTS

The SIEU scales and subscales demonstrate strong internal consistency as well as convergent and discriminant validity.

CONCLUSIONS

The SIEU is easy to use and can be administered as a complete scale or as three smaller scales to separately examine evidence in acquisition, evaluation, or application. The measure demonstrates potential in understanding the role of research evidence in service settings and in monitoring the process of evidence-based practice and application of scientific principles in social work practice.

Testing the Community-Based Learning Collaborative (CBLC) implementation model: a study protocol

Background

High rates of youth exposure to violence, either through direct victimization or witnessing, result in significant health/mental health consequences and high associated lifetime costs. Evidence-based treatments (EBTs), such as Trauma-Focused Cognitive Behavioral Therapy (TF-CBT), can prevent and/or reduce these negative effects, yet these treatments are not standard practice for therapists working with children identified by child welfare or mental health systems as needing services. While research indicates that collaboration among child welfare and mental health services sectors improves availability and sustainment of EBTs for children, few implementation strategies designed specifically to promote and sustain inter-professional collaboration (IC) and inter-organizational relationships (IOR) have undergone empirical investigation. A potential candidate for evaluation is the Community-Based Learning Collaborative (CBLC) implementation model, an adaptation of the Learning Collaborative which includes strategies designed to develop and strengthen inter-professional relationships between brokers and providers of mental health services to promote IC and IOR and achieve sustained implementation of EBTs for children within a community.

Methods/design

This non-experimental, mixed methods study involves two phases: (1) analysis of existing prospective quantitative and qualitative quality improvement and project evaluation data collected pre and post, weekly, and monthly from 998 participants in one of seven CBLCs conducted as part of a statewide initiative; and (2) Phase 2 collection of new quantitative and qualitative (key informant interviews) data during the funded study period to evaluate changes in relations among IC, IOR, social networks and the penetration and sustainment of TF-CBT in targeted communities. Recruitment for Phase 2 is from the pool of 998 CBLC participants to achieve a targeted enrollment of n = 150. Study aims include: (1) Use existing quality improvement (weekly/monthly online surveys; pre-post surveys; interviews) and newly collected quantitative (monthly surveys) and qualitative (key informant interviews) data and social network analysis to test whether CBLC strategies are associated with penetration and sustainment of TF-CBT; and (2) Use existing quantitative quality improvement (weekly/monthly on-line surveys; pre/post surveys) and newly collected qualitative (key informant interviews) data and social network analysis to test whether CBLC strategies are associated with increased IOR and IC intensity.

Discussion

The proposed research leverages an on-going, statewide implementation initiative to generate evidence about implementation strategies needed to make trauma-focused EBTs more accessible to children. This study also provides feasibility data to inform an effectiveness trial that will utilize a time-series design to rigorously evaluate the CBLC model as a mechanism to improve access and sustained use of EBTs for children.

Measuring sustainment of prevention programs and initiatives: a study protocol

BACKGROUND

Sustaining prevention efforts directed at substance use and mental health problems is one of the greatest, yet least understood, challenges in the field of implementation science. A large knowledge gap exists regarding the meaning of the term "sustainment" and what factors predict or even measure sustainability of effective prevention programs and support systems.

METHODS/DESIGN

The U.S. Substance Abuse and Mental Health Services Administration (SAMHSA) supports a diverse portfolio of prevention and treatment grant programs that aim to improve population and individual level behavioral health. This study focuses on four SAMHSA prevention grant programs, two of which target substance abuse prevention at the state or single community level, one targets suicide prevention, and one targets prevention of aggressive/disruptive behavior in elementary schools. An examination of all four grant programs simultaneously provides an opportunity to determine what is meant by the term sustainment and identify and support both the unique requirements for improving sustainability for each program as well as for developing a generalizable framework comprised of core components of sustainment across diverse prevention approaches. Based on an analysis of qualitative and quantitative data of 10 grantees supported by these four programs, we will develop a flexible measurement system, with both general and specific components, that can bring precision to monitoring sustainment of infrastructure, activities, and outcomes for each prevention approach. We will then transform this system for use in evaluating and improving the likelihood of achieving prevention effort sustainment. To achieve these goals, we will (1) identify core components of sustainment of prevention programs and their support infrastructures; (2) design a measurement system for monitoring and providing feedback regarding sustainment within the four SAMHSA's prevention-related grant programs; and (3) pilot test the predictability of this multilevel measurement system across these programs and the feasibility and acceptability of a measurement system to evaluate and improve the likelihood of sustainment.

DISCUSSION

This project is intended to improve sustainment of the supporting prevention infrastructure, activities, and outcomes that are funded by federal, state, community, and foundation sources.

Proceedings of the 3rd Biennial Conference of the Society for Implementation Research Collaboration (SIRC) 2015: advancing efficient methodologies through community partnerships and team science : Seattle, WA, USA. 24-26 September 2015

Introduction to the 3rd Biennial Conference of the Society for Implementation Research Collaboration: advancing efficient methodologies through team science and community partnerships

Cara Lewis, Doyanne Darnell, Suzanne Kerns, Maria Monroe-DeVita, Sara J. Landes, Aaron R. Lyon, Cameo Stanick, Shannon Dorsey, Jill Locke, Brigid Marriott, Ajeng Puspitasari, Caitlin Dorsey, Karin Hendricks, Andria Pierson, Phil Fizur, Katherine A. Comtois

A1: A behavioral economic perspective on adoption, implementation, and sustainment of evidence-based interventions

Lawrence A. Palinkas

A2: Towards making scale up of evidence-based practices in child welfare systems more efficient and affordable

Patricia Chamberlain

A3: Mixed method examination of strategic leadership for evidence-based practice implementation

Gregory A. Aarons, Amy E. Green, Mark. G. Ehrhart, Elise M. Trott, Cathleen E. Willging

A4: Implementing practice change in Federally Qualified Health Centers: Learning from leaders’ experiences

Maria E. Fernandez, Nicholas H. Woolf, Shuting (Lily) Liang, Natalia I. Heredia, Michelle Kegler, Betsy Risendal, Andrea Dwyer, Vicki Young, Dayna Campbell, Michelle Carvalho, Yvonne Kellar-Guenther

A3: Mixed method examination of strategic leadership for evidence-based practice implementation

Gregory A. Aarons, Amy E. Green, Mark. G. Ehrhart, Elise M. Trott, Cathleen E. Willging

A4: Implementing practice change in Federally Qualified Health Centers: Learning from leaders’ experiences

Maria E. Fernandez, Nicholas H. Woolf, Shuting (Lily) Liang, Natalia I. Heredia, Michelle Kegler, Betsy Risendal, Andrea Dwyer, Vicki Young, Dayna Campbell, Michelle Carvalho, Yvonne Kellar-Guenther

A5: Efficient synthesis: Using qualitative comparative analysis and the Consolidated Framework for Implementation Research across diverse studies

Laura J. Damschroder, Julie C. Lowery

A6: Establishing a veterans engagement group to empower patients and inform Veterans Affairs (VA) health services research

Sarah S. Ono, Kathleen F. Carlson, Erika K. Cottrell, Maya E. O’Neil, Travis L. Lovejoy

A7: Building patient-practitioner partnerships in community oncology settings to implement behavioral interventions for anxious and depressed cancer survivors

Joanna J. Arch, Jill L. Mitchell

A8: Tailoring a Cognitive Behavioral Therapy implementation protocol using mixed methods, conjoint analysis, and implementation teams

Cara C. Lewis, Brigid R. Marriott, Kelli Scott

A9: Wraparound Structured Assessment and Review (WrapSTAR): An efficient, yet comprehensive approach to Wraparound implementation evaluation

Jennifer Schurer Coldiron, Eric J. Bruns, Alyssa N. Hook

A10: Improving the efficiency of standardized patient assessment of clinician fidelity: A comparison of automated actor-based and manual clinician-based ratings

Benjamin C. Graham, Katelin Jordan

A11: Measuring fidelity on the cheap

Rochelle F. Hanson, Angela Moreland, Benjamin E. Saunders, Heidi S. Resnick

A12: Leveraging routine clinical materials to assess fidelity to an evidence-based psychotherapy

Shannon Wiltsey Stirman, Cassidy A. Gutner, Jennifer Gamarra, Dawne Vogt, Michael Suvak, Jennifer Schuster Wachen, Katherine Dondanville, Jeffrey S. Yarvis, Jim Mintz, Alan L. Peterson, Elisa V. Borah, Brett T. Litz, Alma Molino, Stacey Young McCaughanPatricia A. Resick

A13: The video vignette survey: An efficient process for gathering diverse community opinions to inform an intervention

Nancy Pandhi, Nora Jacobson, Neftali Serrano, Armando Hernandez, Elizabeth Zeidler- Schreiter, Natalie Wietfeldt, Zaher Karp

A14: Using integrated administrative data to evaluate implementation of a behavioral health and trauma screening for children and youth in foster care

Michael D. Pullmann, Barbara Lucenko, Bridget Pavelle, Jacqueline A. Uomoto, Andrea Negrete, Molly Cevasco, Suzanne E. U. Kerns

A15: Intermediary organizations as a vehicle to promote efficiency and speed of implementation

Robert P. Franks, Christopher Bory

A16: Applying the Consolidated Framework for Implementation Research constructs directly to qualitative data: The power of implementation science in action

Edward J. Miech, Teresa M. Damush

A17: Efficient and effective scaling-up, screening, brief interventions, and referrals to treatment (SBIRT) training: a snowball implementation model

Jason Satterfield, Derek Satre, Maria Wamsley, Patrick Yuan, Patricia O’Sullivan

A18: Matching models of implementation to system needs and capacities: addressing the human factor

Helen Best, Susan Velasquez

A19: Agency characteristics that facilitate efficient and successful implementation efforts

Miya Barnett, Lauren Brookman-Frazee, Jennifer Regan, Nicole Stadnick, Alison Hamilton, Anna Lau

A20: Rapid assessment process: Application to the Prevention and Early Intervention transformation in Los Angeles County

Jennifer Regan, Alison Hamilton, Nicole Stadnick, Miya Barnett, Anna Lau, Lauren Brookman-Frazee

A21: The development of the Evidence-Based Practice-Concordant Care Assessment: An assessment tool to examine treatment strategies across practices

Nicole Stadnick, Anna Lau, Miya Barnett, Jennifer Regan, Scott Roesch, Lauren Brookman-Frazee

A22: Refining a compilation of discrete implementation strategies and determining their importance and feasibility

Byron J. Powell, Thomas J. Waltz, Matthew J. Chinman, Laura Damschroder, Jeffrey L. Smith, Monica M. Matthieu, Enola K. Proctor, JoAnn E. Kirchner

A23: Structuring complex recommendations: Methods and general findings

Thomas J. Waltz, Byron J. Powell, Matthew J. Chinman, Laura J. Damschroder, Jeffrey L. Smith, Monica J. Matthieu, Enola K. Proctor, JoAnn E. Kirchner

A24: Implementing prolonged exposure for post-traumatic stress disorder in the Department of Veterans Affairs: Expert recommendations from the Expert Recommendations for Implementing Change (ERIC) project

Monica M. Matthieu, Craig S. Rosen, Thomas J. Waltz, Byron J. Powell, Matthew J. Chinman, Laura J. Damschroder, Jeffrey L. Smith, Enola K. Proctor, JoAnn E. Kirchner

A25: When readiness is a luxury: Co-designing a risk assessment and quality assurance process with violence prevention frontline workers in Seattle, WA

Sarah C. Walker, Asia S. Bishop, Mariko Lockhart

A26: Implementation potential of structured recidivism risk assessments with justice- involved veterans: Qualitative perspectives from providers

Allison L. Rodriguez, Luisa Manfredi, Andrea Nevedal, Joel Rosenthal, Daniel M. Blonigen

A27: Developing empirically informed readiness measures for providers and agencies for the Family Check-Up using a mixed methods approach

Anne M. Mauricio, Thomas D. Dishion, Jenna Rudo-Stern, Justin D. Smith

A28: Pebbles, rocks, and boulders: The implementation of a school-based social engagement intervention for children with autism

Jill Locke, Courtney Benjamin Wolk, Colleen Harker, Anne Olsen, Travis Shingledecker, Frances Barg, David Mandell, Rinad S. Beidas

A29: Problem Solving Teletherapy (PST.Net): A stakeholder analysis examining the feasibility and acceptability of teletherapy in community based aging services

Marissa C. Hansen, Maria P. Aranda, Isabel Torres-Vigil

A30: A case of collaborative intervention design eventuating in behavior therapy sustainment and diffusion

Bryan Hartzler

A31: Implementation of suicide risk prevention in an integrated delivery system: Mental health specialty services

Bradley Steinfeld, Tory Gildred, Zandrea Harlin, Fredric Shephard

A32: Implementation team, checklist, evaluation, and feedback (ICED): A step-by-step approach to Dialectical Behavior Therapy program implementation

Matthew S. Ditty, Andrea Doyle, John A. Bickel III, Katharine Cristaudo

A33: The challenges in implementing muliple evidence-based practices in a community mental health setting

Dan Fox, Sonia Combs

A34: Using electronic health record technology to promote and support evidence-based practice assessment and treatment intervention

David H. Lischner

A35: Are existing frameworks adequate for measuring implementation outcomes? Results from a new simulation methodology

Richard A. Van Dorn, Stephen J. Tueller, Jesse M. Hinde, Georgia T. Karuntzos

A36: Taking global local: Evaluating training of Washington State clinicians in a modularized cogntive behavioral therapy approach designed for low-resource settings

Maria Monroe-DeVita, Roselyn Peterson, Doyanne Darnell, Lucy Berliner, Shannon Dorsey, Laura K. Murray

A37: Attitudes toward evidence-based practices across therapeutic orientations

Yevgeny Botanov, Beverly Kikuta, Tianying Chen, Marivi Navarro-Haro, Anthony DuBose, Kathryn E. Korslund, Marsha M. Linehan

A38: Predicting the use of an evidence-based intervention for autism in birth-to-three programs

Colleen M. Harker, Elizabeth A. Karp, Sarah R. Edmunds, Lisa V. Ibañez, Wendy L. Stone

A39: Supervision practices and improved fidelity across evidence-based practices: A literature review

Mimi Choy-Brown

A40: Beyond symptom tracking: clinician perceptions of a hybrid measurement feedback system for monitoring treatment fidelity and client progress

Jack H. Andrews, Benjamin D. Johnides, Estee M. Hausman, Kristin M. Hawley

A41: A guideline decision support tool: From creation to implementation

Beth Prusaczyk, Alex Ramsey, Ana Baumann, Graham Colditz, Enola K. Proctor

A42: Dabblers, bedazzlers, or total makeovers: Clinician modification of a common elements cognitive behavioral therapy approach

Rosemary D. Meza, Shannon Dorsey, Shannon Wiltsey-Stirman, Georganna Sedlar, Leah Lucid

A43: Characterization of context and its role in implementation: The impact of structure, infrastructure, and metastructure

Caitlin Dorsey, Brigid Marriott, Nelson Zounlome, Cara Lewis

A44: Effects of consultation method on implementation of cognitive processing therapy for post-traumatic stress disorder

Cassidy A. Gutner, Candice M. Monson, Norman Shields, Marta Mastlej, Meredith SH Landy, Jeanine Lane, Shannon Wiltsey Stirman

A45: Cross-validation of the Implementation Leadership Scale factor structure in child welfare service organizations

Natalie K. Finn, Elisa M. Torres, Mark. G. Ehrhart, Gregory A. Aarons

A46: Sustainability of integrated smoking cessation care in Veterans Affairs posttraumatic stress disorder clinics: A qualitative analysis of focus group data from learning collaborative participants

Carol A. Malte, Aline Lott, Andrew J. Saxon

A47: Key characteristics of effective mental health trainers: The creation of the Measure of Effective Attributes of Trainers (MEAT)

Meredith Boyd, Kelli Scott, Cara C. Lewis

A48: Coaching to improve teacher implementation of evidence-based practices (EBPs)

Jennifer D. Pierce

A49: Factors influencing the implementation of peer-led health promotion programs targeting seniors: A literature review

Agathe Lorthios-Guilledroit, Lucie Richard, Johanne Filiatrault

A50: Developing treatment fidelity rating systems for psychotherapy research: Recommendations and lessons learned

Kevin Hallgren, Shirley Crotwell, Rosa Muñoz, Becky Gius, Benjamin Ladd, Barbara McCrady, Elizabeth Epstein

A51: Rapid translation of alcohol prevention science

John D. Clapp, Danielle E. Ruderman

A52: Factors implicated in successful implementation: evidence to inform improved implementation from high and low-income countries

Melanie Barwick, Raluca Barac, Stanley Zlotkin, Laila Salim, Marnie

Davidson

A53: Tracking implementation strategies prospectively: A practical approach

Alicia C. Bunger, Byron J. Powell, Hillary A. Robertson

A54: Trained but not implementing: the need for effective implementation planning tools

Christopher Botsko

A55: Evidence, context, and facilitation variables related to implementation of Dialectical Behavior Therapy: Qualitative results from a mixed methods inquiry in the Department of Veterans Affairs

Sara J. Landes, Brandy N. Smith, Allison L. Rodriguez, Lindsay R. Trent, Monica M. Matthieu

A56: Learning from implementation as usual in children’s mental health

Byron J. Powell, Enola K. Proctor

A57: Rates and predictors of implementation after Dialectical Behavior Therapy Intensive Training

Melanie S. Harned, Marivi Navarro-Haro, Kathryn E. Korslund, Tianying Chen, Anthony DuBose, André Ivanoff, Marsha M. Linehan

A58: Socio-contextual determinants of research evidence use in public-youth systems of care

Antonio R. Garcia, Minseop Kim, Lawrence A. Palinkas, Lonnie Snowden, John Landsverk

A59: Community resource mapping to integrate evidence-based depression treatment in primary care in Brazil: A pilot project

Annika C. Sweetland, Maria Jose Fernandes, Edilson Santos, Cristiane Duarte, Afrânio Kritski, Noa Krawczyk, Caitlin Nelligan, Milton L. Wainberg

A60: The use of concept mapping to efficiently identify determinants of implementation in the National Institute of Health--President’s Emergent Plan for AIDS Relief Prevention of Mother to Child HIV Transmission Implementation Science Alliance

Gregory A. Aarons, David H. Sommerfeld, Benjamin Chi, Echezona Ezeanolue, Rachel Sturke, Lydia Kline, Laura Guay, George Siberry

A61: Longitudinal remote consultation for implementing collaborative care for depression

Ian M. Bennett, Rinad Beidas, Rachel Gold, Johnny Mao, Diane Powers, Mindy Vredevoogd, Jurgen Unutzer

A62: Integrating a peer coach model to support program implementation and ensure long- term sustainability of the Incredible Years in community-based settings

Jennifer Schroeder, Lane Volpe, Julie Steffen

A63: Efficient sustainability: Existing community based supervisors as evidence-based treatment supports

Shannon Dorsey, Michael D Pullmann, Suzanne E. U. Kerns, Nathaniel Jungbluth, Lucy Berliner, Kelly Thompson, Eliza Segell

A64: Establishment of a national practice-based implementation network to accelerate adoption of evidence-based and best practices

Pearl McGee-Vincent, Nancy Liu, Robyn Walser, Jennifer Runnals, R. Keith Shaw, Sara J. Landes, Craig Rosen, Janet Schmidt, Patrick Calhoun

A65: Facilitation as a mechanism of implementation in a practice-based implementation network: Improving care in a Department of Veterans Affairs post-traumatic stress disorder outpatient clinic

Ruth L. Varkovitzky, Sara J. Landes

A66: The ACT SMART Toolkit: An implementation strategy for community-based organizations providing services to children with autism spectrum disorder

Amy Drahota, Jonathan I. Martinez, Brigitte Brikho, Rosemary Meza, Aubyn C. Stahmer, Gregory A. Aarons

A67: Supporting Policy In Health with Research: An intervention trial (SPIRIT) - protocol and early findings

Anna Williamson

A68: From evidence based practice initiatives to infrastructure: Lessons learned from a public behavioral health system’s efforts to promote evidence based practices

Ronnie M. Rubin, Byron J. Powell, Matthew O. Hurford, Shawna L. Weaver, Rinad S. Beidas, David S. Mandell, Arthur C. Evans

A69: Applying the policy ecology model to Philadelphia’s behavioral health transformation efforts

Byron J. Powell, Rinad S. Beidas, Ronnie M. Rubin, Rebecca E. Stewart, Courtney Benjamin Wolk, Samantha L. Matlin, Shawna Weaver, Matthew O. Hurford, Arthur C. Evans, Trevor R. Hadley, David S. Mandell

A70: A model for providing methodological expertise to advance dissemination and implementation of health discoveries in Clinical and Translational Science Award institutions

Donald R. Gerke, Beth Prusaczyk, Ana Baumann, Ericka M. Lewis, Enola K. Proctor

A71: Establishing a research agenda for the Triple P Implementation Framework

Jenna McWilliam, Jacquie Brown, Michelle Tucker

A72: Cheap and fast, but what is “best?”: Examining implementation outcomes across sites in a state-wide scaled-up evidence-based walking program, Walk With Ease

Kathleen P Conte

A73: Measurement feedback systems in mental health: Initial review of capabilities and characteristics

Aaron R. Lyon, Meredith Boyd, Abigail Melvin, Cara C. Lewis, Freda Liu, Nathaniel Jungbluth

A74: A qualitative investigation of case managers’ attitudes toward implementation of a measurement feedback system in a public mental health system for youth

Amelia Kotte, Kaitlin A. Hill, Albert C. Mah, Priya A. Korathu-Larson, Janelle R. Au, Sonia Izmirian, Scott Keir, Brad J. Nakamura, Charmaine K. Higa-McMillan

A75: Multiple pathways to sustainability: Using Qualitative Comparative Analysis to uncover the necessary and sufficient conditions for successful community-based implementation

Brittany Rhoades Cooper, Angie Funaiole, Eleanor Dizon

A76: Prescribers’ perspectives on opioids and benzodiazepines and medication alerts to reduce co-prescribing of these medications

Eric J. Hawkins, Carol A. Malte, Hildi J. Hagedorn, Douglas Berger, Anissa Frank, Aline Lott, Carol E. Achtmeyer, Anthony J. Mariano, Andrew J. Saxon

A77: Adaptation of Coordinated Anxiety Learning and Management for comorbid anxiety and substance use disorders: Delivery of evidence-based treatment for anxiety in addictions treatment centers

Kate Wolitzky-Taylor, Richard Rawson, Richard Ries, Peter Roy-Byrne, Michelle Craske

A78: Opportunities and challenges of measuring program implementation with online surveys

Dena Simmons, Catalina Torrente, Lori Nathanson, Grace Carroll

A79: Observational assessment of fidelity to a family-centered prevention program: Effectiveness and efficiency

Justin D. Smith, Kimbree Brown, Karina Ramos, Nicole Thornton, Thomas J. Dishion, Elizabeth A. Stormshak, Daniel S. Shaw, Melvin N. Wilson

A80: Strategies and challenges in housing first fidelity: A multistate qualitative analysis

Mimi Choy-Brown, Emmy Tiderington, Bikki Tran Smith, Deborah K. Padgett

A81: Procurement and contracting as an implementation strategy: Getting To Outcomes® contracting

Ronnie M. Rubin, Marilyn L. Ray, Abraham Wandersman, Andrea Lamont, Gordon Hannah, Kassandra A. Alia, Matthew O. Hurford, Arthur C. Evans

A82: Web-based feedback to aid successful implementation: The interactive Stages of Implementation Completion (SIC)^TM tool

Lisa Saldana, Holle Schaper, Mark Campbell, Patricia Chamberlain

A83: Efficient methodologies for monitoring fidelity in routine implementation: Lessons from the Allentown Social Emotional Learning Initiative

Valerie B. Shapiro, B.K. Elizabeth Kim, Jennifer L. Fleming, Paul A. LeBuffe

A84: The Society for Implementation Research Collaboration (SIRC) implementation development workshop: Results from a new methodology for enhancing implementation science proposals

Sara J. Landes, Cara C. Lewis, Allison L. Rodriguez, Brigid R. Marriott, Katherine Anne Comtois

A85: An update on the Society for Implementation Research Collaboration (SIRC) Instrument Review Project

Measuring Current Drug Use in Female Sex Workers and Their Noncommercial Male Partners in Mexico: Concordance Between Data Collected From Surveys Versus Semi-Structured Interviews

BACKGROUND

Self-reports are commonly used to assess prevalence and frequency of drug use, but it is unclear whether qualitative methods like semi-structured interviews are as useful at obtaining such information as quantitative surveys.

OBJECTIVES

This study compared drug use occurrence and frequency using data collected from quantitative surveys and qualitative interviews. We also examined whether combining data from both sources could result in significant increases in percentages of current users and whether the concordance between the two sets of data was associated with the type of drug use, age, gender and socioeconomic status.

METHODS

Self- reports of recent marijuana, heroin, crack, cocaine, crystal/methamphetamine, inhalant, and tranquilizer use were collected using both methods from a cohort of Mexican female sex workers and their non-commercial male partners (n = 82).

RESULTS

Participants were significantly less likely to report marijuana, cocaine and tranquilizer use and frequency of use during the qualitative interviews than during the quantitative surveys. Agreement on frequency of drug use was excellent for crystal/methamphetamine, heroin and inhalant use, and weak for cocaine, tranquilizers and marijuana use. Older participants exhibited significantly higher concordance than younger participants in reports of marijuana and methamphetamine use. Higher monthly income was significantly associated with higher concordance in crack use but lower concordance with marijuana use.

CONCLUSIONS

Although use of such data can result in an underreporting of drug use, qualitative data can be quantified in certain circumstances to triangulate and confirm the results from quantitative analyses and provide a more comprehensive view of drug use.

Refining an intervention for students with emotional disturbance using qualitative parent and teacher data

Intensive supports are needed for students with emotional disturbance during high-risk transitions. Such interventions are most likely to be successful if they address stakeholder perspectives during the development process. This paper discusses qualitative findings from an iterative intervention development project designed to incorporate parent and teacher feedback early in the development process with applications relevant to the adoption of new programs. Using maximum variation purposive sampling, we solicited feedback from five foster/kinship parents, four biological parents and seven teachers to evaluate the feasibility and utility of the Students With Involved Families and Teachers (SWIFT) intervention in home and school settings. SWIFT provides youth and parent skills coaching in the home and school informed by weekly student behavioral progress monitoring. Participants completed semi-structured interviews that were transcribed and coded via an independent co-coding strategy. The findings provide support for school-based interventions involving family participation and lessons to ensure intervention success.

Sustainability of Evidence-Based Practices for HIV Prevention among Female Sex Workers in Mexico

Objective

This study examined service provider perceptions of requirements for successful sustainment of an efficacious intervention for preventing HIV/AIDS and STIs in female sex workers (FSWs) in Mexico.

Methods

Semi-structured interviews were conducted with 77 leaders and counselors from 12 community-based reproductive health clinics located throughout Mexico participating in a large hybrid effectiveness-implementation randomized controlled trial to scale-up the use of Mujer Segura, a psychoeducational intervention designed to promote condom use and enhance safer sex negotiation skills among FSWs.

Results

Five sets of requirements for sustainment were identified: 1) characteristics of the provider, including competence in delivering the intervention, need for continued technical support and assistance from outside experts, and satisfaction with addressing the needs of this population; 2) characteristics of the clients (i.e., FSWs), including client need and demand for services and incentives for participation; 3) characteristics of the organization, including its mission, benefits, and operations; 4) characteristics of the outer setting, including financial support and relationship with the community-based organization’s central offices, and transportation and security in areas where FSWs live and work; and 5) outcomes associated with the intervention itself, including a reduction of risk through education and increased outreach through referrals from FSWs who received the intervention.

Conclusions

Although the requirements for successful sustainment of interventions like Mujer Segura are consistent with the factors identified in many models of implementation, the results illustrate the importance of local context in assigning priority to these model elements and suggest that the five categories are not discrete entities but interconnected.

Inter-organizational collaboration in the implementation of evidence-based practices among public agencies serving abused and neglected youth

This study examined the role of inter-organizational collaboration in implementing new evidence-based practices for addressing problem behaviors in at-risk youth. Semi-structured interviews were conducted with 38 systems leaders of probation, mental health, and child welfare departments of 12 California counties participating in a large randomized controlled trial to scale-up the use of Multidimensional Treatment Foster Care. Three sets of collaboration characteristics were identified: (1) characteristics of collaboration process, (2) characteristics of the external environment, and (3) characteristics of participating organizations and individuals. Inter-organizational collaboration enables an exchange of information and advice and a pooling of resources individual agencies may require for successful implementation.

Peer-led healthy lifestyle program in supportive housing: study protocol for a randomized controlled trial

Background

The risk for obesity is twice as high in people with serious mental illness (SMI) compared to the general population. Racial and ethnic minority status contribute additional health risks. The aim of this study is to describe the protocol of a Hybrid Trial Type 1 design that will test the effectiveness and examine the implementation of a peer-led healthy lifestyle intervention in supportive housing agencies serving diverse clients with serious mental illness who are overweight or obese.

Methods

The Hybrid Trial Type 1 design will combine a randomized effectiveness trial with a mixed-methods implementation study. The effectiveness trial will test the health impacts of a peer-led healthy lifestyle intervention versus usual care in supportive housing agencies. The healthy lifestyle intervention is derived from the Group Lifestyle Balanced Program, lasts 12 months, and will be delivered by trained peer specialists. Repeated assessments will be conducted at baseline and at 6, 12, and 18 months post randomization. A mixed-methods (e.g., structured interviews, focus groups, surveys) implementation study will be conducted to examine multi-level implementation factors and processes that can inform the use of the healthy lifestyle intervention in routine practice, using data from agency directors, program managers, staff, and peer specialists before, during, and after the implementation of the effectiveness trial.

Discussion

This paper describes the use of a hybrid research design that blends effectiveness trial methodologies and implementation science rarely used when studying the physical health of people with SMI and can serve as a model for integrating implementation science and health disparities research. Rigorously testing effectiveness and exploring the implementation process are both necessary steps to establish the evidence for large-scale delivery of peer-led healthy lifestyle intervention to improve the physical health of racial/ethnic minorities with SMI.

Trial registration

www.clinicaltrials.gov; NCT02175641, registered 24 June 2014

Purposeful Sampling for Qualitative Data Collection and Analysis in Mixed Method Implementation Research

Purposeful sampling is widely used in qualitative research for the identification and selection of information-rich cases related to the phenomenon of interest. Although there are several different purposeful sampling strategies, criterion sampling appears to be used most commonly in implementation research. However, combining sampling strategies may be more appropriate to the aims of implementation research and more consistent with recent developments in quantitative methods. This paper reviews the principles and practice of purposeful sampling in implementation research, summarizes types and categories of purposeful sampling strategies and provides a set of recommendations for use of single strategy or multistage strategy designs, particularly for state implementation research.

Approaches to Mixed Methods Dissemination and Implementation Research: Methods, Strengths, Caveats, and Opportunities

Limited translation of research into practice has prompted study of diffusion and implementation, and development of effective methods of encouraging adoption, dissemination and implementation. Mixed methods techniques offer approaches for assessing and addressing processes affecting implementation of evidence-based interventions. We describe common mixed methods approaches used in dissemination and implementation research, discuss strengths and limitations of mixed methods approaches to data collection, and suggest promising methods not yet widely used in implementation research. We review qualitative, quantitative, and hybrid approaches to mixed methods dissemination and implementation studies, and describe methods for integrating multiple methods to increase depth of understanding while improving reliability and validity of findings.

Retaining Low-Income Minority Cancer Patients in a Depression Treatment Intervention Trial: Lessons Learned

Previously published work finds significant benefit from medical and behavioral health team care among safety-net patients with major depression. This qualitative study assessed clinical social worker, psychiatrist and patient navigator strategies to increase depression treatment among low-income minority cancer patients participating in the ADAPt-C clinical depression trial. Patient care retention strategies were elicited through in-depth, semi-structured interviews with nine behavioral health providers. Using grounded theory, concepts from the literature and dropout barriers identified by patients, guided interview prompts. Retention strategies clustered around five dropout barriers: (1) informational, (2) instrumental, (3) provider-patient therapeutic alliance, (4) clinic setting, and (5) depression treatment. All strategies emphasized the importance of communication between providers and patients. Findings suggest that strong therapeutic alliance and telephone facilitates collaborative team provider communication and depression treatment retention among patients in safety-net oncology care systems.

Live to tell: Narratives of methamphetamine-using women taken hostage by their intimate partners in San Diego, CA

BACKGROUND

Hostage-taking, an overlooked phenomenon in public health, constitutes a severe form of intimate partner violence and may be a precursor to female homicide within relationships characterized by substance use. Criminal justice studies indicate that most hostage incidents are male-driven events with more than half of all cases associated with a prior history of violence and substance use. Methamphetamine use increases a woman's risk of partner violence, with methamphetamine-using individuals being up to nine times more likely to commit homicide. As homicide is the most lethal outcome of partner violence and methamphetamine use, this study aims to characterize the potential role of hostage-taking within these intersecting epidemics.

METHODS

Methamphetamine-using women enrolled in an HIV behavioural intervention trial (FASTLANE-II) who reported experiences of partner violence were purposively selected to participate in qualitative sub-studies (Women's Study I & II). Twenty-nine women, ages 26-57, participated in semi-structured interviews that discussed relationship dynamics, partner violence, drug use and sexual practices.

RESULTS

Findings indicated four cases of women being held hostage by a partner, with two women describing two separate hostage experiences. Women discussed partner jealousy, drug withdrawal symptoms, heightened emotional states from methamphetamine use, and escalating violent incidents as factors leading up to hostage-taking. Factors influencing lack of reporting incidents to law enforcement included having a criminal record, fear of partner retaliation, and intentions to terminate the relationship when the partner is incarcerated.

CONCLUSION

Educating women on the warning signs of hostage-taking within the context of methamphetamine use and promoting behaviour change among male perpetrators can contribute to reducing the risk of homicide. Furthermore, bridging the gap between health services and law enforcement agencies and providing comprehensive services that address the needs of methamphetamine-using women in violent relationships can prevent or minimize potential harm to vulnerable women.

Preventing Filipino Mental Health Disparities: Perspectives from Adolescents, Caregivers, Providers, and Advocates

Filipino Americans are the second largest immigrant population and second largest Asian ethnic group in the U.S. Disparities in youth behavioral health problems and the receipt of mental health services among Filipino youth have been documented previously. However, few studies have elicited perspectives from community stakeholders regarding how to prevent mental health disparities among Filipino youth. The purpose of the current study is to identify intervention strategies for implementing mental health prevention programs among Filipino youth. We conducted semi-structured interviews (n=33) with adolescents, caregivers, advocates, and providers and focus groups (n=18) with adolescents and caregivers. Interviews were audio taped and transcribed verbatim. Transcripts were analyzed using a methodology of "coding consensus, co-occurrence, and comparison" and was rooted in grounded theory. Four recommendations were identified when developing mental health prevention strategies among Filipino populations: address the intergenerational gap between Filipino parents and children, provide evidence-based parenting programs, collaborate with churches in order to overcome stigma associated with mental health, and address mental health needs of parents. Findings highlight the implementation of evidence-based preventive parenting programs in faith settings as a community-identified and culturally appropriate strategy to prevent Filipino youth behavioral health disparities.

Fidelity to the housing first model and effectiveness of permanent supported housing programs in California

OBJECTIVES

Permanent supported housing programs are being implemented throughout the United States. This study examined the relationship between fidelity to the Housing First model and residential outcomes among clients of full service partnerships (FSPs) in California.

METHODS

This study had a mixed-methods design. Quantitative administrative and survey data were used to describe FSP practices and to examine the association between fidelity to Housing First and residential outcomes in the year before and after enrollment of 6,584 FSP clients in 86 programs. Focus groups at 20 FSPs provided qualitative data to enhance the understanding of these findings with actual accounts of housing-related experiences in high- and low-fidelity programs.

RESULTS

Prior to enrollment, the mean days of homelessness were greater at high- versus low-fidelity (101 versus 46 days) FSPs. After adjustment for individual characteristics, the analysis found that days spent homeless after enrollment declined by 87 at high-fidelity programs and by 34 at low-fidelity programs. After adjustment for days spent homeless before enrollment, days spent homeless after enrollment declined by 63 at high-fidelity programs and by 53 at low-fidelity programs. After enrollment, clients at high-fidelity programs spent more than 60 additional days in apartments than clients at low-facility programs. Differences were found between high- and low-fidelity FSPs in client choice in housing and how much clients' goals were considered in housing placement.

CONCLUSIONS

Programs with greater fidelity to the Housing First model enrolled clients with longer histories of homelessness and placed most of them in apartments.