Addressing Evaluation Barriers with Early Innovation Development for Adolescent-Focused Sexual and Reproductive Health Interventions

Most evidence-based teen pregnancy prevention programs focus on individual-level sexual health outcomes (e.g., STIs, pregnancy, teen births). To expand program and intervention approaches within teen pregnancy prevention (TPP), the Department of Health and Human Services funded two grantees, Innovative Teen Pregnancy Prevention Programs (iTP3) and Innovation Next (IN) to support and enable early innovation to advance adolescent health and prevent teen pregnancy. The pipeline to support and enable innovation in adolescent health is complex, resulting in barriers and challenges to research and evaluation of novel programs. This paper presents some of the barriers encountered by the grantees. Data for this paper was collected from key personnel and secondary data sources. Focus group participants included seven representatives (n = 7) across the two organizations. Focus group questions assessed barriers related to innovative intervention development and evaluation. Key findings include four barriers to evaluation when fostering innovative adolescent-focused pregnancy prevention interventions. These included (a) funding constraints on evaluation activities, (b) innovation readiness for rigorous testing, (c) evaluation knowledge and expertise on innovation-development teams, and (d) challenges with evaluation requirements. Novel and promising system- and technology-focused interventions with the potential to impact TPP require alternative tools and approaches for evaluation. This would allow research to focus on how systems-level change mechanisms (i.e., policy, access to care) impact sexual risk behaviors and better understand ecological and social determinants of health for the priority population. The advancement of approaches to impact adolescent health identifies the need to expand the focus of evidence-based interventions beyond the adolescent themselves and understand approaches that impact external contexts and environments related to reducing sexual and reproductive health (SRH) risk-taking.

The Development of a Systems-Level Approach to Address Adolescent Access to Health Care: A Novel Confidentiality Policy Intervention

Most evidence-based interventions in adolescent sexual and reproductive health and mental health remain largely aimed at individual-level outcomes and do not conceptualize adolescent health within a social-ecological model. Interventions to affect policy, systems, and environmental change offer potential for sustained population impact. The current initiative used an innovation framework to develop a novel systems-level approach to address adolescent access to health care. The Framework for Public Health Innovation provided an approach to develop a novel intervention. Confident Teen is a systems-level intervention that creates the opportunity, through organizational policy change, to increase adolescents' access to confidential sexual and reproductive health services through organizational policies. Gaps in adolescents' access to health care services allowed for a systems-level approach to be designed through an adolescent pregnancy prevention innovation initiative. Confidentiality is a right and critical component to their health care; therefore, a policy and conversation between provider and patient is a prioritized component of the novel intervention.

Supporting and Enabling the Process of Innovation in Public Health: The Framework for Public Health Innovation

This manuscript introduces a new framework for creating innovations in public health-the Framework for Public Health Innovation. The framework was developed through a longitudinal qualitative research study that investigated the process of creating innovative adolescent health programs. Interviews were conducted with a national sample of 26 organizations over two time points. Data collection focused on the process of innovative program development; organizational capacity; training; and technical assistance needs, successes, and barriers. The framework was developed and modified based on interview findings and expert advice; then, the final framework was validated with content experts. The framework illustrates a dynamic process of innovation that begins with dissatisfaction with the status quo, and then, illustrates three necessary components for innovation-space, process, and partnerships. Four categories of innovation, which range in complexity, are proposed: (1) creating a new component to an existing program, (2) adapting an existing program to meet new needs, (3) taking an alternative approach to addressing an existing program, and (4) reframing a health problem from a new perspective. As illustrated by a feedback loop, the resulting innovations disrupt the status quo. This model can be applied to any content area in public health and is useful for both research and practitioners.

A program evaluation of the Innovative Teen Pregnancy Prevention Programs (iTP3) Project

Background

Teen pregnancy prevention in the United States has traditionally focused on the development, testing, and subsequent implementation of a set of evidence-based programs (EBPs), recommended nationally. However, these existing EBPs often do not prioritize the most at-risk or vulnerable populations.

Methods

The Innovative Teen Pregnancy Prevention Programs (iTP₃) project was funded to facilitate the development of new, innovative programs to reach disparate populations. Through a mixed methods design, iTP₃ evaluated the process and resulting innovative programs from five iterative cohorts of funded organizations, referred to as Innovators. iTP₃ utilized both a traditional funding model with more traditional methods of capacity building assistance, but transitioned over time to a design-focused funding model in which organizations and individuals developed innovative programs through an intensive human centered design process.

Results

Evaluation results showed that the resulting portfolio of programs had differences in the types of programs resulting from the differing funding models. Notable differences among programs from the two funding models include program length, along with personnel, time, and resources needed to develop and manage.

Conclusion

Both traditional and design funding models led to innovative programs, with notable differences in the development process and resulting programs.

A latent class analysis of the co-occurrence of sexual violence, substance use, and mental health in youth

Purpose: The purpose of this study was to understand co-occurrence of sexual violence, substance use, and mental health in youth and see if there are differences in experiences among sexual identities, races, and genders. Methods: The 2017 Youth Risk Behavior Survey sampled 14,638 high school students. Latent class analysis was used to understand the relationship between incidence of sexual violence, substance use, and depression and suicidality in a nationally representative sample. The model controlled for demographic and bullying covariates. Results: A four-class solution provided optimal fit. Classes were low risk (51.8%); low violence, frequent substance use, and high depression and suicidal ideation (29.7%); experienced violence and moderate mental health issues(5.1%); and some violence, high substance use, and high depression and suicidal ideation (13.4%). Youth who identified as sexual minority youth were almost 2.5-5 times more likely to be in the three higher risk classes than their heterosexual peers. Those who identified as "I don't know" were almost 3 times more likely to be in the three higher risk classes than heterosexual youth. Multiracial youth had higher likelihood of being in the three riskier classes compared to Caucasian youth. Females were 2.5 and 3 times more likely to be in the low violence and some violence classes compared to males. Conclusion: The study's finding distinct classes of co-occurring behavioral and mental health outcomes fill gaps in the current literature and informs practitioners that LGB youth and bi/multiracial youth were at an elevated risk of co-occurring victimization, substance use, and mental health problems.