Preventing HIV and HSV-2 through knowledge and attitudes: A replication study of a multi-component community-based intervention in Zimbabwe

Evidence and gap map report: Social and Behavior Change Communication (SBCC) interventions for strengthening HIV prevention and research among adolescent girls and young women (AGYW) in low- and middle-income countries (LMICs)

BACKGROUND

Adolescent girls and young women (AGYW), aged 15-24 years, are disproportionately affected by HIV and other sexual and reproductive health (SRH) risks due to varying social, cultural, and economic factors that affect their choices and shape their knowledge, understanding, and practices with regard to their health. Socio-Behavioral Change Communication (SBCC) interventions targeted at strengthening the capabilities of individuals and their networks have supported the demand and uptake of prevention services and participation in biomedical research. However, despite growing global recognition of the domain, high-quality evidence on the effectiveness of SBCC remains scattered. This evidence and gap map (EGM) report characterizes the evidence base on SBCC interventions for strengthening HIV Prevention and Research among AGYW in low- and middle-income countries (LMICs), identifying evidence gaps and outlining the scope of future research and program design.

OBJECTIVES

The objectives of the proposed EGM are to: (a) identify and map existing EGMs in the use of diverse SBCC strategies to strengthen the adoption of HIV prevention measures and participation in research among AGYW in LMICs and (b) identify areas where more interventions and evidence are needed to inform the design of future SBCC strategies and programs for AGYW engagement in HIV prevention and research.

METHODS

This EGM is based on a comprehensive search of systematic reviews and impact evaluations corresponding to a range of interventions and outcomes-aimed at engaging AGYW in HIV prevention and research - that were published in LMICs from January 2000 to April 2021. Based on guidance for producing a Campbell Collaboration EGM, the intervention and outcome framework was designed in consultation with a group of experts. These interventions were categorized across four broad intervention themes: mass-media, community-based, interpersonal, and Information Communication and Technology (ICT)/Digital Media-based interventions. They were further sub-categorized into 15 intervention categories. Included studies looked at 23 unique behavioral and health outcomes such as knowledge attitude and skills, relationship dynamics, household dynamics, health care services, and health outcomes and research engagement. The EGM is presented as a matrix in which the rows are intervention categories/sub-categories, and the columns are outcome domains/subdomains. Each cell is mapped to an intervention targeted at outcomes. Additional filters like region, country, study design, age group, funding agency, influencers, population group, publication status, study confidence, setting, and year of publication have been added.

SELECTION CRITERIA

To be eligible, studies must have tested the effectiveness of SBCC interventions at engaging AGYW in LMICs in HIV prevention and research. The study sample must have consisted of AGYW between the ages of 15-24, as defined by UNAIDS. Both experimental (random assignment) and quasi-experimental studies that included a comparison group were eligible. Relevant outcomes included those at the individual, influencer, and institutional levels, along with those targeting research engagement and prevention-related outcomes.

RESULTS

This EGM comprises 415 impact evaluations and 43 systematic reviews. Interventions like peer-led interactions, counseling, and community dialogues were the most dominant intervention sub-types. Despite increased digital penetration use of media and technology-driven interventions are relatively less studied. Most of the interventions were delivered by peers, health care providers, and educators, largely in school-based settings, and in many cases are part of sex-education curricula. Evidence across geographies was mostly concentrated in Sub-Saharan Africa (70%). Most measured outcomes focused on disease-related knowledge dissemination and enhancing awareness of available prevention options/strategies. These included messaging around consistent condom use, limiting sexual partners, routine testing, and awareness. Very few studies were able to include psychographic, social, and contextual factors influencing AGYW health behaviors and decisions, especially those measuring the impact of social and gender norms, relationship dynamics, and household dynamics-related outcomes. Outcomes related to engagement in the research were least studied.

CONCLUSION

This EGM highlights that evidence is heavily concentrated within the awareness-intent spectrum of behavior change and gets lean for outcomes situated within the intent-action and the action-habit formation spectrum of the behavior change continuum. Most of the evidence was concentrated on increasing awareness, knowledge, and building risk perception around SRH domains, however, fewer studies focused on strengthening the agency and self-efficacy of individuals. Similarly, evidence on extrinsic factors-such as strengthening social and community norms, relationships, and household dynamics-that determine individual thought and action such as negotiation and life skills were also found to be less populated. Few studies explore the effectiveness of these interventions across diverse AGYW identities, like pregnant women and new mothers, sex workers, and people living with HIV, leading to limited understanding of the use of these interventions across multiple user segments including key influencers such as young men, partners, families, religious leaders, and community elders was relatively low. There is a need for better quality evidence that accounts for the diversity of experiences within these populations to understand what interventions work, for whom, and toward what outcome. Further, the evidence for use of digital and mass-media tools remains poorly populated. Given the increasing penetration of these tools and growing media literacy on one end, with widening gender-based gaps on the other, it is imperative to gather more high-quality evidence on their effectiveness. Timely evidence generation can help leverage these platforms appropriately and enable intervention designs that are responsive to changing communication ecologies of AGYW. SBCC can play a critical role in helping researchers meaningfully engage and collaborate with communities as equal stakeholders, however, this remains poorly evidenced and calls for investigation and investment. A full list of abbreviations and acronyms are available in Supporting Information: Appendix F.

Stakeholder acceptability of the risk reduction behavioural model [RRBM] as an alternative model for adolescent HIV risk reduction and sexual behavior change in Northern Malawi

We sought to assess stakeholder acceptability of a risk reduction behavioural model [RRBM] designed for adolescent HIV risk reduction and whose efficacy we tested in selected schools in Northern Malawi. We used qualitative procedures in sampling, data collection and data analysis. Our data collection instrument was the semi-structured interview and we applied thematic content analysis to establish stakeholder evaluations of the RRBM model. The study population included10 experts working within key organizations and teachers from two schools. The organizations were sampled as providers, implementers and designers of interventions while schools were sampled as providers and consumers of interventions. Individual study participants were recruited purposively through snowball sampling. Results showed consensus among participants on the acceptability, potential for scale up and likelihood of model sustainability if implemented. In essence areas to consider improving and modifying included: focus on the rural girl child and inclusion of an economic empowerment component to target the underlying root causes of HIV risk taking behavior. Stakeholders also recommended intervention extension to out of school adolescent groups as well as involvement of traditional leaders. Involvement of parents and religious leaders in intervention scale up was also highlighted. The study serves as a benchmark for stakeholder involvement in model and intervention evaluation and as a link between researchers and project implementers, designers as well as policy makers to bridge the research to policy and practice gap.

Replication of influential studies on biomedical, social, behavioural and structural interventions for HIV prevention and treatment

Replication is an important tool to promote high quality research and ensure policy makers can rely on studies in making guidelines or funding programs. By ensuring influential studies are replicable we provide assurance that the policies based on these studies are well-founded and the conclusions and recommendations are robust-to different estimation models or different choices. In this paper, we argue that replication is not only useful but necessary to ensure that an author's choice in how to analyse data is not the only factor that determines whether an intervention is effective or not. We also show that while most research is done well and provides robust results, small differences can lead to different interpretations and these differences need to be acknowledged. This special issue highlights 5 such replication studies, which are replications of influential studies on biomedical, social, behavioural and structural interventions for HIV prevention and treatment. We reflect on their findings. Four out of five studies, which conduct push button replication and pure replication, were able to reproduce the results of the original studies with minor differences, mainly due to minor typographical errors or rounding differences. The analysis of the measurement and estimation analyses conducted in these five studies reveals that the original results are not very robust to alternative analytical approaches, especially when these results rely on a small number of observations. In these cases, the original results are weakened. Furthermore, in contrast to the original papers, two of the five included replication studies conducted a theory of change analysis-to explore how or why the interventions work (or do not) not just whether the intervention works or not. These two analyses indicate that the estimated impacts of the interventions are drawn from few mediators. In addition, they demonstrate that, in some cases, a lack of effect may be related to lack of adequate exposure to the intervention rather than inefficacy of the intervention per se. However, overall, the included replication studies show that the results presented in the original papers are trustworthy and robust, especially when based on larger sample sizes. Replication studies can not only verify the results of a study, they can also provide additional insights on the published results, such as how and why an intervention was effective or less effective than expected. They can thus be a tool to inform the research community and/ or policymakers about whether and how interventions could be adopted, which need to be tested further, and which should be discontinued because of their ineffectiveness. Thus, publishing these replication studies in peer-reviewed journals makes the work public and publicized. The work advances knowledge, and publication should be encouraged, as it is for other types of research.

A framework for clinical and translational research in the era of rigor and reproducibility

INTRODUCTION

Rigor and reproducibility are two important cornerstones of medical and scientific advancement. Clinical and translational research (CTR) contains four phases (T1-T4), involving the translation of basic research to humans, then to clinical settings, practice, and the population, with the ultimate goal of improving public health. Here we provide a framework for rigorous and reproducible CTR.

METHODS

In this paper we define CTR, provide general and phase-specific recommendations for improving quality and reproducibility of CTR with emphases on study design, data collection and management, analyses and reporting. We present and discuss aspects of rigor and reproducibility following published examples of CTR from the literature, including one example that shows the development path of different treatments that address anaplastic lymphoma kinase-positive (ALK+) non-small cell lung cancer (NSCLC).

RESULTS

It is particularly important to consider robust and unbiased experimental design and methodology for analysis and interpretation for clinical translation studies to ensure reproducibility before taking the next translational step. There are both commonality and differences along the clinical translation research phases in terms of research focuses and considerations regarding study design, implementation, and data analysis approaches.

CONCLUSIONS

Sound scientific practices, starting with rigorous study design, transparency, and team efforts can greatly enhance CTR. Investigators from multidisciplinary teams should work along the spectrum of CTR phases, and identify optimal practices for study design, data collection, data analysis, and results reporting to allow timely advances in the relevant field of research.