Quasi-experimental evaluation using confirmatory procedures: A case study of an economic and social empowerment intervention to reduce girls' vulnerability to HIV in rural Mozambique

Systematic review of cash plus or bundled interventions targeting adolescents in Africa to reduce HIV risk

BACKGROUND

HIV remains a leading cause of death for adolescents and young people aged 10-24 years. HIV prevention requires multisectoral approaches that target adolescents and young people, addressing HIV risk pathways (e.g., transactional sex, gender-based violence, and school attendance) through bundled interventions that combine economic strengthening, health capabilities, and gender equality education. However, best practices are unknown because evidence on multisectoral programming targeted to adolescents and combining these components has not been systematically reviewed.

METHODS

We conducted a systematic review to summarize the evidence on bundled interventions combining health and economic strengthening components for adolescents and young people and their effects on HIV/STI incidence and risk factors. We included studies from Africa published between 2005 and 2023, combining at least one economic strengthening and one health component, directed toward adolescents and young people aged 10-24 years. Included studies measured programmatic impacts on primary outcomes: HIV and STI incidence/prevalence; and mediators as secondary outcomes: sexual behaviours, sexual and reproductive health, school attendance, health-seeking behaviours, and violence. We conducted key word searches in PubMed, EMBASE, and Web of Science, imported titles/abstracts from the initial search, and reviewed them using the inclusion criteria. Full texts of selected articles were reviewed and information was extracted for analysis. Findings from the full texts identified were summarized.

RESULTS

We reviewed 58 studies, including 43 quantitative studies and 15 qualitative studies, evaluating 26 unique interventions. A majority of studies reviewed were conducted in Eastern and Southern Africa. Interventions reviewed showed a greater number of significant results in improving economic outcomes; mental health and psychosocial outcomes; sexual and reproductive health knowledge and services utilization; and HIV prevention knowledge and testing. They showed fewer significant results in improving outcomes related to HIV incidence/prevalence; sexual risk behaviours; gender-based violence; gender attitudes; education; STI incidence, prevalence and testing; and sexual debut.

CONCLUSIONS

Our review demonstrated the potential for bundled, multisectoral interventions for preventing HIV and facilitating safe transitions to adulthood. Findings have implications for designing HIV sensitive programmes on a larger scale, including how interventions may need to address multiple strata of the social ecological model to achieve success in the prevention of HIV and related pathways.

Evidence and gap map report: Social and Behavior Change Communication (SBCC) interventions for strengthening HIV prevention and research among adolescent girls and young women (AGYW) in low- and middle-income countries (LMICs)

BACKGROUND

Adolescent girls and young women (AGYW), aged 15-24 years, are disproportionately affected by HIV and other sexual and reproductive health (SRH) risks due to varying social, cultural, and economic factors that affect their choices and shape their knowledge, understanding, and practices with regard to their health. Socio-Behavioral Change Communication (SBCC) interventions targeted at strengthening the capabilities of individuals and their networks have supported the demand and uptake of prevention services and participation in biomedical research. However, despite growing global recognition of the domain, high-quality evidence on the effectiveness of SBCC remains scattered. This evidence and gap map (EGM) report characterizes the evidence base on SBCC interventions for strengthening HIV Prevention and Research among AGYW in low- and middle-income countries (LMICs), identifying evidence gaps and outlining the scope of future research and program design.

OBJECTIVES

The objectives of the proposed EGM are to: (a) identify and map existing EGMs in the use of diverse SBCC strategies to strengthen the adoption of HIV prevention measures and participation in research among AGYW in LMICs and (b) identify areas where more interventions and evidence are needed to inform the design of future SBCC strategies and programs for AGYW engagement in HIV prevention and research.

METHODS

This EGM is based on a comprehensive search of systematic reviews and impact evaluations corresponding to a range of interventions and outcomes-aimed at engaging AGYW in HIV prevention and research - that were published in LMICs from January 2000 to April 2021. Based on guidance for producing a Campbell Collaboration EGM, the intervention and outcome framework was designed in consultation with a group of experts. These interventions were categorized across four broad intervention themes: mass-media, community-based, interpersonal, and Information Communication and Technology (ICT)/Digital Media-based interventions. They were further sub-categorized into 15 intervention categories. Included studies looked at 23 unique behavioral and health outcomes such as knowledge attitude and skills, relationship dynamics, household dynamics, health care services, and health outcomes and research engagement. The EGM is presented as a matrix in which the rows are intervention categories/sub-categories, and the columns are outcome domains/subdomains. Each cell is mapped to an intervention targeted at outcomes. Additional filters like region, country, study design, age group, funding agency, influencers, population group, publication status, study confidence, setting, and year of publication have been added.

SELECTION CRITERIA

To be eligible, studies must have tested the effectiveness of SBCC interventions at engaging AGYW in LMICs in HIV prevention and research. The study sample must have consisted of AGYW between the ages of 15-24, as defined by UNAIDS. Both experimental (random assignment) and quasi-experimental studies that included a comparison group were eligible. Relevant outcomes included those at the individual, influencer, and institutional levels, along with those targeting research engagement and prevention-related outcomes.

RESULTS

This EGM comprises 415 impact evaluations and 43 systematic reviews. Interventions like peer-led interactions, counseling, and community dialogues were the most dominant intervention sub-types. Despite increased digital penetration use of media and technology-driven interventions are relatively less studied. Most of the interventions were delivered by peers, health care providers, and educators, largely in school-based settings, and in many cases are part of sex-education curricula. Evidence across geographies was mostly concentrated in Sub-Saharan Africa (70%). Most measured outcomes focused on disease-related knowledge dissemination and enhancing awareness of available prevention options/strategies. These included messaging around consistent condom use, limiting sexual partners, routine testing, and awareness. Very few studies were able to include psychographic, social, and contextual factors influencing AGYW health behaviors and decisions, especially those measuring the impact of social and gender norms, relationship dynamics, and household dynamics-related outcomes. Outcomes related to engagement in the research were least studied.

CONCLUSION

This EGM highlights that evidence is heavily concentrated within the awareness-intent spectrum of behavior change and gets lean for outcomes situated within the intent-action and the action-habit formation spectrum of the behavior change continuum. Most of the evidence was concentrated on increasing awareness, knowledge, and building risk perception around SRH domains, however, fewer studies focused on strengthening the agency and self-efficacy of individuals. Similarly, evidence on extrinsic factors-such as strengthening social and community norms, relationships, and household dynamics-that determine individual thought and action such as negotiation and life skills were also found to be less populated. Few studies explore the effectiveness of these interventions across diverse AGYW identities, like pregnant women and new mothers, sex workers, and people living with HIV, leading to limited understanding of the use of these interventions across multiple user segments including key influencers such as young men, partners, families, religious leaders, and community elders was relatively low. There is a need for better quality evidence that accounts for the diversity of experiences within these populations to understand what interventions work, for whom, and toward what outcome. Further, the evidence for use of digital and mass-media tools remains poorly populated. Given the increasing penetration of these tools and growing media literacy on one end, with widening gender-based gaps on the other, it is imperative to gather more high-quality evidence on their effectiveness. Timely evidence generation can help leverage these platforms appropriately and enable intervention designs that are responsive to changing communication ecologies of AGYW. SBCC can play a critical role in helping researchers meaningfully engage and collaborate with communities as equal stakeholders, however, this remains poorly evidenced and calls for investigation and investment. A full list of abbreviations and acronyms are available in Supporting Information: Appendix F.

Toward a modular evaluation approach of real-world laboratories: Findings from a literature review

The number of real-world laboratories (RwLs) as research settings to address sustainability problems by using collaborative and experimental approaches has been growing steadily over the past years. RwLs are widely considered promising settings for the production of action-orientated knowledge in order to contribute solving wicked real-world problems such as climate change. However, empirically tested evaluative approaches are rare. We argue that evaluations within RwLs are crucial for ensuring high-quality and impactful research, amplifying tested solution approaches, and driving innovative forms of transdisciplinary collaboration. At the same time, evaluations within RwLs seem difficult due to the multilayered structure of RwLs. In order to provide guidance regarding the evaluation in RwLs- for researchers and practitioners, we conduct a scoping literature review that encompasses a comprehensive understanding of RwLs. We identify studies in which the specific components of RwLs lab context, experiments, and interventions—are empirically evaluated. Drawing on our findings, we derive different types of approaches that can be used for evaluating RwLs in practice. Based on how labs, experiments, and interventions in real-world settings have been evaluated in practice so far, we suggest to design evaluation approaches depending on (1) what should exactly be evaluated in the specific RwL, (2) for which purpose, and (3) by whom. We hope this targeted, modular evaluation approach based on evaluation types found in literature will help actors engaged in RwLs to make evaluations more feasible and impactful.

HIV-sensitive social protection for vulnerable young women in East and Southern Africa: a systematic review

INTRODUCTION

Social protection programmes are considered HIV-sensitive when addressing risk, vulnerability or impact of HIV infection. Socio-economic interventions, like livelihood and employability programmes, address HIV vulnerabilities like poverty and gender inequality. We explored the HIV-sensitivity of socio-economic interventions for unemployed and out-of-school young women aged 15 to 30 years, in East and Southern Africa, a key population for HIV infection.

METHODS

We conducted a systematic review using a narrative synthesis method and the Mixed Methods Appraisal Tool for quality appraisal. Interventions of interest were work skills training, microfinance, and employment support. Outcomes of interest were socio-economic outcomes (income, assets, savings, skills, (self-) employment) and HIV-related outcomes (behavioural and biological). We searched published and grey literature (January 2005 to November 2019; English/French) in MEDLINE, Scopus, Web of Science and websites of relevant international organizations.

RESULTS

We screened 3870 titles and abstracts and 188 full-text papers to retain 18 papers, representing 12 projects. Projects offered different combinations of HIV-sensitive social protection programmes, complemented with mentors, safe space and training (HIV, reproductive health and gender training). All 12 projects offered work skills training to improve life and business skills. Six offered formal (n = 2) or informal (n = 5) livelihood training. Eleven projects offered microfinance, including microgrants (n = 7), microcredit (n = 6) and savings (n = 4). One project offered employment support in the form of apprenticeships. In general, microgrants, savings, business and life skills contributed improved socio-economic and HIV-related outcomes. Most livelihood training contributed positive socio-economic outcomes, but only two projects showed improved HIV-related outcomes. Microcredit contributed little to either outcome. Programmes were effective when (i) sensitive to beneficiaries' age, needs, interests and economic vulnerability; (ii) adapted to local implementation contexts; and (iii) included life skills. Programme delivery through mentorship and safe space increased social capital and may be critical to improve the HIV-sensitivity of socio-economic programmes.

CONCLUSIONS

A wide variety of livelihood and employability programmes were leveraged to achieve improved socio-economic and HIV-related outcomes among unemployed and out-of-school young women. To be HIV-sensitive, programmes should be designed around their interests, needs and vulnerability, adapted to local implementation contexts, and include life skills. Employment support received little attention in this literature.

Evaluating a large-scale online behaviour change intervention aimed at wildlife product consumers in Singapore

Interventions to shift the behaviour of consumers using unsustainable wildlife products are key to threatened species conservation. Whether these interventions are effective is largely unknown due to a dearth of detailed evaluations. We previously conducted a country-level online behaviour change intervention targeting consumers of the Critically Endangered saiga antelope (Saiga tatarica) horn in Singapore. To evaluate intervention impact, we carried out in-person consumer surveys with >2,000 individuals pre- and post-intervention (2017 and 2019), and 93 in-person post-intervention surveys with traditional Chinese medicine (TCM) shopkeepers (2019). The proportion of self-reported high-usage saiga horn consumers in the target audience (Chinese Singaporean women aged 35-59) did not change significantly from pre- to post-intervention (24.4% versus 22.6%). However, post-intervention the target audience was significantly more likely than the non-target audience to accurately recall the intervention message and to report a decrease in saiga horn usage (4% versus 1% reported a behaviour change). Within the target audience, high-usage consumers were significantly more likely than lower-usage consumers to recall the message and report a behaviour change. Across respondents who reported a decrease in saiga horn usage, they cited the intervention message as a specific reason for their behaviour change significantly more than other reasons. Additionally, across all respondents, the belief that saiga is a common species in the wild decreased significantly from pre- to post-intervention. TCM shopkeepers, however, cited factors such as price and availability as the strongest influences on saiga horn sales. In sum, the intervention did significantly influence some consumers but the reduction of high-usage consumer frequency was not significant at the population level. We explore reasons for these findings, including competing consumer influences, characteristics of the intervention, and evaluation timing. This work suggests our intervention approach has potential, and exemplifies a multi-pronged in-person evaluation of an online wildlife trade consumer intervention.

Youth engagement in HIV prevention intervention research in sub-Saharan Africa: a scoping review

INTRODUCTION

Youth engagement in HIV research is generally recognized as essential, but often neglected or minimally implemented in practice. Engagement is a process of working collaboratively with diverse groups of people to address common issues. We conducted a scoping review of youth HIV prevention interventions in sub-Saharan Africa to identify and categorize forms and levels of youth engagement across the lifespan of intervention research.

METHODS

We followed Arksey and O'Malley's framework for organizing a scoping review. We searched seven databases for related articles on identified intervention studies through May 28th 2020. Included studies focused on youth (10 to 24 years old) HIV prevention interventions in sub-Saharan Africa. Two reviewers independently examined citations and full manuscripts for inclusion. Data were extracted on study characteristics, location, description of youth engagement and extent of engagement. Youth engagement approaches were categorized based on Hart's ladder as substantial engagement (strong youth decision-making power), moderate engagement (shared decision making with adults), minimal engagement (no youth decision-making power) or no engagement.

RESULTS

We identified 3149 citations and included 112 studies reporting on 74 unique HIV interventions. Twenty-two interventions were in low-income countries, 49 in middle-income countries, and three were in both. Overall, only nine interventions (12%) had substantial or moderate youth engagement, two-thirds (48, 65%) had minimal youth engagement and 17 interventions (23%) had no youth engagement. We also identified specific engagement strategies (e.g. youth-led research, crowdsourcing) that were feasible in multiple settings and resulted in substantial engagement.

CONCLUSIONS

We found limited youth engagement in youth HIV prevention intervention studies in sub-Saharan Africa. However, several activities resulted in substantial youth engagement and could be relevant in many low-and-middle-income-country (LMIC) settings.