How far is mixed methods research in the field of health policy and systems in Africa? A scoping review

Factors associated with COVID-19 vaccine hesitancy in Senegal: A mixed study

This study was an explanatory, sequential, mixed-methods design conducted in Senegal. We collected quantitative data from December 24, 2020, to January 16, 2021, and qualitative data from February 19 to March 30, 2021. We conducted a telephone survey among a marginal quota sample of 607 people over 18 years old. We performed descriptive, bivariate, and multivariate analyses with R software for the quantitative phase; and performed manual content analyses for the qualitative phase. We surveyed 607 people for the quantitative phase and interviewed 30 people for the qualitative phase. Individuals who hesitated or refused to be vaccinated represented 12.9% and 32.8%, respectively. Vaccine hesitancy was related to gender, living in large cities, having a poor attitude toward the vaccine, thinking that the vaccine would not help protect them from the virus, being influenced by people important to them, and lacking information from health professionals. Vaccine refusal was related to living in large cities, having a poor attitude toward the vaccine, thinking that the vaccine would not help protect them from the virus, thinking that the vaccine could endanger their health, trusting opinions of people who were important to them, and lacking information from health professionals. The results of the study show that the factors associated with COVID-19 vaccine hesitancy and refusal are diverse and complex. Addressing these factors will help to ensure better vaccination coverage. Governments and health authorities should intensify their efforts to promote vaccine confidence and reduce misinformation.

The elephant in the room: Intimate partner violence, women, and traumatic brain injury in sub-Saharan Africa

Background

Intimate partner violence (IPV) is a gendered form of violence that has been linked with traumatic brain injury (TBI). The prevalence of IPV in sub-Saharan Africa (SSA) is estimated to be one of the highest globally. Yet, little is known about the association between IPV and TBI in the SSA context. In this scoping review, we examine the intersection between IPV and TBI in SSA to identify gaps, as well as intervention opportunities.

Methods

Using the Preferred Reporting Items for Systematic Reviews and Meta-Analyses—Extension for Scoping Review (PRISMA-ScR) guidelines to guide our analyses and reporting, we searched for published articles indexed in the four largest and most comprehensive library databases: Pubmed, Embase, Web of Science and PsychInfo. Given the increasing attention that has been placed on gender disparities and health in recent years, we focused on studies published between 2010 and 2021.

Results

Our search yielded 5,947 articles and 1,258 were IPV and SSA related. Out of this, only ten examined the intersection between IPV and TBI. All focused on outcomes in female populations from South Africa (n = 5), Ghana (n = 3), Uganda (n = 1), and Cameroon (n = 1). They were a mix of qualitative studies (n = 3), neuro-imaging/biomarker studies (n = 3), case studies/reports (n = 2), quantitative surveys (n = 1) and mixed qualitative/quantitative study (n = 1). Six studies evaluated subjective reporting of IPV-induced TBI symptoms such as headaches, sleep disruptions, and ophthalmic injuries. Three examined objective assessments and included Hypothalamic-Pituitary-Adrenal (HPA) dysregulation detected by salivary cortisol levels, magnetic resonance imaging (MRI) including diffusion tensor imaging (DTI) to evaluate brain connectivity and white matter changes. One final study took a forensic anthropology lens to document an autopsy case report of IPV-induced mortality due to physical head and face trauma.

Conclusion

Our findings demonstrate that both subjective and objective assessments of IPV and TBI are possible in “resource-limited” settings. The combination of these outcomes will be critical for viewing IPV through a clinical rather than a cultural lens, and for substantiating the assertion that gender, is indeed, a social determinant of brain health.

Mixed methods research in complementary and alternative medicine: a scoping review

OBJECTIVE

To update the current characteristics about the scope and quality of mixed methods research (MMR) in complementary and alternative medicine (CAM) after nearly 10 years.

METHODS

A 5-stage approach for conducting a scoping review was adopted. Articles published on the top 10 journals in CAM with the highest impact factor in 2020 were screened for MMR. Information of included articles were extracted, and then synthesized to illustrate the current state. Methodological quality was evaluated according to the Mixed Method Appraisal Tool (MMAT) 2018 version.

RESULTS

A total of 55 (55/2991, 2%) articles using mixed methods were retrieved, including 17 medical studies and 38 ethnobotanical studies. We performed an in-depth analysis on the 17 medical studies, which studied cancer, stress, pain, fatigue, exercises, mindfulness intervention, herbal medicine use, art and acupuncture. Thirteen pilot studies applied MMR to evaluate the feasibility of interventions or programs (13/17, 76%); phenomenology was inferred as the most common philosophical assumptions (13/17, 76%); the most applied type of MMR was convergent design (16/17, 94%); integration often took place at integration (12/17, 71%). Among the 16 eligible studies for quality appraisal, majority were rated as good (14/16, 88%), whereas two studies were rated as poorly described. Primarily, a poor rating was due to incomplete reporting of data analysis and citations in qualitative components; lack of confounder controlling and the sampling strategy in quantitative components; poor description of integration and justification for mixed methods. Comparing with the previous review, fewer MMR were published in 2020 in CAM, but the proportion of studies that clearly reported MMR has increased by 4 times (4%→15%).

CONCLUSION

CAM researchers need to realize the benefits that MMR can have on conducting further health care research. Our findings highlight that applying MMR will be helpful to understand the complex dynamics and interdisciplinary nature of complex intervention. In addition, addressing a standardized reporting criteria for MMR is recommended.

Are Malaria Risk Factors Based on Gender? A Mixed-Methods Survey in an Urban Setting in Ghana

Malaria still represents one of the most debilitating and deadly diseases in the world. It has been suggested that malaria has different impacts on women and men due to both social and biological factors. A gender perspective is therefore important to understand how to eliminate malaria. This study aimed to investigate malaria from a gender perspective in a non-for-profit private health facility, HopeXchange Medical Centre, based in Kumasi (Ghana). A sequential mixed-methods design, comprising quantitative and qualitative methods, was used. This study found low ownership (40%) and use (19%) of insecticide-treated nets (ITNs). Most malaria cases were women (62%), who were less educated and had more external risk factors associated with infection. Our study reported a trend of preferring malaria self-medication at home, which was practiced mostly by men (43%). Our data suggest that women are more likely to be exposed to malaria infections than men, especially due to their prolonged exposure to mosquito bites during the most dangerous hours. Our study highlighted the need for future malaria control policies to be more focused on social and behavioral aspects and from a gender perspective.

Towards an Explanation of the Social Value of Health Systems: An Interpretive Synthesis

BACKGROUND

Health systems are complex social systems, and values constitute a central dimension of their complexity. Values are commonly understood as key drivers of health system change, operating across all health systems components and functions. Moreover, health systems are understood to influence and generate social values, presenting an opportunity to harness health systems to build stronger, more cohesive societies. However, there is little investigation (theoretical, conceptual, or empirical) on social values in health policy and systems research (HPSR), particularly regarding the capacity of health systems to influence and generate social values. This study develops an explanatory theory for the 'social value of health systems.'

METHODS

We present the results of an interpretive synthesis of HPSR literature on social values, drawing on a qualitative systematic review, focusing on claims about the relationship between 'health systems' and 'social values.' We combined relational claims extracted from the literature under a common framework in order to generate new explanatory theory.

RESULTS

We identify four mechanisms by which health systems are considered to contribute social value to society: Health systems can: (1) offer a unifying national ideal and build social cohesion, (2) influence and legitimise popular attitudes about rights and entitlements with regard to healthcare and inform citizen's understanding of state responsibilities, (3) strengthen trust in the state and legitimise state authority, and (4) communicate the extent to which the state values various population groups.

CONCLUSION

We conclude that, using a systems-thinking and complex adaptive systems perspective, the above mechanisms can be explained as emergent properties of the dynamic network of values-based connections operating within health systems. We also demonstrate that this theory accounts for how HPSR authors write about the relationship between health systems and social values. Finally, we offer lessons for researchers and policy-makers seeking to bring about values-based change in health systems.

Lessons Learned From Implementing Prospective, Multicountry Mixed-Methods Evaluations for Gavi and the Global Fund

Lessons learned from implementing evaluations for Gavi, the Vaccine Alliance and the Global Fund for AIDS, Tuberculosis, and Malaria can help inform the design and implementation of ongoing or future evaluations of complex interventions. We share 5 lessons distilled from over 7 years of experience implementing evaluations in 7 countries.

Introduction:

As global health programs have become increasingly complex, corresponding evaluations must be designed to assess the full complexity of these programs. Gavi and the Global Fund have commissioned 2 such evaluations to assess the full spectrum of their investments using a prospective mixed-methods approach. We aim to describe lessons learned from implementing these evaluations.

Methods:

This article presents a synthesis of lessons learned based on the Gavi and Global Fund prospective mixed-methods evaluations, with each evaluation considered a case study. The lessons are based on the evaluation team’s experience from over 7 years (2013–2020) implementing these evaluations. The Centers for Disease Control and Prevention Framework for Evaluation in Public Health was used to ground the identification of lessons learned.

Results:

We identified 5 lessons learned that build on existing evaluation best practices and include a mix of practical and conceptual considerations. The lessons cover the importance of (1) including an inception phase to engage stakeholders and inform a relevant, useful evaluation design; (2) aligning on the degree to which the evaluation is embedded in the program implementation; (3) monitoring programmatic, organizational, or contextual changes and adapting the evaluation accordingly; (4) hiring evaluators with mixed-methods expertise and using tools and approaches that facilitate mixing methods; and (5) contextualizing recommendations and clearly communicating their underlying strength of evidence.

Conclusion:

Global health initiatives, particularly those leveraging complex interventions, should consider embedding evaluations to understand how and why the programs are working. These initiatives can learn from the lessons presented here to inform the design and implementation of such evaluations.

Health Insurance in Sub-Saharan Africa: A Scoping Review of the Methods Used to Evaluate its Impact

We conducted a scoping review with the objective of synthesizing available literature and mapping what designs and methods have been used to evaluate health insurance reforms in sub-Saharan Africa. We systematically searched for scientific and grey literature in English and French published between 1980 and 2017 using a combination of three key concepts: "Insurance" and "Impact evaluation" and "sub-Saharan Africa". The search led to the inclusion of 66 articles with half of the studies pertaining to the evaluation of National Health Insurance schemes, especially the Ghanaian one, and one quarter pertaining to Community-Based Health Insurance and Mutual Health Organization schemes. Sixty-one out of the 66 studies (92%) included were quantitative studies, while only five (8%) were defined as mixed methods. Most studies included applied an observational design (n = 37; 56%), followed by a quasi-experimental (n = 27; 41%) design; only two studies (3%) applied an experimental design. The findings of our scoping review are in line with the observation emerging from prior reviews focused on content in pointing at the fact that evidence on the impact of health insurance is still relatively weak as it is derived primarily from studies relying on observational designs. Our review did identify an increase in the use of quasi-experimental designs in more recent studies, suggesting that we could observe a broadening and deepening of the evidence base on health insurance in Africa over the next few years.

Exploiting the emergent nature of mixed methods designs: insights from a mixed methods impact evaluation in Malawi

The application of mixed methods in Health Policy and Systems Research (HPSR) has expanded remarkably. Nevertheless, a recent review has highlighted how many mixed methods studies do not conceptualize the quantitative and the qualitative component as part of a single research effort, failing to make use of integrated approaches to data collection and analysis. More specifically, current mixed methods studies rarely rely on emergent designs as a specific feature of this methodological approach. In our work, we postulate that explicitly acknowledging the emergent nature of mixed methods research by building on a continuous exchange between quantitative and qualitative strains of data collection and analysis leads to a richer and more informative application in the field of HPSR. We illustrate our point by reflecting on our own experience conducting the mixed methods impact evaluation of a complex health system intervention in Malawi, the Results Based Financing for Maternal and Newborn Health Initiative. We describe how in the light of a contradiction between the initial set of quantitative and qualitative findings, we modified our design multiple times to include additional sources of quantitative and qualitative data and analytical approaches. To find an answer to the initial riddle, we made use of household survey data, routine health facility data, and multiple rounds of interviews with both healthcare workers and service users. We highlight what contextual factors made it possible for us to maintain the high level of methodological flexibility that ultimately allowed us to solve the riddle. This process of constant reiteration between quantitative and qualitative data allowed us to provide policymakers with a more credible and comprehensive picture of what dynamics the intervention had triggered and with what effects, in a way that we would have never been able to do had we kept faithful to our original mixed methods design.

A critical realist synthesis of cross-disciplinary health policy and systems research: defining characteristic features, developing an evaluation framework and identifying challenges

BACKGROUND

Health policy and systems research (HPSR) is an inherently cross-disciplinary field of investigation. However, conflicting conceptualisations about inter-, multi- and transdisciplinary research have contributed to confusion about the characteristics of cross-disciplinary approaches in HPSR. This review was conducted to (1) define the characteristic features of context-mechanism-outcome (CMO) configurations in cross-disciplinary HPSR, (2) develop criteria for evaluating cross-disciplinarity and (3) synthesise emerging challenges of the approach.

METHOD

The paper is a critical realist synthesis conducted in three phases, as follows: (1) scoping the literature, (2) searching for and screening the evidence, and (3) extracting and synthesising the evidence. Five databases, namely the International Bibliography of the Social Sciences and Web of Science, PubMed central, Embase and CINHAL, and reference lists of studies that qualified for inclusion in the review were searched. The search covered peer-reviewed original research, reviews, commentary papers, and institutional or government reports published in English between January 1998 and January 2020.

RESULTS

A total of 7792 titles were identified in the online search and 137 publications, comprising pilot studies as well as anecdotal and empirical literature were selected for the final review. The review draws attention to the fact that cross-disciplinary HPSR is not defined by individual characteristics but by the combination of a particular type of research question and setting (context), a specific way of researchers working together (mechanism), and research output (outcome) that is superior to what could be achieved under a monodisciplinary approach. This CMO framework also informs the criteria for assessing whether a given HPSR is truly cross-disciplinary. The challenges of cross-disciplinary HPSR and their accompanying coping mechanisms were also found to be context driven, originating mainly from conceptual disagreements, institutional restrictions, communication and information management challenges, coordination problems, and resource limitations.

CONCLUSION

These findings have important implications. First, the CMO framework of cross-disciplinary HPSR can provide guidance for researchers engaging in new projects and for policy-makers using their findings. Second, the proposed criteria for evaluating theory and practice of cross-disciplinary HPSR may inform the systematic development of new research projects and the structured assessment of existing ones. Third, a better understanding of the challenges of cross-disciplinary HPSR and potential response mechanisms may help researchers to avoid these problems in the future.

Social values and health systems in health policy and systems research: a mixed-method systematic review and evidence map

Because health systems are conceptualized as social systems, embedded in social contexts and shaped by human agency, values are a key factor in health system change. As such, health systems software-including values, norms, ideas and relationships-is considered a foundational focus of the field of health policy and systems research (HPSR). A substantive evidence-base exploring the influence of software factors on system functioning has developed but remains fragmented, with a lack of conceptual clarity and theoretical coherence. This is especially true for work on 'social values' within health systems-for which there is currently no substantive review available. This study reports on a systematic mixed-methods evidence mapping review on social values within HPSR. The study reaffirms the centrality of social values within HPSR and highlights significant evidence gaps. Research on social values in low- and middle-income country contexts is exceedingly rare (and mostly produced by authors in high-income countries), particularly within the limited body of empirical studies on the subject. In addition, few HPS researchers are drawing on available social science methodologies that would enable more in-depth empirical work on social values. This combination (over-representation of high-income country perspectives and little empirical work) suggests that the field of HPSR is at risk of developing theoretical foundations that are not supported by empirical evidence nor broadly generalizable. Strategies for future work on social values in HPSR are suggested, including: countering pervasive ideas about research hierarchies that prize positivist paradigms and systems hardware-focused studies as more rigorous and relevant to policy-makers; utilizing available social science theories and methodologies; conceptual development to build common framings of key concepts to guide future research, founded on quality empirical research from diverse contexts; and using empirical evidence to inform the development of operationalizable frameworks that will support rigorous future research on social values in health systems.

Mild traumatic brain injury/concussion and female sexuality, a scoping review of the literature

Background

The American Congress of Rehabilitation Medicine (ACRM) in 2010 called for more head injury research on gender disparities to bridge the gender gap for the short-and long-term effects of TBI, including sexual and reproductive outcomes. In this paper, we review the state of the literature before and after the ACRM announcement, and evaluate how research teams have considered females and mildly injured TBI(mTBI)/concussion groups in post-TBI-related changes in sexual functioning.

Methods

The research question for this scoping review was “what is the state of the literature in the evaluation of post-TBI sexual changes for women, and individuals with mTBI?” Using the 2010 ACRM call for action as a line of demarcation, we compared our findings before and after the 2010 announcement.

Results

We identified 9 research studies that addressed sexual functioning changes in females and mTBI/concussion groups. Four of the nine were published before the 2010 ACRM announcement, and five were published after. The representation of female research participants increased steadily over the 28-year timespan. The proportion of individuals with mTBI included in the post-2010 era was higher than the earlier time period. Consistently, women with mTBI reported more adverse sexual outcomes compared to male cohorts, orthopaedic, and non-injured comparison groups. This observation persisted regardless of recruitment site (rehabilitation center/Emergency Department (ED)/Community) or time of outcome assessment (acute versus chronic). The findings also remained despite the heterogeneity of survey questionnaires used to evaluate sexual functioning outcomes. Excluding the most recent 2019 study, none of the research groups compared the findings by TBI severity, making it difficult to fully understand how concussion-related sexual changes compare to more severe forms of the head injury. The long term impacts of the sexual changes, such as infertility and relationship discord were also absent across all studies; even though most evaluated outcomes chronically (some as far out as 20 years post injury).

Conclusion

The number of publications in the era before the ACRM call for action and afterwards were almost identical. In order to tailor interventions for the appropriate groups of TBI patients, more neurosexuality research is needed to increase awareness of the importance of sexuality as a health outcome for individuals with neurodisabilities.

[Recurrence of dengue epidemics in Burkina Faso: Community preference for an intervention to prevent the disease]

BACKGROUND

Community-based interventions have proven effective in several Latin American countries in controlling dengue vector Aedes aegypti and reducing the burden of the disease. However, we did not find any study reporting the assessment or implementation of such interventions in Sub-Saharan Africa. This article presents local communities' preferences for activities as part of the implementation of a community-based intervention for dengue prevention in Ouagadougou (Burkina Faso) where dengue epidemics are recurrent during the rainy season.

METHODS

A mixed-method study combining qualitative and quantitative data collection was conducted. Information from 983 households and their preferences for community-based activities for dengue prevention were collected in five neighborhoods of the city using a quantitative questionnaire. Then, 15 qualitative focus groups were organized in one of the neighborhoods that was randomly selected to receive a community-based intervention for dengue prevention. These groups were made up of 216 people representing the different socio-cultural categories: community leaders, men, women, young girls and boys.

RESULTS

More than 95% of household respondents to the quantitative questionnaire found community-based interventions acceptable and/or useful: to raise awareness of mosquito-borne disease transmission, to identify and remove the mosquito breeding sites and areas favorable to the development of the adult vectors. Most participants in the focus groups, preferred outreach activities such as video/debate sessions, school and home education sessions, focus groups. They also preferred the implementation of community working groups, responsible for identifying and eliminating mosquito breeding sites in the neighborhood. However, many participants had reservations about sending preventive text messages to residents. They found it feasible but not useful since most people cannot read.

CONCLUSION

This study shows that it is important to get the local communities involved in the formulation of health prevention activities in sub-Saharan Africa where some interventions are often implemented using strategies from other continents.