Mentorship for operational research capacity building: hands-on or hands-off?

Quality, Equity and Utility of Observational Studies during 10 Years of Implementing the Structured Operational Research and Training Initiative in 72 Countries

Introduction: Observational studies are often inadequately reported, making it difficult to assess their validity and generalizability and judge whether they can be included in systematic reviews. We assessed the publication characteristics and quality of reporting of observational studies generated by the Structured Operational Research and Training Initiative (SORT IT). Methods: A cross-sectional analysis of original publications from SORT IT courses. SORT IT is a global partnership-based initiative aimed at building sustainable capacity for conducting operational research according to country priorities and using the generated evidence for informed decision-making to improve public health. Reporting quality was independently assessed using an adapted version of ‘Strengthening the Reporting of Observational Studies in Epidemiology’ (STROBE) checklist. Results: In 392 publications, involving 72 countries, 50 journals, 28 publishers and 24 disease domains, low- and middle-income countries (LMICs) first authorship was seen in 370 (94%) and LMIC last authorship in 214 (55%). Publications involved LMIC-LMIC collaboration in 90% and high-income-country-LMIC collaboration in 87%. The majority (89%) of publications were in immediate open access journals. A total of 346 (88.3%) publications achieved a STROBE reporting quality score of >85% (excellent), 41 (10.4%) achieved a score of 76–85% (good) and 5 (1.3%) a score of 65–75% (fair). Conclusion: The majority of publications from SORT IT adhere to STROBE guidelines, while also ensuring LMIC equity and collaborative partnerships. SORT IT is, thus, playing an important role in ensuring high-quality reporting of evidence for informed decision-making in public health.

Implementation, Outputs, and Cost of a National Operational Research Training in Rwanda

Background

Training and mentorship in research skills are essential to developing a critical mass of researchers in low- and middle-income countries (LMICs). However, reporting on the details of such training programs, especially regarding the cost of the training, is limited.

Objectives

This paper describes a year-long operational research training and mentorship course in Rwanda, implemented between 2013 and 2017.

Approach

We describe motivations for the design of the Intermediate Operational Research Training Course (IORT) across four iterations. We also report outputs, evaluate trainee experiences, and estimate training and mentorship costs.

Findings

Of the 132 applicants to the course, 55 (41.7%) were selected, and 53 (96.4%) completed the training. The ratio of female-to-male trainees in the course increased from 1:8 in 2013 to 1:3 in 2017. Trainees developed and co-first-authored 28 research manuscripts, 96.4% (n = 27) of which are published in peer-reviewed journals. For the 15 trainees who completed the post-course evaluation, 93.3% and 86.7% reported improvement in their research and analytical skills, respectively. The median cost per trainee to complete the course was US$908 (Range: US$739-US$1,253) and per research project was US$2,708 (US$1,748-US$6,741). The median annual training delivery and mentorship cost was US$47,170 (US$30,563-US$63,849) for a course with a Rwanda-based senior mentor, junior mentor, and training coordinator. The total essential cost for a year-long IORT course with 16 trainees co-leading eight research projects and mentored by two senior and four junior mentors was US$101,254 (US$73,486-US$157,569).

Conclusion

We attribute the high course completion rates, publication rates, and skills acquisition to the learning-by-doing approach and intensive hands-on mentorship provided in the course. IORT was costly and funded through institutional resources and international partnerships. We encourage funders to prioritize comprehensive research capacity-building initiatives that provide intensive mentorship as these are likely to improve the pool of skilled researchers in LMICs.

Closing the barrier between disease and health outcomes in Africa through research and capacity development

BACKGROUND

While the burden of disease in Africa is high, health research emanating from the continent is low. Building human capacity and research infrastructure to close the gap between research and disease is thus of great imporatance.

OBJECTIVE

In order to improve research outputs and postgraduate training in the Faculty of Health Sciences, University of the Witwatersrand, the Health Sciences Research Office put in place a series of strategic initiatives over time.

METHODS

A range of strategic activities, for both postgraduate students and academic staff, were developed in parallel and sequentially over a period of approximately nine years (2008-2016). The latter years were a time of consolidation of the programmes. Outcomes of these activities were 'measured' by increases in publications, decreases in time to graduation and enrichment of the research environment.

RESULTS

A doubling of research publications and an increase in citations occurred over the period under review. In addition, there was a decrease in the time postgraduate students took to graduate.

CONCLUSIONS

A varied, but structured research management plan may be of value in African and other developing health sciences institutions to enable the increase in research outputs and capacity development, desperately needed to close the barrier between disease and health.

Adapting operational research training to the Rwandan context: the Intermediate Operational Research Training programme

Background: Promoting national health research agendas in low- and middle-income countries (LMICs) requires adequate numbers of individuals with skills to initiate and conduct research. Recently, non-governmental organizations (NGOs) have joined research capacity building efforts to increase research leadership by LMIC nationals. Partners In Health, an international NGO operating in Rwanda, implemented its first Intermediate Operational Research Training (IORT) course to cultivate Rwandan research talent and generate evidence to improve health care delivery.

Objective: This paper describes the implementation of IORT to share experiences with other organizations interested in developing similar training programmes.

Methods: The Intermediate Operational Research Training utilized a deliverable-driven training model, using learning-by-doing pedagogy with intensive hands-on mentorship to build research skills from protocol development to scientific publication. The course had short (two-day) but frequent training sessions (seven sessions over eight months). Trainees were clinical and programme staff working at the district level who were paired to jointly lead a research project.

Results: Of 10 trainees admitted to the course from a pool of 24 applicants, nine trainees completed the course with five research projects published in peer-reviewed journals. Strengths of the course included supportive national and institutional research capacity guidelines, building from a successful training model, and trainee commitment. Challenges included delays in ethical review, high mentorship workload of up to 250 hours of practicum mentorship, lack of access to literature in subscription journals and high costs of open access publication.

Conclusions: The IORT course was an effective way to support the district-based government and NGO staff in gaining research skills, as well as answering research questions relevant to health service delivery at district hospitals. Other NGOs should build on successful programmes while adapting course elements to address context-specific challenges. Mentorship for LMIC trainees is critical for effectiveness of research capacity building initiatives.

Research capacity building integrated into PHIT projects: leveraging research and research funding to build national capacity

Background

Inadequate research capacity impedes the development of evidence-based health programming in sub-Saharan Africa. However, funding for research capacity building (RCB) is often insufficient and restricted, limiting institutions’ ability to address current RCB needs. The Doris Duke Charitable Foundation’s African Health Initiative (AHI) funded Population Health Implementation and Training (PHIT) partnership projects in five African countries (Ghana, Mozambique, Rwanda, Tanzania and Zambia) to implement health systems strengthening initiatives inclusive of RCB.

Methods

Using Cooke’s framework for RCB, RCB activity leaders from each country reported on RCB priorities, activities, program metrics, ongoing challenges and solutions. These were synthesized by the authorship team, identifying common challenges and lessons learned.

Results

For most countries, each of the RCB domains from Cooke’s framework was a high priority. In about half of the countries, domain specific activities happened prior to PHIT. During PHIT, specific RCB activities varied across countries. However, all five countries used AHI funding to improve research administrative support and infrastructure, implement research trainings and support mentorship activities and research dissemination. While outcomes data were not systematically collected, countries reported holding 54 research trainings, forming 56 mentor-mentee relationships, training 201 individuals and awarding 22 PhD and Masters-level scholarships. Over the 5 years, 116 manuscripts were developed. Of the 59 manuscripts published in peer-reviewed journals, 29 had national first authors and 18 had national senior authors. Trainees participated in 99 conferences and projects held 37 forums with policy makers to facilitate research translation into policy.

Conclusion

All five PHIT projects strongly reported an increase in RCB activities and commended the Doris Duke Charitable Foundation for prioritizing RCB, funding RCB at adequate levels and time frames and for allowing flexibility in funding so that each project could implement activities according to their trainees’ needs. As a result, many common challenges for RCB, such as adequate resources and local and international institutional support, were not identified as major challenges for these projects. Overall recommendations are for funders to provide adequate and flexible funding for RCB activities and for institutions to offer a spectrum of RCB activities to enable continued growth, provide adequate mentorship for trainees and systematically monitor RCB activities.

Electronic supplementary material

The online version of this article (10.1186/s12913-017-2657-6) contains supplementary material, which is available to authorized users.