Development of a tool for assessing quality of comprehensive care provided by community health workers in a community-based care programme in South Africa

Community health workers' quality of comprehensive care: a cross-sectional observational study across three districts in South Africa

Background

Community healthcare worker (CHW) training programs are becoming increasingly comprehensive (an expanded range of diseases). However, the CHWs that the program relies on have limited training. Since CHWs' activities occur largely during household visits, which often go unsupervised and unassessed, long-term, ongoing assessment is needed to identify gaps in CHW competency, and improve any such gaps. We observed CHWs during household visits and gave scores according to the proportion of health messages/activities provided for the health conditions encountered in households. We aimed to determine (1) messages/activities scores derived from the proportion of health messages given in the households by CHWs who provide comprehensive care in South Africa, and (2) the associated factors.

Methods

In three districts (from two provinces), we trained five fieldworkers to score the messages provided by, and activities of, 34 CHWs that we randomly selected during 376 household visits in 2018 and 2020 using a cross-sectional study designs. Multilevel models were fitted to identify factors associated with the messages/activities scores, adjusted for the clustering of observations within CHWs. The models were adjusted for fieldworkers and study facilities (n = 5, respectively) as fixed effects. CHW-related (age, education level, and phase of CHW training attended/passed) and household-related factors (household size [number of persons per household], number of conditions per household, and number of persons with a condition [hypertension, diabetes, HIV, tuberculosis TB, and cough]) were investigated.

Results

In the final model, messages/activities scores increased with each extra 5-min increase in visit duration. Messages/activities scores were lower for households with either children/babies, hypertension, diabetes, a large household size, numerous household conditions, and members with either TB or cough. Increasing household size and number of conditions, also lower the score. The messages/activities scores were not associated with any CHW characteristics, including education and training.

Conclusion

This study identifies important factors related to the messages provided by and the activities of CHWs across CHW teams. Increasing efforts are needed to ensure that CHWs who provide comprehensive care are supported given the wider range of conditions for which they provide messages/activities, especially in households with hypertension, diabetes, TB/cough, and children or babies.

The effect of a roving nurse mentor on household coverage and quality of care provided by community health worker teams in South Africa: a longitudinal study with a before, after and 6 months post design

OBJECTIVE

Community health workers (CHW) are undertaking more complex tasks as part of the move towards universal health coverage in many low- and middle-income settings. They are expected to provide promotive and preventative care, make referrals to the local clinic, and follow up on non-attendees for a range of health conditions. CHW programmes can improve access to care for vulnerable communities, but many such programmes struggle due to inadequate supervision, low levels of CHW literacy, and the marginalized status of CHW in the health system. In this paper, we assess the effect of a roving nurse mentor on the coverage and quality of care of the CHW service in two vulnerable communities in South Africa.

PARTICIPANTS

CHW, their supervisors, household members.

INTERVENTION

Roving professional nurse mentor to build skills of supervisors and CHW teams.

METHODS

Three household surveys to assess household coverage of the CHW service (baseline, end of the intervention, and 6 months after end of intervention); structured observations of CHW working in households to assess quality of care.

RESULTS

The intervention led to a sustained 50% increase in the number of households visited by a CHW in the last year. While the proportion of appropriate health messages given to household members by CHW remained constant at approximately 50%, CHW performed a greater range of more complex tasks. They were more likely to visit new households to assess health needs and register the household in the programme, to provide care to pregnant women, children and people who had withdrawn from care. CHW were more likely to discuss with clients the barriers they were facing in accessing care and take notes during a visit.

CONCLUSION

A nurse mentor can have a significant effect both on the quantity and quality of CHW work, allowing them to achieve their potential despite their marginalised status in the health system and their limited prior educational achievement. Supportive supervision is important in enabling the benefit of having a health cadre embedded in marginalised communities to be realised.

Assessing the Utility of a Quality-of-Care Assessment Tool Used in Assessing Comprehensive Care Services Provided by Community Health Workers in South Africa

Background

Few studies exist on the tools for assessing quality-of-care of community health worker (CHW) who provide comprehensive care, and for available tools, evidence on the utility is scanty. We aimed to assess the utility components of a previously-reported quality-of-care assessment tool developed for summative assessment in South Africa.

Methods

In two provinces, we used ratings by 21 CHWs and three team leaders in two primary health care facilities per province regarding whether the tool covered everything that happens during their household visits and whether they were happy to be assessed using the tool (acceptability and face validity), to derive agreement index (≥85%, otherwise the tool had to be revised). A panel of six experts quantitatively validated 11 items of the tool (content validity). Content validity index (CVI), of individual items (I-CVI) or entire scale (S-CVI), should be >80% (excellent). For the inter-rater reliability (IRR), we determined agreement between paired observers' assigned quality-of-care messages and communication scores during 18 CHW household visits (nine households per site). Bland and Altman plots and multilevel model analysis, for clustered data, were used to assess IRR.

Results

In all four CHW and team leader sites, agreement index was ≥85%, except for whether they were happy to be assessed using the tool, where it was <85% in one facility. The I-CVI of the 11 items in the tool ranged between 0.83 and 1.00. For the S-CVI, all six experts agreed on relevancy (universal agreement) in eight of 11 items (0.72) whereas the average of I-CVIs, was 0.95. The Bland-Altman plot limit of agreements between paired observes were −0.18 to 0.44 and −0.30 to 0.44 (messages score); and −0.22 to 0.45 and −0.28 to 0.40 (communication score). Multilevel modeling revealed an estimated reliability of 0.77 (messages score) and 0.14 (communication score).

Conclusion

The quality-of-care assessment tool has a high face and content validity. IRR was substantial for quality-of-care messages but not for communication score. This suggests that the tool may only be useful in the formative assessment of CHWs. Such assessment can provide the basis for reflection and discussion on CHW performance and lead to change.

Supportive supervision from a roving nurse mentor in a community health worker programme: a process evaluation in South Africa

BACKGROUND

Many low and middle- income countries (LMICs) are repositioning community health worker (CHW) programmes to provide a more comprehensive range of promotive and preventive services and referrals to the formal health service. However, insufficient supervision, fragmented programmes, and the low literacy levels of CHWs often result in the under-performance of the programmes. We evaluate the impact of a roving nurse mentor working with CHW teams proving supportive supervision in a semi-rural area of South Africa.

METHODS

We conducted a longitudinal process evaluation, using in-depth interviews, focus groups and observations prior to the intervention, during the intervention, and 6 months post-intervention to assess how the effects of the intervention were generated and sustained. Our participants were CHWs, their supervisors, clients and facility staff members and community representatives.

RESULTS

The nurse mentor operated in an environment of resource shortages, conflicts between CHWs and facility staff, and an active CHW labour union. Over 15 months, the mentor was able to (1) support and train CHWs and their supervisors to gain and practice new skills, (2) address their fears of failing and (3) establish operational systems to address inefficiencies in the CHWs' activities, resulting in improved service provision. Towards the end of the intervention the direct employment of the CHWs by the Department of Health and an increase in their stipend added to their motivation and integration into the local primary care clinic team. However, given the communities' focus on accessing government housing, rather than better healthcare, and volatile nature of the communities, the nurse mentor was not able to establish a collaboration with local structures.

CONCLUSIONS

A roving nurse mentor overseeing several CHW teams within a district healthcare system is a feasible option, particularly in a context where there is a shortage of qualified supervisors to support CHWs activities. A roving nurse mentor can contribute to the knowledge and skills development of the CHWs and enhance the capacity of junior supervisors. However, the long-term sustainability of the effects of intervention is dependent on CHWs' formal employment by the Department of Health.

Community health workers at the dawn of a new era: 10. Programme performance and its assessment

BACKGROUND

While the evidence supporting the effectiveness of community health worker (CHW) programmes is substantial, there is also considerable evidence that many of these programmes have notable weaknesses that need to be addressed in order for them to reach their full potential. Thus, considerations about CHW programme performance and its assessment must be taken into account as the importance of these programmes is becoming more widely appreciated. In this paper, the tenth in our 11-paper series, "Community health workers at the dawn of a new era", we address CHW programme performance and how it is assessed from a systems perspective.

METHODS

The paper builds on the 2014 CHW Reference Guide, a compendium of case studies of 29 national CHW programmes, the 2018 WHO guideline on health policy and system support to optimize CHW programmes, and scientific studies on CHW programme performance published in the past 5 years.

RESULTS

The paper provides an overview of existing frameworks that are useful for assessing the performance of CHW programmes, with a specific focus on how individual CHW performance and community-level outcomes can be measured. The paper also reviews approaches that have been taken to assess CHW programme performance, from programme monitoring using the routine health information system to national assessments using quantitative and/or qualitative study designs and assessment checklists. The paper also discusses contextual factors that influence CHW programme performance, and reflects upon gaps and needs for the future with regard to assessment of CHW programme performance.

CONCLUSION

Assessments of CHW programme performance can have various approaches and foci according to the programme and its context. Given the fact that CHW programmes are complex entities and part of health systems, their assessment ideally needs to be based on data derived from a mix of reliable sources. Assessments should be focused not only on effectiveness (what works) but also on contextual factors and enablers (how, for whom, under what circumstances). Investment in performance assessment is instrumental for continually innovating, upgrading, and improving CHW programmes at scale. Now is the time for new efforts in implementation research for strengthening CHW programming.

Effect of multidimensional comprehensive intervention on medication compliance, social function and incidence of MACE in patients undergoing PCI

OBJECTIVE

To analyze the effect of multidimensional comprehensive intervention on medication compliance, social function and incidence of major adverse cardiovascular events (MACE) in patients undergoing percutaneous coronary intervention (PCI).

METHODS

Ninety-eight patients with coronary heart disease (CHD) who underwent PCI in our hospital were selected and divided into the regular group (n=46, receiving regular nursing intervention) and the comprehensive group (n=52, receiving multidimensional comprehensive nursing intervention) according to the different nursing intervention methods. The medication compliance, social function, quality of life, and incidence of MACE were compared between the two groups.

RESULTS

The comprehensive group showed significantly higher rates of taking medication on time, taking medication according to the proper amount, taking medication at the recomended times, no increase or decrease in the amount of medication, and taking medication without interruption than the regular group (P < 0.05). The comprehensive group exhibited significantly higher scores of medication compliance than the regular group (P < 0.05). The Social Disability Screening Schedule (SDSS) scores of both groups during intervention for 8 weeks were lower than those before intervention and after intervention for 2 and 4 weeks (P < 0.05). The SDSS scores of intervention for 2, 4, and 8 weeks in the comprehensive group were significantly lower than that in the regular group (P < 0.05). After intervention, the comprehensive group showed significantly higher scores of physiological function, psychological function, cognitive function, emotional function, role function, and total quality of life than the regular group (P < 0.05). The incidence of MACE in the comprehensive group was significantly lower than that in the regular group (P < 0.05).

CONCLUSION

The use of multidimensional comprehensive intervention for patients undergoing PCI can effectively improve patients' medication compliance, social function and quality of life, and reduce the incidence of MACE.

Community health workers' efforts to build health system trust in marginalised communities: a qualitative study from South Africa

INTRODUCTION

Community health workers (CHWs) enable marginalised communities, often experiencing structural poverty, to access healthcare. Trust, important in all patient-provider relationships, is difficult to build in such communities, particularly when stigma associated with HIV/AIDS, tuberculosis and now COVID-19, is widespread. CHWs, responsible for bringing people back into care, must repair trust. In South Africa, where a national CHW programme is being rolled out, marginalised communities have high levels of unemployment, domestic violence and injury.

OBJECTIVES

In this complex social environment, we explored CHW workplace trust, interpersonal trust between the patient and CHW, and the institutional trust patients place in the health system.

DESIGN, PARTICIPANTS, SETTING

Within the observation phase of a 3-year intervention study, we conducted interviews, focus groups and observations with patients, CHWs, their supervisors and, facility managers in Sedibeng.

RESULTS

CHWs had low levels of workplace trust. They had recently been on strike demanding better pay, employment conditions and recognition of their work. They did not have the equipment to perform their work safely, and some colleagues did not trust, or value, their contribution. There was considerable interpersonal trust between CHWs and patients, however, CHWs' efforts were hampered by structural poverty, alcohol abuse and no identification documents among long-term migrants. Those supervisors who understood the extent of the poverty supported CHW efforts to help the community. When patients had withdrawn from care, often due to nurses' insensitive behaviour, the CHWs' attempts to repair patients' institutional trust often failed due to the vulnerabilities of the community, and lack of support from the health system.

CONCLUSION

Strategies are needed to build workplace trust including supportive supervision for CHWs and better working conditions, and to build interpersonal and institutional trust by ensuring sensitivity to social inequalities and the effects of structural poverty among healthcare providers. Societies need to care for everyone.