The Client Empowerment in Community Health Systems Scale: Development and validation in three countries

Lessons From a Behavior Change Intervention to Improve Provider-Parent Partnerships and Care for Hospitalized Newborns and Young Children in Kenya

Enhancing respectful, responsive, integrative, and nurturing care for hospitalized newborns and young children (aged 0-24 months) is globally recognized but under-researched in low- and middle-income countries. Responsive, family-centered interventions target providers and parents and emphasize partnership in caring roles. From February 2020 to August 2021, we engaged in a participatory co-creation process with parents, providers, and newborn and child health stakeholders in Kenya to develop a comprehensive provider behavior change intervention and implemented it across 5 hospitals in Nairobi and Bungoma counties in Kenya. The multifaceted intervention included a 7-module orientation, feedback meetings, job aids, and psychosocial support-leveraging in-person and remote modalities-for providers working in newborn and pediatric units. We used a mixed-methods evaluation drawing on a pre-post provider survey, pre-post qualitative interviews with providers and parents, and a follow-up parental survey. There were significant post-intervention improvements in provider knowledge on safeguarding sleep, positioning and handling, and protecting skin. However, there were also significant reductions in providers' knowledge in identifying a child's pain, parental stress, and environmental stress. Among parents who received coaching from providers, there were higher levels of interpersonal communication between parent and provider, parental empowerment, and improved ability to provide integrated, responsive care to their child. Despite the challenges of implementing a provider-focused intervention to improve care for hospitalized newborns and young children during the global COVID-19 pandemic, we have demonstrated that it is feasible to implement a hybrid virtual and in-person process to influence several outcomes, including provider knowledge and practice, improved provider partnerships with parents, and parents' capacity to engage in the care of their newborn or young child.

Development and validation of the trust in my doctor, trust in doctors in general, and trust in the health care team scales

RATIONALE

Historic and present-day racism and inequity in the United States (U.S.) have resulted in diminished trust in health care among many populations. A key barrier to improving trust in health care is a dearth of well-validated measures appropriate for diverse populations. Indeed, systematic reviews indicate a need to develop and test updated trust measures that are multidimensional and inclusive of relevant domains (e.g., fairness).

OBJECTIVE

We developed three trust measures: the Trust in My Doctor (T-MD), Trust in Doctors in General (T-DiG), and Trust in the Health Care Team (T-HCT) scales.

METHODS

After developing an initial item pool, expert reviewers (n = 6) provided feedback on the face validity of each scale. We conducted cognitive interviews (n = 21) with a convenience sample of adults to ensure items were interpreted as intended. In 2020, we administered an online survey to a convenience sample of U.S. adults recruited through the Qualtrics Panel (n = 801) to assess scale reliability and validity.

RESULTS

Exploratory and confirmatory factor analyses indicated acceptable model fit for second order latent factor models for each scale (root mean square error of approximation: <0.07, comparative fit index: ≥0.98, and standardized root mean square residual: ≤0.03). The T-MD contained 25 items and six subscales: communication competency, fidelity, systems trust, confidentiality, fairness, and global trust. The T-DiG and T-HCT each contained 29 items and seven subscales (the same subscales in the T-MD plus an additional subscale related to stigma-based discrimination). Each scale was strongly correlated with existing trust measures and perceived racism in health care and was significantly associated with delayed health care seeking and receipt of a routine health exam.

CONCLUSIONS

The multidimensional T-MD, T-DiG, and T-HCT scales have sound psychometric properties and may be useful for researchers evaluating trust-related interventions or conducting studies where trust is an important construct or main outcome.

Development and validation of a multi-dimensional scale to assess community health worker motivation

BACKGROUND

Ensuring that Community Health Workers (CHWs) are motivated is critical to their performance, retention and well-being - and ultimately to the effectiveness of community health systems worldwide. While CHW motivation is as multi-dimensional construct, there is no multi-dimensional measure available to guide programming. In this study, we developed and validated a pragmatic, multi-dimensional measure of CHW motivation.

METHODS

Scale validation entailed qualitative and survey research in Mali and Bangladesh. We developed a pool of work satisfaction items as well as several items assessing the importance of hypothesized sub-dimensions of motivation, based on the literature and expert consultations. Qualitative research helped finalize scale sub-dimensions and items. We tested the scale in surveys with CHWs in Mali (n = 152, 40% female, mean age 32) and Bangladesh (n = 76 women, mean age 46). We applied a split-sample exploratory/confirmatory factor analysis (EFA/CFA) in Mali, and EFA in Bangladesh, then assessed reliability. We also gauged convergent/predictive validity, assessing associations between scale scores with conceptually related variables.

RESULTS

The final 22-item scale has four sub-dimensions: Quality of supervision, Feeling valued and capacitated in your work, Peer respect and support, and Compensation and workload. Model fit in CFAs was good, as were reliabilities for the full scale (alpha: 0.84 in Mali, 0.93 in Bangladesh) and all sub-dimensions. To construct scores for the final scale, we weighted the scores for each sub-dimension by CHW-reported importance of that sub-dimension. Final possible range was -6 to +6 (sub-dimensions), -24 to +24 (full scale). Mean (standard deviation) of full-scale scores were 5.0 (3.3) in Mali and 14.5 (5.3) in Bangladesh. In both countries, higher motivation was significantly associated with higher overall interest in their work, feeling able to improve health/well-being in their community, as well as indicators of higher performance and retention.

CONCLUSIONS

We found that the Multi-dimensional Motivation (MM) scale for CHWs is a valid and reliable measure that comprehensively assesses motivation. We recommend the scale be employed in future research around CHW performance and community health systems strengthening worldwide. The scale should be further evaluated within longitudinal studies assessing CHW performance and retention outcomes over time.

Measuring quality of care at the community level using the contraceptive method information index plus and client reported experience metrics in Bangladesh

BACKGROUND

Low rates of contraceptive continuation in Bangladesh are a symptom of poor quality family planning (FP) counseling. Improving family planning counseling by the country's community health care workers (CHWs) could improve contraceptive continuation. This study explores client experiences of care from CHWs, as measured by the method information index plus (MII+) and communication quality metric.

METHODS

Conducted in a peri-urban sub-district with low contraceptive use rates, this mixed methods study explores FP client experiences with community-based counseling and referrals by Family Welfare Assistants (FWAs), a CHW cadre providing FP services. Client- and patient-reported experience with community FP services was measured by the MII+ and communication quality metric. A quantitative post-service exit survey was coupled with observations of the interactions between 62 FWAs and 692 female clients to measure FWA and client FP knowledge, FWA capacities, attitudes, quality of FP communication, FP referrals, and contraceptive uptake.

RESULTS

Summary MII+ scores suggest that only 20% of clients reported adequate provision of information for informed decisions. Observations and self-reporting alike suggest moderate to high quality of communication during FWA and client interactions. Despite FWAs' theoretical knowledge of long-acting reversible and permanent FP methods, few clients were referred to facilities for them; 81% of clients who preferred a pill received it, while only 34% of clients seeking long-acting methods received needed referrals.

CONCLUSIONS

Quality community-based FP counseling could help address rising contraceptive discontinuation rates in Bangladesh. While MII and MII+ scores in this study were low, and FWA evinced numerous misconceptions, FWAs demonstrated strong communication skills that facilitate rapport and trust with their clients and communities. Bangladesh's policy and programs should capitalize upon these relationships and enhance CHWs' knowledge of all method types, and side effects management, with updated job aids, refresher training, and supervision.

Measuring client trust in community health workers: A multi-country validation study

BACKGROUND

Client trust in community health workers (CHWs) is integral for improving quality and equity of community health systems globally. Despite its recognized conceptual and pragmatic importance across health areas, there are no quantitative measures of trust in the context of community health services. In this multi-country study, we aimed to develop and validate a scale that assesses trust in CHWs.

METHODS

To develop the scale, we used a consultative process to conceptualize and adapt items and domains from prior literature to the CHW context. Content validity and comprehension of scale items were validated through 10 focus group discussions with 75 community members in Haiti, and Kenya. We then conducted 1939 surveys with clients who interacted with CHWs recently in Bangladesh (n = 1017), Haiti (n = 616), and Kenya (n = 306). To analyze the 15 candidate scale items we conducted a split sample exploratory/confirmatory factor analysis (EFA/CFA), and then assessed internal consistency reliability of resulting set of items. Finally, we assessed convergent validity via multivariable models examining associations between final scale scores with theoretically related constructs.

RESULTS

Factor analyses resulted in a 10-item Trust in CHWs Scale with two factors (sub-scales): Health care competence (5 items) and Respectful communication (5 items). The qualitative data also underscored these two sub-domains. The full scale had good internal consistency reliability in Bangladesh, Haiti and Kenya (alphas 0.87, 0.86, and 0.92, respectively; all alphas for subscales were also > 0.7, most > 0.8). Greater scores on Trust in CHWs were positively associated with increased client empowerment, familiarity with CHWs, satisfaction with recent client-CHW interaction, and positive influence of CHW on client empowerment. Scale scores were not influenced by the age, sex, parity, education, and wealth quintiles in across countries and may be affected by contextual factors.

CONCLUSIONS

The Trust in CHWs Scale, which includes Health care competence and Respectful communication sub-scales, is the first such scale developed and validated globally. Our findings suggest this 10-item scale is a reliable and valid tool for quantifying clients' trust in CHWs, with potential utility for tracking and improving CHW and health systems performance over time.