The know-do gap in quality of health care for childhood diarrhea and pneumonia in rural India

A systematic tale of two differing reviews: evaluating the evidence on public and private sector quality of primary care in low and middle income countries

Systematic reviews are powerful tools for summarizing vast amounts of data in controversial areas; but their utility is limited by methodological choices and assumptions. Two systematic reviews of literature on the quality of private sector primary care in low and middle income countries (LMIC), published in the same journal within a year, reached conflicting conclusions. The difference in findings reflects different review methodologies, but more importantly, a weak underlying body of literature. A detailed examination of the literature cited in both reviews shows that only one of the underlying studies met the gold standard for methodological robustness. Given the current policy momentum on universal health coverage and primary health care reform across the globe, there is an urgent need for high quality empirical evidence on the quality of private versus public sector primary health care in LMIC.

Strategies for Optimal Implementation of Simulated Clients for Measuring Quality of Care in Low- and Middle-Income Countries

When properly implemented, use of simulated clients (“mystery clients”) can provide insight into actual experiences of real clients and evaluate quality of care. Successful implementation calls for recruiting mystery clients who represent the facility's clientele, have strong recall of recent events, and are comfortable being undercover data collectors. Developing training protocols and checklists to standardize mystery client behavior and responses is also key.

The use of simulated clients or “mystery clients” is a data collection approach in which a study team member presents at a health care facility or outlet pretending to be a real customer, patient, or client. Following the visit, the shopper records her observations. The use of mystery clients can overcome challenges of obtaining accurate measures of health care quality and improve the validity of quality assessments, particularly in low- and middle-income countries. However, mystery client studies should be carefully designed and monitored to avoid problems inherent to this data collection approach. In this article, we discuss our experiences with the mystery client methodology in studies conducted in public- and private-sector health facilities in Kenya and in private-sector facilities in Uganda. We identify both the benefits and the challenges in using this methodology to guide other researchers interested in using this technique. Recruitment of appropriate mystery clients who accurately represent the facility's clientele, have strong recall of recent events, and are comfortable in their role as undercover data collectors are key to successful implementation of this methodology. Additionally, developing detailed training protocols can help ensure mystery clients behave identically and mimic real patrons accurately while short checklists can help ensure mystery client responses are standardized. Strict confidentiality and protocols to avoid unnecessary exams or procedures should also be stressed during training and monitored carefully throughout the study. Despite these challenges, researchers should consider mystery client designs to measure actual provider behavior and to supplement self-reported provider behavior. Data from mystery client studies can provide critical insight into the quality of service provision unavailable from other data collection methods. The unique information available from the mystery client approach far outweighs the cost.

Evaluation of a social franchising and telemedicine programme and the care provided for childhood diarrhoea and pneumonia, Bihar, India

Objective

To evaluate the impact on the quality of the care provided for childhood diarrhoea and pneumonia in Bihar, India, of a large-scale, social franchising and telemedicine programme – the World Health Partners’ Sky Program.

Methods

We investigated changes associated with the programme in the knowledge and performance of health-care providers by carrying out 810 assessments in a representative sample of providers in areas where the programme was and was not implemented. Providers were assessed using hypothetical patient vignettes and the standardized patient method both before and after programme implementation, in 2011 and 2014, respectively. Differences in providers’ performance between implementation and nonimplementation areas were assessed using multivariate difference-in-difference linear regression models.

Findings

The programme did not significantly improve health-care providers’ knowledge or performance with regard to childhood diarrhoea or pneumonia in Bihar. There was a persistent large gap between knowledge of appropriate care and the care actually delivered.

Conclusion

Social franchising has received attention globally as a model for delivering high-quality care in rural areas in the developing world but supporting data are scarce. Our findings emphasize the need for sound empirical evidence before social franchising programmes are scaled up.

Enhancing quality of medical care in low income and middle income countries through simulation-based initiatives: recommendations of the Simnovate Global Health Domain Group

Background

Quality of medical care in low income and middle income countries (LMICs) is variable, resulting in significant medical errors and adverse patient outcomes. Integration of simulation-based training and assessment may be considered to enhance quality of patient care in LMICs. The aim of this study was to consider the role of simulation in LMICs, to directly impact health professions education, measurement and assessment.

Methods

The Simnovate Global Health Domain Group undertook three teleconferences and a direct face-to-face meeting. A scoping review of published studies using simulation in LMICs was performed and, in addition, a detailed survey was sent to the World Directory of Medical Schools and selected known simulation centres in LMICs.

Results

Studies in LMICs employed low-tech manikins, standardised patients and procedural simulation methods. Low-technology manikins were the majority simulation method used in medical education (42%), and focused on knowledge and skills outcomes. Compared to HICs, the majority of studies evaluated baseline adherence to guidelines rather than focusing on improving medical knowledge through educational intervention. There were 46 respondents from the survey, representing 21 countries and 28 simulation centres. Within the 28 simulation centres, teachers and trainees were from across all healthcare professions.

Discussion

Broad use of simulation is low in LMICs, and the full potential of simulation-based interventions for improved quality of care has yet to be realised. The use of simulation in LMICs could be a potentially untapped area that, if increased and/or improved, could positively impact patient safety and the quality of care.

Quality of tuberculosis care in high burden countries: the urgent need to address gaps in the care cascade

Despite the high coverage of directly observed treatment short-course (DOTS), tuberculosis (TB) continues to affect 10.4 million people each year, and kills 1.8 million. High TB mortality, the large number of missing TB cases, the emergence of severe forms of drug resistance, and the slow decline in TB incidence indicate that merely expanding the coverage of TB services is insufficient to end the epidemic. In the era of the End TB Strategy, we need to think beyond coverage and start focusing on the quality of TB care that is routinely offered to patients in high burden countries, in both public and private sectors. In this review, current evidence on the quality of TB care in high burden countries, major gaps in the quality of care, and some novel efforts to measure and improve the quality of care are described. Based on systematic reviews on the quality of TB care or surrogates of quality (e.g., TB diagnostic delays), analyses of TB care cascades, and newer studies that directly measure quality of care, it is shown that the quality of care in both the public and private sector falls short of international standards and urgently needs improvement. National TB programs will therefore need to systematically measure and improve quality of TB care and invest in quality improvement programs.

Providers' knowledge of diagnosis and treatment of tuberculosis using vignettes: evidence from rural Bihar, India

Background

Almost 25% of all new cases of tuberculosis (TB) worldwide are in India, where drug resistance and low quality of care remain key challenges.

Methods

We conducted an observational, cross-sectional study of healthcare providers' knowledge of diagnosis and treatment of TB in rural Bihar, India, from June to September 2012. Using data from vignette-based interviews with 395 most commonly visited healthcare providers in study areas, we scored providers' knowledge and used multivariable regression models to examine their relationship to providers' characteristics.

Findings

80% of 395 providers had no formal medical qualifications. Overall, providers demonstrated low levels of knowledge: 64.9% (95% CI 59.8% to 69.8%) diagnosed correctly, and 21.7% (CI 16.8% to 27.1%) recommended correct treatment. Providers seldom asked diagnostic questions such as fever (31.4%, CI 26.8% to 36.2%) and bloody sputum (11.1%, CI 8.2% to 14.7%), or results from sputum microscopy (20.0%, CI: 16.2% to 24.3%). After controlling for whether providers treat TB, MBBS providers were not significantly different, from unqualified providers or those with alternative medical qualifications, on knowledge score or offering correct treatment. MBBS providers were, however, more likely to recommend referrals relative to complementary medicine and unqualified providers (23.2 and 37.7 percentage points, respectively).

Interpretation

Healthcare providers in rural areas in Bihar, India, have low levels of knowledge regarding TB diagnosis and treatment. Our findings highlight the need for policies to improve training, incentives, task shifting and regulation to improve knowledge and performance of existing providers. Further, more research is needed on the incentives providers face and the role of information on quality to help patients select providers who offer higher quality care.

Use of antibiotics in children younger than two years in eight countries: a prospective cohort study

OBJECTIVE

To describe the frequency and factors associated with antibiotic use in early childhood, and estimate the proportion of diarrhoea and respiratory illnesses episodes treated with antibiotics.

METHODS

Between 2009 and 2014, we followed 2134 children from eight sites in Bangladesh, Brazil, India, Nepal, Pakistan, Peru, South Africa and the United Republic of Tanzania, enrolled in the MAL-ED birth cohort study. We documented all antibiotic use from mothers' reports at twice-weekly visits over the children's first two years of life. We estimated the incidence of antibiotic use and the associations of antibiotic use with child and household characteristics. We described treatment patterns for diarrhoea and respiratory illnesses, and identified factors associated with treatment and antibiotic class.

FINDINGS

Over 1 346 388 total days of observation, 16 913 courses of antibiotics were recorded (an incidence of 4.9 courses per child per year), with the highest use in South Asia. Antibiotic treatment was given for 375/499 (75.2%) episodes of bloody diarrhoea and for 4274/9661 (44.2%) episodes of diarrhoea without bloody stools. Antibiotics were used in 2384/3943 (60.5%) episodes of fieldworker-confirmed acute lower respiratory tract illness as well as in 6608/16742 (39.5%) episodes of upper respiratory illness. Penicillins were used most frequently for respiratory illness, while antibiotic classes for diarrhoea treatment varied within and between sites.

CONCLUSION

Repeated antibiotic exposure was common early in life, and treatment of non-bloody diarrhoea and non-specific respiratory illnesses was not consistent with international recommendations. Rational antibiotic use programmes may have the most impact in South Asia, where antibiotic use was highest.

Beyond too little, too late and too much, too soon: a pathway towards evidence-based, respectful maternity care worldwide

On the continuum of maternal health care, two extreme situations exist: too little, too late (TLTL) and too much, too soon (TMTS). TLTL describes care with inadequate resources, below evidence-based standards, or care withheld or unavailable until too late to help. TLTL is an underlying problem associated with high maternal mortality and morbidity. TMTS describes the routine over-medicalisation of normal pregnancy and birth. TMTS includes unnecessary use of non-evidence-based interventions, as well as use of interventions that can be life saving when used appropriately, but harmful when applied routinely or overused. As facility births increase, so does the recognition that TMTS causes harm and increases health costs, and often concentrates disrespect and abuse. Although TMTS is typically ascribed to high-income countries and TLTL to low-income and middle-income ones, social and health inequities mean these extremes coexist in many countries. A global approach to quality and equitable maternal health, supporting the implementation of respectful, evidence-based care for all, is urgently needed. We present a systematic review of evidence-based clinical practice guidelines for routine antenatal, intrapartum, and postnatal care, categorising them as recommended, recommended only for clinical indications, and not recommended. We also present prevalence data from middle-income countries for specific clinical practices, which demonstrate TLTL and increasing TMTS. Health-care providers and health systems need to ensure that all women receive high-quality, evidence-based, equitable and respectful care. The right amount of care needs to be offered at the right time, and delivered in a manner that respects, protects, and promotes human rights.

What tuberculosis can teach us about combating multidrug-resistant Gram negative bacilli

There are striking similarities between the dual pandemics of multidrug-resistant tuberculosis (MDR TB) and multidrug-resistant Gram negative bacilli (MDR GNB) despite fundamental differences in the pathogenesis and epidemiology of these pathogens. In this perspective, we highlight several strategies that have been used by the global TB community to address the MDR TB problem, including approaches to: encourage appropriate use of anti-TB medications, enhance appropriate utilization of molecular diagnostic testing, facilitate development of new antimicrobial agents, and strengthen surveillance systems and infection control practices. Understanding the successes and challenges of these strategies for MDR TB control will be instructive for efforts to curb emergence and spread of MDR GNB.

Management of childhood diarrhea among private providers in Uttar Pradesh, India

Background

In Uttar Pradesh (UP), India, a new initiative to introduce zinc and reinvigorate ORS for diarrhea treatment in the public and private sectors was rolled out in selected districts. We conducted an external evaluation of the program that included assessing the knowledge and practices of private sector providers 6 months after the initial program rollout.

Methods

We conducted interviews and direct observations among a randomly selected group of formal and informal private sector providers in 12 districts of UP. We calculated summary statistics for reported provider characteristics, diarrhea treatment knowledge and preferred treatments, as well as the treatments advised during consultation with a child with diarrhea.

Results

We interviewed 232 providers, of whom 67% reported receiving a diarrhea treatment training/drug detailing visit. In the interview, 14% of providers reported prescribing zinc to all children with diarrhea and 36% reported prescribing zinc to more than half of diarrhea cases. During direct observation, ORS and zinc were prescribed by 77.3% and 29.9% of providers, respectively. Treatments other than zinc and ORS were also commonly prescribed, including antibiotics (61.9%) and antidiarrheals (17.5%).

Conclusion

Adequate treatment of childhood diarrhea with zinc and ORS remains a challenge among private sector providers in rural UP, India. Additional training and knowledge transfer activities are needed to curb the overprescription of antibiotics and antidiarrheals and to increase the confidence of private providers in advising zinc and ORS. In addition, policymakers and program implementers must ensure collaborative efforts to target and meaningfully engage informal private providers who play a major role in childhood diarrhea treatment in hard–to–reach areas.

Use of standardised patients to assess quality of tuberculosis care: a pilot, cross-sectional study

BACKGROUND

Existing studies of the quality of tuberculosis care have relied on recall-based patient surveys, questionnaire surveys of knowledge, and prescription or medical record analysis, and the results mostly show the health-care provider's knowledge rather than actual practice. No study has used standardised patients to assess clinical practice. Therefore we aimed to assess quality of care for tuberculosis using such patients.

METHODS

We did a pilot, cross-sectional validation study of a convenience sample of consenting private health-care providers in low-income and middle-income areas of Delhi, India. We recruited standardised patients in apparently good health from the local community to present four cases (two of presumed tuberculosis and one each of confirmed tuberculosis and suspected multidrug-resistant tuberculosis) to a randomly allocated health-care provider. The key objective was to validate the standardised-patient method using three criteria: negligible risk and ability to avoid adverse events for providers and standardised patients, low detection rates of standardised patients by providers, and data accuracy across standardised patients and audio verification of standardised-patient recall. We also used medical vignettes to assess providers' knowledge of presumed tuberculosis. Correct case management was benchmarked using Standards for Tuberculosis Care in India (STCI).

FINDINGS

Between Feb 2, and March 28, 2014, we recruited and trained 17 standardised patients who had 250 interactions with 100 health-care providers, 29 of whom were qualified in allopathic medicine (ie, they had a Bachelor of Medicine & Surgery [MBBS] degree), 40 of whom practised alternative medicine, and 31 of whom were informal health-care providers with few or no qualifications. The interactions took place between April 1, and April 23, 2014. The proportion of detected standardised patients was low (11 [5%] detected out of 232 interactions among providers who completed the follow-up survey), and standardised patients' recall correlated highly with audio recordings (r=0·63 [95% CI 0·53-0·79]), with no safety concerns reported. The mean consultation length was 6 min (95% CI 5·5-6·6) with a mean of 6·18 (5·72-6·64) questions or examinations completed, representing 35% (33-38) of essential checklist items. Across all cases, only 52 (21% [16-26]) of 250 were correctly managed. Correct management was higher among MBBS-qualified doctors than other types of health-care provider (adjusted odds ratio 2·41 [95% CI 1·17-4·93]; p=0·0166). Of the 69 providers who completed the vignette, knowledge in the vignettes was more consistent with STCI than their actual clinical practice-eg, 50 (73%) ordered a chest radiograph or sputum test during the vignette compared with seven (10%) during the standardised-patient interaction; OR 0·04 (95% CI 0·02-0·11); p<0·0001.

INTERPRETATION

Standardised patients can be successfully implemented to assess tuberculosis care. Our data suggest a big gap between private provider knowledge and practice. Additional work is needed to substantiate our pilot data, understand the know-do gap in provider behaviour, and to identify the best approach to measure and improve the quality of tuberculosis care in India.

FUNDING

Grand Challenges Canada, the Bill & Melinda Gates Foundation, Knowledge for Change Program, and the World Bank Development Research Group.