Comparing the use of direct observation, standardized patients and exit interviews in low- and middle-income countries: a systematic review of methods of assessing quality of primary care

Quality in screening and measuring blood pressure in China's primary health care: a national cross-sectional study using unannounced standardized patients

Background

This study aims to evaluate primary care providers' adherence to the standard of measuring blood pressure for people aged 35 or above during their initial visit, as per Chinese guidelines, and to identify factors affecting their practices.

Methods

We developed 11 standardized patients (SP) cases as tracer conditions to evaluate primary care, and deployed trained SPs for unannounced visits to randomly selected providers in seven provinces of China. The SPs used a checklist based on guidelines to record whether and how blood pressure was measured. Data were analyzed descriptively and regression analysis was performed to examine the association between outcomes and factors such as provider, patient, facility, and clinical case characteristics.

Findings

The SPs conducted 1201 visits and found that less than one-third of USPs ≥35 had their blood pressure measured. Only 26.9% of migraine and 15.4% of diabetes cases received blood pressure measurements. Additionally, these measurements did not follow the proper guidelines and recommended steps. On average, 55.6% of the steps were followed with few providers considering influencing factors before measurement and only 6.0% of patients received both-arm measurements. The use of wrist sphygmomanometers was associated with poor blood pressure measurement.

Interpretation

In China, primary care hypertension screening practices fall short of guidelines, with infrequent initiation of blood pressure measurements and inadequate adherence to proper measurement steps. To address this, priority should be placed on adopting, implementing, and upholding guidelines for hypertension screening and measurement.

Funding

National Natural Science Foundation of China, Swiss Agency for Development and Cooperation, Doctoral Fund Project of Inner Mongolia Medical University, China Postdoctoral Science Foundation.

Using the Simulated Patient Methodology in the Form of Mystery Calls in Community Pharmacy Practice Research: A Scoping Review Protocol

Community pharmacies (CPs) play a major role in health care delivery. The simulated patient methodology (SPM), which is considered the "gold standard", is recommended for studying CP practice. SPM can be applied in different forms, which include visits and also calls ("mystery calls"). So far, only the role of visits in the investigation of CP practice is known. As the first study worldwide, a systematic map of such reports will be provided, which applies calls in the context of the SPM for the study of CP practice. Reports with the pharmacy staff as the population under study should be included. Reports should be included that conduct an investigation using the SPM in the form of calls to simulate patients and other customers. Reports should be included that examine CP practice as defined by the International Pharmaceutical Federation and the World Health Organization (FIP/WHO). The scoping review methodology will be applied using the associated guidelines from Joanna Briggs Institute (JBI) and PRISMA extension for Scoping Review (PRISMA-ScR). The search will be for both published and unpublished original research in English with transparent information on SPM until the end of 2022. The plan is to search Embase, MEDLINE via PubMed, and Web of Science. Directly afterward, the respective literature collection of the reviewers and the reference lists of suitable international reviews will be searched. This will be followed by a forward and backward snowballing in Google Scholar. For the inclusion of reports, a selection process and for the data extraction a data charting process with the help of variables derived from related reviews and from two SPM-form spanning international guidelines will be performed. The data extracted from the included reports should be synthesized and presented in MS Excel tabular form using the previously determined variables.

Behind Closed Doors: A Thematic Analysis of Diabetes Community Health Worker Home Visit Content

The present work studies how community health workers (CHWs) perform the role of educator and how this relates to the implementation of other CHW roles, skills, and qualities. Prior studies on this topic have relied on interviews or focus groups rather than analysis of CHW interactions. We conducted a thematic analysis of 24 transcripts of conversations occurring between CHWs and participants during home visits as part of the Mexican American Trial of Community Health Workers, a randomized controlled trial that improved clinical outcomes among low-income Mexican American adults with type 2 diabetes. Three themes describing interactions related to diabetes self-management education accounted for about half of encounter content. The other half of encounter content was dedicated to interactions not explicitly related to diabetes described by 4 subthemes. In a successful CHW intervention, focused educational content was balanced with other interactions. Interactions not explicitly related to diabetes may have provided space for the implementation of core CHW roles, skills, and qualities other than educator, particularly those related to relationship building. It is important that interventions provide CHWs with sufficient time and flexibility to develop strong relationships with participants.

Investigating the relationship between consultation length and quality of tele-dermatology E-consults in China: a cross-sectional standardized patient study

Background

Consultation length, the time a health provider spend with the patient during a consultation, is a crucial aspect of patient-physician interaction. Prior studies that assessed the relationship between consultation length and quality of care were mainly based on offline visits. Research was lacking in E-consults settings, an emerging modality for primary health care. This study aims to examine the association between consultation length and the quality of E-consults services.

Methods

We defined as standardized patient script to present classic urticaria symptoms in asynchronous E-consults at tertiary public hospitals in Beijing and Hangzhou, China. We appraised consultation length using six indicators, time waiting for first response, time waiting for each response, time for consultation, total times of provider’s responses, total words of provider’s all responses, and average words of provider’s each response. We appraised E-consults services quality using five indicators building on China’s clinical guidelines (adherence to checklist; accurate diagnosis; appropriate prescription; providing lifestyle modification advice; and patient satisfaction). We performed ordinary least squares (OLS) regressions and logistic regressions to investigate the association between each indictor of consultation length and E-consults services quality.

Results

Providers who responded more quickly were more likely to provide lifestyle modification advice and achieve better patient satisfaction, without compromising process, diagnosis, and prescribing quality; Providers who spent more time with patients were likely to adhere to clinical checklists; Providers with more times and words of responses were significantly more likely to adhere to the clinical checklist, provide an accurate diagnosis, appropriate prescription, and lifestyle modification advice, which achieved better satisfaction rate from the patient as well.

Conclusions

The times and words that health providers provide in E-consult can serve as a proxy measure for quality of care. It is essential and urgent to establish rules to regulate the consultation length for Direct-to-consumer telemedicine to ensure adequate patient-provider interaction and improve service quality to promote digital health better.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08566-2.

Patient satisfaction and its health provider-related determinants in primary health facilities in rural China

Background

Patient satisfaction is an important outcome measure of health service and is one of the main reasons for the gradual deterioration of doctor–patient relationships in China. This study used the standardized patient (SP) method to explore patient satisfaction and its health provider-related determinants among primary health facilities in rural China.

Methods

The dataset comprised 1138 clinic cases in 728 rural primary health facilities in 31 counties, spread across four provinces. Information regarding the consultation interaction between the unannounced SPs and primary physicians was recorded. Patient satisfaction was gathered from the feedback of SPs after the visit.

Results

The overall average score of SP satisfaction with rural primary health facilities was only 13.65 (SD = 3.22) out of 20. The SP scores were found to be consistent with those of real patients. After controlling variances in patient population via the SP method, the regression analysis demonstrated that health provider-related factors, such as physician-level characteristics, consultation process, affordability, and convenience, have a significant correlation with patient satisfaction among primary physicians. Among factors relating to physician-level characteristics, affordability, convenience and the consultation process of the visit, the quality of the consultation process (e.g., consultation time, proactively providing necessary instructions and other crucial information) were found to be the prominent determinants.

Conclusions

This study revealed the need to improve patient satisfaction in primary health facilities in rural China. To solve this issue, we recommend that policies to increase medical service quality be implemented in rural primary healthcare systems.

Supplementary Information

The online version contains supplementary material available at 10.1186/s12913-022-08349-9.

Improving Data Surveillance Resilience Beyond COVID-19: Experiences of Primary heAlth Care quAlity Cohort In ChinA (ACACIA) Using Unannounced Standardized Patients

We analyzed COVID-19 influences on the design, implementation, and validity of assessing the quality of primary health care using unannounced standardized patients (USPs) in China. Because of the pandemic, we crowdsourced our funding, removed tuberculosis from the USP case roster, adjusted common cold and asthma cases, used hybrid online-offline training for USPs, shared USPs across provinces, and strengthened ethical considerations. With those changes, we were able to conduct fieldwork despite frequent COVID-19 interruptions. Furthermore, the USP assessment tool maintained high validity in the quality checklist (criteria), USP role fidelity, checklist completion, and physician detection of USPs. Our experiences suggest that the pandemic created not only barriers but also opportunities to innovate ways to build a resilient data collection system. To build data system reliance, we recommend harnessing the power of technology for a hybrid model of remote and in-person work, learning from the sharing economy to pool strengths and optimize resources, and dedicating individual and group leadership to problem-solving and results. (Am J Public Health. 2022;112(6):913-922. https://doi.org/10.2105/AJPH.2022.306779).

Do private providers give patients what they demand, even if it is inappropriate? A randomised study using unannounced standardised patients in Kenya

INTRODUCTION

Low and varied quality of care has been demonstrated for childhood illnesses in low-income and middle-income countries. Some quality improvement strategies focus on increasing patient engagement; however, evidence suggests that patients demanding medicines can favour the selection of resistant microbial strains in the individual and the community if drugs are inappropriately used. This study examines the effects on quality of care when patients demand different types of inappropriate medicines.

METHODS

We conducted an experiment where unannounced standardised patients (SPs), locally recruited individuals trained to simulate a standardised case, present at private clinics. Between 8 March and 28 May 2019, 10 SPs portraying caretakers of a watery diarrhoea childhood case scenario (in absentia) conducted N=200 visits at 200 private, primary care clinics in Kenya. Half of the clinics were randomly assigned to receive an SP demanding amoxicillin (an antibiotic); the other half, an SP demanding albendazole (an antiparasitic drug often used for deworming), with other presenting characteristics the same. We used logistic and linear regression models to assess the effects of demanding these inappropriate medicines on correct and unnecessary case management outcomes.

RESULTS

Compared with 3% among those who did not demand albendazole, the dispensing rate increased significantly to 34% for those who did (adjusted OR 0.06, 95% CI 0.02 to 0.22, p<0.0001). Providers did not give different levels of amoxicillin between those demanding it and those not demanding it (adjusted OR 1.73, 95% CI 0.51 to 5.82). Neither significantly changed any correct management outcomes, such as treatment or referral elsewhere.

CONCLUSION

Private providers appear to account for both business-driven benefits and individual health impacts when making prescribing decisions. Additional research is needed on provider knowledge and perceptions of profit and individual and community health trade-offs when making prescription decisions after patients demand different types of inappropriate medicines.

TRIAL REGISTRATION NUMBERS

American Economic Association Registry (#AEARCTR-0000217) and Pan African Clinical Trial Registry (#PACTR201502000770329).

Characteristics and Injury Patterns of Road Traffic Injuries in Urban and Rural Uganda-A Retrospective Medical Record Review Study in Two Hospitals

In the ongoing Second Decade of Action for Road Safety, road traffic crashes pose a considerable threat especially in low-income countries. Uganda shows a vast burden of non-fatal injuries and resides at the top range of countries with the highest death rates due to unsafe roads. However, little is known about the differences in road traffic associated injuries between urban and rural areas and potential influence factors. Here, we used a cross-sectional study conducted by a retrospective medical record review from trauma cases admitted in 2016 to hospitals in rural and urban areas in Uganda. Injury severity scores were calculated and descriptive analysis was carried out while multivariate logistic regression was applied to assess significant covariates. According to the 1683 medical records reviewed, the mean age of trauma patients in the dataset under investigation was 30.8 years with 74% male. The trauma in-hospital mortality was 4% while prevalence of traumatic injuries is 56.4%. Motorcycle users (49.6%) and pedestrians (33.7%) were identified as the most vulnerable groups in both urban and rural setting while mild injuries of extremities (61.6%) and the head/neck-region (42.0%) were registered most. The frequency of road traffic injuries was homogenous in the urban and rural hospitals investigated in this study; interventions should therefore be intensified ubiquitously. The identification of significant differences in road traffic crash and injury characteristics provides the opportunity for specific programmes to decrease the socio-economic and health burden of unsafe roads. In addition to law enforcement and introduction of a Systems Thinking approach to road safety including infrastructural and educational concepts, the strengthening of trauma care and health resources is recommended.

Development of a video-observation method for examining doctors' clinical and interpersonal skills in a hospital outpatient clinic in Ibadan, Oyo State, Nigeria

BACKGROUND

Improving the quality of primary healthcare provision is a key goal in low-and middle-income countries (LMICs). However, to develop effective quality improvement interventions, we first need to be able to accurately measure the quality of care. The methods most commonly used to measure the technical quality of care all have some key limitations in LMICs settings. Video-observation is appealing but has not yet been used in this context. We examine preliminary feasibility and acceptability of video-observation for assessing physician quality in a hospital outpatients' department in Nigeria. We also develop measurement procedures and examine measurement characteristics.

METHODS

Cross-sectional study at a large tertiary care hospital in Ibadan, Nigeria. Consecutive physician-patient consultations with adults and children under five seeking outpatient care were video-recorded. We also conducted brief interviews with participating physicians to gain feedback on our approach. Video-recordings were double-coded by two medically trained researchers, independent of the study team and each other, using an explicit checklist of key processes of care that we developed, from which we derived a process quality score. We also elicited a global quality rating from reviewers.

RESULTS

We analysed 142 physician-patient consultations. The median process score given by both coders was 100 %. The modal overall rating category was 'above standard' (or 4 on a scale of 1-5). Coders agreed on which rating to assign only 44 % of the time (weighted Cohen's kappa = 0.26). We found in three-level hierarchical modelling that the majority of variance in process scores was explained by coder disagreement. A very high correlation of 0.90 was found between the global quality rating and process quality score across all encounters. Participating physicians liked our approach, despite initial reservations about being observed.

CONCLUSIONS

Video-observation is feasible and acceptable in this setting, and the quality of consultations was high. However, we found that rater agreement is low but comparable to other modalities that involve expert clinician judgements about quality of care including in-person direct observation and case note review. We suggest ways to improve scoring consistency including careful rater selection and improved design of the measurement procedure for the process score.