Development and validation of the patient evaluation scale (PES) for primary health care in Nigeria

[Systematic review of the primary care quality assessment instruments used in the last 10 years]

OBJECTIVE

There are numerous instruments in the scientific literature for the evaluation of the quality of Primary Care (PC) and to know which of them are the most used and in which countries provides more information to make a well-founded decision. The aim is to determine which, between 2013 and 2023, have been the instruments used to assess the international quality of PC, its evolution and geographical distribution.

DESIGN

Systematic review.

DATA SOURCES

PubMed and Embase. From March to December 2023.

INCLUSION CRITERIA

1) Validation studies of specific assessment instruments to measure the quality of PC and/or the satisfaction of patients, providers or managers. 2) carried out in the field of PC and 3) published between 1/01/2013 and 01/02/2023. 83 full-text articles were included.

DATA EXTRACTION

From each publication, an instrument used to evaluate the quality of the PC, attributes of the PC it evaluates, recipient of the evaluation, user, provider or manager, year, and country.

RESULTS

Fifteen PC assessment instruments were found. The most widely used is the Primary Care Assessing Tool (PCAT), with wide geographical distribution, versions in several languages, is more limited in Europe, except in Spain, and is mostly used in the Primary Care Assessing Tool (PCAT).

CONCLUSIONS

The PCAT, due to its cultural adaptability, availability in several languages, its ability to evaluate the fundamental principles of PC enunciated by the World Health Organization and to contemplate the perspectives of all health agents, is a complete, versatile, and consistent questionnaire for the evaluation of the quality of PC.

Development and validation of primary health care quality assessment tool

BACKGROUND

Assessing the quality of health services gives insights to managers about the status of services delivered by them, especially from the client's perspective. Although various tools have been developed to measure the quality of primary health care (PHC), no specific tool was found in this field in Iran. Therefore, the present study was conducted to develop and validate the quality assessment tool of PHC in Iran.

METHODS

This methodological study was conducted in 2021. In the first step, based on a literature review, an initial questionnaire was designed, and its face validity, content validity, construct validity, and reliability were evaluated. Descriptive tests, Kolmogorov-Smirnov, exploratory factor analysis, Kaiser-Myer-Olkin (KMO), and Cronbach's alpha were performed by using SPSS 22.

RESULTS

The initial questionnaire included 33 items, of which three items were removed due to inconsistency with factorization. The final questionnaire consisted of 30 items and nine dimensions: interaction, efficiency, timeliness, accuracy, consultation, tangibility, safety, accessibility, and environment. The KMO and Cronbach's alpha index values were 0.734 and 0.82, respectively, indicating acceptable reliability and validity. The developed dimensions represented about 73% of the total variance.

CONCLUSION

The designed questionnaire has relatively good validity and reliability and can be used to measure the quality of PHC and to identify weaknesses in service delivery. However, researchers should carefully examine it to enhance its applicability as a standard tool for measuring PHC quality.

Patient safety attitudes of frontline healthcare workers in Lahore: A multicenter study

Objectives:

To evaluate patient safety attitudes of the frontline health workers in hospitals of Lahore, Pakistan.

Methods:

A self-administered Safety Attitudes Questionnaire (SAQ) survey was deployed in five hospitals across Lahore, Pakistan (July 2019 to June 2020). A total of 1250 consecutive consenting nurses and postgraduate trainee physicians of under five years working experience were recruited. Assessment for each of the six subdomains (teamwork climate, safety climate, job satisfaction, stress recognition, perception of management, working conditions) was done on a 0-100 scale. Multivariate analyses examined their relationship with job cadre (nurses and physicians), duration of respondents’ work experience (< 2 years, 3 - 4 years, > 4 years), and hospital sector (private and public).

Results:

The response rate was 97% (1212 individuals; 765 nurses, 447 physicians). Nurses scored less than physicians in teamwork climate (-2.4, 95% CI -4.5 – -0.2, p=0.02) and stress recognition (-10.6, 95% CI -13.5 – -7.7, p<0.001), but more in perception of management (4.2, 95% CI 1.5 – 6.8, p=0.002) and working conditions (3.4, 95% CI 0.66 – 6.2, p=0.01). Increasing work experience was related to greater scores in all subdomains. Private hospitals scored generally higher than public ones.

Conclusion:

Duration of job experience was positively correlated with patient safety attitudes of hospital staff. These finding could serve as the baseline to shape staff perceptions by cadre in both public and private sector hospitals.

The devil is in the detail: reflections on the value and application of cognitive interviewing to strengthen quantitative surveys in global health

Cognitive interviewing is a qualitative research method for improving the validity of quantitative surveys, which has been underused by academic researchers and monitoring and evaluation teams in global health. Draft survey questions are administered to participants drawn from the same population as the respondent group for the survey itself. The interviewer facilitates a detailed discussion with the participant to assess how the participant interpreted each question and how they formulated their response. Draft survey questions are revised and undergo additional rounds of cognitive interviewing until they achieve high comprehension and cognitive match between the research team's intent and the target population's interpretation. This methodology is particularly important in global health when surveys involve translation or are developed by researchers who differ from the population being surveyed in terms of socio-demographic characteristics, worldview, or other aspects of identity. Without cognitive interviewing, surveys risk measurement error by including questions that respondents find incomprehensible, that respondents are unable to accurately answer, or that respondents interpret in unintended ways. This methodological musing seeks to encourage a wider uptake of cognitive interviewing in global public health research, provide practical guidance on its application, and prompt discussion on its value and practice. To this end, we define cognitive interviewing, discuss how cognitive interviewing compares to other forms of survey tool development and validation, and present practical steps for its application. These steps cover defining the scope of cognitive interviews, selecting and training researchers to conduct cognitive interviews, sampling participants, collecting data, debriefing, analysing the emerging findings, and ultimately generating revised, validated survey questions. We close by presenting recommendations to ensure quality in cognitive interviewing.

Primary health care performance: a scoping review of the current state of measurement in Africa

INTRODUCTION

Countries with strong primary healthcare (PHC) report better health outcomes, fewer hospital admissions and lower expenditure. People-centred care that delivers essential elements of primary care (PC) leads to improved health outcomes and reduced costs and disparities. Such outcomes underscore the need for validated instruments that measure the extent to which essential, evidence-based features of PC are available and applied to users; and to ensure quality care and provider accountability.

METHODS

A systematic scoping review method was used to identify peer-reviewed African studies and grey literature on PC performance measurement. The service delivery dimension in the Primary Healthcare Performance Initiative conceptual framework was used to identify key measurable components of PC.

RESULTS

The review identified 19 African studies and reports that address measuring elements of PC performance. 13 studies included eight nationally validated performance measuring instruments. Of the eight, the South African and Malawian versions of Primary Care Assessment Tool measured service delivery comprehensively and involved PC user, provider and manager stakeholders.

CONCLUSION

40 years after Alma Ata and despite strong evidence for people-centred care, significant gaps remain regarding use of validated instruments to measure PC performance in Africa; few validated instruments have been used. Agreement on indicators, fit-for-purpose validated instruments and harmonising existing instruments is needed. Rigorous performance-based research is necessary to inform policy, resource allocation, practice and health worker training; and to ensure access to high quality care in a universal health coverage (UHC) system-research with potential to promote socially responsive, accountable PHC in the true spirit of the Alma Ata and Astana Declarations.